00:00:00.001 Started by upstream project "autotest-nightly-lts" build number 1715 00:00:00.001 originally caused by: 00:00:00.002 Started by upstream project "nightly-trigger" build number 2976 00:00:00.002 originally caused by: 00:00:00.002 Started by timer 00:00:00.084 Checking out git https://review.spdk.io/gerrit/a/build_pool/jenkins_build_pool into /var/jenkins_home/workspace/nvmf-tcp-phy-autotest_script/33b20b30f0a51e6b52980845e0f6aa336787973ad45e341fbbf98d1b65b265d4 to read jbp/jenkins/jjb-config/jobs/autotest-downstream/autotest-phy.groovy 00:00:00.084 The recommended git tool is: git 00:00:00.084 using credential 00000000-0000-0000-0000-000000000002 00:00:00.086 > git rev-parse --resolve-git-dir /var/jenkins_home/workspace/nvmf-tcp-phy-autotest_script/33b20b30f0a51e6b52980845e0f6aa336787973ad45e341fbbf98d1b65b265d4/jbp/.git # timeout=10 00:00:00.122 Fetching changes from the remote Git repository 00:00:00.123 > git config remote.origin.url https://review.spdk.io/gerrit/a/build_pool/jenkins_build_pool # timeout=10 00:00:00.181 Using shallow fetch with depth 1 00:00:00.181 Fetching upstream changes from https://review.spdk.io/gerrit/a/build_pool/jenkins_build_pool 00:00:00.181 > git --version # timeout=10 00:00:00.222 > git --version # 'git version 2.39.2' 00:00:00.222 using GIT_ASKPASS to set credentials SPDKCI HTTPS Credentials 00:00:00.223 Setting http proxy: proxy-dmz.intel.com:911 00:00:00.223 > git fetch --tags --force --progress --depth=1 -- https://review.spdk.io/gerrit/a/build_pool/jenkins_build_pool refs/heads/master # timeout=5 00:00:06.430 > git rev-parse origin/FETCH_HEAD^{commit} # timeout=10 00:00:06.439 > git rev-parse FETCH_HEAD^{commit} # timeout=10 00:00:06.448 Checking out Revision d55dd09e9e6d4661df5d1073790609767cbcb60c (FETCH_HEAD) 00:00:06.448 > git config core.sparsecheckout # timeout=10 00:00:06.458 > git read-tree -mu HEAD # timeout=10 00:00:06.472 > git checkout -f d55dd09e9e6d4661df5d1073790609767cbcb60c # timeout=5 00:00:06.495 Commit message: "ansible/roles/custom_facts: Add subsystem info to VMDs' nvmes" 00:00:06.495 > git rev-list --no-walk d55dd09e9e6d4661df5d1073790609767cbcb60c # timeout=10 00:00:06.572 [Pipeline] Start of Pipeline 00:00:06.587 [Pipeline] library 00:00:06.589 Loading library shm_lib@master 00:00:06.589 Library shm_lib@master is cached. Copying from home. 00:00:06.601 [Pipeline] node 00:00:06.610 Running on GP11 in /var/jenkins/workspace/nvmf-tcp-phy-autotest 00:00:06.612 [Pipeline] { 00:00:06.621 [Pipeline] catchError 00:00:06.623 [Pipeline] { 00:00:06.636 [Pipeline] wrap 00:00:06.645 [Pipeline] { 00:00:06.654 [Pipeline] stage 00:00:06.656 [Pipeline] { (Prologue) 00:00:06.823 [Pipeline] sh 00:00:07.115 + logger -p user.info -t JENKINS-CI 00:00:07.136 [Pipeline] echo 00:00:07.138 Node: GP11 00:00:07.147 [Pipeline] sh 00:00:07.456 [Pipeline] setCustomBuildProperty 00:00:07.468 [Pipeline] echo 00:00:07.469 Cleanup processes 00:00:07.473 [Pipeline] sh 00:00:07.755 + sudo pgrep -af /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:00:07.755 78294 sudo pgrep -af /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:00:07.766 [Pipeline] sh 00:00:08.046 ++ sudo pgrep -af /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:00:08.047 ++ grep -v 'sudo pgrep' 00:00:08.047 ++ awk '{print $1}' 00:00:08.047 + sudo kill -9 00:00:08.047 + true 00:00:08.063 [Pipeline] cleanWs 00:00:08.076 [WS-CLEANUP] Deleting project workspace... 00:00:08.076 [WS-CLEANUP] Deferred wipeout is used... 00:00:08.082 [WS-CLEANUP] done 00:00:08.086 [Pipeline] setCustomBuildProperty 00:00:08.100 [Pipeline] sh 00:00:08.387 + sudo git config --global --replace-all safe.directory '*' 00:00:08.459 [Pipeline] nodesByLabel 00:00:08.461 Found a total of 1 nodes with the 'sorcerer' label 00:00:08.470 [Pipeline] httpRequest 00:00:08.475 HttpMethod: GET 00:00:08.476 URL: http://10.211.164.101/packages/jbp_d55dd09e9e6d4661df5d1073790609767cbcb60c.tar.gz 00:00:08.484 Sending request to url: http://10.211.164.101/packages/jbp_d55dd09e9e6d4661df5d1073790609767cbcb60c.tar.gz 00:00:08.511 Response Code: HTTP/1.1 200 OK 00:00:08.512 Success: Status code 200 is in the accepted range: 200,404 00:00:08.512 Saving response body to /var/jenkins/workspace/nvmf-tcp-phy-autotest/jbp_d55dd09e9e6d4661df5d1073790609767cbcb60c.tar.gz 00:00:27.435 [Pipeline] sh 00:00:27.724 + tar --no-same-owner -xf jbp_d55dd09e9e6d4661df5d1073790609767cbcb60c.tar.gz 00:00:27.745 [Pipeline] httpRequest 00:00:27.750 HttpMethod: GET 00:00:27.751 URL: http://10.211.164.101/packages/spdk_4b134b4abdb5f2f6eeebb3eae1bf496dfaad149f.tar.gz 00:00:27.752 Sending request to url: http://10.211.164.101/packages/spdk_4b134b4abdb5f2f6eeebb3eae1bf496dfaad149f.tar.gz 00:00:27.765 Response Code: HTTP/1.1 200 OK 00:00:27.765 Success: Status code 200 is in the accepted range: 200,404 00:00:27.766 Saving response body to /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk_4b134b4abdb5f2f6eeebb3eae1bf496dfaad149f.tar.gz 00:00:45.295 [Pipeline] sh 00:00:45.582 + tar --no-same-owner -xf spdk_4b134b4abdb5f2f6eeebb3eae1bf496dfaad149f.tar.gz 00:00:48.129 [Pipeline] sh 00:00:48.416 + git -C spdk log --oneline -n5 00:00:48.416 4b134b4ab bdev/nvme: Delay callbacks when the next operation is a failover 00:00:48.416 d2ea4ecb1 llvm/vfio: Suppress checking leaks for `spdk_nvme_ctrlr_alloc_io_qpair` 00:00:48.416 3b33f4333 test/nvme/cuse: Fix typo 00:00:48.416 bf784f7a1 test/nvme: Set SEL only when the field is supported 00:00:48.416 a5153247d autopackage: Slurp spdk-ld-path while building against native DPDK 00:00:48.429 [Pipeline] } 00:00:48.444 [Pipeline] // stage 00:00:48.451 [Pipeline] stage 00:00:48.453 [Pipeline] { (Prepare) 00:00:48.468 [Pipeline] writeFile 00:00:48.481 [Pipeline] sh 00:00:48.774 + logger -p user.info -t JENKINS-CI 00:00:48.804 [Pipeline] sh 00:00:49.086 + logger -p user.info -t JENKINS-CI 00:00:49.098 [Pipeline] sh 00:00:49.384 + cat autorun-spdk.conf 00:00:49.384 SPDK_RUN_FUNCTIONAL_TEST=1 00:00:49.384 SPDK_TEST_NVMF=1 00:00:49.384 SPDK_TEST_NVME_CLI=1 00:00:49.384 SPDK_TEST_NVMF_TRANSPORT=tcp 00:00:49.384 SPDK_TEST_NVMF_NICS=e810 00:00:49.384 SPDK_RUN_UBSAN=1 00:00:49.384 NET_TYPE=phy 00:00:49.392 RUN_NIGHTLY=1 00:00:49.396 [Pipeline] readFile 00:00:49.421 [Pipeline] withEnv 00:00:49.423 [Pipeline] { 00:00:49.436 [Pipeline] sh 00:00:49.721 + set -ex 00:00:49.721 + [[ -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/autorun-spdk.conf ]] 00:00:49.721 + source /var/jenkins/workspace/nvmf-tcp-phy-autotest/autorun-spdk.conf 00:00:49.721 ++ SPDK_RUN_FUNCTIONAL_TEST=1 00:00:49.721 ++ SPDK_TEST_NVMF=1 00:00:49.721 ++ SPDK_TEST_NVME_CLI=1 00:00:49.721 ++ SPDK_TEST_NVMF_TRANSPORT=tcp 00:00:49.721 ++ SPDK_TEST_NVMF_NICS=e810 00:00:49.721 ++ SPDK_RUN_UBSAN=1 00:00:49.721 ++ NET_TYPE=phy 00:00:49.721 ++ RUN_NIGHTLY=1 00:00:49.721 + case $SPDK_TEST_NVMF_NICS in 00:00:49.721 + DRIVERS=ice 00:00:49.721 + [[ tcp == \r\d\m\a ]] 00:00:49.721 + [[ -n ice ]] 00:00:49.721 + sudo rmmod mlx4_ib mlx5_ib irdma i40iw iw_cxgb4 00:00:49.721 rmmod: ERROR: Module mlx4_ib is not currently loaded 00:00:49.721 rmmod: ERROR: Module mlx5_ib is not currently loaded 00:00:49.721 rmmod: ERROR: Module irdma is not currently loaded 00:00:49.721 rmmod: ERROR: Module i40iw is not currently loaded 00:00:49.721 rmmod: ERROR: Module iw_cxgb4 is not currently loaded 00:00:49.721 + true 00:00:49.721 + for D in $DRIVERS 00:00:49.721 + sudo modprobe ice 00:00:49.721 + exit 0 00:00:49.731 [Pipeline] } 00:00:49.748 [Pipeline] // withEnv 00:00:49.752 [Pipeline] } 00:00:49.767 [Pipeline] // stage 00:00:49.775 [Pipeline] catchError 00:00:49.777 [Pipeline] { 00:00:49.791 [Pipeline] timeout 00:00:49.791 Timeout set to expire in 40 min 00:00:49.792 [Pipeline] { 00:00:49.807 [Pipeline] stage 00:00:49.808 [Pipeline] { (Tests) 00:00:49.823 [Pipeline] sh 00:00:50.106 + jbp/jenkins/jjb-config/jobs/scripts/autoruner.sh /var/jenkins/workspace/nvmf-tcp-phy-autotest 00:00:50.107 ++ readlink -f /var/jenkins/workspace/nvmf-tcp-phy-autotest 00:00:50.107 + DIR_ROOT=/var/jenkins/workspace/nvmf-tcp-phy-autotest 00:00:50.107 + [[ -n /var/jenkins/workspace/nvmf-tcp-phy-autotest ]] 00:00:50.107 + DIR_SPDK=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:00:50.107 + DIR_OUTPUT=/var/jenkins/workspace/nvmf-tcp-phy-autotest/output 00:00:50.107 + [[ -d /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk ]] 00:00:50.107 + [[ ! -d /var/jenkins/workspace/nvmf-tcp-phy-autotest/output ]] 00:00:50.107 + mkdir -p /var/jenkins/workspace/nvmf-tcp-phy-autotest/output 00:00:50.107 + [[ -d /var/jenkins/workspace/nvmf-tcp-phy-autotest/output ]] 00:00:50.107 + cd /var/jenkins/workspace/nvmf-tcp-phy-autotest 00:00:50.107 + source /etc/os-release 00:00:50.107 ++ NAME='Fedora Linux' 00:00:50.107 ++ VERSION='38 (Cloud Edition)' 00:00:50.107 ++ ID=fedora 00:00:50.107 ++ VERSION_ID=38 00:00:50.107 ++ VERSION_CODENAME= 00:00:50.107 ++ PLATFORM_ID=platform:f38 00:00:50.107 ++ PRETTY_NAME='Fedora Linux 38 (Cloud Edition)' 00:00:50.107 ++ ANSI_COLOR='0;38;2;60;110;180' 00:00:50.107 ++ LOGO=fedora-logo-icon 00:00:50.107 ++ CPE_NAME=cpe:/o:fedoraproject:fedora:38 00:00:50.107 ++ HOME_URL=https://fedoraproject.org/ 00:00:50.107 ++ DOCUMENTATION_URL=https://docs.fedoraproject.org/en-US/fedora/f38/system-administrators-guide/ 00:00:50.107 ++ SUPPORT_URL=https://ask.fedoraproject.org/ 00:00:50.107 ++ BUG_REPORT_URL=https://bugzilla.redhat.com/ 00:00:50.107 ++ REDHAT_BUGZILLA_PRODUCT=Fedora 00:00:50.107 ++ REDHAT_BUGZILLA_PRODUCT_VERSION=38 00:00:50.107 ++ REDHAT_SUPPORT_PRODUCT=Fedora 00:00:50.107 ++ REDHAT_SUPPORT_PRODUCT_VERSION=38 00:00:50.107 ++ SUPPORT_END=2024-05-14 00:00:50.107 ++ VARIANT='Cloud Edition' 00:00:50.107 ++ VARIANT_ID=cloud 00:00:50.107 + uname -a 00:00:50.107 Linux spdk-gp-11 6.7.0-68.fc38.x86_64 #1 SMP PREEMPT_DYNAMIC Mon Jan 15 00:59:40 UTC 2024 x86_64 GNU/Linux 00:00:50.107 + sudo /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh status 00:00:51.042 Hugepages 00:00:51.042 node hugesize free / total 00:00:51.042 node0 1048576kB 0 / 0 00:00:51.042 node0 2048kB 0 / 0 00:00:51.042 node1 1048576kB 0 / 0 00:00:51.042 node1 2048kB 0 / 0 00:00:51.042 00:00:51.042 Type BDF Vendor Device NUMA Driver Device Block devices 00:00:51.042 I/OAT 0000:00:04.0 8086 0e20 0 ioatdma - - 00:00:51.042 I/OAT 0000:00:04.1 8086 0e21 0 ioatdma - - 00:00:51.042 I/OAT 0000:00:04.2 8086 0e22 0 ioatdma - - 00:00:51.042 I/OAT 0000:00:04.3 8086 0e23 0 ioatdma - - 00:00:51.042 I/OAT 0000:00:04.4 8086 0e24 0 ioatdma - - 00:00:51.042 I/OAT 0000:00:04.5 8086 0e25 0 ioatdma - - 00:00:51.042 I/OAT 0000:00:04.6 8086 0e26 0 ioatdma - - 00:00:51.042 I/OAT 0000:00:04.7 8086 0e27 0 ioatdma - - 00:00:51.042 I/OAT 0000:80:04.0 8086 0e20 1 ioatdma - - 00:00:51.043 I/OAT 0000:80:04.1 8086 0e21 1 ioatdma - - 00:00:51.043 I/OAT 0000:80:04.2 8086 0e22 1 ioatdma - - 00:00:51.043 I/OAT 0000:80:04.3 8086 0e23 1 ioatdma - - 00:00:51.043 I/OAT 0000:80:04.4 8086 0e24 1 ioatdma - - 00:00:51.043 I/OAT 0000:80:04.5 8086 0e25 1 ioatdma - - 00:00:51.043 I/OAT 0000:80:04.6 8086 0e26 1 ioatdma - - 00:00:51.043 I/OAT 0000:80:04.7 8086 0e27 1 ioatdma - - 00:00:51.301 NVMe 0000:88:00.0 8086 0a54 1 nvme nvme0 nvme0n1 00:00:51.301 + rm -f /tmp/spdk-ld-path 00:00:51.301 + source autorun-spdk.conf 00:00:51.301 ++ SPDK_RUN_FUNCTIONAL_TEST=1 00:00:51.301 ++ SPDK_TEST_NVMF=1 00:00:51.301 ++ SPDK_TEST_NVME_CLI=1 00:00:51.301 ++ SPDK_TEST_NVMF_TRANSPORT=tcp 00:00:51.301 ++ SPDK_TEST_NVMF_NICS=e810 00:00:51.301 ++ SPDK_RUN_UBSAN=1 00:00:51.301 ++ NET_TYPE=phy 00:00:51.301 ++ RUN_NIGHTLY=1 00:00:51.301 + (( SPDK_TEST_NVME_CMB == 1 || SPDK_TEST_NVME_PMR == 1 )) 00:00:51.301 + [[ -n '' ]] 00:00:51.301 + sudo git config --global --add safe.directory /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:00:51.301 + for M in /var/spdk/build-*-manifest.txt 00:00:51.301 + [[ -f /var/spdk/build-pkg-manifest.txt ]] 00:00:51.301 + cp /var/spdk/build-pkg-manifest.txt /var/jenkins/workspace/nvmf-tcp-phy-autotest/output/ 00:00:51.301 + for M in /var/spdk/build-*-manifest.txt 00:00:51.301 + [[ -f /var/spdk/build-repo-manifest.txt ]] 00:00:51.301 + cp /var/spdk/build-repo-manifest.txt /var/jenkins/workspace/nvmf-tcp-phy-autotest/output/ 00:00:51.301 ++ uname 00:00:51.301 + [[ Linux == \L\i\n\u\x ]] 00:00:51.301 + sudo dmesg -T 00:00:51.301 + sudo dmesg --clear 00:00:51.301 + dmesg_pid=78951 00:00:51.301 + [[ Fedora Linux == FreeBSD ]] 00:00:51.301 + export UNBIND_ENTIRE_IOMMU_GROUP=yes 00:00:51.301 + sudo dmesg -Tw 00:00:51.301 + UNBIND_ENTIRE_IOMMU_GROUP=yes 00:00:51.301 + [[ -e /var/spdk/dependencies/vhost/spdk_test_image.qcow2 ]] 00:00:51.301 + [[ -x /usr/src/fio-static/fio ]] 00:00:51.301 + export FIO_BIN=/usr/src/fio-static/fio 00:00:51.301 + FIO_BIN=/usr/src/fio-static/fio 00:00:51.301 + [[ '' == \/\v\a\r\/\j\e\n\k\i\n\s\/\w\o\r\k\s\p\a\c\e\/\n\v\m\f\-\t\c\p\-\p\h\y\-\a\u\t\o\t\e\s\t\/\q\e\m\u\_\v\f\i\o\/* ]] 00:00:51.301 + [[ ! -v VFIO_QEMU_BIN ]] 00:00:51.301 + [[ -e /usr/local/qemu/vfio-user-latest ]] 00:00:51.301 + export VFIO_QEMU_BIN=/usr/local/qemu/vfio-user-latest/bin/qemu-system-x86_64 00:00:51.301 + VFIO_QEMU_BIN=/usr/local/qemu/vfio-user-latest/bin/qemu-system-x86_64 00:00:51.302 + [[ -e /usr/local/qemu/vanilla-latest ]] 00:00:51.302 + export QEMU_BIN=/usr/local/qemu/vanilla-latest/bin/qemu-system-x86_64 00:00:51.302 + QEMU_BIN=/usr/local/qemu/vanilla-latest/bin/qemu-system-x86_64 00:00:51.302 + spdk/autorun.sh /var/jenkins/workspace/nvmf-tcp-phy-autotest/autorun-spdk.conf 00:00:51.302 Test configuration: 00:00:51.302 SPDK_RUN_FUNCTIONAL_TEST=1 00:00:51.302 SPDK_TEST_NVMF=1 00:00:51.302 SPDK_TEST_NVME_CLI=1 00:00:51.302 SPDK_TEST_NVMF_TRANSPORT=tcp 00:00:51.302 SPDK_TEST_NVMF_NICS=e810 00:00:51.302 SPDK_RUN_UBSAN=1 00:00:51.302 NET_TYPE=phy 00:00:51.302 RUN_NIGHTLY=1 22:38:42 -- common/autobuild_common.sh@15 -- $ source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:00:51.302 22:38:42 -- scripts/common.sh@433 -- $ [[ -e /bin/wpdk_common.sh ]] 00:00:51.302 22:38:42 -- scripts/common.sh@441 -- $ [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:00:51.302 22:38:42 -- scripts/common.sh@442 -- $ source /etc/opt/spdk-pkgdep/paths/export.sh 00:00:51.302 22:38:42 -- paths/export.sh@2 -- $ PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/home/sys_sgci/.local/bin:/home/sys_sgci/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:00:51.302 22:38:42 -- paths/export.sh@3 -- $ PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/home/sys_sgci/.local/bin:/home/sys_sgci/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:00:51.302 22:38:42 -- paths/export.sh@4 -- $ PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/home/sys_sgci/.local/bin:/home/sys_sgci/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:00:51.302 22:38:42 -- paths/export.sh@5 -- $ export PATH 00:00:51.302 22:38:42 -- paths/export.sh@6 -- $ echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/home/sys_sgci/.local/bin:/home/sys_sgci/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:00:51.302 22:38:42 -- common/autobuild_common.sh@434 -- $ out=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output 00:00:51.302 22:38:42 -- common/autobuild_common.sh@435 -- $ date +%s 00:00:51.302 22:38:42 -- common/autobuild_common.sh@435 -- $ mktemp -dt spdk_1713299922.XXXXXX 00:00:51.302 22:38:42 -- common/autobuild_common.sh@435 -- $ SPDK_WORKSPACE=/tmp/spdk_1713299922.o08Zjl 00:00:51.302 22:38:42 -- common/autobuild_common.sh@437 -- $ [[ -n '' ]] 00:00:51.302 22:38:42 -- common/autobuild_common.sh@441 -- $ '[' -n '' ']' 00:00:51.302 22:38:42 -- common/autobuild_common.sh@444 -- $ scanbuild_exclude='--exclude /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/dpdk/' 00:00:51.302 22:38:42 -- common/autobuild_common.sh@448 -- $ scanbuild_exclude+=' --exclude /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/xnvme --exclude /tmp' 00:00:51.302 22:38:42 -- common/autobuild_common.sh@450 -- $ scanbuild='scan-build -o /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/scan-build-tmp --exclude /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/dpdk/ --exclude /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/xnvme --exclude /tmp --status-bugs' 00:00:51.302 22:38:42 -- common/autobuild_common.sh@451 -- $ get_config_params 00:00:51.302 22:38:42 -- common/autotest_common.sh@387 -- $ xtrace_disable 00:00:51.302 22:38:42 -- common/autotest_common.sh@10 -- $ set +x 00:00:51.302 22:38:42 -- common/autobuild_common.sh@451 -- $ config_params='--enable-debug --enable-werror --with-rdma --with-idxd --with-fio=/usr/src/fio --with-iscsi-initiator --disable-unit-tests --enable-ubsan --enable-coverage --with-ublk' 00:00:51.302 22:38:42 -- spdk/autobuild.sh@11 -- $ SPDK_TEST_AUTOBUILD= 00:00:51.302 22:38:42 -- spdk/autobuild.sh@12 -- $ umask 022 00:00:51.302 22:38:42 -- spdk/autobuild.sh@13 -- $ cd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:00:51.302 22:38:42 -- spdk/autobuild.sh@16 -- $ date -u 00:00:51.302 Tue Apr 16 08:38:42 PM UTC 2024 00:00:51.302 22:38:42 -- spdk/autobuild.sh@17 -- $ git describe --tags 00:00:51.302 LTS-22-g4b134b4ab 00:00:51.302 22:38:42 -- spdk/autobuild.sh@19 -- $ '[' 0 -eq 1 ']' 00:00:51.302 22:38:42 -- spdk/autobuild.sh@23 -- $ '[' 1 -eq 1 ']' 00:00:51.302 22:38:42 -- spdk/autobuild.sh@24 -- $ run_test ubsan echo 'using ubsan' 00:00:51.302 22:38:42 -- common/autotest_common.sh@1077 -- $ '[' 3 -le 1 ']' 00:00:51.302 22:38:42 -- common/autotest_common.sh@1083 -- $ xtrace_disable 00:00:51.302 22:38:42 -- common/autotest_common.sh@10 -- $ set +x 00:00:51.302 ************************************ 00:00:51.302 START TEST ubsan 00:00:51.302 ************************************ 00:00:51.302 22:38:42 -- common/autotest_common.sh@1104 -- $ echo 'using ubsan' 00:00:51.302 using ubsan 00:00:51.302 00:00:51.302 real 0m0.000s 00:00:51.302 user 0m0.000s 00:00:51.302 sys 0m0.000s 00:00:51.302 22:38:42 -- common/autotest_common.sh@1105 -- $ xtrace_disable 00:00:51.302 22:38:42 -- common/autotest_common.sh@10 -- $ set +x 00:00:51.302 ************************************ 00:00:51.302 END TEST ubsan 00:00:51.302 ************************************ 00:00:51.302 22:38:42 -- spdk/autobuild.sh@27 -- $ '[' -n '' ']' 00:00:51.302 22:38:42 -- spdk/autobuild.sh@31 -- $ case "$SPDK_TEST_AUTOBUILD" in 00:00:51.302 22:38:42 -- spdk/autobuild.sh@47 -- $ [[ 0 -eq 1 ]] 00:00:51.302 22:38:42 -- spdk/autobuild.sh@51 -- $ [[ 0 -eq 1 ]] 00:00:51.302 22:38:42 -- spdk/autobuild.sh@55 -- $ [[ -n '' ]] 00:00:51.302 22:38:42 -- spdk/autobuild.sh@57 -- $ [[ 0 -eq 1 ]] 00:00:51.302 22:38:42 -- spdk/autobuild.sh@59 -- $ [[ 0 -eq 1 ]] 00:00:51.302 22:38:42 -- spdk/autobuild.sh@62 -- $ [[ 0 -eq 1 ]] 00:00:51.302 22:38:42 -- spdk/autobuild.sh@67 -- $ /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/configure --enable-debug --enable-werror --with-rdma --with-idxd --with-fio=/usr/src/fio --with-iscsi-initiator --disable-unit-tests --enable-ubsan --enable-coverage --with-ublk --with-shared 00:00:51.302 Using default SPDK env in /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/env_dpdk 00:00:51.302 Using default DPDK in /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/dpdk/build 00:00:51.870 Using 'verbs' RDMA provider 00:01:02.116 Configuring ISA-L (logfile: /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/isa-l/spdk-isal.log)...done. 00:01:12.092 Configuring ISA-L-crypto (logfile: /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/isa-l-crypto/spdk-isal-crypto.log)...done. 00:01:12.092 Creating mk/config.mk...done. 00:01:12.092 Creating mk/cc.flags.mk...done. 00:01:12.092 Type 'make' to build. 00:01:12.092 22:39:02 -- spdk/autobuild.sh@69 -- $ run_test make make -j48 00:01:12.092 22:39:02 -- common/autotest_common.sh@1077 -- $ '[' 3 -le 1 ']' 00:01:12.092 22:39:02 -- common/autotest_common.sh@1083 -- $ xtrace_disable 00:01:12.092 22:39:02 -- common/autotest_common.sh@10 -- $ set +x 00:01:12.092 ************************************ 00:01:12.092 START TEST make 00:01:12.092 ************************************ 00:01:12.092 22:39:02 -- common/autotest_common.sh@1104 -- $ make -j48 00:01:12.092 make[1]: Nothing to be done for 'all'. 00:01:20.259 The Meson build system 00:01:20.259 Version: 1.3.1 00:01:20.259 Source dir: /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/dpdk 00:01:20.259 Build dir: /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/dpdk/build-tmp 00:01:20.259 Build type: native build 00:01:20.259 Program cat found: YES (/usr/bin/cat) 00:01:20.259 Project name: DPDK 00:01:20.259 Project version: 23.11.0 00:01:20.259 C compiler for the host machine: cc (gcc 13.2.1 "cc (GCC) 13.2.1 20231011 (Red Hat 13.2.1-4)") 00:01:20.259 C linker for the host machine: cc ld.bfd 2.39-16 00:01:20.259 Host machine cpu family: x86_64 00:01:20.259 Host machine cpu: x86_64 00:01:20.259 Message: ## Building in Developer Mode ## 00:01:20.259 Program pkg-config found: YES (/usr/bin/pkg-config) 00:01:20.259 Program check-symbols.sh found: YES (/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/dpdk/buildtools/check-symbols.sh) 00:01:20.259 Program options-ibverbs-static.sh found: YES (/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/dpdk/buildtools/options-ibverbs-static.sh) 00:01:20.259 Program python3 found: YES (/usr/bin/python3) 00:01:20.259 Program cat found: YES (/usr/bin/cat) 00:01:20.259 Compiler for C supports arguments -march=native: YES 00:01:20.259 Checking for size of "void *" : 8 00:01:20.259 Checking for size of "void *" : 8 (cached) 00:01:20.259 Library m found: YES 00:01:20.259 Library numa found: YES 00:01:20.259 Has header "numaif.h" : YES 00:01:20.259 Library fdt found: NO 00:01:20.259 Library execinfo found: NO 00:01:20.259 Has header "execinfo.h" : YES 00:01:20.259 Found pkg-config: YES (/usr/bin/pkg-config) 1.8.0 00:01:20.259 Run-time dependency libarchive found: NO (tried pkgconfig) 00:01:20.259 Run-time dependency libbsd found: NO (tried pkgconfig) 00:01:20.259 Run-time dependency jansson found: NO (tried pkgconfig) 00:01:20.259 Run-time dependency openssl found: YES 3.0.9 00:01:20.259 Run-time dependency libpcap found: YES 1.10.4 00:01:20.259 Has header "pcap.h" with dependency libpcap: YES 00:01:20.259 Compiler for C supports arguments -Wcast-qual: YES 00:01:20.259 Compiler for C supports arguments -Wdeprecated: YES 00:01:20.260 Compiler for C supports arguments -Wformat: YES 00:01:20.260 Compiler for C supports arguments -Wformat-nonliteral: NO 00:01:20.260 Compiler for C supports arguments -Wformat-security: NO 00:01:20.260 Compiler for C supports arguments -Wmissing-declarations: YES 00:01:20.260 Compiler for C supports arguments -Wmissing-prototypes: YES 00:01:20.260 Compiler for C supports arguments -Wnested-externs: YES 00:01:20.260 Compiler for C supports arguments -Wold-style-definition: YES 00:01:20.260 Compiler for C supports arguments -Wpointer-arith: YES 00:01:20.260 Compiler for C supports arguments -Wsign-compare: YES 00:01:20.260 Compiler for C supports arguments -Wstrict-prototypes: YES 00:01:20.260 Compiler for C supports arguments -Wundef: YES 00:01:20.260 Compiler for C supports arguments -Wwrite-strings: YES 00:01:20.260 Compiler for C supports arguments -Wno-address-of-packed-member: YES 00:01:20.260 Compiler for C supports arguments -Wno-packed-not-aligned: YES 00:01:20.260 Compiler for C supports arguments -Wno-missing-field-initializers: YES 00:01:20.260 Compiler for C supports arguments -Wno-zero-length-bounds: YES 00:01:20.260 Program objdump found: YES (/usr/bin/objdump) 00:01:20.260 Compiler for C supports arguments -mavx512f: YES 00:01:20.260 Checking if "AVX512 checking" compiles: YES 00:01:20.260 Fetching value of define "__SSE4_2__" : 1 00:01:20.260 Fetching value of define "__AES__" : 1 00:01:20.260 Fetching value of define "__AVX__" : 1 00:01:20.260 Fetching value of define "__AVX2__" : (undefined) 00:01:20.260 Fetching value of define "__AVX512BW__" : (undefined) 00:01:20.260 Fetching value of define "__AVX512CD__" : (undefined) 00:01:20.260 Fetching value of define "__AVX512DQ__" : (undefined) 00:01:20.260 Fetching value of define "__AVX512F__" : (undefined) 00:01:20.260 Fetching value of define "__AVX512VL__" : (undefined) 00:01:20.260 Fetching value of define "__PCLMUL__" : 1 00:01:20.260 Fetching value of define "__RDRND__" : 1 00:01:20.260 Fetching value of define "__RDSEED__" : (undefined) 00:01:20.260 Fetching value of define "__VPCLMULQDQ__" : (undefined) 00:01:20.260 Fetching value of define "__znver1__" : (undefined) 00:01:20.260 Fetching value of define "__znver2__" : (undefined) 00:01:20.260 Fetching value of define "__znver3__" : (undefined) 00:01:20.260 Fetching value of define "__znver4__" : (undefined) 00:01:20.260 Compiler for C supports arguments -Wno-format-truncation: YES 00:01:20.260 Message: lib/log: Defining dependency "log" 00:01:20.260 Message: lib/kvargs: Defining dependency "kvargs" 00:01:20.260 Message: lib/telemetry: Defining dependency "telemetry" 00:01:20.260 Checking for function "getentropy" : NO 00:01:20.260 Message: lib/eal: Defining dependency "eal" 00:01:20.260 Message: lib/ring: Defining dependency "ring" 00:01:20.260 Message: lib/rcu: Defining dependency "rcu" 00:01:20.260 Message: lib/mempool: Defining dependency "mempool" 00:01:20.260 Message: lib/mbuf: Defining dependency "mbuf" 00:01:20.260 Fetching value of define "__PCLMUL__" : 1 (cached) 00:01:20.260 Fetching value of define "__AVX512F__" : (undefined) (cached) 00:01:20.260 Compiler for C supports arguments -mpclmul: YES 00:01:20.260 Compiler for C supports arguments -maes: YES 00:01:20.260 Compiler for C supports arguments -mavx512f: YES (cached) 00:01:20.260 Compiler for C supports arguments -mavx512bw: YES 00:01:20.260 Compiler for C supports arguments -mavx512dq: YES 00:01:20.260 Compiler for C supports arguments -mavx512vl: YES 00:01:20.260 Compiler for C supports arguments -mvpclmulqdq: YES 00:01:20.260 Compiler for C supports arguments -mavx2: YES 00:01:20.260 Compiler for C supports arguments -mavx: YES 00:01:20.260 Message: lib/net: Defining dependency "net" 00:01:20.260 Message: lib/meter: Defining dependency "meter" 00:01:20.260 Message: lib/ethdev: Defining dependency "ethdev" 00:01:20.260 Message: lib/pci: Defining dependency "pci" 00:01:20.260 Message: lib/cmdline: Defining dependency "cmdline" 00:01:20.260 Message: lib/hash: Defining dependency "hash" 00:01:20.260 Message: lib/timer: Defining dependency "timer" 00:01:20.260 Message: lib/compressdev: Defining dependency "compressdev" 00:01:20.260 Message: lib/cryptodev: Defining dependency "cryptodev" 00:01:20.260 Message: lib/dmadev: Defining dependency "dmadev" 00:01:20.260 Compiler for C supports arguments -Wno-cast-qual: YES 00:01:20.260 Message: lib/power: Defining dependency "power" 00:01:20.260 Message: lib/reorder: Defining dependency "reorder" 00:01:20.260 Message: lib/security: Defining dependency "security" 00:01:20.260 Has header "linux/userfaultfd.h" : YES 00:01:20.260 Has header "linux/vduse.h" : YES 00:01:20.260 Message: lib/vhost: Defining dependency "vhost" 00:01:20.260 Compiler for C supports arguments -Wno-format-truncation: YES (cached) 00:01:20.260 Message: drivers/bus/pci: Defining dependency "bus_pci" 00:01:20.260 Message: drivers/bus/vdev: Defining dependency "bus_vdev" 00:01:20.260 Message: drivers/mempool/ring: Defining dependency "mempool_ring" 00:01:20.260 Message: Disabling raw/* drivers: missing internal dependency "rawdev" 00:01:20.260 Message: Disabling regex/* drivers: missing internal dependency "regexdev" 00:01:20.260 Message: Disabling ml/* drivers: missing internal dependency "mldev" 00:01:20.260 Message: Disabling event/* drivers: missing internal dependency "eventdev" 00:01:20.260 Message: Disabling baseband/* drivers: missing internal dependency "bbdev" 00:01:20.260 Message: Disabling gpu/* drivers: missing internal dependency "gpudev" 00:01:20.260 Program doxygen found: YES (/usr/bin/doxygen) 00:01:20.260 Configuring doxy-api-html.conf using configuration 00:01:20.260 Configuring doxy-api-man.conf using configuration 00:01:20.260 Program mandb found: YES (/usr/bin/mandb) 00:01:20.260 Program sphinx-build found: NO 00:01:20.260 Configuring rte_build_config.h using configuration 00:01:20.260 Message: 00:01:20.260 ================= 00:01:20.260 Applications Enabled 00:01:20.260 ================= 00:01:20.260 00:01:20.260 apps: 00:01:20.260 00:01:20.260 00:01:20.260 Message: 00:01:20.260 ================= 00:01:20.260 Libraries Enabled 00:01:20.260 ================= 00:01:20.260 00:01:20.260 libs: 00:01:20.260 log, kvargs, telemetry, eal, ring, rcu, mempool, mbuf, 00:01:20.260 net, meter, ethdev, pci, cmdline, hash, timer, compressdev, 00:01:20.260 cryptodev, dmadev, power, reorder, security, vhost, 00:01:20.260 00:01:20.260 Message: 00:01:20.260 =============== 00:01:20.260 Drivers Enabled 00:01:20.260 =============== 00:01:20.260 00:01:20.260 common: 00:01:20.260 00:01:20.260 bus: 00:01:20.260 pci, vdev, 00:01:20.260 mempool: 00:01:20.260 ring, 00:01:20.260 dma: 00:01:20.260 00:01:20.260 net: 00:01:20.260 00:01:20.260 crypto: 00:01:20.260 00:01:20.260 compress: 00:01:20.260 00:01:20.260 vdpa: 00:01:20.260 00:01:20.260 00:01:20.260 Message: 00:01:20.260 ================= 00:01:20.260 Content Skipped 00:01:20.260 ================= 00:01:20.260 00:01:20.260 apps: 00:01:20.260 dumpcap: explicitly disabled via build config 00:01:20.260 graph: explicitly disabled via build config 00:01:20.260 pdump: explicitly disabled via build config 00:01:20.260 proc-info: explicitly disabled via build config 00:01:20.260 test-acl: explicitly disabled via build config 00:01:20.260 test-bbdev: explicitly disabled via build config 00:01:20.260 test-cmdline: explicitly disabled via build config 00:01:20.260 test-compress-perf: explicitly disabled via build config 00:01:20.260 test-crypto-perf: explicitly disabled via build config 00:01:20.260 test-dma-perf: explicitly disabled via build config 00:01:20.260 test-eventdev: explicitly disabled via build config 00:01:20.260 test-fib: explicitly disabled via build config 00:01:20.260 test-flow-perf: explicitly disabled via build config 00:01:20.260 test-gpudev: explicitly disabled via build config 00:01:20.260 test-mldev: explicitly disabled via build config 00:01:20.260 test-pipeline: explicitly disabled via build config 00:01:20.260 test-pmd: explicitly disabled via build config 00:01:20.260 test-regex: explicitly disabled via build config 00:01:20.260 test-sad: explicitly disabled via build config 00:01:20.260 test-security-perf: explicitly disabled via build config 00:01:20.260 00:01:20.260 libs: 00:01:20.260 metrics: explicitly disabled via build config 00:01:20.260 acl: explicitly disabled via build config 00:01:20.260 bbdev: explicitly disabled via build config 00:01:20.260 bitratestats: explicitly disabled via build config 00:01:20.260 bpf: explicitly disabled via build config 00:01:20.260 cfgfile: explicitly disabled via build config 00:01:20.260 distributor: explicitly disabled via build config 00:01:20.260 efd: explicitly disabled via build config 00:01:20.260 eventdev: explicitly disabled via build config 00:01:20.260 dispatcher: explicitly disabled via build config 00:01:20.260 gpudev: explicitly disabled via build config 00:01:20.260 gro: explicitly disabled via build config 00:01:20.260 gso: explicitly disabled via build config 00:01:20.260 ip_frag: explicitly disabled via build config 00:01:20.260 jobstats: explicitly disabled via build config 00:01:20.260 latencystats: explicitly disabled via build config 00:01:20.260 lpm: explicitly disabled via build config 00:01:20.260 member: explicitly disabled via build config 00:01:20.260 pcapng: explicitly disabled via build config 00:01:20.260 rawdev: explicitly disabled via build config 00:01:20.260 regexdev: explicitly disabled via build config 00:01:20.260 mldev: explicitly disabled via build config 00:01:20.260 rib: explicitly disabled via build config 00:01:20.260 sched: explicitly disabled via build config 00:01:20.260 stack: explicitly disabled via build config 00:01:20.260 ipsec: explicitly disabled via build config 00:01:20.260 pdcp: explicitly disabled via build config 00:01:20.260 fib: explicitly disabled via build config 00:01:20.260 port: explicitly disabled via build config 00:01:20.260 pdump: explicitly disabled via build config 00:01:20.260 table: explicitly disabled via build config 00:01:20.260 pipeline: explicitly disabled via build config 00:01:20.260 graph: explicitly disabled via build config 00:01:20.260 node: explicitly disabled via build config 00:01:20.260 00:01:20.260 drivers: 00:01:20.260 common/cpt: not in enabled drivers build config 00:01:20.260 common/dpaax: not in enabled drivers build config 00:01:20.260 common/iavf: not in enabled drivers build config 00:01:20.261 common/idpf: not in enabled drivers build config 00:01:20.261 common/mvep: not in enabled drivers build config 00:01:20.261 common/octeontx: not in enabled drivers build config 00:01:20.261 bus/auxiliary: not in enabled drivers build config 00:01:20.261 bus/cdx: not in enabled drivers build config 00:01:20.261 bus/dpaa: not in enabled drivers build config 00:01:20.261 bus/fslmc: not in enabled drivers build config 00:01:20.261 bus/ifpga: not in enabled drivers build config 00:01:20.261 bus/platform: not in enabled drivers build config 00:01:20.261 bus/vmbus: not in enabled drivers build config 00:01:20.261 common/cnxk: not in enabled drivers build config 00:01:20.261 common/mlx5: not in enabled drivers build config 00:01:20.261 common/nfp: not in enabled drivers build config 00:01:20.261 common/qat: not in enabled drivers build config 00:01:20.261 common/sfc_efx: not in enabled drivers build config 00:01:20.261 mempool/bucket: not in enabled drivers build config 00:01:20.261 mempool/cnxk: not in enabled drivers build config 00:01:20.261 mempool/dpaa: not in enabled drivers build config 00:01:20.261 mempool/dpaa2: not in enabled drivers build config 00:01:20.261 mempool/octeontx: not in enabled drivers build config 00:01:20.261 mempool/stack: not in enabled drivers build config 00:01:20.261 dma/cnxk: not in enabled drivers build config 00:01:20.261 dma/dpaa: not in enabled drivers build config 00:01:20.261 dma/dpaa2: not in enabled drivers build config 00:01:20.261 dma/hisilicon: not in enabled drivers build config 00:01:20.261 dma/idxd: not in enabled drivers build config 00:01:20.261 dma/ioat: not in enabled drivers build config 00:01:20.261 dma/skeleton: not in enabled drivers build config 00:01:20.261 net/af_packet: not in enabled drivers build config 00:01:20.261 net/af_xdp: not in enabled drivers build config 00:01:20.261 net/ark: not in enabled drivers build config 00:01:20.261 net/atlantic: not in enabled drivers build config 00:01:20.261 net/avp: not in enabled drivers build config 00:01:20.261 net/axgbe: not in enabled drivers build config 00:01:20.261 net/bnx2x: not in enabled drivers build config 00:01:20.261 net/bnxt: not in enabled drivers build config 00:01:20.261 net/bonding: not in enabled drivers build config 00:01:20.261 net/cnxk: not in enabled drivers build config 00:01:20.261 net/cpfl: not in enabled drivers build config 00:01:20.261 net/cxgbe: not in enabled drivers build config 00:01:20.261 net/dpaa: not in enabled drivers build config 00:01:20.261 net/dpaa2: not in enabled drivers build config 00:01:20.261 net/e1000: not in enabled drivers build config 00:01:20.261 net/ena: not in enabled drivers build config 00:01:20.261 net/enetc: not in enabled drivers build config 00:01:20.261 net/enetfec: not in enabled drivers build config 00:01:20.261 net/enic: not in enabled drivers build config 00:01:20.261 net/failsafe: not in enabled drivers build config 00:01:20.261 net/fm10k: not in enabled drivers build config 00:01:20.261 net/gve: not in enabled drivers build config 00:01:20.261 net/hinic: not in enabled drivers build config 00:01:20.261 net/hns3: not in enabled drivers build config 00:01:20.261 net/i40e: not in enabled drivers build config 00:01:20.261 net/iavf: not in enabled drivers build config 00:01:20.261 net/ice: not in enabled drivers build config 00:01:20.261 net/idpf: not in enabled drivers build config 00:01:20.261 net/igc: not in enabled drivers build config 00:01:20.261 net/ionic: not in enabled drivers build config 00:01:20.261 net/ipn3ke: not in enabled drivers build config 00:01:20.261 net/ixgbe: not in enabled drivers build config 00:01:20.261 net/mana: not in enabled drivers build config 00:01:20.261 net/memif: not in enabled drivers build config 00:01:20.261 net/mlx4: not in enabled drivers build config 00:01:20.261 net/mlx5: not in enabled drivers build config 00:01:20.261 net/mvneta: not in enabled drivers build config 00:01:20.261 net/mvpp2: not in enabled drivers build config 00:01:20.261 net/netvsc: not in enabled drivers build config 00:01:20.261 net/nfb: not in enabled drivers build config 00:01:20.261 net/nfp: not in enabled drivers build config 00:01:20.261 net/ngbe: not in enabled drivers build config 00:01:20.261 net/null: not in enabled drivers build config 00:01:20.261 net/octeontx: not in enabled drivers build config 00:01:20.261 net/octeon_ep: not in enabled drivers build config 00:01:20.261 net/pcap: not in enabled drivers build config 00:01:20.261 net/pfe: not in enabled drivers build config 00:01:20.261 net/qede: not in enabled drivers build config 00:01:20.261 net/ring: not in enabled drivers build config 00:01:20.261 net/sfc: not in enabled drivers build config 00:01:20.261 net/softnic: not in enabled drivers build config 00:01:20.261 net/tap: not in enabled drivers build config 00:01:20.261 net/thunderx: not in enabled drivers build config 00:01:20.261 net/txgbe: not in enabled drivers build config 00:01:20.261 net/vdev_netvsc: not in enabled drivers build config 00:01:20.261 net/vhost: not in enabled drivers build config 00:01:20.261 net/virtio: not in enabled drivers build config 00:01:20.261 net/vmxnet3: not in enabled drivers build config 00:01:20.261 raw/*: missing internal dependency, "rawdev" 00:01:20.261 crypto/armv8: not in enabled drivers build config 00:01:20.261 crypto/bcmfs: not in enabled drivers build config 00:01:20.261 crypto/caam_jr: not in enabled drivers build config 00:01:20.261 crypto/ccp: not in enabled drivers build config 00:01:20.261 crypto/cnxk: not in enabled drivers build config 00:01:20.261 crypto/dpaa_sec: not in enabled drivers build config 00:01:20.261 crypto/dpaa2_sec: not in enabled drivers build config 00:01:20.261 crypto/ipsec_mb: not in enabled drivers build config 00:01:20.261 crypto/mlx5: not in enabled drivers build config 00:01:20.261 crypto/mvsam: not in enabled drivers build config 00:01:20.261 crypto/nitrox: not in enabled drivers build config 00:01:20.261 crypto/null: not in enabled drivers build config 00:01:20.261 crypto/octeontx: not in enabled drivers build config 00:01:20.261 crypto/openssl: not in enabled drivers build config 00:01:20.261 crypto/scheduler: not in enabled drivers build config 00:01:20.261 crypto/uadk: not in enabled drivers build config 00:01:20.261 crypto/virtio: not in enabled drivers build config 00:01:20.261 compress/isal: not in enabled drivers build config 00:01:20.261 compress/mlx5: not in enabled drivers build config 00:01:20.261 compress/octeontx: not in enabled drivers build config 00:01:20.261 compress/zlib: not in enabled drivers build config 00:01:20.261 regex/*: missing internal dependency, "regexdev" 00:01:20.261 ml/*: missing internal dependency, "mldev" 00:01:20.261 vdpa/ifc: not in enabled drivers build config 00:01:20.261 vdpa/mlx5: not in enabled drivers build config 00:01:20.261 vdpa/nfp: not in enabled drivers build config 00:01:20.261 vdpa/sfc: not in enabled drivers build config 00:01:20.261 event/*: missing internal dependency, "eventdev" 00:01:20.261 baseband/*: missing internal dependency, "bbdev" 00:01:20.261 gpu/*: missing internal dependency, "gpudev" 00:01:20.261 00:01:20.261 00:01:20.261 Build targets in project: 85 00:01:20.261 00:01:20.261 DPDK 23.11.0 00:01:20.261 00:01:20.261 User defined options 00:01:20.261 buildtype : debug 00:01:20.261 default_library : shared 00:01:20.261 libdir : lib 00:01:20.261 prefix : /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/dpdk/build 00:01:20.261 c_args : -fPIC -Werror -Wno-stringop-overflow -fcommon -Wno-stringop-overread -Wno-array-bounds 00:01:20.261 c_link_args : 00:01:20.261 cpu_instruction_set: native 00:01:20.261 disable_apps : test-sad,graph,test-regex,dumpcap,test-eventdev,test-compress-perf,pdump,test-security-perf,test-pmd,test-flow-perf,test-pipeline,test-crypto-perf,test-gpudev,test-cmdline,test-dma-perf,proc-info,test-bbdev,test-acl,test,test-mldev,test-fib 00:01:20.261 disable_libs : sched,port,dispatcher,graph,rawdev,pdcp,bitratestats,ipsec,pcapng,pdump,gso,cfgfile,gpudev,ip_frag,node,distributor,mldev,lpm,acl,bpf,latencystats,eventdev,regexdev,gro,stack,fib,pipeline,bbdev,table,metrics,member,jobstats,efd,rib 00:01:20.261 enable_docs : false 00:01:20.261 enable_drivers : bus,bus/pci,bus/vdev,mempool/ring 00:01:20.261 enable_kmods : false 00:01:20.261 tests : false 00:01:20.261 00:01:20.261 Found ninja-1.11.1.git.kitware.jobserver-1 at /usr/local/bin/ninja 00:01:20.261 ninja: Entering directory `/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/dpdk/build-tmp' 00:01:20.530 [1/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_hypervisor.c.o 00:01:20.530 [2/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_errno.c.o 00:01:20.530 [3/265] Compiling C object lib/librte_log.a.p/log_log_linux.c.o 00:01:20.530 [4/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_hexdump.c.o 00:01:20.530 [5/265] Compiling C object lib/librte_eal.a.p/eal_common_rte_version.c.o 00:01:20.530 [6/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_class.c.o 00:01:20.530 [7/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_cpuflags.c.o 00:01:20.530 [8/265] Compiling C object lib/librte_eal.a.p/eal_common_rte_reciprocal.c.o 00:01:20.530 [9/265] Compiling C object lib/librte_kvargs.a.p/kvargs_rte_kvargs.c.o 00:01:20.530 [10/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_uuid.c.o 00:01:20.530 [11/265] Linking static target lib/librte_kvargs.a 00:01:20.530 [12/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_debug.c.o 00:01:20.530 [13/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_string_fns.c.o 00:01:20.530 [14/265] Compiling C object lib/librte_telemetry.a.p/telemetry_telemetry_data.c.o 00:01:20.530 [15/265] Compiling C object lib/librte_eal.a.p/eal_unix_eal_debug.c.o 00:01:20.530 [16/265] Compiling C object lib/librte_log.a.p/log_log.c.o 00:01:20.530 [17/265] Linking static target lib/librte_log.a 00:01:20.530 [18/265] Compiling C object lib/librte_eal.a.p/eal_unix_eal_firmware.c.o 00:01:20.530 [19/265] Compiling C object lib/librte_eal.a.p/eal_unix_rte_thread.c.o 00:01:20.530 [20/265] Compiling C object lib/librte_eal.a.p/eal_linux_eal_cpuflags.c.o 00:01:20.789 [21/265] Compiling C object lib/librte_eal.a.p/eal_linux_eal_thread.c.o 00:01:21.356 [22/265] Generating lib/kvargs.sym_chk with a custom command (wrapped by meson to capture output) 00:01:21.356 [23/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_config.c.o 00:01:21.356 [24/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_tailqs.c.o 00:01:21.356 [25/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_timer.c.o 00:01:21.356 [26/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_launch.c.o 00:01:21.356 [27/265] Compiling C object lib/librte_telemetry.a.p/telemetry_telemetry_legacy.c.o 00:01:21.356 [28/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_memalloc.c.o 00:01:21.356 [29/265] Compiling C object lib/librte_eal.a.p/eal_common_rte_random.c.o 00:01:21.356 [30/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_bus.c.o 00:01:21.356 [31/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_mcfg.c.o 00:01:21.356 [32/265] Compiling C object lib/librte_eal.a.p/eal_common_rte_keepalive.c.o 00:01:21.356 [33/265] Compiling C object lib/librte_eal.a.p/eal_unix_eal_file.c.o 00:01:21.356 [34/265] Compiling C object lib/librte_eal.a.p/eal_unix_eal_unix_timer.c.o 00:01:21.356 [35/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_interrupts.c.o 00:01:21.356 [36/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_trace_utils.c.o 00:01:21.356 [37/265] Compiling C object lib/librte_eal.a.p/eal_common_malloc_elem.c.o 00:01:21.356 [38/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_thread.c.o 00:01:21.356 [39/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_trace.c.o 00:01:21.356 [40/265] Compiling C object lib/librte_eal.a.p/eal_common_hotplug_mp.c.o 00:01:21.356 [41/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_memzone.c.o 00:01:21.356 [42/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_trace_points.c.o 00:01:21.356 [43/265] Compiling C object lib/librte_eal.a.p/eal_x86_rte_spinlock.c.o 00:01:21.356 [44/265] Compiling C object lib/librte_eal.a.p/eal_linux_eal_vfio_mp_sync.c.o 00:01:21.356 [45/265] Compiling C object lib/librte_eal.a.p/eal_x86_rte_cpuflags.c.o 00:01:21.356 [46/265] Compiling C object lib/librte_eal.a.p/eal_x86_rte_hypervisor.c.o 00:01:21.356 [47/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_dev.c.o 00:01:21.356 [48/265] Compiling C object lib/librte_eal.a.p/eal_unix_eal_unix_memory.c.o 00:01:21.356 [49/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_devargs.c.o 00:01:21.356 [50/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_lcore.c.o 00:01:21.356 [51/265] Compiling C object lib/librte_eal.a.p/eal_unix_eal_unix_thread.c.o 00:01:21.356 [52/265] Compiling C object lib/librte_eal.a.p/eal_common_malloc_mp.c.o 00:01:21.356 [53/265] Compiling C object lib/librte_eal.a.p/eal_common_malloc_heap.c.o 00:01:21.356 [54/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_trace_ctf.c.o 00:01:21.356 [55/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_proc.c.o 00:01:21.356 [56/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_fbarray.c.o 00:01:21.356 [57/265] Compiling C object lib/librte_telemetry.a.p/telemetry_telemetry.c.o 00:01:21.618 [58/265] Compiling C object lib/librte_eal.a.p/eal_linux_eal_dev.c.o 00:01:21.618 [59/265] Linking static target lib/librte_telemetry.a 00:01:21.618 [60/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_memory.c.o 00:01:21.618 [61/265] Compiling C object lib/librte_eal.a.p/eal_common_rte_service.c.o 00:01:21.618 [62/265] Compiling C object lib/librte_eal.a.p/eal_linux_eal_alarm.c.o 00:01:21.618 [63/265] Compiling C object lib/librte_eal.a.p/eal_linux_eal_hugepage_info.c.o 00:01:21.618 [64/265] Compiling C object lib/librte_eal.a.p/eal_linux_eal_lcore.c.o 00:01:21.618 [65/265] Compiling C object lib/librte_eal.a.p/eal_unix_eal_filesystem.c.o 00:01:21.618 [66/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_dynmem.c.o 00:01:21.618 [67/265] Compiling C object lib/librte_eal.a.p/eal_linux_eal.c.o 00:01:21.618 [68/265] Compiling C object lib/librte_eal.a.p/eal_linux_eal_interrupts.c.o 00:01:21.618 [69/265] Compiling C object lib/librte_pci.a.p/pci_rte_pci.c.o 00:01:21.618 [70/265] Linking static target lib/librte_pci.a 00:01:21.618 [71/265] Compiling C object lib/librte_eal.a.p/eal_common_rte_malloc.c.o 00:01:21.618 [72/265] Compiling C object lib/librte_cmdline.a.p/cmdline_cmdline_cirbuf.c.o 00:01:21.880 [73/265] Compiling C object lib/librte_eal.a.p/eal_linux_eal_memalloc.c.o 00:01:21.880 [74/265] Compiling C object lib/librte_cmdline.a.p/cmdline_cmdline.c.o 00:01:21.880 [75/265] Compiling C object lib/librte_eal.a.p/eal_linux_eal_memory.c.o 00:01:21.880 [76/265] Compiling C object lib/librte_cmdline.a.p/cmdline_cmdline_parse.c.o 00:01:21.880 [77/265] Generating lib/log.sym_chk with a custom command (wrapped by meson to capture output) 00:01:21.880 [78/265] Compiling C object lib/librte_cmdline.a.p/cmdline_cmdline_parse_num.c.o 00:01:21.880 [79/265] Compiling C object lib/librte_eal.a.p/eal_linux_eal_timer.c.o 00:01:21.880 [80/265] Compiling C object lib/librte_cmdline.a.p/cmdline_cmdline_parse_portlist.c.o 00:01:21.880 [81/265] Compiling C object lib/librte_cmdline.a.p/cmdline_cmdline_parse_string.c.o 00:01:21.880 [82/265] Compiling C object lib/librte_cmdline.a.p/cmdline_cmdline_vt100.c.o 00:01:21.880 [83/265] Linking target lib/librte_log.so.24.0 00:01:21.880 [84/265] Compiling C object lib/librte_cmdline.a.p/cmdline_cmdline_os_unix.c.o 00:01:21.880 [85/265] Compiling C object lib/librte_cmdline.a.p/cmdline_cmdline_rdline.c.o 00:01:21.880 [86/265] Compiling C object lib/librte_cmdline.a.p/cmdline_cmdline_socket.c.o 00:01:22.140 [87/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_options.c.o 00:01:22.140 [88/265] Generating lib/pci.sym_chk with a custom command (wrapped by meson to capture output) 00:01:22.140 [89/265] Compiling C object lib/librte_eal.a.p/eal_x86_rte_power_intrinsics.c.o 00:01:22.140 [90/265] Generating symbol file lib/librte_log.so.24.0.p/librte_log.so.24.0.symbols 00:01:22.140 [91/265] Compiling C object lib/net/libnet_crc_avx512_lib.a.p/net_crc_avx512.c.o 00:01:22.140 [92/265] Compiling C object lib/librte_eal.a.p/eal_x86_rte_cycles.c.o 00:01:22.140 [93/265] Linking static target lib/net/libnet_crc_avx512_lib.a 00:01:22.405 [94/265] Compiling C object lib/librte_ring.a.p/ring_rte_ring.c.o 00:01:22.405 [95/265] Linking static target lib/librte_ring.a 00:01:22.405 [96/265] Compiling C object lib/librte_net.a.p/net_rte_net_crc.c.o 00:01:22.405 [97/265] Compiling C object lib/librte_net.a.p/net_net_crc_sse.c.o 00:01:22.405 [98/265] Linking target lib/librte_kvargs.so.24.0 00:01:22.405 [99/265] Generating lib/telemetry.sym_chk with a custom command (wrapped by meson to capture output) 00:01:22.405 [100/265] Compiling C object lib/librte_mbuf.a.p/mbuf_rte_mbuf_ptype.c.o 00:01:22.405 [101/265] Compiling C object lib/librte_mbuf.a.p/mbuf_rte_mbuf_pool_ops.c.o 00:01:22.405 [102/265] Compiling C object lib/librte_meter.a.p/meter_rte_meter.c.o 00:01:22.405 [103/265] Compiling C object lib/librte_mempool.a.p/mempool_rte_mempool_ops.c.o 00:01:22.405 [104/265] Linking static target lib/librte_meter.a 00:01:22.405 [105/265] Linking target lib/librte_telemetry.so.24.0 00:01:22.405 [106/265] Compiling C object lib/librte_mempool.a.p/mempool_rte_mempool_ops_default.c.o 00:01:22.405 [107/265] Compiling C object lib/librte_power.a.p/power_guest_channel.c.o 00:01:22.405 [108/265] Compiling C object lib/librte_eal.a.p/eal_linux_eal_vfio.c.o 00:01:22.405 [109/265] Compiling C object lib/librte_mempool.a.p/mempool_mempool_trace_points.c.o 00:01:22.405 [110/265] Compiling C object lib/librte_power.a.p/power_power_common.c.o 00:01:22.405 [111/265] Compiling C object lib/librte_mbuf.a.p/mbuf_rte_mbuf_dyn.c.o 00:01:22.405 [112/265] Linking static target lib/librte_eal.a 00:01:22.665 [113/265] Compiling C object lib/librte_net.a.p/net_rte_net.c.o 00:01:22.665 [114/265] Generating symbol file lib/librte_kvargs.so.24.0.p/librte_kvargs.so.24.0.symbols 00:01:22.665 [115/265] Compiling C object lib/librte_power.a.p/power_power_kvm_vm.c.o 00:01:22.665 [116/265] Compiling C object lib/librte_ethdev.a.p/ethdev_ethdev_private.c.o 00:01:22.665 [117/265] Compiling C object lib/librte_ethdev.a.p/ethdev_rte_class_eth.c.o 00:01:22.665 [118/265] Compiling C object lib/librte_rcu.a.p/rcu_rte_rcu_qsbr.c.o 00:01:22.665 [119/265] Compiling C object lib/librte_ethdev.a.p/ethdev_sff_telemetry.c.o 00:01:22.665 [120/265] Compiling C object lib/librte_ethdev.a.p/ethdev_ethdev_driver.c.o 00:01:22.665 [121/265] Linking static target lib/librte_rcu.a 00:01:22.665 [122/265] Compiling C object lib/librte_mempool.a.p/mempool_rte_mempool.c.o 00:01:22.665 [123/265] Linking static target lib/librte_mempool.a 00:01:22.665 [124/265] Generating symbol file lib/librte_telemetry.so.24.0.p/librte_telemetry.so.24.0.symbols 00:01:22.665 [125/265] Compiling C object lib/librte_net.a.p/net_rte_ether.c.o 00:01:22.665 [126/265] Compiling C object lib/librte_ethdev.a.p/ethdev_sff_8472.c.o 00:01:22.665 [127/265] Compiling C object lib/librte_cmdline.a.p/cmdline_cmdline_parse_etheraddr.c.o 00:01:22.665 [128/265] Compiling C object lib/librte_vhost.a.p/vhost_fd_man.c.o 00:01:22.665 [129/265] Compiling C object lib/librte_ethdev.a.p/ethdev_sff_8079.c.o 00:01:22.665 [130/265] Compiling C object lib/librte_ethdev.a.p/ethdev_rte_ethdev_cman.c.o 00:01:22.665 [131/265] Compiling C object lib/librte_ethdev.a.p/ethdev_sff_common.c.o 00:01:22.665 [132/265] Compiling C object lib/librte_cmdline.a.p/cmdline_cmdline_parse_ipaddr.c.o 00:01:22.665 [133/265] Compiling C object lib/librte_ethdev.a.p/ethdev_rte_ethdev_telemetry.c.o 00:01:22.926 [134/265] Linking static target lib/librte_cmdline.a 00:01:22.926 [135/265] Compiling C object lib/librte_ethdev.a.p/ethdev_ethdev_profile.c.o 00:01:22.926 [136/265] Generating lib/ring.sym_chk with a custom command (wrapped by meson to capture output) 00:01:22.926 [137/265] Compiling C object lib/librte_hash.a.p/hash_rte_fbk_hash.c.o 00:01:22.926 [138/265] Compiling C object drivers/libtmp_rte_bus_pci.a.p/bus_pci_pci_params.c.o 00:01:22.926 [139/265] Generating lib/meter.sym_chk with a custom command (wrapped by meson to capture output) 00:01:22.926 [140/265] Compiling C object lib/librte_ethdev.a.p/ethdev_rte_tm.c.o 00:01:22.926 [141/265] Compiling C object lib/librte_timer.a.p/timer_rte_timer.c.o 00:01:22.926 [142/265] Compiling C object lib/librte_net.a.p/net_rte_arp.c.o 00:01:22.926 [143/265] Compiling C object lib/librte_ethdev.a.p/ethdev_sff_8636.c.o 00:01:22.926 [144/265] Linking static target lib/librte_net.a 00:01:22.926 [145/265] Linking static target lib/librte_timer.a 00:01:23.185 [146/265] Compiling C object lib/librte_compressdev.a.p/compressdev_rte_compressdev_pmd.c.o 00:01:23.185 [147/265] Compiling C object drivers/libtmp_rte_bus_vdev.a.p/bus_vdev_vdev_params.c.o 00:01:23.185 [148/265] Compiling C object lib/librte_compressdev.a.p/compressdev_rte_compressdev.c.o 00:01:23.185 [149/265] Compiling C object lib/librte_cryptodev.a.p/cryptodev_cryptodev_pmd.c.o 00:01:23.185 [150/265] Compiling C object lib/librte_ethdev.a.p/ethdev_rte_mtr.c.o 00:01:23.185 [151/265] Compiling C object lib/librte_dmadev.a.p/dmadev_rte_dmadev_trace_points.c.o 00:01:23.185 [152/265] Compiling C object lib/librte_ethdev.a.p/ethdev_ethdev_trace_points.c.o 00:01:23.185 [153/265] Generating lib/rcu.sym_chk with a custom command (wrapped by meson to capture output) 00:01:23.185 [154/265] Compiling C object lib/librte_hash.a.p/hash_rte_thash.c.o 00:01:23.442 [155/265] Compiling C object lib/librte_cryptodev.a.p/cryptodev_cryptodev_trace_points.c.o 00:01:23.442 [156/265] Compiling C object lib/librte_dmadev.a.p/dmadev_rte_dmadev.c.o 00:01:23.442 [157/265] Linking static target lib/librte_dmadev.a 00:01:23.442 [158/265] Compiling C object lib/librte_power.a.p/power_rte_power.c.o 00:01:23.442 [159/265] Generating lib/net.sym_chk with a custom command (wrapped by meson to capture output) 00:01:23.442 [160/265] Compiling C object lib/librte_power.a.p/power_rte_power_uncore.c.o 00:01:23.442 [161/265] Generating lib/timer.sym_chk with a custom command (wrapped by meson to capture output) 00:01:23.442 [162/265] Compiling C object lib/librte_power.a.p/power_power_acpi_cpufreq.c.o 00:01:23.442 [163/265] Compiling C object lib/librte_compressdev.a.p/compressdev_rte_comp.c.o 00:01:23.442 [164/265] Linking static target lib/librte_compressdev.a 00:01:23.442 [165/265] Compiling C object lib/librte_power.a.p/power_power_pstate_cpufreq.c.o 00:01:23.700 [166/265] Compiling C object lib/librte_power.a.p/power_power_amd_pstate_cpufreq.c.o 00:01:23.700 [167/265] Generating lib/mempool.sym_chk with a custom command (wrapped by meson to capture output) 00:01:23.700 [168/265] Compiling C object lib/librte_vhost.a.p/vhost_vdpa.c.o 00:01:23.700 [169/265] Compiling C object lib/librte_power.a.p/power_power_cppc_cpufreq.c.o 00:01:23.700 [170/265] Compiling C object lib/librte_vhost.a.p/vhost_virtio_net_ctrl.c.o 00:01:23.700 [171/265] Compiling C object drivers/libtmp_rte_bus_pci.a.p/bus_pci_pci_common_uio.c.o 00:01:23.700 [172/265] Compiling C object lib/librte_vhost.a.p/vhost_iotlb.c.o 00:01:23.700 [173/265] Compiling C object lib/librte_power.a.p/power_power_intel_uncore.c.o 00:01:23.700 [174/265] Compiling C object lib/librte_power.a.p/power_rte_power_pmd_mgmt.c.o 00:01:23.700 [175/265] Compiling C object lib/librte_hash.a.p/hash_rte_cuckoo_hash.c.o 00:01:23.700 [176/265] Linking static target lib/librte_power.a 00:01:23.700 [177/265] Linking static target lib/librte_hash.a 00:01:23.700 [178/265] Compiling C object drivers/libtmp_rte_bus_pci.a.p/bus_pci_linux_pci.c.o 00:01:23.700 [179/265] Compiling C object drivers/libtmp_rte_bus_pci.a.p/bus_pci_pci_common.c.o 00:01:23.700 [180/265] Compiling C object lib/librte_vhost.a.p/vhost_vduse.c.o 00:01:23.700 [181/265] Compiling C object lib/librte_vhost.a.p/vhost_socket.c.o 00:01:23.700 [182/265] Generating lib/dmadev.sym_chk with a custom command (wrapped by meson to capture output) 00:01:23.700 [183/265] Compiling C object drivers/libtmp_rte_bus_pci.a.p/bus_pci_linux_pci_uio.c.o 00:01:23.700 [184/265] Generating lib/cmdline.sym_chk with a custom command (wrapped by meson to capture output) 00:01:23.959 [185/265] Compiling C object lib/librte_reorder.a.p/reorder_rte_reorder.c.o 00:01:23.959 [186/265] Linking static target lib/librte_reorder.a 00:01:23.959 [187/265] Compiling C object drivers/libtmp_rte_bus_pci.a.p/bus_pci_linux_pci_vfio.c.o 00:01:23.959 [188/265] Linking static target drivers/libtmp_rte_bus_pci.a 00:01:23.959 [189/265] Compiling C object drivers/libtmp_rte_bus_vdev.a.p/bus_vdev_vdev.c.o 00:01:23.959 [190/265] Linking static target drivers/libtmp_rte_bus_vdev.a 00:01:23.959 [191/265] Compiling C object lib/librte_vhost.a.p/vhost_vhost_user.c.o 00:01:23.959 [192/265] Compiling C object lib/librte_mbuf.a.p/mbuf_rte_mbuf.c.o 00:01:23.959 [193/265] Linking static target lib/librte_mbuf.a 00:01:23.959 [194/265] Generating lib/compressdev.sym_chk with a custom command (wrapped by meson to capture output) 00:01:23.959 [195/265] Compiling C object drivers/libtmp_rte_mempool_ring.a.p/mempool_ring_rte_mempool_ring.c.o 00:01:23.959 [196/265] Linking static target drivers/libtmp_rte_mempool_ring.a 00:01:23.959 [197/265] Compiling C object lib/librte_vhost.a.p/vhost_vhost.c.o 00:01:24.217 [198/265] Generating drivers/rte_bus_pci.pmd.c with a custom command 00:01:24.217 [199/265] Generating drivers/rte_bus_vdev.pmd.c with a custom command 00:01:24.217 [200/265] Compiling C object drivers/librte_bus_pci.a.p/meson-generated_.._rte_bus_pci.pmd.c.o 00:01:24.217 [201/265] Compiling C object drivers/librte_bus_pci.so.24.0.p/meson-generated_.._rte_bus_pci.pmd.c.o 00:01:24.217 [202/265] Linking static target drivers/librte_bus_pci.a 00:01:24.217 [203/265] Generating lib/reorder.sym_chk with a custom command (wrapped by meson to capture output) 00:01:24.217 [204/265] Compiling C object drivers/librte_bus_vdev.so.24.0.p/meson-generated_.._rte_bus_vdev.pmd.c.o 00:01:24.217 [205/265] Compiling C object drivers/librte_bus_vdev.a.p/meson-generated_.._rte_bus_vdev.pmd.c.o 00:01:24.217 [206/265] Linking static target drivers/librte_bus_vdev.a 00:01:24.217 [207/265] Generating lib/hash.sym_chk with a custom command (wrapped by meson to capture output) 00:01:24.217 [208/265] Generating lib/power.sym_chk with a custom command (wrapped by meson to capture output) 00:01:24.217 [209/265] Compiling C object lib/librte_ethdev.a.p/ethdev_rte_ethdev.c.o 00:01:24.217 [210/265] Generating drivers/rte_mempool_ring.pmd.c with a custom command 00:01:24.217 [211/265] Compiling C object drivers/librte_mempool_ring.a.p/meson-generated_.._rte_mempool_ring.pmd.c.o 00:01:24.217 [212/265] Compiling C object drivers/librte_mempool_ring.so.24.0.p/meson-generated_.._rte_mempool_ring.pmd.c.o 00:01:24.217 [213/265] Compiling C object lib/librte_security.a.p/security_rte_security.c.o 00:01:24.217 [214/265] Linking static target drivers/librte_mempool_ring.a 00:01:24.217 [215/265] Linking static target lib/librte_security.a 00:01:24.475 [216/265] Generating drivers/rte_bus_vdev.sym_chk with a custom command (wrapped by meson to capture output) 00:01:24.475 [217/265] Generating lib/mbuf.sym_chk with a custom command (wrapped by meson to capture output) 00:01:24.475 [218/265] Compiling C object lib/librte_cryptodev.a.p/cryptodev_rte_cryptodev.c.o 00:01:24.475 [219/265] Linking static target lib/librte_cryptodev.a 00:01:24.475 [220/265] Generating drivers/rte_bus_pci.sym_chk with a custom command (wrapped by meson to capture output) 00:01:24.733 [221/265] Compiling C object lib/librte_ethdev.a.p/ethdev_rte_flow.c.o 00:01:24.733 [222/265] Linking static target lib/librte_ethdev.a 00:01:24.733 [223/265] Generating lib/security.sym_chk with a custom command (wrapped by meson to capture output) 00:01:25.665 [224/265] Generating lib/cryptodev.sym_chk with a custom command (wrapped by meson to capture output) 00:01:26.598 [225/265] Compiling C object lib/librte_vhost.a.p/vhost_vhost_crypto.c.o 00:01:28.495 [226/265] Generating lib/ethdev.sym_chk with a custom command (wrapped by meson to capture output) 00:01:28.753 [227/265] Generating lib/eal.sym_chk with a custom command (wrapped by meson to capture output) 00:01:28.753 [228/265] Linking target lib/librte_eal.so.24.0 00:01:28.753 [229/265] Generating symbol file lib/librte_eal.so.24.0.p/librte_eal.so.24.0.symbols 00:01:28.753 [230/265] Linking target lib/librte_ring.so.24.0 00:01:28.753 [231/265] Linking target lib/librte_meter.so.24.0 00:01:28.753 [232/265] Linking target lib/librte_dmadev.so.24.0 00:01:28.753 [233/265] Linking target lib/librte_timer.so.24.0 00:01:28.753 [234/265] Linking target lib/librte_pci.so.24.0 00:01:28.753 [235/265] Linking target drivers/librte_bus_vdev.so.24.0 00:01:29.011 [236/265] Generating symbol file lib/librte_dmadev.so.24.0.p/librte_dmadev.so.24.0.symbols 00:01:29.011 [237/265] Generating symbol file lib/librte_meter.so.24.0.p/librte_meter.so.24.0.symbols 00:01:29.011 [238/265] Generating symbol file lib/librte_ring.so.24.0.p/librte_ring.so.24.0.symbols 00:01:29.011 [239/265] Generating symbol file lib/librte_timer.so.24.0.p/librte_timer.so.24.0.symbols 00:01:29.011 [240/265] Generating symbol file lib/librte_pci.so.24.0.p/librte_pci.so.24.0.symbols 00:01:29.011 [241/265] Linking target lib/librte_rcu.so.24.0 00:01:29.011 [242/265] Linking target lib/librte_mempool.so.24.0 00:01:29.011 [243/265] Linking target drivers/librte_bus_pci.so.24.0 00:01:29.268 [244/265] Generating symbol file lib/librte_mempool.so.24.0.p/librte_mempool.so.24.0.symbols 00:01:29.268 [245/265] Generating symbol file lib/librte_rcu.so.24.0.p/librte_rcu.so.24.0.symbols 00:01:29.268 [246/265] Linking target drivers/librte_mempool_ring.so.24.0 00:01:29.268 [247/265] Linking target lib/librte_mbuf.so.24.0 00:01:29.268 [248/265] Generating symbol file lib/librte_mbuf.so.24.0.p/librte_mbuf.so.24.0.symbols 00:01:29.268 [249/265] Linking target lib/librte_reorder.so.24.0 00:01:29.268 [250/265] Linking target lib/librte_compressdev.so.24.0 00:01:29.268 [251/265] Linking target lib/librte_net.so.24.0 00:01:29.268 [252/265] Linking target lib/librte_cryptodev.so.24.0 00:01:29.525 [253/265] Generating symbol file lib/librte_net.so.24.0.p/librte_net.so.24.0.symbols 00:01:29.525 [254/265] Generating symbol file lib/librte_cryptodev.so.24.0.p/librte_cryptodev.so.24.0.symbols 00:01:29.525 [255/265] Linking target lib/librte_hash.so.24.0 00:01:29.525 [256/265] Linking target lib/librte_security.so.24.0 00:01:29.525 [257/265] Linking target lib/librte_cmdline.so.24.0 00:01:29.525 [258/265] Linking target lib/librte_ethdev.so.24.0 00:01:29.525 [259/265] Generating symbol file lib/librte_hash.so.24.0.p/librte_hash.so.24.0.symbols 00:01:29.784 [260/265] Generating symbol file lib/librte_ethdev.so.24.0.p/librte_ethdev.so.24.0.symbols 00:01:29.784 [261/265] Linking target lib/librte_power.so.24.0 00:01:32.318 [262/265] Compiling C object lib/librte_vhost.a.p/vhost_virtio_net.c.o 00:01:32.318 [263/265] Linking static target lib/librte_vhost.a 00:01:33.253 [264/265] Generating lib/vhost.sym_chk with a custom command (wrapped by meson to capture output) 00:01:33.253 [265/265] Linking target lib/librte_vhost.so.24.0 00:01:33.253 INFO: autodetecting backend as ninja 00:01:33.253 INFO: calculating backend command to run: /usr/local/bin/ninja -C /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/dpdk/build-tmp -j 48 00:01:34.187 CC lib/ut_mock/mock.o 00:01:34.187 CC lib/log/log.o 00:01:34.187 CC lib/log/log_flags.o 00:01:34.187 CC lib/log/log_deprecated.o 00:01:34.187 CC lib/ut/ut.o 00:01:34.187 LIB libspdk_ut_mock.a 00:01:34.187 SO libspdk_ut_mock.so.5.0 00:01:34.187 LIB libspdk_log.a 00:01:34.187 LIB libspdk_ut.a 00:01:34.187 SO libspdk_log.so.6.1 00:01:34.187 SYMLINK libspdk_ut_mock.so 00:01:34.187 SO libspdk_ut.so.1.0 00:01:34.187 SYMLINK libspdk_log.so 00:01:34.187 SYMLINK libspdk_ut.so 00:01:34.445 CC lib/ioat/ioat.o 00:01:34.445 CXX lib/trace_parser/trace.o 00:01:34.445 CC lib/dma/dma.o 00:01:34.445 CC lib/util/base64.o 00:01:34.445 CC lib/util/bit_array.o 00:01:34.445 CC lib/util/cpuset.o 00:01:34.445 CC lib/util/crc16.o 00:01:34.445 CC lib/util/crc32.o 00:01:34.445 CC lib/util/crc32c.o 00:01:34.445 CC lib/util/crc32_ieee.o 00:01:34.445 CC lib/util/crc64.o 00:01:34.445 CC lib/util/dif.o 00:01:34.445 CC lib/util/fd.o 00:01:34.445 CC lib/util/file.o 00:01:34.445 CC lib/util/hexlify.o 00:01:34.445 CC lib/util/iov.o 00:01:34.445 CC lib/util/math.o 00:01:34.445 CC lib/util/pipe.o 00:01:34.445 CC lib/util/strerror_tls.o 00:01:34.445 CC lib/util/string.o 00:01:34.445 CC lib/util/uuid.o 00:01:34.445 CC lib/util/fd_group.o 00:01:34.445 CC lib/util/xor.o 00:01:34.445 CC lib/util/zipf.o 00:01:34.445 CC lib/vfio_user/host/vfio_user_pci.o 00:01:34.445 CC lib/vfio_user/host/vfio_user.o 00:01:34.445 LIB libspdk_dma.a 00:01:34.703 SO libspdk_dma.so.3.0 00:01:34.703 SYMLINK libspdk_dma.so 00:01:34.703 LIB libspdk_ioat.a 00:01:34.703 SO libspdk_ioat.so.6.0 00:01:34.703 LIB libspdk_vfio_user.a 00:01:34.703 SYMLINK libspdk_ioat.so 00:01:34.703 SO libspdk_vfio_user.so.4.0 00:01:34.703 SYMLINK libspdk_vfio_user.so 00:01:34.961 LIB libspdk_util.a 00:01:34.961 SO libspdk_util.so.8.0 00:01:35.219 SYMLINK libspdk_util.so 00:01:35.219 CC lib/rdma/common.o 00:01:35.219 CC lib/idxd/idxd.o 00:01:35.219 CC lib/json/json_parse.o 00:01:35.219 CC lib/conf/conf.o 00:01:35.219 CC lib/vmd/vmd.o 00:01:35.219 CC lib/json/json_util.o 00:01:35.219 CC lib/idxd/idxd_user.o 00:01:35.219 CC lib/env_dpdk/env.o 00:01:35.219 CC lib/rdma/rdma_verbs.o 00:01:35.219 CC lib/json/json_write.o 00:01:35.219 CC lib/vmd/led.o 00:01:35.219 CC lib/env_dpdk/memory.o 00:01:35.219 CC lib/env_dpdk/pci.o 00:01:35.219 CC lib/env_dpdk/init.o 00:01:35.219 CC lib/env_dpdk/threads.o 00:01:35.219 CC lib/env_dpdk/pci_ioat.o 00:01:35.219 CC lib/env_dpdk/pci_virtio.o 00:01:35.219 CC lib/env_dpdk/pci_vmd.o 00:01:35.219 CC lib/env_dpdk/pci_idxd.o 00:01:35.219 CC lib/env_dpdk/pci_event.o 00:01:35.219 CC lib/env_dpdk/sigbus_handler.o 00:01:35.219 CC lib/env_dpdk/pci_dpdk.o 00:01:35.219 CC lib/env_dpdk/pci_dpdk_2207.o 00:01:35.219 CC lib/env_dpdk/pci_dpdk_2211.o 00:01:35.477 LIB libspdk_trace_parser.a 00:01:35.477 SO libspdk_trace_parser.so.4.0 00:01:35.477 LIB libspdk_conf.a 00:01:35.477 SO libspdk_conf.so.5.0 00:01:35.477 LIB libspdk_rdma.a 00:01:35.477 SYMLINK libspdk_trace_parser.so 00:01:35.477 SYMLINK libspdk_conf.so 00:01:35.477 LIB libspdk_json.a 00:01:35.477 SO libspdk_rdma.so.5.0 00:01:35.477 SO libspdk_json.so.5.1 00:01:35.735 SYMLINK libspdk_rdma.so 00:01:35.735 SYMLINK libspdk_json.so 00:01:35.735 CC lib/jsonrpc/jsonrpc_server.o 00:01:35.735 CC lib/jsonrpc/jsonrpc_server_tcp.o 00:01:35.735 CC lib/jsonrpc/jsonrpc_client.o 00:01:35.735 CC lib/jsonrpc/jsonrpc_client_tcp.o 00:01:35.735 LIB libspdk_idxd.a 00:01:35.735 SO libspdk_idxd.so.11.0 00:01:35.992 SYMLINK libspdk_idxd.so 00:01:35.992 LIB libspdk_vmd.a 00:01:35.992 SO libspdk_vmd.so.5.0 00:01:35.992 SYMLINK libspdk_vmd.so 00:01:35.992 LIB libspdk_jsonrpc.a 00:01:35.992 SO libspdk_jsonrpc.so.5.1 00:01:35.993 SYMLINK libspdk_jsonrpc.so 00:01:36.250 CC lib/rpc/rpc.o 00:01:36.508 LIB libspdk_rpc.a 00:01:36.508 SO libspdk_rpc.so.5.0 00:01:36.508 SYMLINK libspdk_rpc.so 00:01:36.508 CC lib/sock/sock.o 00:01:36.508 CC lib/trace/trace.o 00:01:36.508 CC lib/sock/sock_rpc.o 00:01:36.508 CC lib/trace/trace_flags.o 00:01:36.508 CC lib/trace/trace_rpc.o 00:01:36.508 CC lib/notify/notify.o 00:01:36.508 CC lib/notify/notify_rpc.o 00:01:36.765 LIB libspdk_notify.a 00:01:36.765 SO libspdk_notify.so.5.0 00:01:36.765 SYMLINK libspdk_notify.so 00:01:36.765 LIB libspdk_trace.a 00:01:36.765 SO libspdk_trace.so.9.0 00:01:37.023 SYMLINK libspdk_trace.so 00:01:37.023 LIB libspdk_sock.a 00:01:37.023 SO libspdk_sock.so.8.0 00:01:37.023 CC lib/thread/thread.o 00:01:37.023 CC lib/thread/iobuf.o 00:01:37.023 SYMLINK libspdk_sock.so 00:01:37.023 CC lib/nvme/nvme_ctrlr_cmd.o 00:01:37.023 CC lib/nvme/nvme_ctrlr.o 00:01:37.023 CC lib/nvme/nvme_fabric.o 00:01:37.023 CC lib/nvme/nvme_ns_cmd.o 00:01:37.023 CC lib/nvme/nvme_ns.o 00:01:37.023 CC lib/nvme/nvme_pcie_common.o 00:01:37.023 CC lib/nvme/nvme_pcie.o 00:01:37.281 CC lib/nvme/nvme_qpair.o 00:01:37.281 CC lib/nvme/nvme.o 00:01:37.281 CC lib/nvme/nvme_quirks.o 00:01:37.281 CC lib/nvme/nvme_transport.o 00:01:37.281 CC lib/nvme/nvme_discovery.o 00:01:37.281 CC lib/nvme/nvme_ctrlr_ocssd_cmd.o 00:01:37.281 CC lib/nvme/nvme_ns_ocssd_cmd.o 00:01:37.281 CC lib/nvme/nvme_tcp.o 00:01:37.281 CC lib/nvme/nvme_opal.o 00:01:37.281 CC lib/nvme/nvme_io_msg.o 00:01:37.281 CC lib/nvme/nvme_poll_group.o 00:01:37.281 CC lib/nvme/nvme_zns.o 00:01:37.281 CC lib/nvme/nvme_cuse.o 00:01:37.281 CC lib/nvme/nvme_vfio_user.o 00:01:37.281 CC lib/nvme/nvme_rdma.o 00:01:37.281 LIB libspdk_env_dpdk.a 00:01:37.281 SO libspdk_env_dpdk.so.13.0 00:01:37.549 SYMLINK libspdk_env_dpdk.so 00:01:38.498 LIB libspdk_thread.a 00:01:38.498 SO libspdk_thread.so.9.0 00:01:38.756 SYMLINK libspdk_thread.so 00:01:38.756 CC lib/accel/accel.o 00:01:38.756 CC lib/blob/blobstore.o 00:01:38.756 CC lib/init/json_config.o 00:01:38.756 CC lib/accel/accel_rpc.o 00:01:38.756 CC lib/blob/request.o 00:01:38.756 CC lib/init/subsystem.o 00:01:38.756 CC lib/virtio/virtio.o 00:01:38.756 CC lib/virtio/virtio_vhost_user.o 00:01:38.756 CC lib/blob/zeroes.o 00:01:38.756 CC lib/accel/accel_sw.o 00:01:38.756 CC lib/init/subsystem_rpc.o 00:01:38.756 CC lib/virtio/virtio_vfio_user.o 00:01:38.756 CC lib/blob/blob_bs_dev.o 00:01:38.756 CC lib/init/rpc.o 00:01:38.756 CC lib/virtio/virtio_pci.o 00:01:39.014 LIB libspdk_init.a 00:01:39.014 SO libspdk_init.so.4.0 00:01:39.014 LIB libspdk_virtio.a 00:01:39.014 SYMLINK libspdk_init.so 00:01:39.272 SO libspdk_virtio.so.6.0 00:01:39.272 SYMLINK libspdk_virtio.so 00:01:39.272 CC lib/event/app.o 00:01:39.272 CC lib/event/reactor.o 00:01:39.272 CC lib/event/log_rpc.o 00:01:39.272 CC lib/event/app_rpc.o 00:01:39.272 CC lib/event/scheduler_static.o 00:01:39.530 LIB libspdk_nvme.a 00:01:39.530 SO libspdk_nvme.so.12.0 00:01:39.530 LIB libspdk_event.a 00:01:39.788 SO libspdk_event.so.12.0 00:01:39.788 SYMLINK libspdk_event.so 00:01:39.788 LIB libspdk_accel.a 00:01:39.788 SO libspdk_accel.so.14.0 00:01:39.788 SYMLINK libspdk_nvme.so 00:01:39.788 SYMLINK libspdk_accel.so 00:01:40.046 CC lib/bdev/bdev.o 00:01:40.046 CC lib/bdev/bdev_rpc.o 00:01:40.046 CC lib/bdev/bdev_zone.o 00:01:40.046 CC lib/bdev/part.o 00:01:40.046 CC lib/bdev/scsi_nvme.o 00:01:41.419 LIB libspdk_blob.a 00:01:41.419 SO libspdk_blob.so.10.1 00:01:41.677 SYMLINK libspdk_blob.so 00:01:41.677 CC lib/blobfs/blobfs.o 00:01:41.677 CC lib/blobfs/tree.o 00:01:41.677 CC lib/lvol/lvol.o 00:01:42.611 LIB libspdk_blobfs.a 00:01:42.611 LIB libspdk_lvol.a 00:01:42.611 SO libspdk_blobfs.so.9.0 00:01:42.611 SO libspdk_lvol.so.9.1 00:01:42.611 SYMLINK libspdk_blobfs.so 00:01:42.611 SYMLINK libspdk_lvol.so 00:01:42.874 LIB libspdk_bdev.a 00:01:42.874 SO libspdk_bdev.so.14.0 00:01:42.874 SYMLINK libspdk_bdev.so 00:01:42.874 CC lib/ublk/ublk.o 00:01:42.874 CC lib/nbd/nbd.o 00:01:42.874 CC lib/ublk/ublk_rpc.o 00:01:42.874 CC lib/nvmf/ctrlr.o 00:01:42.874 CC lib/nbd/nbd_rpc.o 00:01:42.874 CC lib/ftl/ftl_core.o 00:01:42.874 CC lib/scsi/dev.o 00:01:42.874 CC lib/nvmf/ctrlr_discovery.o 00:01:42.874 CC lib/ftl/ftl_init.o 00:01:42.874 CC lib/nvmf/ctrlr_bdev.o 00:01:42.874 CC lib/scsi/lun.o 00:01:42.874 CC lib/ftl/ftl_layout.o 00:01:42.874 CC lib/nvmf/subsystem.o 00:01:42.874 CC lib/scsi/port.o 00:01:42.874 CC lib/ftl/ftl_debug.o 00:01:42.874 CC lib/nvmf/nvmf.o 00:01:42.874 CC lib/nvmf/nvmf_rpc.o 00:01:42.874 CC lib/ftl/ftl_io.o 00:01:42.874 CC lib/scsi/scsi.o 00:01:42.874 CC lib/scsi/scsi_bdev.o 00:01:42.874 CC lib/nvmf/transport.o 00:01:42.874 CC lib/ftl/ftl_sb.o 00:01:42.874 CC lib/nvmf/tcp.o 00:01:42.874 CC lib/scsi/scsi_rpc.o 00:01:42.874 CC lib/scsi/scsi_pr.o 00:01:42.874 CC lib/nvmf/rdma.o 00:01:42.874 CC lib/scsi/task.o 00:01:42.874 CC lib/ftl/ftl_l2p.o 00:01:42.874 CC lib/ftl/ftl_l2p_flat.o 00:01:42.874 CC lib/ftl/ftl_nv_cache.o 00:01:42.874 CC lib/ftl/ftl_band.o 00:01:42.874 CC lib/ftl/ftl_band_ops.o 00:01:42.874 CC lib/ftl/ftl_writer.o 00:01:42.874 CC lib/ftl/ftl_rq.o 00:01:42.874 CC lib/ftl/ftl_reloc.o 00:01:42.875 CC lib/ftl/ftl_l2p_cache.o 00:01:42.875 CC lib/ftl/ftl_p2l.o 00:01:42.875 CC lib/ftl/mngt/ftl_mngt.o 00:01:42.875 CC lib/ftl/mngt/ftl_mngt_bdev.o 00:01:42.875 CC lib/ftl/mngt/ftl_mngt_shutdown.o 00:01:42.875 CC lib/ftl/mngt/ftl_mngt_startup.o 00:01:42.875 CC lib/ftl/mngt/ftl_mngt_md.o 00:01:42.875 CC lib/ftl/mngt/ftl_mngt_misc.o 00:01:42.875 CC lib/ftl/mngt/ftl_mngt_ioch.o 00:01:42.875 CC lib/ftl/mngt/ftl_mngt_l2p.o 00:01:42.875 CC lib/ftl/mngt/ftl_mngt_band.o 00:01:42.875 CC lib/ftl/mngt/ftl_mngt_self_test.o 00:01:42.875 CC lib/ftl/mngt/ftl_mngt_p2l.o 00:01:43.444 CC lib/ftl/mngt/ftl_mngt_recovery.o 00:01:43.444 CC lib/ftl/mngt/ftl_mngt_upgrade.o 00:01:43.444 CC lib/ftl/utils/ftl_conf.o 00:01:43.444 CC lib/ftl/utils/ftl_md.o 00:01:43.444 CC lib/ftl/utils/ftl_mempool.o 00:01:43.444 CC lib/ftl/utils/ftl_bitmap.o 00:01:43.444 CC lib/ftl/utils/ftl_property.o 00:01:43.444 CC lib/ftl/utils/ftl_layout_tracker_bdev.o 00:01:43.444 CC lib/ftl/upgrade/ftl_layout_upgrade.o 00:01:43.444 CC lib/ftl/upgrade/ftl_sb_upgrade.o 00:01:43.444 CC lib/ftl/upgrade/ftl_p2l_upgrade.o 00:01:43.444 CC lib/ftl/upgrade/ftl_band_upgrade.o 00:01:43.444 CC lib/ftl/upgrade/ftl_chunk_upgrade.o 00:01:43.444 CC lib/ftl/upgrade/ftl_sb_v3.o 00:01:43.444 CC lib/ftl/upgrade/ftl_sb_v5.o 00:01:43.444 CC lib/ftl/nvc/ftl_nvc_dev.o 00:01:43.444 CC lib/ftl/nvc/ftl_nvc_bdev_vss.o 00:01:43.444 CC lib/ftl/base/ftl_base_dev.o 00:01:43.444 CC lib/ftl/base/ftl_base_bdev.o 00:01:43.444 CC lib/ftl/ftl_trace.o 00:01:43.702 LIB libspdk_nbd.a 00:01:43.702 SO libspdk_nbd.so.6.0 00:01:43.702 SYMLINK libspdk_nbd.so 00:01:43.961 LIB libspdk_scsi.a 00:01:43.961 SO libspdk_scsi.so.8.0 00:01:43.961 LIB libspdk_ublk.a 00:01:43.961 SO libspdk_ublk.so.2.0 00:01:43.961 SYMLINK libspdk_scsi.so 00:01:43.961 SYMLINK libspdk_ublk.so 00:01:43.961 CC lib/vhost/vhost.o 00:01:43.961 CC lib/iscsi/conn.o 00:01:43.961 CC lib/vhost/vhost_rpc.o 00:01:43.961 CC lib/vhost/vhost_scsi.o 00:01:43.961 CC lib/iscsi/init_grp.o 00:01:43.961 CC lib/vhost/vhost_blk.o 00:01:43.961 CC lib/iscsi/iscsi.o 00:01:43.961 CC lib/vhost/rte_vhost_user.o 00:01:43.961 CC lib/iscsi/md5.o 00:01:43.961 CC lib/iscsi/param.o 00:01:43.961 CC lib/iscsi/portal_grp.o 00:01:44.219 CC lib/iscsi/tgt_node.o 00:01:44.219 CC lib/iscsi/iscsi_subsystem.o 00:01:44.219 CC lib/iscsi/iscsi_rpc.o 00:01:44.219 CC lib/iscsi/task.o 00:01:44.219 LIB libspdk_ftl.a 00:01:44.476 SO libspdk_ftl.so.8.0 00:01:44.732 SYMLINK libspdk_ftl.so 00:01:45.297 LIB libspdk_vhost.a 00:01:45.297 SO libspdk_vhost.so.7.1 00:01:45.297 SYMLINK libspdk_vhost.so 00:01:45.297 LIB libspdk_nvmf.a 00:01:45.555 LIB libspdk_iscsi.a 00:01:45.555 SO libspdk_nvmf.so.17.0 00:01:45.555 SO libspdk_iscsi.so.7.0 00:01:45.555 SYMLINK libspdk_nvmf.so 00:01:45.555 SYMLINK libspdk_iscsi.so 00:01:45.813 CC module/env_dpdk/env_dpdk_rpc.o 00:01:45.813 CC module/accel/dsa/accel_dsa.o 00:01:45.813 CC module/accel/error/accel_error.o 00:01:45.813 CC module/accel/dsa/accel_dsa_rpc.o 00:01:45.813 CC module/blob/bdev/blob_bdev.o 00:01:45.813 CC module/accel/error/accel_error_rpc.o 00:01:45.813 CC module/scheduler/dpdk_governor/dpdk_governor.o 00:01:45.813 CC module/accel/ioat/accel_ioat.o 00:01:45.813 CC module/scheduler/gscheduler/gscheduler.o 00:01:45.813 CC module/accel/ioat/accel_ioat_rpc.o 00:01:45.813 CC module/accel/iaa/accel_iaa.o 00:01:45.813 CC module/scheduler/dynamic/scheduler_dynamic.o 00:01:45.813 CC module/accel/iaa/accel_iaa_rpc.o 00:01:45.813 CC module/sock/posix/posix.o 00:01:46.072 LIB libspdk_env_dpdk_rpc.a 00:01:46.072 SO libspdk_env_dpdk_rpc.so.5.0 00:01:46.072 LIB libspdk_scheduler_gscheduler.a 00:01:46.072 SYMLINK libspdk_env_dpdk_rpc.so 00:01:46.072 LIB libspdk_scheduler_dpdk_governor.a 00:01:46.072 SO libspdk_scheduler_gscheduler.so.3.0 00:01:46.072 SO libspdk_scheduler_dpdk_governor.so.3.0 00:01:46.072 LIB libspdk_accel_error.a 00:01:46.072 LIB libspdk_accel_ioat.a 00:01:46.072 LIB libspdk_scheduler_dynamic.a 00:01:46.072 LIB libspdk_accel_iaa.a 00:01:46.072 SO libspdk_accel_error.so.1.0 00:01:46.072 SO libspdk_accel_ioat.so.5.0 00:01:46.072 SYMLINK libspdk_scheduler_gscheduler.so 00:01:46.072 SO libspdk_scheduler_dynamic.so.3.0 00:01:46.072 SYMLINK libspdk_scheduler_dpdk_governor.so 00:01:46.072 SO libspdk_accel_iaa.so.2.0 00:01:46.072 LIB libspdk_accel_dsa.a 00:01:46.072 LIB libspdk_blob_bdev.a 00:01:46.072 SYMLINK libspdk_accel_error.so 00:01:46.072 SYMLINK libspdk_accel_ioat.so 00:01:46.072 SYMLINK libspdk_scheduler_dynamic.so 00:01:46.072 SO libspdk_accel_dsa.so.4.0 00:01:46.334 SO libspdk_blob_bdev.so.10.1 00:01:46.334 SYMLINK libspdk_accel_iaa.so 00:01:46.334 SYMLINK libspdk_accel_dsa.so 00:01:46.334 SYMLINK libspdk_blob_bdev.so 00:01:46.334 CC module/bdev/error/vbdev_error.o 00:01:46.334 CC module/bdev/null/bdev_null.o 00:01:46.334 CC module/bdev/raid/bdev_raid.o 00:01:46.334 CC module/bdev/null/bdev_null_rpc.o 00:01:46.334 CC module/bdev/raid/bdev_raid_rpc.o 00:01:46.334 CC module/bdev/malloc/bdev_malloc.o 00:01:46.334 CC module/bdev/lvol/vbdev_lvol.o 00:01:46.334 CC module/bdev/ftl/bdev_ftl.o 00:01:46.334 CC module/bdev/error/vbdev_error_rpc.o 00:01:46.334 CC module/bdev/delay/vbdev_delay_rpc.o 00:01:46.334 CC module/bdev/split/vbdev_split.o 00:01:46.334 CC module/bdev/raid/bdev_raid_sb.o 00:01:46.334 CC module/bdev/delay/vbdev_delay.o 00:01:46.334 CC module/blobfs/bdev/blobfs_bdev.o 00:01:46.334 CC module/bdev/lvol/vbdev_lvol_rpc.o 00:01:46.334 CC module/bdev/ftl/bdev_ftl_rpc.o 00:01:46.334 CC module/bdev/raid/raid0.o 00:01:46.334 CC module/bdev/zone_block/vbdev_zone_block.o 00:01:46.334 CC module/bdev/passthru/vbdev_passthru.o 00:01:46.334 CC module/bdev/raid/raid1.o 00:01:46.334 CC module/bdev/nvme/bdev_nvme.o 00:01:46.334 CC module/bdev/raid/concat.o 00:01:46.334 CC module/bdev/passthru/vbdev_passthru_rpc.o 00:01:46.334 CC module/bdev/virtio/bdev_virtio_scsi.o 00:01:46.334 CC module/bdev/aio/bdev_aio.o 00:01:46.334 CC module/bdev/zone_block/vbdev_zone_block_rpc.o 00:01:46.334 CC module/bdev/virtio/bdev_virtio_blk.o 00:01:46.334 CC module/bdev/malloc/bdev_malloc_rpc.o 00:01:46.334 CC module/bdev/nvme/bdev_nvme_rpc.o 00:01:46.334 CC module/bdev/aio/bdev_aio_rpc.o 00:01:46.334 CC module/bdev/split/vbdev_split_rpc.o 00:01:46.334 CC module/bdev/virtio/bdev_virtio_rpc.o 00:01:46.334 CC module/blobfs/bdev/blobfs_bdev_rpc.o 00:01:46.334 CC module/bdev/iscsi/bdev_iscsi.o 00:01:46.334 CC module/bdev/gpt/gpt.o 00:01:46.334 CC module/bdev/iscsi/bdev_iscsi_rpc.o 00:01:46.334 CC module/bdev/gpt/vbdev_gpt.o 00:01:46.334 CC module/bdev/nvme/nvme_rpc.o 00:01:46.334 CC module/bdev/nvme/bdev_mdns_client.o 00:01:46.334 CC module/bdev/nvme/vbdev_opal.o 00:01:46.334 CC module/bdev/nvme/vbdev_opal_rpc.o 00:01:46.334 CC module/bdev/nvme/bdev_nvme_cuse_rpc.o 00:01:46.901 LIB libspdk_sock_posix.a 00:01:46.901 SO libspdk_sock_posix.so.5.0 00:01:46.901 LIB libspdk_blobfs_bdev.a 00:01:46.901 SO libspdk_blobfs_bdev.so.5.0 00:01:46.901 LIB libspdk_bdev_split.a 00:01:46.901 SYMLINK libspdk_sock_posix.so 00:01:46.901 SO libspdk_bdev_split.so.5.0 00:01:46.901 LIB libspdk_bdev_error.a 00:01:46.901 SYMLINK libspdk_blobfs_bdev.so 00:01:46.901 LIB libspdk_bdev_null.a 00:01:46.901 SO libspdk_bdev_error.so.5.0 00:01:46.901 LIB libspdk_bdev_gpt.a 00:01:46.901 SYMLINK libspdk_bdev_split.so 00:01:46.901 SO libspdk_bdev_null.so.5.0 00:01:46.901 SO libspdk_bdev_gpt.so.5.0 00:01:46.901 LIB libspdk_bdev_zone_block.a 00:01:46.901 LIB libspdk_bdev_ftl.a 00:01:46.901 SYMLINK libspdk_bdev_error.so 00:01:46.901 SO libspdk_bdev_zone_block.so.5.0 00:01:46.901 LIB libspdk_bdev_passthru.a 00:01:46.901 SO libspdk_bdev_ftl.so.5.0 00:01:46.901 LIB libspdk_bdev_aio.a 00:01:46.901 SYMLINK libspdk_bdev_null.so 00:01:46.901 SYMLINK libspdk_bdev_gpt.so 00:01:46.901 SO libspdk_bdev_passthru.so.5.0 00:01:46.901 LIB libspdk_bdev_iscsi.a 00:01:46.901 LIB libspdk_bdev_malloc.a 00:01:46.901 SO libspdk_bdev_aio.so.5.0 00:01:46.901 SYMLINK libspdk_bdev_zone_block.so 00:01:47.159 SO libspdk_bdev_iscsi.so.5.0 00:01:47.159 SO libspdk_bdev_malloc.so.5.0 00:01:47.159 SYMLINK libspdk_bdev_ftl.so 00:01:47.159 LIB libspdk_bdev_delay.a 00:01:47.159 SYMLINK libspdk_bdev_passthru.so 00:01:47.159 SYMLINK libspdk_bdev_aio.so 00:01:47.159 SO libspdk_bdev_delay.so.5.0 00:01:47.159 SYMLINK libspdk_bdev_iscsi.so 00:01:47.159 SYMLINK libspdk_bdev_malloc.so 00:01:47.159 LIB libspdk_bdev_virtio.a 00:01:47.159 SYMLINK libspdk_bdev_delay.so 00:01:47.159 LIB libspdk_bdev_lvol.a 00:01:47.159 SO libspdk_bdev_virtio.so.5.0 00:01:47.159 SO libspdk_bdev_lvol.so.5.0 00:01:47.159 SYMLINK libspdk_bdev_virtio.so 00:01:47.159 SYMLINK libspdk_bdev_lvol.so 00:01:47.417 LIB libspdk_bdev_raid.a 00:01:47.417 SO libspdk_bdev_raid.so.5.0 00:01:47.675 SYMLINK libspdk_bdev_raid.so 00:01:48.608 LIB libspdk_bdev_nvme.a 00:01:48.866 SO libspdk_bdev_nvme.so.6.0 00:01:48.866 SYMLINK libspdk_bdev_nvme.so 00:01:49.123 CC module/event/subsystems/scheduler/scheduler.o 00:01:49.123 CC module/event/subsystems/sock/sock.o 00:01:49.123 CC module/event/subsystems/iobuf/iobuf.o 00:01:49.123 CC module/event/subsystems/vmd/vmd.o 00:01:49.123 CC module/event/subsystems/iobuf/iobuf_rpc.o 00:01:49.123 CC module/event/subsystems/vhost_blk/vhost_blk.o 00:01:49.123 CC module/event/subsystems/vmd/vmd_rpc.o 00:01:49.123 LIB libspdk_event_sock.a 00:01:49.123 LIB libspdk_event_scheduler.a 00:01:49.123 LIB libspdk_event_vhost_blk.a 00:01:49.123 LIB libspdk_event_vmd.a 00:01:49.123 SO libspdk_event_sock.so.4.0 00:01:49.123 LIB libspdk_event_iobuf.a 00:01:49.123 SO libspdk_event_vhost_blk.so.2.0 00:01:49.123 SO libspdk_event_scheduler.so.3.0 00:01:49.381 SO libspdk_event_vmd.so.5.0 00:01:49.382 SO libspdk_event_iobuf.so.2.0 00:01:49.382 SYMLINK libspdk_event_sock.so 00:01:49.382 SYMLINK libspdk_event_vhost_blk.so 00:01:49.382 SYMLINK libspdk_event_scheduler.so 00:01:49.382 SYMLINK libspdk_event_vmd.so 00:01:49.382 SYMLINK libspdk_event_iobuf.so 00:01:49.382 CC module/event/subsystems/accel/accel.o 00:01:49.640 LIB libspdk_event_accel.a 00:01:49.640 SO libspdk_event_accel.so.5.0 00:01:49.640 SYMLINK libspdk_event_accel.so 00:01:49.898 CC module/event/subsystems/bdev/bdev.o 00:01:49.898 LIB libspdk_event_bdev.a 00:01:49.898 SO libspdk_event_bdev.so.5.0 00:01:49.898 SYMLINK libspdk_event_bdev.so 00:01:50.156 CC module/event/subsystems/nbd/nbd.o 00:01:50.156 CC module/event/subsystems/scsi/scsi.o 00:01:50.156 CC module/event/subsystems/nvmf/nvmf_rpc.o 00:01:50.156 CC module/event/subsystems/ublk/ublk.o 00:01:50.156 CC module/event/subsystems/nvmf/nvmf_tgt.o 00:01:50.156 LIB libspdk_event_ublk.a 00:01:50.156 LIB libspdk_event_nbd.a 00:01:50.156 LIB libspdk_event_scsi.a 00:01:50.413 SO libspdk_event_ublk.so.2.0 00:01:50.413 SO libspdk_event_nbd.so.5.0 00:01:50.413 SO libspdk_event_scsi.so.5.0 00:01:50.413 SYMLINK libspdk_event_nbd.so 00:01:50.413 SYMLINK libspdk_event_ublk.so 00:01:50.413 LIB libspdk_event_nvmf.a 00:01:50.413 SYMLINK libspdk_event_scsi.so 00:01:50.413 SO libspdk_event_nvmf.so.5.0 00:01:50.413 SYMLINK libspdk_event_nvmf.so 00:01:50.413 CC module/event/subsystems/vhost_scsi/vhost_scsi.o 00:01:50.413 CC module/event/subsystems/iscsi/iscsi.o 00:01:50.672 LIB libspdk_event_vhost_scsi.a 00:01:50.672 SO libspdk_event_vhost_scsi.so.2.0 00:01:50.672 LIB libspdk_event_iscsi.a 00:01:50.672 SO libspdk_event_iscsi.so.5.0 00:01:50.672 SYMLINK libspdk_event_vhost_scsi.so 00:01:50.672 SYMLINK libspdk_event_iscsi.so 00:01:50.672 SO libspdk.so.5.0 00:01:50.672 SYMLINK libspdk.so 00:01:50.934 CC app/spdk_nvme_perf/perf.o 00:01:50.934 CC app/trace_record/trace_record.o 00:01:50.934 CXX app/trace/trace.o 00:01:50.934 CC app/spdk_lspci/spdk_lspci.o 00:01:50.934 CC app/spdk_top/spdk_top.o 00:01:50.934 CC app/spdk_nvme_identify/identify.o 00:01:50.934 CC test/rpc_client/rpc_client_test.o 00:01:50.934 CC app/spdk_nvme_discover/discovery_aer.o 00:01:50.934 TEST_HEADER include/spdk/accel.h 00:01:50.934 TEST_HEADER include/spdk/accel_module.h 00:01:50.934 TEST_HEADER include/spdk/assert.h 00:01:50.934 TEST_HEADER include/spdk/barrier.h 00:01:50.934 TEST_HEADER include/spdk/base64.h 00:01:50.934 TEST_HEADER include/spdk/bdev.h 00:01:50.934 TEST_HEADER include/spdk/bdev_module.h 00:01:50.934 TEST_HEADER include/spdk/bdev_zone.h 00:01:50.934 TEST_HEADER include/spdk/bit_array.h 00:01:50.934 TEST_HEADER include/spdk/bit_pool.h 00:01:50.934 TEST_HEADER include/spdk/blob_bdev.h 00:01:50.934 TEST_HEADER include/spdk/blobfs_bdev.h 00:01:50.934 TEST_HEADER include/spdk/blobfs.h 00:01:50.934 TEST_HEADER include/spdk/blob.h 00:01:50.934 CC app/spdk_dd/spdk_dd.o 00:01:50.934 TEST_HEADER include/spdk/conf.h 00:01:50.934 CC examples/interrupt_tgt/interrupt_tgt.o 00:01:50.934 TEST_HEADER include/spdk/config.h 00:01:50.934 TEST_HEADER include/spdk/cpuset.h 00:01:50.934 TEST_HEADER include/spdk/crc16.h 00:01:50.934 CC app/nvmf_tgt/nvmf_main.o 00:01:50.934 TEST_HEADER include/spdk/crc32.h 00:01:50.934 CC app/iscsi_tgt/iscsi_tgt.o 00:01:50.934 TEST_HEADER include/spdk/crc64.h 00:01:50.934 TEST_HEADER include/spdk/dif.h 00:01:50.934 CC examples/nvme/hello_world/hello_world.o 00:01:50.934 TEST_HEADER include/spdk/dma.h 00:01:50.934 CC examples/ioat/perf/perf.o 00:01:50.934 CC examples/nvme/reconnect/reconnect.o 00:01:50.934 CC examples/nvme/nvme_manage/nvme_manage.o 00:01:50.934 CC examples/ioat/verify/verify.o 00:01:50.934 TEST_HEADER include/spdk/endian.h 00:01:50.934 CC examples/nvme/pmr_persistence/pmr_persistence.o 00:01:50.934 CC examples/sock/hello_world/hello_sock.o 00:01:50.934 CC examples/util/zipf/zipf.o 00:01:50.934 CC examples/accel/perf/accel_perf.o 00:01:50.934 CC examples/idxd/perf/perf.o 00:01:50.934 TEST_HEADER include/spdk/env_dpdk.h 00:01:50.934 CC examples/nvme/abort/abort.o 00:01:50.934 CC examples/vmd/lsvmd/lsvmd.o 00:01:50.934 CC app/vhost/vhost.o 00:01:50.934 CC examples/nvme/arbitration/arbitration.o 00:01:50.934 TEST_HEADER include/spdk/env.h 00:01:50.934 CC examples/nvme/cmb_copy/cmb_copy.o 00:01:50.934 CC examples/nvme/hotplug/hotplug.o 00:01:50.934 CC app/fio/nvme/fio_plugin.o 00:01:50.934 TEST_HEADER include/spdk/event.h 00:01:50.934 TEST_HEADER include/spdk/fd_group.h 00:01:50.934 CC test/thread/poller_perf/poller_perf.o 00:01:50.934 TEST_HEADER include/spdk/fd.h 00:01:50.934 TEST_HEADER include/spdk/file.h 00:01:50.934 CC test/nvme/aer/aer.o 00:01:50.934 CC test/event/event_perf/event_perf.o 00:01:50.934 TEST_HEADER include/spdk/ftl.h 00:01:50.934 TEST_HEADER include/spdk/gpt_spec.h 00:01:50.934 TEST_HEADER include/spdk/hexlify.h 00:01:51.196 CC app/spdk_tgt/spdk_tgt.o 00:01:51.196 TEST_HEADER include/spdk/histogram_data.h 00:01:51.196 TEST_HEADER include/spdk/idxd.h 00:01:51.196 TEST_HEADER include/spdk/idxd_spec.h 00:01:51.196 TEST_HEADER include/spdk/init.h 00:01:51.196 TEST_HEADER include/spdk/ioat.h 00:01:51.196 TEST_HEADER include/spdk/ioat_spec.h 00:01:51.196 TEST_HEADER include/spdk/iscsi_spec.h 00:01:51.196 TEST_HEADER include/spdk/json.h 00:01:51.196 TEST_HEADER include/spdk/jsonrpc.h 00:01:51.196 CC examples/blob/cli/blobcli.o 00:01:51.196 TEST_HEADER include/spdk/likely.h 00:01:51.196 TEST_HEADER include/spdk/log.h 00:01:51.196 CC examples/blob/hello_world/hello_blob.o 00:01:51.196 CC test/blobfs/mkfs/mkfs.o 00:01:51.196 TEST_HEADER include/spdk/lvol.h 00:01:51.196 CC examples/nvmf/nvmf/nvmf.o 00:01:51.196 CC examples/bdev/hello_world/hello_bdev.o 00:01:51.196 CC test/accel/dif/dif.o 00:01:51.196 TEST_HEADER include/spdk/memory.h 00:01:51.196 CC app/fio/bdev/fio_plugin.o 00:01:51.196 CC test/dma/test_dma/test_dma.o 00:01:51.196 TEST_HEADER include/spdk/mmio.h 00:01:51.196 TEST_HEADER include/spdk/nbd.h 00:01:51.196 CC examples/thread/thread/thread_ex.o 00:01:51.196 CC test/app/bdev_svc/bdev_svc.o 00:01:51.196 TEST_HEADER include/spdk/notify.h 00:01:51.196 CC test/bdev/bdevio/bdevio.o 00:01:51.196 TEST_HEADER include/spdk/nvme.h 00:01:51.196 CC examples/bdev/bdevperf/bdevperf.o 00:01:51.196 CC test/lvol/esnap/esnap.o 00:01:51.196 TEST_HEADER include/spdk/nvme_intel.h 00:01:51.196 TEST_HEADER include/spdk/nvme_ocssd.h 00:01:51.196 CC test/env/mem_callbacks/mem_callbacks.o 00:01:51.196 TEST_HEADER include/spdk/nvme_ocssd_spec.h 00:01:51.196 TEST_HEADER include/spdk/nvme_spec.h 00:01:51.196 TEST_HEADER include/spdk/nvme_zns.h 00:01:51.196 TEST_HEADER include/spdk/nvmf_cmd.h 00:01:51.196 TEST_HEADER include/spdk/nvmf_fc_spec.h 00:01:51.196 TEST_HEADER include/spdk/nvmf.h 00:01:51.196 TEST_HEADER include/spdk/nvmf_spec.h 00:01:51.196 TEST_HEADER include/spdk/nvmf_transport.h 00:01:51.196 TEST_HEADER include/spdk/opal.h 00:01:51.196 TEST_HEADER include/spdk/opal_spec.h 00:01:51.196 TEST_HEADER include/spdk/pci_ids.h 00:01:51.196 TEST_HEADER include/spdk/pipe.h 00:01:51.196 TEST_HEADER include/spdk/queue.h 00:01:51.196 TEST_HEADER include/spdk/reduce.h 00:01:51.196 TEST_HEADER include/spdk/rpc.h 00:01:51.196 TEST_HEADER include/spdk/scheduler.h 00:01:51.196 TEST_HEADER include/spdk/scsi.h 00:01:51.196 LINK spdk_lspci 00:01:51.196 TEST_HEADER include/spdk/scsi_spec.h 00:01:51.196 TEST_HEADER include/spdk/sock.h 00:01:51.196 TEST_HEADER include/spdk/stdinc.h 00:01:51.196 TEST_HEADER include/spdk/string.h 00:01:51.196 TEST_HEADER include/spdk/thread.h 00:01:51.196 TEST_HEADER include/spdk/trace.h 00:01:51.196 TEST_HEADER include/spdk/trace_parser.h 00:01:51.196 TEST_HEADER include/spdk/tree.h 00:01:51.196 TEST_HEADER include/spdk/ublk.h 00:01:51.196 TEST_HEADER include/spdk/util.h 00:01:51.196 TEST_HEADER include/spdk/uuid.h 00:01:51.196 TEST_HEADER include/spdk/version.h 00:01:51.196 TEST_HEADER include/spdk/vfio_user_pci.h 00:01:51.196 TEST_HEADER include/spdk/vfio_user_spec.h 00:01:51.196 TEST_HEADER include/spdk/vhost.h 00:01:51.196 TEST_HEADER include/spdk/vmd.h 00:01:51.196 TEST_HEADER include/spdk/xor.h 00:01:51.196 TEST_HEADER include/spdk/zipf.h 00:01:51.196 CXX test/cpp_headers/accel.o 00:01:51.196 LINK lsvmd 00:01:51.196 LINK rpc_client_test 00:01:51.457 LINK spdk_nvme_discover 00:01:51.457 LINK poller_perf 00:01:51.457 LINK zipf 00:01:51.458 LINK event_perf 00:01:51.458 LINK interrupt_tgt 00:01:51.458 LINK pmr_persistence 00:01:51.458 LINK cmb_copy 00:01:51.458 LINK nvmf_tgt 00:01:51.458 LINK spdk_trace_record 00:01:51.458 LINK vhost 00:01:51.458 LINK iscsi_tgt 00:01:51.458 LINK verify 00:01:51.458 LINK ioat_perf 00:01:51.458 LINK spdk_tgt 00:01:51.458 LINK hello_world 00:01:51.458 LINK bdev_svc 00:01:51.458 LINK mkfs 00:01:51.458 LINK hello_sock 00:01:51.458 LINK hotplug 00:01:51.458 LINK hello_blob 00:01:51.721 LINK hello_bdev 00:01:51.721 LINK aer 00:01:51.721 LINK thread 00:01:51.721 CC test/env/vtophys/vtophys.o 00:01:51.721 CXX test/cpp_headers/accel_module.o 00:01:51.721 LINK nvmf 00:01:51.721 LINK arbitration 00:01:51.721 LINK idxd_perf 00:01:51.721 CXX test/cpp_headers/assert.o 00:01:51.721 LINK reconnect 00:01:51.721 LINK spdk_dd 00:01:51.721 CXX test/cpp_headers/barrier.o 00:01:51.721 CC examples/vmd/led/led.o 00:01:51.721 CC test/env/env_dpdk_post_init/env_dpdk_post_init.o 00:01:51.721 CC test/event/reactor/reactor.o 00:01:51.721 CC test/env/memory/memory_ut.o 00:01:51.721 LINK spdk_trace 00:01:51.721 LINK abort 00:01:51.721 CC test/nvme/reset/reset.o 00:01:51.721 CXX test/cpp_headers/base64.o 00:01:51.721 LINK dif 00:01:51.721 CXX test/cpp_headers/bdev.o 00:01:51.721 CXX test/cpp_headers/bdev_module.o 00:01:51.721 CC test/env/pci/pci_ut.o 00:01:51.721 LINK test_dma 00:01:51.721 CXX test/cpp_headers/bdev_zone.o 00:01:51.721 CC test/nvme/sgl/sgl.o 00:01:51.721 CC test/app/fuzz/nvme_fuzz/nvme_fuzz.o 00:01:51.986 CC test/event/reactor_perf/reactor_perf.o 00:01:51.986 LINK accel_perf 00:01:51.986 CC test/nvme/e2edp/nvme_dp.o 00:01:51.986 LINK bdevio 00:01:51.986 CXX test/cpp_headers/bit_array.o 00:01:51.986 CC test/app/histogram_perf/histogram_perf.o 00:01:51.986 LINK vtophys 00:01:51.986 CC test/event/app_repeat/app_repeat.o 00:01:51.986 CC test/app/fuzz/iscsi_fuzz/iscsi_fuzz.o 00:01:51.986 CXX test/cpp_headers/bit_pool.o 00:01:51.986 LINK nvme_manage 00:01:51.986 CXX test/cpp_headers/blob_bdev.o 00:01:51.986 CXX test/cpp_headers/blobfs_bdev.o 00:01:51.986 CC test/app/fuzz/vhost_fuzz/vhost_fuzz_rpc.o 00:01:51.986 LINK reactor 00:01:51.986 LINK led 00:01:51.986 LINK blobcli 00:01:51.986 LINK spdk_nvme 00:01:51.986 CC test/event/scheduler/scheduler.o 00:01:51.986 LINK env_dpdk_post_init 00:01:51.986 LINK spdk_bdev 00:01:51.986 CC test/app/fuzz/vhost_fuzz/vhost_fuzz.o 00:01:51.986 CC test/app/jsoncat/jsoncat.o 00:01:51.986 CC test/app/stub/stub.o 00:01:51.986 CC test/nvme/overhead/overhead.o 00:01:51.986 CC test/nvme/err_injection/err_injection.o 00:01:51.986 CC test/nvme/startup/startup.o 00:01:52.247 CC test/nvme/reserve/reserve.o 00:01:52.247 LINK reactor_perf 00:01:52.247 CXX test/cpp_headers/blobfs.o 00:01:52.247 LINK histogram_perf 00:01:52.247 CC test/nvme/boot_partition/boot_partition.o 00:01:52.247 CC test/nvme/connect_stress/connect_stress.o 00:01:52.247 CXX test/cpp_headers/blob.o 00:01:52.247 CC test/nvme/simple_copy/simple_copy.o 00:01:52.247 CXX test/cpp_headers/conf.o 00:01:52.247 CXX test/cpp_headers/config.o 00:01:52.247 CXX test/cpp_headers/cpuset.o 00:01:52.247 LINK reset 00:01:52.247 CXX test/cpp_headers/crc16.o 00:01:52.247 CXX test/cpp_headers/crc32.o 00:01:52.247 LINK app_repeat 00:01:52.247 CXX test/cpp_headers/crc64.o 00:01:52.247 CXX test/cpp_headers/dif.o 00:01:52.247 CC test/nvme/compliance/nvme_compliance.o 00:01:52.247 CXX test/cpp_headers/dma.o 00:01:52.247 CXX test/cpp_headers/endian.o 00:01:52.247 CC test/nvme/doorbell_aers/doorbell_aers.o 00:01:52.247 CXX test/cpp_headers/env_dpdk.o 00:01:52.247 CC test/nvme/fused_ordering/fused_ordering.o 00:01:52.247 CC test/nvme/fdp/fdp.o 00:01:52.247 CC test/nvme/cuse/cuse.o 00:01:52.247 LINK mem_callbacks 00:01:52.247 LINK jsoncat 00:01:52.247 CXX test/cpp_headers/env.o 00:01:52.247 LINK sgl 00:01:52.512 CXX test/cpp_headers/event.o 00:01:52.512 CXX test/cpp_headers/fd_group.o 00:01:52.512 LINK spdk_nvme_perf 00:01:52.512 LINK nvme_dp 00:01:52.512 CXX test/cpp_headers/fd.o 00:01:52.512 CXX test/cpp_headers/file.o 00:01:52.512 LINK stub 00:01:52.512 CXX test/cpp_headers/ftl.o 00:01:52.512 LINK startup 00:01:52.512 CXX test/cpp_headers/gpt_spec.o 00:01:52.512 LINK err_injection 00:01:52.512 LINK spdk_nvme_identify 00:01:52.512 CXX test/cpp_headers/hexlify.o 00:01:52.512 LINK scheduler 00:01:52.512 LINK pci_ut 00:01:52.512 LINK reserve 00:01:52.512 LINK boot_partition 00:01:52.512 CXX test/cpp_headers/histogram_data.o 00:01:52.512 LINK spdk_top 00:01:52.512 LINK bdevperf 00:01:52.512 CXX test/cpp_headers/idxd.o 00:01:52.512 CXX test/cpp_headers/idxd_spec.o 00:01:52.512 LINK connect_stress 00:01:52.512 CXX test/cpp_headers/init.o 00:01:52.512 LINK nvme_fuzz 00:01:52.512 CXX test/cpp_headers/ioat.o 00:01:52.512 CXX test/cpp_headers/ioat_spec.o 00:01:52.512 CXX test/cpp_headers/iscsi_spec.o 00:01:52.512 CXX test/cpp_headers/json.o 00:01:52.512 CXX test/cpp_headers/jsonrpc.o 00:01:52.776 CXX test/cpp_headers/likely.o 00:01:52.776 CXX test/cpp_headers/log.o 00:01:52.776 CXX test/cpp_headers/lvol.o 00:01:52.776 CXX test/cpp_headers/mmio.o 00:01:52.776 CXX test/cpp_headers/memory.o 00:01:52.776 CXX test/cpp_headers/nbd.o 00:01:52.776 LINK simple_copy 00:01:52.776 LINK overhead 00:01:52.776 LINK doorbell_aers 00:01:52.776 CXX test/cpp_headers/notify.o 00:01:52.776 LINK fused_ordering 00:01:52.777 CXX test/cpp_headers/nvme.o 00:01:52.777 CXX test/cpp_headers/nvme_intel.o 00:01:52.777 CXX test/cpp_headers/nvme_ocssd.o 00:01:52.777 CXX test/cpp_headers/nvme_ocssd_spec.o 00:01:52.777 CXX test/cpp_headers/nvme_spec.o 00:01:52.777 CXX test/cpp_headers/nvme_zns.o 00:01:52.777 CXX test/cpp_headers/nvmf_cmd.o 00:01:52.777 CXX test/cpp_headers/nvmf_fc_spec.o 00:01:52.777 CXX test/cpp_headers/nvmf.o 00:01:52.777 CXX test/cpp_headers/nvmf_spec.o 00:01:52.777 CXX test/cpp_headers/nvmf_transport.o 00:01:52.777 LINK vhost_fuzz 00:01:52.777 CXX test/cpp_headers/opal.o 00:01:52.777 CXX test/cpp_headers/opal_spec.o 00:01:52.777 CXX test/cpp_headers/pci_ids.o 00:01:52.777 CXX test/cpp_headers/pipe.o 00:01:52.777 CXX test/cpp_headers/queue.o 00:01:52.777 CXX test/cpp_headers/reduce.o 00:01:52.777 CXX test/cpp_headers/rpc.o 00:01:53.042 CXX test/cpp_headers/scheduler.o 00:01:53.042 LINK nvme_compliance 00:01:53.042 CXX test/cpp_headers/scsi.o 00:01:53.042 CXX test/cpp_headers/scsi_spec.o 00:01:53.042 CXX test/cpp_headers/sock.o 00:01:53.042 LINK fdp 00:01:53.042 CXX test/cpp_headers/stdinc.o 00:01:53.042 CXX test/cpp_headers/string.o 00:01:53.042 CXX test/cpp_headers/thread.o 00:01:53.042 CXX test/cpp_headers/trace.o 00:01:53.042 CXX test/cpp_headers/trace_parser.o 00:01:53.042 CXX test/cpp_headers/tree.o 00:01:53.042 CXX test/cpp_headers/ublk.o 00:01:53.042 CXX test/cpp_headers/util.o 00:01:53.042 CXX test/cpp_headers/uuid.o 00:01:53.042 CXX test/cpp_headers/version.o 00:01:53.042 CXX test/cpp_headers/vfio_user_pci.o 00:01:53.042 CXX test/cpp_headers/vfio_user_spec.o 00:01:53.042 CXX test/cpp_headers/vhost.o 00:01:53.042 CXX test/cpp_headers/vmd.o 00:01:53.042 CXX test/cpp_headers/xor.o 00:01:53.042 CXX test/cpp_headers/zipf.o 00:01:53.328 LINK memory_ut 00:01:53.892 LINK cuse 00:01:54.149 LINK iscsi_fuzz 00:01:56.674 LINK esnap 00:01:56.674 00:01:56.674 real 0m45.550s 00:01:56.674 user 9m35.216s 00:01:56.674 sys 2m8.956s 00:01:56.674 22:39:47 -- common/autotest_common.sh@1105 -- $ xtrace_disable 00:01:56.674 22:39:47 -- common/autotest_common.sh@10 -- $ set +x 00:01:56.674 ************************************ 00:01:56.674 END TEST make 00:01:56.674 ************************************ 00:01:56.674 22:39:47 -- spdk/autotest.sh@25 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:01:56.674 22:39:47 -- nvmf/common.sh@7 -- # uname -s 00:01:56.674 22:39:47 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:01:56.674 22:39:47 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:01:56.674 22:39:47 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:01:56.674 22:39:47 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:01:56.674 22:39:47 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:01:56.674 22:39:47 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:01:56.674 22:39:47 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:01:56.674 22:39:47 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:01:56.674 22:39:47 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:01:56.674 22:39:47 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:01:56.674 22:39:47 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:01:56.674 22:39:47 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:01:56.674 22:39:47 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:01:56.674 22:39:47 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:01:56.674 22:39:47 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:01:56.674 22:39:47 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:01:56.674 22:39:47 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:01:56.674 22:39:47 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:01:56.674 22:39:47 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:01:56.674 22:39:47 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:01:56.674 22:39:47 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:01:56.674 22:39:47 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:01:56.674 22:39:47 -- paths/export.sh@5 -- # export PATH 00:01:56.674 22:39:47 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:01:56.674 22:39:47 -- nvmf/common.sh@46 -- # : 0 00:01:56.674 22:39:47 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:01:56.674 22:39:47 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:01:56.674 22:39:47 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:01:56.674 22:39:47 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:01:56.674 22:39:47 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:01:56.674 22:39:47 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:01:56.674 22:39:47 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:01:56.674 22:39:47 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:01:56.933 22:39:47 -- spdk/autotest.sh@27 -- # '[' 0 -ne 0 ']' 00:01:56.933 22:39:47 -- spdk/autotest.sh@32 -- # uname -s 00:01:56.933 22:39:47 -- spdk/autotest.sh@32 -- # '[' Linux = Linux ']' 00:01:56.933 22:39:47 -- spdk/autotest.sh@33 -- # old_core_pattern='|/usr/lib/systemd/systemd-coredump %P %u %g %s %t %c %h' 00:01:56.933 22:39:47 -- spdk/autotest.sh@34 -- # mkdir -p /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/coredumps 00:01:56.933 22:39:47 -- spdk/autotest.sh@39 -- # echo '|/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/core-collector.sh %P %s %t' 00:01:56.933 22:39:47 -- spdk/autotest.sh@40 -- # echo /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/coredumps 00:01:56.933 22:39:47 -- spdk/autotest.sh@44 -- # modprobe nbd 00:01:56.933 22:39:47 -- spdk/autotest.sh@46 -- # type -P udevadm 00:01:56.933 22:39:47 -- spdk/autotest.sh@46 -- # udevadm=/usr/sbin/udevadm 00:01:56.933 22:39:47 -- spdk/autotest.sh@48 -- # udevadm_pid=121850 00:01:56.933 22:39:47 -- spdk/autotest.sh@47 -- # /usr/sbin/udevadm monitor --property 00:01:56.933 22:39:47 -- spdk/autotest.sh@51 -- # mkdir -p /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/power 00:01:56.933 22:39:47 -- spdk/autotest.sh@54 -- # echo 121852 00:01:56.933 22:39:47 -- spdk/autotest.sh@53 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/perf/pm/collect-cpu-load -d /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/power 00:01:56.933 22:39:47 -- spdk/autotest.sh@56 -- # echo 121853 00:01:56.933 22:39:47 -- spdk/autotest.sh@55 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/perf/pm/collect-vmstat -d /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/power 00:01:56.933 22:39:47 -- spdk/autotest.sh@58 -- # [[ ............................... != QEMU ]] 00:01:56.933 22:39:47 -- spdk/autotest.sh@60 -- # echo 121854 00:01:56.933 22:39:47 -- spdk/autotest.sh@59 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/perf/pm/collect-cpu-temp -d /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/power -l 00:01:56.933 22:39:47 -- spdk/autotest.sh@62 -- # echo 121855 00:01:56.933 22:39:47 -- spdk/autotest.sh@61 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/perf/pm/collect-bmc-pm -d /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/power -l 00:01:56.933 22:39:47 -- spdk/autotest.sh@66 -- # trap 'autotest_cleanup || :; exit 1' SIGINT SIGTERM EXIT 00:01:56.933 22:39:47 -- spdk/autotest.sh@68 -- # timing_enter autotest 00:01:56.933 22:39:47 -- common/autotest_common.sh@712 -- # xtrace_disable 00:01:56.933 22:39:47 -- common/autotest_common.sh@10 -- # set +x 00:01:56.933 22:39:47 -- spdk/autotest.sh@70 -- # create_test_list 00:01:56.933 22:39:47 -- common/autotest_common.sh@736 -- # xtrace_disable 00:01:56.933 22:39:47 -- common/autotest_common.sh@10 -- # set +x 00:01:56.933 Redirecting to /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/power/collect-bmc-pm.bmc.pm.log 00:01:56.933 Redirecting to /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/power/collect-cpu-temp.pm.log 00:01:56.933 22:39:47 -- spdk/autotest.sh@72 -- # dirname /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/autotest.sh 00:01:56.933 22:39:47 -- spdk/autotest.sh@72 -- # readlink -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:01:56.933 22:39:47 -- spdk/autotest.sh@72 -- # src=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:01:56.933 22:39:47 -- spdk/autotest.sh@73 -- # out=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output 00:01:56.933 22:39:47 -- spdk/autotest.sh@74 -- # cd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:01:56.933 22:39:47 -- spdk/autotest.sh@76 -- # freebsd_update_contigmem_mod 00:01:56.933 22:39:47 -- common/autotest_common.sh@1440 -- # uname 00:01:56.933 22:39:47 -- common/autotest_common.sh@1440 -- # '[' Linux = FreeBSD ']' 00:01:56.933 22:39:47 -- spdk/autotest.sh@77 -- # freebsd_set_maxsock_buf 00:01:56.933 22:39:47 -- common/autotest_common.sh@1460 -- # uname 00:01:56.933 22:39:47 -- common/autotest_common.sh@1460 -- # [[ Linux = FreeBSD ]] 00:01:56.933 22:39:47 -- spdk/autotest.sh@82 -- # grep CC_TYPE mk/cc.mk 00:01:56.933 22:39:47 -- spdk/autotest.sh@82 -- # CC_TYPE=CC_TYPE=gcc 00:01:56.933 22:39:47 -- spdk/autotest.sh@83 -- # hash lcov 00:01:56.933 22:39:47 -- spdk/autotest.sh@83 -- # [[ CC_TYPE=gcc == *\c\l\a\n\g* ]] 00:01:56.933 22:39:47 -- spdk/autotest.sh@91 -- # export 'LCOV_OPTS= 00:01:56.933 --rc lcov_branch_coverage=1 00:01:56.933 --rc lcov_function_coverage=1 00:01:56.933 --rc genhtml_branch_coverage=1 00:01:56.933 --rc genhtml_function_coverage=1 00:01:56.933 --rc genhtml_legend=1 00:01:56.933 --rc geninfo_all_blocks=1 00:01:56.933 ' 00:01:56.933 22:39:47 -- spdk/autotest.sh@91 -- # LCOV_OPTS=' 00:01:56.933 --rc lcov_branch_coverage=1 00:01:56.933 --rc lcov_function_coverage=1 00:01:56.933 --rc genhtml_branch_coverage=1 00:01:56.933 --rc genhtml_function_coverage=1 00:01:56.933 --rc genhtml_legend=1 00:01:56.933 --rc geninfo_all_blocks=1 00:01:56.933 ' 00:01:56.933 22:39:47 -- spdk/autotest.sh@92 -- # export 'LCOV=lcov 00:01:56.933 --rc lcov_branch_coverage=1 00:01:56.933 --rc lcov_function_coverage=1 00:01:56.933 --rc genhtml_branch_coverage=1 00:01:56.933 --rc genhtml_function_coverage=1 00:01:56.933 --rc genhtml_legend=1 00:01:56.933 --rc geninfo_all_blocks=1 00:01:56.933 --no-external' 00:01:56.933 22:39:47 -- spdk/autotest.sh@92 -- # LCOV='lcov 00:01:56.933 --rc lcov_branch_coverage=1 00:01:56.933 --rc lcov_function_coverage=1 00:01:56.933 --rc genhtml_branch_coverage=1 00:01:56.933 --rc genhtml_function_coverage=1 00:01:56.933 --rc genhtml_legend=1 00:01:56.933 --rc geninfo_all_blocks=1 00:01:56.933 --no-external' 00:01:56.933 22:39:47 -- spdk/autotest.sh@94 -- # lcov --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 --rc genhtml_branch_coverage=1 --rc genhtml_function_coverage=1 --rc genhtml_legend=1 --rc geninfo_all_blocks=1 --no-external -v 00:01:56.933 lcov: LCOV version 1.14 00:01:56.933 22:39:47 -- spdk/autotest.sh@96 -- # lcov --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 --rc genhtml_branch_coverage=1 --rc genhtml_function_coverage=1 --rc genhtml_legend=1 --rc geninfo_all_blocks=1 --no-external -q -c -i -t Baseline -d /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk -o /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/cov_base.info 00:02:11.797 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/ftl/upgrade/ftl_p2l_upgrade.gcno:no functions found 00:02:11.797 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/ftl/upgrade/ftl_p2l_upgrade.gcno 00:02:11.797 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/ftl/upgrade/ftl_band_upgrade.gcno:no functions found 00:02:11.797 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/ftl/upgrade/ftl_band_upgrade.gcno 00:02:11.797 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/ftl/upgrade/ftl_chunk_upgrade.gcno:no functions found 00:02:11.798 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/ftl/upgrade/ftl_chunk_upgrade.gcno 00:02:26.665 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/accel.gcno:no functions found 00:02:26.665 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/accel.gcno 00:02:26.665 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/accel_module.gcno:no functions found 00:02:26.665 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/accel_module.gcno 00:02:26.665 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/assert.gcno:no functions found 00:02:26.665 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/assert.gcno 00:02:26.665 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/barrier.gcno:no functions found 00:02:26.665 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/barrier.gcno 00:02:26.665 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/base64.gcno:no functions found 00:02:26.665 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/base64.gcno 00:02:26.665 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/bdev.gcno:no functions found 00:02:26.665 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/bdev.gcno 00:02:26.665 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/bdev_module.gcno:no functions found 00:02:26.665 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/bdev_module.gcno 00:02:26.665 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/bdev_zone.gcno:no functions found 00:02:26.665 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/bdev_zone.gcno 00:02:26.665 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/bit_array.gcno:no functions found 00:02:26.665 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/bit_array.gcno 00:02:26.665 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/bit_pool.gcno:no functions found 00:02:26.665 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/bit_pool.gcno 00:02:26.665 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/blob_bdev.gcno:no functions found 00:02:26.665 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/blob_bdev.gcno 00:02:26.665 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/blobfs_bdev.gcno:no functions found 00:02:26.665 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/blobfs_bdev.gcno 00:02:26.665 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/blobfs.gcno:no functions found 00:02:26.665 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/blobfs.gcno 00:02:26.665 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/blob.gcno:no functions found 00:02:26.665 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/blob.gcno 00:02:26.665 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/conf.gcno:no functions found 00:02:26.665 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/conf.gcno 00:02:26.665 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/config.gcno:no functions found 00:02:26.665 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/config.gcno 00:02:26.665 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/cpuset.gcno:no functions found 00:02:26.665 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/cpuset.gcno 00:02:26.665 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/crc16.gcno:no functions found 00:02:26.665 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/crc16.gcno 00:02:26.665 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/crc32.gcno:no functions found 00:02:26.665 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/crc32.gcno 00:02:26.665 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/crc64.gcno:no functions found 00:02:26.665 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/crc64.gcno 00:02:26.665 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/dif.gcno:no functions found 00:02:26.665 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/dif.gcno 00:02:26.665 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/dma.gcno:no functions found 00:02:26.665 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/dma.gcno 00:02:26.665 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/env_dpdk.gcno:no functions found 00:02:26.665 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/env_dpdk.gcno 00:02:26.665 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/endian.gcno:no functions found 00:02:26.665 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/endian.gcno 00:02:26.665 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/env.gcno:no functions found 00:02:26.665 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/env.gcno 00:02:26.665 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/event.gcno:no functions found 00:02:26.665 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/event.gcno 00:02:26.665 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/fd.gcno:no functions found 00:02:26.665 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/fd.gcno 00:02:26.665 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/fd_group.gcno:no functions found 00:02:26.665 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/fd_group.gcno 00:02:26.665 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/file.gcno:no functions found 00:02:26.665 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/file.gcno 00:02:26.665 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/ftl.gcno:no functions found 00:02:26.665 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/ftl.gcno 00:02:26.665 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/gpt_spec.gcno:no functions found 00:02:26.665 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/gpt_spec.gcno 00:02:26.665 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/hexlify.gcno:no functions found 00:02:26.665 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/hexlify.gcno 00:02:26.665 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/histogram_data.gcno:no functions found 00:02:26.665 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/histogram_data.gcno 00:02:26.665 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/idxd_spec.gcno:no functions found 00:02:26.666 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/idxd_spec.gcno 00:02:26.666 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/idxd.gcno:no functions found 00:02:26.666 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/idxd.gcno 00:02:26.666 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/init.gcno:no functions found 00:02:26.666 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/init.gcno 00:02:26.666 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/ioat.gcno:no functions found 00:02:26.666 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/ioat.gcno 00:02:26.666 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/ioat_spec.gcno:no functions found 00:02:26.666 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/ioat_spec.gcno 00:02:26.666 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/json.gcno:no functions found 00:02:26.666 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/json.gcno 00:02:26.666 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/iscsi_spec.gcno:no functions found 00:02:26.666 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/iscsi_spec.gcno 00:02:26.666 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/jsonrpc.gcno:no functions found 00:02:26.666 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/jsonrpc.gcno 00:02:26.666 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/likely.gcno:no functions found 00:02:26.666 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/likely.gcno 00:02:26.666 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/log.gcno:no functions found 00:02:26.666 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/log.gcno 00:02:26.666 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/lvol.gcno:no functions found 00:02:26.666 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/lvol.gcno 00:02:26.666 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/memory.gcno:no functions found 00:02:26.666 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/memory.gcno 00:02:26.666 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/mmio.gcno:no functions found 00:02:26.666 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/mmio.gcno 00:02:26.666 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/nbd.gcno:no functions found 00:02:26.666 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/nbd.gcno 00:02:26.666 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/notify.gcno:no functions found 00:02:26.666 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/notify.gcno 00:02:26.666 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/nvme.gcno:no functions found 00:02:26.666 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/nvme.gcno 00:02:26.666 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/nvme_intel.gcno:no functions found 00:02:26.666 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/nvme_intel.gcno 00:02:26.666 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/nvme_ocssd.gcno:no functions found 00:02:26.666 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/nvme_ocssd.gcno 00:02:26.666 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/nvme_ocssd_spec.gcno:no functions found 00:02:26.666 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/nvme_ocssd_spec.gcno 00:02:26.666 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/nvme_spec.gcno:no functions found 00:02:26.666 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/nvme_spec.gcno 00:02:26.666 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/nvme_zns.gcno:no functions found 00:02:26.666 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/nvme_zns.gcno 00:02:26.666 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/nvmf_cmd.gcno:no functions found 00:02:26.666 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/nvmf_cmd.gcno 00:02:26.666 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/nvmf_fc_spec.gcno:no functions found 00:02:26.666 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/nvmf_fc_spec.gcno 00:02:26.666 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/nvmf.gcno:no functions found 00:02:26.666 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/nvmf.gcno 00:02:26.666 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/nvmf_spec.gcno:no functions found 00:02:26.666 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/nvmf_spec.gcno 00:02:26.666 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/nvmf_transport.gcno:no functions found 00:02:26.666 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/nvmf_transport.gcno 00:02:26.666 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/opal.gcno:no functions found 00:02:26.666 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/opal.gcno 00:02:26.666 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/opal_spec.gcno:no functions found 00:02:26.666 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/opal_spec.gcno 00:02:26.666 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/pci_ids.gcno:no functions found 00:02:26.666 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/pci_ids.gcno 00:02:26.666 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/pipe.gcno:no functions found 00:02:26.666 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/pipe.gcno 00:02:26.666 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/queue.gcno:no functions found 00:02:26.666 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/queue.gcno 00:02:26.666 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/reduce.gcno:no functions found 00:02:26.666 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/reduce.gcno 00:02:26.666 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/rpc.gcno:no functions found 00:02:26.666 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/rpc.gcno 00:02:26.666 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/scheduler.gcno:no functions found 00:02:26.666 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/scheduler.gcno 00:02:26.666 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/scsi.gcno:no functions found 00:02:26.666 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/scsi.gcno 00:02:26.666 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/scsi_spec.gcno:no functions found 00:02:26.666 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/scsi_spec.gcno 00:02:26.666 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/sock.gcno:no functions found 00:02:26.666 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/sock.gcno 00:02:26.666 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/stdinc.gcno:no functions found 00:02:26.666 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/stdinc.gcno 00:02:26.666 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/string.gcno:no functions found 00:02:26.666 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/string.gcno 00:02:26.666 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/thread.gcno:no functions found 00:02:26.666 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/thread.gcno 00:02:26.666 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/trace.gcno:no functions found 00:02:26.666 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/trace.gcno 00:02:26.666 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/trace_parser.gcno:no functions found 00:02:26.666 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/trace_parser.gcno 00:02:26.666 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/tree.gcno:no functions found 00:02:26.666 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/tree.gcno 00:02:26.666 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/util.gcno:no functions found 00:02:26.666 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/util.gcno 00:02:26.666 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/ublk.gcno:no functions found 00:02:26.666 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/ublk.gcno 00:02:26.666 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/uuid.gcno:no functions found 00:02:26.666 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/uuid.gcno 00:02:26.666 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/version.gcno:no functions found 00:02:26.666 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/version.gcno 00:02:26.666 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/vfio_user_spec.gcno:no functions found 00:02:26.666 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/vfio_user_spec.gcno 00:02:26.666 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/vfio_user_pci.gcno:no functions found 00:02:26.666 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/vfio_user_pci.gcno 00:02:26.666 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/vhost.gcno:no functions found 00:02:26.666 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/vhost.gcno 00:02:26.666 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/vmd.gcno:no functions found 00:02:26.666 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/vmd.gcno 00:02:26.666 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/xor.gcno:no functions found 00:02:26.666 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/xor.gcno 00:02:26.666 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/zipf.gcno:no functions found 00:02:26.666 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/zipf.gcno 00:02:27.232 22:40:18 -- spdk/autotest.sh@100 -- # timing_enter pre_cleanup 00:02:27.232 22:40:18 -- common/autotest_common.sh@712 -- # xtrace_disable 00:02:27.232 22:40:18 -- common/autotest_common.sh@10 -- # set +x 00:02:27.232 22:40:18 -- spdk/autotest.sh@102 -- # rm -f 00:02:27.232 22:40:18 -- spdk/autotest.sh@105 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh reset 00:02:28.617 0000:88:00.0 (8086 0a54): Already using the nvme driver 00:02:28.617 0000:00:04.7 (8086 0e27): Already using the ioatdma driver 00:02:28.617 0000:00:04.6 (8086 0e26): Already using the ioatdma driver 00:02:28.617 0000:00:04.5 (8086 0e25): Already using the ioatdma driver 00:02:28.617 0000:00:04.4 (8086 0e24): Already using the ioatdma driver 00:02:28.617 0000:00:04.3 (8086 0e23): Already using the ioatdma driver 00:02:28.617 0000:00:04.2 (8086 0e22): Already using the ioatdma driver 00:02:28.617 0000:00:04.1 (8086 0e21): Already using the ioatdma driver 00:02:28.617 0000:00:04.0 (8086 0e20): Already using the ioatdma driver 00:02:28.617 0000:80:04.7 (8086 0e27): Already using the ioatdma driver 00:02:28.617 0000:80:04.6 (8086 0e26): Already using the ioatdma driver 00:02:28.617 0000:80:04.5 (8086 0e25): Already using the ioatdma driver 00:02:28.617 0000:80:04.4 (8086 0e24): Already using the ioatdma driver 00:02:28.617 0000:80:04.3 (8086 0e23): Already using the ioatdma driver 00:02:28.617 0000:80:04.2 (8086 0e22): Already using the ioatdma driver 00:02:28.617 0000:80:04.1 (8086 0e21): Already using the ioatdma driver 00:02:28.617 0000:80:04.0 (8086 0e20): Already using the ioatdma driver 00:02:28.617 22:40:19 -- spdk/autotest.sh@107 -- # get_zoned_devs 00:02:28.617 22:40:19 -- common/autotest_common.sh@1654 -- # zoned_devs=() 00:02:28.617 22:40:19 -- common/autotest_common.sh@1654 -- # local -gA zoned_devs 00:02:28.617 22:40:19 -- common/autotest_common.sh@1655 -- # local nvme bdf 00:02:28.617 22:40:19 -- common/autotest_common.sh@1657 -- # for nvme in /sys/block/nvme* 00:02:28.617 22:40:19 -- common/autotest_common.sh@1658 -- # is_block_zoned nvme0n1 00:02:28.617 22:40:19 -- common/autotest_common.sh@1647 -- # local device=nvme0n1 00:02:28.617 22:40:19 -- common/autotest_common.sh@1649 -- # [[ -e /sys/block/nvme0n1/queue/zoned ]] 00:02:28.617 22:40:19 -- common/autotest_common.sh@1650 -- # [[ none != none ]] 00:02:28.617 22:40:19 -- spdk/autotest.sh@109 -- # (( 0 > 0 )) 00:02:28.617 22:40:19 -- spdk/autotest.sh@121 -- # ls /dev/nvme0n1 00:02:28.617 22:40:19 -- spdk/autotest.sh@121 -- # grep -v p 00:02:28.617 22:40:19 -- spdk/autotest.sh@121 -- # for dev in $(ls /dev/nvme*n* | grep -v p || true) 00:02:28.617 22:40:19 -- spdk/autotest.sh@123 -- # [[ -z '' ]] 00:02:28.617 22:40:19 -- spdk/autotest.sh@124 -- # block_in_use /dev/nvme0n1 00:02:28.617 22:40:19 -- scripts/common.sh@380 -- # local block=/dev/nvme0n1 pt 00:02:28.617 22:40:19 -- scripts/common.sh@389 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/spdk-gpt.py /dev/nvme0n1 00:02:28.617 No valid GPT data, bailing 00:02:28.617 22:40:19 -- scripts/common.sh@393 -- # blkid -s PTTYPE -o value /dev/nvme0n1 00:02:28.617 22:40:19 -- scripts/common.sh@393 -- # pt= 00:02:28.617 22:40:19 -- scripts/common.sh@394 -- # return 1 00:02:28.617 22:40:19 -- spdk/autotest.sh@125 -- # dd if=/dev/zero of=/dev/nvme0n1 bs=1M count=1 00:02:28.617 1+0 records in 00:02:28.617 1+0 records out 00:02:28.617 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00192333 s, 545 MB/s 00:02:28.617 22:40:19 -- spdk/autotest.sh@129 -- # sync 00:02:28.617 22:40:19 -- spdk/autotest.sh@131 -- # xtrace_disable_per_cmd reap_spdk_processes 00:02:28.617 22:40:19 -- common/autotest_common.sh@22 -- # eval 'reap_spdk_processes 12> /dev/null' 00:02:28.617 22:40:19 -- common/autotest_common.sh@22 -- # reap_spdk_processes 00:02:30.520 22:40:21 -- spdk/autotest.sh@135 -- # uname -s 00:02:30.520 22:40:21 -- spdk/autotest.sh@135 -- # '[' Linux = Linux ']' 00:02:30.520 22:40:21 -- spdk/autotest.sh@136 -- # run_test setup.sh /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/test-setup.sh 00:02:30.520 22:40:21 -- common/autotest_common.sh@1077 -- # '[' 2 -le 1 ']' 00:02:30.520 22:40:21 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:02:30.520 22:40:21 -- common/autotest_common.sh@10 -- # set +x 00:02:30.520 ************************************ 00:02:30.520 START TEST setup.sh 00:02:30.520 ************************************ 00:02:30.520 22:40:21 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/test-setup.sh 00:02:30.778 * Looking for test storage... 00:02:30.778 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup 00:02:30.778 22:40:21 -- setup/test-setup.sh@10 -- # uname -s 00:02:30.778 22:40:21 -- setup/test-setup.sh@10 -- # [[ Linux == Linux ]] 00:02:30.778 22:40:21 -- setup/test-setup.sh@12 -- # run_test acl /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/acl.sh 00:02:30.778 22:40:21 -- common/autotest_common.sh@1077 -- # '[' 2 -le 1 ']' 00:02:30.778 22:40:21 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:02:30.778 22:40:21 -- common/autotest_common.sh@10 -- # set +x 00:02:30.778 ************************************ 00:02:30.778 START TEST acl 00:02:30.778 ************************************ 00:02:30.778 22:40:21 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/acl.sh 00:02:30.778 * Looking for test storage... 00:02:30.778 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup 00:02:30.778 22:40:21 -- setup/acl.sh@10 -- # get_zoned_devs 00:02:30.778 22:40:21 -- common/autotest_common.sh@1654 -- # zoned_devs=() 00:02:30.778 22:40:21 -- common/autotest_common.sh@1654 -- # local -gA zoned_devs 00:02:30.778 22:40:21 -- common/autotest_common.sh@1655 -- # local nvme bdf 00:02:30.778 22:40:21 -- common/autotest_common.sh@1657 -- # for nvme in /sys/block/nvme* 00:02:30.778 22:40:21 -- common/autotest_common.sh@1658 -- # is_block_zoned nvme0n1 00:02:30.778 22:40:21 -- common/autotest_common.sh@1647 -- # local device=nvme0n1 00:02:30.778 22:40:21 -- common/autotest_common.sh@1649 -- # [[ -e /sys/block/nvme0n1/queue/zoned ]] 00:02:30.778 22:40:21 -- common/autotest_common.sh@1650 -- # [[ none != none ]] 00:02:30.778 22:40:21 -- setup/acl.sh@12 -- # devs=() 00:02:30.778 22:40:21 -- setup/acl.sh@12 -- # declare -a devs 00:02:30.778 22:40:21 -- setup/acl.sh@13 -- # drivers=() 00:02:30.778 22:40:21 -- setup/acl.sh@13 -- # declare -A drivers 00:02:30.778 22:40:21 -- setup/acl.sh@51 -- # setup reset 00:02:30.779 22:40:21 -- setup/common.sh@9 -- # [[ reset == output ]] 00:02:30.779 22:40:21 -- setup/common.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh reset 00:02:32.154 22:40:23 -- setup/acl.sh@52 -- # collect_setup_devs 00:02:32.154 22:40:23 -- setup/acl.sh@16 -- # local dev driver 00:02:32.154 22:40:23 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:02:32.154 22:40:23 -- setup/acl.sh@15 -- # setup output status 00:02:32.154 22:40:23 -- setup/common.sh@9 -- # [[ output == output ]] 00:02:32.154 22:40:23 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh status 00:02:33.558 Hugepages 00:02:33.558 node hugesize free / total 00:02:33.558 22:40:24 -- setup/acl.sh@19 -- # [[ 1048576kB == *:*:*.* ]] 00:02:33.558 22:40:24 -- setup/acl.sh@19 -- # continue 00:02:33.558 22:40:24 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:02:33.558 22:40:24 -- setup/acl.sh@19 -- # [[ 2048kB == *:*:*.* ]] 00:02:33.558 22:40:24 -- setup/acl.sh@19 -- # continue 00:02:33.558 22:40:24 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:02:33.558 22:40:24 -- setup/acl.sh@19 -- # [[ 1048576kB == *:*:*.* ]] 00:02:33.558 22:40:24 -- setup/acl.sh@19 -- # continue 00:02:33.558 22:40:24 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:02:33.558 00:02:33.558 Type BDF Vendor Device NUMA Driver Device Block devices 00:02:33.558 22:40:24 -- setup/acl.sh@19 -- # [[ 2048kB == *:*:*.* ]] 00:02:33.558 22:40:24 -- setup/acl.sh@19 -- # continue 00:02:33.558 22:40:24 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:02:33.558 22:40:24 -- setup/acl.sh@19 -- # [[ 0000:00:04.0 == *:*:*.* ]] 00:02:33.558 22:40:24 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:02:33.558 22:40:24 -- setup/acl.sh@20 -- # continue 00:02:33.558 22:40:24 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:02:33.558 22:40:24 -- setup/acl.sh@19 -- # [[ 0000:00:04.1 == *:*:*.* ]] 00:02:33.558 22:40:24 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:02:33.558 22:40:24 -- setup/acl.sh@20 -- # continue 00:02:33.558 22:40:24 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:02:33.558 22:40:24 -- setup/acl.sh@19 -- # [[ 0000:00:04.2 == *:*:*.* ]] 00:02:33.558 22:40:24 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:02:33.558 22:40:24 -- setup/acl.sh@20 -- # continue 00:02:33.558 22:40:24 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:02:33.558 22:40:24 -- setup/acl.sh@19 -- # [[ 0000:00:04.3 == *:*:*.* ]] 00:02:33.558 22:40:24 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:02:33.558 22:40:24 -- setup/acl.sh@20 -- # continue 00:02:33.558 22:40:24 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:02:33.558 22:40:24 -- setup/acl.sh@19 -- # [[ 0000:00:04.4 == *:*:*.* ]] 00:02:33.558 22:40:24 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:02:33.558 22:40:24 -- setup/acl.sh@20 -- # continue 00:02:33.558 22:40:24 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:02:33.558 22:40:24 -- setup/acl.sh@19 -- # [[ 0000:00:04.5 == *:*:*.* ]] 00:02:33.558 22:40:24 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:02:33.558 22:40:24 -- setup/acl.sh@20 -- # continue 00:02:33.558 22:40:24 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:02:33.558 22:40:24 -- setup/acl.sh@19 -- # [[ 0000:00:04.6 == *:*:*.* ]] 00:02:33.558 22:40:24 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:02:33.558 22:40:24 -- setup/acl.sh@20 -- # continue 00:02:33.558 22:40:24 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:02:33.558 22:40:24 -- setup/acl.sh@19 -- # [[ 0000:00:04.7 == *:*:*.* ]] 00:02:33.558 22:40:24 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:02:33.558 22:40:24 -- setup/acl.sh@20 -- # continue 00:02:33.558 22:40:24 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:02:33.558 22:40:24 -- setup/acl.sh@19 -- # [[ 0000:80:04.0 == *:*:*.* ]] 00:02:33.558 22:40:24 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:02:33.558 22:40:24 -- setup/acl.sh@20 -- # continue 00:02:33.558 22:40:24 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:02:33.558 22:40:24 -- setup/acl.sh@19 -- # [[ 0000:80:04.1 == *:*:*.* ]] 00:02:33.558 22:40:24 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:02:33.558 22:40:24 -- setup/acl.sh@20 -- # continue 00:02:33.558 22:40:24 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:02:33.558 22:40:24 -- setup/acl.sh@19 -- # [[ 0000:80:04.2 == *:*:*.* ]] 00:02:33.558 22:40:24 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:02:33.558 22:40:24 -- setup/acl.sh@20 -- # continue 00:02:33.558 22:40:24 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:02:33.558 22:40:24 -- setup/acl.sh@19 -- # [[ 0000:80:04.3 == *:*:*.* ]] 00:02:33.558 22:40:24 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:02:33.558 22:40:24 -- setup/acl.sh@20 -- # continue 00:02:33.559 22:40:24 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:02:33.559 22:40:24 -- setup/acl.sh@19 -- # [[ 0000:80:04.4 == *:*:*.* ]] 00:02:33.559 22:40:24 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:02:33.559 22:40:24 -- setup/acl.sh@20 -- # continue 00:02:33.559 22:40:24 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:02:33.559 22:40:24 -- setup/acl.sh@19 -- # [[ 0000:80:04.5 == *:*:*.* ]] 00:02:33.559 22:40:24 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:02:33.559 22:40:24 -- setup/acl.sh@20 -- # continue 00:02:33.559 22:40:24 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:02:33.559 22:40:24 -- setup/acl.sh@19 -- # [[ 0000:80:04.6 == *:*:*.* ]] 00:02:33.559 22:40:24 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:02:33.559 22:40:24 -- setup/acl.sh@20 -- # continue 00:02:33.559 22:40:24 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:02:33.559 22:40:24 -- setup/acl.sh@19 -- # [[ 0000:80:04.7 == *:*:*.* ]] 00:02:33.559 22:40:24 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:02:33.559 22:40:24 -- setup/acl.sh@20 -- # continue 00:02:33.559 22:40:24 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:02:33.559 22:40:24 -- setup/acl.sh@19 -- # [[ 0000:88:00.0 == *:*:*.* ]] 00:02:33.559 22:40:24 -- setup/acl.sh@20 -- # [[ nvme == nvme ]] 00:02:33.559 22:40:24 -- setup/acl.sh@21 -- # [[ '' == *\0\0\0\0\:\8\8\:\0\0\.\0* ]] 00:02:33.559 22:40:24 -- setup/acl.sh@22 -- # devs+=("$dev") 00:02:33.559 22:40:24 -- setup/acl.sh@22 -- # drivers["$dev"]=nvme 00:02:33.559 22:40:24 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:02:33.559 22:40:24 -- setup/acl.sh@24 -- # (( 1 > 0 )) 00:02:33.559 22:40:24 -- setup/acl.sh@54 -- # run_test denied denied 00:02:33.559 22:40:24 -- common/autotest_common.sh@1077 -- # '[' 2 -le 1 ']' 00:02:33.559 22:40:24 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:02:33.559 22:40:24 -- common/autotest_common.sh@10 -- # set +x 00:02:33.559 ************************************ 00:02:33.559 START TEST denied 00:02:33.559 ************************************ 00:02:33.559 22:40:24 -- common/autotest_common.sh@1104 -- # denied 00:02:33.559 22:40:24 -- setup/acl.sh@38 -- # PCI_BLOCKED=' 0000:88:00.0' 00:02:33.559 22:40:24 -- setup/acl.sh@38 -- # setup output config 00:02:33.559 22:40:24 -- setup/acl.sh@39 -- # grep 'Skipping denied controller at 0000:88:00.0' 00:02:33.559 22:40:24 -- setup/common.sh@9 -- # [[ output == output ]] 00:02:33.559 22:40:24 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh config 00:02:34.939 0000:88:00.0 (8086 0a54): Skipping denied controller at 0000:88:00.0 00:02:34.939 22:40:25 -- setup/acl.sh@40 -- # verify 0000:88:00.0 00:02:34.939 22:40:25 -- setup/acl.sh@28 -- # local dev driver 00:02:34.939 22:40:25 -- setup/acl.sh@30 -- # for dev in "$@" 00:02:34.939 22:40:25 -- setup/acl.sh@31 -- # [[ -e /sys/bus/pci/devices/0000:88:00.0 ]] 00:02:34.939 22:40:25 -- setup/acl.sh@32 -- # readlink -f /sys/bus/pci/devices/0000:88:00.0/driver 00:02:34.939 22:40:25 -- setup/acl.sh@32 -- # driver=/sys/bus/pci/drivers/nvme 00:02:34.939 22:40:25 -- setup/acl.sh@33 -- # [[ nvme == \n\v\m\e ]] 00:02:34.939 22:40:25 -- setup/acl.sh@41 -- # setup reset 00:02:34.939 22:40:25 -- setup/common.sh@9 -- # [[ reset == output ]] 00:02:34.939 22:40:25 -- setup/common.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh reset 00:02:36.844 00:02:36.844 real 0m3.476s 00:02:36.844 user 0m1.027s 00:02:36.844 sys 0m1.632s 00:02:36.844 22:40:27 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:02:36.844 22:40:27 -- common/autotest_common.sh@10 -- # set +x 00:02:36.844 ************************************ 00:02:36.844 END TEST denied 00:02:36.844 ************************************ 00:02:36.844 22:40:27 -- setup/acl.sh@55 -- # run_test allowed allowed 00:02:36.844 22:40:27 -- common/autotest_common.sh@1077 -- # '[' 2 -le 1 ']' 00:02:36.844 22:40:27 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:02:36.844 22:40:27 -- common/autotest_common.sh@10 -- # set +x 00:02:36.844 ************************************ 00:02:36.844 START TEST allowed 00:02:36.844 ************************************ 00:02:36.844 22:40:27 -- common/autotest_common.sh@1104 -- # allowed 00:02:36.844 22:40:27 -- setup/acl.sh@45 -- # PCI_ALLOWED=0000:88:00.0 00:02:36.844 22:40:27 -- setup/acl.sh@45 -- # setup output config 00:02:36.844 22:40:27 -- setup/acl.sh@46 -- # grep -E '0000:88:00.0 .*: nvme -> .*' 00:02:36.844 22:40:27 -- setup/common.sh@9 -- # [[ output == output ]] 00:02:36.844 22:40:27 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh config 00:02:39.381 0000:88:00.0 (8086 0a54): nvme -> vfio-pci 00:02:39.381 22:40:30 -- setup/acl.sh@47 -- # verify 00:02:39.381 22:40:30 -- setup/acl.sh@28 -- # local dev driver 00:02:39.381 22:40:30 -- setup/acl.sh@48 -- # setup reset 00:02:39.381 22:40:30 -- setup/common.sh@9 -- # [[ reset == output ]] 00:02:39.381 22:40:30 -- setup/common.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh reset 00:02:40.760 00:02:40.760 real 0m3.876s 00:02:40.760 user 0m1.026s 00:02:40.760 sys 0m1.750s 00:02:40.760 22:40:31 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:02:40.760 22:40:31 -- common/autotest_common.sh@10 -- # set +x 00:02:40.760 ************************************ 00:02:40.760 END TEST allowed 00:02:40.760 ************************************ 00:02:40.760 00:02:40.760 real 0m10.061s 00:02:40.760 user 0m3.104s 00:02:40.760 sys 0m5.128s 00:02:40.760 22:40:31 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:02:40.760 22:40:31 -- common/autotest_common.sh@10 -- # set +x 00:02:40.760 ************************************ 00:02:40.760 END TEST acl 00:02:40.760 ************************************ 00:02:40.760 22:40:31 -- setup/test-setup.sh@13 -- # run_test hugepages /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/hugepages.sh 00:02:40.760 22:40:31 -- common/autotest_common.sh@1077 -- # '[' 2 -le 1 ']' 00:02:40.760 22:40:31 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:02:40.760 22:40:31 -- common/autotest_common.sh@10 -- # set +x 00:02:40.760 ************************************ 00:02:40.760 START TEST hugepages 00:02:40.760 ************************************ 00:02:40.760 22:40:31 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/hugepages.sh 00:02:40.760 * Looking for test storage... 00:02:40.760 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup 00:02:40.760 22:40:31 -- setup/hugepages.sh@10 -- # nodes_sys=() 00:02:40.760 22:40:31 -- setup/hugepages.sh@10 -- # declare -a nodes_sys 00:02:40.760 22:40:31 -- setup/hugepages.sh@12 -- # declare -i default_hugepages=0 00:02:40.760 22:40:31 -- setup/hugepages.sh@13 -- # declare -i no_nodes=0 00:02:40.760 22:40:31 -- setup/hugepages.sh@14 -- # declare -i nr_hugepages=0 00:02:40.760 22:40:31 -- setup/hugepages.sh@16 -- # get_meminfo Hugepagesize 00:02:40.760 22:40:31 -- setup/common.sh@17 -- # local get=Hugepagesize 00:02:40.760 22:40:31 -- setup/common.sh@18 -- # local node= 00:02:40.760 22:40:31 -- setup/common.sh@19 -- # local var val 00:02:40.760 22:40:31 -- setup/common.sh@20 -- # local mem_f mem 00:02:40.760 22:40:31 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:02:40.760 22:40:31 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:02:40.760 22:40:31 -- setup/common.sh@25 -- # [[ -n '' ]] 00:02:40.760 22:40:31 -- setup/common.sh@28 -- # mapfile -t mem 00:02:40.760 22:40:31 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:02:40.760 22:40:31 -- setup/common.sh@31 -- # IFS=': ' 00:02:40.760 22:40:31 -- setup/common.sh@31 -- # read -r var val _ 00:02:40.760 22:40:31 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60541736 kB' 'MemFree: 41231884 kB' 'MemAvailable: 45223360 kB' 'Buffers: 2696 kB' 'Cached: 12518048 kB' 'SwapCached: 0 kB' 'Active: 9311308 kB' 'Inactive: 3655836 kB' 'Active(anon): 8746992 kB' 'Inactive(anon): 0 kB' 'Active(file): 564316 kB' 'Inactive(file): 3655836 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 449680 kB' 'Mapped: 202480 kB' 'Shmem: 8300592 kB' 'KReclaimable: 415760 kB' 'Slab: 807732 kB' 'SReclaimable: 415760 kB' 'SUnreclaim: 391972 kB' 'KernelStack: 12944 kB' 'PageTables: 9248 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 36562320 kB' 'Committed_AS: 9889356 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 197004 kB' 'VmallocChunk: 0 kB' 'Percpu: 38592 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 2048' 'HugePages_Free: 2048' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 4194304 kB' 'DirectMap4k: 2506332 kB' 'DirectMap2M: 24676352 kB' 'DirectMap1G: 41943040 kB' 00:02:40.760 22:40:31 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:02:40.760 22:40:31 -- setup/common.sh@32 -- # continue 00:02:40.760 22:40:31 -- setup/common.sh@31 -- # IFS=': ' 00:02:40.760 22:40:31 -- setup/common.sh@31 -- # read -r var val _ 00:02:40.760 22:40:31 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:02:40.760 22:40:31 -- setup/common.sh@32 -- # continue 00:02:40.760 22:40:31 -- setup/common.sh@31 -- # IFS=': ' 00:02:40.760 22:40:31 -- setup/common.sh@31 -- # read -r var val _ 00:02:40.760 22:40:31 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:02:40.760 22:40:31 -- setup/common.sh@32 -- # continue 00:02:40.760 22:40:31 -- setup/common.sh@31 -- # IFS=': ' 00:02:40.760 22:40:31 -- setup/common.sh@31 -- # read -r var val _ 00:02:40.760 22:40:31 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:02:40.760 22:40:31 -- setup/common.sh@32 -- # continue 00:02:40.760 22:40:31 -- setup/common.sh@31 -- # IFS=': ' 00:02:40.760 22:40:31 -- setup/common.sh@31 -- # read -r var val _ 00:02:40.760 22:40:31 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:02:40.760 22:40:31 -- setup/common.sh@32 -- # continue 00:02:40.760 22:40:31 -- setup/common.sh@31 -- # IFS=': ' 00:02:40.760 22:40:31 -- setup/common.sh@31 -- # read -r var val _ 00:02:40.760 22:40:31 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:02:40.760 22:40:31 -- setup/common.sh@32 -- # continue 00:02:40.760 22:40:31 -- setup/common.sh@31 -- # IFS=': ' 00:02:40.760 22:40:31 -- setup/common.sh@31 -- # read -r var val _ 00:02:40.760 22:40:31 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:02:40.760 22:40:31 -- setup/common.sh@32 -- # continue 00:02:40.760 22:40:31 -- setup/common.sh@31 -- # IFS=': ' 00:02:40.760 22:40:31 -- setup/common.sh@31 -- # read -r var val _ 00:02:40.760 22:40:31 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:02:40.760 22:40:31 -- setup/common.sh@32 -- # continue 00:02:40.760 22:40:31 -- setup/common.sh@31 -- # IFS=': ' 00:02:40.760 22:40:31 -- setup/common.sh@31 -- # read -r var val _ 00:02:40.760 22:40:31 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:02:40.760 22:40:31 -- setup/common.sh@32 -- # continue 00:02:40.760 22:40:31 -- setup/common.sh@31 -- # IFS=': ' 00:02:40.760 22:40:31 -- setup/common.sh@31 -- # read -r var val _ 00:02:40.760 22:40:31 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:02:40.760 22:40:31 -- setup/common.sh@32 -- # continue 00:02:40.760 22:40:31 -- setup/common.sh@31 -- # IFS=': ' 00:02:40.760 22:40:31 -- setup/common.sh@31 -- # read -r var val _ 00:02:40.760 22:40:31 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:02:40.760 22:40:31 -- setup/common.sh@32 -- # continue 00:02:40.760 22:40:31 -- setup/common.sh@31 -- # IFS=': ' 00:02:40.760 22:40:31 -- setup/common.sh@31 -- # read -r var val _ 00:02:40.760 22:40:31 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:02:40.760 22:40:31 -- setup/common.sh@32 -- # continue 00:02:40.760 22:40:31 -- setup/common.sh@31 -- # IFS=': ' 00:02:40.760 22:40:31 -- setup/common.sh@31 -- # read -r var val _ 00:02:40.760 22:40:31 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:02:40.760 22:40:31 -- setup/common.sh@32 -- # continue 00:02:40.760 22:40:31 -- setup/common.sh@31 -- # IFS=': ' 00:02:40.760 22:40:31 -- setup/common.sh@31 -- # read -r var val _ 00:02:40.760 22:40:31 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:02:40.760 22:40:31 -- setup/common.sh@32 -- # continue 00:02:40.760 22:40:31 -- setup/common.sh@31 -- # IFS=': ' 00:02:40.760 22:40:31 -- setup/common.sh@31 -- # read -r var val _ 00:02:40.760 22:40:31 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:02:40.760 22:40:31 -- setup/common.sh@32 -- # continue 00:02:40.760 22:40:31 -- setup/common.sh@31 -- # IFS=': ' 00:02:40.760 22:40:31 -- setup/common.sh@31 -- # read -r var val _ 00:02:40.760 22:40:31 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:02:40.760 22:40:31 -- setup/common.sh@32 -- # continue 00:02:40.760 22:40:31 -- setup/common.sh@31 -- # IFS=': ' 00:02:40.760 22:40:31 -- setup/common.sh@31 -- # read -r var val _ 00:02:40.760 22:40:31 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:02:40.760 22:40:31 -- setup/common.sh@32 -- # continue 00:02:40.760 22:40:31 -- setup/common.sh@31 -- # IFS=': ' 00:02:40.760 22:40:31 -- setup/common.sh@31 -- # read -r var val _ 00:02:40.760 22:40:31 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:02:40.760 22:40:31 -- setup/common.sh@32 -- # continue 00:02:40.760 22:40:31 -- setup/common.sh@31 -- # IFS=': ' 00:02:40.760 22:40:31 -- setup/common.sh@31 -- # read -r var val _ 00:02:40.760 22:40:31 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:02:40.760 22:40:31 -- setup/common.sh@32 -- # continue 00:02:40.760 22:40:31 -- setup/common.sh@31 -- # IFS=': ' 00:02:40.760 22:40:31 -- setup/common.sh@31 -- # read -r var val _ 00:02:40.760 22:40:31 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:02:40.760 22:40:31 -- setup/common.sh@32 -- # continue 00:02:40.760 22:40:31 -- setup/common.sh@31 -- # IFS=': ' 00:02:40.760 22:40:31 -- setup/common.sh@31 -- # read -r var val _ 00:02:40.760 22:40:31 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:02:40.760 22:40:31 -- setup/common.sh@32 -- # continue 00:02:40.761 22:40:31 -- setup/common.sh@31 -- # IFS=': ' 00:02:40.761 22:40:31 -- setup/common.sh@31 -- # read -r var val _ 00:02:40.761 22:40:31 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:02:40.761 22:40:31 -- setup/common.sh@32 -- # continue 00:02:40.761 22:40:31 -- setup/common.sh@31 -- # IFS=': ' 00:02:40.761 22:40:31 -- setup/common.sh@31 -- # read -r var val _ 00:02:40.761 22:40:31 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:02:40.761 22:40:31 -- setup/common.sh@32 -- # continue 00:02:40.761 22:40:31 -- setup/common.sh@31 -- # IFS=': ' 00:02:40.761 22:40:31 -- setup/common.sh@31 -- # read -r var val _ 00:02:40.761 22:40:31 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:02:40.761 22:40:31 -- setup/common.sh@32 -- # continue 00:02:40.761 22:40:31 -- setup/common.sh@31 -- # IFS=': ' 00:02:40.761 22:40:31 -- setup/common.sh@31 -- # read -r var val _ 00:02:40.761 22:40:31 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:02:40.761 22:40:31 -- setup/common.sh@32 -- # continue 00:02:40.761 22:40:31 -- setup/common.sh@31 -- # IFS=': ' 00:02:40.761 22:40:31 -- setup/common.sh@31 -- # read -r var val _ 00:02:40.761 22:40:31 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:02:40.761 22:40:31 -- setup/common.sh@32 -- # continue 00:02:40.761 22:40:31 -- setup/common.sh@31 -- # IFS=': ' 00:02:40.761 22:40:31 -- setup/common.sh@31 -- # read -r var val _ 00:02:40.761 22:40:31 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:02:40.761 22:40:31 -- setup/common.sh@32 -- # continue 00:02:40.761 22:40:31 -- setup/common.sh@31 -- # IFS=': ' 00:02:40.761 22:40:31 -- setup/common.sh@31 -- # read -r var val _ 00:02:40.761 22:40:31 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:02:40.761 22:40:31 -- setup/common.sh@32 -- # continue 00:02:40.761 22:40:31 -- setup/common.sh@31 -- # IFS=': ' 00:02:40.761 22:40:31 -- setup/common.sh@31 -- # read -r var val _ 00:02:40.761 22:40:31 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:02:40.761 22:40:31 -- setup/common.sh@32 -- # continue 00:02:40.761 22:40:31 -- setup/common.sh@31 -- # IFS=': ' 00:02:40.761 22:40:31 -- setup/common.sh@31 -- # read -r var val _ 00:02:40.761 22:40:31 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:02:40.761 22:40:31 -- setup/common.sh@32 -- # continue 00:02:40.761 22:40:31 -- setup/common.sh@31 -- # IFS=': ' 00:02:40.761 22:40:31 -- setup/common.sh@31 -- # read -r var val _ 00:02:40.761 22:40:31 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:02:40.761 22:40:31 -- setup/common.sh@32 -- # continue 00:02:40.761 22:40:31 -- setup/common.sh@31 -- # IFS=': ' 00:02:40.761 22:40:31 -- setup/common.sh@31 -- # read -r var val _ 00:02:40.761 22:40:31 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:02:40.761 22:40:31 -- setup/common.sh@32 -- # continue 00:02:40.761 22:40:31 -- setup/common.sh@31 -- # IFS=': ' 00:02:40.761 22:40:31 -- setup/common.sh@31 -- # read -r var val _ 00:02:40.761 22:40:31 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:02:40.761 22:40:31 -- setup/common.sh@32 -- # continue 00:02:40.761 22:40:31 -- setup/common.sh@31 -- # IFS=': ' 00:02:40.761 22:40:31 -- setup/common.sh@31 -- # read -r var val _ 00:02:40.761 22:40:31 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:02:40.761 22:40:31 -- setup/common.sh@32 -- # continue 00:02:40.761 22:40:31 -- setup/common.sh@31 -- # IFS=': ' 00:02:40.761 22:40:31 -- setup/common.sh@31 -- # read -r var val _ 00:02:40.761 22:40:31 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:02:40.761 22:40:31 -- setup/common.sh@32 -- # continue 00:02:40.761 22:40:31 -- setup/common.sh@31 -- # IFS=': ' 00:02:40.761 22:40:31 -- setup/common.sh@31 -- # read -r var val _ 00:02:40.761 22:40:31 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:02:40.761 22:40:31 -- setup/common.sh@32 -- # continue 00:02:40.761 22:40:31 -- setup/common.sh@31 -- # IFS=': ' 00:02:40.761 22:40:31 -- setup/common.sh@31 -- # read -r var val _ 00:02:40.761 22:40:31 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:02:40.761 22:40:31 -- setup/common.sh@32 -- # continue 00:02:40.761 22:40:31 -- setup/common.sh@31 -- # IFS=': ' 00:02:40.761 22:40:31 -- setup/common.sh@31 -- # read -r var val _ 00:02:40.761 22:40:31 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:02:40.761 22:40:31 -- setup/common.sh@32 -- # continue 00:02:40.761 22:40:31 -- setup/common.sh@31 -- # IFS=': ' 00:02:40.761 22:40:31 -- setup/common.sh@31 -- # read -r var val _ 00:02:40.761 22:40:31 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:02:40.761 22:40:31 -- setup/common.sh@32 -- # continue 00:02:40.761 22:40:31 -- setup/common.sh@31 -- # IFS=': ' 00:02:40.761 22:40:31 -- setup/common.sh@31 -- # read -r var val _ 00:02:40.761 22:40:31 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:02:40.761 22:40:31 -- setup/common.sh@32 -- # continue 00:02:40.761 22:40:31 -- setup/common.sh@31 -- # IFS=': ' 00:02:40.761 22:40:31 -- setup/common.sh@31 -- # read -r var val _ 00:02:40.761 22:40:31 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:02:40.761 22:40:31 -- setup/common.sh@32 -- # continue 00:02:40.761 22:40:31 -- setup/common.sh@31 -- # IFS=': ' 00:02:40.761 22:40:31 -- setup/common.sh@31 -- # read -r var val _ 00:02:40.761 22:40:31 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:02:40.761 22:40:31 -- setup/common.sh@32 -- # continue 00:02:40.761 22:40:31 -- setup/common.sh@31 -- # IFS=': ' 00:02:40.761 22:40:31 -- setup/common.sh@31 -- # read -r var val _ 00:02:40.761 22:40:31 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:02:40.761 22:40:31 -- setup/common.sh@32 -- # continue 00:02:40.761 22:40:31 -- setup/common.sh@31 -- # IFS=': ' 00:02:40.761 22:40:31 -- setup/common.sh@31 -- # read -r var val _ 00:02:40.761 22:40:31 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:02:40.761 22:40:31 -- setup/common.sh@32 -- # continue 00:02:40.761 22:40:31 -- setup/common.sh@31 -- # IFS=': ' 00:02:40.761 22:40:31 -- setup/common.sh@31 -- # read -r var val _ 00:02:40.761 22:40:31 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:02:40.761 22:40:31 -- setup/common.sh@32 -- # continue 00:02:40.761 22:40:31 -- setup/common.sh@31 -- # IFS=': ' 00:02:40.761 22:40:31 -- setup/common.sh@31 -- # read -r var val _ 00:02:40.761 22:40:31 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:02:40.761 22:40:31 -- setup/common.sh@32 -- # continue 00:02:40.761 22:40:31 -- setup/common.sh@31 -- # IFS=': ' 00:02:40.761 22:40:31 -- setup/common.sh@31 -- # read -r var val _ 00:02:40.761 22:40:31 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:02:40.761 22:40:31 -- setup/common.sh@32 -- # continue 00:02:40.761 22:40:31 -- setup/common.sh@31 -- # IFS=': ' 00:02:40.761 22:40:31 -- setup/common.sh@31 -- # read -r var val _ 00:02:40.761 22:40:31 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:02:40.761 22:40:31 -- setup/common.sh@32 -- # continue 00:02:40.761 22:40:31 -- setup/common.sh@31 -- # IFS=': ' 00:02:40.761 22:40:31 -- setup/common.sh@31 -- # read -r var val _ 00:02:40.761 22:40:31 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:02:40.761 22:40:31 -- setup/common.sh@32 -- # continue 00:02:40.761 22:40:31 -- setup/common.sh@31 -- # IFS=': ' 00:02:40.761 22:40:31 -- setup/common.sh@31 -- # read -r var val _ 00:02:40.761 22:40:31 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:02:40.761 22:40:31 -- setup/common.sh@32 -- # continue 00:02:40.761 22:40:31 -- setup/common.sh@31 -- # IFS=': ' 00:02:40.761 22:40:31 -- setup/common.sh@31 -- # read -r var val _ 00:02:40.761 22:40:31 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:02:40.761 22:40:31 -- setup/common.sh@32 -- # continue 00:02:40.761 22:40:31 -- setup/common.sh@31 -- # IFS=': ' 00:02:40.761 22:40:31 -- setup/common.sh@31 -- # read -r var val _ 00:02:40.761 22:40:31 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:02:40.761 22:40:31 -- setup/common.sh@32 -- # continue 00:02:40.761 22:40:31 -- setup/common.sh@31 -- # IFS=': ' 00:02:40.761 22:40:31 -- setup/common.sh@31 -- # read -r var val _ 00:02:40.761 22:40:31 -- setup/common.sh@32 -- # [[ Hugepagesize == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:02:40.761 22:40:31 -- setup/common.sh@33 -- # echo 2048 00:02:40.761 22:40:31 -- setup/common.sh@33 -- # return 0 00:02:40.761 22:40:31 -- setup/hugepages.sh@16 -- # default_hugepages=2048 00:02:40.761 22:40:31 -- setup/hugepages.sh@17 -- # default_huge_nr=/sys/kernel/mm/hugepages/hugepages-2048kB/nr_hugepages 00:02:40.761 22:40:31 -- setup/hugepages.sh@18 -- # global_huge_nr=/proc/sys/vm/nr_hugepages 00:02:40.761 22:40:31 -- setup/hugepages.sh@21 -- # unset -v HUGE_EVEN_ALLOC 00:02:40.761 22:40:31 -- setup/hugepages.sh@22 -- # unset -v HUGEMEM 00:02:40.761 22:40:31 -- setup/hugepages.sh@23 -- # unset -v HUGENODE 00:02:40.761 22:40:31 -- setup/hugepages.sh@24 -- # unset -v NRHUGE 00:02:40.761 22:40:31 -- setup/hugepages.sh@207 -- # get_nodes 00:02:40.761 22:40:31 -- setup/hugepages.sh@27 -- # local node 00:02:40.761 22:40:31 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:02:40.761 22:40:31 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=2048 00:02:40.761 22:40:31 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:02:40.761 22:40:31 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=0 00:02:40.761 22:40:31 -- setup/hugepages.sh@32 -- # no_nodes=2 00:02:40.761 22:40:31 -- setup/hugepages.sh@33 -- # (( no_nodes > 0 )) 00:02:40.761 22:40:31 -- setup/hugepages.sh@208 -- # clear_hp 00:02:40.761 22:40:31 -- setup/hugepages.sh@37 -- # local node hp 00:02:40.761 22:40:31 -- setup/hugepages.sh@39 -- # for node in "${!nodes_sys[@]}" 00:02:40.761 22:40:31 -- setup/hugepages.sh@40 -- # for hp in "/sys/devices/system/node/node$node/hugepages/hugepages-"* 00:02:40.761 22:40:31 -- setup/hugepages.sh@41 -- # echo 0 00:02:40.761 22:40:31 -- setup/hugepages.sh@40 -- # for hp in "/sys/devices/system/node/node$node/hugepages/hugepages-"* 00:02:40.761 22:40:31 -- setup/hugepages.sh@41 -- # echo 0 00:02:40.761 22:40:31 -- setup/hugepages.sh@39 -- # for node in "${!nodes_sys[@]}" 00:02:40.761 22:40:31 -- setup/hugepages.sh@40 -- # for hp in "/sys/devices/system/node/node$node/hugepages/hugepages-"* 00:02:40.761 22:40:31 -- setup/hugepages.sh@41 -- # echo 0 00:02:40.761 22:40:31 -- setup/hugepages.sh@40 -- # for hp in "/sys/devices/system/node/node$node/hugepages/hugepages-"* 00:02:40.761 22:40:31 -- setup/hugepages.sh@41 -- # echo 0 00:02:40.761 22:40:31 -- setup/hugepages.sh@45 -- # export CLEAR_HUGE=yes 00:02:40.761 22:40:31 -- setup/hugepages.sh@45 -- # CLEAR_HUGE=yes 00:02:40.762 22:40:31 -- setup/hugepages.sh@210 -- # run_test default_setup default_setup 00:02:40.762 22:40:31 -- common/autotest_common.sh@1077 -- # '[' 2 -le 1 ']' 00:02:40.762 22:40:31 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:02:40.762 22:40:31 -- common/autotest_common.sh@10 -- # set +x 00:02:41.020 ************************************ 00:02:41.020 START TEST default_setup 00:02:41.020 ************************************ 00:02:41.020 22:40:31 -- common/autotest_common.sh@1104 -- # default_setup 00:02:41.020 22:40:31 -- setup/hugepages.sh@136 -- # get_test_nr_hugepages 2097152 0 00:02:41.020 22:40:31 -- setup/hugepages.sh@49 -- # local size=2097152 00:02:41.020 22:40:31 -- setup/hugepages.sh@50 -- # (( 2 > 1 )) 00:02:41.020 22:40:31 -- setup/hugepages.sh@51 -- # shift 00:02:41.020 22:40:31 -- setup/hugepages.sh@52 -- # node_ids=('0') 00:02:41.020 22:40:31 -- setup/hugepages.sh@52 -- # local node_ids 00:02:41.020 22:40:31 -- setup/hugepages.sh@55 -- # (( size >= default_hugepages )) 00:02:41.020 22:40:31 -- setup/hugepages.sh@57 -- # nr_hugepages=1024 00:02:41.020 22:40:31 -- setup/hugepages.sh@58 -- # get_test_nr_hugepages_per_node 0 00:02:41.020 22:40:31 -- setup/hugepages.sh@62 -- # user_nodes=('0') 00:02:41.020 22:40:31 -- setup/hugepages.sh@62 -- # local user_nodes 00:02:41.020 22:40:31 -- setup/hugepages.sh@64 -- # local _nr_hugepages=1024 00:02:41.020 22:40:31 -- setup/hugepages.sh@65 -- # local _no_nodes=2 00:02:41.020 22:40:31 -- setup/hugepages.sh@67 -- # nodes_test=() 00:02:41.020 22:40:31 -- setup/hugepages.sh@67 -- # local -g nodes_test 00:02:41.020 22:40:31 -- setup/hugepages.sh@69 -- # (( 1 > 0 )) 00:02:41.021 22:40:31 -- setup/hugepages.sh@70 -- # for _no_nodes in "${user_nodes[@]}" 00:02:41.021 22:40:31 -- setup/hugepages.sh@71 -- # nodes_test[_no_nodes]=1024 00:02:41.021 22:40:31 -- setup/hugepages.sh@73 -- # return 0 00:02:41.021 22:40:31 -- setup/hugepages.sh@137 -- # setup output 00:02:41.021 22:40:31 -- setup/common.sh@9 -- # [[ output == output ]] 00:02:41.021 22:40:31 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh 00:02:41.973 0000:00:04.7 (8086 0e27): ioatdma -> vfio-pci 00:02:41.973 0000:00:04.6 (8086 0e26): ioatdma -> vfio-pci 00:02:41.973 0000:00:04.5 (8086 0e25): ioatdma -> vfio-pci 00:02:41.973 0000:00:04.4 (8086 0e24): ioatdma -> vfio-pci 00:02:41.973 0000:00:04.3 (8086 0e23): ioatdma -> vfio-pci 00:02:41.973 0000:00:04.2 (8086 0e22): ioatdma -> vfio-pci 00:02:41.973 0000:00:04.1 (8086 0e21): ioatdma -> vfio-pci 00:02:41.973 0000:00:04.0 (8086 0e20): ioatdma -> vfio-pci 00:02:41.973 0000:80:04.7 (8086 0e27): ioatdma -> vfio-pci 00:02:41.973 0000:80:04.6 (8086 0e26): ioatdma -> vfio-pci 00:02:41.973 0000:80:04.5 (8086 0e25): ioatdma -> vfio-pci 00:02:41.973 0000:80:04.4 (8086 0e24): ioatdma -> vfio-pci 00:02:41.973 0000:80:04.3 (8086 0e23): ioatdma -> vfio-pci 00:02:41.973 0000:80:04.2 (8086 0e22): ioatdma -> vfio-pci 00:02:41.973 0000:80:04.1 (8086 0e21): ioatdma -> vfio-pci 00:02:41.973 0000:80:04.0 (8086 0e20): ioatdma -> vfio-pci 00:02:42.911 0000:88:00.0 (8086 0a54): nvme -> vfio-pci 00:02:43.174 22:40:34 -- setup/hugepages.sh@138 -- # verify_nr_hugepages 00:02:43.174 22:40:34 -- setup/hugepages.sh@89 -- # local node 00:02:43.174 22:40:34 -- setup/hugepages.sh@90 -- # local sorted_t 00:02:43.174 22:40:34 -- setup/hugepages.sh@91 -- # local sorted_s 00:02:43.174 22:40:34 -- setup/hugepages.sh@92 -- # local surp 00:02:43.174 22:40:34 -- setup/hugepages.sh@93 -- # local resv 00:02:43.174 22:40:34 -- setup/hugepages.sh@94 -- # local anon 00:02:43.174 22:40:34 -- setup/hugepages.sh@96 -- # [[ always [madvise] never != *\[\n\e\v\e\r\]* ]] 00:02:43.174 22:40:34 -- setup/hugepages.sh@97 -- # get_meminfo AnonHugePages 00:02:43.174 22:40:34 -- setup/common.sh@17 -- # local get=AnonHugePages 00:02:43.174 22:40:34 -- setup/common.sh@18 -- # local node= 00:02:43.174 22:40:34 -- setup/common.sh@19 -- # local var val 00:02:43.174 22:40:34 -- setup/common.sh@20 -- # local mem_f mem 00:02:43.174 22:40:34 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:02:43.174 22:40:34 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:02:43.174 22:40:34 -- setup/common.sh@25 -- # [[ -n '' ]] 00:02:43.174 22:40:34 -- setup/common.sh@28 -- # mapfile -t mem 00:02:43.174 22:40:34 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:02:43.174 22:40:34 -- setup/common.sh@31 -- # IFS=': ' 00:02:43.174 22:40:34 -- setup/common.sh@31 -- # read -r var val _ 00:02:43.174 22:40:34 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60541736 kB' 'MemFree: 43332088 kB' 'MemAvailable: 47323332 kB' 'Buffers: 2696 kB' 'Cached: 12518132 kB' 'SwapCached: 0 kB' 'Active: 9329236 kB' 'Inactive: 3655836 kB' 'Active(anon): 8764920 kB' 'Inactive(anon): 0 kB' 'Active(file): 564316 kB' 'Inactive(file): 3655836 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 467488 kB' 'Mapped: 202608 kB' 'Shmem: 8300676 kB' 'KReclaimable: 415528 kB' 'Slab: 807116 kB' 'SReclaimable: 415528 kB' 'SUnreclaim: 391588 kB' 'KernelStack: 12720 kB' 'PageTables: 8412 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37610896 kB' 'Committed_AS: 9912516 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 197068 kB' 'VmallocChunk: 0 kB' 'Percpu: 38592 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 2506332 kB' 'DirectMap2M: 24676352 kB' 'DirectMap1G: 41943040 kB' 00:02:43.174 22:40:34 -- setup/common.sh@32 -- # [[ MemTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:43.174 22:40:34 -- setup/common.sh@32 -- # continue 00:02:43.174 22:40:34 -- setup/common.sh@31 -- # IFS=': ' 00:02:43.174 22:40:34 -- setup/common.sh@31 -- # read -r var val _ 00:02:43.174 22:40:34 -- setup/common.sh@32 -- # [[ MemFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:43.174 22:40:34 -- setup/common.sh@32 -- # continue 00:02:43.174 22:40:34 -- setup/common.sh@31 -- # IFS=': ' 00:02:43.174 22:40:34 -- setup/common.sh@31 -- # read -r var val _ 00:02:43.174 22:40:34 -- setup/common.sh@32 -- # [[ MemAvailable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:43.174 22:40:34 -- setup/common.sh@32 -- # continue 00:02:43.174 22:40:34 -- setup/common.sh@31 -- # IFS=': ' 00:02:43.174 22:40:34 -- setup/common.sh@31 -- # read -r var val _ 00:02:43.174 22:40:34 -- setup/common.sh@32 -- # [[ Buffers == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:43.174 22:40:34 -- setup/common.sh@32 -- # continue 00:02:43.174 22:40:34 -- setup/common.sh@31 -- # IFS=': ' 00:02:43.174 22:40:34 -- setup/common.sh@31 -- # read -r var val _ 00:02:43.174 22:40:34 -- setup/common.sh@32 -- # [[ Cached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:43.174 22:40:34 -- setup/common.sh@32 -- # continue 00:02:43.174 22:40:34 -- setup/common.sh@31 -- # IFS=': ' 00:02:43.174 22:40:34 -- setup/common.sh@31 -- # read -r var val _ 00:02:43.174 22:40:34 -- setup/common.sh@32 -- # [[ SwapCached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:43.174 22:40:34 -- setup/common.sh@32 -- # continue 00:02:43.174 22:40:34 -- setup/common.sh@31 -- # IFS=': ' 00:02:43.174 22:40:34 -- setup/common.sh@31 -- # read -r var val _ 00:02:43.174 22:40:34 -- setup/common.sh@32 -- # [[ Active == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:43.174 22:40:34 -- setup/common.sh@32 -- # continue 00:02:43.174 22:40:34 -- setup/common.sh@31 -- # IFS=': ' 00:02:43.174 22:40:34 -- setup/common.sh@31 -- # read -r var val _ 00:02:43.174 22:40:34 -- setup/common.sh@32 -- # [[ Inactive == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:43.174 22:40:34 -- setup/common.sh@32 -- # continue 00:02:43.174 22:40:34 -- setup/common.sh@31 -- # IFS=': ' 00:02:43.174 22:40:34 -- setup/common.sh@31 -- # read -r var val _ 00:02:43.174 22:40:34 -- setup/common.sh@32 -- # [[ Active(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:43.174 22:40:34 -- setup/common.sh@32 -- # continue 00:02:43.174 22:40:34 -- setup/common.sh@31 -- # IFS=': ' 00:02:43.174 22:40:34 -- setup/common.sh@31 -- # read -r var val _ 00:02:43.174 22:40:34 -- setup/common.sh@32 -- # [[ Inactive(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:43.174 22:40:34 -- setup/common.sh@32 -- # continue 00:02:43.174 22:40:34 -- setup/common.sh@31 -- # IFS=': ' 00:02:43.174 22:40:34 -- setup/common.sh@31 -- # read -r var val _ 00:02:43.174 22:40:34 -- setup/common.sh@32 -- # [[ Active(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:43.174 22:40:34 -- setup/common.sh@32 -- # continue 00:02:43.174 22:40:34 -- setup/common.sh@31 -- # IFS=': ' 00:02:43.174 22:40:34 -- setup/common.sh@31 -- # read -r var val _ 00:02:43.175 22:40:34 -- setup/common.sh@32 -- # [[ Inactive(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:43.175 22:40:34 -- setup/common.sh@32 -- # continue 00:02:43.175 22:40:34 -- setup/common.sh@31 -- # IFS=': ' 00:02:43.175 22:40:34 -- setup/common.sh@31 -- # read -r var val _ 00:02:43.175 22:40:34 -- setup/common.sh@32 -- # [[ Unevictable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:43.175 22:40:34 -- setup/common.sh@32 -- # continue 00:02:43.175 22:40:34 -- setup/common.sh@31 -- # IFS=': ' 00:02:43.175 22:40:34 -- setup/common.sh@31 -- # read -r var val _ 00:02:43.175 22:40:34 -- setup/common.sh@32 -- # [[ Mlocked == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:43.175 22:40:34 -- setup/common.sh@32 -- # continue 00:02:43.175 22:40:34 -- setup/common.sh@31 -- # IFS=': ' 00:02:43.175 22:40:34 -- setup/common.sh@31 -- # read -r var val _ 00:02:43.175 22:40:34 -- setup/common.sh@32 -- # [[ SwapTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:43.175 22:40:34 -- setup/common.sh@32 -- # continue 00:02:43.175 22:40:34 -- setup/common.sh@31 -- # IFS=': ' 00:02:43.175 22:40:34 -- setup/common.sh@31 -- # read -r var val _ 00:02:43.175 22:40:34 -- setup/common.sh@32 -- # [[ SwapFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:43.175 22:40:34 -- setup/common.sh@32 -- # continue 00:02:43.175 22:40:34 -- setup/common.sh@31 -- # IFS=': ' 00:02:43.175 22:40:34 -- setup/common.sh@31 -- # read -r var val _ 00:02:43.175 22:40:34 -- setup/common.sh@32 -- # [[ Zswap == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:43.175 22:40:34 -- setup/common.sh@32 -- # continue 00:02:43.175 22:40:34 -- setup/common.sh@31 -- # IFS=': ' 00:02:43.175 22:40:34 -- setup/common.sh@31 -- # read -r var val _ 00:02:43.175 22:40:34 -- setup/common.sh@32 -- # [[ Zswapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:43.175 22:40:34 -- setup/common.sh@32 -- # continue 00:02:43.175 22:40:34 -- setup/common.sh@31 -- # IFS=': ' 00:02:43.175 22:40:34 -- setup/common.sh@31 -- # read -r var val _ 00:02:43.175 22:40:34 -- setup/common.sh@32 -- # [[ Dirty == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:43.175 22:40:34 -- setup/common.sh@32 -- # continue 00:02:43.175 22:40:34 -- setup/common.sh@31 -- # IFS=': ' 00:02:43.175 22:40:34 -- setup/common.sh@31 -- # read -r var val _ 00:02:43.175 22:40:34 -- setup/common.sh@32 -- # [[ Writeback == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:43.175 22:40:34 -- setup/common.sh@32 -- # continue 00:02:43.175 22:40:34 -- setup/common.sh@31 -- # IFS=': ' 00:02:43.175 22:40:34 -- setup/common.sh@31 -- # read -r var val _ 00:02:43.175 22:40:34 -- setup/common.sh@32 -- # [[ AnonPages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:43.175 22:40:34 -- setup/common.sh@32 -- # continue 00:02:43.175 22:40:34 -- setup/common.sh@31 -- # IFS=': ' 00:02:43.175 22:40:34 -- setup/common.sh@31 -- # read -r var val _ 00:02:43.175 22:40:34 -- setup/common.sh@32 -- # [[ Mapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:43.175 22:40:34 -- setup/common.sh@32 -- # continue 00:02:43.175 22:40:34 -- setup/common.sh@31 -- # IFS=': ' 00:02:43.175 22:40:34 -- setup/common.sh@31 -- # read -r var val _ 00:02:43.175 22:40:34 -- setup/common.sh@32 -- # [[ Shmem == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:43.175 22:40:34 -- setup/common.sh@32 -- # continue 00:02:43.175 22:40:34 -- setup/common.sh@31 -- # IFS=': ' 00:02:43.175 22:40:34 -- setup/common.sh@31 -- # read -r var val _ 00:02:43.175 22:40:34 -- setup/common.sh@32 -- # [[ KReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:43.175 22:40:34 -- setup/common.sh@32 -- # continue 00:02:43.175 22:40:34 -- setup/common.sh@31 -- # IFS=': ' 00:02:43.175 22:40:34 -- setup/common.sh@31 -- # read -r var val _ 00:02:43.175 22:40:34 -- setup/common.sh@32 -- # [[ Slab == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:43.175 22:40:34 -- setup/common.sh@32 -- # continue 00:02:43.175 22:40:34 -- setup/common.sh@31 -- # IFS=': ' 00:02:43.175 22:40:34 -- setup/common.sh@31 -- # read -r var val _ 00:02:43.175 22:40:34 -- setup/common.sh@32 -- # [[ SReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:43.175 22:40:34 -- setup/common.sh@32 -- # continue 00:02:43.175 22:40:34 -- setup/common.sh@31 -- # IFS=': ' 00:02:43.175 22:40:34 -- setup/common.sh@31 -- # read -r var val _ 00:02:43.175 22:40:34 -- setup/common.sh@32 -- # [[ SUnreclaim == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:43.175 22:40:34 -- setup/common.sh@32 -- # continue 00:02:43.175 22:40:34 -- setup/common.sh@31 -- # IFS=': ' 00:02:43.175 22:40:34 -- setup/common.sh@31 -- # read -r var val _ 00:02:43.175 22:40:34 -- setup/common.sh@32 -- # [[ KernelStack == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:43.175 22:40:34 -- setup/common.sh@32 -- # continue 00:02:43.175 22:40:34 -- setup/common.sh@31 -- # IFS=': ' 00:02:43.175 22:40:34 -- setup/common.sh@31 -- # read -r var val _ 00:02:43.175 22:40:34 -- setup/common.sh@32 -- # [[ PageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:43.175 22:40:34 -- setup/common.sh@32 -- # continue 00:02:43.175 22:40:34 -- setup/common.sh@31 -- # IFS=': ' 00:02:43.175 22:40:34 -- setup/common.sh@31 -- # read -r var val _ 00:02:43.175 22:40:34 -- setup/common.sh@32 -- # [[ SecPageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:43.175 22:40:34 -- setup/common.sh@32 -- # continue 00:02:43.175 22:40:34 -- setup/common.sh@31 -- # IFS=': ' 00:02:43.175 22:40:34 -- setup/common.sh@31 -- # read -r var val _ 00:02:43.175 22:40:34 -- setup/common.sh@32 -- # [[ NFS_Unstable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:43.175 22:40:34 -- setup/common.sh@32 -- # continue 00:02:43.175 22:40:34 -- setup/common.sh@31 -- # IFS=': ' 00:02:43.175 22:40:34 -- setup/common.sh@31 -- # read -r var val _ 00:02:43.175 22:40:34 -- setup/common.sh@32 -- # [[ Bounce == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:43.175 22:40:34 -- setup/common.sh@32 -- # continue 00:02:43.175 22:40:34 -- setup/common.sh@31 -- # IFS=': ' 00:02:43.175 22:40:34 -- setup/common.sh@31 -- # read -r var val _ 00:02:43.175 22:40:34 -- setup/common.sh@32 -- # [[ WritebackTmp == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:43.175 22:40:34 -- setup/common.sh@32 -- # continue 00:02:43.175 22:40:34 -- setup/common.sh@31 -- # IFS=': ' 00:02:43.175 22:40:34 -- setup/common.sh@31 -- # read -r var val _ 00:02:43.175 22:40:34 -- setup/common.sh@32 -- # [[ CommitLimit == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:43.175 22:40:34 -- setup/common.sh@32 -- # continue 00:02:43.175 22:40:34 -- setup/common.sh@31 -- # IFS=': ' 00:02:43.175 22:40:34 -- setup/common.sh@31 -- # read -r var val _ 00:02:43.175 22:40:34 -- setup/common.sh@32 -- # [[ Committed_AS == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:43.175 22:40:34 -- setup/common.sh@32 -- # continue 00:02:43.175 22:40:34 -- setup/common.sh@31 -- # IFS=': ' 00:02:43.175 22:40:34 -- setup/common.sh@31 -- # read -r var val _ 00:02:43.175 22:40:34 -- setup/common.sh@32 -- # [[ VmallocTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:43.175 22:40:34 -- setup/common.sh@32 -- # continue 00:02:43.175 22:40:34 -- setup/common.sh@31 -- # IFS=': ' 00:02:43.175 22:40:34 -- setup/common.sh@31 -- # read -r var val _ 00:02:43.175 22:40:34 -- setup/common.sh@32 -- # [[ VmallocUsed == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:43.175 22:40:34 -- setup/common.sh@32 -- # continue 00:02:43.175 22:40:34 -- setup/common.sh@31 -- # IFS=': ' 00:02:43.175 22:40:34 -- setup/common.sh@31 -- # read -r var val _ 00:02:43.175 22:40:34 -- setup/common.sh@32 -- # [[ VmallocChunk == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:43.175 22:40:34 -- setup/common.sh@32 -- # continue 00:02:43.175 22:40:34 -- setup/common.sh@31 -- # IFS=': ' 00:02:43.175 22:40:34 -- setup/common.sh@31 -- # read -r var val _ 00:02:43.175 22:40:34 -- setup/common.sh@32 -- # [[ Percpu == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:43.175 22:40:34 -- setup/common.sh@32 -- # continue 00:02:43.175 22:40:34 -- setup/common.sh@31 -- # IFS=': ' 00:02:43.175 22:40:34 -- setup/common.sh@31 -- # read -r var val _ 00:02:43.175 22:40:34 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:43.175 22:40:34 -- setup/common.sh@32 -- # continue 00:02:43.175 22:40:34 -- setup/common.sh@31 -- # IFS=': ' 00:02:43.175 22:40:34 -- setup/common.sh@31 -- # read -r var val _ 00:02:43.175 22:40:34 -- setup/common.sh@32 -- # [[ AnonHugePages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:43.175 22:40:34 -- setup/common.sh@33 -- # echo 0 00:02:43.175 22:40:34 -- setup/common.sh@33 -- # return 0 00:02:43.175 22:40:34 -- setup/hugepages.sh@97 -- # anon=0 00:02:43.175 22:40:34 -- setup/hugepages.sh@99 -- # get_meminfo HugePages_Surp 00:02:43.175 22:40:34 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:02:43.175 22:40:34 -- setup/common.sh@18 -- # local node= 00:02:43.175 22:40:34 -- setup/common.sh@19 -- # local var val 00:02:43.175 22:40:34 -- setup/common.sh@20 -- # local mem_f mem 00:02:43.175 22:40:34 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:02:43.175 22:40:34 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:02:43.175 22:40:34 -- setup/common.sh@25 -- # [[ -n '' ]] 00:02:43.175 22:40:34 -- setup/common.sh@28 -- # mapfile -t mem 00:02:43.175 22:40:34 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:02:43.175 22:40:34 -- setup/common.sh@31 -- # IFS=': ' 00:02:43.175 22:40:34 -- setup/common.sh@31 -- # read -r var val _ 00:02:43.175 22:40:34 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60541736 kB' 'MemFree: 43332272 kB' 'MemAvailable: 47323516 kB' 'Buffers: 2696 kB' 'Cached: 12518136 kB' 'SwapCached: 0 kB' 'Active: 9328712 kB' 'Inactive: 3655836 kB' 'Active(anon): 8764396 kB' 'Inactive(anon): 0 kB' 'Active(file): 564316 kB' 'Inactive(file): 3655836 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 467000 kB' 'Mapped: 202560 kB' 'Shmem: 8300680 kB' 'KReclaimable: 415528 kB' 'Slab: 807112 kB' 'SReclaimable: 415528 kB' 'SUnreclaim: 391584 kB' 'KernelStack: 12832 kB' 'PageTables: 8704 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37610896 kB' 'Committed_AS: 9912528 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 197068 kB' 'VmallocChunk: 0 kB' 'Percpu: 38592 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 2506332 kB' 'DirectMap2M: 24676352 kB' 'DirectMap1G: 41943040 kB' 00:02:43.175 22:40:34 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:43.175 22:40:34 -- setup/common.sh@32 -- # continue 00:02:43.175 22:40:34 -- setup/common.sh@31 -- # IFS=': ' 00:02:43.175 22:40:34 -- setup/common.sh@31 -- # read -r var val _ 00:02:43.175 22:40:34 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:43.175 22:40:34 -- setup/common.sh@32 -- # continue 00:02:43.175 22:40:34 -- setup/common.sh@31 -- # IFS=': ' 00:02:43.175 22:40:34 -- setup/common.sh@31 -- # read -r var val _ 00:02:43.175 22:40:34 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:43.175 22:40:34 -- setup/common.sh@32 -- # continue 00:02:43.175 22:40:34 -- setup/common.sh@31 -- # IFS=': ' 00:02:43.175 22:40:34 -- setup/common.sh@31 -- # read -r var val _ 00:02:43.175 22:40:34 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:43.175 22:40:34 -- setup/common.sh@32 -- # continue 00:02:43.175 22:40:34 -- setup/common.sh@31 -- # IFS=': ' 00:02:43.175 22:40:34 -- setup/common.sh@31 -- # read -r var val _ 00:02:43.175 22:40:34 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:43.176 22:40:34 -- setup/common.sh@32 -- # continue 00:02:43.176 22:40:34 -- setup/common.sh@31 -- # IFS=': ' 00:02:43.176 22:40:34 -- setup/common.sh@31 -- # read -r var val _ 00:02:43.176 22:40:34 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:43.176 22:40:34 -- setup/common.sh@32 -- # continue 00:02:43.176 22:40:34 -- setup/common.sh@31 -- # IFS=': ' 00:02:43.176 22:40:34 -- setup/common.sh@31 -- # read -r var val _ 00:02:43.176 22:40:34 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:43.176 22:40:34 -- setup/common.sh@32 -- # continue 00:02:43.176 22:40:34 -- setup/common.sh@31 -- # IFS=': ' 00:02:43.176 22:40:34 -- setup/common.sh@31 -- # read -r var val _ 00:02:43.176 22:40:34 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:43.176 22:40:34 -- setup/common.sh@32 -- # continue 00:02:43.176 22:40:34 -- setup/common.sh@31 -- # IFS=': ' 00:02:43.176 22:40:34 -- setup/common.sh@31 -- # read -r var val _ 00:02:43.176 22:40:34 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:43.176 22:40:34 -- setup/common.sh@32 -- # continue 00:02:43.176 22:40:34 -- setup/common.sh@31 -- # IFS=': ' 00:02:43.176 22:40:34 -- setup/common.sh@31 -- # read -r var val _ 00:02:43.176 22:40:34 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:43.176 22:40:34 -- setup/common.sh@32 -- # continue 00:02:43.176 22:40:34 -- setup/common.sh@31 -- # IFS=': ' 00:02:43.176 22:40:34 -- setup/common.sh@31 -- # read -r var val _ 00:02:43.176 22:40:34 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:43.176 22:40:34 -- setup/common.sh@32 -- # continue 00:02:43.176 22:40:34 -- setup/common.sh@31 -- # IFS=': ' 00:02:43.176 22:40:34 -- setup/common.sh@31 -- # read -r var val _ 00:02:43.176 22:40:34 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:43.176 22:40:34 -- setup/common.sh@32 -- # continue 00:02:43.176 22:40:34 -- setup/common.sh@31 -- # IFS=': ' 00:02:43.176 22:40:34 -- setup/common.sh@31 -- # read -r var val _ 00:02:43.176 22:40:34 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:43.176 22:40:34 -- setup/common.sh@32 -- # continue 00:02:43.176 22:40:34 -- setup/common.sh@31 -- # IFS=': ' 00:02:43.176 22:40:34 -- setup/common.sh@31 -- # read -r var val _ 00:02:43.176 22:40:34 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:43.176 22:40:34 -- setup/common.sh@32 -- # continue 00:02:43.176 22:40:34 -- setup/common.sh@31 -- # IFS=': ' 00:02:43.176 22:40:34 -- setup/common.sh@31 -- # read -r var val _ 00:02:43.176 22:40:34 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:43.176 22:40:34 -- setup/common.sh@32 -- # continue 00:02:43.176 22:40:34 -- setup/common.sh@31 -- # IFS=': ' 00:02:43.176 22:40:34 -- setup/common.sh@31 -- # read -r var val _ 00:02:43.176 22:40:34 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:43.176 22:40:34 -- setup/common.sh@32 -- # continue 00:02:43.176 22:40:34 -- setup/common.sh@31 -- # IFS=': ' 00:02:43.176 22:40:34 -- setup/common.sh@31 -- # read -r var val _ 00:02:43.176 22:40:34 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:43.176 22:40:34 -- setup/common.sh@32 -- # continue 00:02:43.176 22:40:34 -- setup/common.sh@31 -- # IFS=': ' 00:02:43.176 22:40:34 -- setup/common.sh@31 -- # read -r var val _ 00:02:43.176 22:40:34 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:43.176 22:40:34 -- setup/common.sh@32 -- # continue 00:02:43.176 22:40:34 -- setup/common.sh@31 -- # IFS=': ' 00:02:43.176 22:40:34 -- setup/common.sh@31 -- # read -r var val _ 00:02:43.176 22:40:34 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:43.176 22:40:34 -- setup/common.sh@32 -- # continue 00:02:43.176 22:40:34 -- setup/common.sh@31 -- # IFS=': ' 00:02:43.176 22:40:34 -- setup/common.sh@31 -- # read -r var val _ 00:02:43.176 22:40:34 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:43.176 22:40:34 -- setup/common.sh@32 -- # continue 00:02:43.176 22:40:34 -- setup/common.sh@31 -- # IFS=': ' 00:02:43.176 22:40:34 -- setup/common.sh@31 -- # read -r var val _ 00:02:43.176 22:40:34 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:43.176 22:40:34 -- setup/common.sh@32 -- # continue 00:02:43.176 22:40:34 -- setup/common.sh@31 -- # IFS=': ' 00:02:43.176 22:40:34 -- setup/common.sh@31 -- # read -r var val _ 00:02:43.176 22:40:34 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:43.176 22:40:34 -- setup/common.sh@32 -- # continue 00:02:43.176 22:40:34 -- setup/common.sh@31 -- # IFS=': ' 00:02:43.176 22:40:34 -- setup/common.sh@31 -- # read -r var val _ 00:02:43.176 22:40:34 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:43.176 22:40:34 -- setup/common.sh@32 -- # continue 00:02:43.176 22:40:34 -- setup/common.sh@31 -- # IFS=': ' 00:02:43.176 22:40:34 -- setup/common.sh@31 -- # read -r var val _ 00:02:43.176 22:40:34 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:43.176 22:40:34 -- setup/common.sh@32 -- # continue 00:02:43.176 22:40:34 -- setup/common.sh@31 -- # IFS=': ' 00:02:43.176 22:40:34 -- setup/common.sh@31 -- # read -r var val _ 00:02:43.176 22:40:34 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:43.176 22:40:34 -- setup/common.sh@32 -- # continue 00:02:43.176 22:40:34 -- setup/common.sh@31 -- # IFS=': ' 00:02:43.176 22:40:34 -- setup/common.sh@31 -- # read -r var val _ 00:02:43.176 22:40:34 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:43.176 22:40:34 -- setup/common.sh@32 -- # continue 00:02:43.176 22:40:34 -- setup/common.sh@31 -- # IFS=': ' 00:02:43.176 22:40:34 -- setup/common.sh@31 -- # read -r var val _ 00:02:43.176 22:40:34 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:43.176 22:40:34 -- setup/common.sh@32 -- # continue 00:02:43.176 22:40:34 -- setup/common.sh@31 -- # IFS=': ' 00:02:43.176 22:40:34 -- setup/common.sh@31 -- # read -r var val _ 00:02:43.176 22:40:34 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:43.176 22:40:34 -- setup/common.sh@32 -- # continue 00:02:43.176 22:40:34 -- setup/common.sh@31 -- # IFS=': ' 00:02:43.176 22:40:34 -- setup/common.sh@31 -- # read -r var val _ 00:02:43.176 22:40:34 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:43.176 22:40:34 -- setup/common.sh@32 -- # continue 00:02:43.176 22:40:34 -- setup/common.sh@31 -- # IFS=': ' 00:02:43.176 22:40:34 -- setup/common.sh@31 -- # read -r var val _ 00:02:43.176 22:40:34 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:43.176 22:40:34 -- setup/common.sh@32 -- # continue 00:02:43.176 22:40:34 -- setup/common.sh@31 -- # IFS=': ' 00:02:43.176 22:40:34 -- setup/common.sh@31 -- # read -r var val _ 00:02:43.176 22:40:34 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:43.176 22:40:34 -- setup/common.sh@32 -- # continue 00:02:43.176 22:40:34 -- setup/common.sh@31 -- # IFS=': ' 00:02:43.176 22:40:34 -- setup/common.sh@31 -- # read -r var val _ 00:02:43.176 22:40:34 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:43.176 22:40:34 -- setup/common.sh@32 -- # continue 00:02:43.176 22:40:34 -- setup/common.sh@31 -- # IFS=': ' 00:02:43.176 22:40:34 -- setup/common.sh@31 -- # read -r var val _ 00:02:43.176 22:40:34 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:43.176 22:40:34 -- setup/common.sh@32 -- # continue 00:02:43.176 22:40:34 -- setup/common.sh@31 -- # IFS=': ' 00:02:43.176 22:40:34 -- setup/common.sh@31 -- # read -r var val _ 00:02:43.176 22:40:34 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:43.176 22:40:34 -- setup/common.sh@32 -- # continue 00:02:43.176 22:40:34 -- setup/common.sh@31 -- # IFS=': ' 00:02:43.176 22:40:34 -- setup/common.sh@31 -- # read -r var val _ 00:02:43.176 22:40:34 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:43.176 22:40:34 -- setup/common.sh@32 -- # continue 00:02:43.176 22:40:34 -- setup/common.sh@31 -- # IFS=': ' 00:02:43.176 22:40:34 -- setup/common.sh@31 -- # read -r var val _ 00:02:43.176 22:40:34 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:43.176 22:40:34 -- setup/common.sh@32 -- # continue 00:02:43.176 22:40:34 -- setup/common.sh@31 -- # IFS=': ' 00:02:43.176 22:40:34 -- setup/common.sh@31 -- # read -r var val _ 00:02:43.176 22:40:34 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:43.176 22:40:34 -- setup/common.sh@32 -- # continue 00:02:43.176 22:40:34 -- setup/common.sh@31 -- # IFS=': ' 00:02:43.176 22:40:34 -- setup/common.sh@31 -- # read -r var val _ 00:02:43.176 22:40:34 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:43.176 22:40:34 -- setup/common.sh@32 -- # continue 00:02:43.176 22:40:34 -- setup/common.sh@31 -- # IFS=': ' 00:02:43.176 22:40:34 -- setup/common.sh@31 -- # read -r var val _ 00:02:43.176 22:40:34 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:43.176 22:40:34 -- setup/common.sh@32 -- # continue 00:02:43.176 22:40:34 -- setup/common.sh@31 -- # IFS=': ' 00:02:43.176 22:40:34 -- setup/common.sh@31 -- # read -r var val _ 00:02:43.176 22:40:34 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:43.176 22:40:34 -- setup/common.sh@32 -- # continue 00:02:43.176 22:40:34 -- setup/common.sh@31 -- # IFS=': ' 00:02:43.176 22:40:34 -- setup/common.sh@31 -- # read -r var val _ 00:02:43.176 22:40:34 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:43.176 22:40:34 -- setup/common.sh@32 -- # continue 00:02:43.176 22:40:34 -- setup/common.sh@31 -- # IFS=': ' 00:02:43.176 22:40:34 -- setup/common.sh@31 -- # read -r var val _ 00:02:43.176 22:40:34 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:43.176 22:40:34 -- setup/common.sh@32 -- # continue 00:02:43.176 22:40:34 -- setup/common.sh@31 -- # IFS=': ' 00:02:43.176 22:40:34 -- setup/common.sh@31 -- # read -r var val _ 00:02:43.176 22:40:34 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:43.176 22:40:34 -- setup/common.sh@32 -- # continue 00:02:43.176 22:40:34 -- setup/common.sh@31 -- # IFS=': ' 00:02:43.176 22:40:34 -- setup/common.sh@31 -- # read -r var val _ 00:02:43.176 22:40:34 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:43.176 22:40:34 -- setup/common.sh@32 -- # continue 00:02:43.176 22:40:34 -- setup/common.sh@31 -- # IFS=': ' 00:02:43.176 22:40:34 -- setup/common.sh@31 -- # read -r var val _ 00:02:43.176 22:40:34 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:43.176 22:40:34 -- setup/common.sh@32 -- # continue 00:02:43.176 22:40:34 -- setup/common.sh@31 -- # IFS=': ' 00:02:43.176 22:40:34 -- setup/common.sh@31 -- # read -r var val _ 00:02:43.176 22:40:34 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:43.176 22:40:34 -- setup/common.sh@32 -- # continue 00:02:43.176 22:40:34 -- setup/common.sh@31 -- # IFS=': ' 00:02:43.177 22:40:34 -- setup/common.sh@31 -- # read -r var val _ 00:02:43.177 22:40:34 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:43.177 22:40:34 -- setup/common.sh@32 -- # continue 00:02:43.177 22:40:34 -- setup/common.sh@31 -- # IFS=': ' 00:02:43.177 22:40:34 -- setup/common.sh@31 -- # read -r var val _ 00:02:43.177 22:40:34 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:43.177 22:40:34 -- setup/common.sh@32 -- # continue 00:02:43.177 22:40:34 -- setup/common.sh@31 -- # IFS=': ' 00:02:43.177 22:40:34 -- setup/common.sh@31 -- # read -r var val _ 00:02:43.177 22:40:34 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:43.177 22:40:34 -- setup/common.sh@32 -- # continue 00:02:43.177 22:40:34 -- setup/common.sh@31 -- # IFS=': ' 00:02:43.177 22:40:34 -- setup/common.sh@31 -- # read -r var val _ 00:02:43.177 22:40:34 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:43.177 22:40:34 -- setup/common.sh@32 -- # continue 00:02:43.177 22:40:34 -- setup/common.sh@31 -- # IFS=': ' 00:02:43.177 22:40:34 -- setup/common.sh@31 -- # read -r var val _ 00:02:43.177 22:40:34 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:43.177 22:40:34 -- setup/common.sh@32 -- # continue 00:02:43.177 22:40:34 -- setup/common.sh@31 -- # IFS=': ' 00:02:43.177 22:40:34 -- setup/common.sh@31 -- # read -r var val _ 00:02:43.177 22:40:34 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:43.177 22:40:34 -- setup/common.sh@33 -- # echo 0 00:02:43.177 22:40:34 -- setup/common.sh@33 -- # return 0 00:02:43.177 22:40:34 -- setup/hugepages.sh@99 -- # surp=0 00:02:43.177 22:40:34 -- setup/hugepages.sh@100 -- # get_meminfo HugePages_Rsvd 00:02:43.177 22:40:34 -- setup/common.sh@17 -- # local get=HugePages_Rsvd 00:02:43.177 22:40:34 -- setup/common.sh@18 -- # local node= 00:02:43.177 22:40:34 -- setup/common.sh@19 -- # local var val 00:02:43.177 22:40:34 -- setup/common.sh@20 -- # local mem_f mem 00:02:43.177 22:40:34 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:02:43.177 22:40:34 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:02:43.177 22:40:34 -- setup/common.sh@25 -- # [[ -n '' ]] 00:02:43.177 22:40:34 -- setup/common.sh@28 -- # mapfile -t mem 00:02:43.177 22:40:34 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:02:43.177 22:40:34 -- setup/common.sh@31 -- # IFS=': ' 00:02:43.177 22:40:34 -- setup/common.sh@31 -- # read -r var val _ 00:02:43.177 22:40:34 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60541736 kB' 'MemFree: 43332480 kB' 'MemAvailable: 47323724 kB' 'Buffers: 2696 kB' 'Cached: 12518148 kB' 'SwapCached: 0 kB' 'Active: 9328348 kB' 'Inactive: 3655836 kB' 'Active(anon): 8764032 kB' 'Inactive(anon): 0 kB' 'Active(file): 564316 kB' 'Inactive(file): 3655836 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 466684 kB' 'Mapped: 202500 kB' 'Shmem: 8300692 kB' 'KReclaimable: 415528 kB' 'Slab: 807164 kB' 'SReclaimable: 415528 kB' 'SUnreclaim: 391636 kB' 'KernelStack: 12832 kB' 'PageTables: 8744 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37610896 kB' 'Committed_AS: 9912544 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 197052 kB' 'VmallocChunk: 0 kB' 'Percpu: 38592 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 2506332 kB' 'DirectMap2M: 24676352 kB' 'DirectMap1G: 41943040 kB' 00:02:43.177 22:40:34 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:43.177 22:40:34 -- setup/common.sh@32 -- # continue 00:02:43.177 22:40:34 -- setup/common.sh@31 -- # IFS=': ' 00:02:43.177 22:40:34 -- setup/common.sh@31 -- # read -r var val _ 00:02:43.177 22:40:34 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:43.177 22:40:34 -- setup/common.sh@32 -- # continue 00:02:43.177 22:40:34 -- setup/common.sh@31 -- # IFS=': ' 00:02:43.177 22:40:34 -- setup/common.sh@31 -- # read -r var val _ 00:02:43.177 22:40:34 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:43.177 22:40:34 -- setup/common.sh@32 -- # continue 00:02:43.177 22:40:34 -- setup/common.sh@31 -- # IFS=': ' 00:02:43.177 22:40:34 -- setup/common.sh@31 -- # read -r var val _ 00:02:43.177 22:40:34 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:43.177 22:40:34 -- setup/common.sh@32 -- # continue 00:02:43.177 22:40:34 -- setup/common.sh@31 -- # IFS=': ' 00:02:43.177 22:40:34 -- setup/common.sh@31 -- # read -r var val _ 00:02:43.177 22:40:34 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:43.177 22:40:34 -- setup/common.sh@32 -- # continue 00:02:43.177 22:40:34 -- setup/common.sh@31 -- # IFS=': ' 00:02:43.177 22:40:34 -- setup/common.sh@31 -- # read -r var val _ 00:02:43.177 22:40:34 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:43.177 22:40:34 -- setup/common.sh@32 -- # continue 00:02:43.177 22:40:34 -- setup/common.sh@31 -- # IFS=': ' 00:02:43.177 22:40:34 -- setup/common.sh@31 -- # read -r var val _ 00:02:43.177 22:40:34 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:43.177 22:40:34 -- setup/common.sh@32 -- # continue 00:02:43.177 22:40:34 -- setup/common.sh@31 -- # IFS=': ' 00:02:43.177 22:40:34 -- setup/common.sh@31 -- # read -r var val _ 00:02:43.177 22:40:34 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:43.177 22:40:34 -- setup/common.sh@32 -- # continue 00:02:43.177 22:40:34 -- setup/common.sh@31 -- # IFS=': ' 00:02:43.177 22:40:34 -- setup/common.sh@31 -- # read -r var val _ 00:02:43.177 22:40:34 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:43.177 22:40:34 -- setup/common.sh@32 -- # continue 00:02:43.177 22:40:34 -- setup/common.sh@31 -- # IFS=': ' 00:02:43.177 22:40:34 -- setup/common.sh@31 -- # read -r var val _ 00:02:43.177 22:40:34 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:43.177 22:40:34 -- setup/common.sh@32 -- # continue 00:02:43.177 22:40:34 -- setup/common.sh@31 -- # IFS=': ' 00:02:43.177 22:40:34 -- setup/common.sh@31 -- # read -r var val _ 00:02:43.177 22:40:34 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:43.177 22:40:34 -- setup/common.sh@32 -- # continue 00:02:43.177 22:40:34 -- setup/common.sh@31 -- # IFS=': ' 00:02:43.177 22:40:34 -- setup/common.sh@31 -- # read -r var val _ 00:02:43.177 22:40:34 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:43.177 22:40:34 -- setup/common.sh@32 -- # continue 00:02:43.177 22:40:34 -- setup/common.sh@31 -- # IFS=': ' 00:02:43.177 22:40:34 -- setup/common.sh@31 -- # read -r var val _ 00:02:43.177 22:40:34 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:43.177 22:40:34 -- setup/common.sh@32 -- # continue 00:02:43.177 22:40:34 -- setup/common.sh@31 -- # IFS=': ' 00:02:43.177 22:40:34 -- setup/common.sh@31 -- # read -r var val _ 00:02:43.177 22:40:34 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:43.177 22:40:34 -- setup/common.sh@32 -- # continue 00:02:43.177 22:40:34 -- setup/common.sh@31 -- # IFS=': ' 00:02:43.177 22:40:34 -- setup/common.sh@31 -- # read -r var val _ 00:02:43.177 22:40:34 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:43.177 22:40:34 -- setup/common.sh@32 -- # continue 00:02:43.177 22:40:34 -- setup/common.sh@31 -- # IFS=': ' 00:02:43.177 22:40:34 -- setup/common.sh@31 -- # read -r var val _ 00:02:43.177 22:40:34 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:43.177 22:40:34 -- setup/common.sh@32 -- # continue 00:02:43.177 22:40:34 -- setup/common.sh@31 -- # IFS=': ' 00:02:43.177 22:40:34 -- setup/common.sh@31 -- # read -r var val _ 00:02:43.177 22:40:34 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:43.177 22:40:34 -- setup/common.sh@32 -- # continue 00:02:43.177 22:40:34 -- setup/common.sh@31 -- # IFS=': ' 00:02:43.177 22:40:34 -- setup/common.sh@31 -- # read -r var val _ 00:02:43.177 22:40:34 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:43.177 22:40:34 -- setup/common.sh@32 -- # continue 00:02:43.177 22:40:34 -- setup/common.sh@31 -- # IFS=': ' 00:02:43.177 22:40:34 -- setup/common.sh@31 -- # read -r var val _ 00:02:43.177 22:40:34 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:43.177 22:40:34 -- setup/common.sh@32 -- # continue 00:02:43.177 22:40:34 -- setup/common.sh@31 -- # IFS=': ' 00:02:43.177 22:40:34 -- setup/common.sh@31 -- # read -r var val _ 00:02:43.177 22:40:34 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:43.177 22:40:34 -- setup/common.sh@32 -- # continue 00:02:43.177 22:40:34 -- setup/common.sh@31 -- # IFS=': ' 00:02:43.177 22:40:34 -- setup/common.sh@31 -- # read -r var val _ 00:02:43.177 22:40:34 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:43.177 22:40:34 -- setup/common.sh@32 -- # continue 00:02:43.177 22:40:34 -- setup/common.sh@31 -- # IFS=': ' 00:02:43.177 22:40:34 -- setup/common.sh@31 -- # read -r var val _ 00:02:43.177 22:40:34 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:43.177 22:40:34 -- setup/common.sh@32 -- # continue 00:02:43.177 22:40:34 -- setup/common.sh@31 -- # IFS=': ' 00:02:43.177 22:40:34 -- setup/common.sh@31 -- # read -r var val _ 00:02:43.177 22:40:34 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:43.177 22:40:34 -- setup/common.sh@32 -- # continue 00:02:43.177 22:40:34 -- setup/common.sh@31 -- # IFS=': ' 00:02:43.177 22:40:34 -- setup/common.sh@31 -- # read -r var val _ 00:02:43.177 22:40:34 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:43.177 22:40:34 -- setup/common.sh@32 -- # continue 00:02:43.177 22:40:34 -- setup/common.sh@31 -- # IFS=': ' 00:02:43.177 22:40:34 -- setup/common.sh@31 -- # read -r var val _ 00:02:43.177 22:40:34 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:43.177 22:40:34 -- setup/common.sh@32 -- # continue 00:02:43.177 22:40:34 -- setup/common.sh@31 -- # IFS=': ' 00:02:43.177 22:40:34 -- setup/common.sh@31 -- # read -r var val _ 00:02:43.177 22:40:34 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:43.177 22:40:34 -- setup/common.sh@32 -- # continue 00:02:43.177 22:40:34 -- setup/common.sh@31 -- # IFS=': ' 00:02:43.177 22:40:34 -- setup/common.sh@31 -- # read -r var val _ 00:02:43.177 22:40:34 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:43.177 22:40:34 -- setup/common.sh@32 -- # continue 00:02:43.177 22:40:34 -- setup/common.sh@31 -- # IFS=': ' 00:02:43.177 22:40:34 -- setup/common.sh@31 -- # read -r var val _ 00:02:43.177 22:40:34 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:43.177 22:40:34 -- setup/common.sh@32 -- # continue 00:02:43.177 22:40:34 -- setup/common.sh@31 -- # IFS=': ' 00:02:43.177 22:40:34 -- setup/common.sh@31 -- # read -r var val _ 00:02:43.178 22:40:34 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:43.178 22:40:34 -- setup/common.sh@32 -- # continue 00:02:43.178 22:40:34 -- setup/common.sh@31 -- # IFS=': ' 00:02:43.178 22:40:34 -- setup/common.sh@31 -- # read -r var val _ 00:02:43.178 22:40:34 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:43.178 22:40:34 -- setup/common.sh@32 -- # continue 00:02:43.178 22:40:34 -- setup/common.sh@31 -- # IFS=': ' 00:02:43.178 22:40:34 -- setup/common.sh@31 -- # read -r var val _ 00:02:43.178 22:40:34 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:43.178 22:40:34 -- setup/common.sh@32 -- # continue 00:02:43.178 22:40:34 -- setup/common.sh@31 -- # IFS=': ' 00:02:43.178 22:40:34 -- setup/common.sh@31 -- # read -r var val _ 00:02:43.178 22:40:34 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:43.178 22:40:34 -- setup/common.sh@32 -- # continue 00:02:43.178 22:40:34 -- setup/common.sh@31 -- # IFS=': ' 00:02:43.178 22:40:34 -- setup/common.sh@31 -- # read -r var val _ 00:02:43.178 22:40:34 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:43.178 22:40:34 -- setup/common.sh@32 -- # continue 00:02:43.178 22:40:34 -- setup/common.sh@31 -- # IFS=': ' 00:02:43.178 22:40:34 -- setup/common.sh@31 -- # read -r var val _ 00:02:43.178 22:40:34 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:43.178 22:40:34 -- setup/common.sh@32 -- # continue 00:02:43.178 22:40:34 -- setup/common.sh@31 -- # IFS=': ' 00:02:43.178 22:40:34 -- setup/common.sh@31 -- # read -r var val _ 00:02:43.178 22:40:34 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:43.178 22:40:34 -- setup/common.sh@32 -- # continue 00:02:43.178 22:40:34 -- setup/common.sh@31 -- # IFS=': ' 00:02:43.178 22:40:34 -- setup/common.sh@31 -- # read -r var val _ 00:02:43.178 22:40:34 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:43.178 22:40:34 -- setup/common.sh@32 -- # continue 00:02:43.178 22:40:34 -- setup/common.sh@31 -- # IFS=': ' 00:02:43.178 22:40:34 -- setup/common.sh@31 -- # read -r var val _ 00:02:43.178 22:40:34 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:43.178 22:40:34 -- setup/common.sh@32 -- # continue 00:02:43.178 22:40:34 -- setup/common.sh@31 -- # IFS=': ' 00:02:43.178 22:40:34 -- setup/common.sh@31 -- # read -r var val _ 00:02:43.178 22:40:34 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:43.178 22:40:34 -- setup/common.sh@32 -- # continue 00:02:43.178 22:40:34 -- setup/common.sh@31 -- # IFS=': ' 00:02:43.178 22:40:34 -- setup/common.sh@31 -- # read -r var val _ 00:02:43.178 22:40:34 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:43.178 22:40:34 -- setup/common.sh@32 -- # continue 00:02:43.178 22:40:34 -- setup/common.sh@31 -- # IFS=': ' 00:02:43.178 22:40:34 -- setup/common.sh@31 -- # read -r var val _ 00:02:43.178 22:40:34 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:43.178 22:40:34 -- setup/common.sh@32 -- # continue 00:02:43.178 22:40:34 -- setup/common.sh@31 -- # IFS=': ' 00:02:43.178 22:40:34 -- setup/common.sh@31 -- # read -r var val _ 00:02:43.178 22:40:34 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:43.178 22:40:34 -- setup/common.sh@32 -- # continue 00:02:43.178 22:40:34 -- setup/common.sh@31 -- # IFS=': ' 00:02:43.178 22:40:34 -- setup/common.sh@31 -- # read -r var val _ 00:02:43.178 22:40:34 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:43.178 22:40:34 -- setup/common.sh@32 -- # continue 00:02:43.178 22:40:34 -- setup/common.sh@31 -- # IFS=': ' 00:02:43.178 22:40:34 -- setup/common.sh@31 -- # read -r var val _ 00:02:43.178 22:40:34 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:43.178 22:40:34 -- setup/common.sh@32 -- # continue 00:02:43.178 22:40:34 -- setup/common.sh@31 -- # IFS=': ' 00:02:43.178 22:40:34 -- setup/common.sh@31 -- # read -r var val _ 00:02:43.178 22:40:34 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:43.178 22:40:34 -- setup/common.sh@32 -- # continue 00:02:43.178 22:40:34 -- setup/common.sh@31 -- # IFS=': ' 00:02:43.178 22:40:34 -- setup/common.sh@31 -- # read -r var val _ 00:02:43.178 22:40:34 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:43.178 22:40:34 -- setup/common.sh@32 -- # continue 00:02:43.178 22:40:34 -- setup/common.sh@31 -- # IFS=': ' 00:02:43.178 22:40:34 -- setup/common.sh@31 -- # read -r var val _ 00:02:43.178 22:40:34 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:43.178 22:40:34 -- setup/common.sh@32 -- # continue 00:02:43.178 22:40:34 -- setup/common.sh@31 -- # IFS=': ' 00:02:43.178 22:40:34 -- setup/common.sh@31 -- # read -r var val _ 00:02:43.178 22:40:34 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:43.178 22:40:34 -- setup/common.sh@32 -- # continue 00:02:43.178 22:40:34 -- setup/common.sh@31 -- # IFS=': ' 00:02:43.178 22:40:34 -- setup/common.sh@31 -- # read -r var val _ 00:02:43.178 22:40:34 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:43.178 22:40:34 -- setup/common.sh@32 -- # continue 00:02:43.178 22:40:34 -- setup/common.sh@31 -- # IFS=': ' 00:02:43.178 22:40:34 -- setup/common.sh@31 -- # read -r var val _ 00:02:43.178 22:40:34 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:43.178 22:40:34 -- setup/common.sh@32 -- # continue 00:02:43.178 22:40:34 -- setup/common.sh@31 -- # IFS=': ' 00:02:43.178 22:40:34 -- setup/common.sh@31 -- # read -r var val _ 00:02:43.178 22:40:34 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:43.178 22:40:34 -- setup/common.sh@32 -- # continue 00:02:43.178 22:40:34 -- setup/common.sh@31 -- # IFS=': ' 00:02:43.178 22:40:34 -- setup/common.sh@31 -- # read -r var val _ 00:02:43.178 22:40:34 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:43.178 22:40:34 -- setup/common.sh@33 -- # echo 0 00:02:43.178 22:40:34 -- setup/common.sh@33 -- # return 0 00:02:43.178 22:40:34 -- setup/hugepages.sh@100 -- # resv=0 00:02:43.178 22:40:34 -- setup/hugepages.sh@102 -- # echo nr_hugepages=1024 00:02:43.178 nr_hugepages=1024 00:02:43.178 22:40:34 -- setup/hugepages.sh@103 -- # echo resv_hugepages=0 00:02:43.178 resv_hugepages=0 00:02:43.178 22:40:34 -- setup/hugepages.sh@104 -- # echo surplus_hugepages=0 00:02:43.178 surplus_hugepages=0 00:02:43.178 22:40:34 -- setup/hugepages.sh@105 -- # echo anon_hugepages=0 00:02:43.178 anon_hugepages=0 00:02:43.178 22:40:34 -- setup/hugepages.sh@107 -- # (( 1024 == nr_hugepages + surp + resv )) 00:02:43.178 22:40:34 -- setup/hugepages.sh@109 -- # (( 1024 == nr_hugepages )) 00:02:43.178 22:40:34 -- setup/hugepages.sh@110 -- # get_meminfo HugePages_Total 00:02:43.178 22:40:34 -- setup/common.sh@17 -- # local get=HugePages_Total 00:02:43.178 22:40:34 -- setup/common.sh@18 -- # local node= 00:02:43.178 22:40:34 -- setup/common.sh@19 -- # local var val 00:02:43.178 22:40:34 -- setup/common.sh@20 -- # local mem_f mem 00:02:43.178 22:40:34 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:02:43.178 22:40:34 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:02:43.178 22:40:34 -- setup/common.sh@25 -- # [[ -n '' ]] 00:02:43.178 22:40:34 -- setup/common.sh@28 -- # mapfile -t mem 00:02:43.178 22:40:34 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:02:43.178 22:40:34 -- setup/common.sh@31 -- # IFS=': ' 00:02:43.178 22:40:34 -- setup/common.sh@31 -- # read -r var val _ 00:02:43.178 22:40:34 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60541736 kB' 'MemFree: 43332880 kB' 'MemAvailable: 47324124 kB' 'Buffers: 2696 kB' 'Cached: 12518160 kB' 'SwapCached: 0 kB' 'Active: 9328364 kB' 'Inactive: 3655836 kB' 'Active(anon): 8764048 kB' 'Inactive(anon): 0 kB' 'Active(file): 564316 kB' 'Inactive(file): 3655836 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 466688 kB' 'Mapped: 202500 kB' 'Shmem: 8300704 kB' 'KReclaimable: 415528 kB' 'Slab: 807164 kB' 'SReclaimable: 415528 kB' 'SUnreclaim: 391636 kB' 'KernelStack: 12832 kB' 'PageTables: 8744 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37610896 kB' 'Committed_AS: 9912560 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 197052 kB' 'VmallocChunk: 0 kB' 'Percpu: 38592 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 2506332 kB' 'DirectMap2M: 24676352 kB' 'DirectMap1G: 41943040 kB' 00:02:43.178 22:40:34 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:43.178 22:40:34 -- setup/common.sh@32 -- # continue 00:02:43.178 22:40:34 -- setup/common.sh@31 -- # IFS=': ' 00:02:43.178 22:40:34 -- setup/common.sh@31 -- # read -r var val _ 00:02:43.178 22:40:34 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:43.178 22:40:34 -- setup/common.sh@32 -- # continue 00:02:43.178 22:40:34 -- setup/common.sh@31 -- # IFS=': ' 00:02:43.178 22:40:34 -- setup/common.sh@31 -- # read -r var val _ 00:02:43.178 22:40:34 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:43.178 22:40:34 -- setup/common.sh@32 -- # continue 00:02:43.178 22:40:34 -- setup/common.sh@31 -- # IFS=': ' 00:02:43.178 22:40:34 -- setup/common.sh@31 -- # read -r var val _ 00:02:43.178 22:40:34 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:43.178 22:40:34 -- setup/common.sh@32 -- # continue 00:02:43.178 22:40:34 -- setup/common.sh@31 -- # IFS=': ' 00:02:43.178 22:40:34 -- setup/common.sh@31 -- # read -r var val _ 00:02:43.178 22:40:34 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:43.178 22:40:34 -- setup/common.sh@32 -- # continue 00:02:43.178 22:40:34 -- setup/common.sh@31 -- # IFS=': ' 00:02:43.178 22:40:34 -- setup/common.sh@31 -- # read -r var val _ 00:02:43.178 22:40:34 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:43.178 22:40:34 -- setup/common.sh@32 -- # continue 00:02:43.178 22:40:34 -- setup/common.sh@31 -- # IFS=': ' 00:02:43.178 22:40:34 -- setup/common.sh@31 -- # read -r var val _ 00:02:43.178 22:40:34 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:43.178 22:40:34 -- setup/common.sh@32 -- # continue 00:02:43.178 22:40:34 -- setup/common.sh@31 -- # IFS=': ' 00:02:43.178 22:40:34 -- setup/common.sh@31 -- # read -r var val _ 00:02:43.178 22:40:34 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:43.178 22:40:34 -- setup/common.sh@32 -- # continue 00:02:43.178 22:40:34 -- setup/common.sh@31 -- # IFS=': ' 00:02:43.178 22:40:34 -- setup/common.sh@31 -- # read -r var val _ 00:02:43.179 22:40:34 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:43.179 22:40:34 -- setup/common.sh@32 -- # continue 00:02:43.179 22:40:34 -- setup/common.sh@31 -- # IFS=': ' 00:02:43.179 22:40:34 -- setup/common.sh@31 -- # read -r var val _ 00:02:43.179 22:40:34 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:43.179 22:40:34 -- setup/common.sh@32 -- # continue 00:02:43.179 22:40:34 -- setup/common.sh@31 -- # IFS=': ' 00:02:43.179 22:40:34 -- setup/common.sh@31 -- # read -r var val _ 00:02:43.179 22:40:34 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:43.179 22:40:34 -- setup/common.sh@32 -- # continue 00:02:43.179 22:40:34 -- setup/common.sh@31 -- # IFS=': ' 00:02:43.179 22:40:34 -- setup/common.sh@31 -- # read -r var val _ 00:02:43.179 22:40:34 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:43.179 22:40:34 -- setup/common.sh@32 -- # continue 00:02:43.179 22:40:34 -- setup/common.sh@31 -- # IFS=': ' 00:02:43.179 22:40:34 -- setup/common.sh@31 -- # read -r var val _ 00:02:43.179 22:40:34 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:43.179 22:40:34 -- setup/common.sh@32 -- # continue 00:02:43.179 22:40:34 -- setup/common.sh@31 -- # IFS=': ' 00:02:43.179 22:40:34 -- setup/common.sh@31 -- # read -r var val _ 00:02:43.179 22:40:34 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:43.179 22:40:34 -- setup/common.sh@32 -- # continue 00:02:43.179 22:40:34 -- setup/common.sh@31 -- # IFS=': ' 00:02:43.179 22:40:34 -- setup/common.sh@31 -- # read -r var val _ 00:02:43.179 22:40:34 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:43.179 22:40:34 -- setup/common.sh@32 -- # continue 00:02:43.179 22:40:34 -- setup/common.sh@31 -- # IFS=': ' 00:02:43.179 22:40:34 -- setup/common.sh@31 -- # read -r var val _ 00:02:43.179 22:40:34 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:43.179 22:40:34 -- setup/common.sh@32 -- # continue 00:02:43.179 22:40:34 -- setup/common.sh@31 -- # IFS=': ' 00:02:43.179 22:40:34 -- setup/common.sh@31 -- # read -r var val _ 00:02:43.179 22:40:34 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:43.179 22:40:34 -- setup/common.sh@32 -- # continue 00:02:43.179 22:40:34 -- setup/common.sh@31 -- # IFS=': ' 00:02:43.179 22:40:34 -- setup/common.sh@31 -- # read -r var val _ 00:02:43.179 22:40:34 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:43.179 22:40:34 -- setup/common.sh@32 -- # continue 00:02:43.179 22:40:34 -- setup/common.sh@31 -- # IFS=': ' 00:02:43.179 22:40:34 -- setup/common.sh@31 -- # read -r var val _ 00:02:43.179 22:40:34 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:43.179 22:40:34 -- setup/common.sh@32 -- # continue 00:02:43.179 22:40:34 -- setup/common.sh@31 -- # IFS=': ' 00:02:43.179 22:40:34 -- setup/common.sh@31 -- # read -r var val _ 00:02:43.179 22:40:34 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:43.179 22:40:34 -- setup/common.sh@32 -- # continue 00:02:43.179 22:40:34 -- setup/common.sh@31 -- # IFS=': ' 00:02:43.179 22:40:34 -- setup/common.sh@31 -- # read -r var val _ 00:02:43.179 22:40:34 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:43.179 22:40:34 -- setup/common.sh@32 -- # continue 00:02:43.179 22:40:34 -- setup/common.sh@31 -- # IFS=': ' 00:02:43.179 22:40:34 -- setup/common.sh@31 -- # read -r var val _ 00:02:43.179 22:40:34 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:43.179 22:40:34 -- setup/common.sh@32 -- # continue 00:02:43.179 22:40:34 -- setup/common.sh@31 -- # IFS=': ' 00:02:43.179 22:40:34 -- setup/common.sh@31 -- # read -r var val _ 00:02:43.179 22:40:34 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:43.179 22:40:34 -- setup/common.sh@32 -- # continue 00:02:43.179 22:40:34 -- setup/common.sh@31 -- # IFS=': ' 00:02:43.179 22:40:34 -- setup/common.sh@31 -- # read -r var val _ 00:02:43.179 22:40:34 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:43.179 22:40:34 -- setup/common.sh@32 -- # continue 00:02:43.179 22:40:34 -- setup/common.sh@31 -- # IFS=': ' 00:02:43.179 22:40:34 -- setup/common.sh@31 -- # read -r var val _ 00:02:43.179 22:40:34 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:43.179 22:40:34 -- setup/common.sh@32 -- # continue 00:02:43.179 22:40:34 -- setup/common.sh@31 -- # IFS=': ' 00:02:43.179 22:40:34 -- setup/common.sh@31 -- # read -r var val _ 00:02:43.179 22:40:34 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:43.179 22:40:34 -- setup/common.sh@32 -- # continue 00:02:43.179 22:40:34 -- setup/common.sh@31 -- # IFS=': ' 00:02:43.179 22:40:34 -- setup/common.sh@31 -- # read -r var val _ 00:02:43.179 22:40:34 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:43.179 22:40:34 -- setup/common.sh@32 -- # continue 00:02:43.179 22:40:34 -- setup/common.sh@31 -- # IFS=': ' 00:02:43.179 22:40:34 -- setup/common.sh@31 -- # read -r var val _ 00:02:43.179 22:40:34 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:43.179 22:40:34 -- setup/common.sh@32 -- # continue 00:02:43.179 22:40:34 -- setup/common.sh@31 -- # IFS=': ' 00:02:43.179 22:40:34 -- setup/common.sh@31 -- # read -r var val _ 00:02:43.179 22:40:34 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:43.179 22:40:34 -- setup/common.sh@32 -- # continue 00:02:43.179 22:40:34 -- setup/common.sh@31 -- # IFS=': ' 00:02:43.179 22:40:34 -- setup/common.sh@31 -- # read -r var val _ 00:02:43.179 22:40:34 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:43.179 22:40:34 -- setup/common.sh@32 -- # continue 00:02:43.179 22:40:34 -- setup/common.sh@31 -- # IFS=': ' 00:02:43.179 22:40:34 -- setup/common.sh@31 -- # read -r var val _ 00:02:43.179 22:40:34 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:43.179 22:40:34 -- setup/common.sh@32 -- # continue 00:02:43.179 22:40:34 -- setup/common.sh@31 -- # IFS=': ' 00:02:43.179 22:40:34 -- setup/common.sh@31 -- # read -r var val _ 00:02:43.179 22:40:34 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:43.179 22:40:34 -- setup/common.sh@32 -- # continue 00:02:43.179 22:40:34 -- setup/common.sh@31 -- # IFS=': ' 00:02:43.179 22:40:34 -- setup/common.sh@31 -- # read -r var val _ 00:02:43.179 22:40:34 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:43.179 22:40:34 -- setup/common.sh@32 -- # continue 00:02:43.179 22:40:34 -- setup/common.sh@31 -- # IFS=': ' 00:02:43.179 22:40:34 -- setup/common.sh@31 -- # read -r var val _ 00:02:43.179 22:40:34 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:43.179 22:40:34 -- setup/common.sh@32 -- # continue 00:02:43.179 22:40:34 -- setup/common.sh@31 -- # IFS=': ' 00:02:43.179 22:40:34 -- setup/common.sh@31 -- # read -r var val _ 00:02:43.179 22:40:34 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:43.179 22:40:34 -- setup/common.sh@32 -- # continue 00:02:43.179 22:40:34 -- setup/common.sh@31 -- # IFS=': ' 00:02:43.179 22:40:34 -- setup/common.sh@31 -- # read -r var val _ 00:02:43.180 22:40:34 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:43.180 22:40:34 -- setup/common.sh@32 -- # continue 00:02:43.180 22:40:34 -- setup/common.sh@31 -- # IFS=': ' 00:02:43.180 22:40:34 -- setup/common.sh@31 -- # read -r var val _ 00:02:43.180 22:40:34 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:43.180 22:40:34 -- setup/common.sh@32 -- # continue 00:02:43.180 22:40:34 -- setup/common.sh@31 -- # IFS=': ' 00:02:43.180 22:40:34 -- setup/common.sh@31 -- # read -r var val _ 00:02:43.180 22:40:34 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:43.180 22:40:34 -- setup/common.sh@32 -- # continue 00:02:43.180 22:40:34 -- setup/common.sh@31 -- # IFS=': ' 00:02:43.180 22:40:34 -- setup/common.sh@31 -- # read -r var val _ 00:02:43.180 22:40:34 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:43.180 22:40:34 -- setup/common.sh@32 -- # continue 00:02:43.180 22:40:34 -- setup/common.sh@31 -- # IFS=': ' 00:02:43.180 22:40:34 -- setup/common.sh@31 -- # read -r var val _ 00:02:43.180 22:40:34 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:43.180 22:40:34 -- setup/common.sh@32 -- # continue 00:02:43.180 22:40:34 -- setup/common.sh@31 -- # IFS=': ' 00:02:43.180 22:40:34 -- setup/common.sh@31 -- # read -r var val _ 00:02:43.180 22:40:34 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:43.180 22:40:34 -- setup/common.sh@32 -- # continue 00:02:43.180 22:40:34 -- setup/common.sh@31 -- # IFS=': ' 00:02:43.180 22:40:34 -- setup/common.sh@31 -- # read -r var val _ 00:02:43.180 22:40:34 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:43.180 22:40:34 -- setup/common.sh@32 -- # continue 00:02:43.180 22:40:34 -- setup/common.sh@31 -- # IFS=': ' 00:02:43.180 22:40:34 -- setup/common.sh@31 -- # read -r var val _ 00:02:43.180 22:40:34 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:43.180 22:40:34 -- setup/common.sh@32 -- # continue 00:02:43.180 22:40:34 -- setup/common.sh@31 -- # IFS=': ' 00:02:43.180 22:40:34 -- setup/common.sh@31 -- # read -r var val _ 00:02:43.180 22:40:34 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:43.180 22:40:34 -- setup/common.sh@32 -- # continue 00:02:43.180 22:40:34 -- setup/common.sh@31 -- # IFS=': ' 00:02:43.180 22:40:34 -- setup/common.sh@31 -- # read -r var val _ 00:02:43.180 22:40:34 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:43.180 22:40:34 -- setup/common.sh@32 -- # continue 00:02:43.180 22:40:34 -- setup/common.sh@31 -- # IFS=': ' 00:02:43.180 22:40:34 -- setup/common.sh@31 -- # read -r var val _ 00:02:43.180 22:40:34 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:43.180 22:40:34 -- setup/common.sh@32 -- # continue 00:02:43.180 22:40:34 -- setup/common.sh@31 -- # IFS=': ' 00:02:43.180 22:40:34 -- setup/common.sh@31 -- # read -r var val _ 00:02:43.180 22:40:34 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:43.180 22:40:34 -- setup/common.sh@32 -- # continue 00:02:43.180 22:40:34 -- setup/common.sh@31 -- # IFS=': ' 00:02:43.180 22:40:34 -- setup/common.sh@31 -- # read -r var val _ 00:02:43.180 22:40:34 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:43.180 22:40:34 -- setup/common.sh@32 -- # continue 00:02:43.180 22:40:34 -- setup/common.sh@31 -- # IFS=': ' 00:02:43.180 22:40:34 -- setup/common.sh@31 -- # read -r var val _ 00:02:43.180 22:40:34 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:43.180 22:40:34 -- setup/common.sh@33 -- # echo 1024 00:02:43.180 22:40:34 -- setup/common.sh@33 -- # return 0 00:02:43.180 22:40:34 -- setup/hugepages.sh@110 -- # (( 1024 == nr_hugepages + surp + resv )) 00:02:43.180 22:40:34 -- setup/hugepages.sh@112 -- # get_nodes 00:02:43.180 22:40:34 -- setup/hugepages.sh@27 -- # local node 00:02:43.180 22:40:34 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:02:43.180 22:40:34 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=1024 00:02:43.180 22:40:34 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:02:43.180 22:40:34 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=0 00:02:43.180 22:40:34 -- setup/hugepages.sh@32 -- # no_nodes=2 00:02:43.180 22:40:34 -- setup/hugepages.sh@33 -- # (( no_nodes > 0 )) 00:02:43.180 22:40:34 -- setup/hugepages.sh@115 -- # for node in "${!nodes_test[@]}" 00:02:43.180 22:40:34 -- setup/hugepages.sh@116 -- # (( nodes_test[node] += resv )) 00:02:43.180 22:40:34 -- setup/hugepages.sh@117 -- # get_meminfo HugePages_Surp 0 00:02:43.180 22:40:34 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:02:43.180 22:40:34 -- setup/common.sh@18 -- # local node=0 00:02:43.180 22:40:34 -- setup/common.sh@19 -- # local var val 00:02:43.180 22:40:34 -- setup/common.sh@20 -- # local mem_f mem 00:02:43.180 22:40:34 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:02:43.180 22:40:34 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node0/meminfo ]] 00:02:43.180 22:40:34 -- setup/common.sh@24 -- # mem_f=/sys/devices/system/node/node0/meminfo 00:02:43.180 22:40:34 -- setup/common.sh@28 -- # mapfile -t mem 00:02:43.180 22:40:34 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:02:43.180 22:40:34 -- setup/common.sh@31 -- # IFS=': ' 00:02:43.180 22:40:34 -- setup/common.sh@31 -- # read -r var val _ 00:02:43.180 22:40:34 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 32829884 kB' 'MemFree: 19075756 kB' 'MemUsed: 13754128 kB' 'SwapCached: 0 kB' 'Active: 6999884 kB' 'Inactive: 3490860 kB' 'Active(anon): 6618672 kB' 'Inactive(anon): 0 kB' 'Active(file): 381212 kB' 'Inactive(file): 3490860 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'FilePages: 10244000 kB' 'Mapped: 157360 kB' 'AnonPages: 249908 kB' 'Shmem: 6371928 kB' 'KernelStack: 6600 kB' 'PageTables: 4620 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'KReclaimable: 272444 kB' 'Slab: 484920 kB' 'SReclaimable: 272444 kB' 'SUnreclaim: 212476 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Surp: 0' 00:02:43.180 22:40:34 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:43.180 22:40:34 -- setup/common.sh@32 -- # continue 00:02:43.180 22:40:34 -- setup/common.sh@31 -- # IFS=': ' 00:02:43.180 22:40:34 -- setup/common.sh@31 -- # read -r var val _ 00:02:43.180 22:40:34 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:43.180 22:40:34 -- setup/common.sh@32 -- # continue 00:02:43.180 22:40:34 -- setup/common.sh@31 -- # IFS=': ' 00:02:43.180 22:40:34 -- setup/common.sh@31 -- # read -r var val _ 00:02:43.180 22:40:34 -- setup/common.sh@32 -- # [[ MemUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:43.180 22:40:34 -- setup/common.sh@32 -- # continue 00:02:43.180 22:40:34 -- setup/common.sh@31 -- # IFS=': ' 00:02:43.180 22:40:34 -- setup/common.sh@31 -- # read -r var val _ 00:02:43.180 22:40:34 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:43.180 22:40:34 -- setup/common.sh@32 -- # continue 00:02:43.180 22:40:34 -- setup/common.sh@31 -- # IFS=': ' 00:02:43.180 22:40:34 -- setup/common.sh@31 -- # read -r var val _ 00:02:43.180 22:40:34 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:43.180 22:40:34 -- setup/common.sh@32 -- # continue 00:02:43.180 22:40:34 -- setup/common.sh@31 -- # IFS=': ' 00:02:43.180 22:40:34 -- setup/common.sh@31 -- # read -r var val _ 00:02:43.180 22:40:34 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:43.180 22:40:34 -- setup/common.sh@32 -- # continue 00:02:43.180 22:40:34 -- setup/common.sh@31 -- # IFS=': ' 00:02:43.180 22:40:34 -- setup/common.sh@31 -- # read -r var val _ 00:02:43.180 22:40:34 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:43.180 22:40:34 -- setup/common.sh@32 -- # continue 00:02:43.180 22:40:34 -- setup/common.sh@31 -- # IFS=': ' 00:02:43.180 22:40:34 -- setup/common.sh@31 -- # read -r var val _ 00:02:43.180 22:40:34 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:43.180 22:40:34 -- setup/common.sh@32 -- # continue 00:02:43.180 22:40:34 -- setup/common.sh@31 -- # IFS=': ' 00:02:43.180 22:40:34 -- setup/common.sh@31 -- # read -r var val _ 00:02:43.180 22:40:34 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:43.180 22:40:34 -- setup/common.sh@32 -- # continue 00:02:43.180 22:40:34 -- setup/common.sh@31 -- # IFS=': ' 00:02:43.180 22:40:34 -- setup/common.sh@31 -- # read -r var val _ 00:02:43.180 22:40:34 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:43.180 22:40:34 -- setup/common.sh@32 -- # continue 00:02:43.180 22:40:34 -- setup/common.sh@31 -- # IFS=': ' 00:02:43.180 22:40:34 -- setup/common.sh@31 -- # read -r var val _ 00:02:43.180 22:40:34 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:43.180 22:40:34 -- setup/common.sh@32 -- # continue 00:02:43.180 22:40:34 -- setup/common.sh@31 -- # IFS=': ' 00:02:43.180 22:40:34 -- setup/common.sh@31 -- # read -r var val _ 00:02:43.180 22:40:34 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:43.180 22:40:34 -- setup/common.sh@32 -- # continue 00:02:43.180 22:40:34 -- setup/common.sh@31 -- # IFS=': ' 00:02:43.180 22:40:34 -- setup/common.sh@31 -- # read -r var val _ 00:02:43.180 22:40:34 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:43.180 22:40:34 -- setup/common.sh@32 -- # continue 00:02:43.180 22:40:34 -- setup/common.sh@31 -- # IFS=': ' 00:02:43.180 22:40:34 -- setup/common.sh@31 -- # read -r var val _ 00:02:43.180 22:40:34 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:43.180 22:40:34 -- setup/common.sh@32 -- # continue 00:02:43.180 22:40:34 -- setup/common.sh@31 -- # IFS=': ' 00:02:43.180 22:40:34 -- setup/common.sh@31 -- # read -r var val _ 00:02:43.180 22:40:34 -- setup/common.sh@32 -- # [[ FilePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:43.180 22:40:34 -- setup/common.sh@32 -- # continue 00:02:43.180 22:40:34 -- setup/common.sh@31 -- # IFS=': ' 00:02:43.180 22:40:34 -- setup/common.sh@31 -- # read -r var val _ 00:02:43.180 22:40:34 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:43.180 22:40:34 -- setup/common.sh@32 -- # continue 00:02:43.181 22:40:34 -- setup/common.sh@31 -- # IFS=': ' 00:02:43.181 22:40:34 -- setup/common.sh@31 -- # read -r var val _ 00:02:43.181 22:40:34 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:43.181 22:40:34 -- setup/common.sh@32 -- # continue 00:02:43.181 22:40:34 -- setup/common.sh@31 -- # IFS=': ' 00:02:43.181 22:40:34 -- setup/common.sh@31 -- # read -r var val _ 00:02:43.181 22:40:34 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:43.181 22:40:34 -- setup/common.sh@32 -- # continue 00:02:43.181 22:40:34 -- setup/common.sh@31 -- # IFS=': ' 00:02:43.181 22:40:34 -- setup/common.sh@31 -- # read -r var val _ 00:02:43.181 22:40:34 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:43.181 22:40:34 -- setup/common.sh@32 -- # continue 00:02:43.181 22:40:34 -- setup/common.sh@31 -- # IFS=': ' 00:02:43.181 22:40:34 -- setup/common.sh@31 -- # read -r var val _ 00:02:43.181 22:40:34 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:43.181 22:40:34 -- setup/common.sh@32 -- # continue 00:02:43.181 22:40:34 -- setup/common.sh@31 -- # IFS=': ' 00:02:43.181 22:40:34 -- setup/common.sh@31 -- # read -r var val _ 00:02:43.181 22:40:34 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:43.181 22:40:34 -- setup/common.sh@32 -- # continue 00:02:43.181 22:40:34 -- setup/common.sh@31 -- # IFS=': ' 00:02:43.181 22:40:34 -- setup/common.sh@31 -- # read -r var val _ 00:02:43.181 22:40:34 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:43.181 22:40:34 -- setup/common.sh@32 -- # continue 00:02:43.181 22:40:34 -- setup/common.sh@31 -- # IFS=': ' 00:02:43.181 22:40:34 -- setup/common.sh@31 -- # read -r var val _ 00:02:43.181 22:40:34 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:43.181 22:40:34 -- setup/common.sh@32 -- # continue 00:02:43.181 22:40:34 -- setup/common.sh@31 -- # IFS=': ' 00:02:43.181 22:40:34 -- setup/common.sh@31 -- # read -r var val _ 00:02:43.181 22:40:34 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:43.181 22:40:34 -- setup/common.sh@32 -- # continue 00:02:43.181 22:40:34 -- setup/common.sh@31 -- # IFS=': ' 00:02:43.181 22:40:34 -- setup/common.sh@31 -- # read -r var val _ 00:02:43.181 22:40:34 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:43.181 22:40:34 -- setup/common.sh@32 -- # continue 00:02:43.181 22:40:34 -- setup/common.sh@31 -- # IFS=': ' 00:02:43.181 22:40:34 -- setup/common.sh@31 -- # read -r var val _ 00:02:43.181 22:40:34 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:43.181 22:40:34 -- setup/common.sh@32 -- # continue 00:02:43.181 22:40:34 -- setup/common.sh@31 -- # IFS=': ' 00:02:43.181 22:40:34 -- setup/common.sh@31 -- # read -r var val _ 00:02:43.181 22:40:34 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:43.181 22:40:34 -- setup/common.sh@32 -- # continue 00:02:43.181 22:40:34 -- setup/common.sh@31 -- # IFS=': ' 00:02:43.181 22:40:34 -- setup/common.sh@31 -- # read -r var val _ 00:02:43.181 22:40:34 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:43.181 22:40:34 -- setup/common.sh@32 -- # continue 00:02:43.181 22:40:34 -- setup/common.sh@31 -- # IFS=': ' 00:02:43.181 22:40:34 -- setup/common.sh@31 -- # read -r var val _ 00:02:43.181 22:40:34 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:43.181 22:40:34 -- setup/common.sh@32 -- # continue 00:02:43.181 22:40:34 -- setup/common.sh@31 -- # IFS=': ' 00:02:43.181 22:40:34 -- setup/common.sh@31 -- # read -r var val _ 00:02:43.181 22:40:34 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:43.181 22:40:34 -- setup/common.sh@32 -- # continue 00:02:43.181 22:40:34 -- setup/common.sh@31 -- # IFS=': ' 00:02:43.181 22:40:34 -- setup/common.sh@31 -- # read -r var val _ 00:02:43.181 22:40:34 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:43.181 22:40:34 -- setup/common.sh@32 -- # continue 00:02:43.181 22:40:34 -- setup/common.sh@31 -- # IFS=': ' 00:02:43.181 22:40:34 -- setup/common.sh@31 -- # read -r var val _ 00:02:43.181 22:40:34 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:43.181 22:40:34 -- setup/common.sh@32 -- # continue 00:02:43.181 22:40:34 -- setup/common.sh@31 -- # IFS=': ' 00:02:43.181 22:40:34 -- setup/common.sh@31 -- # read -r var val _ 00:02:43.181 22:40:34 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:43.181 22:40:34 -- setup/common.sh@32 -- # continue 00:02:43.181 22:40:34 -- setup/common.sh@31 -- # IFS=': ' 00:02:43.181 22:40:34 -- setup/common.sh@31 -- # read -r var val _ 00:02:43.181 22:40:34 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:43.181 22:40:34 -- setup/common.sh@32 -- # continue 00:02:43.181 22:40:34 -- setup/common.sh@31 -- # IFS=': ' 00:02:43.181 22:40:34 -- setup/common.sh@31 -- # read -r var val _ 00:02:43.181 22:40:34 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:43.181 22:40:34 -- setup/common.sh@32 -- # continue 00:02:43.181 22:40:34 -- setup/common.sh@31 -- # IFS=': ' 00:02:43.181 22:40:34 -- setup/common.sh@31 -- # read -r var val _ 00:02:43.181 22:40:34 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:43.181 22:40:34 -- setup/common.sh@32 -- # continue 00:02:43.181 22:40:34 -- setup/common.sh@31 -- # IFS=': ' 00:02:43.181 22:40:34 -- setup/common.sh@31 -- # read -r var val _ 00:02:43.181 22:40:34 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:43.181 22:40:34 -- setup/common.sh@33 -- # echo 0 00:02:43.181 22:40:34 -- setup/common.sh@33 -- # return 0 00:02:43.181 22:40:34 -- setup/hugepages.sh@117 -- # (( nodes_test[node] += 0 )) 00:02:43.181 22:40:34 -- setup/hugepages.sh@126 -- # for node in "${!nodes_test[@]}" 00:02:43.181 22:40:34 -- setup/hugepages.sh@127 -- # sorted_t[nodes_test[node]]=1 00:02:43.181 22:40:34 -- setup/hugepages.sh@127 -- # sorted_s[nodes_sys[node]]=1 00:02:43.181 22:40:34 -- setup/hugepages.sh@128 -- # echo 'node0=1024 expecting 1024' 00:02:43.181 node0=1024 expecting 1024 00:02:43.181 22:40:34 -- setup/hugepages.sh@130 -- # [[ 1024 == \1\0\2\4 ]] 00:02:43.181 00:02:43.181 real 0m2.320s 00:02:43.181 user 0m0.572s 00:02:43.181 sys 0m0.770s 00:02:43.181 22:40:34 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:02:43.181 22:40:34 -- common/autotest_common.sh@10 -- # set +x 00:02:43.181 ************************************ 00:02:43.181 END TEST default_setup 00:02:43.181 ************************************ 00:02:43.181 22:40:34 -- setup/hugepages.sh@211 -- # run_test per_node_1G_alloc per_node_1G_alloc 00:02:43.181 22:40:34 -- common/autotest_common.sh@1077 -- # '[' 2 -le 1 ']' 00:02:43.181 22:40:34 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:02:43.181 22:40:34 -- common/autotest_common.sh@10 -- # set +x 00:02:43.181 ************************************ 00:02:43.181 START TEST per_node_1G_alloc 00:02:43.181 ************************************ 00:02:43.181 22:40:34 -- common/autotest_common.sh@1104 -- # per_node_1G_alloc 00:02:43.181 22:40:34 -- setup/hugepages.sh@143 -- # local IFS=, 00:02:43.181 22:40:34 -- setup/hugepages.sh@145 -- # get_test_nr_hugepages 1048576 0 1 00:02:43.181 22:40:34 -- setup/hugepages.sh@49 -- # local size=1048576 00:02:43.181 22:40:34 -- setup/hugepages.sh@50 -- # (( 3 > 1 )) 00:02:43.181 22:40:34 -- setup/hugepages.sh@51 -- # shift 00:02:43.181 22:40:34 -- setup/hugepages.sh@52 -- # node_ids=('0' '1') 00:02:43.181 22:40:34 -- setup/hugepages.sh@52 -- # local node_ids 00:02:43.181 22:40:34 -- setup/hugepages.sh@55 -- # (( size >= default_hugepages )) 00:02:43.181 22:40:34 -- setup/hugepages.sh@57 -- # nr_hugepages=512 00:02:43.181 22:40:34 -- setup/hugepages.sh@58 -- # get_test_nr_hugepages_per_node 0 1 00:02:43.181 22:40:34 -- setup/hugepages.sh@62 -- # user_nodes=('0' '1') 00:02:43.181 22:40:34 -- setup/hugepages.sh@62 -- # local user_nodes 00:02:43.181 22:40:34 -- setup/hugepages.sh@64 -- # local _nr_hugepages=512 00:02:43.181 22:40:34 -- setup/hugepages.sh@65 -- # local _no_nodes=2 00:02:43.181 22:40:34 -- setup/hugepages.sh@67 -- # nodes_test=() 00:02:43.181 22:40:34 -- setup/hugepages.sh@67 -- # local -g nodes_test 00:02:43.181 22:40:34 -- setup/hugepages.sh@69 -- # (( 2 > 0 )) 00:02:43.181 22:40:34 -- setup/hugepages.sh@70 -- # for _no_nodes in "${user_nodes[@]}" 00:02:43.181 22:40:34 -- setup/hugepages.sh@71 -- # nodes_test[_no_nodes]=512 00:02:43.181 22:40:34 -- setup/hugepages.sh@70 -- # for _no_nodes in "${user_nodes[@]}" 00:02:43.181 22:40:34 -- setup/hugepages.sh@71 -- # nodes_test[_no_nodes]=512 00:02:43.181 22:40:34 -- setup/hugepages.sh@73 -- # return 0 00:02:43.181 22:40:34 -- setup/hugepages.sh@146 -- # NRHUGE=512 00:02:43.181 22:40:34 -- setup/hugepages.sh@146 -- # HUGENODE=0,1 00:02:43.181 22:40:34 -- setup/hugepages.sh@146 -- # setup output 00:02:43.181 22:40:34 -- setup/common.sh@9 -- # [[ output == output ]] 00:02:43.181 22:40:34 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh 00:02:44.562 0000:00:04.7 (8086 0e27): Already using the vfio-pci driver 00:02:44.562 0000:88:00.0 (8086 0a54): Already using the vfio-pci driver 00:02:44.562 0000:00:04.6 (8086 0e26): Already using the vfio-pci driver 00:02:44.562 0000:00:04.5 (8086 0e25): Already using the vfio-pci driver 00:02:44.562 0000:00:04.4 (8086 0e24): Already using the vfio-pci driver 00:02:44.562 0000:00:04.3 (8086 0e23): Already using the vfio-pci driver 00:02:44.562 0000:00:04.2 (8086 0e22): Already using the vfio-pci driver 00:02:44.562 0000:00:04.1 (8086 0e21): Already using the vfio-pci driver 00:02:44.562 0000:00:04.0 (8086 0e20): Already using the vfio-pci driver 00:02:44.562 0000:80:04.7 (8086 0e27): Already using the vfio-pci driver 00:02:44.562 0000:80:04.6 (8086 0e26): Already using the vfio-pci driver 00:02:44.562 0000:80:04.5 (8086 0e25): Already using the vfio-pci driver 00:02:44.562 0000:80:04.4 (8086 0e24): Already using the vfio-pci driver 00:02:44.562 0000:80:04.3 (8086 0e23): Already using the vfio-pci driver 00:02:44.562 0000:80:04.2 (8086 0e22): Already using the vfio-pci driver 00:02:44.562 0000:80:04.1 (8086 0e21): Already using the vfio-pci driver 00:02:44.562 0000:80:04.0 (8086 0e20): Already using the vfio-pci driver 00:02:44.562 22:40:35 -- setup/hugepages.sh@147 -- # nr_hugepages=1024 00:02:44.562 22:40:35 -- setup/hugepages.sh@147 -- # verify_nr_hugepages 00:02:44.562 22:40:35 -- setup/hugepages.sh@89 -- # local node 00:02:44.562 22:40:35 -- setup/hugepages.sh@90 -- # local sorted_t 00:02:44.562 22:40:35 -- setup/hugepages.sh@91 -- # local sorted_s 00:02:44.562 22:40:35 -- setup/hugepages.sh@92 -- # local surp 00:02:44.562 22:40:35 -- setup/hugepages.sh@93 -- # local resv 00:02:44.562 22:40:35 -- setup/hugepages.sh@94 -- # local anon 00:02:44.562 22:40:35 -- setup/hugepages.sh@96 -- # [[ always [madvise] never != *\[\n\e\v\e\r\]* ]] 00:02:44.562 22:40:35 -- setup/hugepages.sh@97 -- # get_meminfo AnonHugePages 00:02:44.562 22:40:35 -- setup/common.sh@17 -- # local get=AnonHugePages 00:02:44.562 22:40:35 -- setup/common.sh@18 -- # local node= 00:02:44.562 22:40:35 -- setup/common.sh@19 -- # local var val 00:02:44.562 22:40:35 -- setup/common.sh@20 -- # local mem_f mem 00:02:44.562 22:40:35 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:02:44.562 22:40:35 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:02:44.562 22:40:35 -- setup/common.sh@25 -- # [[ -n '' ]] 00:02:44.562 22:40:35 -- setup/common.sh@28 -- # mapfile -t mem 00:02:44.562 22:40:35 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:02:44.562 22:40:35 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.562 22:40:35 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.562 22:40:35 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60541736 kB' 'MemFree: 43356188 kB' 'MemAvailable: 47347432 kB' 'Buffers: 2696 kB' 'Cached: 12518220 kB' 'SwapCached: 0 kB' 'Active: 9328720 kB' 'Inactive: 3655836 kB' 'Active(anon): 8764404 kB' 'Inactive(anon): 0 kB' 'Active(file): 564316 kB' 'Inactive(file): 3655836 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 466828 kB' 'Mapped: 202528 kB' 'Shmem: 8300764 kB' 'KReclaimable: 415528 kB' 'Slab: 807060 kB' 'SReclaimable: 415528 kB' 'SUnreclaim: 391532 kB' 'KernelStack: 12816 kB' 'PageTables: 8640 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37610896 kB' 'Committed_AS: 9912736 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 197196 kB' 'VmallocChunk: 0 kB' 'Percpu: 38592 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 2506332 kB' 'DirectMap2M: 24676352 kB' 'DirectMap1G: 41943040 kB' 00:02:44.562 22:40:35 -- setup/common.sh@32 -- # [[ MemTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:44.562 22:40:35 -- setup/common.sh@32 -- # continue 00:02:44.562 22:40:35 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.562 22:40:35 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.562 22:40:35 -- setup/common.sh@32 -- # [[ MemFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:44.562 22:40:35 -- setup/common.sh@32 -- # continue 00:02:44.562 22:40:35 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.562 22:40:35 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.562 22:40:35 -- setup/common.sh@32 -- # [[ MemAvailable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:44.562 22:40:35 -- setup/common.sh@32 -- # continue 00:02:44.562 22:40:35 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.562 22:40:35 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.562 22:40:35 -- setup/common.sh@32 -- # [[ Buffers == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:44.562 22:40:35 -- setup/common.sh@32 -- # continue 00:02:44.562 22:40:35 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.562 22:40:35 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.562 22:40:35 -- setup/common.sh@32 -- # [[ Cached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:44.562 22:40:35 -- setup/common.sh@32 -- # continue 00:02:44.562 22:40:35 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.562 22:40:35 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.562 22:40:35 -- setup/common.sh@32 -- # [[ SwapCached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:44.562 22:40:35 -- setup/common.sh@32 -- # continue 00:02:44.562 22:40:35 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.562 22:40:35 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.562 22:40:35 -- setup/common.sh@32 -- # [[ Active == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:44.562 22:40:35 -- setup/common.sh@32 -- # continue 00:02:44.562 22:40:35 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.562 22:40:35 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.562 22:40:35 -- setup/common.sh@32 -- # [[ Inactive == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:44.562 22:40:35 -- setup/common.sh@32 -- # continue 00:02:44.562 22:40:35 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.562 22:40:35 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.562 22:40:35 -- setup/common.sh@32 -- # [[ Active(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:44.562 22:40:35 -- setup/common.sh@32 -- # continue 00:02:44.562 22:40:35 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.562 22:40:35 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.562 22:40:35 -- setup/common.sh@32 -- # [[ Inactive(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:44.562 22:40:35 -- setup/common.sh@32 -- # continue 00:02:44.562 22:40:35 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.562 22:40:35 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.563 22:40:35 -- setup/common.sh@32 -- # [[ Active(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:44.563 22:40:35 -- setup/common.sh@32 -- # continue 00:02:44.563 22:40:35 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.563 22:40:35 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.563 22:40:35 -- setup/common.sh@32 -- # [[ Inactive(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:44.563 22:40:35 -- setup/common.sh@32 -- # continue 00:02:44.563 22:40:35 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.563 22:40:35 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.563 22:40:35 -- setup/common.sh@32 -- # [[ Unevictable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:44.563 22:40:35 -- setup/common.sh@32 -- # continue 00:02:44.563 22:40:35 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.563 22:40:35 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.563 22:40:35 -- setup/common.sh@32 -- # [[ Mlocked == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:44.563 22:40:35 -- setup/common.sh@32 -- # continue 00:02:44.563 22:40:35 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.563 22:40:35 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.563 22:40:35 -- setup/common.sh@32 -- # [[ SwapTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:44.563 22:40:35 -- setup/common.sh@32 -- # continue 00:02:44.563 22:40:35 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.563 22:40:35 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.563 22:40:35 -- setup/common.sh@32 -- # [[ SwapFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:44.563 22:40:35 -- setup/common.sh@32 -- # continue 00:02:44.563 22:40:35 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.563 22:40:35 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.563 22:40:35 -- setup/common.sh@32 -- # [[ Zswap == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:44.563 22:40:35 -- setup/common.sh@32 -- # continue 00:02:44.563 22:40:35 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.563 22:40:35 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.563 22:40:35 -- setup/common.sh@32 -- # [[ Zswapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:44.563 22:40:35 -- setup/common.sh@32 -- # continue 00:02:44.563 22:40:35 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.563 22:40:35 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.563 22:40:35 -- setup/common.sh@32 -- # [[ Dirty == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:44.563 22:40:35 -- setup/common.sh@32 -- # continue 00:02:44.563 22:40:35 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.563 22:40:35 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.563 22:40:35 -- setup/common.sh@32 -- # [[ Writeback == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:44.563 22:40:35 -- setup/common.sh@32 -- # continue 00:02:44.563 22:40:35 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.563 22:40:35 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.563 22:40:35 -- setup/common.sh@32 -- # [[ AnonPages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:44.563 22:40:35 -- setup/common.sh@32 -- # continue 00:02:44.563 22:40:35 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.563 22:40:35 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.563 22:40:35 -- setup/common.sh@32 -- # [[ Mapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:44.563 22:40:35 -- setup/common.sh@32 -- # continue 00:02:44.563 22:40:35 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.563 22:40:35 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.563 22:40:35 -- setup/common.sh@32 -- # [[ Shmem == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:44.563 22:40:35 -- setup/common.sh@32 -- # continue 00:02:44.563 22:40:35 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.563 22:40:35 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.563 22:40:35 -- setup/common.sh@32 -- # [[ KReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:44.563 22:40:35 -- setup/common.sh@32 -- # continue 00:02:44.563 22:40:35 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.563 22:40:35 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.563 22:40:35 -- setup/common.sh@32 -- # [[ Slab == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:44.563 22:40:35 -- setup/common.sh@32 -- # continue 00:02:44.563 22:40:35 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.563 22:40:35 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.563 22:40:35 -- setup/common.sh@32 -- # [[ SReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:44.563 22:40:35 -- setup/common.sh@32 -- # continue 00:02:44.563 22:40:35 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.563 22:40:35 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.563 22:40:35 -- setup/common.sh@32 -- # [[ SUnreclaim == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:44.563 22:40:35 -- setup/common.sh@32 -- # continue 00:02:44.563 22:40:35 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.563 22:40:35 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.563 22:40:35 -- setup/common.sh@32 -- # [[ KernelStack == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:44.563 22:40:35 -- setup/common.sh@32 -- # continue 00:02:44.563 22:40:35 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.563 22:40:35 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.563 22:40:35 -- setup/common.sh@32 -- # [[ PageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:44.563 22:40:35 -- setup/common.sh@32 -- # continue 00:02:44.563 22:40:35 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.563 22:40:35 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.563 22:40:35 -- setup/common.sh@32 -- # [[ SecPageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:44.563 22:40:35 -- setup/common.sh@32 -- # continue 00:02:44.563 22:40:35 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.563 22:40:35 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.563 22:40:35 -- setup/common.sh@32 -- # [[ NFS_Unstable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:44.563 22:40:35 -- setup/common.sh@32 -- # continue 00:02:44.563 22:40:35 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.563 22:40:35 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.563 22:40:35 -- setup/common.sh@32 -- # [[ Bounce == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:44.563 22:40:35 -- setup/common.sh@32 -- # continue 00:02:44.563 22:40:35 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.563 22:40:35 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.563 22:40:35 -- setup/common.sh@32 -- # [[ WritebackTmp == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:44.563 22:40:35 -- setup/common.sh@32 -- # continue 00:02:44.563 22:40:35 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.563 22:40:35 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.563 22:40:35 -- setup/common.sh@32 -- # [[ CommitLimit == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:44.563 22:40:35 -- setup/common.sh@32 -- # continue 00:02:44.563 22:40:35 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.563 22:40:35 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.563 22:40:35 -- setup/common.sh@32 -- # [[ Committed_AS == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:44.563 22:40:35 -- setup/common.sh@32 -- # continue 00:02:44.563 22:40:35 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.563 22:40:35 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.563 22:40:35 -- setup/common.sh@32 -- # [[ VmallocTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:44.563 22:40:35 -- setup/common.sh@32 -- # continue 00:02:44.563 22:40:35 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.563 22:40:35 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.563 22:40:35 -- setup/common.sh@32 -- # [[ VmallocUsed == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:44.563 22:40:35 -- setup/common.sh@32 -- # continue 00:02:44.563 22:40:35 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.563 22:40:35 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.563 22:40:35 -- setup/common.sh@32 -- # [[ VmallocChunk == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:44.563 22:40:35 -- setup/common.sh@32 -- # continue 00:02:44.563 22:40:35 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.563 22:40:35 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.563 22:40:35 -- setup/common.sh@32 -- # [[ Percpu == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:44.563 22:40:35 -- setup/common.sh@32 -- # continue 00:02:44.563 22:40:35 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.563 22:40:35 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.563 22:40:35 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:44.563 22:40:35 -- setup/common.sh@32 -- # continue 00:02:44.563 22:40:35 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.563 22:40:35 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.563 22:40:35 -- setup/common.sh@32 -- # [[ AnonHugePages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:44.563 22:40:35 -- setup/common.sh@33 -- # echo 0 00:02:44.563 22:40:35 -- setup/common.sh@33 -- # return 0 00:02:44.563 22:40:35 -- setup/hugepages.sh@97 -- # anon=0 00:02:44.563 22:40:35 -- setup/hugepages.sh@99 -- # get_meminfo HugePages_Surp 00:02:44.563 22:40:35 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:02:44.563 22:40:35 -- setup/common.sh@18 -- # local node= 00:02:44.563 22:40:35 -- setup/common.sh@19 -- # local var val 00:02:44.563 22:40:35 -- setup/common.sh@20 -- # local mem_f mem 00:02:44.563 22:40:35 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:02:44.563 22:40:35 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:02:44.563 22:40:35 -- setup/common.sh@25 -- # [[ -n '' ]] 00:02:44.563 22:40:35 -- setup/common.sh@28 -- # mapfile -t mem 00:02:44.563 22:40:35 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:02:44.563 22:40:35 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.563 22:40:35 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.563 22:40:35 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60541736 kB' 'MemFree: 43358808 kB' 'MemAvailable: 47350052 kB' 'Buffers: 2696 kB' 'Cached: 12518220 kB' 'SwapCached: 0 kB' 'Active: 9329224 kB' 'Inactive: 3655836 kB' 'Active(anon): 8764908 kB' 'Inactive(anon): 0 kB' 'Active(file): 564316 kB' 'Inactive(file): 3655836 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 467396 kB' 'Mapped: 202536 kB' 'Shmem: 8300764 kB' 'KReclaimable: 415528 kB' 'Slab: 807056 kB' 'SReclaimable: 415528 kB' 'SUnreclaim: 391528 kB' 'KernelStack: 12848 kB' 'PageTables: 8672 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37610896 kB' 'Committed_AS: 9912748 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 197164 kB' 'VmallocChunk: 0 kB' 'Percpu: 38592 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 2506332 kB' 'DirectMap2M: 24676352 kB' 'DirectMap1G: 41943040 kB' 00:02:44.563 22:40:35 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:44.563 22:40:35 -- setup/common.sh@32 -- # continue 00:02:44.563 22:40:35 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.563 22:40:35 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.563 22:40:35 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:44.563 22:40:35 -- setup/common.sh@32 -- # continue 00:02:44.563 22:40:35 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.563 22:40:35 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.563 22:40:35 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:44.563 22:40:35 -- setup/common.sh@32 -- # continue 00:02:44.563 22:40:35 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.564 22:40:35 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.564 22:40:35 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:44.564 22:40:35 -- setup/common.sh@32 -- # continue 00:02:44.564 22:40:35 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.564 22:40:35 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.564 22:40:35 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:44.564 22:40:35 -- setup/common.sh@32 -- # continue 00:02:44.564 22:40:35 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.564 22:40:35 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.564 22:40:35 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:44.564 22:40:35 -- setup/common.sh@32 -- # continue 00:02:44.564 22:40:35 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.564 22:40:35 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.564 22:40:35 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:44.564 22:40:35 -- setup/common.sh@32 -- # continue 00:02:44.564 22:40:35 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.564 22:40:35 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.564 22:40:35 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:44.564 22:40:35 -- setup/common.sh@32 -- # continue 00:02:44.564 22:40:35 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.564 22:40:35 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.564 22:40:35 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:44.564 22:40:35 -- setup/common.sh@32 -- # continue 00:02:44.564 22:40:35 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.564 22:40:35 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.564 22:40:35 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:44.564 22:40:35 -- setup/common.sh@32 -- # continue 00:02:44.564 22:40:35 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.564 22:40:35 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.564 22:40:35 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:44.564 22:40:35 -- setup/common.sh@32 -- # continue 00:02:44.564 22:40:35 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.564 22:40:35 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.564 22:40:35 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:44.564 22:40:35 -- setup/common.sh@32 -- # continue 00:02:44.564 22:40:35 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.564 22:40:35 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.564 22:40:35 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:44.564 22:40:35 -- setup/common.sh@32 -- # continue 00:02:44.564 22:40:35 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.564 22:40:35 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.564 22:40:35 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:44.564 22:40:35 -- setup/common.sh@32 -- # continue 00:02:44.564 22:40:35 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.564 22:40:35 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.564 22:40:35 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:44.564 22:40:35 -- setup/common.sh@32 -- # continue 00:02:44.564 22:40:35 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.564 22:40:35 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.564 22:40:35 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:44.564 22:40:35 -- setup/common.sh@32 -- # continue 00:02:44.564 22:40:35 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.564 22:40:35 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.564 22:40:35 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:44.564 22:40:35 -- setup/common.sh@32 -- # continue 00:02:44.564 22:40:35 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.564 22:40:35 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.564 22:40:35 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:44.564 22:40:35 -- setup/common.sh@32 -- # continue 00:02:44.564 22:40:35 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.564 22:40:35 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.564 22:40:35 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:44.564 22:40:35 -- setup/common.sh@32 -- # continue 00:02:44.564 22:40:35 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.564 22:40:35 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.564 22:40:35 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:44.564 22:40:35 -- setup/common.sh@32 -- # continue 00:02:44.564 22:40:35 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.564 22:40:35 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.564 22:40:35 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:44.564 22:40:35 -- setup/common.sh@32 -- # continue 00:02:44.564 22:40:35 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.564 22:40:35 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.564 22:40:35 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:44.564 22:40:35 -- setup/common.sh@32 -- # continue 00:02:44.564 22:40:35 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.564 22:40:35 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.564 22:40:35 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:44.564 22:40:35 -- setup/common.sh@32 -- # continue 00:02:44.564 22:40:35 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.564 22:40:35 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.564 22:40:35 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:44.564 22:40:35 -- setup/common.sh@32 -- # continue 00:02:44.564 22:40:35 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.564 22:40:35 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.564 22:40:35 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:44.564 22:40:35 -- setup/common.sh@32 -- # continue 00:02:44.564 22:40:35 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.564 22:40:35 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.564 22:40:35 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:44.564 22:40:35 -- setup/common.sh@32 -- # continue 00:02:44.564 22:40:35 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.564 22:40:35 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.564 22:40:35 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:44.564 22:40:35 -- setup/common.sh@32 -- # continue 00:02:44.564 22:40:35 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.564 22:40:35 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.564 22:40:35 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:44.564 22:40:35 -- setup/common.sh@32 -- # continue 00:02:44.564 22:40:35 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.564 22:40:35 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.564 22:40:35 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:44.564 22:40:35 -- setup/common.sh@32 -- # continue 00:02:44.564 22:40:35 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.564 22:40:35 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.564 22:40:35 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:44.564 22:40:35 -- setup/common.sh@32 -- # continue 00:02:44.564 22:40:35 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.564 22:40:35 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.564 22:40:35 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:44.564 22:40:35 -- setup/common.sh@32 -- # continue 00:02:44.564 22:40:35 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.564 22:40:35 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.564 22:40:35 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:44.564 22:40:35 -- setup/common.sh@32 -- # continue 00:02:44.564 22:40:35 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.564 22:40:35 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.564 22:40:35 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:44.564 22:40:35 -- setup/common.sh@32 -- # continue 00:02:44.564 22:40:35 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.564 22:40:35 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.564 22:40:35 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:44.564 22:40:35 -- setup/common.sh@32 -- # continue 00:02:44.564 22:40:35 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.564 22:40:35 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.564 22:40:35 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:44.564 22:40:35 -- setup/common.sh@32 -- # continue 00:02:44.564 22:40:35 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.564 22:40:35 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.564 22:40:35 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:44.564 22:40:35 -- setup/common.sh@32 -- # continue 00:02:44.564 22:40:35 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.564 22:40:35 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.564 22:40:35 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:44.564 22:40:35 -- setup/common.sh@32 -- # continue 00:02:44.564 22:40:35 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.564 22:40:35 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.564 22:40:35 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:44.564 22:40:35 -- setup/common.sh@32 -- # continue 00:02:44.564 22:40:35 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.564 22:40:35 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.564 22:40:35 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:44.564 22:40:35 -- setup/common.sh@32 -- # continue 00:02:44.564 22:40:35 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.564 22:40:35 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.564 22:40:35 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:44.564 22:40:35 -- setup/common.sh@32 -- # continue 00:02:44.564 22:40:35 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.564 22:40:35 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.564 22:40:35 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:44.564 22:40:35 -- setup/common.sh@32 -- # continue 00:02:44.564 22:40:35 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.564 22:40:35 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.564 22:40:35 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:44.564 22:40:35 -- setup/common.sh@32 -- # continue 00:02:44.564 22:40:35 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.564 22:40:35 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.564 22:40:35 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:44.564 22:40:35 -- setup/common.sh@32 -- # continue 00:02:44.564 22:40:35 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.564 22:40:35 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.564 22:40:35 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:44.564 22:40:35 -- setup/common.sh@32 -- # continue 00:02:44.564 22:40:35 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.565 22:40:35 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.565 22:40:35 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:44.565 22:40:35 -- setup/common.sh@32 -- # continue 00:02:44.565 22:40:35 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.565 22:40:35 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.565 22:40:35 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:44.565 22:40:35 -- setup/common.sh@32 -- # continue 00:02:44.565 22:40:35 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.565 22:40:35 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.565 22:40:35 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:44.565 22:40:35 -- setup/common.sh@32 -- # continue 00:02:44.565 22:40:35 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.565 22:40:35 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.565 22:40:35 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:44.565 22:40:35 -- setup/common.sh@32 -- # continue 00:02:44.565 22:40:35 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.565 22:40:35 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.565 22:40:35 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:44.565 22:40:35 -- setup/common.sh@32 -- # continue 00:02:44.565 22:40:35 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.565 22:40:35 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.565 22:40:35 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:44.565 22:40:35 -- setup/common.sh@32 -- # continue 00:02:44.565 22:40:35 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.565 22:40:35 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.565 22:40:35 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:44.565 22:40:35 -- setup/common.sh@32 -- # continue 00:02:44.565 22:40:35 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.565 22:40:35 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.565 22:40:35 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:44.565 22:40:35 -- setup/common.sh@33 -- # echo 0 00:02:44.565 22:40:35 -- setup/common.sh@33 -- # return 0 00:02:44.565 22:40:35 -- setup/hugepages.sh@99 -- # surp=0 00:02:44.565 22:40:35 -- setup/hugepages.sh@100 -- # get_meminfo HugePages_Rsvd 00:02:44.565 22:40:35 -- setup/common.sh@17 -- # local get=HugePages_Rsvd 00:02:44.565 22:40:35 -- setup/common.sh@18 -- # local node= 00:02:44.565 22:40:35 -- setup/common.sh@19 -- # local var val 00:02:44.565 22:40:35 -- setup/common.sh@20 -- # local mem_f mem 00:02:44.565 22:40:35 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:02:44.565 22:40:35 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:02:44.565 22:40:35 -- setup/common.sh@25 -- # [[ -n '' ]] 00:02:44.565 22:40:35 -- setup/common.sh@28 -- # mapfile -t mem 00:02:44.565 22:40:35 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:02:44.565 22:40:35 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.565 22:40:35 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.565 22:40:35 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60541736 kB' 'MemFree: 43359488 kB' 'MemAvailable: 47350732 kB' 'Buffers: 2696 kB' 'Cached: 12518232 kB' 'SwapCached: 0 kB' 'Active: 9328616 kB' 'Inactive: 3655836 kB' 'Active(anon): 8764300 kB' 'Inactive(anon): 0 kB' 'Active(file): 564316 kB' 'Inactive(file): 3655836 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 466764 kB' 'Mapped: 202508 kB' 'Shmem: 8300776 kB' 'KReclaimable: 415528 kB' 'Slab: 807096 kB' 'SReclaimable: 415528 kB' 'SUnreclaim: 391568 kB' 'KernelStack: 12864 kB' 'PageTables: 8728 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37610896 kB' 'Committed_AS: 9912760 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 197164 kB' 'VmallocChunk: 0 kB' 'Percpu: 38592 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 2506332 kB' 'DirectMap2M: 24676352 kB' 'DirectMap1G: 41943040 kB' 00:02:44.565 22:40:35 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:44.565 22:40:35 -- setup/common.sh@32 -- # continue 00:02:44.565 22:40:35 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.565 22:40:35 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.565 22:40:35 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:44.565 22:40:35 -- setup/common.sh@32 -- # continue 00:02:44.565 22:40:35 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.565 22:40:35 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.565 22:40:35 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:44.565 22:40:35 -- setup/common.sh@32 -- # continue 00:02:44.565 22:40:35 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.565 22:40:35 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.565 22:40:35 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:44.565 22:40:35 -- setup/common.sh@32 -- # continue 00:02:44.565 22:40:35 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.565 22:40:35 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.565 22:40:35 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:44.565 22:40:35 -- setup/common.sh@32 -- # continue 00:02:44.565 22:40:35 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.565 22:40:35 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.565 22:40:35 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:44.565 22:40:35 -- setup/common.sh@32 -- # continue 00:02:44.565 22:40:35 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.565 22:40:35 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.565 22:40:35 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:44.565 22:40:35 -- setup/common.sh@32 -- # continue 00:02:44.565 22:40:35 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.565 22:40:35 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.565 22:40:35 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:44.565 22:40:35 -- setup/common.sh@32 -- # continue 00:02:44.565 22:40:35 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.565 22:40:35 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.565 22:40:35 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:44.565 22:40:35 -- setup/common.sh@32 -- # continue 00:02:44.565 22:40:35 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.565 22:40:35 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.565 22:40:35 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:44.565 22:40:35 -- setup/common.sh@32 -- # continue 00:02:44.565 22:40:35 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.565 22:40:35 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.565 22:40:35 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:44.565 22:40:35 -- setup/common.sh@32 -- # continue 00:02:44.565 22:40:35 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.565 22:40:35 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.565 22:40:35 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:44.565 22:40:35 -- setup/common.sh@32 -- # continue 00:02:44.565 22:40:35 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.565 22:40:35 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.565 22:40:35 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:44.565 22:40:35 -- setup/common.sh@32 -- # continue 00:02:44.565 22:40:35 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.565 22:40:35 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.565 22:40:35 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:44.565 22:40:35 -- setup/common.sh@32 -- # continue 00:02:44.565 22:40:35 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.565 22:40:35 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.565 22:40:35 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:44.565 22:40:35 -- setup/common.sh@32 -- # continue 00:02:44.565 22:40:35 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.565 22:40:35 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.565 22:40:35 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:44.565 22:40:35 -- setup/common.sh@32 -- # continue 00:02:44.565 22:40:35 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.565 22:40:35 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.565 22:40:35 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:44.565 22:40:35 -- setup/common.sh@32 -- # continue 00:02:44.565 22:40:35 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.565 22:40:35 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.565 22:40:35 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:44.565 22:40:35 -- setup/common.sh@32 -- # continue 00:02:44.565 22:40:35 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.565 22:40:35 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.565 22:40:35 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:44.565 22:40:35 -- setup/common.sh@32 -- # continue 00:02:44.565 22:40:35 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.565 22:40:35 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.565 22:40:35 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:44.565 22:40:35 -- setup/common.sh@32 -- # continue 00:02:44.565 22:40:35 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.565 22:40:35 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.565 22:40:35 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:44.565 22:40:35 -- setup/common.sh@32 -- # continue 00:02:44.565 22:40:35 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.565 22:40:35 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.565 22:40:35 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:44.565 22:40:35 -- setup/common.sh@32 -- # continue 00:02:44.565 22:40:35 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.565 22:40:35 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.565 22:40:35 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:44.565 22:40:35 -- setup/common.sh@32 -- # continue 00:02:44.565 22:40:35 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.565 22:40:35 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.565 22:40:35 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:44.565 22:40:35 -- setup/common.sh@32 -- # continue 00:02:44.565 22:40:35 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.565 22:40:35 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.565 22:40:35 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:44.565 22:40:35 -- setup/common.sh@32 -- # continue 00:02:44.565 22:40:35 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.566 22:40:35 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.566 22:40:35 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:44.566 22:40:35 -- setup/common.sh@32 -- # continue 00:02:44.566 22:40:35 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.566 22:40:35 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.566 22:40:35 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:44.566 22:40:35 -- setup/common.sh@32 -- # continue 00:02:44.566 22:40:35 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.566 22:40:35 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.566 22:40:35 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:44.566 22:40:35 -- setup/common.sh@32 -- # continue 00:02:44.566 22:40:35 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.566 22:40:35 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.566 22:40:35 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:44.566 22:40:35 -- setup/common.sh@32 -- # continue 00:02:44.566 22:40:35 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.566 22:40:35 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.566 22:40:35 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:44.566 22:40:35 -- setup/common.sh@32 -- # continue 00:02:44.566 22:40:35 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.566 22:40:35 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.566 22:40:35 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:44.566 22:40:35 -- setup/common.sh@32 -- # continue 00:02:44.566 22:40:35 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.566 22:40:35 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.566 22:40:35 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:44.566 22:40:35 -- setup/common.sh@32 -- # continue 00:02:44.566 22:40:35 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.566 22:40:35 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.566 22:40:35 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:44.566 22:40:35 -- setup/common.sh@32 -- # continue 00:02:44.566 22:40:35 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.566 22:40:35 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.566 22:40:35 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:44.566 22:40:35 -- setup/common.sh@32 -- # continue 00:02:44.566 22:40:35 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.566 22:40:35 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.566 22:40:35 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:44.566 22:40:35 -- setup/common.sh@32 -- # continue 00:02:44.566 22:40:35 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.566 22:40:35 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.566 22:40:35 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:44.566 22:40:35 -- setup/common.sh@32 -- # continue 00:02:44.566 22:40:35 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.566 22:40:35 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.566 22:40:35 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:44.566 22:40:35 -- setup/common.sh@32 -- # continue 00:02:44.566 22:40:35 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.566 22:40:35 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.566 22:40:35 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:44.566 22:40:35 -- setup/common.sh@32 -- # continue 00:02:44.566 22:40:35 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.566 22:40:35 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.566 22:40:35 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:44.566 22:40:35 -- setup/common.sh@32 -- # continue 00:02:44.566 22:40:35 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.566 22:40:35 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.566 22:40:35 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:44.566 22:40:35 -- setup/common.sh@32 -- # continue 00:02:44.566 22:40:35 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.566 22:40:35 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.566 22:40:35 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:44.566 22:40:35 -- setup/common.sh@32 -- # continue 00:02:44.566 22:40:35 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.566 22:40:35 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.566 22:40:35 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:44.566 22:40:35 -- setup/common.sh@32 -- # continue 00:02:44.566 22:40:35 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.566 22:40:35 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.566 22:40:35 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:44.566 22:40:35 -- setup/common.sh@32 -- # continue 00:02:44.566 22:40:35 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.566 22:40:35 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.566 22:40:35 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:44.566 22:40:35 -- setup/common.sh@32 -- # continue 00:02:44.566 22:40:35 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.566 22:40:35 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.566 22:40:35 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:44.566 22:40:35 -- setup/common.sh@32 -- # continue 00:02:44.566 22:40:35 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.566 22:40:35 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.566 22:40:35 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:44.566 22:40:35 -- setup/common.sh@32 -- # continue 00:02:44.566 22:40:35 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.566 22:40:35 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.566 22:40:35 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:44.566 22:40:35 -- setup/common.sh@32 -- # continue 00:02:44.566 22:40:35 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.566 22:40:35 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.566 22:40:35 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:44.566 22:40:35 -- setup/common.sh@32 -- # continue 00:02:44.566 22:40:35 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.566 22:40:35 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.566 22:40:35 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:44.566 22:40:35 -- setup/common.sh@32 -- # continue 00:02:44.566 22:40:35 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.566 22:40:35 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.566 22:40:35 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:44.566 22:40:35 -- setup/common.sh@32 -- # continue 00:02:44.566 22:40:35 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.566 22:40:35 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.566 22:40:35 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:44.566 22:40:35 -- setup/common.sh@33 -- # echo 0 00:02:44.566 22:40:35 -- setup/common.sh@33 -- # return 0 00:02:44.566 22:40:35 -- setup/hugepages.sh@100 -- # resv=0 00:02:44.566 22:40:35 -- setup/hugepages.sh@102 -- # echo nr_hugepages=1024 00:02:44.566 nr_hugepages=1024 00:02:44.566 22:40:35 -- setup/hugepages.sh@103 -- # echo resv_hugepages=0 00:02:44.566 resv_hugepages=0 00:02:44.566 22:40:35 -- setup/hugepages.sh@104 -- # echo surplus_hugepages=0 00:02:44.566 surplus_hugepages=0 00:02:44.566 22:40:35 -- setup/hugepages.sh@105 -- # echo anon_hugepages=0 00:02:44.566 anon_hugepages=0 00:02:44.566 22:40:35 -- setup/hugepages.sh@107 -- # (( 1024 == nr_hugepages + surp + resv )) 00:02:44.566 22:40:35 -- setup/hugepages.sh@109 -- # (( 1024 == nr_hugepages )) 00:02:44.566 22:40:35 -- setup/hugepages.sh@110 -- # get_meminfo HugePages_Total 00:02:44.566 22:40:35 -- setup/common.sh@17 -- # local get=HugePages_Total 00:02:44.566 22:40:35 -- setup/common.sh@18 -- # local node= 00:02:44.566 22:40:35 -- setup/common.sh@19 -- # local var val 00:02:44.566 22:40:35 -- setup/common.sh@20 -- # local mem_f mem 00:02:44.566 22:40:35 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:02:44.566 22:40:35 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:02:44.566 22:40:35 -- setup/common.sh@25 -- # [[ -n '' ]] 00:02:44.566 22:40:35 -- setup/common.sh@28 -- # mapfile -t mem 00:02:44.566 22:40:35 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:02:44.566 22:40:35 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.566 22:40:35 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.566 22:40:35 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60541736 kB' 'MemFree: 43359488 kB' 'MemAvailable: 47350732 kB' 'Buffers: 2696 kB' 'Cached: 12518248 kB' 'SwapCached: 0 kB' 'Active: 9328644 kB' 'Inactive: 3655836 kB' 'Active(anon): 8764328 kB' 'Inactive(anon): 0 kB' 'Active(file): 564316 kB' 'Inactive(file): 3655836 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 466764 kB' 'Mapped: 202508 kB' 'Shmem: 8300792 kB' 'KReclaimable: 415528 kB' 'Slab: 807096 kB' 'SReclaimable: 415528 kB' 'SUnreclaim: 391568 kB' 'KernelStack: 12864 kB' 'PageTables: 8728 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37610896 kB' 'Committed_AS: 9912776 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 197180 kB' 'VmallocChunk: 0 kB' 'Percpu: 38592 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 2506332 kB' 'DirectMap2M: 24676352 kB' 'DirectMap1G: 41943040 kB' 00:02:44.566 22:40:35 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:44.566 22:40:35 -- setup/common.sh@32 -- # continue 00:02:44.566 22:40:35 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.566 22:40:35 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.566 22:40:35 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:44.566 22:40:35 -- setup/common.sh@32 -- # continue 00:02:44.566 22:40:35 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.566 22:40:35 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.566 22:40:35 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:44.566 22:40:35 -- setup/common.sh@32 -- # continue 00:02:44.566 22:40:35 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.566 22:40:35 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.566 22:40:35 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:44.566 22:40:35 -- setup/common.sh@32 -- # continue 00:02:44.566 22:40:35 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.566 22:40:35 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.566 22:40:35 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:44.566 22:40:35 -- setup/common.sh@32 -- # continue 00:02:44.566 22:40:35 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.566 22:40:35 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.566 22:40:35 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:44.567 22:40:35 -- setup/common.sh@32 -- # continue 00:02:44.567 22:40:35 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.567 22:40:35 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.567 22:40:35 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:44.567 22:40:35 -- setup/common.sh@32 -- # continue 00:02:44.567 22:40:35 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.567 22:40:35 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.567 22:40:35 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:44.567 22:40:35 -- setup/common.sh@32 -- # continue 00:02:44.567 22:40:35 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.567 22:40:35 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.567 22:40:35 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:44.567 22:40:35 -- setup/common.sh@32 -- # continue 00:02:44.567 22:40:35 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.567 22:40:35 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.567 22:40:35 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:44.567 22:40:35 -- setup/common.sh@32 -- # continue 00:02:44.567 22:40:35 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.567 22:40:35 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.567 22:40:35 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:44.567 22:40:35 -- setup/common.sh@32 -- # continue 00:02:44.567 22:40:35 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.567 22:40:35 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.567 22:40:35 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:44.567 22:40:35 -- setup/common.sh@32 -- # continue 00:02:44.567 22:40:35 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.567 22:40:35 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.567 22:40:35 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:44.567 22:40:35 -- setup/common.sh@32 -- # continue 00:02:44.567 22:40:35 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.567 22:40:35 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.567 22:40:35 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:44.567 22:40:35 -- setup/common.sh@32 -- # continue 00:02:44.567 22:40:35 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.567 22:40:35 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.567 22:40:35 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:44.567 22:40:35 -- setup/common.sh@32 -- # continue 00:02:44.567 22:40:35 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.567 22:40:35 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.567 22:40:35 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:44.567 22:40:35 -- setup/common.sh@32 -- # continue 00:02:44.567 22:40:35 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.567 22:40:35 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.567 22:40:35 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:44.567 22:40:35 -- setup/common.sh@32 -- # continue 00:02:44.567 22:40:35 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.567 22:40:35 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.567 22:40:35 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:44.567 22:40:35 -- setup/common.sh@32 -- # continue 00:02:44.567 22:40:35 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.567 22:40:35 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.567 22:40:35 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:44.567 22:40:35 -- setup/common.sh@32 -- # continue 00:02:44.567 22:40:35 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.567 22:40:35 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.567 22:40:35 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:44.567 22:40:35 -- setup/common.sh@32 -- # continue 00:02:44.567 22:40:35 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.567 22:40:35 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.567 22:40:35 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:44.567 22:40:35 -- setup/common.sh@32 -- # continue 00:02:44.567 22:40:35 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.567 22:40:35 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.567 22:40:35 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:44.567 22:40:35 -- setup/common.sh@32 -- # continue 00:02:44.567 22:40:35 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.567 22:40:35 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.567 22:40:35 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:44.567 22:40:35 -- setup/common.sh@32 -- # continue 00:02:44.567 22:40:35 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.567 22:40:35 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.567 22:40:35 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:44.567 22:40:35 -- setup/common.sh@32 -- # continue 00:02:44.567 22:40:35 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.567 22:40:35 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.567 22:40:35 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:44.567 22:40:35 -- setup/common.sh@32 -- # continue 00:02:44.567 22:40:35 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.567 22:40:35 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.567 22:40:35 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:44.567 22:40:35 -- setup/common.sh@32 -- # continue 00:02:44.567 22:40:35 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.567 22:40:35 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.567 22:40:35 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:44.567 22:40:35 -- setup/common.sh@32 -- # continue 00:02:44.567 22:40:35 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.567 22:40:35 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.567 22:40:35 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:44.567 22:40:35 -- setup/common.sh@32 -- # continue 00:02:44.567 22:40:35 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.567 22:40:35 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.567 22:40:35 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:44.567 22:40:35 -- setup/common.sh@32 -- # continue 00:02:44.567 22:40:35 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.567 22:40:35 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.567 22:40:35 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:44.567 22:40:35 -- setup/common.sh@32 -- # continue 00:02:44.567 22:40:35 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.567 22:40:35 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.567 22:40:35 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:44.567 22:40:35 -- setup/common.sh@32 -- # continue 00:02:44.567 22:40:35 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.567 22:40:35 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.567 22:40:35 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:44.567 22:40:35 -- setup/common.sh@32 -- # continue 00:02:44.567 22:40:35 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.567 22:40:35 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.567 22:40:35 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:44.567 22:40:35 -- setup/common.sh@32 -- # continue 00:02:44.567 22:40:35 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.567 22:40:35 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.567 22:40:35 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:44.567 22:40:35 -- setup/common.sh@32 -- # continue 00:02:44.567 22:40:35 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.567 22:40:35 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.567 22:40:35 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:44.567 22:40:35 -- setup/common.sh@32 -- # continue 00:02:44.567 22:40:35 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.567 22:40:35 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.567 22:40:35 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:44.567 22:40:35 -- setup/common.sh@32 -- # continue 00:02:44.567 22:40:35 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.567 22:40:35 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.567 22:40:35 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:44.567 22:40:35 -- setup/common.sh@32 -- # continue 00:02:44.567 22:40:35 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.567 22:40:35 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.567 22:40:35 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:44.567 22:40:35 -- setup/common.sh@32 -- # continue 00:02:44.567 22:40:35 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.567 22:40:35 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.567 22:40:35 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:44.567 22:40:35 -- setup/common.sh@32 -- # continue 00:02:44.567 22:40:35 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.567 22:40:35 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.567 22:40:35 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:44.568 22:40:35 -- setup/common.sh@32 -- # continue 00:02:44.568 22:40:35 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.568 22:40:35 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.568 22:40:35 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:44.568 22:40:35 -- setup/common.sh@32 -- # continue 00:02:44.568 22:40:35 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.568 22:40:35 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.568 22:40:35 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:44.568 22:40:35 -- setup/common.sh@32 -- # continue 00:02:44.568 22:40:35 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.568 22:40:35 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.568 22:40:35 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:44.568 22:40:35 -- setup/common.sh@32 -- # continue 00:02:44.568 22:40:35 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.568 22:40:35 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.568 22:40:35 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:44.568 22:40:35 -- setup/common.sh@32 -- # continue 00:02:44.568 22:40:35 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.568 22:40:35 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.568 22:40:35 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:44.568 22:40:35 -- setup/common.sh@32 -- # continue 00:02:44.568 22:40:35 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.568 22:40:35 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.568 22:40:35 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:44.568 22:40:35 -- setup/common.sh@32 -- # continue 00:02:44.568 22:40:35 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.568 22:40:35 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.568 22:40:35 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:44.568 22:40:35 -- setup/common.sh@32 -- # continue 00:02:44.568 22:40:35 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.568 22:40:35 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.568 22:40:35 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:44.568 22:40:35 -- setup/common.sh@32 -- # continue 00:02:44.568 22:40:35 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.568 22:40:35 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.568 22:40:35 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:44.568 22:40:35 -- setup/common.sh@33 -- # echo 1024 00:02:44.568 22:40:35 -- setup/common.sh@33 -- # return 0 00:02:44.568 22:40:35 -- setup/hugepages.sh@110 -- # (( 1024 == nr_hugepages + surp + resv )) 00:02:44.568 22:40:35 -- setup/hugepages.sh@112 -- # get_nodes 00:02:44.568 22:40:35 -- setup/hugepages.sh@27 -- # local node 00:02:44.568 22:40:35 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:02:44.568 22:40:35 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=512 00:02:44.568 22:40:35 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:02:44.568 22:40:35 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=512 00:02:44.568 22:40:35 -- setup/hugepages.sh@32 -- # no_nodes=2 00:02:44.568 22:40:35 -- setup/hugepages.sh@33 -- # (( no_nodes > 0 )) 00:02:44.568 22:40:35 -- setup/hugepages.sh@115 -- # for node in "${!nodes_test[@]}" 00:02:44.568 22:40:35 -- setup/hugepages.sh@116 -- # (( nodes_test[node] += resv )) 00:02:44.568 22:40:35 -- setup/hugepages.sh@117 -- # get_meminfo HugePages_Surp 0 00:02:44.568 22:40:35 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:02:44.568 22:40:35 -- setup/common.sh@18 -- # local node=0 00:02:44.568 22:40:35 -- setup/common.sh@19 -- # local var val 00:02:44.568 22:40:35 -- setup/common.sh@20 -- # local mem_f mem 00:02:44.568 22:40:35 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:02:44.568 22:40:35 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node0/meminfo ]] 00:02:44.568 22:40:35 -- setup/common.sh@24 -- # mem_f=/sys/devices/system/node/node0/meminfo 00:02:44.568 22:40:35 -- setup/common.sh@28 -- # mapfile -t mem 00:02:44.568 22:40:35 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:02:44.568 22:40:35 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.568 22:40:35 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 32829884 kB' 'MemFree: 20140836 kB' 'MemUsed: 12689048 kB' 'SwapCached: 0 kB' 'Active: 6999904 kB' 'Inactive: 3490860 kB' 'Active(anon): 6618692 kB' 'Inactive(anon): 0 kB' 'Active(file): 381212 kB' 'Inactive(file): 3490860 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'FilePages: 10244068 kB' 'Mapped: 157368 kB' 'AnonPages: 249864 kB' 'Shmem: 6371996 kB' 'KernelStack: 6616 kB' 'PageTables: 4612 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'KReclaimable: 272444 kB' 'Slab: 484900 kB' 'SReclaimable: 272444 kB' 'SUnreclaim: 212456 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 512' 'HugePages_Free: 512' 'HugePages_Surp: 0' 00:02:44.568 22:40:35 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.568 22:40:35 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:44.568 22:40:35 -- setup/common.sh@32 -- # continue 00:02:44.568 22:40:35 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.568 22:40:35 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.568 22:40:35 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:44.568 22:40:35 -- setup/common.sh@32 -- # continue 00:02:44.568 22:40:35 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.568 22:40:35 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.568 22:40:35 -- setup/common.sh@32 -- # [[ MemUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:44.568 22:40:35 -- setup/common.sh@32 -- # continue 00:02:44.568 22:40:35 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.568 22:40:35 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.568 22:40:35 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:44.568 22:40:35 -- setup/common.sh@32 -- # continue 00:02:44.568 22:40:35 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.568 22:40:35 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.568 22:40:35 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:44.568 22:40:35 -- setup/common.sh@32 -- # continue 00:02:44.568 22:40:35 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.568 22:40:35 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.568 22:40:35 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:44.568 22:40:35 -- setup/common.sh@32 -- # continue 00:02:44.568 22:40:35 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.568 22:40:35 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.568 22:40:35 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:44.568 22:40:35 -- setup/common.sh@32 -- # continue 00:02:44.568 22:40:35 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.568 22:40:35 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.568 22:40:35 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:44.568 22:40:35 -- setup/common.sh@32 -- # continue 00:02:44.568 22:40:35 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.568 22:40:35 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.568 22:40:35 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:44.568 22:40:35 -- setup/common.sh@32 -- # continue 00:02:44.568 22:40:35 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.568 22:40:35 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.568 22:40:35 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:44.568 22:40:35 -- setup/common.sh@32 -- # continue 00:02:44.568 22:40:35 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.568 22:40:35 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.568 22:40:35 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:44.568 22:40:35 -- setup/common.sh@32 -- # continue 00:02:44.568 22:40:35 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.568 22:40:35 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.568 22:40:35 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:44.568 22:40:35 -- setup/common.sh@32 -- # continue 00:02:44.568 22:40:35 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.568 22:40:35 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.568 22:40:35 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:44.568 22:40:35 -- setup/common.sh@32 -- # continue 00:02:44.568 22:40:35 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.568 22:40:35 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.568 22:40:35 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:44.568 22:40:35 -- setup/common.sh@32 -- # continue 00:02:44.568 22:40:35 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.568 22:40:35 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.568 22:40:35 -- setup/common.sh@32 -- # [[ FilePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:44.568 22:40:35 -- setup/common.sh@32 -- # continue 00:02:44.568 22:40:35 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.568 22:40:35 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.568 22:40:35 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:44.568 22:40:35 -- setup/common.sh@32 -- # continue 00:02:44.568 22:40:35 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.568 22:40:35 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.568 22:40:35 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:44.568 22:40:35 -- setup/common.sh@32 -- # continue 00:02:44.568 22:40:35 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.568 22:40:35 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.568 22:40:35 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:44.568 22:40:35 -- setup/common.sh@32 -- # continue 00:02:44.568 22:40:35 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.568 22:40:35 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.568 22:40:35 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:44.568 22:40:35 -- setup/common.sh@32 -- # continue 00:02:44.568 22:40:35 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.568 22:40:35 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.568 22:40:35 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:44.568 22:40:35 -- setup/common.sh@32 -- # continue 00:02:44.568 22:40:35 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.568 22:40:35 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.568 22:40:35 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:44.568 22:40:35 -- setup/common.sh@32 -- # continue 00:02:44.568 22:40:35 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.568 22:40:35 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.568 22:40:35 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:44.568 22:40:35 -- setup/common.sh@32 -- # continue 00:02:44.568 22:40:35 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.568 22:40:35 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.568 22:40:35 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:44.568 22:40:35 -- setup/common.sh@32 -- # continue 00:02:44.568 22:40:35 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.569 22:40:35 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.569 22:40:35 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:44.569 22:40:35 -- setup/common.sh@32 -- # continue 00:02:44.569 22:40:35 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.569 22:40:35 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.569 22:40:35 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:44.569 22:40:35 -- setup/common.sh@32 -- # continue 00:02:44.569 22:40:35 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.569 22:40:35 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.569 22:40:35 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:44.569 22:40:35 -- setup/common.sh@32 -- # continue 00:02:44.569 22:40:35 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.569 22:40:35 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.569 22:40:35 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:44.569 22:40:35 -- setup/common.sh@32 -- # continue 00:02:44.569 22:40:35 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.569 22:40:35 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.569 22:40:35 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:44.569 22:40:35 -- setup/common.sh@32 -- # continue 00:02:44.569 22:40:35 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.569 22:40:35 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.569 22:40:35 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:44.569 22:40:35 -- setup/common.sh@32 -- # continue 00:02:44.569 22:40:35 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.569 22:40:35 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.569 22:40:35 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:44.569 22:40:35 -- setup/common.sh@32 -- # continue 00:02:44.569 22:40:35 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.569 22:40:35 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.569 22:40:35 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:44.569 22:40:35 -- setup/common.sh@32 -- # continue 00:02:44.569 22:40:35 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.569 22:40:35 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.569 22:40:35 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:44.569 22:40:35 -- setup/common.sh@32 -- # continue 00:02:44.569 22:40:35 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.569 22:40:35 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.569 22:40:35 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:44.569 22:40:35 -- setup/common.sh@32 -- # continue 00:02:44.569 22:40:35 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.569 22:40:35 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.569 22:40:35 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:44.569 22:40:35 -- setup/common.sh@32 -- # continue 00:02:44.569 22:40:35 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.569 22:40:35 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.569 22:40:35 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:44.569 22:40:35 -- setup/common.sh@32 -- # continue 00:02:44.569 22:40:35 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.569 22:40:35 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.569 22:40:35 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:44.569 22:40:35 -- setup/common.sh@32 -- # continue 00:02:44.569 22:40:35 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.569 22:40:35 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.569 22:40:35 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:44.569 22:40:35 -- setup/common.sh@33 -- # echo 0 00:02:44.569 22:40:35 -- setup/common.sh@33 -- # return 0 00:02:44.569 22:40:35 -- setup/hugepages.sh@117 -- # (( nodes_test[node] += 0 )) 00:02:44.569 22:40:35 -- setup/hugepages.sh@115 -- # for node in "${!nodes_test[@]}" 00:02:44.569 22:40:35 -- setup/hugepages.sh@116 -- # (( nodes_test[node] += resv )) 00:02:44.569 22:40:35 -- setup/hugepages.sh@117 -- # get_meminfo HugePages_Surp 1 00:02:44.569 22:40:35 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:02:44.569 22:40:35 -- setup/common.sh@18 -- # local node=1 00:02:44.569 22:40:35 -- setup/common.sh@19 -- # local var val 00:02:44.569 22:40:35 -- setup/common.sh@20 -- # local mem_f mem 00:02:44.569 22:40:35 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:02:44.569 22:40:35 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node1/meminfo ]] 00:02:44.569 22:40:35 -- setup/common.sh@24 -- # mem_f=/sys/devices/system/node/node1/meminfo 00:02:44.569 22:40:35 -- setup/common.sh@28 -- # mapfile -t mem 00:02:44.569 22:40:35 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:02:44.569 22:40:35 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.569 22:40:35 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.569 22:40:35 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 27711852 kB' 'MemFree: 23218976 kB' 'MemUsed: 4492876 kB' 'SwapCached: 0 kB' 'Active: 2328744 kB' 'Inactive: 164976 kB' 'Active(anon): 2145640 kB' 'Inactive(anon): 0 kB' 'Active(file): 183104 kB' 'Inactive(file): 164976 kB' 'Unevictable: 0 kB' 'Mlocked: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'FilePages: 2276892 kB' 'Mapped: 45140 kB' 'AnonPages: 216900 kB' 'Shmem: 1928812 kB' 'KernelStack: 6248 kB' 'PageTables: 4116 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'KReclaimable: 143084 kB' 'Slab: 322196 kB' 'SReclaimable: 143084 kB' 'SUnreclaim: 179112 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 512' 'HugePages_Free: 512' 'HugePages_Surp: 0' 00:02:44.569 22:40:35 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:44.569 22:40:35 -- setup/common.sh@32 -- # continue 00:02:44.569 22:40:35 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.569 22:40:35 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.569 22:40:35 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:44.569 22:40:35 -- setup/common.sh@32 -- # continue 00:02:44.569 22:40:35 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.569 22:40:35 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.569 22:40:35 -- setup/common.sh@32 -- # [[ MemUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:44.569 22:40:35 -- setup/common.sh@32 -- # continue 00:02:44.569 22:40:35 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.569 22:40:35 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.569 22:40:35 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:44.569 22:40:35 -- setup/common.sh@32 -- # continue 00:02:44.569 22:40:35 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.569 22:40:35 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.569 22:40:35 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:44.569 22:40:35 -- setup/common.sh@32 -- # continue 00:02:44.569 22:40:35 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.569 22:40:35 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.569 22:40:35 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:44.569 22:40:35 -- setup/common.sh@32 -- # continue 00:02:44.569 22:40:35 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.569 22:40:35 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.569 22:40:35 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:44.569 22:40:35 -- setup/common.sh@32 -- # continue 00:02:44.569 22:40:35 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.569 22:40:35 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.569 22:40:35 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:44.569 22:40:35 -- setup/common.sh@32 -- # continue 00:02:44.569 22:40:35 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.569 22:40:35 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.569 22:40:35 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:44.569 22:40:35 -- setup/common.sh@32 -- # continue 00:02:44.569 22:40:35 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.569 22:40:35 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.569 22:40:35 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:44.569 22:40:35 -- setup/common.sh@32 -- # continue 00:02:44.569 22:40:35 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.569 22:40:35 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.569 22:40:35 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:44.569 22:40:35 -- setup/common.sh@32 -- # continue 00:02:44.569 22:40:35 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.569 22:40:35 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.569 22:40:35 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:44.569 22:40:35 -- setup/common.sh@32 -- # continue 00:02:44.569 22:40:35 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.569 22:40:35 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.569 22:40:35 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:44.569 22:40:35 -- setup/common.sh@32 -- # continue 00:02:44.569 22:40:35 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.569 22:40:35 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.569 22:40:35 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:44.569 22:40:35 -- setup/common.sh@32 -- # continue 00:02:44.569 22:40:35 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.569 22:40:35 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.569 22:40:35 -- setup/common.sh@32 -- # [[ FilePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:44.569 22:40:35 -- setup/common.sh@32 -- # continue 00:02:44.569 22:40:35 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.569 22:40:35 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.569 22:40:35 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:44.569 22:40:35 -- setup/common.sh@32 -- # continue 00:02:44.569 22:40:35 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.569 22:40:35 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.569 22:40:35 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:44.569 22:40:35 -- setup/common.sh@32 -- # continue 00:02:44.569 22:40:35 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.569 22:40:35 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.569 22:40:35 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:44.569 22:40:35 -- setup/common.sh@32 -- # continue 00:02:44.569 22:40:35 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.569 22:40:35 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.569 22:40:35 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:44.569 22:40:35 -- setup/common.sh@32 -- # continue 00:02:44.569 22:40:35 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.569 22:40:35 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.569 22:40:35 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:44.569 22:40:35 -- setup/common.sh@32 -- # continue 00:02:44.569 22:40:35 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.569 22:40:35 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.569 22:40:35 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:44.569 22:40:35 -- setup/common.sh@32 -- # continue 00:02:44.570 22:40:35 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.570 22:40:35 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.570 22:40:35 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:44.570 22:40:35 -- setup/common.sh@32 -- # continue 00:02:44.570 22:40:35 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.570 22:40:35 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.570 22:40:35 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:44.570 22:40:35 -- setup/common.sh@32 -- # continue 00:02:44.570 22:40:35 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.570 22:40:35 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.570 22:40:35 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:44.570 22:40:35 -- setup/common.sh@32 -- # continue 00:02:44.570 22:40:35 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.570 22:40:35 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.570 22:40:35 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:44.570 22:40:35 -- setup/common.sh@32 -- # continue 00:02:44.570 22:40:35 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.570 22:40:35 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.570 22:40:35 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:44.570 22:40:35 -- setup/common.sh@32 -- # continue 00:02:44.570 22:40:35 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.570 22:40:35 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.570 22:40:35 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:44.570 22:40:35 -- setup/common.sh@32 -- # continue 00:02:44.570 22:40:35 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.570 22:40:35 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.570 22:40:35 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:44.570 22:40:35 -- setup/common.sh@32 -- # continue 00:02:44.570 22:40:35 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.570 22:40:35 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.570 22:40:35 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:44.570 22:40:35 -- setup/common.sh@32 -- # continue 00:02:44.570 22:40:35 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.570 22:40:35 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.570 22:40:35 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:44.570 22:40:35 -- setup/common.sh@32 -- # continue 00:02:44.570 22:40:35 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.570 22:40:35 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.570 22:40:35 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:44.570 22:40:35 -- setup/common.sh@32 -- # continue 00:02:44.570 22:40:35 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.570 22:40:35 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.570 22:40:35 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:44.570 22:40:35 -- setup/common.sh@32 -- # continue 00:02:44.570 22:40:35 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.570 22:40:35 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.570 22:40:35 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:44.570 22:40:35 -- setup/common.sh@32 -- # continue 00:02:44.570 22:40:35 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.570 22:40:35 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.570 22:40:35 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:44.570 22:40:35 -- setup/common.sh@32 -- # continue 00:02:44.570 22:40:35 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.570 22:40:35 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.570 22:40:35 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:44.570 22:40:35 -- setup/common.sh@32 -- # continue 00:02:44.570 22:40:35 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.570 22:40:35 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.570 22:40:35 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:44.570 22:40:35 -- setup/common.sh@32 -- # continue 00:02:44.570 22:40:35 -- setup/common.sh@31 -- # IFS=': ' 00:02:44.570 22:40:35 -- setup/common.sh@31 -- # read -r var val _ 00:02:44.570 22:40:35 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:44.570 22:40:35 -- setup/common.sh@33 -- # echo 0 00:02:44.570 22:40:35 -- setup/common.sh@33 -- # return 0 00:02:44.570 22:40:35 -- setup/hugepages.sh@117 -- # (( nodes_test[node] += 0 )) 00:02:44.570 22:40:35 -- setup/hugepages.sh@126 -- # for node in "${!nodes_test[@]}" 00:02:44.570 22:40:35 -- setup/hugepages.sh@127 -- # sorted_t[nodes_test[node]]=1 00:02:44.570 22:40:35 -- setup/hugepages.sh@127 -- # sorted_s[nodes_sys[node]]=1 00:02:44.570 22:40:35 -- setup/hugepages.sh@128 -- # echo 'node0=512 expecting 512' 00:02:44.570 node0=512 expecting 512 00:02:44.570 22:40:35 -- setup/hugepages.sh@126 -- # for node in "${!nodes_test[@]}" 00:02:44.570 22:40:35 -- setup/hugepages.sh@127 -- # sorted_t[nodes_test[node]]=1 00:02:44.570 22:40:35 -- setup/hugepages.sh@127 -- # sorted_s[nodes_sys[node]]=1 00:02:44.570 22:40:35 -- setup/hugepages.sh@128 -- # echo 'node1=512 expecting 512' 00:02:44.570 node1=512 expecting 512 00:02:44.570 22:40:35 -- setup/hugepages.sh@130 -- # [[ 512 == \5\1\2 ]] 00:02:44.570 00:02:44.570 real 0m1.415s 00:02:44.570 user 0m0.627s 00:02:44.570 sys 0m0.752s 00:02:44.570 22:40:35 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:02:44.570 22:40:35 -- common/autotest_common.sh@10 -- # set +x 00:02:44.570 ************************************ 00:02:44.570 END TEST per_node_1G_alloc 00:02:44.570 ************************************ 00:02:44.570 22:40:35 -- setup/hugepages.sh@212 -- # run_test even_2G_alloc even_2G_alloc 00:02:44.570 22:40:35 -- common/autotest_common.sh@1077 -- # '[' 2 -le 1 ']' 00:02:44.570 22:40:35 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:02:44.570 22:40:35 -- common/autotest_common.sh@10 -- # set +x 00:02:44.570 ************************************ 00:02:44.570 START TEST even_2G_alloc 00:02:44.570 ************************************ 00:02:44.570 22:40:35 -- common/autotest_common.sh@1104 -- # even_2G_alloc 00:02:44.570 22:40:35 -- setup/hugepages.sh@152 -- # get_test_nr_hugepages 2097152 00:02:44.570 22:40:35 -- setup/hugepages.sh@49 -- # local size=2097152 00:02:44.570 22:40:35 -- setup/hugepages.sh@50 -- # (( 1 > 1 )) 00:02:44.570 22:40:35 -- setup/hugepages.sh@55 -- # (( size >= default_hugepages )) 00:02:44.570 22:40:35 -- setup/hugepages.sh@57 -- # nr_hugepages=1024 00:02:44.570 22:40:35 -- setup/hugepages.sh@58 -- # get_test_nr_hugepages_per_node 00:02:44.570 22:40:35 -- setup/hugepages.sh@62 -- # user_nodes=() 00:02:44.570 22:40:35 -- setup/hugepages.sh@62 -- # local user_nodes 00:02:44.570 22:40:35 -- setup/hugepages.sh@64 -- # local _nr_hugepages=1024 00:02:44.570 22:40:35 -- setup/hugepages.sh@65 -- # local _no_nodes=2 00:02:44.570 22:40:35 -- setup/hugepages.sh@67 -- # nodes_test=() 00:02:44.570 22:40:35 -- setup/hugepages.sh@67 -- # local -g nodes_test 00:02:44.570 22:40:35 -- setup/hugepages.sh@69 -- # (( 0 > 0 )) 00:02:44.570 22:40:35 -- setup/hugepages.sh@74 -- # (( 0 > 0 )) 00:02:44.570 22:40:35 -- setup/hugepages.sh@81 -- # (( _no_nodes > 0 )) 00:02:44.570 22:40:35 -- setup/hugepages.sh@82 -- # nodes_test[_no_nodes - 1]=512 00:02:44.570 22:40:35 -- setup/hugepages.sh@83 -- # : 512 00:02:44.570 22:40:35 -- setup/hugepages.sh@84 -- # : 1 00:02:44.570 22:40:35 -- setup/hugepages.sh@81 -- # (( _no_nodes > 0 )) 00:02:44.570 22:40:35 -- setup/hugepages.sh@82 -- # nodes_test[_no_nodes - 1]=512 00:02:44.570 22:40:35 -- setup/hugepages.sh@83 -- # : 0 00:02:44.570 22:40:35 -- setup/hugepages.sh@84 -- # : 0 00:02:44.570 22:40:35 -- setup/hugepages.sh@81 -- # (( _no_nodes > 0 )) 00:02:44.570 22:40:35 -- setup/hugepages.sh@153 -- # NRHUGE=1024 00:02:44.570 22:40:35 -- setup/hugepages.sh@153 -- # HUGE_EVEN_ALLOC=yes 00:02:44.570 22:40:35 -- setup/hugepages.sh@153 -- # setup output 00:02:44.570 22:40:35 -- setup/common.sh@9 -- # [[ output == output ]] 00:02:44.570 22:40:35 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh 00:02:45.954 0000:00:04.7 (8086 0e27): Already using the vfio-pci driver 00:02:45.954 0000:88:00.0 (8086 0a54): Already using the vfio-pci driver 00:02:45.954 0000:00:04.6 (8086 0e26): Already using the vfio-pci driver 00:02:45.954 0000:00:04.5 (8086 0e25): Already using the vfio-pci driver 00:02:45.954 0000:00:04.4 (8086 0e24): Already using the vfio-pci driver 00:02:45.954 0000:00:04.3 (8086 0e23): Already using the vfio-pci driver 00:02:45.954 0000:00:04.2 (8086 0e22): Already using the vfio-pci driver 00:02:45.954 0000:00:04.1 (8086 0e21): Already using the vfio-pci driver 00:02:45.954 0000:00:04.0 (8086 0e20): Already using the vfio-pci driver 00:02:45.954 0000:80:04.7 (8086 0e27): Already using the vfio-pci driver 00:02:45.954 0000:80:04.6 (8086 0e26): Already using the vfio-pci driver 00:02:45.954 0000:80:04.5 (8086 0e25): Already using the vfio-pci driver 00:02:45.954 0000:80:04.4 (8086 0e24): Already using the vfio-pci driver 00:02:45.954 0000:80:04.3 (8086 0e23): Already using the vfio-pci driver 00:02:45.954 0000:80:04.2 (8086 0e22): Already using the vfio-pci driver 00:02:45.954 0000:80:04.1 (8086 0e21): Already using the vfio-pci driver 00:02:45.954 0000:80:04.0 (8086 0e20): Already using the vfio-pci driver 00:02:45.954 22:40:36 -- setup/hugepages.sh@154 -- # verify_nr_hugepages 00:02:45.954 22:40:36 -- setup/hugepages.sh@89 -- # local node 00:02:45.954 22:40:36 -- setup/hugepages.sh@90 -- # local sorted_t 00:02:45.954 22:40:36 -- setup/hugepages.sh@91 -- # local sorted_s 00:02:45.954 22:40:36 -- setup/hugepages.sh@92 -- # local surp 00:02:45.954 22:40:36 -- setup/hugepages.sh@93 -- # local resv 00:02:45.954 22:40:36 -- setup/hugepages.sh@94 -- # local anon 00:02:45.954 22:40:36 -- setup/hugepages.sh@96 -- # [[ always [madvise] never != *\[\n\e\v\e\r\]* ]] 00:02:45.954 22:40:36 -- setup/hugepages.sh@97 -- # get_meminfo AnonHugePages 00:02:45.954 22:40:36 -- setup/common.sh@17 -- # local get=AnonHugePages 00:02:45.954 22:40:36 -- setup/common.sh@18 -- # local node= 00:02:45.954 22:40:36 -- setup/common.sh@19 -- # local var val 00:02:45.954 22:40:36 -- setup/common.sh@20 -- # local mem_f mem 00:02:45.954 22:40:36 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:02:45.954 22:40:36 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:02:45.954 22:40:36 -- setup/common.sh@25 -- # [[ -n '' ]] 00:02:45.954 22:40:36 -- setup/common.sh@28 -- # mapfile -t mem 00:02:45.954 22:40:36 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:02:45.954 22:40:36 -- setup/common.sh@31 -- # IFS=': ' 00:02:45.954 22:40:36 -- setup/common.sh@31 -- # read -r var val _ 00:02:45.954 22:40:36 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60541736 kB' 'MemFree: 43325060 kB' 'MemAvailable: 47316304 kB' 'Buffers: 2696 kB' 'Cached: 12518304 kB' 'SwapCached: 0 kB' 'Active: 9330200 kB' 'Inactive: 3655836 kB' 'Active(anon): 8765884 kB' 'Inactive(anon): 0 kB' 'Active(file): 564316 kB' 'Inactive(file): 3655836 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 468352 kB' 'Mapped: 203016 kB' 'Shmem: 8300848 kB' 'KReclaimable: 415528 kB' 'Slab: 807060 kB' 'SReclaimable: 415528 kB' 'SUnreclaim: 391532 kB' 'KernelStack: 12880 kB' 'PageTables: 8828 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37610896 kB' 'Committed_AS: 9914704 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 197228 kB' 'VmallocChunk: 0 kB' 'Percpu: 38592 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 2506332 kB' 'DirectMap2M: 24676352 kB' 'DirectMap1G: 41943040 kB' 00:02:45.954 22:40:36 -- setup/common.sh@32 -- # [[ MemTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:45.954 22:40:36 -- setup/common.sh@32 -- # continue 00:02:45.954 22:40:36 -- setup/common.sh@31 -- # IFS=': ' 00:02:45.954 22:40:36 -- setup/common.sh@31 -- # read -r var val _ 00:02:45.954 22:40:36 -- setup/common.sh@32 -- # [[ MemFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:45.954 22:40:36 -- setup/common.sh@32 -- # continue 00:02:45.954 22:40:36 -- setup/common.sh@31 -- # IFS=': ' 00:02:45.954 22:40:36 -- setup/common.sh@31 -- # read -r var val _ 00:02:45.954 22:40:36 -- setup/common.sh@32 -- # [[ MemAvailable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:45.954 22:40:36 -- setup/common.sh@32 -- # continue 00:02:45.954 22:40:36 -- setup/common.sh@31 -- # IFS=': ' 00:02:45.954 22:40:36 -- setup/common.sh@31 -- # read -r var val _ 00:02:45.954 22:40:36 -- setup/common.sh@32 -- # [[ Buffers == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:45.954 22:40:36 -- setup/common.sh@32 -- # continue 00:02:45.954 22:40:36 -- setup/common.sh@31 -- # IFS=': ' 00:02:45.954 22:40:36 -- setup/common.sh@31 -- # read -r var val _ 00:02:45.954 22:40:36 -- setup/common.sh@32 -- # [[ Cached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:45.954 22:40:36 -- setup/common.sh@32 -- # continue 00:02:45.954 22:40:36 -- setup/common.sh@31 -- # IFS=': ' 00:02:45.954 22:40:36 -- setup/common.sh@31 -- # read -r var val _ 00:02:45.954 22:40:36 -- setup/common.sh@32 -- # [[ SwapCached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:45.954 22:40:36 -- setup/common.sh@32 -- # continue 00:02:45.954 22:40:36 -- setup/common.sh@31 -- # IFS=': ' 00:02:45.954 22:40:36 -- setup/common.sh@31 -- # read -r var val _ 00:02:45.954 22:40:36 -- setup/common.sh@32 -- # [[ Active == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:45.954 22:40:36 -- setup/common.sh@32 -- # continue 00:02:45.954 22:40:36 -- setup/common.sh@31 -- # IFS=': ' 00:02:45.954 22:40:36 -- setup/common.sh@31 -- # read -r var val _ 00:02:45.954 22:40:36 -- setup/common.sh@32 -- # [[ Inactive == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:45.954 22:40:36 -- setup/common.sh@32 -- # continue 00:02:45.954 22:40:36 -- setup/common.sh@31 -- # IFS=': ' 00:02:45.954 22:40:36 -- setup/common.sh@31 -- # read -r var val _ 00:02:45.954 22:40:36 -- setup/common.sh@32 -- # [[ Active(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:45.954 22:40:36 -- setup/common.sh@32 -- # continue 00:02:45.954 22:40:36 -- setup/common.sh@31 -- # IFS=': ' 00:02:45.955 22:40:36 -- setup/common.sh@31 -- # read -r var val _ 00:02:45.955 22:40:36 -- setup/common.sh@32 -- # [[ Inactive(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:45.955 22:40:36 -- setup/common.sh@32 -- # continue 00:02:45.955 22:40:36 -- setup/common.sh@31 -- # IFS=': ' 00:02:45.955 22:40:36 -- setup/common.sh@31 -- # read -r var val _ 00:02:45.955 22:40:36 -- setup/common.sh@32 -- # [[ Active(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:45.955 22:40:36 -- setup/common.sh@32 -- # continue 00:02:45.955 22:40:36 -- setup/common.sh@31 -- # IFS=': ' 00:02:45.955 22:40:36 -- setup/common.sh@31 -- # read -r var val _ 00:02:45.955 22:40:36 -- setup/common.sh@32 -- # [[ Inactive(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:45.955 22:40:36 -- setup/common.sh@32 -- # continue 00:02:45.955 22:40:36 -- setup/common.sh@31 -- # IFS=': ' 00:02:45.955 22:40:36 -- setup/common.sh@31 -- # read -r var val _ 00:02:45.955 22:40:36 -- setup/common.sh@32 -- # [[ Unevictable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:45.955 22:40:36 -- setup/common.sh@32 -- # continue 00:02:45.955 22:40:36 -- setup/common.sh@31 -- # IFS=': ' 00:02:45.955 22:40:36 -- setup/common.sh@31 -- # read -r var val _ 00:02:45.955 22:40:36 -- setup/common.sh@32 -- # [[ Mlocked == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:45.955 22:40:36 -- setup/common.sh@32 -- # continue 00:02:45.955 22:40:36 -- setup/common.sh@31 -- # IFS=': ' 00:02:45.955 22:40:36 -- setup/common.sh@31 -- # read -r var val _ 00:02:45.955 22:40:36 -- setup/common.sh@32 -- # [[ SwapTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:45.955 22:40:36 -- setup/common.sh@32 -- # continue 00:02:45.955 22:40:36 -- setup/common.sh@31 -- # IFS=': ' 00:02:45.955 22:40:36 -- setup/common.sh@31 -- # read -r var val _ 00:02:45.955 22:40:36 -- setup/common.sh@32 -- # [[ SwapFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:45.955 22:40:36 -- setup/common.sh@32 -- # continue 00:02:45.955 22:40:36 -- setup/common.sh@31 -- # IFS=': ' 00:02:45.955 22:40:36 -- setup/common.sh@31 -- # read -r var val _ 00:02:45.955 22:40:36 -- setup/common.sh@32 -- # [[ Zswap == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:45.955 22:40:36 -- setup/common.sh@32 -- # continue 00:02:45.955 22:40:36 -- setup/common.sh@31 -- # IFS=': ' 00:02:45.955 22:40:36 -- setup/common.sh@31 -- # read -r var val _ 00:02:45.955 22:40:36 -- setup/common.sh@32 -- # [[ Zswapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:45.955 22:40:36 -- setup/common.sh@32 -- # continue 00:02:45.955 22:40:36 -- setup/common.sh@31 -- # IFS=': ' 00:02:45.955 22:40:36 -- setup/common.sh@31 -- # read -r var val _ 00:02:45.955 22:40:36 -- setup/common.sh@32 -- # [[ Dirty == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:45.955 22:40:36 -- setup/common.sh@32 -- # continue 00:02:45.955 22:40:36 -- setup/common.sh@31 -- # IFS=': ' 00:02:45.955 22:40:36 -- setup/common.sh@31 -- # read -r var val _ 00:02:45.955 22:40:36 -- setup/common.sh@32 -- # [[ Writeback == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:45.955 22:40:36 -- setup/common.sh@32 -- # continue 00:02:45.955 22:40:36 -- setup/common.sh@31 -- # IFS=': ' 00:02:45.955 22:40:36 -- setup/common.sh@31 -- # read -r var val _ 00:02:45.955 22:40:36 -- setup/common.sh@32 -- # [[ AnonPages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:45.955 22:40:36 -- setup/common.sh@32 -- # continue 00:02:45.955 22:40:36 -- setup/common.sh@31 -- # IFS=': ' 00:02:45.955 22:40:36 -- setup/common.sh@31 -- # read -r var val _ 00:02:45.955 22:40:36 -- setup/common.sh@32 -- # [[ Mapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:45.955 22:40:36 -- setup/common.sh@32 -- # continue 00:02:45.955 22:40:36 -- setup/common.sh@31 -- # IFS=': ' 00:02:45.955 22:40:36 -- setup/common.sh@31 -- # read -r var val _ 00:02:45.955 22:40:36 -- setup/common.sh@32 -- # [[ Shmem == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:45.955 22:40:36 -- setup/common.sh@32 -- # continue 00:02:45.955 22:40:36 -- setup/common.sh@31 -- # IFS=': ' 00:02:45.955 22:40:36 -- setup/common.sh@31 -- # read -r var val _ 00:02:45.955 22:40:36 -- setup/common.sh@32 -- # [[ KReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:45.955 22:40:36 -- setup/common.sh@32 -- # continue 00:02:45.955 22:40:36 -- setup/common.sh@31 -- # IFS=': ' 00:02:45.955 22:40:36 -- setup/common.sh@31 -- # read -r var val _ 00:02:45.955 22:40:36 -- setup/common.sh@32 -- # [[ Slab == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:45.955 22:40:36 -- setup/common.sh@32 -- # continue 00:02:45.955 22:40:36 -- setup/common.sh@31 -- # IFS=': ' 00:02:45.955 22:40:36 -- setup/common.sh@31 -- # read -r var val _ 00:02:45.955 22:40:36 -- setup/common.sh@32 -- # [[ SReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:45.955 22:40:36 -- setup/common.sh@32 -- # continue 00:02:45.955 22:40:36 -- setup/common.sh@31 -- # IFS=': ' 00:02:45.955 22:40:36 -- setup/common.sh@31 -- # read -r var val _ 00:02:45.955 22:40:36 -- setup/common.sh@32 -- # [[ SUnreclaim == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:45.955 22:40:36 -- setup/common.sh@32 -- # continue 00:02:45.955 22:40:36 -- setup/common.sh@31 -- # IFS=': ' 00:02:45.955 22:40:36 -- setup/common.sh@31 -- # read -r var val _ 00:02:45.955 22:40:36 -- setup/common.sh@32 -- # [[ KernelStack == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:45.955 22:40:36 -- setup/common.sh@32 -- # continue 00:02:45.955 22:40:36 -- setup/common.sh@31 -- # IFS=': ' 00:02:45.955 22:40:36 -- setup/common.sh@31 -- # read -r var val _ 00:02:45.955 22:40:36 -- setup/common.sh@32 -- # [[ PageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:45.955 22:40:36 -- setup/common.sh@32 -- # continue 00:02:45.955 22:40:36 -- setup/common.sh@31 -- # IFS=': ' 00:02:45.955 22:40:36 -- setup/common.sh@31 -- # read -r var val _ 00:02:45.955 22:40:36 -- setup/common.sh@32 -- # [[ SecPageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:45.955 22:40:36 -- setup/common.sh@32 -- # continue 00:02:45.955 22:40:36 -- setup/common.sh@31 -- # IFS=': ' 00:02:45.955 22:40:36 -- setup/common.sh@31 -- # read -r var val _ 00:02:45.955 22:40:36 -- setup/common.sh@32 -- # [[ NFS_Unstable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:45.955 22:40:36 -- setup/common.sh@32 -- # continue 00:02:45.955 22:40:36 -- setup/common.sh@31 -- # IFS=': ' 00:02:45.955 22:40:36 -- setup/common.sh@31 -- # read -r var val _ 00:02:45.955 22:40:36 -- setup/common.sh@32 -- # [[ Bounce == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:45.955 22:40:36 -- setup/common.sh@32 -- # continue 00:02:45.955 22:40:36 -- setup/common.sh@31 -- # IFS=': ' 00:02:45.955 22:40:36 -- setup/common.sh@31 -- # read -r var val _ 00:02:45.955 22:40:36 -- setup/common.sh@32 -- # [[ WritebackTmp == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:45.955 22:40:36 -- setup/common.sh@32 -- # continue 00:02:45.955 22:40:36 -- setup/common.sh@31 -- # IFS=': ' 00:02:45.955 22:40:36 -- setup/common.sh@31 -- # read -r var val _ 00:02:45.955 22:40:36 -- setup/common.sh@32 -- # [[ CommitLimit == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:45.955 22:40:36 -- setup/common.sh@32 -- # continue 00:02:45.955 22:40:36 -- setup/common.sh@31 -- # IFS=': ' 00:02:45.955 22:40:36 -- setup/common.sh@31 -- # read -r var val _ 00:02:45.955 22:40:36 -- setup/common.sh@32 -- # [[ Committed_AS == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:45.955 22:40:36 -- setup/common.sh@32 -- # continue 00:02:45.955 22:40:36 -- setup/common.sh@31 -- # IFS=': ' 00:02:45.955 22:40:36 -- setup/common.sh@31 -- # read -r var val _ 00:02:45.955 22:40:36 -- setup/common.sh@32 -- # [[ VmallocTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:45.955 22:40:36 -- setup/common.sh@32 -- # continue 00:02:45.955 22:40:36 -- setup/common.sh@31 -- # IFS=': ' 00:02:45.955 22:40:36 -- setup/common.sh@31 -- # read -r var val _ 00:02:45.955 22:40:36 -- setup/common.sh@32 -- # [[ VmallocUsed == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:45.955 22:40:36 -- setup/common.sh@32 -- # continue 00:02:45.955 22:40:36 -- setup/common.sh@31 -- # IFS=': ' 00:02:45.955 22:40:36 -- setup/common.sh@31 -- # read -r var val _ 00:02:45.955 22:40:36 -- setup/common.sh@32 -- # [[ VmallocChunk == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:45.955 22:40:36 -- setup/common.sh@32 -- # continue 00:02:45.955 22:40:36 -- setup/common.sh@31 -- # IFS=': ' 00:02:45.955 22:40:36 -- setup/common.sh@31 -- # read -r var val _ 00:02:45.955 22:40:36 -- setup/common.sh@32 -- # [[ Percpu == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:45.955 22:40:36 -- setup/common.sh@32 -- # continue 00:02:45.955 22:40:36 -- setup/common.sh@31 -- # IFS=': ' 00:02:45.955 22:40:36 -- setup/common.sh@31 -- # read -r var val _ 00:02:45.955 22:40:36 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:45.955 22:40:36 -- setup/common.sh@32 -- # continue 00:02:45.955 22:40:36 -- setup/common.sh@31 -- # IFS=': ' 00:02:45.955 22:40:36 -- setup/common.sh@31 -- # read -r var val _ 00:02:45.955 22:40:36 -- setup/common.sh@32 -- # [[ AnonHugePages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:45.955 22:40:36 -- setup/common.sh@33 -- # echo 0 00:02:45.955 22:40:36 -- setup/common.sh@33 -- # return 0 00:02:45.955 22:40:36 -- setup/hugepages.sh@97 -- # anon=0 00:02:45.955 22:40:36 -- setup/hugepages.sh@99 -- # get_meminfo HugePages_Surp 00:02:45.955 22:40:36 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:02:45.955 22:40:36 -- setup/common.sh@18 -- # local node= 00:02:45.955 22:40:36 -- setup/common.sh@19 -- # local var val 00:02:45.955 22:40:36 -- setup/common.sh@20 -- # local mem_f mem 00:02:45.955 22:40:36 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:02:45.955 22:40:36 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:02:45.955 22:40:36 -- setup/common.sh@25 -- # [[ -n '' ]] 00:02:45.955 22:40:36 -- setup/common.sh@28 -- # mapfile -t mem 00:02:45.955 22:40:36 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:02:45.955 22:40:36 -- setup/common.sh@31 -- # IFS=': ' 00:02:45.955 22:40:36 -- setup/common.sh@31 -- # read -r var val _ 00:02:45.955 22:40:36 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60541736 kB' 'MemFree: 43322840 kB' 'MemAvailable: 47314084 kB' 'Buffers: 2696 kB' 'Cached: 12518308 kB' 'SwapCached: 0 kB' 'Active: 9333696 kB' 'Inactive: 3655836 kB' 'Active(anon): 8769380 kB' 'Inactive(anon): 0 kB' 'Active(file): 564316 kB' 'Inactive(file): 3655836 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 471784 kB' 'Mapped: 203132 kB' 'Shmem: 8300852 kB' 'KReclaimable: 415528 kB' 'Slab: 807124 kB' 'SReclaimable: 415528 kB' 'SUnreclaim: 391596 kB' 'KernelStack: 12832 kB' 'PageTables: 8676 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37610896 kB' 'Committed_AS: 9917488 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 197164 kB' 'VmallocChunk: 0 kB' 'Percpu: 38592 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 2506332 kB' 'DirectMap2M: 24676352 kB' 'DirectMap1G: 41943040 kB' 00:02:45.955 22:40:36 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:45.955 22:40:36 -- setup/common.sh@32 -- # continue 00:02:45.955 22:40:36 -- setup/common.sh@31 -- # IFS=': ' 00:02:45.955 22:40:36 -- setup/common.sh@31 -- # read -r var val _ 00:02:45.955 22:40:36 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:45.955 22:40:36 -- setup/common.sh@32 -- # continue 00:02:45.955 22:40:36 -- setup/common.sh@31 -- # IFS=': ' 00:02:45.955 22:40:36 -- setup/common.sh@31 -- # read -r var val _ 00:02:45.956 22:40:36 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:45.956 22:40:36 -- setup/common.sh@32 -- # continue 00:02:45.956 22:40:36 -- setup/common.sh@31 -- # IFS=': ' 00:02:45.956 22:40:36 -- setup/common.sh@31 -- # read -r var val _ 00:02:45.956 22:40:36 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:45.956 22:40:36 -- setup/common.sh@32 -- # continue 00:02:45.956 22:40:36 -- setup/common.sh@31 -- # IFS=': ' 00:02:45.956 22:40:36 -- setup/common.sh@31 -- # read -r var val _ 00:02:45.956 22:40:36 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:45.956 22:40:36 -- setup/common.sh@32 -- # continue 00:02:45.956 22:40:36 -- setup/common.sh@31 -- # IFS=': ' 00:02:45.956 22:40:36 -- setup/common.sh@31 -- # read -r var val _ 00:02:45.956 22:40:36 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:45.956 22:40:36 -- setup/common.sh@32 -- # continue 00:02:45.956 22:40:36 -- setup/common.sh@31 -- # IFS=': ' 00:02:45.956 22:40:36 -- setup/common.sh@31 -- # read -r var val _ 00:02:45.956 22:40:36 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:45.956 22:40:36 -- setup/common.sh@32 -- # continue 00:02:45.956 22:40:36 -- setup/common.sh@31 -- # IFS=': ' 00:02:45.956 22:40:36 -- setup/common.sh@31 -- # read -r var val _ 00:02:45.956 22:40:36 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:45.956 22:40:36 -- setup/common.sh@32 -- # continue 00:02:45.956 22:40:36 -- setup/common.sh@31 -- # IFS=': ' 00:02:45.956 22:40:36 -- setup/common.sh@31 -- # read -r var val _ 00:02:45.956 22:40:36 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:45.956 22:40:36 -- setup/common.sh@32 -- # continue 00:02:45.956 22:40:36 -- setup/common.sh@31 -- # IFS=': ' 00:02:45.956 22:40:36 -- setup/common.sh@31 -- # read -r var val _ 00:02:45.956 22:40:36 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:45.956 22:40:36 -- setup/common.sh@32 -- # continue 00:02:45.956 22:40:36 -- setup/common.sh@31 -- # IFS=': ' 00:02:45.956 22:40:36 -- setup/common.sh@31 -- # read -r var val _ 00:02:45.956 22:40:36 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:45.956 22:40:36 -- setup/common.sh@32 -- # continue 00:02:45.956 22:40:36 -- setup/common.sh@31 -- # IFS=': ' 00:02:45.956 22:40:36 -- setup/common.sh@31 -- # read -r var val _ 00:02:45.956 22:40:36 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:45.956 22:40:36 -- setup/common.sh@32 -- # continue 00:02:45.956 22:40:36 -- setup/common.sh@31 -- # IFS=': ' 00:02:45.956 22:40:36 -- setup/common.sh@31 -- # read -r var val _ 00:02:45.956 22:40:36 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:45.956 22:40:36 -- setup/common.sh@32 -- # continue 00:02:45.956 22:40:36 -- setup/common.sh@31 -- # IFS=': ' 00:02:45.956 22:40:36 -- setup/common.sh@31 -- # read -r var val _ 00:02:45.956 22:40:36 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:45.956 22:40:36 -- setup/common.sh@32 -- # continue 00:02:45.956 22:40:36 -- setup/common.sh@31 -- # IFS=': ' 00:02:45.956 22:40:36 -- setup/common.sh@31 -- # read -r var val _ 00:02:45.956 22:40:36 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:45.956 22:40:36 -- setup/common.sh@32 -- # continue 00:02:45.956 22:40:36 -- setup/common.sh@31 -- # IFS=': ' 00:02:45.956 22:40:36 -- setup/common.sh@31 -- # read -r var val _ 00:02:45.956 22:40:36 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:45.956 22:40:36 -- setup/common.sh@32 -- # continue 00:02:45.956 22:40:36 -- setup/common.sh@31 -- # IFS=': ' 00:02:45.956 22:40:36 -- setup/common.sh@31 -- # read -r var val _ 00:02:45.956 22:40:36 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:45.956 22:40:36 -- setup/common.sh@32 -- # continue 00:02:45.956 22:40:36 -- setup/common.sh@31 -- # IFS=': ' 00:02:45.956 22:40:36 -- setup/common.sh@31 -- # read -r var val _ 00:02:45.956 22:40:36 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:45.956 22:40:36 -- setup/common.sh@32 -- # continue 00:02:45.956 22:40:36 -- setup/common.sh@31 -- # IFS=': ' 00:02:45.956 22:40:36 -- setup/common.sh@31 -- # read -r var val _ 00:02:45.956 22:40:36 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:45.956 22:40:36 -- setup/common.sh@32 -- # continue 00:02:45.956 22:40:36 -- setup/common.sh@31 -- # IFS=': ' 00:02:45.956 22:40:36 -- setup/common.sh@31 -- # read -r var val _ 00:02:45.956 22:40:36 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:45.956 22:40:36 -- setup/common.sh@32 -- # continue 00:02:45.956 22:40:36 -- setup/common.sh@31 -- # IFS=': ' 00:02:45.956 22:40:36 -- setup/common.sh@31 -- # read -r var val _ 00:02:45.956 22:40:36 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:45.956 22:40:36 -- setup/common.sh@32 -- # continue 00:02:45.956 22:40:36 -- setup/common.sh@31 -- # IFS=': ' 00:02:45.956 22:40:36 -- setup/common.sh@31 -- # read -r var val _ 00:02:45.956 22:40:36 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:45.956 22:40:36 -- setup/common.sh@32 -- # continue 00:02:45.956 22:40:36 -- setup/common.sh@31 -- # IFS=': ' 00:02:45.956 22:40:36 -- setup/common.sh@31 -- # read -r var val _ 00:02:45.956 22:40:36 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:45.956 22:40:36 -- setup/common.sh@32 -- # continue 00:02:45.956 22:40:36 -- setup/common.sh@31 -- # IFS=': ' 00:02:45.956 22:40:36 -- setup/common.sh@31 -- # read -r var val _ 00:02:45.956 22:40:36 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:45.956 22:40:36 -- setup/common.sh@32 -- # continue 00:02:45.956 22:40:36 -- setup/common.sh@31 -- # IFS=': ' 00:02:45.956 22:40:36 -- setup/common.sh@31 -- # read -r var val _ 00:02:45.956 22:40:36 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:45.956 22:40:36 -- setup/common.sh@32 -- # continue 00:02:45.956 22:40:36 -- setup/common.sh@31 -- # IFS=': ' 00:02:45.956 22:40:36 -- setup/common.sh@31 -- # read -r var val _ 00:02:45.956 22:40:36 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:45.956 22:40:36 -- setup/common.sh@32 -- # continue 00:02:45.956 22:40:36 -- setup/common.sh@31 -- # IFS=': ' 00:02:45.956 22:40:36 -- setup/common.sh@31 -- # read -r var val _ 00:02:45.956 22:40:36 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:45.956 22:40:36 -- setup/common.sh@32 -- # continue 00:02:45.956 22:40:36 -- setup/common.sh@31 -- # IFS=': ' 00:02:45.956 22:40:36 -- setup/common.sh@31 -- # read -r var val _ 00:02:45.956 22:40:36 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:45.956 22:40:36 -- setup/common.sh@32 -- # continue 00:02:45.956 22:40:36 -- setup/common.sh@31 -- # IFS=': ' 00:02:45.956 22:40:36 -- setup/common.sh@31 -- # read -r var val _ 00:02:45.956 22:40:36 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:45.956 22:40:36 -- setup/common.sh@32 -- # continue 00:02:45.956 22:40:36 -- setup/common.sh@31 -- # IFS=': ' 00:02:45.956 22:40:36 -- setup/common.sh@31 -- # read -r var val _ 00:02:45.956 22:40:36 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:45.956 22:40:36 -- setup/common.sh@32 -- # continue 00:02:45.956 22:40:36 -- setup/common.sh@31 -- # IFS=': ' 00:02:45.956 22:40:36 -- setup/common.sh@31 -- # read -r var val _ 00:02:45.956 22:40:36 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:45.956 22:40:36 -- setup/common.sh@32 -- # continue 00:02:45.956 22:40:36 -- setup/common.sh@31 -- # IFS=': ' 00:02:45.956 22:40:36 -- setup/common.sh@31 -- # read -r var val _ 00:02:45.956 22:40:36 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:45.956 22:40:36 -- setup/common.sh@32 -- # continue 00:02:45.956 22:40:36 -- setup/common.sh@31 -- # IFS=': ' 00:02:45.956 22:40:36 -- setup/common.sh@31 -- # read -r var val _ 00:02:45.956 22:40:36 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:45.956 22:40:36 -- setup/common.sh@32 -- # continue 00:02:45.956 22:40:36 -- setup/common.sh@31 -- # IFS=': ' 00:02:45.956 22:40:36 -- setup/common.sh@31 -- # read -r var val _ 00:02:45.956 22:40:36 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:45.956 22:40:36 -- setup/common.sh@32 -- # continue 00:02:45.956 22:40:36 -- setup/common.sh@31 -- # IFS=': ' 00:02:45.956 22:40:36 -- setup/common.sh@31 -- # read -r var val _ 00:02:45.956 22:40:36 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:45.956 22:40:36 -- setup/common.sh@32 -- # continue 00:02:45.956 22:40:36 -- setup/common.sh@31 -- # IFS=': ' 00:02:45.956 22:40:36 -- setup/common.sh@31 -- # read -r var val _ 00:02:45.956 22:40:36 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:45.956 22:40:36 -- setup/common.sh@32 -- # continue 00:02:45.956 22:40:36 -- setup/common.sh@31 -- # IFS=': ' 00:02:45.956 22:40:36 -- setup/common.sh@31 -- # read -r var val _ 00:02:45.956 22:40:36 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:45.956 22:40:36 -- setup/common.sh@32 -- # continue 00:02:45.956 22:40:36 -- setup/common.sh@31 -- # IFS=': ' 00:02:45.956 22:40:36 -- setup/common.sh@31 -- # read -r var val _ 00:02:45.956 22:40:36 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:45.956 22:40:36 -- setup/common.sh@32 -- # continue 00:02:45.956 22:40:36 -- setup/common.sh@31 -- # IFS=': ' 00:02:45.956 22:40:36 -- setup/common.sh@31 -- # read -r var val _ 00:02:45.956 22:40:36 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:45.956 22:40:36 -- setup/common.sh@32 -- # continue 00:02:45.956 22:40:36 -- setup/common.sh@31 -- # IFS=': ' 00:02:45.956 22:40:36 -- setup/common.sh@31 -- # read -r var val _ 00:02:45.956 22:40:36 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:45.956 22:40:36 -- setup/common.sh@32 -- # continue 00:02:45.956 22:40:36 -- setup/common.sh@31 -- # IFS=': ' 00:02:45.956 22:40:36 -- setup/common.sh@31 -- # read -r var val _ 00:02:45.956 22:40:36 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:45.956 22:40:36 -- setup/common.sh@32 -- # continue 00:02:45.956 22:40:36 -- setup/common.sh@31 -- # IFS=': ' 00:02:45.956 22:40:36 -- setup/common.sh@31 -- # read -r var val _ 00:02:45.956 22:40:36 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:45.956 22:40:36 -- setup/common.sh@32 -- # continue 00:02:45.956 22:40:36 -- setup/common.sh@31 -- # IFS=': ' 00:02:45.956 22:40:36 -- setup/common.sh@31 -- # read -r var val _ 00:02:45.956 22:40:36 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:45.956 22:40:36 -- setup/common.sh@32 -- # continue 00:02:45.956 22:40:36 -- setup/common.sh@31 -- # IFS=': ' 00:02:45.956 22:40:36 -- setup/common.sh@31 -- # read -r var val _ 00:02:45.957 22:40:36 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:45.957 22:40:36 -- setup/common.sh@32 -- # continue 00:02:45.957 22:40:36 -- setup/common.sh@31 -- # IFS=': ' 00:02:45.957 22:40:36 -- setup/common.sh@31 -- # read -r var val _ 00:02:45.957 22:40:36 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:45.957 22:40:36 -- setup/common.sh@32 -- # continue 00:02:45.957 22:40:36 -- setup/common.sh@31 -- # IFS=': ' 00:02:45.957 22:40:36 -- setup/common.sh@31 -- # read -r var val _ 00:02:45.957 22:40:36 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:45.957 22:40:36 -- setup/common.sh@32 -- # continue 00:02:45.957 22:40:36 -- setup/common.sh@31 -- # IFS=': ' 00:02:45.957 22:40:36 -- setup/common.sh@31 -- # read -r var val _ 00:02:45.957 22:40:36 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:45.957 22:40:36 -- setup/common.sh@32 -- # continue 00:02:45.957 22:40:36 -- setup/common.sh@31 -- # IFS=': ' 00:02:45.957 22:40:36 -- setup/common.sh@31 -- # read -r var val _ 00:02:45.957 22:40:36 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:45.957 22:40:36 -- setup/common.sh@32 -- # continue 00:02:45.957 22:40:36 -- setup/common.sh@31 -- # IFS=': ' 00:02:45.957 22:40:36 -- setup/common.sh@31 -- # read -r var val _ 00:02:45.957 22:40:36 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:45.957 22:40:36 -- setup/common.sh@32 -- # continue 00:02:45.957 22:40:36 -- setup/common.sh@31 -- # IFS=': ' 00:02:45.957 22:40:36 -- setup/common.sh@31 -- # read -r var val _ 00:02:45.957 22:40:36 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:45.957 22:40:36 -- setup/common.sh@32 -- # continue 00:02:45.957 22:40:36 -- setup/common.sh@31 -- # IFS=': ' 00:02:45.957 22:40:36 -- setup/common.sh@31 -- # read -r var val _ 00:02:45.957 22:40:36 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:45.957 22:40:36 -- setup/common.sh@32 -- # continue 00:02:45.957 22:40:36 -- setup/common.sh@31 -- # IFS=': ' 00:02:45.957 22:40:36 -- setup/common.sh@31 -- # read -r var val _ 00:02:45.957 22:40:36 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:45.957 22:40:36 -- setup/common.sh@33 -- # echo 0 00:02:45.957 22:40:36 -- setup/common.sh@33 -- # return 0 00:02:45.957 22:40:36 -- setup/hugepages.sh@99 -- # surp=0 00:02:45.957 22:40:36 -- setup/hugepages.sh@100 -- # get_meminfo HugePages_Rsvd 00:02:45.957 22:40:36 -- setup/common.sh@17 -- # local get=HugePages_Rsvd 00:02:45.957 22:40:36 -- setup/common.sh@18 -- # local node= 00:02:45.957 22:40:36 -- setup/common.sh@19 -- # local var val 00:02:45.957 22:40:36 -- setup/common.sh@20 -- # local mem_f mem 00:02:45.957 22:40:36 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:02:45.957 22:40:36 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:02:45.957 22:40:36 -- setup/common.sh@25 -- # [[ -n '' ]] 00:02:45.957 22:40:36 -- setup/common.sh@28 -- # mapfile -t mem 00:02:45.957 22:40:36 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:02:45.957 22:40:36 -- setup/common.sh@31 -- # IFS=': ' 00:02:45.957 22:40:36 -- setup/common.sh@31 -- # read -r var val _ 00:02:45.957 22:40:36 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60541736 kB' 'MemFree: 43323428 kB' 'MemAvailable: 47314672 kB' 'Buffers: 2696 kB' 'Cached: 12518316 kB' 'SwapCached: 0 kB' 'Active: 9335076 kB' 'Inactive: 3655836 kB' 'Active(anon): 8770760 kB' 'Inactive(anon): 0 kB' 'Active(file): 564316 kB' 'Inactive(file): 3655836 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 473200 kB' 'Mapped: 203364 kB' 'Shmem: 8300860 kB' 'KReclaimable: 415528 kB' 'Slab: 807108 kB' 'SReclaimable: 415528 kB' 'SUnreclaim: 391580 kB' 'KernelStack: 12880 kB' 'PageTables: 8772 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37610896 kB' 'Committed_AS: 9918968 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 197152 kB' 'VmallocChunk: 0 kB' 'Percpu: 38592 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 2506332 kB' 'DirectMap2M: 24676352 kB' 'DirectMap1G: 41943040 kB' 00:02:45.957 22:40:36 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:45.957 22:40:36 -- setup/common.sh@32 -- # continue 00:02:45.957 22:40:36 -- setup/common.sh@31 -- # IFS=': ' 00:02:45.957 22:40:36 -- setup/common.sh@31 -- # read -r var val _ 00:02:45.957 22:40:36 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:45.957 22:40:36 -- setup/common.sh@32 -- # continue 00:02:45.957 22:40:36 -- setup/common.sh@31 -- # IFS=': ' 00:02:45.957 22:40:36 -- setup/common.sh@31 -- # read -r var val _ 00:02:45.957 22:40:36 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:45.957 22:40:36 -- setup/common.sh@32 -- # continue 00:02:45.957 22:40:36 -- setup/common.sh@31 -- # IFS=': ' 00:02:45.957 22:40:36 -- setup/common.sh@31 -- # read -r var val _ 00:02:45.957 22:40:36 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:45.957 22:40:36 -- setup/common.sh@32 -- # continue 00:02:45.957 22:40:36 -- setup/common.sh@31 -- # IFS=': ' 00:02:45.957 22:40:36 -- setup/common.sh@31 -- # read -r var val _ 00:02:45.957 22:40:36 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:45.957 22:40:36 -- setup/common.sh@32 -- # continue 00:02:45.957 22:40:36 -- setup/common.sh@31 -- # IFS=': ' 00:02:45.957 22:40:36 -- setup/common.sh@31 -- # read -r var val _ 00:02:45.957 22:40:36 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:45.957 22:40:36 -- setup/common.sh@32 -- # continue 00:02:45.957 22:40:36 -- setup/common.sh@31 -- # IFS=': ' 00:02:45.957 22:40:36 -- setup/common.sh@31 -- # read -r var val _ 00:02:45.957 22:40:36 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:45.957 22:40:36 -- setup/common.sh@32 -- # continue 00:02:45.957 22:40:36 -- setup/common.sh@31 -- # IFS=': ' 00:02:45.957 22:40:36 -- setup/common.sh@31 -- # read -r var val _ 00:02:45.957 22:40:36 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:45.957 22:40:36 -- setup/common.sh@32 -- # continue 00:02:45.957 22:40:36 -- setup/common.sh@31 -- # IFS=': ' 00:02:45.957 22:40:36 -- setup/common.sh@31 -- # read -r var val _ 00:02:45.957 22:40:36 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:45.957 22:40:36 -- setup/common.sh@32 -- # continue 00:02:45.957 22:40:36 -- setup/common.sh@31 -- # IFS=': ' 00:02:45.957 22:40:36 -- setup/common.sh@31 -- # read -r var val _ 00:02:45.957 22:40:36 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:45.957 22:40:36 -- setup/common.sh@32 -- # continue 00:02:45.957 22:40:36 -- setup/common.sh@31 -- # IFS=': ' 00:02:45.957 22:40:36 -- setup/common.sh@31 -- # read -r var val _ 00:02:45.957 22:40:36 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:45.957 22:40:36 -- setup/common.sh@32 -- # continue 00:02:45.957 22:40:36 -- setup/common.sh@31 -- # IFS=': ' 00:02:45.957 22:40:36 -- setup/common.sh@31 -- # read -r var val _ 00:02:45.957 22:40:36 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:45.957 22:40:36 -- setup/common.sh@32 -- # continue 00:02:45.957 22:40:36 -- setup/common.sh@31 -- # IFS=': ' 00:02:45.957 22:40:36 -- setup/common.sh@31 -- # read -r var val _ 00:02:45.957 22:40:36 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:45.957 22:40:36 -- setup/common.sh@32 -- # continue 00:02:45.957 22:40:36 -- setup/common.sh@31 -- # IFS=': ' 00:02:45.957 22:40:36 -- setup/common.sh@31 -- # read -r var val _ 00:02:45.957 22:40:36 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:45.957 22:40:36 -- setup/common.sh@32 -- # continue 00:02:45.957 22:40:36 -- setup/common.sh@31 -- # IFS=': ' 00:02:45.957 22:40:36 -- setup/common.sh@31 -- # read -r var val _ 00:02:45.957 22:40:36 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:45.957 22:40:36 -- setup/common.sh@32 -- # continue 00:02:45.957 22:40:36 -- setup/common.sh@31 -- # IFS=': ' 00:02:45.957 22:40:36 -- setup/common.sh@31 -- # read -r var val _ 00:02:45.957 22:40:36 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:45.957 22:40:36 -- setup/common.sh@32 -- # continue 00:02:45.957 22:40:36 -- setup/common.sh@31 -- # IFS=': ' 00:02:45.957 22:40:36 -- setup/common.sh@31 -- # read -r var val _ 00:02:45.957 22:40:36 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:45.957 22:40:36 -- setup/common.sh@32 -- # continue 00:02:45.957 22:40:36 -- setup/common.sh@31 -- # IFS=': ' 00:02:45.957 22:40:36 -- setup/common.sh@31 -- # read -r var val _ 00:02:45.957 22:40:36 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:45.957 22:40:36 -- setup/common.sh@32 -- # continue 00:02:45.957 22:40:36 -- setup/common.sh@31 -- # IFS=': ' 00:02:45.957 22:40:36 -- setup/common.sh@31 -- # read -r var val _ 00:02:45.957 22:40:36 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:45.957 22:40:36 -- setup/common.sh@32 -- # continue 00:02:45.957 22:40:36 -- setup/common.sh@31 -- # IFS=': ' 00:02:45.957 22:40:36 -- setup/common.sh@31 -- # read -r var val _ 00:02:45.957 22:40:36 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:45.957 22:40:36 -- setup/common.sh@32 -- # continue 00:02:45.957 22:40:36 -- setup/common.sh@31 -- # IFS=': ' 00:02:45.957 22:40:36 -- setup/common.sh@31 -- # read -r var val _ 00:02:45.957 22:40:36 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:45.957 22:40:36 -- setup/common.sh@32 -- # continue 00:02:45.957 22:40:36 -- setup/common.sh@31 -- # IFS=': ' 00:02:45.957 22:40:36 -- setup/common.sh@31 -- # read -r var val _ 00:02:45.957 22:40:36 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:45.957 22:40:36 -- setup/common.sh@32 -- # continue 00:02:45.957 22:40:36 -- setup/common.sh@31 -- # IFS=': ' 00:02:45.957 22:40:36 -- setup/common.sh@31 -- # read -r var val _ 00:02:45.957 22:40:36 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:45.957 22:40:36 -- setup/common.sh@32 -- # continue 00:02:45.957 22:40:36 -- setup/common.sh@31 -- # IFS=': ' 00:02:45.957 22:40:36 -- setup/common.sh@31 -- # read -r var val _ 00:02:45.957 22:40:36 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:45.957 22:40:36 -- setup/common.sh@32 -- # continue 00:02:45.957 22:40:36 -- setup/common.sh@31 -- # IFS=': ' 00:02:45.957 22:40:36 -- setup/common.sh@31 -- # read -r var val _ 00:02:45.957 22:40:36 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:45.957 22:40:36 -- setup/common.sh@32 -- # continue 00:02:45.957 22:40:36 -- setup/common.sh@31 -- # IFS=': ' 00:02:45.957 22:40:36 -- setup/common.sh@31 -- # read -r var val _ 00:02:45.958 22:40:36 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:45.958 22:40:36 -- setup/common.sh@32 -- # continue 00:02:45.958 22:40:36 -- setup/common.sh@31 -- # IFS=': ' 00:02:45.958 22:40:36 -- setup/common.sh@31 -- # read -r var val _ 00:02:45.958 22:40:36 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:45.958 22:40:36 -- setup/common.sh@32 -- # continue 00:02:45.958 22:40:36 -- setup/common.sh@31 -- # IFS=': ' 00:02:45.958 22:40:36 -- setup/common.sh@31 -- # read -r var val _ 00:02:45.958 22:40:36 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:45.958 22:40:36 -- setup/common.sh@32 -- # continue 00:02:45.958 22:40:36 -- setup/common.sh@31 -- # IFS=': ' 00:02:45.958 22:40:36 -- setup/common.sh@31 -- # read -r var val _ 00:02:45.958 22:40:36 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:45.958 22:40:36 -- setup/common.sh@32 -- # continue 00:02:45.958 22:40:36 -- setup/common.sh@31 -- # IFS=': ' 00:02:45.958 22:40:36 -- setup/common.sh@31 -- # read -r var val _ 00:02:45.958 22:40:36 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:45.958 22:40:36 -- setup/common.sh@32 -- # continue 00:02:45.958 22:40:36 -- setup/common.sh@31 -- # IFS=': ' 00:02:45.958 22:40:36 -- setup/common.sh@31 -- # read -r var val _ 00:02:45.958 22:40:36 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:45.958 22:40:36 -- setup/common.sh@32 -- # continue 00:02:45.958 22:40:36 -- setup/common.sh@31 -- # IFS=': ' 00:02:45.958 22:40:36 -- setup/common.sh@31 -- # read -r var val _ 00:02:45.958 22:40:36 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:45.958 22:40:36 -- setup/common.sh@32 -- # continue 00:02:45.958 22:40:36 -- setup/common.sh@31 -- # IFS=': ' 00:02:45.958 22:40:36 -- setup/common.sh@31 -- # read -r var val _ 00:02:45.958 22:40:36 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:45.958 22:40:36 -- setup/common.sh@32 -- # continue 00:02:45.958 22:40:36 -- setup/common.sh@31 -- # IFS=': ' 00:02:45.958 22:40:36 -- setup/common.sh@31 -- # read -r var val _ 00:02:45.958 22:40:36 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:45.958 22:40:36 -- setup/common.sh@32 -- # continue 00:02:45.958 22:40:36 -- setup/common.sh@31 -- # IFS=': ' 00:02:45.958 22:40:36 -- setup/common.sh@31 -- # read -r var val _ 00:02:45.958 22:40:36 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:45.958 22:40:36 -- setup/common.sh@32 -- # continue 00:02:45.958 22:40:36 -- setup/common.sh@31 -- # IFS=': ' 00:02:45.958 22:40:36 -- setup/common.sh@31 -- # read -r var val _ 00:02:45.958 22:40:36 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:45.958 22:40:36 -- setup/common.sh@32 -- # continue 00:02:45.958 22:40:36 -- setup/common.sh@31 -- # IFS=': ' 00:02:45.958 22:40:36 -- setup/common.sh@31 -- # read -r var val _ 00:02:45.958 22:40:36 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:45.958 22:40:36 -- setup/common.sh@32 -- # continue 00:02:45.958 22:40:36 -- setup/common.sh@31 -- # IFS=': ' 00:02:45.958 22:40:36 -- setup/common.sh@31 -- # read -r var val _ 00:02:45.958 22:40:36 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:45.958 22:40:36 -- setup/common.sh@32 -- # continue 00:02:45.958 22:40:36 -- setup/common.sh@31 -- # IFS=': ' 00:02:45.958 22:40:36 -- setup/common.sh@31 -- # read -r var val _ 00:02:45.958 22:40:36 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:45.958 22:40:36 -- setup/common.sh@32 -- # continue 00:02:45.958 22:40:36 -- setup/common.sh@31 -- # IFS=': ' 00:02:45.958 22:40:36 -- setup/common.sh@31 -- # read -r var val _ 00:02:45.958 22:40:36 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:45.958 22:40:36 -- setup/common.sh@32 -- # continue 00:02:45.958 22:40:36 -- setup/common.sh@31 -- # IFS=': ' 00:02:45.958 22:40:36 -- setup/common.sh@31 -- # read -r var val _ 00:02:45.958 22:40:36 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:45.958 22:40:36 -- setup/common.sh@32 -- # continue 00:02:45.958 22:40:36 -- setup/common.sh@31 -- # IFS=': ' 00:02:45.958 22:40:36 -- setup/common.sh@31 -- # read -r var val _ 00:02:45.958 22:40:36 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:45.958 22:40:36 -- setup/common.sh@32 -- # continue 00:02:45.958 22:40:36 -- setup/common.sh@31 -- # IFS=': ' 00:02:45.958 22:40:36 -- setup/common.sh@31 -- # read -r var val _ 00:02:45.958 22:40:36 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:45.958 22:40:36 -- setup/common.sh@32 -- # continue 00:02:45.958 22:40:36 -- setup/common.sh@31 -- # IFS=': ' 00:02:45.958 22:40:36 -- setup/common.sh@31 -- # read -r var val _ 00:02:45.958 22:40:36 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:45.958 22:40:36 -- setup/common.sh@32 -- # continue 00:02:45.958 22:40:36 -- setup/common.sh@31 -- # IFS=': ' 00:02:45.958 22:40:36 -- setup/common.sh@31 -- # read -r var val _ 00:02:45.958 22:40:36 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:45.958 22:40:36 -- setup/common.sh@32 -- # continue 00:02:45.958 22:40:36 -- setup/common.sh@31 -- # IFS=': ' 00:02:45.958 22:40:36 -- setup/common.sh@31 -- # read -r var val _ 00:02:45.958 22:40:36 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:45.958 22:40:36 -- setup/common.sh@32 -- # continue 00:02:45.958 22:40:36 -- setup/common.sh@31 -- # IFS=': ' 00:02:45.958 22:40:36 -- setup/common.sh@31 -- # read -r var val _ 00:02:45.958 22:40:36 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:45.958 22:40:36 -- setup/common.sh@32 -- # continue 00:02:45.958 22:40:36 -- setup/common.sh@31 -- # IFS=': ' 00:02:45.958 22:40:36 -- setup/common.sh@31 -- # read -r var val _ 00:02:45.958 22:40:36 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:45.958 22:40:36 -- setup/common.sh@32 -- # continue 00:02:45.958 22:40:36 -- setup/common.sh@31 -- # IFS=': ' 00:02:45.958 22:40:36 -- setup/common.sh@31 -- # read -r var val _ 00:02:45.958 22:40:36 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:45.958 22:40:36 -- setup/common.sh@32 -- # continue 00:02:45.958 22:40:36 -- setup/common.sh@31 -- # IFS=': ' 00:02:45.958 22:40:36 -- setup/common.sh@31 -- # read -r var val _ 00:02:45.958 22:40:36 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:45.958 22:40:36 -- setup/common.sh@32 -- # continue 00:02:45.958 22:40:36 -- setup/common.sh@31 -- # IFS=': ' 00:02:45.958 22:40:36 -- setup/common.sh@31 -- # read -r var val _ 00:02:45.958 22:40:36 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:45.958 22:40:36 -- setup/common.sh@33 -- # echo 0 00:02:45.958 22:40:36 -- setup/common.sh@33 -- # return 0 00:02:45.958 22:40:36 -- setup/hugepages.sh@100 -- # resv=0 00:02:45.958 22:40:36 -- setup/hugepages.sh@102 -- # echo nr_hugepages=1024 00:02:45.958 nr_hugepages=1024 00:02:45.958 22:40:36 -- setup/hugepages.sh@103 -- # echo resv_hugepages=0 00:02:45.958 resv_hugepages=0 00:02:45.958 22:40:36 -- setup/hugepages.sh@104 -- # echo surplus_hugepages=0 00:02:45.958 surplus_hugepages=0 00:02:45.958 22:40:36 -- setup/hugepages.sh@105 -- # echo anon_hugepages=0 00:02:45.958 anon_hugepages=0 00:02:45.958 22:40:36 -- setup/hugepages.sh@107 -- # (( 1024 == nr_hugepages + surp + resv )) 00:02:45.958 22:40:36 -- setup/hugepages.sh@109 -- # (( 1024 == nr_hugepages )) 00:02:45.958 22:40:36 -- setup/hugepages.sh@110 -- # get_meminfo HugePages_Total 00:02:45.958 22:40:36 -- setup/common.sh@17 -- # local get=HugePages_Total 00:02:45.958 22:40:36 -- setup/common.sh@18 -- # local node= 00:02:45.958 22:40:36 -- setup/common.sh@19 -- # local var val 00:02:45.958 22:40:36 -- setup/common.sh@20 -- # local mem_f mem 00:02:45.958 22:40:36 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:02:45.958 22:40:36 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:02:45.958 22:40:36 -- setup/common.sh@25 -- # [[ -n '' ]] 00:02:45.958 22:40:36 -- setup/common.sh@28 -- # mapfile -t mem 00:02:45.958 22:40:36 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:02:45.958 22:40:36 -- setup/common.sh@31 -- # IFS=': ' 00:02:45.958 22:40:36 -- setup/common.sh@31 -- # read -r var val _ 00:02:45.958 22:40:36 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60541736 kB' 'MemFree: 43323756 kB' 'MemAvailable: 47315000 kB' 'Buffers: 2696 kB' 'Cached: 12518332 kB' 'SwapCached: 0 kB' 'Active: 9329412 kB' 'Inactive: 3655836 kB' 'Active(anon): 8765096 kB' 'Inactive(anon): 0 kB' 'Active(file): 564316 kB' 'Inactive(file): 3655836 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 467548 kB' 'Mapped: 202928 kB' 'Shmem: 8300876 kB' 'KReclaimable: 415528 kB' 'Slab: 807108 kB' 'SReclaimable: 415528 kB' 'SUnreclaim: 391580 kB' 'KernelStack: 12880 kB' 'PageTables: 8780 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37610896 kB' 'Committed_AS: 9912860 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 197164 kB' 'VmallocChunk: 0 kB' 'Percpu: 38592 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 2506332 kB' 'DirectMap2M: 24676352 kB' 'DirectMap1G: 41943040 kB' 00:02:45.958 22:40:36 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:45.958 22:40:36 -- setup/common.sh@32 -- # continue 00:02:45.958 22:40:36 -- setup/common.sh@31 -- # IFS=': ' 00:02:45.958 22:40:36 -- setup/common.sh@31 -- # read -r var val _ 00:02:45.958 22:40:36 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:45.958 22:40:36 -- setup/common.sh@32 -- # continue 00:02:45.958 22:40:36 -- setup/common.sh@31 -- # IFS=': ' 00:02:45.958 22:40:36 -- setup/common.sh@31 -- # read -r var val _ 00:02:45.958 22:40:36 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:45.958 22:40:36 -- setup/common.sh@32 -- # continue 00:02:45.958 22:40:36 -- setup/common.sh@31 -- # IFS=': ' 00:02:45.958 22:40:36 -- setup/common.sh@31 -- # read -r var val _ 00:02:45.958 22:40:36 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:45.958 22:40:36 -- setup/common.sh@32 -- # continue 00:02:45.958 22:40:36 -- setup/common.sh@31 -- # IFS=': ' 00:02:45.958 22:40:36 -- setup/common.sh@31 -- # read -r var val _ 00:02:45.958 22:40:36 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:45.958 22:40:36 -- setup/common.sh@32 -- # continue 00:02:45.958 22:40:36 -- setup/common.sh@31 -- # IFS=': ' 00:02:45.958 22:40:36 -- setup/common.sh@31 -- # read -r var val _ 00:02:45.958 22:40:36 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:45.959 22:40:36 -- setup/common.sh@32 -- # continue 00:02:45.959 22:40:36 -- setup/common.sh@31 -- # IFS=': ' 00:02:45.959 22:40:36 -- setup/common.sh@31 -- # read -r var val _ 00:02:45.959 22:40:36 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:45.959 22:40:36 -- setup/common.sh@32 -- # continue 00:02:45.959 22:40:36 -- setup/common.sh@31 -- # IFS=': ' 00:02:45.959 22:40:36 -- setup/common.sh@31 -- # read -r var val _ 00:02:45.959 22:40:36 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:45.959 22:40:36 -- setup/common.sh@32 -- # continue 00:02:45.959 22:40:36 -- setup/common.sh@31 -- # IFS=': ' 00:02:45.959 22:40:36 -- setup/common.sh@31 -- # read -r var val _ 00:02:45.959 22:40:36 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:45.959 22:40:36 -- setup/common.sh@32 -- # continue 00:02:45.959 22:40:36 -- setup/common.sh@31 -- # IFS=': ' 00:02:45.959 22:40:36 -- setup/common.sh@31 -- # read -r var val _ 00:02:45.959 22:40:36 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:45.959 22:40:36 -- setup/common.sh@32 -- # continue 00:02:45.959 22:40:36 -- setup/common.sh@31 -- # IFS=': ' 00:02:45.959 22:40:36 -- setup/common.sh@31 -- # read -r var val _ 00:02:45.959 22:40:36 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:45.959 22:40:36 -- setup/common.sh@32 -- # continue 00:02:45.959 22:40:36 -- setup/common.sh@31 -- # IFS=': ' 00:02:45.959 22:40:36 -- setup/common.sh@31 -- # read -r var val _ 00:02:45.959 22:40:36 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:45.959 22:40:36 -- setup/common.sh@32 -- # continue 00:02:45.959 22:40:36 -- setup/common.sh@31 -- # IFS=': ' 00:02:45.959 22:40:36 -- setup/common.sh@31 -- # read -r var val _ 00:02:45.959 22:40:36 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:45.959 22:40:36 -- setup/common.sh@32 -- # continue 00:02:45.959 22:40:36 -- setup/common.sh@31 -- # IFS=': ' 00:02:45.959 22:40:36 -- setup/common.sh@31 -- # read -r var val _ 00:02:45.959 22:40:36 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:45.959 22:40:36 -- setup/common.sh@32 -- # continue 00:02:45.959 22:40:36 -- setup/common.sh@31 -- # IFS=': ' 00:02:45.959 22:40:36 -- setup/common.sh@31 -- # read -r var val _ 00:02:45.959 22:40:36 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:45.959 22:40:36 -- setup/common.sh@32 -- # continue 00:02:45.959 22:40:36 -- setup/common.sh@31 -- # IFS=': ' 00:02:45.959 22:40:36 -- setup/common.sh@31 -- # read -r var val _ 00:02:45.959 22:40:36 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:45.959 22:40:36 -- setup/common.sh@32 -- # continue 00:02:45.959 22:40:36 -- setup/common.sh@31 -- # IFS=': ' 00:02:45.959 22:40:36 -- setup/common.sh@31 -- # read -r var val _ 00:02:45.959 22:40:36 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:45.959 22:40:36 -- setup/common.sh@32 -- # continue 00:02:45.959 22:40:36 -- setup/common.sh@31 -- # IFS=': ' 00:02:45.959 22:40:36 -- setup/common.sh@31 -- # read -r var val _ 00:02:45.959 22:40:36 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:45.959 22:40:36 -- setup/common.sh@32 -- # continue 00:02:45.959 22:40:36 -- setup/common.sh@31 -- # IFS=': ' 00:02:45.959 22:40:36 -- setup/common.sh@31 -- # read -r var val _ 00:02:45.959 22:40:36 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:45.959 22:40:36 -- setup/common.sh@32 -- # continue 00:02:45.959 22:40:36 -- setup/common.sh@31 -- # IFS=': ' 00:02:45.959 22:40:36 -- setup/common.sh@31 -- # read -r var val _ 00:02:45.959 22:40:36 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:45.959 22:40:36 -- setup/common.sh@32 -- # continue 00:02:45.959 22:40:36 -- setup/common.sh@31 -- # IFS=': ' 00:02:45.959 22:40:36 -- setup/common.sh@31 -- # read -r var val _ 00:02:45.959 22:40:36 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:45.959 22:40:36 -- setup/common.sh@32 -- # continue 00:02:45.959 22:40:36 -- setup/common.sh@31 -- # IFS=': ' 00:02:45.959 22:40:36 -- setup/common.sh@31 -- # read -r var val _ 00:02:45.959 22:40:36 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:45.959 22:40:36 -- setup/common.sh@32 -- # continue 00:02:45.959 22:40:36 -- setup/common.sh@31 -- # IFS=': ' 00:02:45.959 22:40:36 -- setup/common.sh@31 -- # read -r var val _ 00:02:45.959 22:40:36 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:45.959 22:40:36 -- setup/common.sh@32 -- # continue 00:02:45.959 22:40:36 -- setup/common.sh@31 -- # IFS=': ' 00:02:45.959 22:40:36 -- setup/common.sh@31 -- # read -r var val _ 00:02:45.959 22:40:36 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:45.959 22:40:36 -- setup/common.sh@32 -- # continue 00:02:45.959 22:40:36 -- setup/common.sh@31 -- # IFS=': ' 00:02:45.959 22:40:36 -- setup/common.sh@31 -- # read -r var val _ 00:02:45.959 22:40:36 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:45.959 22:40:36 -- setup/common.sh@32 -- # continue 00:02:45.959 22:40:36 -- setup/common.sh@31 -- # IFS=': ' 00:02:45.959 22:40:36 -- setup/common.sh@31 -- # read -r var val _ 00:02:45.959 22:40:36 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:45.959 22:40:36 -- setup/common.sh@32 -- # continue 00:02:45.959 22:40:36 -- setup/common.sh@31 -- # IFS=': ' 00:02:45.959 22:40:36 -- setup/common.sh@31 -- # read -r var val _ 00:02:45.959 22:40:36 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:45.959 22:40:36 -- setup/common.sh@32 -- # continue 00:02:45.959 22:40:36 -- setup/common.sh@31 -- # IFS=': ' 00:02:45.959 22:40:36 -- setup/common.sh@31 -- # read -r var val _ 00:02:45.959 22:40:36 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:45.959 22:40:36 -- setup/common.sh@32 -- # continue 00:02:45.959 22:40:36 -- setup/common.sh@31 -- # IFS=': ' 00:02:45.959 22:40:36 -- setup/common.sh@31 -- # read -r var val _ 00:02:45.959 22:40:36 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:45.959 22:40:36 -- setup/common.sh@32 -- # continue 00:02:45.959 22:40:36 -- setup/common.sh@31 -- # IFS=': ' 00:02:45.959 22:40:36 -- setup/common.sh@31 -- # read -r var val _ 00:02:45.959 22:40:36 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:45.959 22:40:36 -- setup/common.sh@32 -- # continue 00:02:45.959 22:40:36 -- setup/common.sh@31 -- # IFS=': ' 00:02:45.959 22:40:37 -- setup/common.sh@31 -- # read -r var val _ 00:02:45.959 22:40:37 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:45.959 22:40:37 -- setup/common.sh@32 -- # continue 00:02:45.959 22:40:37 -- setup/common.sh@31 -- # IFS=': ' 00:02:45.959 22:40:37 -- setup/common.sh@31 -- # read -r var val _ 00:02:45.959 22:40:37 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:45.959 22:40:37 -- setup/common.sh@32 -- # continue 00:02:45.959 22:40:37 -- setup/common.sh@31 -- # IFS=': ' 00:02:45.959 22:40:37 -- setup/common.sh@31 -- # read -r var val _ 00:02:45.959 22:40:37 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:45.959 22:40:37 -- setup/common.sh@32 -- # continue 00:02:45.959 22:40:37 -- setup/common.sh@31 -- # IFS=': ' 00:02:45.959 22:40:37 -- setup/common.sh@31 -- # read -r var val _ 00:02:45.959 22:40:37 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:45.959 22:40:37 -- setup/common.sh@32 -- # continue 00:02:45.959 22:40:37 -- setup/common.sh@31 -- # IFS=': ' 00:02:45.959 22:40:37 -- setup/common.sh@31 -- # read -r var val _ 00:02:45.959 22:40:37 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:45.959 22:40:37 -- setup/common.sh@32 -- # continue 00:02:45.959 22:40:37 -- setup/common.sh@31 -- # IFS=': ' 00:02:45.959 22:40:37 -- setup/common.sh@31 -- # read -r var val _ 00:02:45.959 22:40:37 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:45.959 22:40:37 -- setup/common.sh@32 -- # continue 00:02:45.959 22:40:37 -- setup/common.sh@31 -- # IFS=': ' 00:02:45.959 22:40:37 -- setup/common.sh@31 -- # read -r var val _ 00:02:45.959 22:40:37 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:45.959 22:40:37 -- setup/common.sh@32 -- # continue 00:02:45.959 22:40:37 -- setup/common.sh@31 -- # IFS=': ' 00:02:45.959 22:40:37 -- setup/common.sh@31 -- # read -r var val _ 00:02:45.959 22:40:37 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:45.959 22:40:37 -- setup/common.sh@32 -- # continue 00:02:45.959 22:40:37 -- setup/common.sh@31 -- # IFS=': ' 00:02:45.959 22:40:37 -- setup/common.sh@31 -- # read -r var val _ 00:02:45.959 22:40:37 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:45.959 22:40:37 -- setup/common.sh@32 -- # continue 00:02:45.959 22:40:37 -- setup/common.sh@31 -- # IFS=': ' 00:02:45.959 22:40:37 -- setup/common.sh@31 -- # read -r var val _ 00:02:45.960 22:40:37 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:45.960 22:40:37 -- setup/common.sh@32 -- # continue 00:02:45.960 22:40:37 -- setup/common.sh@31 -- # IFS=': ' 00:02:45.960 22:40:37 -- setup/common.sh@31 -- # read -r var val _ 00:02:45.960 22:40:37 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:45.960 22:40:37 -- setup/common.sh@32 -- # continue 00:02:45.960 22:40:37 -- setup/common.sh@31 -- # IFS=': ' 00:02:45.960 22:40:37 -- setup/common.sh@31 -- # read -r var val _ 00:02:45.960 22:40:37 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:45.960 22:40:37 -- setup/common.sh@32 -- # continue 00:02:45.960 22:40:37 -- setup/common.sh@31 -- # IFS=': ' 00:02:45.960 22:40:37 -- setup/common.sh@31 -- # read -r var val _ 00:02:45.960 22:40:37 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:45.960 22:40:37 -- setup/common.sh@32 -- # continue 00:02:45.960 22:40:37 -- setup/common.sh@31 -- # IFS=': ' 00:02:45.960 22:40:37 -- setup/common.sh@31 -- # read -r var val _ 00:02:45.960 22:40:37 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:45.960 22:40:37 -- setup/common.sh@32 -- # continue 00:02:45.960 22:40:37 -- setup/common.sh@31 -- # IFS=': ' 00:02:45.960 22:40:37 -- setup/common.sh@31 -- # read -r var val _ 00:02:45.960 22:40:37 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:45.960 22:40:37 -- setup/common.sh@32 -- # continue 00:02:45.960 22:40:37 -- setup/common.sh@31 -- # IFS=': ' 00:02:45.960 22:40:37 -- setup/common.sh@31 -- # read -r var val _ 00:02:45.960 22:40:37 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:45.960 22:40:37 -- setup/common.sh@32 -- # continue 00:02:45.960 22:40:37 -- setup/common.sh@31 -- # IFS=': ' 00:02:45.960 22:40:37 -- setup/common.sh@31 -- # read -r var val _ 00:02:45.960 22:40:37 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:45.960 22:40:37 -- setup/common.sh@32 -- # continue 00:02:45.960 22:40:37 -- setup/common.sh@31 -- # IFS=': ' 00:02:45.960 22:40:37 -- setup/common.sh@31 -- # read -r var val _ 00:02:45.960 22:40:37 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:45.960 22:40:37 -- setup/common.sh@32 -- # continue 00:02:45.960 22:40:37 -- setup/common.sh@31 -- # IFS=': ' 00:02:45.960 22:40:37 -- setup/common.sh@31 -- # read -r var val _ 00:02:45.960 22:40:37 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:45.960 22:40:37 -- setup/common.sh@33 -- # echo 1024 00:02:45.960 22:40:37 -- setup/common.sh@33 -- # return 0 00:02:45.960 22:40:37 -- setup/hugepages.sh@110 -- # (( 1024 == nr_hugepages + surp + resv )) 00:02:45.960 22:40:37 -- setup/hugepages.sh@112 -- # get_nodes 00:02:45.960 22:40:37 -- setup/hugepages.sh@27 -- # local node 00:02:45.960 22:40:37 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:02:45.960 22:40:37 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=512 00:02:45.960 22:40:37 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:02:45.960 22:40:37 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=512 00:02:45.960 22:40:37 -- setup/hugepages.sh@32 -- # no_nodes=2 00:02:45.960 22:40:37 -- setup/hugepages.sh@33 -- # (( no_nodes > 0 )) 00:02:45.960 22:40:37 -- setup/hugepages.sh@115 -- # for node in "${!nodes_test[@]}" 00:02:45.960 22:40:37 -- setup/hugepages.sh@116 -- # (( nodes_test[node] += resv )) 00:02:45.960 22:40:37 -- setup/hugepages.sh@117 -- # get_meminfo HugePages_Surp 0 00:02:45.960 22:40:37 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:02:45.960 22:40:37 -- setup/common.sh@18 -- # local node=0 00:02:45.960 22:40:37 -- setup/common.sh@19 -- # local var val 00:02:45.960 22:40:37 -- setup/common.sh@20 -- # local mem_f mem 00:02:45.960 22:40:37 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:02:45.960 22:40:37 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node0/meminfo ]] 00:02:45.960 22:40:37 -- setup/common.sh@24 -- # mem_f=/sys/devices/system/node/node0/meminfo 00:02:45.960 22:40:37 -- setup/common.sh@28 -- # mapfile -t mem 00:02:45.960 22:40:37 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:02:45.960 22:40:37 -- setup/common.sh@31 -- # IFS=': ' 00:02:45.960 22:40:37 -- setup/common.sh@31 -- # read -r var val _ 00:02:45.960 22:40:37 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 32829884 kB' 'MemFree: 20141576 kB' 'MemUsed: 12688308 kB' 'SwapCached: 0 kB' 'Active: 7000780 kB' 'Inactive: 3490860 kB' 'Active(anon): 6619568 kB' 'Inactive(anon): 0 kB' 'Active(file): 381212 kB' 'Inactive(file): 3490860 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'FilePages: 10244148 kB' 'Mapped: 157372 kB' 'AnonPages: 250700 kB' 'Shmem: 6372076 kB' 'KernelStack: 6616 kB' 'PageTables: 4612 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'KReclaimable: 272444 kB' 'Slab: 484820 kB' 'SReclaimable: 272444 kB' 'SUnreclaim: 212376 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 512' 'HugePages_Free: 512' 'HugePages_Surp: 0' 00:02:45.960 22:40:37 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:45.960 22:40:37 -- setup/common.sh@32 -- # continue 00:02:45.960 22:40:37 -- setup/common.sh@31 -- # IFS=': ' 00:02:45.960 22:40:37 -- setup/common.sh@31 -- # read -r var val _ 00:02:45.960 22:40:37 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:45.960 22:40:37 -- setup/common.sh@32 -- # continue 00:02:45.960 22:40:37 -- setup/common.sh@31 -- # IFS=': ' 00:02:45.960 22:40:37 -- setup/common.sh@31 -- # read -r var val _ 00:02:45.960 22:40:37 -- setup/common.sh@32 -- # [[ MemUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:45.960 22:40:37 -- setup/common.sh@32 -- # continue 00:02:45.960 22:40:37 -- setup/common.sh@31 -- # IFS=': ' 00:02:45.960 22:40:37 -- setup/common.sh@31 -- # read -r var val _ 00:02:45.960 22:40:37 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:45.960 22:40:37 -- setup/common.sh@32 -- # continue 00:02:45.960 22:40:37 -- setup/common.sh@31 -- # IFS=': ' 00:02:45.960 22:40:37 -- setup/common.sh@31 -- # read -r var val _ 00:02:45.960 22:40:37 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:45.960 22:40:37 -- setup/common.sh@32 -- # continue 00:02:45.960 22:40:37 -- setup/common.sh@31 -- # IFS=': ' 00:02:45.960 22:40:37 -- setup/common.sh@31 -- # read -r var val _ 00:02:45.960 22:40:37 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:45.960 22:40:37 -- setup/common.sh@32 -- # continue 00:02:45.960 22:40:37 -- setup/common.sh@31 -- # IFS=': ' 00:02:45.960 22:40:37 -- setup/common.sh@31 -- # read -r var val _ 00:02:45.960 22:40:37 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:45.960 22:40:37 -- setup/common.sh@32 -- # continue 00:02:45.960 22:40:37 -- setup/common.sh@31 -- # IFS=': ' 00:02:45.960 22:40:37 -- setup/common.sh@31 -- # read -r var val _ 00:02:45.960 22:40:37 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:45.960 22:40:37 -- setup/common.sh@32 -- # continue 00:02:45.960 22:40:37 -- setup/common.sh@31 -- # IFS=': ' 00:02:45.960 22:40:37 -- setup/common.sh@31 -- # read -r var val _ 00:02:45.960 22:40:37 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:45.960 22:40:37 -- setup/common.sh@32 -- # continue 00:02:45.960 22:40:37 -- setup/common.sh@31 -- # IFS=': ' 00:02:45.960 22:40:37 -- setup/common.sh@31 -- # read -r var val _ 00:02:45.960 22:40:37 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:45.960 22:40:37 -- setup/common.sh@32 -- # continue 00:02:45.960 22:40:37 -- setup/common.sh@31 -- # IFS=': ' 00:02:45.960 22:40:37 -- setup/common.sh@31 -- # read -r var val _ 00:02:45.960 22:40:37 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:45.960 22:40:37 -- setup/common.sh@32 -- # continue 00:02:45.960 22:40:37 -- setup/common.sh@31 -- # IFS=': ' 00:02:45.960 22:40:37 -- setup/common.sh@31 -- # read -r var val _ 00:02:45.960 22:40:37 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:45.960 22:40:37 -- setup/common.sh@32 -- # continue 00:02:45.960 22:40:37 -- setup/common.sh@31 -- # IFS=': ' 00:02:45.960 22:40:37 -- setup/common.sh@31 -- # read -r var val _ 00:02:45.960 22:40:37 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:45.960 22:40:37 -- setup/common.sh@32 -- # continue 00:02:45.960 22:40:37 -- setup/common.sh@31 -- # IFS=': ' 00:02:45.960 22:40:37 -- setup/common.sh@31 -- # read -r var val _ 00:02:45.960 22:40:37 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:45.960 22:40:37 -- setup/common.sh@32 -- # continue 00:02:45.960 22:40:37 -- setup/common.sh@31 -- # IFS=': ' 00:02:45.960 22:40:37 -- setup/common.sh@31 -- # read -r var val _ 00:02:45.960 22:40:37 -- setup/common.sh@32 -- # [[ FilePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:45.960 22:40:37 -- setup/common.sh@32 -- # continue 00:02:45.960 22:40:37 -- setup/common.sh@31 -- # IFS=': ' 00:02:45.960 22:40:37 -- setup/common.sh@31 -- # read -r var val _ 00:02:45.960 22:40:37 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:45.960 22:40:37 -- setup/common.sh@32 -- # continue 00:02:45.960 22:40:37 -- setup/common.sh@31 -- # IFS=': ' 00:02:45.960 22:40:37 -- setup/common.sh@31 -- # read -r var val _ 00:02:45.960 22:40:37 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:45.960 22:40:37 -- setup/common.sh@32 -- # continue 00:02:45.960 22:40:37 -- setup/common.sh@31 -- # IFS=': ' 00:02:45.960 22:40:37 -- setup/common.sh@31 -- # read -r var val _ 00:02:45.960 22:40:37 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:45.960 22:40:37 -- setup/common.sh@32 -- # continue 00:02:45.960 22:40:37 -- setup/common.sh@31 -- # IFS=': ' 00:02:45.960 22:40:37 -- setup/common.sh@31 -- # read -r var val _ 00:02:45.960 22:40:37 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:45.960 22:40:37 -- setup/common.sh@32 -- # continue 00:02:45.960 22:40:37 -- setup/common.sh@31 -- # IFS=': ' 00:02:45.960 22:40:37 -- setup/common.sh@31 -- # read -r var val _ 00:02:45.960 22:40:37 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:45.960 22:40:37 -- setup/common.sh@32 -- # continue 00:02:45.960 22:40:37 -- setup/common.sh@31 -- # IFS=': ' 00:02:45.960 22:40:37 -- setup/common.sh@31 -- # read -r var val _ 00:02:45.960 22:40:37 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:45.960 22:40:37 -- setup/common.sh@32 -- # continue 00:02:45.960 22:40:37 -- setup/common.sh@31 -- # IFS=': ' 00:02:45.960 22:40:37 -- setup/common.sh@31 -- # read -r var val _ 00:02:45.960 22:40:37 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:45.960 22:40:37 -- setup/common.sh@32 -- # continue 00:02:45.960 22:40:37 -- setup/common.sh@31 -- # IFS=': ' 00:02:45.960 22:40:37 -- setup/common.sh@31 -- # read -r var val _ 00:02:45.960 22:40:37 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:45.960 22:40:37 -- setup/common.sh@32 -- # continue 00:02:45.960 22:40:37 -- setup/common.sh@31 -- # IFS=': ' 00:02:45.961 22:40:37 -- setup/common.sh@31 -- # read -r var val _ 00:02:45.961 22:40:37 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:45.961 22:40:37 -- setup/common.sh@32 -- # continue 00:02:45.961 22:40:37 -- setup/common.sh@31 -- # IFS=': ' 00:02:45.961 22:40:37 -- setup/common.sh@31 -- # read -r var val _ 00:02:45.961 22:40:37 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:45.961 22:40:37 -- setup/common.sh@32 -- # continue 00:02:45.961 22:40:37 -- setup/common.sh@31 -- # IFS=': ' 00:02:45.961 22:40:37 -- setup/common.sh@31 -- # read -r var val _ 00:02:45.961 22:40:37 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:45.961 22:40:37 -- setup/common.sh@32 -- # continue 00:02:45.961 22:40:37 -- setup/common.sh@31 -- # IFS=': ' 00:02:45.961 22:40:37 -- setup/common.sh@31 -- # read -r var val _ 00:02:45.961 22:40:37 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:45.961 22:40:37 -- setup/common.sh@32 -- # continue 00:02:45.961 22:40:37 -- setup/common.sh@31 -- # IFS=': ' 00:02:45.961 22:40:37 -- setup/common.sh@31 -- # read -r var val _ 00:02:45.961 22:40:37 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:45.961 22:40:37 -- setup/common.sh@32 -- # continue 00:02:45.961 22:40:37 -- setup/common.sh@31 -- # IFS=': ' 00:02:45.961 22:40:37 -- setup/common.sh@31 -- # read -r var val _ 00:02:45.961 22:40:37 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:45.961 22:40:37 -- setup/common.sh@32 -- # continue 00:02:45.961 22:40:37 -- setup/common.sh@31 -- # IFS=': ' 00:02:45.961 22:40:37 -- setup/common.sh@31 -- # read -r var val _ 00:02:45.961 22:40:37 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:45.961 22:40:37 -- setup/common.sh@32 -- # continue 00:02:45.961 22:40:37 -- setup/common.sh@31 -- # IFS=': ' 00:02:45.961 22:40:37 -- setup/common.sh@31 -- # read -r var val _ 00:02:45.961 22:40:37 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:45.961 22:40:37 -- setup/common.sh@32 -- # continue 00:02:45.961 22:40:37 -- setup/common.sh@31 -- # IFS=': ' 00:02:45.961 22:40:37 -- setup/common.sh@31 -- # read -r var val _ 00:02:45.961 22:40:37 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:45.961 22:40:37 -- setup/common.sh@32 -- # continue 00:02:45.961 22:40:37 -- setup/common.sh@31 -- # IFS=': ' 00:02:45.961 22:40:37 -- setup/common.sh@31 -- # read -r var val _ 00:02:45.961 22:40:37 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:45.961 22:40:37 -- setup/common.sh@32 -- # continue 00:02:45.961 22:40:37 -- setup/common.sh@31 -- # IFS=': ' 00:02:45.961 22:40:37 -- setup/common.sh@31 -- # read -r var val _ 00:02:45.961 22:40:37 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:45.961 22:40:37 -- setup/common.sh@32 -- # continue 00:02:45.961 22:40:37 -- setup/common.sh@31 -- # IFS=': ' 00:02:45.961 22:40:37 -- setup/common.sh@31 -- # read -r var val _ 00:02:45.961 22:40:37 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:45.961 22:40:37 -- setup/common.sh@32 -- # continue 00:02:45.961 22:40:37 -- setup/common.sh@31 -- # IFS=': ' 00:02:45.961 22:40:37 -- setup/common.sh@31 -- # read -r var val _ 00:02:45.961 22:40:37 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:45.961 22:40:37 -- setup/common.sh@32 -- # continue 00:02:45.961 22:40:37 -- setup/common.sh@31 -- # IFS=': ' 00:02:45.961 22:40:37 -- setup/common.sh@31 -- # read -r var val _ 00:02:45.961 22:40:37 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:45.961 22:40:37 -- setup/common.sh@33 -- # echo 0 00:02:45.961 22:40:37 -- setup/common.sh@33 -- # return 0 00:02:45.961 22:40:37 -- setup/hugepages.sh@117 -- # (( nodes_test[node] += 0 )) 00:02:45.961 22:40:37 -- setup/hugepages.sh@115 -- # for node in "${!nodes_test[@]}" 00:02:45.961 22:40:37 -- setup/hugepages.sh@116 -- # (( nodes_test[node] += resv )) 00:02:45.961 22:40:37 -- setup/hugepages.sh@117 -- # get_meminfo HugePages_Surp 1 00:02:45.961 22:40:37 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:02:45.961 22:40:37 -- setup/common.sh@18 -- # local node=1 00:02:45.961 22:40:37 -- setup/common.sh@19 -- # local var val 00:02:45.961 22:40:37 -- setup/common.sh@20 -- # local mem_f mem 00:02:45.961 22:40:37 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:02:45.961 22:40:37 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node1/meminfo ]] 00:02:45.961 22:40:37 -- setup/common.sh@24 -- # mem_f=/sys/devices/system/node/node1/meminfo 00:02:45.961 22:40:37 -- setup/common.sh@28 -- # mapfile -t mem 00:02:45.961 22:40:37 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:02:45.961 22:40:37 -- setup/common.sh@31 -- # IFS=': ' 00:02:45.961 22:40:37 -- setup/common.sh@31 -- # read -r var val _ 00:02:45.961 22:40:37 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 27711852 kB' 'MemFree: 23182180 kB' 'MemUsed: 4529672 kB' 'SwapCached: 0 kB' 'Active: 2328672 kB' 'Inactive: 164976 kB' 'Active(anon): 2145568 kB' 'Inactive(anon): 0 kB' 'Active(file): 183104 kB' 'Inactive(file): 164976 kB' 'Unevictable: 0 kB' 'Mlocked: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'FilePages: 2276896 kB' 'Mapped: 45140 kB' 'AnonPages: 216836 kB' 'Shmem: 1928816 kB' 'KernelStack: 6248 kB' 'PageTables: 4084 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'KReclaimable: 143084 kB' 'Slab: 322288 kB' 'SReclaimable: 143084 kB' 'SUnreclaim: 179204 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 512' 'HugePages_Free: 512' 'HugePages_Surp: 0' 00:02:45.961 22:40:37 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:45.961 22:40:37 -- setup/common.sh@32 -- # continue 00:02:45.961 22:40:37 -- setup/common.sh@31 -- # IFS=': ' 00:02:45.961 22:40:37 -- setup/common.sh@31 -- # read -r var val _ 00:02:45.961 22:40:37 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:45.961 22:40:37 -- setup/common.sh@32 -- # continue 00:02:45.961 22:40:37 -- setup/common.sh@31 -- # IFS=': ' 00:02:45.961 22:40:37 -- setup/common.sh@31 -- # read -r var val _ 00:02:45.961 22:40:37 -- setup/common.sh@32 -- # [[ MemUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:45.961 22:40:37 -- setup/common.sh@32 -- # continue 00:02:45.961 22:40:37 -- setup/common.sh@31 -- # IFS=': ' 00:02:45.961 22:40:37 -- setup/common.sh@31 -- # read -r var val _ 00:02:45.961 22:40:37 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:45.961 22:40:37 -- setup/common.sh@32 -- # continue 00:02:45.961 22:40:37 -- setup/common.sh@31 -- # IFS=': ' 00:02:45.961 22:40:37 -- setup/common.sh@31 -- # read -r var val _ 00:02:45.961 22:40:37 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:45.961 22:40:37 -- setup/common.sh@32 -- # continue 00:02:45.961 22:40:37 -- setup/common.sh@31 -- # IFS=': ' 00:02:45.961 22:40:37 -- setup/common.sh@31 -- # read -r var val _ 00:02:45.961 22:40:37 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:45.961 22:40:37 -- setup/common.sh@32 -- # continue 00:02:45.961 22:40:37 -- setup/common.sh@31 -- # IFS=': ' 00:02:45.961 22:40:37 -- setup/common.sh@31 -- # read -r var val _ 00:02:45.961 22:40:37 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:45.961 22:40:37 -- setup/common.sh@32 -- # continue 00:02:45.961 22:40:37 -- setup/common.sh@31 -- # IFS=': ' 00:02:45.961 22:40:37 -- setup/common.sh@31 -- # read -r var val _ 00:02:45.961 22:40:37 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:45.961 22:40:37 -- setup/common.sh@32 -- # continue 00:02:45.961 22:40:37 -- setup/common.sh@31 -- # IFS=': ' 00:02:45.961 22:40:37 -- setup/common.sh@31 -- # read -r var val _ 00:02:45.961 22:40:37 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:45.961 22:40:37 -- setup/common.sh@32 -- # continue 00:02:45.961 22:40:37 -- setup/common.sh@31 -- # IFS=': ' 00:02:45.961 22:40:37 -- setup/common.sh@31 -- # read -r var val _ 00:02:45.961 22:40:37 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:45.961 22:40:37 -- setup/common.sh@32 -- # continue 00:02:45.961 22:40:37 -- setup/common.sh@31 -- # IFS=': ' 00:02:45.961 22:40:37 -- setup/common.sh@31 -- # read -r var val _ 00:02:45.961 22:40:37 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:45.961 22:40:37 -- setup/common.sh@32 -- # continue 00:02:45.961 22:40:37 -- setup/common.sh@31 -- # IFS=': ' 00:02:45.961 22:40:37 -- setup/common.sh@31 -- # read -r var val _ 00:02:45.961 22:40:37 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:45.961 22:40:37 -- setup/common.sh@32 -- # continue 00:02:45.961 22:40:37 -- setup/common.sh@31 -- # IFS=': ' 00:02:45.961 22:40:37 -- setup/common.sh@31 -- # read -r var val _ 00:02:45.961 22:40:37 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:45.961 22:40:37 -- setup/common.sh@32 -- # continue 00:02:45.961 22:40:37 -- setup/common.sh@31 -- # IFS=': ' 00:02:45.961 22:40:37 -- setup/common.sh@31 -- # read -r var val _ 00:02:45.961 22:40:37 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:45.961 22:40:37 -- setup/common.sh@32 -- # continue 00:02:45.961 22:40:37 -- setup/common.sh@31 -- # IFS=': ' 00:02:45.961 22:40:37 -- setup/common.sh@31 -- # read -r var val _ 00:02:45.961 22:40:37 -- setup/common.sh@32 -- # [[ FilePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:45.961 22:40:37 -- setup/common.sh@32 -- # continue 00:02:45.961 22:40:37 -- setup/common.sh@31 -- # IFS=': ' 00:02:45.961 22:40:37 -- setup/common.sh@31 -- # read -r var val _ 00:02:45.961 22:40:37 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:45.961 22:40:37 -- setup/common.sh@32 -- # continue 00:02:45.961 22:40:37 -- setup/common.sh@31 -- # IFS=': ' 00:02:45.961 22:40:37 -- setup/common.sh@31 -- # read -r var val _ 00:02:45.961 22:40:37 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:45.961 22:40:37 -- setup/common.sh@32 -- # continue 00:02:45.961 22:40:37 -- setup/common.sh@31 -- # IFS=': ' 00:02:45.961 22:40:37 -- setup/common.sh@31 -- # read -r var val _ 00:02:45.961 22:40:37 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:45.961 22:40:37 -- setup/common.sh@32 -- # continue 00:02:45.961 22:40:37 -- setup/common.sh@31 -- # IFS=': ' 00:02:45.961 22:40:37 -- setup/common.sh@31 -- # read -r var val _ 00:02:45.961 22:40:37 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:45.961 22:40:37 -- setup/common.sh@32 -- # continue 00:02:45.961 22:40:37 -- setup/common.sh@31 -- # IFS=': ' 00:02:45.961 22:40:37 -- setup/common.sh@31 -- # read -r var val _ 00:02:45.961 22:40:37 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:45.961 22:40:37 -- setup/common.sh@32 -- # continue 00:02:45.961 22:40:37 -- setup/common.sh@31 -- # IFS=': ' 00:02:45.961 22:40:37 -- setup/common.sh@31 -- # read -r var val _ 00:02:45.961 22:40:37 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:45.961 22:40:37 -- setup/common.sh@32 -- # continue 00:02:45.962 22:40:37 -- setup/common.sh@31 -- # IFS=': ' 00:02:45.962 22:40:37 -- setup/common.sh@31 -- # read -r var val _ 00:02:45.962 22:40:37 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:45.962 22:40:37 -- setup/common.sh@32 -- # continue 00:02:45.962 22:40:37 -- setup/common.sh@31 -- # IFS=': ' 00:02:45.962 22:40:37 -- setup/common.sh@31 -- # read -r var val _ 00:02:45.962 22:40:37 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:45.962 22:40:37 -- setup/common.sh@32 -- # continue 00:02:45.962 22:40:37 -- setup/common.sh@31 -- # IFS=': ' 00:02:45.962 22:40:37 -- setup/common.sh@31 -- # read -r var val _ 00:02:45.962 22:40:37 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:45.962 22:40:37 -- setup/common.sh@32 -- # continue 00:02:45.962 22:40:37 -- setup/common.sh@31 -- # IFS=': ' 00:02:45.962 22:40:37 -- setup/common.sh@31 -- # read -r var val _ 00:02:45.962 22:40:37 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:45.962 22:40:37 -- setup/common.sh@32 -- # continue 00:02:45.962 22:40:37 -- setup/common.sh@31 -- # IFS=': ' 00:02:45.962 22:40:37 -- setup/common.sh@31 -- # read -r var val _ 00:02:45.962 22:40:37 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:45.962 22:40:37 -- setup/common.sh@32 -- # continue 00:02:45.962 22:40:37 -- setup/common.sh@31 -- # IFS=': ' 00:02:45.962 22:40:37 -- setup/common.sh@31 -- # read -r var val _ 00:02:45.962 22:40:37 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:45.962 22:40:37 -- setup/common.sh@32 -- # continue 00:02:45.962 22:40:37 -- setup/common.sh@31 -- # IFS=': ' 00:02:45.962 22:40:37 -- setup/common.sh@31 -- # read -r var val _ 00:02:45.962 22:40:37 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:45.962 22:40:37 -- setup/common.sh@32 -- # continue 00:02:45.962 22:40:37 -- setup/common.sh@31 -- # IFS=': ' 00:02:45.962 22:40:37 -- setup/common.sh@31 -- # read -r var val _ 00:02:45.962 22:40:37 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:45.962 22:40:37 -- setup/common.sh@32 -- # continue 00:02:45.962 22:40:37 -- setup/common.sh@31 -- # IFS=': ' 00:02:45.962 22:40:37 -- setup/common.sh@31 -- # read -r var val _ 00:02:45.962 22:40:37 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:45.962 22:40:37 -- setup/common.sh@32 -- # continue 00:02:45.962 22:40:37 -- setup/common.sh@31 -- # IFS=': ' 00:02:45.962 22:40:37 -- setup/common.sh@31 -- # read -r var val _ 00:02:45.962 22:40:37 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:45.962 22:40:37 -- setup/common.sh@32 -- # continue 00:02:45.962 22:40:37 -- setup/common.sh@31 -- # IFS=': ' 00:02:45.962 22:40:37 -- setup/common.sh@31 -- # read -r var val _ 00:02:45.962 22:40:37 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:45.962 22:40:37 -- setup/common.sh@32 -- # continue 00:02:45.962 22:40:37 -- setup/common.sh@31 -- # IFS=': ' 00:02:45.962 22:40:37 -- setup/common.sh@31 -- # read -r var val _ 00:02:45.962 22:40:37 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:45.962 22:40:37 -- setup/common.sh@32 -- # continue 00:02:45.962 22:40:37 -- setup/common.sh@31 -- # IFS=': ' 00:02:45.962 22:40:37 -- setup/common.sh@31 -- # read -r var val _ 00:02:45.962 22:40:37 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:45.962 22:40:37 -- setup/common.sh@32 -- # continue 00:02:45.962 22:40:37 -- setup/common.sh@31 -- # IFS=': ' 00:02:45.962 22:40:37 -- setup/common.sh@31 -- # read -r var val _ 00:02:45.962 22:40:37 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:45.962 22:40:37 -- setup/common.sh@32 -- # continue 00:02:45.962 22:40:37 -- setup/common.sh@31 -- # IFS=': ' 00:02:45.962 22:40:37 -- setup/common.sh@31 -- # read -r var val _ 00:02:45.962 22:40:37 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:45.962 22:40:37 -- setup/common.sh@32 -- # continue 00:02:45.962 22:40:37 -- setup/common.sh@31 -- # IFS=': ' 00:02:45.962 22:40:37 -- setup/common.sh@31 -- # read -r var val _ 00:02:45.962 22:40:37 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:45.962 22:40:37 -- setup/common.sh@33 -- # echo 0 00:02:45.962 22:40:37 -- setup/common.sh@33 -- # return 0 00:02:45.962 22:40:37 -- setup/hugepages.sh@117 -- # (( nodes_test[node] += 0 )) 00:02:45.962 22:40:37 -- setup/hugepages.sh@126 -- # for node in "${!nodes_test[@]}" 00:02:45.962 22:40:37 -- setup/hugepages.sh@127 -- # sorted_t[nodes_test[node]]=1 00:02:45.962 22:40:37 -- setup/hugepages.sh@127 -- # sorted_s[nodes_sys[node]]=1 00:02:45.962 22:40:37 -- setup/hugepages.sh@128 -- # echo 'node0=512 expecting 512' 00:02:45.962 node0=512 expecting 512 00:02:45.962 22:40:37 -- setup/hugepages.sh@126 -- # for node in "${!nodes_test[@]}" 00:02:45.962 22:40:37 -- setup/hugepages.sh@127 -- # sorted_t[nodes_test[node]]=1 00:02:45.962 22:40:37 -- setup/hugepages.sh@127 -- # sorted_s[nodes_sys[node]]=1 00:02:45.962 22:40:37 -- setup/hugepages.sh@128 -- # echo 'node1=512 expecting 512' 00:02:45.962 node1=512 expecting 512 00:02:45.962 22:40:37 -- setup/hugepages.sh@130 -- # [[ 512 == \5\1\2 ]] 00:02:45.962 00:02:45.962 real 0m1.384s 00:02:45.962 user 0m0.607s 00:02:45.962 sys 0m0.739s 00:02:45.962 22:40:37 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:02:45.962 22:40:37 -- common/autotest_common.sh@10 -- # set +x 00:02:45.962 ************************************ 00:02:45.962 END TEST even_2G_alloc 00:02:45.962 ************************************ 00:02:45.962 22:40:37 -- setup/hugepages.sh@213 -- # run_test odd_alloc odd_alloc 00:02:45.962 22:40:37 -- common/autotest_common.sh@1077 -- # '[' 2 -le 1 ']' 00:02:45.962 22:40:37 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:02:45.962 22:40:37 -- common/autotest_common.sh@10 -- # set +x 00:02:45.962 ************************************ 00:02:45.962 START TEST odd_alloc 00:02:45.962 ************************************ 00:02:45.962 22:40:37 -- common/autotest_common.sh@1104 -- # odd_alloc 00:02:45.962 22:40:37 -- setup/hugepages.sh@159 -- # get_test_nr_hugepages 2098176 00:02:45.962 22:40:37 -- setup/hugepages.sh@49 -- # local size=2098176 00:02:45.962 22:40:37 -- setup/hugepages.sh@50 -- # (( 1 > 1 )) 00:02:45.962 22:40:37 -- setup/hugepages.sh@55 -- # (( size >= default_hugepages )) 00:02:45.962 22:40:37 -- setup/hugepages.sh@57 -- # nr_hugepages=1025 00:02:45.962 22:40:37 -- setup/hugepages.sh@58 -- # get_test_nr_hugepages_per_node 00:02:45.962 22:40:37 -- setup/hugepages.sh@62 -- # user_nodes=() 00:02:45.962 22:40:37 -- setup/hugepages.sh@62 -- # local user_nodes 00:02:45.962 22:40:37 -- setup/hugepages.sh@64 -- # local _nr_hugepages=1025 00:02:45.962 22:40:37 -- setup/hugepages.sh@65 -- # local _no_nodes=2 00:02:45.962 22:40:37 -- setup/hugepages.sh@67 -- # nodes_test=() 00:02:45.962 22:40:37 -- setup/hugepages.sh@67 -- # local -g nodes_test 00:02:45.962 22:40:37 -- setup/hugepages.sh@69 -- # (( 0 > 0 )) 00:02:46.222 22:40:37 -- setup/hugepages.sh@74 -- # (( 0 > 0 )) 00:02:46.222 22:40:37 -- setup/hugepages.sh@81 -- # (( _no_nodes > 0 )) 00:02:46.222 22:40:37 -- setup/hugepages.sh@82 -- # nodes_test[_no_nodes - 1]=512 00:02:46.222 22:40:37 -- setup/hugepages.sh@83 -- # : 513 00:02:46.222 22:40:37 -- setup/hugepages.sh@84 -- # : 1 00:02:46.222 22:40:37 -- setup/hugepages.sh@81 -- # (( _no_nodes > 0 )) 00:02:46.222 22:40:37 -- setup/hugepages.sh@82 -- # nodes_test[_no_nodes - 1]=513 00:02:46.222 22:40:37 -- setup/hugepages.sh@83 -- # : 0 00:02:46.222 22:40:37 -- setup/hugepages.sh@84 -- # : 0 00:02:46.222 22:40:37 -- setup/hugepages.sh@81 -- # (( _no_nodes > 0 )) 00:02:46.222 22:40:37 -- setup/hugepages.sh@160 -- # HUGEMEM=2049 00:02:46.222 22:40:37 -- setup/hugepages.sh@160 -- # HUGE_EVEN_ALLOC=yes 00:02:46.222 22:40:37 -- setup/hugepages.sh@160 -- # setup output 00:02:46.222 22:40:37 -- setup/common.sh@9 -- # [[ output == output ]] 00:02:46.222 22:40:37 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh 00:02:47.156 0000:00:04.7 (8086 0e27): Already using the vfio-pci driver 00:02:47.156 0000:88:00.0 (8086 0a54): Already using the vfio-pci driver 00:02:47.156 0000:00:04.6 (8086 0e26): Already using the vfio-pci driver 00:02:47.156 0000:00:04.5 (8086 0e25): Already using the vfio-pci driver 00:02:47.156 0000:00:04.4 (8086 0e24): Already using the vfio-pci driver 00:02:47.156 0000:00:04.3 (8086 0e23): Already using the vfio-pci driver 00:02:47.156 0000:00:04.2 (8086 0e22): Already using the vfio-pci driver 00:02:47.156 0000:00:04.1 (8086 0e21): Already using the vfio-pci driver 00:02:47.156 0000:00:04.0 (8086 0e20): Already using the vfio-pci driver 00:02:47.156 0000:80:04.7 (8086 0e27): Already using the vfio-pci driver 00:02:47.156 0000:80:04.6 (8086 0e26): Already using the vfio-pci driver 00:02:47.156 0000:80:04.5 (8086 0e25): Already using the vfio-pci driver 00:02:47.156 0000:80:04.4 (8086 0e24): Already using the vfio-pci driver 00:02:47.156 0000:80:04.3 (8086 0e23): Already using the vfio-pci driver 00:02:47.156 0000:80:04.2 (8086 0e22): Already using the vfio-pci driver 00:02:47.156 0000:80:04.1 (8086 0e21): Already using the vfio-pci driver 00:02:47.156 0000:80:04.0 (8086 0e20): Already using the vfio-pci driver 00:02:47.419 22:40:38 -- setup/hugepages.sh@161 -- # verify_nr_hugepages 00:02:47.419 22:40:38 -- setup/hugepages.sh@89 -- # local node 00:02:47.419 22:40:38 -- setup/hugepages.sh@90 -- # local sorted_t 00:02:47.419 22:40:38 -- setup/hugepages.sh@91 -- # local sorted_s 00:02:47.419 22:40:38 -- setup/hugepages.sh@92 -- # local surp 00:02:47.419 22:40:38 -- setup/hugepages.sh@93 -- # local resv 00:02:47.419 22:40:38 -- setup/hugepages.sh@94 -- # local anon 00:02:47.419 22:40:38 -- setup/hugepages.sh@96 -- # [[ always [madvise] never != *\[\n\e\v\e\r\]* ]] 00:02:47.419 22:40:38 -- setup/hugepages.sh@97 -- # get_meminfo AnonHugePages 00:02:47.419 22:40:38 -- setup/common.sh@17 -- # local get=AnonHugePages 00:02:47.419 22:40:38 -- setup/common.sh@18 -- # local node= 00:02:47.419 22:40:38 -- setup/common.sh@19 -- # local var val 00:02:47.419 22:40:38 -- setup/common.sh@20 -- # local mem_f mem 00:02:47.419 22:40:38 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:02:47.419 22:40:38 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:02:47.419 22:40:38 -- setup/common.sh@25 -- # [[ -n '' ]] 00:02:47.419 22:40:38 -- setup/common.sh@28 -- # mapfile -t mem 00:02:47.419 22:40:38 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:02:47.419 22:40:38 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.419 22:40:38 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.419 22:40:38 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60541736 kB' 'MemFree: 43366292 kB' 'MemAvailable: 47357520 kB' 'Buffers: 2696 kB' 'Cached: 12518400 kB' 'SwapCached: 0 kB' 'Active: 9323048 kB' 'Inactive: 3655836 kB' 'Active(anon): 8758732 kB' 'Inactive(anon): 0 kB' 'Active(file): 564316 kB' 'Inactive(file): 3655836 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 461120 kB' 'Mapped: 201520 kB' 'Shmem: 8300944 kB' 'KReclaimable: 415512 kB' 'Slab: 806880 kB' 'SReclaimable: 415512 kB' 'SUnreclaim: 391368 kB' 'KernelStack: 12800 kB' 'PageTables: 8180 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37609872 kB' 'Committed_AS: 9884344 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 197116 kB' 'VmallocChunk: 0 kB' 'Percpu: 38592 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1025' 'HugePages_Free: 1025' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2099200 kB' 'DirectMap4k: 2506332 kB' 'DirectMap2M: 24676352 kB' 'DirectMap1G: 41943040 kB' 00:02:47.419 22:40:38 -- setup/common.sh@32 -- # [[ MemTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:47.419 22:40:38 -- setup/common.sh@32 -- # continue 00:02:47.419 22:40:38 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.419 22:40:38 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.419 22:40:38 -- setup/common.sh@32 -- # [[ MemFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:47.419 22:40:38 -- setup/common.sh@32 -- # continue 00:02:47.419 22:40:38 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.419 22:40:38 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.419 22:40:38 -- setup/common.sh@32 -- # [[ MemAvailable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:47.419 22:40:38 -- setup/common.sh@32 -- # continue 00:02:47.419 22:40:38 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.419 22:40:38 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.419 22:40:38 -- setup/common.sh@32 -- # [[ Buffers == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:47.419 22:40:38 -- setup/common.sh@32 -- # continue 00:02:47.419 22:40:38 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.419 22:40:38 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.419 22:40:38 -- setup/common.sh@32 -- # [[ Cached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:47.419 22:40:38 -- setup/common.sh@32 -- # continue 00:02:47.419 22:40:38 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.419 22:40:38 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.419 22:40:38 -- setup/common.sh@32 -- # [[ SwapCached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:47.419 22:40:38 -- setup/common.sh@32 -- # continue 00:02:47.419 22:40:38 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.419 22:40:38 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.419 22:40:38 -- setup/common.sh@32 -- # [[ Active == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:47.419 22:40:38 -- setup/common.sh@32 -- # continue 00:02:47.419 22:40:38 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.419 22:40:38 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.419 22:40:38 -- setup/common.sh@32 -- # [[ Inactive == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:47.419 22:40:38 -- setup/common.sh@32 -- # continue 00:02:47.419 22:40:38 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.419 22:40:38 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.419 22:40:38 -- setup/common.sh@32 -- # [[ Active(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:47.419 22:40:38 -- setup/common.sh@32 -- # continue 00:02:47.419 22:40:38 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.419 22:40:38 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.419 22:40:38 -- setup/common.sh@32 -- # [[ Inactive(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:47.419 22:40:38 -- setup/common.sh@32 -- # continue 00:02:47.419 22:40:38 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.419 22:40:38 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.419 22:40:38 -- setup/common.sh@32 -- # [[ Active(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:47.419 22:40:38 -- setup/common.sh@32 -- # continue 00:02:47.419 22:40:38 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.419 22:40:38 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.419 22:40:38 -- setup/common.sh@32 -- # [[ Inactive(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:47.419 22:40:38 -- setup/common.sh@32 -- # continue 00:02:47.419 22:40:38 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.419 22:40:38 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.419 22:40:38 -- setup/common.sh@32 -- # [[ Unevictable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:47.419 22:40:38 -- setup/common.sh@32 -- # continue 00:02:47.419 22:40:38 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.419 22:40:38 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.419 22:40:38 -- setup/common.sh@32 -- # [[ Mlocked == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:47.419 22:40:38 -- setup/common.sh@32 -- # continue 00:02:47.420 22:40:38 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.420 22:40:38 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.420 22:40:38 -- setup/common.sh@32 -- # [[ SwapTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:47.420 22:40:38 -- setup/common.sh@32 -- # continue 00:02:47.420 22:40:38 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.420 22:40:38 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.420 22:40:38 -- setup/common.sh@32 -- # [[ SwapFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:47.420 22:40:38 -- setup/common.sh@32 -- # continue 00:02:47.420 22:40:38 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.420 22:40:38 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.420 22:40:38 -- setup/common.sh@32 -- # [[ Zswap == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:47.420 22:40:38 -- setup/common.sh@32 -- # continue 00:02:47.420 22:40:38 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.420 22:40:38 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.420 22:40:38 -- setup/common.sh@32 -- # [[ Zswapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:47.420 22:40:38 -- setup/common.sh@32 -- # continue 00:02:47.420 22:40:38 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.420 22:40:38 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.420 22:40:38 -- setup/common.sh@32 -- # [[ Dirty == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:47.420 22:40:38 -- setup/common.sh@32 -- # continue 00:02:47.420 22:40:38 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.420 22:40:38 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.420 22:40:38 -- setup/common.sh@32 -- # [[ Writeback == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:47.420 22:40:38 -- setup/common.sh@32 -- # continue 00:02:47.420 22:40:38 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.420 22:40:38 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.420 22:40:38 -- setup/common.sh@32 -- # [[ AnonPages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:47.420 22:40:38 -- setup/common.sh@32 -- # continue 00:02:47.420 22:40:38 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.420 22:40:38 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.420 22:40:38 -- setup/common.sh@32 -- # [[ Mapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:47.420 22:40:38 -- setup/common.sh@32 -- # continue 00:02:47.420 22:40:38 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.420 22:40:38 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.420 22:40:38 -- setup/common.sh@32 -- # [[ Shmem == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:47.420 22:40:38 -- setup/common.sh@32 -- # continue 00:02:47.420 22:40:38 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.420 22:40:38 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.420 22:40:38 -- setup/common.sh@32 -- # [[ KReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:47.420 22:40:38 -- setup/common.sh@32 -- # continue 00:02:47.420 22:40:38 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.420 22:40:38 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.420 22:40:38 -- setup/common.sh@32 -- # [[ Slab == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:47.420 22:40:38 -- setup/common.sh@32 -- # continue 00:02:47.420 22:40:38 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.420 22:40:38 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.420 22:40:38 -- setup/common.sh@32 -- # [[ SReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:47.420 22:40:38 -- setup/common.sh@32 -- # continue 00:02:47.420 22:40:38 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.420 22:40:38 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.420 22:40:38 -- setup/common.sh@32 -- # [[ SUnreclaim == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:47.420 22:40:38 -- setup/common.sh@32 -- # continue 00:02:47.420 22:40:38 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.420 22:40:38 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.420 22:40:38 -- setup/common.sh@32 -- # [[ KernelStack == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:47.420 22:40:38 -- setup/common.sh@32 -- # continue 00:02:47.420 22:40:38 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.420 22:40:38 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.420 22:40:38 -- setup/common.sh@32 -- # [[ PageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:47.420 22:40:38 -- setup/common.sh@32 -- # continue 00:02:47.420 22:40:38 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.420 22:40:38 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.420 22:40:38 -- setup/common.sh@32 -- # [[ SecPageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:47.420 22:40:38 -- setup/common.sh@32 -- # continue 00:02:47.420 22:40:38 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.420 22:40:38 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.420 22:40:38 -- setup/common.sh@32 -- # [[ NFS_Unstable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:47.420 22:40:38 -- setup/common.sh@32 -- # continue 00:02:47.420 22:40:38 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.420 22:40:38 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.420 22:40:38 -- setup/common.sh@32 -- # [[ Bounce == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:47.420 22:40:38 -- setup/common.sh@32 -- # continue 00:02:47.420 22:40:38 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.420 22:40:38 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.420 22:40:38 -- setup/common.sh@32 -- # [[ WritebackTmp == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:47.420 22:40:38 -- setup/common.sh@32 -- # continue 00:02:47.420 22:40:38 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.420 22:40:38 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.420 22:40:38 -- setup/common.sh@32 -- # [[ CommitLimit == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:47.420 22:40:38 -- setup/common.sh@32 -- # continue 00:02:47.420 22:40:38 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.420 22:40:38 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.420 22:40:38 -- setup/common.sh@32 -- # [[ Committed_AS == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:47.420 22:40:38 -- setup/common.sh@32 -- # continue 00:02:47.420 22:40:38 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.420 22:40:38 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.420 22:40:38 -- setup/common.sh@32 -- # [[ VmallocTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:47.420 22:40:38 -- setup/common.sh@32 -- # continue 00:02:47.420 22:40:38 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.420 22:40:38 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.420 22:40:38 -- setup/common.sh@32 -- # [[ VmallocUsed == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:47.420 22:40:38 -- setup/common.sh@32 -- # continue 00:02:47.420 22:40:38 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.420 22:40:38 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.420 22:40:38 -- setup/common.sh@32 -- # [[ VmallocChunk == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:47.420 22:40:38 -- setup/common.sh@32 -- # continue 00:02:47.420 22:40:38 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.420 22:40:38 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.420 22:40:38 -- setup/common.sh@32 -- # [[ Percpu == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:47.420 22:40:38 -- setup/common.sh@32 -- # continue 00:02:47.420 22:40:38 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.420 22:40:38 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.420 22:40:38 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:47.420 22:40:38 -- setup/common.sh@32 -- # continue 00:02:47.420 22:40:38 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.420 22:40:38 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.420 22:40:38 -- setup/common.sh@32 -- # [[ AnonHugePages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:47.420 22:40:38 -- setup/common.sh@33 -- # echo 0 00:02:47.420 22:40:38 -- setup/common.sh@33 -- # return 0 00:02:47.420 22:40:38 -- setup/hugepages.sh@97 -- # anon=0 00:02:47.420 22:40:38 -- setup/hugepages.sh@99 -- # get_meminfo HugePages_Surp 00:02:47.420 22:40:38 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:02:47.420 22:40:38 -- setup/common.sh@18 -- # local node= 00:02:47.420 22:40:38 -- setup/common.sh@19 -- # local var val 00:02:47.420 22:40:38 -- setup/common.sh@20 -- # local mem_f mem 00:02:47.420 22:40:38 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:02:47.420 22:40:38 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:02:47.420 22:40:38 -- setup/common.sh@25 -- # [[ -n '' ]] 00:02:47.420 22:40:38 -- setup/common.sh@28 -- # mapfile -t mem 00:02:47.420 22:40:38 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:02:47.420 22:40:38 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.420 22:40:38 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.420 22:40:38 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60541736 kB' 'MemFree: 43366884 kB' 'MemAvailable: 47358112 kB' 'Buffers: 2696 kB' 'Cached: 12518404 kB' 'SwapCached: 0 kB' 'Active: 9322624 kB' 'Inactive: 3655836 kB' 'Active(anon): 8758308 kB' 'Inactive(anon): 0 kB' 'Active(file): 564316 kB' 'Inactive(file): 3655836 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 460688 kB' 'Mapped: 201520 kB' 'Shmem: 8300948 kB' 'KReclaimable: 415512 kB' 'Slab: 806872 kB' 'SReclaimable: 415512 kB' 'SUnreclaim: 391360 kB' 'KernelStack: 12736 kB' 'PageTables: 7952 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37609872 kB' 'Committed_AS: 9884356 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 197068 kB' 'VmallocChunk: 0 kB' 'Percpu: 38592 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1025' 'HugePages_Free: 1025' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2099200 kB' 'DirectMap4k: 2506332 kB' 'DirectMap2M: 24676352 kB' 'DirectMap1G: 41943040 kB' 00:02:47.420 22:40:38 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:47.420 22:40:38 -- setup/common.sh@32 -- # continue 00:02:47.420 22:40:38 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.420 22:40:38 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.420 22:40:38 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:47.420 22:40:38 -- setup/common.sh@32 -- # continue 00:02:47.420 22:40:38 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.420 22:40:38 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.420 22:40:38 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:47.420 22:40:38 -- setup/common.sh@32 -- # continue 00:02:47.420 22:40:38 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.420 22:40:38 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.420 22:40:38 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:47.420 22:40:38 -- setup/common.sh@32 -- # continue 00:02:47.420 22:40:38 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.420 22:40:38 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.420 22:40:38 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:47.420 22:40:38 -- setup/common.sh@32 -- # continue 00:02:47.421 22:40:38 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.421 22:40:38 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.421 22:40:38 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:47.421 22:40:38 -- setup/common.sh@32 -- # continue 00:02:47.421 22:40:38 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.421 22:40:38 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.421 22:40:38 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:47.421 22:40:38 -- setup/common.sh@32 -- # continue 00:02:47.421 22:40:38 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.421 22:40:38 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.421 22:40:38 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:47.421 22:40:38 -- setup/common.sh@32 -- # continue 00:02:47.421 22:40:38 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.421 22:40:38 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.421 22:40:38 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:47.421 22:40:38 -- setup/common.sh@32 -- # continue 00:02:47.421 22:40:38 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.421 22:40:38 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.421 22:40:38 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:47.421 22:40:38 -- setup/common.sh@32 -- # continue 00:02:47.421 22:40:38 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.421 22:40:38 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.421 22:40:38 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:47.421 22:40:38 -- setup/common.sh@32 -- # continue 00:02:47.421 22:40:38 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.421 22:40:38 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.421 22:40:38 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:47.421 22:40:38 -- setup/common.sh@32 -- # continue 00:02:47.421 22:40:38 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.421 22:40:38 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.421 22:40:38 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:47.421 22:40:38 -- setup/common.sh@32 -- # continue 00:02:47.421 22:40:38 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.421 22:40:38 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.421 22:40:38 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:47.421 22:40:38 -- setup/common.sh@32 -- # continue 00:02:47.421 22:40:38 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.421 22:40:38 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.421 22:40:38 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:47.421 22:40:38 -- setup/common.sh@32 -- # continue 00:02:47.421 22:40:38 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.421 22:40:38 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.421 22:40:38 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:47.421 22:40:38 -- setup/common.sh@32 -- # continue 00:02:47.421 22:40:38 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.421 22:40:38 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.421 22:40:38 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:47.421 22:40:38 -- setup/common.sh@32 -- # continue 00:02:47.421 22:40:38 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.421 22:40:38 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.421 22:40:38 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:47.421 22:40:38 -- setup/common.sh@32 -- # continue 00:02:47.421 22:40:38 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.421 22:40:38 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.421 22:40:38 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:47.421 22:40:38 -- setup/common.sh@32 -- # continue 00:02:47.421 22:40:38 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.421 22:40:38 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.421 22:40:38 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:47.421 22:40:38 -- setup/common.sh@32 -- # continue 00:02:47.421 22:40:38 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.421 22:40:38 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.421 22:40:38 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:47.421 22:40:38 -- setup/common.sh@32 -- # continue 00:02:47.421 22:40:38 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.421 22:40:38 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.421 22:40:38 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:47.421 22:40:38 -- setup/common.sh@32 -- # continue 00:02:47.421 22:40:38 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.421 22:40:38 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.421 22:40:38 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:47.421 22:40:38 -- setup/common.sh@32 -- # continue 00:02:47.421 22:40:38 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.421 22:40:38 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.421 22:40:38 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:47.421 22:40:38 -- setup/common.sh@32 -- # continue 00:02:47.421 22:40:38 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.421 22:40:38 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.421 22:40:38 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:47.421 22:40:38 -- setup/common.sh@32 -- # continue 00:02:47.421 22:40:38 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.421 22:40:38 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.421 22:40:38 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:47.421 22:40:38 -- setup/common.sh@32 -- # continue 00:02:47.421 22:40:38 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.421 22:40:38 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.421 22:40:38 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:47.421 22:40:38 -- setup/common.sh@32 -- # continue 00:02:47.421 22:40:38 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.421 22:40:38 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.421 22:40:38 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:47.421 22:40:38 -- setup/common.sh@32 -- # continue 00:02:47.421 22:40:38 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.421 22:40:38 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.421 22:40:38 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:47.421 22:40:38 -- setup/common.sh@32 -- # continue 00:02:47.421 22:40:38 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.421 22:40:38 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.421 22:40:38 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:47.421 22:40:38 -- setup/common.sh@32 -- # continue 00:02:47.421 22:40:38 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.421 22:40:38 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.421 22:40:38 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:47.421 22:40:38 -- setup/common.sh@32 -- # continue 00:02:47.421 22:40:38 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.421 22:40:38 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.421 22:40:38 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:47.421 22:40:38 -- setup/common.sh@32 -- # continue 00:02:47.421 22:40:38 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.421 22:40:38 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.421 22:40:38 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:47.421 22:40:38 -- setup/common.sh@32 -- # continue 00:02:47.421 22:40:38 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.421 22:40:38 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.421 22:40:38 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:47.421 22:40:38 -- setup/common.sh@32 -- # continue 00:02:47.421 22:40:38 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.421 22:40:38 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.421 22:40:38 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:47.421 22:40:38 -- setup/common.sh@32 -- # continue 00:02:47.421 22:40:38 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.421 22:40:38 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.421 22:40:38 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:47.421 22:40:38 -- setup/common.sh@32 -- # continue 00:02:47.421 22:40:38 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.421 22:40:38 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.421 22:40:38 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:47.421 22:40:38 -- setup/common.sh@32 -- # continue 00:02:47.421 22:40:38 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.421 22:40:38 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.421 22:40:38 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:47.421 22:40:38 -- setup/common.sh@32 -- # continue 00:02:47.421 22:40:38 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.421 22:40:38 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.421 22:40:38 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:47.421 22:40:38 -- setup/common.sh@32 -- # continue 00:02:47.421 22:40:38 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.421 22:40:38 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.421 22:40:38 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:47.421 22:40:38 -- setup/common.sh@32 -- # continue 00:02:47.421 22:40:38 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.422 22:40:38 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.422 22:40:38 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:47.422 22:40:38 -- setup/common.sh@32 -- # continue 00:02:47.422 22:40:38 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.422 22:40:38 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.422 22:40:38 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:47.422 22:40:38 -- setup/common.sh@32 -- # continue 00:02:47.422 22:40:38 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.422 22:40:38 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.422 22:40:38 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:47.422 22:40:38 -- setup/common.sh@32 -- # continue 00:02:47.422 22:40:38 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.422 22:40:38 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.422 22:40:38 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:47.422 22:40:38 -- setup/common.sh@32 -- # continue 00:02:47.422 22:40:38 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.422 22:40:38 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.422 22:40:38 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:47.422 22:40:38 -- setup/common.sh@32 -- # continue 00:02:47.422 22:40:38 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.422 22:40:38 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.422 22:40:38 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:47.422 22:40:38 -- setup/common.sh@32 -- # continue 00:02:47.422 22:40:38 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.422 22:40:38 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.422 22:40:38 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:47.422 22:40:38 -- setup/common.sh@32 -- # continue 00:02:47.422 22:40:38 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.422 22:40:38 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.422 22:40:38 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:47.422 22:40:38 -- setup/common.sh@32 -- # continue 00:02:47.422 22:40:38 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.422 22:40:38 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.422 22:40:38 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:47.422 22:40:38 -- setup/common.sh@32 -- # continue 00:02:47.422 22:40:38 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.422 22:40:38 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.422 22:40:38 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:47.422 22:40:38 -- setup/common.sh@32 -- # continue 00:02:47.422 22:40:38 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.422 22:40:38 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.422 22:40:38 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:47.422 22:40:38 -- setup/common.sh@32 -- # continue 00:02:47.422 22:40:38 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.422 22:40:38 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.422 22:40:38 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:47.422 22:40:38 -- setup/common.sh@33 -- # echo 0 00:02:47.422 22:40:38 -- setup/common.sh@33 -- # return 0 00:02:47.422 22:40:38 -- setup/hugepages.sh@99 -- # surp=0 00:02:47.422 22:40:38 -- setup/hugepages.sh@100 -- # get_meminfo HugePages_Rsvd 00:02:47.422 22:40:38 -- setup/common.sh@17 -- # local get=HugePages_Rsvd 00:02:47.422 22:40:38 -- setup/common.sh@18 -- # local node= 00:02:47.422 22:40:38 -- setup/common.sh@19 -- # local var val 00:02:47.422 22:40:38 -- setup/common.sh@20 -- # local mem_f mem 00:02:47.422 22:40:38 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:02:47.422 22:40:38 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:02:47.422 22:40:38 -- setup/common.sh@25 -- # [[ -n '' ]] 00:02:47.422 22:40:38 -- setup/common.sh@28 -- # mapfile -t mem 00:02:47.422 22:40:38 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:02:47.422 22:40:38 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.422 22:40:38 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.422 22:40:38 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60541736 kB' 'MemFree: 43371132 kB' 'MemAvailable: 47362360 kB' 'Buffers: 2696 kB' 'Cached: 12518408 kB' 'SwapCached: 0 kB' 'Active: 9322480 kB' 'Inactive: 3655836 kB' 'Active(anon): 8758164 kB' 'Inactive(anon): 0 kB' 'Active(file): 564316 kB' 'Inactive(file): 3655836 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 460952 kB' 'Mapped: 201456 kB' 'Shmem: 8300952 kB' 'KReclaimable: 415512 kB' 'Slab: 806872 kB' 'SReclaimable: 415512 kB' 'SUnreclaim: 391360 kB' 'KernelStack: 12768 kB' 'PageTables: 8036 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37609872 kB' 'Committed_AS: 9884372 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 197052 kB' 'VmallocChunk: 0 kB' 'Percpu: 38592 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1025' 'HugePages_Free: 1025' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2099200 kB' 'DirectMap4k: 2506332 kB' 'DirectMap2M: 24676352 kB' 'DirectMap1G: 41943040 kB' 00:02:47.422 22:40:38 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:47.422 22:40:38 -- setup/common.sh@32 -- # continue 00:02:47.422 22:40:38 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.422 22:40:38 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.422 22:40:38 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:47.422 22:40:38 -- setup/common.sh@32 -- # continue 00:02:47.422 22:40:38 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.422 22:40:38 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.422 22:40:38 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:47.422 22:40:38 -- setup/common.sh@32 -- # continue 00:02:47.422 22:40:38 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.422 22:40:38 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.422 22:40:38 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:47.422 22:40:38 -- setup/common.sh@32 -- # continue 00:02:47.422 22:40:38 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.422 22:40:38 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.422 22:40:38 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:47.422 22:40:38 -- setup/common.sh@32 -- # continue 00:02:47.422 22:40:38 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.422 22:40:38 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.422 22:40:38 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:47.422 22:40:38 -- setup/common.sh@32 -- # continue 00:02:47.422 22:40:38 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.422 22:40:38 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.422 22:40:38 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:47.422 22:40:38 -- setup/common.sh@32 -- # continue 00:02:47.422 22:40:38 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.422 22:40:38 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.422 22:40:38 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:47.422 22:40:38 -- setup/common.sh@32 -- # continue 00:02:47.422 22:40:38 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.422 22:40:38 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.422 22:40:38 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:47.422 22:40:38 -- setup/common.sh@32 -- # continue 00:02:47.422 22:40:38 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.422 22:40:38 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.422 22:40:38 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:47.422 22:40:38 -- setup/common.sh@32 -- # continue 00:02:47.422 22:40:38 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.422 22:40:38 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.422 22:40:38 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:47.422 22:40:38 -- setup/common.sh@32 -- # continue 00:02:47.422 22:40:38 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.422 22:40:38 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.422 22:40:38 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:47.422 22:40:38 -- setup/common.sh@32 -- # continue 00:02:47.422 22:40:38 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.422 22:40:38 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.422 22:40:38 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:47.422 22:40:38 -- setup/common.sh@32 -- # continue 00:02:47.422 22:40:38 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.422 22:40:38 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.422 22:40:38 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:47.422 22:40:38 -- setup/common.sh@32 -- # continue 00:02:47.422 22:40:38 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.422 22:40:38 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.422 22:40:38 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:47.422 22:40:38 -- setup/common.sh@32 -- # continue 00:02:47.422 22:40:38 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.422 22:40:38 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.422 22:40:38 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:47.422 22:40:38 -- setup/common.sh@32 -- # continue 00:02:47.422 22:40:38 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.422 22:40:38 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.422 22:40:38 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:47.422 22:40:38 -- setup/common.sh@32 -- # continue 00:02:47.422 22:40:38 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.422 22:40:38 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.422 22:40:38 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:47.422 22:40:38 -- setup/common.sh@32 -- # continue 00:02:47.422 22:40:38 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.422 22:40:38 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.423 22:40:38 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:47.423 22:40:38 -- setup/common.sh@32 -- # continue 00:02:47.423 22:40:38 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.423 22:40:38 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.423 22:40:38 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:47.423 22:40:38 -- setup/common.sh@32 -- # continue 00:02:47.423 22:40:38 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.423 22:40:38 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.423 22:40:38 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:47.423 22:40:38 -- setup/common.sh@32 -- # continue 00:02:47.423 22:40:38 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.423 22:40:38 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.423 22:40:38 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:47.423 22:40:38 -- setup/common.sh@32 -- # continue 00:02:47.423 22:40:38 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.423 22:40:38 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.423 22:40:38 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:47.423 22:40:38 -- setup/common.sh@32 -- # continue 00:02:47.423 22:40:38 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.423 22:40:38 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.423 22:40:38 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:47.423 22:40:38 -- setup/common.sh@32 -- # continue 00:02:47.423 22:40:38 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.423 22:40:38 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.423 22:40:38 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:47.423 22:40:38 -- setup/common.sh@32 -- # continue 00:02:47.423 22:40:38 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.423 22:40:38 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.423 22:40:38 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:47.423 22:40:38 -- setup/common.sh@32 -- # continue 00:02:47.423 22:40:38 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.423 22:40:38 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.423 22:40:38 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:47.423 22:40:38 -- setup/common.sh@32 -- # continue 00:02:47.423 22:40:38 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.423 22:40:38 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.423 22:40:38 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:47.423 22:40:38 -- setup/common.sh@32 -- # continue 00:02:47.423 22:40:38 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.423 22:40:38 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.423 22:40:38 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:47.423 22:40:38 -- setup/common.sh@32 -- # continue 00:02:47.423 22:40:38 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.423 22:40:38 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.423 22:40:38 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:47.423 22:40:38 -- setup/common.sh@32 -- # continue 00:02:47.423 22:40:38 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.423 22:40:38 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.423 22:40:38 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:47.423 22:40:38 -- setup/common.sh@32 -- # continue 00:02:47.423 22:40:38 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.423 22:40:38 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.423 22:40:38 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:47.423 22:40:38 -- setup/common.sh@32 -- # continue 00:02:47.423 22:40:38 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.423 22:40:38 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.423 22:40:38 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:47.423 22:40:38 -- setup/common.sh@32 -- # continue 00:02:47.423 22:40:38 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.423 22:40:38 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.423 22:40:38 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:47.423 22:40:38 -- setup/common.sh@32 -- # continue 00:02:47.423 22:40:38 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.423 22:40:38 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.423 22:40:38 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:47.423 22:40:38 -- setup/common.sh@32 -- # continue 00:02:47.423 22:40:38 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.423 22:40:38 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.423 22:40:38 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:47.423 22:40:38 -- setup/common.sh@32 -- # continue 00:02:47.423 22:40:38 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.423 22:40:38 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.423 22:40:38 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:47.423 22:40:38 -- setup/common.sh@32 -- # continue 00:02:47.423 22:40:38 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.423 22:40:38 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.423 22:40:38 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:47.423 22:40:38 -- setup/common.sh@32 -- # continue 00:02:47.423 22:40:38 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.423 22:40:38 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.423 22:40:38 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:47.423 22:40:38 -- setup/common.sh@32 -- # continue 00:02:47.423 22:40:38 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.423 22:40:38 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.423 22:40:38 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:47.423 22:40:38 -- setup/common.sh@32 -- # continue 00:02:47.423 22:40:38 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.423 22:40:38 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.423 22:40:38 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:47.423 22:40:38 -- setup/common.sh@32 -- # continue 00:02:47.423 22:40:38 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.423 22:40:38 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.423 22:40:38 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:47.423 22:40:38 -- setup/common.sh@32 -- # continue 00:02:47.423 22:40:38 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.423 22:40:38 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.423 22:40:38 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:47.423 22:40:38 -- setup/common.sh@32 -- # continue 00:02:47.423 22:40:38 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.423 22:40:38 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.423 22:40:38 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:47.423 22:40:38 -- setup/common.sh@32 -- # continue 00:02:47.423 22:40:38 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.423 22:40:38 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.423 22:40:38 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:47.423 22:40:38 -- setup/common.sh@32 -- # continue 00:02:47.423 22:40:38 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.423 22:40:38 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.423 22:40:38 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:47.423 22:40:38 -- setup/common.sh@32 -- # continue 00:02:47.423 22:40:38 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.423 22:40:38 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.423 22:40:38 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:47.423 22:40:38 -- setup/common.sh@32 -- # continue 00:02:47.423 22:40:38 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.423 22:40:38 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.423 22:40:38 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:47.423 22:40:38 -- setup/common.sh@32 -- # continue 00:02:47.423 22:40:38 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.423 22:40:38 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.423 22:40:38 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:47.423 22:40:38 -- setup/common.sh@32 -- # continue 00:02:47.423 22:40:38 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.423 22:40:38 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.423 22:40:38 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:47.423 22:40:38 -- setup/common.sh@32 -- # continue 00:02:47.423 22:40:38 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.423 22:40:38 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.423 22:40:38 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:47.423 22:40:38 -- setup/common.sh@33 -- # echo 0 00:02:47.423 22:40:38 -- setup/common.sh@33 -- # return 0 00:02:47.423 22:40:38 -- setup/hugepages.sh@100 -- # resv=0 00:02:47.423 22:40:38 -- setup/hugepages.sh@102 -- # echo nr_hugepages=1025 00:02:47.423 nr_hugepages=1025 00:02:47.423 22:40:38 -- setup/hugepages.sh@103 -- # echo resv_hugepages=0 00:02:47.423 resv_hugepages=0 00:02:47.423 22:40:38 -- setup/hugepages.sh@104 -- # echo surplus_hugepages=0 00:02:47.423 surplus_hugepages=0 00:02:47.423 22:40:38 -- setup/hugepages.sh@105 -- # echo anon_hugepages=0 00:02:47.423 anon_hugepages=0 00:02:47.423 22:40:38 -- setup/hugepages.sh@107 -- # (( 1025 == nr_hugepages + surp + resv )) 00:02:47.423 22:40:38 -- setup/hugepages.sh@109 -- # (( 1025 == nr_hugepages )) 00:02:47.423 22:40:38 -- setup/hugepages.sh@110 -- # get_meminfo HugePages_Total 00:02:47.423 22:40:38 -- setup/common.sh@17 -- # local get=HugePages_Total 00:02:47.423 22:40:38 -- setup/common.sh@18 -- # local node= 00:02:47.423 22:40:38 -- setup/common.sh@19 -- # local var val 00:02:47.423 22:40:38 -- setup/common.sh@20 -- # local mem_f mem 00:02:47.423 22:40:38 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:02:47.423 22:40:38 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:02:47.423 22:40:38 -- setup/common.sh@25 -- # [[ -n '' ]] 00:02:47.423 22:40:38 -- setup/common.sh@28 -- # mapfile -t mem 00:02:47.423 22:40:38 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:02:47.423 22:40:38 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.423 22:40:38 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.424 22:40:38 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60541736 kB' 'MemFree: 43371556 kB' 'MemAvailable: 47362784 kB' 'Buffers: 2696 kB' 'Cached: 12518428 kB' 'SwapCached: 0 kB' 'Active: 9322772 kB' 'Inactive: 3655836 kB' 'Active(anon): 8758456 kB' 'Inactive(anon): 0 kB' 'Active(file): 564316 kB' 'Inactive(file): 3655836 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 460832 kB' 'Mapped: 201456 kB' 'Shmem: 8300972 kB' 'KReclaimable: 415512 kB' 'Slab: 806864 kB' 'SReclaimable: 415512 kB' 'SUnreclaim: 391352 kB' 'KernelStack: 12800 kB' 'PageTables: 8164 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37609872 kB' 'Committed_AS: 9884384 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 197052 kB' 'VmallocChunk: 0 kB' 'Percpu: 38592 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1025' 'HugePages_Free: 1025' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2099200 kB' 'DirectMap4k: 2506332 kB' 'DirectMap2M: 24676352 kB' 'DirectMap1G: 41943040 kB' 00:02:47.424 22:40:38 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:47.424 22:40:38 -- setup/common.sh@32 -- # continue 00:02:47.424 22:40:38 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.424 22:40:38 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.424 22:40:38 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:47.424 22:40:38 -- setup/common.sh@32 -- # continue 00:02:47.424 22:40:38 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.424 22:40:38 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.424 22:40:38 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:47.424 22:40:38 -- setup/common.sh@32 -- # continue 00:02:47.424 22:40:38 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.424 22:40:38 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.424 22:40:38 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:47.424 22:40:38 -- setup/common.sh@32 -- # continue 00:02:47.424 22:40:38 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.424 22:40:38 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.424 22:40:38 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:47.424 22:40:38 -- setup/common.sh@32 -- # continue 00:02:47.424 22:40:38 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.424 22:40:38 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.424 22:40:38 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:47.424 22:40:38 -- setup/common.sh@32 -- # continue 00:02:47.424 22:40:38 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.424 22:40:38 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.424 22:40:38 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:47.424 22:40:38 -- setup/common.sh@32 -- # continue 00:02:47.424 22:40:38 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.424 22:40:38 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.424 22:40:38 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:47.424 22:40:38 -- setup/common.sh@32 -- # continue 00:02:47.424 22:40:38 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.424 22:40:38 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.424 22:40:38 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:47.424 22:40:38 -- setup/common.sh@32 -- # continue 00:02:47.424 22:40:38 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.424 22:40:38 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.424 22:40:38 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:47.424 22:40:38 -- setup/common.sh@32 -- # continue 00:02:47.424 22:40:38 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.424 22:40:38 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.424 22:40:38 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:47.424 22:40:38 -- setup/common.sh@32 -- # continue 00:02:47.424 22:40:38 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.424 22:40:38 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.424 22:40:38 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:47.424 22:40:38 -- setup/common.sh@32 -- # continue 00:02:47.424 22:40:38 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.424 22:40:38 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.424 22:40:38 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:47.424 22:40:38 -- setup/common.sh@32 -- # continue 00:02:47.424 22:40:38 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.424 22:40:38 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.424 22:40:38 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:47.424 22:40:38 -- setup/common.sh@32 -- # continue 00:02:47.424 22:40:38 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.424 22:40:38 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.424 22:40:38 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:47.424 22:40:38 -- setup/common.sh@32 -- # continue 00:02:47.424 22:40:38 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.424 22:40:38 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.424 22:40:38 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:47.424 22:40:38 -- setup/common.sh@32 -- # continue 00:02:47.424 22:40:38 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.424 22:40:38 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.424 22:40:38 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:47.424 22:40:38 -- setup/common.sh@32 -- # continue 00:02:47.424 22:40:38 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.424 22:40:38 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.424 22:40:38 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:47.424 22:40:38 -- setup/common.sh@32 -- # continue 00:02:47.424 22:40:38 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.424 22:40:38 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.424 22:40:38 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:47.424 22:40:38 -- setup/common.sh@32 -- # continue 00:02:47.424 22:40:38 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.424 22:40:38 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.424 22:40:38 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:47.424 22:40:38 -- setup/common.sh@32 -- # continue 00:02:47.424 22:40:38 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.424 22:40:38 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.424 22:40:38 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:47.424 22:40:38 -- setup/common.sh@32 -- # continue 00:02:47.424 22:40:38 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.424 22:40:38 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.424 22:40:38 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:47.424 22:40:38 -- setup/common.sh@32 -- # continue 00:02:47.424 22:40:38 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.424 22:40:38 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.424 22:40:38 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:47.424 22:40:38 -- setup/common.sh@32 -- # continue 00:02:47.424 22:40:38 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.424 22:40:38 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.425 22:40:38 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:47.425 22:40:38 -- setup/common.sh@32 -- # continue 00:02:47.425 22:40:38 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.425 22:40:38 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.425 22:40:38 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:47.425 22:40:38 -- setup/common.sh@32 -- # continue 00:02:47.425 22:40:38 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.425 22:40:38 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.425 22:40:38 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:47.425 22:40:38 -- setup/common.sh@32 -- # continue 00:02:47.425 22:40:38 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.425 22:40:38 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.425 22:40:38 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:47.425 22:40:38 -- setup/common.sh@32 -- # continue 00:02:47.425 22:40:38 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.425 22:40:38 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.425 22:40:38 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:47.425 22:40:38 -- setup/common.sh@32 -- # continue 00:02:47.425 22:40:38 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.425 22:40:38 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.425 22:40:38 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:47.425 22:40:38 -- setup/common.sh@32 -- # continue 00:02:47.425 22:40:38 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.425 22:40:38 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.425 22:40:38 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:47.425 22:40:38 -- setup/common.sh@32 -- # continue 00:02:47.425 22:40:38 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.425 22:40:38 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.425 22:40:38 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:47.425 22:40:38 -- setup/common.sh@32 -- # continue 00:02:47.425 22:40:38 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.425 22:40:38 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.425 22:40:38 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:47.425 22:40:38 -- setup/common.sh@32 -- # continue 00:02:47.425 22:40:38 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.425 22:40:38 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.425 22:40:38 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:47.425 22:40:38 -- setup/common.sh@32 -- # continue 00:02:47.425 22:40:38 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.425 22:40:38 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.425 22:40:38 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:47.425 22:40:38 -- setup/common.sh@32 -- # continue 00:02:47.425 22:40:38 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.425 22:40:38 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.425 22:40:38 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:47.425 22:40:38 -- setup/common.sh@32 -- # continue 00:02:47.425 22:40:38 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.425 22:40:38 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.425 22:40:38 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:47.425 22:40:38 -- setup/common.sh@32 -- # continue 00:02:47.425 22:40:38 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.425 22:40:38 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.425 22:40:38 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:47.425 22:40:38 -- setup/common.sh@32 -- # continue 00:02:47.425 22:40:38 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.425 22:40:38 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.425 22:40:38 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:47.425 22:40:38 -- setup/common.sh@32 -- # continue 00:02:47.425 22:40:38 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.425 22:40:38 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.425 22:40:38 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:47.425 22:40:38 -- setup/common.sh@32 -- # continue 00:02:47.425 22:40:38 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.425 22:40:38 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.425 22:40:38 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:47.425 22:40:38 -- setup/common.sh@32 -- # continue 00:02:47.425 22:40:38 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.425 22:40:38 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.425 22:40:38 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:47.425 22:40:38 -- setup/common.sh@32 -- # continue 00:02:47.425 22:40:38 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.425 22:40:38 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.425 22:40:38 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:47.425 22:40:38 -- setup/common.sh@32 -- # continue 00:02:47.425 22:40:38 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.425 22:40:38 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.425 22:40:38 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:47.425 22:40:38 -- setup/common.sh@32 -- # continue 00:02:47.425 22:40:38 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.425 22:40:38 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.425 22:40:38 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:47.425 22:40:38 -- setup/common.sh@32 -- # continue 00:02:47.425 22:40:38 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.425 22:40:38 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.425 22:40:38 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:47.425 22:40:38 -- setup/common.sh@32 -- # continue 00:02:47.425 22:40:38 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.425 22:40:38 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.425 22:40:38 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:47.425 22:40:38 -- setup/common.sh@32 -- # continue 00:02:47.425 22:40:38 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.425 22:40:38 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.425 22:40:38 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:47.425 22:40:38 -- setup/common.sh@32 -- # continue 00:02:47.425 22:40:38 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.425 22:40:38 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.425 22:40:38 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:47.425 22:40:38 -- setup/common.sh@32 -- # continue 00:02:47.425 22:40:38 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.425 22:40:38 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.425 22:40:38 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:47.425 22:40:38 -- setup/common.sh@33 -- # echo 1025 00:02:47.425 22:40:38 -- setup/common.sh@33 -- # return 0 00:02:47.425 22:40:38 -- setup/hugepages.sh@110 -- # (( 1025 == nr_hugepages + surp + resv )) 00:02:47.425 22:40:38 -- setup/hugepages.sh@112 -- # get_nodes 00:02:47.425 22:40:38 -- setup/hugepages.sh@27 -- # local node 00:02:47.425 22:40:38 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:02:47.425 22:40:38 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=512 00:02:47.425 22:40:38 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:02:47.425 22:40:38 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=513 00:02:47.425 22:40:38 -- setup/hugepages.sh@32 -- # no_nodes=2 00:02:47.425 22:40:38 -- setup/hugepages.sh@33 -- # (( no_nodes > 0 )) 00:02:47.425 22:40:38 -- setup/hugepages.sh@115 -- # for node in "${!nodes_test[@]}" 00:02:47.425 22:40:38 -- setup/hugepages.sh@116 -- # (( nodes_test[node] += resv )) 00:02:47.425 22:40:38 -- setup/hugepages.sh@117 -- # get_meminfo HugePages_Surp 0 00:02:47.425 22:40:38 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:02:47.425 22:40:38 -- setup/common.sh@18 -- # local node=0 00:02:47.425 22:40:38 -- setup/common.sh@19 -- # local var val 00:02:47.425 22:40:38 -- setup/common.sh@20 -- # local mem_f mem 00:02:47.425 22:40:38 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:02:47.425 22:40:38 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node0/meminfo ]] 00:02:47.425 22:40:38 -- setup/common.sh@24 -- # mem_f=/sys/devices/system/node/node0/meminfo 00:02:47.425 22:40:38 -- setup/common.sh@28 -- # mapfile -t mem 00:02:47.425 22:40:38 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:02:47.425 22:40:38 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.425 22:40:38 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.425 22:40:38 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 32829884 kB' 'MemFree: 20160064 kB' 'MemUsed: 12669820 kB' 'SwapCached: 0 kB' 'Active: 6998328 kB' 'Inactive: 3490860 kB' 'Active(anon): 6617116 kB' 'Inactive(anon): 0 kB' 'Active(file): 381212 kB' 'Inactive(file): 3490860 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'FilePages: 10244236 kB' 'Mapped: 156416 kB' 'AnonPages: 248160 kB' 'Shmem: 6372164 kB' 'KernelStack: 6680 kB' 'PageTables: 4624 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'KReclaimable: 272444 kB' 'Slab: 484788 kB' 'SReclaimable: 272444 kB' 'SUnreclaim: 212344 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 512' 'HugePages_Free: 512' 'HugePages_Surp: 0' 00:02:47.425 22:40:38 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:47.425 22:40:38 -- setup/common.sh@32 -- # continue 00:02:47.425 22:40:38 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.425 22:40:38 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.425 22:40:38 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:47.425 22:40:38 -- setup/common.sh@32 -- # continue 00:02:47.425 22:40:38 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.425 22:40:38 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.425 22:40:38 -- setup/common.sh@32 -- # [[ MemUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:47.425 22:40:38 -- setup/common.sh@32 -- # continue 00:02:47.426 22:40:38 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.426 22:40:38 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.426 22:40:38 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:47.426 22:40:38 -- setup/common.sh@32 -- # continue 00:02:47.426 22:40:38 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.426 22:40:38 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.426 22:40:38 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:47.426 22:40:38 -- setup/common.sh@32 -- # continue 00:02:47.426 22:40:38 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.426 22:40:38 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.426 22:40:38 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:47.426 22:40:38 -- setup/common.sh@32 -- # continue 00:02:47.426 22:40:38 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.426 22:40:38 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.426 22:40:38 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:47.426 22:40:38 -- setup/common.sh@32 -- # continue 00:02:47.426 22:40:38 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.426 22:40:38 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.426 22:40:38 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:47.426 22:40:38 -- setup/common.sh@32 -- # continue 00:02:47.426 22:40:38 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.426 22:40:38 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.426 22:40:38 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:47.426 22:40:38 -- setup/common.sh@32 -- # continue 00:02:47.426 22:40:38 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.426 22:40:38 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.426 22:40:38 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:47.426 22:40:38 -- setup/common.sh@32 -- # continue 00:02:47.426 22:40:38 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.426 22:40:38 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.426 22:40:38 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:47.426 22:40:38 -- setup/common.sh@32 -- # continue 00:02:47.426 22:40:38 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.426 22:40:38 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.426 22:40:38 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:47.426 22:40:38 -- setup/common.sh@32 -- # continue 00:02:47.426 22:40:38 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.426 22:40:38 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.426 22:40:38 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:47.426 22:40:38 -- setup/common.sh@32 -- # continue 00:02:47.426 22:40:38 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.426 22:40:38 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.426 22:40:38 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:47.426 22:40:38 -- setup/common.sh@32 -- # continue 00:02:47.426 22:40:38 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.426 22:40:38 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.426 22:40:38 -- setup/common.sh@32 -- # [[ FilePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:47.426 22:40:38 -- setup/common.sh@32 -- # continue 00:02:47.426 22:40:38 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.426 22:40:38 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.426 22:40:38 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:47.426 22:40:38 -- setup/common.sh@32 -- # continue 00:02:47.426 22:40:38 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.426 22:40:38 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.426 22:40:38 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:47.426 22:40:38 -- setup/common.sh@32 -- # continue 00:02:47.426 22:40:38 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.426 22:40:38 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.426 22:40:38 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:47.426 22:40:38 -- setup/common.sh@32 -- # continue 00:02:47.426 22:40:38 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.426 22:40:38 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.426 22:40:38 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:47.426 22:40:38 -- setup/common.sh@32 -- # continue 00:02:47.426 22:40:38 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.426 22:40:38 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.426 22:40:38 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:47.426 22:40:38 -- setup/common.sh@32 -- # continue 00:02:47.426 22:40:38 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.426 22:40:38 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.426 22:40:38 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:47.426 22:40:38 -- setup/common.sh@32 -- # continue 00:02:47.426 22:40:38 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.426 22:40:38 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.426 22:40:38 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:47.426 22:40:38 -- setup/common.sh@32 -- # continue 00:02:47.426 22:40:38 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.426 22:40:38 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.426 22:40:38 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:47.426 22:40:38 -- setup/common.sh@32 -- # continue 00:02:47.426 22:40:38 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.426 22:40:38 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.426 22:40:38 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:47.426 22:40:38 -- setup/common.sh@32 -- # continue 00:02:47.426 22:40:38 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.426 22:40:38 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.426 22:40:38 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:47.426 22:40:38 -- setup/common.sh@32 -- # continue 00:02:47.426 22:40:38 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.426 22:40:38 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.426 22:40:38 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:47.426 22:40:38 -- setup/common.sh@32 -- # continue 00:02:47.426 22:40:38 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.426 22:40:38 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.426 22:40:38 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:47.426 22:40:38 -- setup/common.sh@32 -- # continue 00:02:47.426 22:40:38 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.426 22:40:38 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.426 22:40:38 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:47.426 22:40:38 -- setup/common.sh@32 -- # continue 00:02:47.426 22:40:38 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.426 22:40:38 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.426 22:40:38 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:47.426 22:40:38 -- setup/common.sh@32 -- # continue 00:02:47.426 22:40:38 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.426 22:40:38 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.426 22:40:38 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:47.426 22:40:38 -- setup/common.sh@32 -- # continue 00:02:47.426 22:40:38 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.426 22:40:38 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.426 22:40:38 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:47.426 22:40:38 -- setup/common.sh@32 -- # continue 00:02:47.426 22:40:38 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.426 22:40:38 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.426 22:40:38 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:47.426 22:40:38 -- setup/common.sh@32 -- # continue 00:02:47.426 22:40:38 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.426 22:40:38 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.426 22:40:38 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:47.426 22:40:38 -- setup/common.sh@32 -- # continue 00:02:47.426 22:40:38 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.426 22:40:38 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.426 22:40:38 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:47.426 22:40:38 -- setup/common.sh@32 -- # continue 00:02:47.426 22:40:38 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.426 22:40:38 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.426 22:40:38 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:47.426 22:40:38 -- setup/common.sh@32 -- # continue 00:02:47.426 22:40:38 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.426 22:40:38 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.426 22:40:38 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:47.426 22:40:38 -- setup/common.sh@32 -- # continue 00:02:47.426 22:40:38 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.426 22:40:38 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.426 22:40:38 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:47.426 22:40:38 -- setup/common.sh@33 -- # echo 0 00:02:47.426 22:40:38 -- setup/common.sh@33 -- # return 0 00:02:47.426 22:40:38 -- setup/hugepages.sh@117 -- # (( nodes_test[node] += 0 )) 00:02:47.426 22:40:38 -- setup/hugepages.sh@115 -- # for node in "${!nodes_test[@]}" 00:02:47.426 22:40:38 -- setup/hugepages.sh@116 -- # (( nodes_test[node] += resv )) 00:02:47.426 22:40:38 -- setup/hugepages.sh@117 -- # get_meminfo HugePages_Surp 1 00:02:47.427 22:40:38 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:02:47.427 22:40:38 -- setup/common.sh@18 -- # local node=1 00:02:47.427 22:40:38 -- setup/common.sh@19 -- # local var val 00:02:47.427 22:40:38 -- setup/common.sh@20 -- # local mem_f mem 00:02:47.427 22:40:38 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:02:47.427 22:40:38 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node1/meminfo ]] 00:02:47.427 22:40:38 -- setup/common.sh@24 -- # mem_f=/sys/devices/system/node/node1/meminfo 00:02:47.427 22:40:38 -- setup/common.sh@28 -- # mapfile -t mem 00:02:47.427 22:40:38 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:02:47.427 22:40:38 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.427 22:40:38 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.427 22:40:38 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 27711852 kB' 'MemFree: 23211492 kB' 'MemUsed: 4500360 kB' 'SwapCached: 0 kB' 'Active: 2324428 kB' 'Inactive: 164976 kB' 'Active(anon): 2141324 kB' 'Inactive(anon): 0 kB' 'Active(file): 183104 kB' 'Inactive(file): 164976 kB' 'Unevictable: 0 kB' 'Mlocked: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'FilePages: 2276904 kB' 'Mapped: 45040 kB' 'AnonPages: 212636 kB' 'Shmem: 1928824 kB' 'KernelStack: 6104 kB' 'PageTables: 3492 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'KReclaimable: 143068 kB' 'Slab: 322076 kB' 'SReclaimable: 143068 kB' 'SUnreclaim: 179008 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 513' 'HugePages_Free: 513' 'HugePages_Surp: 0' 00:02:47.427 22:40:38 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:47.427 22:40:38 -- setup/common.sh@32 -- # continue 00:02:47.427 22:40:38 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.427 22:40:38 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.427 22:40:38 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:47.427 22:40:38 -- setup/common.sh@32 -- # continue 00:02:47.427 22:40:38 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.427 22:40:38 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.427 22:40:38 -- setup/common.sh@32 -- # [[ MemUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:47.427 22:40:38 -- setup/common.sh@32 -- # continue 00:02:47.427 22:40:38 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.427 22:40:38 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.427 22:40:38 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:47.427 22:40:38 -- setup/common.sh@32 -- # continue 00:02:47.427 22:40:38 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.427 22:40:38 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.427 22:40:38 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:47.427 22:40:38 -- setup/common.sh@32 -- # continue 00:02:47.427 22:40:38 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.427 22:40:38 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.427 22:40:38 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:47.427 22:40:38 -- setup/common.sh@32 -- # continue 00:02:47.427 22:40:38 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.427 22:40:38 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.427 22:40:38 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:47.427 22:40:38 -- setup/common.sh@32 -- # continue 00:02:47.427 22:40:38 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.427 22:40:38 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.427 22:40:38 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:47.427 22:40:38 -- setup/common.sh@32 -- # continue 00:02:47.427 22:40:38 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.427 22:40:38 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.427 22:40:38 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:47.427 22:40:38 -- setup/common.sh@32 -- # continue 00:02:47.427 22:40:38 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.427 22:40:38 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.427 22:40:38 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:47.427 22:40:38 -- setup/common.sh@32 -- # continue 00:02:47.427 22:40:38 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.427 22:40:38 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.427 22:40:38 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:47.427 22:40:38 -- setup/common.sh@32 -- # continue 00:02:47.427 22:40:38 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.427 22:40:38 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.427 22:40:38 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:47.427 22:40:38 -- setup/common.sh@32 -- # continue 00:02:47.427 22:40:38 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.427 22:40:38 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.427 22:40:38 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:47.427 22:40:38 -- setup/common.sh@32 -- # continue 00:02:47.427 22:40:38 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.427 22:40:38 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.427 22:40:38 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:47.427 22:40:38 -- setup/common.sh@32 -- # continue 00:02:47.427 22:40:38 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.427 22:40:38 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.427 22:40:38 -- setup/common.sh@32 -- # [[ FilePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:47.427 22:40:38 -- setup/common.sh@32 -- # continue 00:02:47.427 22:40:38 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.427 22:40:38 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.427 22:40:38 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:47.427 22:40:38 -- setup/common.sh@32 -- # continue 00:02:47.427 22:40:38 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.427 22:40:38 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.427 22:40:38 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:47.427 22:40:38 -- setup/common.sh@32 -- # continue 00:02:47.427 22:40:38 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.427 22:40:38 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.427 22:40:38 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:47.427 22:40:38 -- setup/common.sh@32 -- # continue 00:02:47.427 22:40:38 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.427 22:40:38 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.427 22:40:38 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:47.427 22:40:38 -- setup/common.sh@32 -- # continue 00:02:47.427 22:40:38 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.427 22:40:38 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.427 22:40:38 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:47.427 22:40:38 -- setup/common.sh@32 -- # continue 00:02:47.427 22:40:38 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.427 22:40:38 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.427 22:40:38 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:47.427 22:40:38 -- setup/common.sh@32 -- # continue 00:02:47.427 22:40:38 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.427 22:40:38 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.427 22:40:38 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:47.427 22:40:38 -- setup/common.sh@32 -- # continue 00:02:47.427 22:40:38 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.427 22:40:38 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.427 22:40:38 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:47.427 22:40:38 -- setup/common.sh@32 -- # continue 00:02:47.427 22:40:38 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.427 22:40:38 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.427 22:40:38 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:47.427 22:40:38 -- setup/common.sh@32 -- # continue 00:02:47.427 22:40:38 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.427 22:40:38 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.427 22:40:38 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:47.427 22:40:38 -- setup/common.sh@32 -- # continue 00:02:47.427 22:40:38 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.427 22:40:38 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.427 22:40:38 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:47.427 22:40:38 -- setup/common.sh@32 -- # continue 00:02:47.427 22:40:38 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.427 22:40:38 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.427 22:40:38 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:47.427 22:40:38 -- setup/common.sh@32 -- # continue 00:02:47.427 22:40:38 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.427 22:40:38 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.427 22:40:38 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:47.427 22:40:38 -- setup/common.sh@32 -- # continue 00:02:47.427 22:40:38 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.427 22:40:38 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.428 22:40:38 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:47.428 22:40:38 -- setup/common.sh@32 -- # continue 00:02:47.428 22:40:38 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.428 22:40:38 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.428 22:40:38 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:47.428 22:40:38 -- setup/common.sh@32 -- # continue 00:02:47.428 22:40:38 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.428 22:40:38 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.428 22:40:38 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:47.428 22:40:38 -- setup/common.sh@32 -- # continue 00:02:47.428 22:40:38 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.428 22:40:38 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.428 22:40:38 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:47.428 22:40:38 -- setup/common.sh@32 -- # continue 00:02:47.428 22:40:38 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.428 22:40:38 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.428 22:40:38 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:47.428 22:40:38 -- setup/common.sh@32 -- # continue 00:02:47.428 22:40:38 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.428 22:40:38 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.428 22:40:38 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:47.428 22:40:38 -- setup/common.sh@32 -- # continue 00:02:47.428 22:40:38 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.428 22:40:38 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.428 22:40:38 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:47.428 22:40:38 -- setup/common.sh@32 -- # continue 00:02:47.428 22:40:38 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.428 22:40:38 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.428 22:40:38 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:47.428 22:40:38 -- setup/common.sh@32 -- # continue 00:02:47.428 22:40:38 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.428 22:40:38 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.428 22:40:38 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:47.428 22:40:38 -- setup/common.sh@33 -- # echo 0 00:02:47.428 22:40:38 -- setup/common.sh@33 -- # return 0 00:02:47.428 22:40:38 -- setup/hugepages.sh@117 -- # (( nodes_test[node] += 0 )) 00:02:47.428 22:40:38 -- setup/hugepages.sh@126 -- # for node in "${!nodes_test[@]}" 00:02:47.428 22:40:38 -- setup/hugepages.sh@127 -- # sorted_t[nodes_test[node]]=1 00:02:47.428 22:40:38 -- setup/hugepages.sh@127 -- # sorted_s[nodes_sys[node]]=1 00:02:47.428 22:40:38 -- setup/hugepages.sh@128 -- # echo 'node0=512 expecting 513' 00:02:47.428 node0=512 expecting 513 00:02:47.428 22:40:38 -- setup/hugepages.sh@126 -- # for node in "${!nodes_test[@]}" 00:02:47.428 22:40:38 -- setup/hugepages.sh@127 -- # sorted_t[nodes_test[node]]=1 00:02:47.428 22:40:38 -- setup/hugepages.sh@127 -- # sorted_s[nodes_sys[node]]=1 00:02:47.428 22:40:38 -- setup/hugepages.sh@128 -- # echo 'node1=513 expecting 512' 00:02:47.428 node1=513 expecting 512 00:02:47.428 22:40:38 -- setup/hugepages.sh@130 -- # [[ 512 513 == \5\1\2\ \5\1\3 ]] 00:02:47.428 00:02:47.428 real 0m1.395s 00:02:47.428 user 0m0.603s 00:02:47.428 sys 0m0.754s 00:02:47.428 22:40:38 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:02:47.428 22:40:38 -- common/autotest_common.sh@10 -- # set +x 00:02:47.428 ************************************ 00:02:47.428 END TEST odd_alloc 00:02:47.428 ************************************ 00:02:47.428 22:40:38 -- setup/hugepages.sh@214 -- # run_test custom_alloc custom_alloc 00:02:47.428 22:40:38 -- common/autotest_common.sh@1077 -- # '[' 2 -le 1 ']' 00:02:47.428 22:40:38 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:02:47.428 22:40:38 -- common/autotest_common.sh@10 -- # set +x 00:02:47.428 ************************************ 00:02:47.428 START TEST custom_alloc 00:02:47.428 ************************************ 00:02:47.428 22:40:38 -- common/autotest_common.sh@1104 -- # custom_alloc 00:02:47.428 22:40:38 -- setup/hugepages.sh@167 -- # local IFS=, 00:02:47.428 22:40:38 -- setup/hugepages.sh@169 -- # local node 00:02:47.428 22:40:38 -- setup/hugepages.sh@170 -- # nodes_hp=() 00:02:47.428 22:40:38 -- setup/hugepages.sh@170 -- # local nodes_hp 00:02:47.428 22:40:38 -- setup/hugepages.sh@172 -- # local nr_hugepages=0 _nr_hugepages=0 00:02:47.428 22:40:38 -- setup/hugepages.sh@174 -- # get_test_nr_hugepages 1048576 00:02:47.428 22:40:38 -- setup/hugepages.sh@49 -- # local size=1048576 00:02:47.428 22:40:38 -- setup/hugepages.sh@50 -- # (( 1 > 1 )) 00:02:47.428 22:40:38 -- setup/hugepages.sh@55 -- # (( size >= default_hugepages )) 00:02:47.428 22:40:38 -- setup/hugepages.sh@57 -- # nr_hugepages=512 00:02:47.428 22:40:38 -- setup/hugepages.sh@58 -- # get_test_nr_hugepages_per_node 00:02:47.428 22:40:38 -- setup/hugepages.sh@62 -- # user_nodes=() 00:02:47.428 22:40:38 -- setup/hugepages.sh@62 -- # local user_nodes 00:02:47.428 22:40:38 -- setup/hugepages.sh@64 -- # local _nr_hugepages=512 00:02:47.428 22:40:38 -- setup/hugepages.sh@65 -- # local _no_nodes=2 00:02:47.428 22:40:38 -- setup/hugepages.sh@67 -- # nodes_test=() 00:02:47.428 22:40:38 -- setup/hugepages.sh@67 -- # local -g nodes_test 00:02:47.428 22:40:38 -- setup/hugepages.sh@69 -- # (( 0 > 0 )) 00:02:47.428 22:40:38 -- setup/hugepages.sh@74 -- # (( 0 > 0 )) 00:02:47.428 22:40:38 -- setup/hugepages.sh@81 -- # (( _no_nodes > 0 )) 00:02:47.428 22:40:38 -- setup/hugepages.sh@82 -- # nodes_test[_no_nodes - 1]=256 00:02:47.428 22:40:38 -- setup/hugepages.sh@83 -- # : 256 00:02:47.428 22:40:38 -- setup/hugepages.sh@84 -- # : 1 00:02:47.428 22:40:38 -- setup/hugepages.sh@81 -- # (( _no_nodes > 0 )) 00:02:47.428 22:40:38 -- setup/hugepages.sh@82 -- # nodes_test[_no_nodes - 1]=256 00:02:47.428 22:40:38 -- setup/hugepages.sh@83 -- # : 0 00:02:47.428 22:40:38 -- setup/hugepages.sh@84 -- # : 0 00:02:47.428 22:40:38 -- setup/hugepages.sh@81 -- # (( _no_nodes > 0 )) 00:02:47.428 22:40:38 -- setup/hugepages.sh@175 -- # nodes_hp[0]=512 00:02:47.428 22:40:38 -- setup/hugepages.sh@176 -- # (( 2 > 1 )) 00:02:47.428 22:40:38 -- setup/hugepages.sh@177 -- # get_test_nr_hugepages 2097152 00:02:47.428 22:40:38 -- setup/hugepages.sh@49 -- # local size=2097152 00:02:47.428 22:40:38 -- setup/hugepages.sh@50 -- # (( 1 > 1 )) 00:02:47.428 22:40:38 -- setup/hugepages.sh@55 -- # (( size >= default_hugepages )) 00:02:47.428 22:40:38 -- setup/hugepages.sh@57 -- # nr_hugepages=1024 00:02:47.428 22:40:38 -- setup/hugepages.sh@58 -- # get_test_nr_hugepages_per_node 00:02:47.428 22:40:38 -- setup/hugepages.sh@62 -- # user_nodes=() 00:02:47.428 22:40:38 -- setup/hugepages.sh@62 -- # local user_nodes 00:02:47.428 22:40:38 -- setup/hugepages.sh@64 -- # local _nr_hugepages=1024 00:02:47.428 22:40:38 -- setup/hugepages.sh@65 -- # local _no_nodes=2 00:02:47.428 22:40:38 -- setup/hugepages.sh@67 -- # nodes_test=() 00:02:47.428 22:40:38 -- setup/hugepages.sh@67 -- # local -g nodes_test 00:02:47.428 22:40:38 -- setup/hugepages.sh@69 -- # (( 0 > 0 )) 00:02:47.428 22:40:38 -- setup/hugepages.sh@74 -- # (( 1 > 0 )) 00:02:47.428 22:40:38 -- setup/hugepages.sh@75 -- # for _no_nodes in "${!nodes_hp[@]}" 00:02:47.428 22:40:38 -- setup/hugepages.sh@76 -- # nodes_test[_no_nodes]=512 00:02:47.428 22:40:38 -- setup/hugepages.sh@78 -- # return 0 00:02:47.428 22:40:38 -- setup/hugepages.sh@178 -- # nodes_hp[1]=1024 00:02:47.428 22:40:38 -- setup/hugepages.sh@181 -- # for node in "${!nodes_hp[@]}" 00:02:47.428 22:40:38 -- setup/hugepages.sh@182 -- # HUGENODE+=("nodes_hp[$node]=${nodes_hp[node]}") 00:02:47.428 22:40:38 -- setup/hugepages.sh@183 -- # (( _nr_hugepages += nodes_hp[node] )) 00:02:47.428 22:40:38 -- setup/hugepages.sh@181 -- # for node in "${!nodes_hp[@]}" 00:02:47.428 22:40:38 -- setup/hugepages.sh@182 -- # HUGENODE+=("nodes_hp[$node]=${nodes_hp[node]}") 00:02:47.428 22:40:38 -- setup/hugepages.sh@183 -- # (( _nr_hugepages += nodes_hp[node] )) 00:02:47.428 22:40:38 -- setup/hugepages.sh@186 -- # get_test_nr_hugepages_per_node 00:02:47.428 22:40:38 -- setup/hugepages.sh@62 -- # user_nodes=() 00:02:47.428 22:40:38 -- setup/hugepages.sh@62 -- # local user_nodes 00:02:47.428 22:40:38 -- setup/hugepages.sh@64 -- # local _nr_hugepages=1024 00:02:47.428 22:40:38 -- setup/hugepages.sh@65 -- # local _no_nodes=2 00:02:47.428 22:40:38 -- setup/hugepages.sh@67 -- # nodes_test=() 00:02:47.428 22:40:38 -- setup/hugepages.sh@67 -- # local -g nodes_test 00:02:47.428 22:40:38 -- setup/hugepages.sh@69 -- # (( 0 > 0 )) 00:02:47.428 22:40:38 -- setup/hugepages.sh@74 -- # (( 2 > 0 )) 00:02:47.428 22:40:38 -- setup/hugepages.sh@75 -- # for _no_nodes in "${!nodes_hp[@]}" 00:02:47.428 22:40:38 -- setup/hugepages.sh@76 -- # nodes_test[_no_nodes]=512 00:02:47.428 22:40:38 -- setup/hugepages.sh@75 -- # for _no_nodes in "${!nodes_hp[@]}" 00:02:47.428 22:40:38 -- setup/hugepages.sh@76 -- # nodes_test[_no_nodes]=1024 00:02:47.428 22:40:38 -- setup/hugepages.sh@78 -- # return 0 00:02:47.428 22:40:38 -- setup/hugepages.sh@187 -- # HUGENODE='nodes_hp[0]=512,nodes_hp[1]=1024' 00:02:47.428 22:40:38 -- setup/hugepages.sh@187 -- # setup output 00:02:47.428 22:40:38 -- setup/common.sh@9 -- # [[ output == output ]] 00:02:47.428 22:40:38 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh 00:02:48.807 0000:00:04.7 (8086 0e27): Already using the vfio-pci driver 00:02:48.807 0000:88:00.0 (8086 0a54): Already using the vfio-pci driver 00:02:48.807 0000:00:04.6 (8086 0e26): Already using the vfio-pci driver 00:02:48.807 0000:00:04.5 (8086 0e25): Already using the vfio-pci driver 00:02:48.807 0000:00:04.4 (8086 0e24): Already using the vfio-pci driver 00:02:48.807 0000:00:04.3 (8086 0e23): Already using the vfio-pci driver 00:02:48.807 0000:00:04.2 (8086 0e22): Already using the vfio-pci driver 00:02:48.807 0000:00:04.1 (8086 0e21): Already using the vfio-pci driver 00:02:48.807 0000:00:04.0 (8086 0e20): Already using the vfio-pci driver 00:02:48.807 0000:80:04.7 (8086 0e27): Already using the vfio-pci driver 00:02:48.807 0000:80:04.6 (8086 0e26): Already using the vfio-pci driver 00:02:48.807 0000:80:04.5 (8086 0e25): Already using the vfio-pci driver 00:02:48.807 0000:80:04.4 (8086 0e24): Already using the vfio-pci driver 00:02:48.807 0000:80:04.3 (8086 0e23): Already using the vfio-pci driver 00:02:48.807 0000:80:04.2 (8086 0e22): Already using the vfio-pci driver 00:02:48.807 0000:80:04.1 (8086 0e21): Already using the vfio-pci driver 00:02:48.807 0000:80:04.0 (8086 0e20): Already using the vfio-pci driver 00:02:48.807 22:40:39 -- setup/hugepages.sh@188 -- # nr_hugepages=1536 00:02:48.807 22:40:39 -- setup/hugepages.sh@188 -- # verify_nr_hugepages 00:02:48.807 22:40:39 -- setup/hugepages.sh@89 -- # local node 00:02:48.807 22:40:39 -- setup/hugepages.sh@90 -- # local sorted_t 00:02:48.807 22:40:39 -- setup/hugepages.sh@91 -- # local sorted_s 00:02:48.807 22:40:39 -- setup/hugepages.sh@92 -- # local surp 00:02:48.807 22:40:39 -- setup/hugepages.sh@93 -- # local resv 00:02:48.807 22:40:39 -- setup/hugepages.sh@94 -- # local anon 00:02:48.807 22:40:39 -- setup/hugepages.sh@96 -- # [[ always [madvise] never != *\[\n\e\v\e\r\]* ]] 00:02:48.807 22:40:39 -- setup/hugepages.sh@97 -- # get_meminfo AnonHugePages 00:02:48.807 22:40:39 -- setup/common.sh@17 -- # local get=AnonHugePages 00:02:48.807 22:40:39 -- setup/common.sh@18 -- # local node= 00:02:48.807 22:40:39 -- setup/common.sh@19 -- # local var val 00:02:48.807 22:40:39 -- setup/common.sh@20 -- # local mem_f mem 00:02:48.807 22:40:39 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:02:48.807 22:40:39 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:02:48.807 22:40:39 -- setup/common.sh@25 -- # [[ -n '' ]] 00:02:48.807 22:40:39 -- setup/common.sh@28 -- # mapfile -t mem 00:02:48.807 22:40:39 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:02:48.807 22:40:39 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.807 22:40:39 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.807 22:40:39 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60541736 kB' 'MemFree: 42323280 kB' 'MemAvailable: 46314508 kB' 'Buffers: 2696 kB' 'Cached: 12518500 kB' 'SwapCached: 0 kB' 'Active: 9323904 kB' 'Inactive: 3655836 kB' 'Active(anon): 8759588 kB' 'Inactive(anon): 0 kB' 'Active(file): 564316 kB' 'Inactive(file): 3655836 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 461724 kB' 'Mapped: 201416 kB' 'Shmem: 8301044 kB' 'KReclaimable: 415512 kB' 'Slab: 806840 kB' 'SReclaimable: 415512 kB' 'SUnreclaim: 391328 kB' 'KernelStack: 12736 kB' 'PageTables: 7960 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37086608 kB' 'Committed_AS: 9884712 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 197116 kB' 'VmallocChunk: 0 kB' 'Percpu: 38592 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1536' 'HugePages_Free: 1536' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 3145728 kB' 'DirectMap4k: 2506332 kB' 'DirectMap2M: 24676352 kB' 'DirectMap1G: 41943040 kB' 00:02:48.807 22:40:39 -- setup/common.sh@32 -- # [[ MemTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:48.807 22:40:39 -- setup/common.sh@32 -- # continue 00:02:48.807 22:40:39 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.807 22:40:39 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.807 22:40:39 -- setup/common.sh@32 -- # [[ MemFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:48.807 22:40:39 -- setup/common.sh@32 -- # continue 00:02:48.807 22:40:39 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.807 22:40:39 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.807 22:40:39 -- setup/common.sh@32 -- # [[ MemAvailable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:48.807 22:40:39 -- setup/common.sh@32 -- # continue 00:02:48.807 22:40:39 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.807 22:40:39 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.807 22:40:39 -- setup/common.sh@32 -- # [[ Buffers == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:48.807 22:40:39 -- setup/common.sh@32 -- # continue 00:02:48.807 22:40:39 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.807 22:40:39 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.807 22:40:39 -- setup/common.sh@32 -- # [[ Cached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:48.808 22:40:39 -- setup/common.sh@32 -- # continue 00:02:48.808 22:40:39 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.808 22:40:39 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.808 22:40:39 -- setup/common.sh@32 -- # [[ SwapCached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:48.808 22:40:39 -- setup/common.sh@32 -- # continue 00:02:48.808 22:40:39 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.808 22:40:39 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.808 22:40:39 -- setup/common.sh@32 -- # [[ Active == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:48.808 22:40:39 -- setup/common.sh@32 -- # continue 00:02:48.808 22:40:39 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.808 22:40:39 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.808 22:40:39 -- setup/common.sh@32 -- # [[ Inactive == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:48.808 22:40:39 -- setup/common.sh@32 -- # continue 00:02:48.808 22:40:39 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.808 22:40:39 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.808 22:40:39 -- setup/common.sh@32 -- # [[ Active(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:48.808 22:40:39 -- setup/common.sh@32 -- # continue 00:02:48.808 22:40:39 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.808 22:40:39 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.808 22:40:39 -- setup/common.sh@32 -- # [[ Inactive(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:48.808 22:40:39 -- setup/common.sh@32 -- # continue 00:02:48.808 22:40:39 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.808 22:40:39 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.808 22:40:39 -- setup/common.sh@32 -- # [[ Active(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:48.808 22:40:39 -- setup/common.sh@32 -- # continue 00:02:48.808 22:40:39 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.808 22:40:39 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.808 22:40:39 -- setup/common.sh@32 -- # [[ Inactive(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:48.808 22:40:39 -- setup/common.sh@32 -- # continue 00:02:48.808 22:40:39 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.808 22:40:39 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.808 22:40:39 -- setup/common.sh@32 -- # [[ Unevictable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:48.808 22:40:39 -- setup/common.sh@32 -- # continue 00:02:48.808 22:40:39 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.808 22:40:39 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.808 22:40:39 -- setup/common.sh@32 -- # [[ Mlocked == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:48.808 22:40:39 -- setup/common.sh@32 -- # continue 00:02:48.808 22:40:39 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.808 22:40:39 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.808 22:40:39 -- setup/common.sh@32 -- # [[ SwapTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:48.808 22:40:39 -- setup/common.sh@32 -- # continue 00:02:48.808 22:40:39 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.808 22:40:39 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.808 22:40:39 -- setup/common.sh@32 -- # [[ SwapFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:48.808 22:40:39 -- setup/common.sh@32 -- # continue 00:02:48.808 22:40:39 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.808 22:40:39 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.808 22:40:39 -- setup/common.sh@32 -- # [[ Zswap == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:48.808 22:40:39 -- setup/common.sh@32 -- # continue 00:02:48.808 22:40:39 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.808 22:40:39 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.808 22:40:39 -- setup/common.sh@32 -- # [[ Zswapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:48.808 22:40:39 -- setup/common.sh@32 -- # continue 00:02:48.808 22:40:39 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.808 22:40:39 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.808 22:40:39 -- setup/common.sh@32 -- # [[ Dirty == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:48.808 22:40:39 -- setup/common.sh@32 -- # continue 00:02:48.808 22:40:39 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.808 22:40:39 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.808 22:40:39 -- setup/common.sh@32 -- # [[ Writeback == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:48.808 22:40:39 -- setup/common.sh@32 -- # continue 00:02:48.808 22:40:39 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.808 22:40:39 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.808 22:40:39 -- setup/common.sh@32 -- # [[ AnonPages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:48.808 22:40:39 -- setup/common.sh@32 -- # continue 00:02:48.808 22:40:39 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.808 22:40:39 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.808 22:40:39 -- setup/common.sh@32 -- # [[ Mapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:48.808 22:40:39 -- setup/common.sh@32 -- # continue 00:02:48.808 22:40:39 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.808 22:40:39 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.808 22:40:39 -- setup/common.sh@32 -- # [[ Shmem == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:48.808 22:40:39 -- setup/common.sh@32 -- # continue 00:02:48.808 22:40:39 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.808 22:40:39 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.808 22:40:39 -- setup/common.sh@32 -- # [[ KReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:48.808 22:40:39 -- setup/common.sh@32 -- # continue 00:02:48.808 22:40:39 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.808 22:40:39 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.808 22:40:39 -- setup/common.sh@32 -- # [[ Slab == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:48.808 22:40:39 -- setup/common.sh@32 -- # continue 00:02:48.808 22:40:39 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.808 22:40:39 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.808 22:40:39 -- setup/common.sh@32 -- # [[ SReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:48.808 22:40:39 -- setup/common.sh@32 -- # continue 00:02:48.808 22:40:39 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.808 22:40:39 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.808 22:40:39 -- setup/common.sh@32 -- # [[ SUnreclaim == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:48.808 22:40:39 -- setup/common.sh@32 -- # continue 00:02:48.808 22:40:39 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.808 22:40:39 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.808 22:40:39 -- setup/common.sh@32 -- # [[ KernelStack == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:48.808 22:40:39 -- setup/common.sh@32 -- # continue 00:02:48.808 22:40:39 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.808 22:40:39 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.808 22:40:39 -- setup/common.sh@32 -- # [[ PageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:48.808 22:40:39 -- setup/common.sh@32 -- # continue 00:02:48.808 22:40:39 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.808 22:40:39 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.808 22:40:39 -- setup/common.sh@32 -- # [[ SecPageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:48.808 22:40:39 -- setup/common.sh@32 -- # continue 00:02:48.808 22:40:39 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.808 22:40:39 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.808 22:40:39 -- setup/common.sh@32 -- # [[ NFS_Unstable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:48.808 22:40:39 -- setup/common.sh@32 -- # continue 00:02:48.808 22:40:39 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.808 22:40:39 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.808 22:40:39 -- setup/common.sh@32 -- # [[ Bounce == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:48.808 22:40:39 -- setup/common.sh@32 -- # continue 00:02:48.808 22:40:39 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.808 22:40:39 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.808 22:40:39 -- setup/common.sh@32 -- # [[ WritebackTmp == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:48.808 22:40:39 -- setup/common.sh@32 -- # continue 00:02:48.808 22:40:39 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.808 22:40:39 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.808 22:40:39 -- setup/common.sh@32 -- # [[ CommitLimit == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:48.808 22:40:39 -- setup/common.sh@32 -- # continue 00:02:48.808 22:40:39 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.808 22:40:39 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.808 22:40:39 -- setup/common.sh@32 -- # [[ Committed_AS == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:48.808 22:40:39 -- setup/common.sh@32 -- # continue 00:02:48.808 22:40:39 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.808 22:40:39 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.808 22:40:39 -- setup/common.sh@32 -- # [[ VmallocTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:48.808 22:40:39 -- setup/common.sh@32 -- # continue 00:02:48.808 22:40:39 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.808 22:40:39 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.808 22:40:39 -- setup/common.sh@32 -- # [[ VmallocUsed == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:48.808 22:40:39 -- setup/common.sh@32 -- # continue 00:02:48.808 22:40:39 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.808 22:40:39 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.808 22:40:39 -- setup/common.sh@32 -- # [[ VmallocChunk == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:48.808 22:40:39 -- setup/common.sh@32 -- # continue 00:02:48.808 22:40:39 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.808 22:40:39 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.808 22:40:39 -- setup/common.sh@32 -- # [[ Percpu == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:48.808 22:40:39 -- setup/common.sh@32 -- # continue 00:02:48.808 22:40:39 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.808 22:40:39 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.809 22:40:39 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:48.809 22:40:39 -- setup/common.sh@32 -- # continue 00:02:48.809 22:40:39 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.809 22:40:39 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.809 22:40:39 -- setup/common.sh@32 -- # [[ AnonHugePages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:48.809 22:40:39 -- setup/common.sh@33 -- # echo 0 00:02:48.809 22:40:39 -- setup/common.sh@33 -- # return 0 00:02:48.809 22:40:39 -- setup/hugepages.sh@97 -- # anon=0 00:02:48.809 22:40:39 -- setup/hugepages.sh@99 -- # get_meminfo HugePages_Surp 00:02:48.809 22:40:39 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:02:48.809 22:40:39 -- setup/common.sh@18 -- # local node= 00:02:48.809 22:40:39 -- setup/common.sh@19 -- # local var val 00:02:48.809 22:40:39 -- setup/common.sh@20 -- # local mem_f mem 00:02:48.809 22:40:39 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:02:48.809 22:40:39 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:02:48.809 22:40:39 -- setup/common.sh@25 -- # [[ -n '' ]] 00:02:48.809 22:40:39 -- setup/common.sh@28 -- # mapfile -t mem 00:02:48.809 22:40:39 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:02:48.809 22:40:39 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.809 22:40:39 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.809 22:40:39 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60541736 kB' 'MemFree: 42323772 kB' 'MemAvailable: 46315000 kB' 'Buffers: 2696 kB' 'Cached: 12518504 kB' 'SwapCached: 0 kB' 'Active: 9322956 kB' 'Inactive: 3655836 kB' 'Active(anon): 8758640 kB' 'Inactive(anon): 0 kB' 'Active(file): 564316 kB' 'Inactive(file): 3655836 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 460804 kB' 'Mapped: 201404 kB' 'Shmem: 8301048 kB' 'KReclaimable: 415512 kB' 'Slab: 806840 kB' 'SReclaimable: 415512 kB' 'SUnreclaim: 391328 kB' 'KernelStack: 12800 kB' 'PageTables: 7964 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37086608 kB' 'Committed_AS: 9884724 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 197100 kB' 'VmallocChunk: 0 kB' 'Percpu: 38592 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1536' 'HugePages_Free: 1536' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 3145728 kB' 'DirectMap4k: 2506332 kB' 'DirectMap2M: 24676352 kB' 'DirectMap1G: 41943040 kB' 00:02:48.809 22:40:39 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:48.809 22:40:39 -- setup/common.sh@32 -- # continue 00:02:48.809 22:40:39 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.809 22:40:39 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.809 22:40:39 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:48.809 22:40:39 -- setup/common.sh@32 -- # continue 00:02:48.809 22:40:39 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.809 22:40:39 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.809 22:40:39 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:48.809 22:40:39 -- setup/common.sh@32 -- # continue 00:02:48.809 22:40:39 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.809 22:40:39 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.809 22:40:39 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:48.809 22:40:39 -- setup/common.sh@32 -- # continue 00:02:48.809 22:40:39 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.809 22:40:39 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.809 22:40:39 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:48.809 22:40:39 -- setup/common.sh@32 -- # continue 00:02:48.809 22:40:39 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.809 22:40:39 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.809 22:40:39 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:48.809 22:40:39 -- setup/common.sh@32 -- # continue 00:02:48.809 22:40:39 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.809 22:40:39 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.809 22:40:39 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:48.809 22:40:39 -- setup/common.sh@32 -- # continue 00:02:48.809 22:40:39 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.809 22:40:39 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.809 22:40:39 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:48.809 22:40:39 -- setup/common.sh@32 -- # continue 00:02:48.809 22:40:39 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.809 22:40:39 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.809 22:40:39 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:48.809 22:40:39 -- setup/common.sh@32 -- # continue 00:02:48.809 22:40:39 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.809 22:40:39 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.809 22:40:39 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:48.809 22:40:39 -- setup/common.sh@32 -- # continue 00:02:48.809 22:40:39 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.809 22:40:39 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.809 22:40:39 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:48.809 22:40:39 -- setup/common.sh@32 -- # continue 00:02:48.809 22:40:39 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.809 22:40:39 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.809 22:40:39 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:48.809 22:40:39 -- setup/common.sh@32 -- # continue 00:02:48.809 22:40:39 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.809 22:40:39 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.809 22:40:39 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:48.809 22:40:39 -- setup/common.sh@32 -- # continue 00:02:48.809 22:40:39 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.809 22:40:39 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.809 22:40:39 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:48.809 22:40:39 -- setup/common.sh@32 -- # continue 00:02:48.809 22:40:39 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.809 22:40:39 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.809 22:40:39 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:48.809 22:40:39 -- setup/common.sh@32 -- # continue 00:02:48.809 22:40:39 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.809 22:40:39 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.809 22:40:39 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:48.809 22:40:39 -- setup/common.sh@32 -- # continue 00:02:48.809 22:40:39 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.809 22:40:39 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.809 22:40:39 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:48.809 22:40:39 -- setup/common.sh@32 -- # continue 00:02:48.809 22:40:39 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.809 22:40:39 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.809 22:40:39 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:48.809 22:40:39 -- setup/common.sh@32 -- # continue 00:02:48.809 22:40:39 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.809 22:40:39 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.809 22:40:39 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:48.809 22:40:39 -- setup/common.sh@32 -- # continue 00:02:48.809 22:40:39 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.809 22:40:39 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.809 22:40:39 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:48.809 22:40:39 -- setup/common.sh@32 -- # continue 00:02:48.809 22:40:39 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.809 22:40:39 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.809 22:40:39 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:48.809 22:40:39 -- setup/common.sh@32 -- # continue 00:02:48.809 22:40:39 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.809 22:40:39 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.809 22:40:39 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:48.809 22:40:39 -- setup/common.sh@32 -- # continue 00:02:48.809 22:40:39 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.809 22:40:39 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.809 22:40:39 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:48.809 22:40:39 -- setup/common.sh@32 -- # continue 00:02:48.809 22:40:39 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.809 22:40:39 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.809 22:40:39 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:48.809 22:40:39 -- setup/common.sh@32 -- # continue 00:02:48.809 22:40:39 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.809 22:40:39 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.809 22:40:39 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:48.809 22:40:39 -- setup/common.sh@32 -- # continue 00:02:48.809 22:40:39 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.809 22:40:39 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.809 22:40:39 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:48.809 22:40:39 -- setup/common.sh@32 -- # continue 00:02:48.809 22:40:39 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.809 22:40:39 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.809 22:40:39 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:48.809 22:40:39 -- setup/common.sh@32 -- # continue 00:02:48.809 22:40:39 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.809 22:40:39 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.809 22:40:39 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:48.809 22:40:39 -- setup/common.sh@32 -- # continue 00:02:48.809 22:40:39 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.809 22:40:39 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.809 22:40:39 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:48.809 22:40:39 -- setup/common.sh@32 -- # continue 00:02:48.809 22:40:39 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.809 22:40:39 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.809 22:40:39 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:48.809 22:40:39 -- setup/common.sh@32 -- # continue 00:02:48.809 22:40:39 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.809 22:40:39 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.809 22:40:39 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:48.810 22:40:39 -- setup/common.sh@32 -- # continue 00:02:48.810 22:40:39 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.810 22:40:39 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.810 22:40:39 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:48.810 22:40:39 -- setup/common.sh@32 -- # continue 00:02:48.810 22:40:39 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.810 22:40:39 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.810 22:40:39 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:48.810 22:40:39 -- setup/common.sh@32 -- # continue 00:02:48.810 22:40:39 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.810 22:40:39 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.810 22:40:39 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:48.810 22:40:39 -- setup/common.sh@32 -- # continue 00:02:48.810 22:40:39 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.810 22:40:39 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.810 22:40:39 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:48.810 22:40:39 -- setup/common.sh@32 -- # continue 00:02:48.810 22:40:39 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.810 22:40:39 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.810 22:40:39 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:48.810 22:40:39 -- setup/common.sh@32 -- # continue 00:02:48.810 22:40:39 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.810 22:40:39 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.810 22:40:39 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:48.810 22:40:39 -- setup/common.sh@32 -- # continue 00:02:48.810 22:40:39 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.810 22:40:39 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.810 22:40:39 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:48.810 22:40:39 -- setup/common.sh@32 -- # continue 00:02:48.810 22:40:39 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.810 22:40:39 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.810 22:40:39 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:48.810 22:40:39 -- setup/common.sh@32 -- # continue 00:02:48.810 22:40:39 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.810 22:40:39 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.810 22:40:39 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:48.810 22:40:39 -- setup/common.sh@32 -- # continue 00:02:48.810 22:40:39 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.810 22:40:39 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.810 22:40:39 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:48.810 22:40:39 -- setup/common.sh@32 -- # continue 00:02:48.810 22:40:39 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.810 22:40:39 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.810 22:40:39 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:48.810 22:40:39 -- setup/common.sh@32 -- # continue 00:02:48.810 22:40:39 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.810 22:40:39 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.810 22:40:39 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:48.810 22:40:39 -- setup/common.sh@32 -- # continue 00:02:48.810 22:40:39 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.810 22:40:39 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.810 22:40:39 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:48.810 22:40:39 -- setup/common.sh@32 -- # continue 00:02:48.810 22:40:39 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.810 22:40:39 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.810 22:40:39 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:48.810 22:40:39 -- setup/common.sh@32 -- # continue 00:02:48.810 22:40:39 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.810 22:40:39 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.810 22:40:39 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:48.810 22:40:39 -- setup/common.sh@32 -- # continue 00:02:48.810 22:40:39 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.810 22:40:39 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.810 22:40:39 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:48.810 22:40:39 -- setup/common.sh@32 -- # continue 00:02:48.810 22:40:39 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.810 22:40:39 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.810 22:40:39 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:48.810 22:40:39 -- setup/common.sh@32 -- # continue 00:02:48.810 22:40:39 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.810 22:40:39 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.810 22:40:39 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:48.810 22:40:39 -- setup/common.sh@32 -- # continue 00:02:48.810 22:40:39 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.810 22:40:39 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.810 22:40:39 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:48.810 22:40:39 -- setup/common.sh@32 -- # continue 00:02:48.810 22:40:39 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.810 22:40:39 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.810 22:40:39 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:48.810 22:40:39 -- setup/common.sh@32 -- # continue 00:02:48.810 22:40:39 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.810 22:40:39 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.810 22:40:39 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:48.810 22:40:39 -- setup/common.sh@33 -- # echo 0 00:02:48.810 22:40:39 -- setup/common.sh@33 -- # return 0 00:02:48.810 22:40:39 -- setup/hugepages.sh@99 -- # surp=0 00:02:48.810 22:40:39 -- setup/hugepages.sh@100 -- # get_meminfo HugePages_Rsvd 00:02:48.810 22:40:39 -- setup/common.sh@17 -- # local get=HugePages_Rsvd 00:02:48.810 22:40:39 -- setup/common.sh@18 -- # local node= 00:02:48.810 22:40:39 -- setup/common.sh@19 -- # local var val 00:02:48.810 22:40:39 -- setup/common.sh@20 -- # local mem_f mem 00:02:48.810 22:40:39 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:02:48.810 22:40:39 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:02:48.810 22:40:39 -- setup/common.sh@25 -- # [[ -n '' ]] 00:02:48.810 22:40:39 -- setup/common.sh@28 -- # mapfile -t mem 00:02:48.810 22:40:39 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:02:48.810 22:40:39 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.810 22:40:39 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.810 22:40:39 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60541736 kB' 'MemFree: 42326504 kB' 'MemAvailable: 46317732 kB' 'Buffers: 2696 kB' 'Cached: 12518508 kB' 'SwapCached: 0 kB' 'Active: 9322776 kB' 'Inactive: 3655836 kB' 'Active(anon): 8758460 kB' 'Inactive(anon): 0 kB' 'Active(file): 564316 kB' 'Inactive(file): 3655836 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 460604 kB' 'Mapped: 201464 kB' 'Shmem: 8301052 kB' 'KReclaimable: 415512 kB' 'Slab: 806848 kB' 'SReclaimable: 415512 kB' 'SUnreclaim: 391336 kB' 'KernelStack: 12800 kB' 'PageTables: 7972 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37086608 kB' 'Committed_AS: 9884740 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 197100 kB' 'VmallocChunk: 0 kB' 'Percpu: 38592 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1536' 'HugePages_Free: 1536' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 3145728 kB' 'DirectMap4k: 2506332 kB' 'DirectMap2M: 24676352 kB' 'DirectMap1G: 41943040 kB' 00:02:48.810 22:40:39 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:48.810 22:40:39 -- setup/common.sh@32 -- # continue 00:02:48.810 22:40:39 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.810 22:40:39 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.810 22:40:39 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:48.810 22:40:39 -- setup/common.sh@32 -- # continue 00:02:48.810 22:40:39 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.810 22:40:39 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.810 22:40:39 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:48.810 22:40:39 -- setup/common.sh@32 -- # continue 00:02:48.810 22:40:39 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.810 22:40:39 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.810 22:40:39 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:48.810 22:40:39 -- setup/common.sh@32 -- # continue 00:02:48.810 22:40:39 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.810 22:40:39 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.810 22:40:39 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:48.810 22:40:39 -- setup/common.sh@32 -- # continue 00:02:48.810 22:40:39 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.810 22:40:39 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.810 22:40:39 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:48.810 22:40:39 -- setup/common.sh@32 -- # continue 00:02:48.810 22:40:39 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.810 22:40:39 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.810 22:40:39 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:48.810 22:40:39 -- setup/common.sh@32 -- # continue 00:02:48.810 22:40:39 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.810 22:40:39 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.810 22:40:39 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:48.811 22:40:39 -- setup/common.sh@32 -- # continue 00:02:48.811 22:40:39 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.811 22:40:39 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.811 22:40:39 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:48.811 22:40:39 -- setup/common.sh@32 -- # continue 00:02:48.811 22:40:39 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.811 22:40:39 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.811 22:40:39 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:48.811 22:40:39 -- setup/common.sh@32 -- # continue 00:02:48.811 22:40:39 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.811 22:40:39 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.811 22:40:39 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:48.811 22:40:39 -- setup/common.sh@32 -- # continue 00:02:48.811 22:40:39 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.811 22:40:39 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.811 22:40:39 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:48.811 22:40:39 -- setup/common.sh@32 -- # continue 00:02:48.811 22:40:39 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.811 22:40:39 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.811 22:40:39 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:48.811 22:40:39 -- setup/common.sh@32 -- # continue 00:02:48.811 22:40:39 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.811 22:40:39 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.811 22:40:39 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:48.811 22:40:39 -- setup/common.sh@32 -- # continue 00:02:48.811 22:40:39 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.811 22:40:39 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.811 22:40:39 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:48.811 22:40:39 -- setup/common.sh@32 -- # continue 00:02:48.811 22:40:39 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.811 22:40:39 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.811 22:40:39 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:48.811 22:40:39 -- setup/common.sh@32 -- # continue 00:02:48.811 22:40:39 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.811 22:40:39 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.811 22:40:39 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:48.811 22:40:39 -- setup/common.sh@32 -- # continue 00:02:48.811 22:40:39 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.811 22:40:39 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.811 22:40:39 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:48.811 22:40:39 -- setup/common.sh@32 -- # continue 00:02:48.811 22:40:39 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.811 22:40:39 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.811 22:40:39 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:48.811 22:40:39 -- setup/common.sh@32 -- # continue 00:02:48.811 22:40:39 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.811 22:40:39 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.811 22:40:39 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:48.811 22:40:39 -- setup/common.sh@32 -- # continue 00:02:48.811 22:40:39 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.811 22:40:39 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.811 22:40:39 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:48.811 22:40:39 -- setup/common.sh@32 -- # continue 00:02:48.811 22:40:39 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.811 22:40:39 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.811 22:40:39 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:48.811 22:40:39 -- setup/common.sh@32 -- # continue 00:02:48.811 22:40:39 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.811 22:40:39 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.811 22:40:39 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:48.811 22:40:39 -- setup/common.sh@32 -- # continue 00:02:48.811 22:40:39 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.811 22:40:39 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.811 22:40:39 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:48.811 22:40:39 -- setup/common.sh@32 -- # continue 00:02:48.811 22:40:39 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.811 22:40:39 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.811 22:40:39 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:48.811 22:40:39 -- setup/common.sh@32 -- # continue 00:02:48.811 22:40:39 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.811 22:40:39 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.811 22:40:39 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:48.811 22:40:39 -- setup/common.sh@32 -- # continue 00:02:48.811 22:40:39 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.811 22:40:39 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.811 22:40:39 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:48.811 22:40:39 -- setup/common.sh@32 -- # continue 00:02:48.811 22:40:39 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.811 22:40:39 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.811 22:40:39 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:48.811 22:40:39 -- setup/common.sh@32 -- # continue 00:02:48.811 22:40:39 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.811 22:40:39 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.811 22:40:39 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:48.811 22:40:39 -- setup/common.sh@32 -- # continue 00:02:48.811 22:40:39 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.811 22:40:39 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.811 22:40:39 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:48.811 22:40:39 -- setup/common.sh@32 -- # continue 00:02:48.811 22:40:39 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.811 22:40:39 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.811 22:40:39 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:48.811 22:40:39 -- setup/common.sh@32 -- # continue 00:02:48.811 22:40:39 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.811 22:40:39 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.811 22:40:39 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:48.811 22:40:39 -- setup/common.sh@32 -- # continue 00:02:48.811 22:40:39 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.811 22:40:39 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.811 22:40:39 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:48.811 22:40:39 -- setup/common.sh@32 -- # continue 00:02:48.811 22:40:39 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.811 22:40:39 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.811 22:40:39 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:48.811 22:40:39 -- setup/common.sh@32 -- # continue 00:02:48.811 22:40:39 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.811 22:40:39 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.811 22:40:39 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:48.811 22:40:39 -- setup/common.sh@32 -- # continue 00:02:48.811 22:40:39 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.811 22:40:39 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.811 22:40:39 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:48.811 22:40:39 -- setup/common.sh@32 -- # continue 00:02:48.811 22:40:39 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.811 22:40:39 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.811 22:40:39 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:48.811 22:40:39 -- setup/common.sh@32 -- # continue 00:02:48.811 22:40:39 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.811 22:40:39 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.811 22:40:39 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:48.811 22:40:39 -- setup/common.sh@32 -- # continue 00:02:48.811 22:40:39 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.811 22:40:39 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.811 22:40:39 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:48.811 22:40:39 -- setup/common.sh@32 -- # continue 00:02:48.811 22:40:39 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.811 22:40:39 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.811 22:40:39 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:48.811 22:40:39 -- setup/common.sh@32 -- # continue 00:02:48.811 22:40:39 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.811 22:40:39 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.811 22:40:39 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:48.811 22:40:39 -- setup/common.sh@32 -- # continue 00:02:48.811 22:40:39 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.811 22:40:39 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.811 22:40:39 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:48.811 22:40:39 -- setup/common.sh@32 -- # continue 00:02:48.811 22:40:39 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.811 22:40:39 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.811 22:40:39 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:48.811 22:40:39 -- setup/common.sh@32 -- # continue 00:02:48.811 22:40:39 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.811 22:40:39 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.811 22:40:39 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:48.811 22:40:39 -- setup/common.sh@32 -- # continue 00:02:48.811 22:40:39 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.811 22:40:39 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.811 22:40:39 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:48.811 22:40:39 -- setup/common.sh@32 -- # continue 00:02:48.811 22:40:39 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.812 22:40:39 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.812 22:40:39 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:48.812 22:40:39 -- setup/common.sh@32 -- # continue 00:02:48.812 22:40:39 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.812 22:40:39 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.812 22:40:39 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:48.812 22:40:39 -- setup/common.sh@32 -- # continue 00:02:48.812 22:40:39 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.812 22:40:39 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.812 22:40:39 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:48.812 22:40:39 -- setup/common.sh@32 -- # continue 00:02:48.812 22:40:39 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.812 22:40:39 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.812 22:40:39 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:48.812 22:40:39 -- setup/common.sh@32 -- # continue 00:02:48.812 22:40:39 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.812 22:40:39 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.812 22:40:39 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:48.812 22:40:39 -- setup/common.sh@32 -- # continue 00:02:48.812 22:40:39 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.812 22:40:39 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.812 22:40:39 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:48.812 22:40:39 -- setup/common.sh@33 -- # echo 0 00:02:48.812 22:40:39 -- setup/common.sh@33 -- # return 0 00:02:48.812 22:40:39 -- setup/hugepages.sh@100 -- # resv=0 00:02:48.812 22:40:39 -- setup/hugepages.sh@102 -- # echo nr_hugepages=1536 00:02:48.812 nr_hugepages=1536 00:02:48.812 22:40:39 -- setup/hugepages.sh@103 -- # echo resv_hugepages=0 00:02:48.812 resv_hugepages=0 00:02:48.812 22:40:39 -- setup/hugepages.sh@104 -- # echo surplus_hugepages=0 00:02:48.812 surplus_hugepages=0 00:02:48.812 22:40:39 -- setup/hugepages.sh@105 -- # echo anon_hugepages=0 00:02:48.812 anon_hugepages=0 00:02:48.812 22:40:39 -- setup/hugepages.sh@107 -- # (( 1536 == nr_hugepages + surp + resv )) 00:02:48.812 22:40:39 -- setup/hugepages.sh@109 -- # (( 1536 == nr_hugepages )) 00:02:48.812 22:40:39 -- setup/hugepages.sh@110 -- # get_meminfo HugePages_Total 00:02:48.812 22:40:39 -- setup/common.sh@17 -- # local get=HugePages_Total 00:02:48.812 22:40:39 -- setup/common.sh@18 -- # local node= 00:02:48.812 22:40:39 -- setup/common.sh@19 -- # local var val 00:02:48.812 22:40:39 -- setup/common.sh@20 -- # local mem_f mem 00:02:48.812 22:40:39 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:02:48.812 22:40:39 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:02:48.812 22:40:39 -- setup/common.sh@25 -- # [[ -n '' ]] 00:02:48.812 22:40:39 -- setup/common.sh@28 -- # mapfile -t mem 00:02:48.812 22:40:39 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:02:48.812 22:40:39 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.812 22:40:39 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.812 22:40:39 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60541736 kB' 'MemFree: 42326884 kB' 'MemAvailable: 46318112 kB' 'Buffers: 2696 kB' 'Cached: 12518528 kB' 'SwapCached: 0 kB' 'Active: 9322832 kB' 'Inactive: 3655836 kB' 'Active(anon): 8758516 kB' 'Inactive(anon): 0 kB' 'Active(file): 564316 kB' 'Inactive(file): 3655836 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 460640 kB' 'Mapped: 201464 kB' 'Shmem: 8301072 kB' 'KReclaimable: 415512 kB' 'Slab: 806848 kB' 'SReclaimable: 415512 kB' 'SUnreclaim: 391336 kB' 'KernelStack: 12800 kB' 'PageTables: 7972 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37086608 kB' 'Committed_AS: 9884752 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 197084 kB' 'VmallocChunk: 0 kB' 'Percpu: 38592 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1536' 'HugePages_Free: 1536' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 3145728 kB' 'DirectMap4k: 2506332 kB' 'DirectMap2M: 24676352 kB' 'DirectMap1G: 41943040 kB' 00:02:48.812 22:40:39 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:48.812 22:40:39 -- setup/common.sh@32 -- # continue 00:02:48.812 22:40:39 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.812 22:40:39 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.812 22:40:39 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:48.812 22:40:39 -- setup/common.sh@32 -- # continue 00:02:48.812 22:40:39 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.812 22:40:39 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.812 22:40:39 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:48.812 22:40:39 -- setup/common.sh@32 -- # continue 00:02:48.812 22:40:39 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.812 22:40:39 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.812 22:40:39 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:48.812 22:40:39 -- setup/common.sh@32 -- # continue 00:02:48.812 22:40:39 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.812 22:40:39 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.812 22:40:39 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:48.812 22:40:39 -- setup/common.sh@32 -- # continue 00:02:48.812 22:40:39 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.812 22:40:39 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.812 22:40:39 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:48.812 22:40:39 -- setup/common.sh@32 -- # continue 00:02:48.812 22:40:39 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.812 22:40:39 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.812 22:40:39 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:48.812 22:40:39 -- setup/common.sh@32 -- # continue 00:02:48.812 22:40:39 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.812 22:40:39 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.812 22:40:39 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:48.812 22:40:39 -- setup/common.sh@32 -- # continue 00:02:48.812 22:40:39 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.812 22:40:39 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.812 22:40:39 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:48.812 22:40:39 -- setup/common.sh@32 -- # continue 00:02:48.812 22:40:39 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.812 22:40:39 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.812 22:40:39 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:48.812 22:40:39 -- setup/common.sh@32 -- # continue 00:02:48.812 22:40:39 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.812 22:40:39 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.812 22:40:39 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:48.812 22:40:39 -- setup/common.sh@32 -- # continue 00:02:48.812 22:40:39 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.812 22:40:39 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.812 22:40:39 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:48.812 22:40:39 -- setup/common.sh@32 -- # continue 00:02:48.812 22:40:39 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.812 22:40:39 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.812 22:40:39 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:48.812 22:40:39 -- setup/common.sh@32 -- # continue 00:02:48.812 22:40:39 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.812 22:40:39 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.812 22:40:39 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:48.812 22:40:39 -- setup/common.sh@32 -- # continue 00:02:48.813 22:40:39 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.813 22:40:39 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.813 22:40:39 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:48.813 22:40:39 -- setup/common.sh@32 -- # continue 00:02:48.813 22:40:39 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.813 22:40:39 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.813 22:40:39 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:48.813 22:40:39 -- setup/common.sh@32 -- # continue 00:02:48.813 22:40:39 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.813 22:40:39 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.813 22:40:39 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:48.813 22:40:39 -- setup/common.sh@32 -- # continue 00:02:48.813 22:40:39 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.813 22:40:39 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.813 22:40:39 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:48.813 22:40:39 -- setup/common.sh@32 -- # continue 00:02:48.813 22:40:39 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.813 22:40:39 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.813 22:40:39 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:48.813 22:40:39 -- setup/common.sh@32 -- # continue 00:02:48.813 22:40:39 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.813 22:40:39 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.813 22:40:39 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:48.813 22:40:39 -- setup/common.sh@32 -- # continue 00:02:48.813 22:40:39 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.813 22:40:39 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.813 22:40:39 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:48.813 22:40:39 -- setup/common.sh@32 -- # continue 00:02:48.813 22:40:39 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.813 22:40:39 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.813 22:40:39 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:48.813 22:40:39 -- setup/common.sh@32 -- # continue 00:02:48.813 22:40:39 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.813 22:40:39 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.813 22:40:39 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:48.813 22:40:39 -- setup/common.sh@32 -- # continue 00:02:48.813 22:40:39 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.813 22:40:39 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.813 22:40:39 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:48.813 22:40:39 -- setup/common.sh@32 -- # continue 00:02:48.813 22:40:39 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.813 22:40:39 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.813 22:40:39 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:48.813 22:40:39 -- setup/common.sh@32 -- # continue 00:02:48.813 22:40:39 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.813 22:40:39 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.813 22:40:39 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:48.813 22:40:39 -- setup/common.sh@32 -- # continue 00:02:48.813 22:40:39 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.813 22:40:39 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.813 22:40:39 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:48.813 22:40:39 -- setup/common.sh@32 -- # continue 00:02:48.813 22:40:39 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.813 22:40:39 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.813 22:40:39 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:48.813 22:40:39 -- setup/common.sh@32 -- # continue 00:02:48.813 22:40:39 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.813 22:40:39 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.813 22:40:39 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:48.813 22:40:39 -- setup/common.sh@32 -- # continue 00:02:48.813 22:40:39 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.813 22:40:39 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.813 22:40:39 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:48.813 22:40:39 -- setup/common.sh@32 -- # continue 00:02:48.813 22:40:39 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.813 22:40:39 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.813 22:40:39 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:48.813 22:40:39 -- setup/common.sh@32 -- # continue 00:02:48.813 22:40:39 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.813 22:40:39 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.813 22:40:39 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:48.813 22:40:39 -- setup/common.sh@32 -- # continue 00:02:48.813 22:40:39 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.813 22:40:39 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.813 22:40:39 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:48.813 22:40:39 -- setup/common.sh@32 -- # continue 00:02:48.813 22:40:39 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.813 22:40:39 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.813 22:40:39 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:48.813 22:40:39 -- setup/common.sh@32 -- # continue 00:02:48.813 22:40:39 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.813 22:40:39 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.813 22:40:39 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:48.813 22:40:39 -- setup/common.sh@32 -- # continue 00:02:48.813 22:40:39 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.813 22:40:39 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.813 22:40:39 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:48.813 22:40:39 -- setup/common.sh@32 -- # continue 00:02:48.813 22:40:39 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.813 22:40:39 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.813 22:40:39 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:48.813 22:40:39 -- setup/common.sh@32 -- # continue 00:02:48.813 22:40:39 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.813 22:40:39 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.813 22:40:39 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:48.813 22:40:39 -- setup/common.sh@32 -- # continue 00:02:48.813 22:40:39 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.813 22:40:39 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.813 22:40:39 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:48.813 22:40:39 -- setup/common.sh@32 -- # continue 00:02:48.813 22:40:39 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.813 22:40:39 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.813 22:40:39 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:48.813 22:40:39 -- setup/common.sh@32 -- # continue 00:02:48.813 22:40:39 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.813 22:40:39 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.813 22:40:39 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:48.813 22:40:39 -- setup/common.sh@32 -- # continue 00:02:48.813 22:40:39 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.813 22:40:39 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.813 22:40:39 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:48.813 22:40:39 -- setup/common.sh@32 -- # continue 00:02:48.813 22:40:39 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.813 22:40:39 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.813 22:40:39 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:48.813 22:40:39 -- setup/common.sh@32 -- # continue 00:02:48.813 22:40:39 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.813 22:40:39 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.813 22:40:39 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:48.813 22:40:39 -- setup/common.sh@32 -- # continue 00:02:48.813 22:40:39 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.813 22:40:39 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.813 22:40:39 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:48.813 22:40:39 -- setup/common.sh@32 -- # continue 00:02:48.813 22:40:39 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.813 22:40:39 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.813 22:40:39 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:48.813 22:40:39 -- setup/common.sh@32 -- # continue 00:02:48.813 22:40:39 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.813 22:40:39 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.813 22:40:39 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:48.813 22:40:39 -- setup/common.sh@32 -- # continue 00:02:48.813 22:40:39 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.813 22:40:39 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.813 22:40:39 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:48.813 22:40:39 -- setup/common.sh@32 -- # continue 00:02:48.813 22:40:39 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.813 22:40:39 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.813 22:40:39 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:48.813 22:40:39 -- setup/common.sh@33 -- # echo 1536 00:02:48.813 22:40:39 -- setup/common.sh@33 -- # return 0 00:02:48.813 22:40:39 -- setup/hugepages.sh@110 -- # (( 1536 == nr_hugepages + surp + resv )) 00:02:48.813 22:40:39 -- setup/hugepages.sh@112 -- # get_nodes 00:02:48.813 22:40:39 -- setup/hugepages.sh@27 -- # local node 00:02:48.813 22:40:39 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:02:48.814 22:40:39 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=512 00:02:48.814 22:40:39 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:02:48.814 22:40:39 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=1024 00:02:48.814 22:40:39 -- setup/hugepages.sh@32 -- # no_nodes=2 00:02:48.814 22:40:39 -- setup/hugepages.sh@33 -- # (( no_nodes > 0 )) 00:02:48.814 22:40:39 -- setup/hugepages.sh@115 -- # for node in "${!nodes_test[@]}" 00:02:48.814 22:40:39 -- setup/hugepages.sh@116 -- # (( nodes_test[node] += resv )) 00:02:48.814 22:40:39 -- setup/hugepages.sh@117 -- # get_meminfo HugePages_Surp 0 00:02:48.814 22:40:39 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:02:48.814 22:40:39 -- setup/common.sh@18 -- # local node=0 00:02:48.814 22:40:39 -- setup/common.sh@19 -- # local var val 00:02:48.814 22:40:39 -- setup/common.sh@20 -- # local mem_f mem 00:02:48.814 22:40:39 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:02:48.814 22:40:39 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node0/meminfo ]] 00:02:48.814 22:40:39 -- setup/common.sh@24 -- # mem_f=/sys/devices/system/node/node0/meminfo 00:02:48.814 22:40:39 -- setup/common.sh@28 -- # mapfile -t mem 00:02:48.814 22:40:39 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:02:48.814 22:40:39 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.814 22:40:39 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.814 22:40:39 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 32829884 kB' 'MemFree: 20161684 kB' 'MemUsed: 12668200 kB' 'SwapCached: 0 kB' 'Active: 6998492 kB' 'Inactive: 3490860 kB' 'Active(anon): 6617280 kB' 'Inactive(anon): 0 kB' 'Active(file): 381212 kB' 'Inactive(file): 3490860 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'FilePages: 10244328 kB' 'Mapped: 156424 kB' 'AnonPages: 248152 kB' 'Shmem: 6372256 kB' 'KernelStack: 6680 kB' 'PageTables: 4528 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'KReclaimable: 272444 kB' 'Slab: 484760 kB' 'SReclaimable: 272444 kB' 'SUnreclaim: 212316 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 512' 'HugePages_Free: 512' 'HugePages_Surp: 0' 00:02:48.814 22:40:39 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:48.814 22:40:39 -- setup/common.sh@32 -- # continue 00:02:48.814 22:40:39 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.814 22:40:39 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.814 22:40:39 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:48.814 22:40:39 -- setup/common.sh@32 -- # continue 00:02:48.814 22:40:39 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.814 22:40:39 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.814 22:40:39 -- setup/common.sh@32 -- # [[ MemUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:48.814 22:40:39 -- setup/common.sh@32 -- # continue 00:02:48.814 22:40:39 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.814 22:40:39 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.814 22:40:39 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:48.814 22:40:39 -- setup/common.sh@32 -- # continue 00:02:48.814 22:40:39 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.814 22:40:39 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.814 22:40:39 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:48.814 22:40:39 -- setup/common.sh@32 -- # continue 00:02:48.814 22:40:39 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.814 22:40:39 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.814 22:40:39 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:48.814 22:40:39 -- setup/common.sh@32 -- # continue 00:02:48.814 22:40:39 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.814 22:40:39 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.814 22:40:39 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:48.814 22:40:39 -- setup/common.sh@32 -- # continue 00:02:48.814 22:40:39 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.814 22:40:39 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.814 22:40:39 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:48.814 22:40:39 -- setup/common.sh@32 -- # continue 00:02:48.814 22:40:39 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.814 22:40:39 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.814 22:40:39 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:48.814 22:40:39 -- setup/common.sh@32 -- # continue 00:02:48.814 22:40:39 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.814 22:40:39 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.814 22:40:39 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:48.814 22:40:39 -- setup/common.sh@32 -- # continue 00:02:48.814 22:40:39 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.814 22:40:39 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.814 22:40:39 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:48.814 22:40:39 -- setup/common.sh@32 -- # continue 00:02:48.814 22:40:39 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.814 22:40:39 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.814 22:40:39 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:48.814 22:40:39 -- setup/common.sh@32 -- # continue 00:02:48.814 22:40:39 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.814 22:40:39 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.814 22:40:39 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:48.814 22:40:39 -- setup/common.sh@32 -- # continue 00:02:48.814 22:40:39 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.814 22:40:39 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.814 22:40:39 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:48.814 22:40:39 -- setup/common.sh@32 -- # continue 00:02:48.814 22:40:39 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.814 22:40:39 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.814 22:40:39 -- setup/common.sh@32 -- # [[ FilePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:48.814 22:40:39 -- setup/common.sh@32 -- # continue 00:02:48.814 22:40:39 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.814 22:40:39 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.814 22:40:39 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:48.814 22:40:39 -- setup/common.sh@32 -- # continue 00:02:48.814 22:40:39 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.814 22:40:39 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.814 22:40:39 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:48.814 22:40:39 -- setup/common.sh@32 -- # continue 00:02:48.814 22:40:39 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.814 22:40:39 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.814 22:40:39 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:48.814 22:40:39 -- setup/common.sh@32 -- # continue 00:02:48.814 22:40:39 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.814 22:40:39 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.814 22:40:39 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:48.814 22:40:39 -- setup/common.sh@32 -- # continue 00:02:48.814 22:40:39 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.814 22:40:39 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.814 22:40:39 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:48.814 22:40:39 -- setup/common.sh@32 -- # continue 00:02:48.814 22:40:39 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.814 22:40:39 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.814 22:40:39 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:48.814 22:40:39 -- setup/common.sh@32 -- # continue 00:02:48.814 22:40:39 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.814 22:40:39 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.814 22:40:39 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:48.814 22:40:39 -- setup/common.sh@32 -- # continue 00:02:48.814 22:40:39 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.814 22:40:39 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.814 22:40:39 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:48.814 22:40:39 -- setup/common.sh@32 -- # continue 00:02:48.814 22:40:39 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.814 22:40:39 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.814 22:40:39 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:48.814 22:40:39 -- setup/common.sh@32 -- # continue 00:02:48.814 22:40:39 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.814 22:40:39 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.814 22:40:39 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:48.814 22:40:39 -- setup/common.sh@32 -- # continue 00:02:48.814 22:40:39 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.814 22:40:39 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.814 22:40:39 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:48.814 22:40:39 -- setup/common.sh@32 -- # continue 00:02:48.814 22:40:39 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.814 22:40:39 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.814 22:40:39 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:48.814 22:40:39 -- setup/common.sh@32 -- # continue 00:02:48.814 22:40:39 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.814 22:40:39 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.814 22:40:39 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:48.814 22:40:39 -- setup/common.sh@32 -- # continue 00:02:48.814 22:40:39 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.814 22:40:39 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.814 22:40:39 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:48.814 22:40:39 -- setup/common.sh@32 -- # continue 00:02:48.814 22:40:39 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.814 22:40:39 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.814 22:40:39 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:48.814 22:40:39 -- setup/common.sh@32 -- # continue 00:02:48.814 22:40:39 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.814 22:40:39 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.814 22:40:39 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:48.814 22:40:39 -- setup/common.sh@32 -- # continue 00:02:48.814 22:40:39 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.814 22:40:39 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.814 22:40:39 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:48.814 22:40:39 -- setup/common.sh@32 -- # continue 00:02:48.814 22:40:39 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.814 22:40:39 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.814 22:40:39 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:48.814 22:40:39 -- setup/common.sh@32 -- # continue 00:02:48.814 22:40:39 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.815 22:40:39 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.815 22:40:39 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:48.815 22:40:39 -- setup/common.sh@32 -- # continue 00:02:48.815 22:40:39 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.815 22:40:39 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.815 22:40:39 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:48.815 22:40:39 -- setup/common.sh@32 -- # continue 00:02:48.815 22:40:39 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.815 22:40:39 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.815 22:40:39 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:48.815 22:40:39 -- setup/common.sh@32 -- # continue 00:02:48.815 22:40:39 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.815 22:40:39 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.815 22:40:39 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:48.815 22:40:39 -- setup/common.sh@33 -- # echo 0 00:02:48.815 22:40:39 -- setup/common.sh@33 -- # return 0 00:02:48.815 22:40:39 -- setup/hugepages.sh@117 -- # (( nodes_test[node] += 0 )) 00:02:48.815 22:40:39 -- setup/hugepages.sh@115 -- # for node in "${!nodes_test[@]}" 00:02:48.815 22:40:39 -- setup/hugepages.sh@116 -- # (( nodes_test[node] += resv )) 00:02:48.815 22:40:39 -- setup/hugepages.sh@117 -- # get_meminfo HugePages_Surp 1 00:02:48.815 22:40:39 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:02:48.815 22:40:39 -- setup/common.sh@18 -- # local node=1 00:02:48.815 22:40:39 -- setup/common.sh@19 -- # local var val 00:02:48.815 22:40:39 -- setup/common.sh@20 -- # local mem_f mem 00:02:48.815 22:40:39 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:02:48.815 22:40:39 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node1/meminfo ]] 00:02:48.815 22:40:39 -- setup/common.sh@24 -- # mem_f=/sys/devices/system/node/node1/meminfo 00:02:48.815 22:40:39 -- setup/common.sh@28 -- # mapfile -t mem 00:02:48.815 22:40:39 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:02:48.815 22:40:39 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.815 22:40:39 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.815 22:40:39 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 27711852 kB' 'MemFree: 22165160 kB' 'MemUsed: 5546692 kB' 'SwapCached: 0 kB' 'Active: 2324384 kB' 'Inactive: 164976 kB' 'Active(anon): 2141280 kB' 'Inactive(anon): 0 kB' 'Active(file): 183104 kB' 'Inactive(file): 164976 kB' 'Unevictable: 0 kB' 'Mlocked: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'FilePages: 2276912 kB' 'Mapped: 45040 kB' 'AnonPages: 212520 kB' 'Shmem: 1928832 kB' 'KernelStack: 6136 kB' 'PageTables: 3492 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'KReclaimable: 143068 kB' 'Slab: 322080 kB' 'SReclaimable: 143068 kB' 'SUnreclaim: 179012 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Surp: 0' 00:02:48.815 22:40:39 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:48.815 22:40:39 -- setup/common.sh@32 -- # continue 00:02:48.815 22:40:39 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.815 22:40:39 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.815 22:40:39 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:48.815 22:40:39 -- setup/common.sh@32 -- # continue 00:02:48.815 22:40:39 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.815 22:40:39 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.815 22:40:39 -- setup/common.sh@32 -- # [[ MemUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:48.815 22:40:39 -- setup/common.sh@32 -- # continue 00:02:48.815 22:40:39 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.815 22:40:39 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.815 22:40:39 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:48.815 22:40:39 -- setup/common.sh@32 -- # continue 00:02:48.815 22:40:39 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.815 22:40:39 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.815 22:40:39 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:48.815 22:40:39 -- setup/common.sh@32 -- # continue 00:02:48.815 22:40:39 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.815 22:40:39 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.815 22:40:39 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:48.815 22:40:39 -- setup/common.sh@32 -- # continue 00:02:48.815 22:40:39 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.815 22:40:39 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.815 22:40:39 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:48.815 22:40:39 -- setup/common.sh@32 -- # continue 00:02:48.815 22:40:39 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.815 22:40:39 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.815 22:40:39 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:48.815 22:40:39 -- setup/common.sh@32 -- # continue 00:02:48.815 22:40:39 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.815 22:40:39 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.815 22:40:39 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:48.815 22:40:39 -- setup/common.sh@32 -- # continue 00:02:48.815 22:40:39 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.815 22:40:39 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.815 22:40:39 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:48.815 22:40:39 -- setup/common.sh@32 -- # continue 00:02:48.815 22:40:39 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.815 22:40:39 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.815 22:40:39 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:48.815 22:40:39 -- setup/common.sh@32 -- # continue 00:02:48.815 22:40:39 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.815 22:40:39 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.815 22:40:39 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:48.815 22:40:39 -- setup/common.sh@32 -- # continue 00:02:48.815 22:40:39 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.815 22:40:39 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.815 22:40:39 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:48.815 22:40:39 -- setup/common.sh@32 -- # continue 00:02:48.815 22:40:39 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.815 22:40:39 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.815 22:40:39 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:48.815 22:40:39 -- setup/common.sh@32 -- # continue 00:02:48.815 22:40:39 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.815 22:40:39 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.815 22:40:39 -- setup/common.sh@32 -- # [[ FilePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:48.815 22:40:39 -- setup/common.sh@32 -- # continue 00:02:48.815 22:40:39 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.815 22:40:39 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.815 22:40:39 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:48.815 22:40:39 -- setup/common.sh@32 -- # continue 00:02:48.815 22:40:39 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.815 22:40:39 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.815 22:40:39 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:48.815 22:40:39 -- setup/common.sh@32 -- # continue 00:02:48.815 22:40:39 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.815 22:40:39 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.815 22:40:39 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:48.815 22:40:39 -- setup/common.sh@32 -- # continue 00:02:48.815 22:40:39 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.815 22:40:39 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.815 22:40:39 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:48.815 22:40:39 -- setup/common.sh@32 -- # continue 00:02:48.815 22:40:39 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.815 22:40:39 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.815 22:40:39 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:48.815 22:40:39 -- setup/common.sh@32 -- # continue 00:02:48.815 22:40:39 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.815 22:40:39 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.815 22:40:39 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:48.815 22:40:39 -- setup/common.sh@32 -- # continue 00:02:48.815 22:40:39 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.815 22:40:39 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.815 22:40:39 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:48.815 22:40:39 -- setup/common.sh@32 -- # continue 00:02:48.815 22:40:39 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.815 22:40:39 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.815 22:40:39 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:48.815 22:40:39 -- setup/common.sh@32 -- # continue 00:02:48.815 22:40:39 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.815 22:40:39 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.815 22:40:39 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:48.815 22:40:39 -- setup/common.sh@32 -- # continue 00:02:48.815 22:40:39 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.815 22:40:39 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.815 22:40:39 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:48.815 22:40:39 -- setup/common.sh@32 -- # continue 00:02:48.815 22:40:39 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.815 22:40:39 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.815 22:40:39 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:48.815 22:40:39 -- setup/common.sh@32 -- # continue 00:02:48.815 22:40:39 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.815 22:40:39 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.815 22:40:39 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:48.815 22:40:39 -- setup/common.sh@32 -- # continue 00:02:48.815 22:40:39 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.815 22:40:39 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.815 22:40:39 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:48.815 22:40:39 -- setup/common.sh@32 -- # continue 00:02:48.815 22:40:39 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.815 22:40:39 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.815 22:40:39 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:48.815 22:40:39 -- setup/common.sh@32 -- # continue 00:02:48.816 22:40:39 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.816 22:40:39 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.816 22:40:39 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:48.816 22:40:39 -- setup/common.sh@32 -- # continue 00:02:48.816 22:40:39 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.816 22:40:39 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.816 22:40:39 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:48.816 22:40:39 -- setup/common.sh@32 -- # continue 00:02:48.816 22:40:39 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.816 22:40:39 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.816 22:40:39 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:48.816 22:40:39 -- setup/common.sh@32 -- # continue 00:02:48.816 22:40:39 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.816 22:40:39 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.816 22:40:39 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:48.816 22:40:39 -- setup/common.sh@32 -- # continue 00:02:49.074 22:40:39 -- setup/common.sh@31 -- # IFS=': ' 00:02:49.074 22:40:39 -- setup/common.sh@31 -- # read -r var val _ 00:02:49.074 22:40:39 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:49.074 22:40:39 -- setup/common.sh@32 -- # continue 00:02:49.074 22:40:39 -- setup/common.sh@31 -- # IFS=': ' 00:02:49.074 22:40:39 -- setup/common.sh@31 -- # read -r var val _ 00:02:49.074 22:40:39 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:49.074 22:40:39 -- setup/common.sh@32 -- # continue 00:02:49.074 22:40:39 -- setup/common.sh@31 -- # IFS=': ' 00:02:49.074 22:40:39 -- setup/common.sh@31 -- # read -r var val _ 00:02:49.074 22:40:39 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:49.074 22:40:39 -- setup/common.sh@32 -- # continue 00:02:49.074 22:40:39 -- setup/common.sh@31 -- # IFS=': ' 00:02:49.074 22:40:39 -- setup/common.sh@31 -- # read -r var val _ 00:02:49.074 22:40:39 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:49.074 22:40:39 -- setup/common.sh@33 -- # echo 0 00:02:49.074 22:40:39 -- setup/common.sh@33 -- # return 0 00:02:49.074 22:40:39 -- setup/hugepages.sh@117 -- # (( nodes_test[node] += 0 )) 00:02:49.074 22:40:39 -- setup/hugepages.sh@126 -- # for node in "${!nodes_test[@]}" 00:02:49.074 22:40:39 -- setup/hugepages.sh@127 -- # sorted_t[nodes_test[node]]=1 00:02:49.074 22:40:39 -- setup/hugepages.sh@127 -- # sorted_s[nodes_sys[node]]=1 00:02:49.074 22:40:39 -- setup/hugepages.sh@128 -- # echo 'node0=512 expecting 512' 00:02:49.074 node0=512 expecting 512 00:02:49.074 22:40:39 -- setup/hugepages.sh@126 -- # for node in "${!nodes_test[@]}" 00:02:49.074 22:40:39 -- setup/hugepages.sh@127 -- # sorted_t[nodes_test[node]]=1 00:02:49.074 22:40:39 -- setup/hugepages.sh@127 -- # sorted_s[nodes_sys[node]]=1 00:02:49.074 22:40:39 -- setup/hugepages.sh@128 -- # echo 'node1=1024 expecting 1024' 00:02:49.074 node1=1024 expecting 1024 00:02:49.074 22:40:39 -- setup/hugepages.sh@130 -- # [[ 512,1024 == \5\1\2\,\1\0\2\4 ]] 00:02:49.074 00:02:49.074 real 0m1.443s 00:02:49.074 user 0m0.605s 00:02:49.074 sys 0m0.800s 00:02:49.074 22:40:39 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:02:49.074 22:40:39 -- common/autotest_common.sh@10 -- # set +x 00:02:49.074 ************************************ 00:02:49.074 END TEST custom_alloc 00:02:49.074 ************************************ 00:02:49.074 22:40:39 -- setup/hugepages.sh@215 -- # run_test no_shrink_alloc no_shrink_alloc 00:02:49.074 22:40:39 -- common/autotest_common.sh@1077 -- # '[' 2 -le 1 ']' 00:02:49.074 22:40:39 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:02:49.074 22:40:39 -- common/autotest_common.sh@10 -- # set +x 00:02:49.074 ************************************ 00:02:49.074 START TEST no_shrink_alloc 00:02:49.074 ************************************ 00:02:49.074 22:40:39 -- common/autotest_common.sh@1104 -- # no_shrink_alloc 00:02:49.074 22:40:39 -- setup/hugepages.sh@195 -- # get_test_nr_hugepages 2097152 0 00:02:49.074 22:40:39 -- setup/hugepages.sh@49 -- # local size=2097152 00:02:49.074 22:40:39 -- setup/hugepages.sh@50 -- # (( 2 > 1 )) 00:02:49.074 22:40:39 -- setup/hugepages.sh@51 -- # shift 00:02:49.074 22:40:39 -- setup/hugepages.sh@52 -- # node_ids=('0') 00:02:49.074 22:40:39 -- setup/hugepages.sh@52 -- # local node_ids 00:02:49.074 22:40:39 -- setup/hugepages.sh@55 -- # (( size >= default_hugepages )) 00:02:49.074 22:40:39 -- setup/hugepages.sh@57 -- # nr_hugepages=1024 00:02:49.074 22:40:39 -- setup/hugepages.sh@58 -- # get_test_nr_hugepages_per_node 0 00:02:49.074 22:40:39 -- setup/hugepages.sh@62 -- # user_nodes=('0') 00:02:49.075 22:40:39 -- setup/hugepages.sh@62 -- # local user_nodes 00:02:49.075 22:40:39 -- setup/hugepages.sh@64 -- # local _nr_hugepages=1024 00:02:49.075 22:40:39 -- setup/hugepages.sh@65 -- # local _no_nodes=2 00:02:49.075 22:40:39 -- setup/hugepages.sh@67 -- # nodes_test=() 00:02:49.075 22:40:39 -- setup/hugepages.sh@67 -- # local -g nodes_test 00:02:49.075 22:40:39 -- setup/hugepages.sh@69 -- # (( 1 > 0 )) 00:02:49.075 22:40:39 -- setup/hugepages.sh@70 -- # for _no_nodes in "${user_nodes[@]}" 00:02:49.075 22:40:39 -- setup/hugepages.sh@71 -- # nodes_test[_no_nodes]=1024 00:02:49.075 22:40:39 -- setup/hugepages.sh@73 -- # return 0 00:02:49.075 22:40:39 -- setup/hugepages.sh@198 -- # setup output 00:02:49.075 22:40:39 -- setup/common.sh@9 -- # [[ output == output ]] 00:02:49.075 22:40:39 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh 00:02:50.010 0000:00:04.7 (8086 0e27): Already using the vfio-pci driver 00:02:50.010 0000:88:00.0 (8086 0a54): Already using the vfio-pci driver 00:02:50.010 0000:00:04.6 (8086 0e26): Already using the vfio-pci driver 00:02:50.010 0000:00:04.5 (8086 0e25): Already using the vfio-pci driver 00:02:50.010 0000:00:04.4 (8086 0e24): Already using the vfio-pci driver 00:02:50.010 0000:00:04.3 (8086 0e23): Already using the vfio-pci driver 00:02:50.010 0000:00:04.2 (8086 0e22): Already using the vfio-pci driver 00:02:50.010 0000:00:04.1 (8086 0e21): Already using the vfio-pci driver 00:02:50.010 0000:00:04.0 (8086 0e20): Already using the vfio-pci driver 00:02:50.010 0000:80:04.7 (8086 0e27): Already using the vfio-pci driver 00:02:50.010 0000:80:04.6 (8086 0e26): Already using the vfio-pci driver 00:02:50.010 0000:80:04.5 (8086 0e25): Already using the vfio-pci driver 00:02:50.010 0000:80:04.4 (8086 0e24): Already using the vfio-pci driver 00:02:50.010 0000:80:04.3 (8086 0e23): Already using the vfio-pci driver 00:02:50.010 0000:80:04.2 (8086 0e22): Already using the vfio-pci driver 00:02:50.010 0000:80:04.1 (8086 0e21): Already using the vfio-pci driver 00:02:50.010 0000:80:04.0 (8086 0e20): Already using the vfio-pci driver 00:02:50.272 22:40:41 -- setup/hugepages.sh@199 -- # verify_nr_hugepages 00:02:50.272 22:40:41 -- setup/hugepages.sh@89 -- # local node 00:02:50.272 22:40:41 -- setup/hugepages.sh@90 -- # local sorted_t 00:02:50.272 22:40:41 -- setup/hugepages.sh@91 -- # local sorted_s 00:02:50.272 22:40:41 -- setup/hugepages.sh@92 -- # local surp 00:02:50.272 22:40:41 -- setup/hugepages.sh@93 -- # local resv 00:02:50.272 22:40:41 -- setup/hugepages.sh@94 -- # local anon 00:02:50.272 22:40:41 -- setup/hugepages.sh@96 -- # [[ always [madvise] never != *\[\n\e\v\e\r\]* ]] 00:02:50.272 22:40:41 -- setup/hugepages.sh@97 -- # get_meminfo AnonHugePages 00:02:50.272 22:40:41 -- setup/common.sh@17 -- # local get=AnonHugePages 00:02:50.272 22:40:41 -- setup/common.sh@18 -- # local node= 00:02:50.272 22:40:41 -- setup/common.sh@19 -- # local var val 00:02:50.272 22:40:41 -- setup/common.sh@20 -- # local mem_f mem 00:02:50.272 22:40:41 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:02:50.272 22:40:41 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:02:50.272 22:40:41 -- setup/common.sh@25 -- # [[ -n '' ]] 00:02:50.272 22:40:41 -- setup/common.sh@28 -- # mapfile -t mem 00:02:50.272 22:40:41 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:02:50.272 22:40:41 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.272 22:40:41 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.272 22:40:41 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60541736 kB' 'MemFree: 43349016 kB' 'MemAvailable: 47340404 kB' 'Buffers: 2696 kB' 'Cached: 12518588 kB' 'SwapCached: 0 kB' 'Active: 9322844 kB' 'Inactive: 3655836 kB' 'Active(anon): 8758528 kB' 'Inactive(anon): 0 kB' 'Active(file): 564316 kB' 'Inactive(file): 3655836 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 460600 kB' 'Mapped: 201508 kB' 'Shmem: 8301132 kB' 'KReclaimable: 415672 kB' 'Slab: 807140 kB' 'SReclaimable: 415672 kB' 'SUnreclaim: 391468 kB' 'KernelStack: 12832 kB' 'PageTables: 8076 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37610896 kB' 'Committed_AS: 9884932 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 197148 kB' 'VmallocChunk: 0 kB' 'Percpu: 38592 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 2506332 kB' 'DirectMap2M: 24676352 kB' 'DirectMap1G: 41943040 kB' 00:02:50.272 22:40:41 -- setup/common.sh@32 -- # [[ MemTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:50.272 22:40:41 -- setup/common.sh@32 -- # continue 00:02:50.272 22:40:41 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.272 22:40:41 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.272 22:40:41 -- setup/common.sh@32 -- # [[ MemFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:50.272 22:40:41 -- setup/common.sh@32 -- # continue 00:02:50.272 22:40:41 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.272 22:40:41 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.272 22:40:41 -- setup/common.sh@32 -- # [[ MemAvailable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:50.272 22:40:41 -- setup/common.sh@32 -- # continue 00:02:50.272 22:40:41 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.272 22:40:41 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.272 22:40:41 -- setup/common.sh@32 -- # [[ Buffers == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:50.272 22:40:41 -- setup/common.sh@32 -- # continue 00:02:50.272 22:40:41 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.272 22:40:41 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.272 22:40:41 -- setup/common.sh@32 -- # [[ Cached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:50.272 22:40:41 -- setup/common.sh@32 -- # continue 00:02:50.272 22:40:41 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.272 22:40:41 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.272 22:40:41 -- setup/common.sh@32 -- # [[ SwapCached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:50.272 22:40:41 -- setup/common.sh@32 -- # continue 00:02:50.272 22:40:41 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.272 22:40:41 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.273 22:40:41 -- setup/common.sh@32 -- # [[ Active == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:50.273 22:40:41 -- setup/common.sh@32 -- # continue 00:02:50.273 22:40:41 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.273 22:40:41 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.273 22:40:41 -- setup/common.sh@32 -- # [[ Inactive == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:50.273 22:40:41 -- setup/common.sh@32 -- # continue 00:02:50.273 22:40:41 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.273 22:40:41 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.273 22:40:41 -- setup/common.sh@32 -- # [[ Active(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:50.273 22:40:41 -- setup/common.sh@32 -- # continue 00:02:50.273 22:40:41 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.273 22:40:41 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.273 22:40:41 -- setup/common.sh@32 -- # [[ Inactive(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:50.273 22:40:41 -- setup/common.sh@32 -- # continue 00:02:50.273 22:40:41 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.273 22:40:41 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.273 22:40:41 -- setup/common.sh@32 -- # [[ Active(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:50.273 22:40:41 -- setup/common.sh@32 -- # continue 00:02:50.273 22:40:41 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.273 22:40:41 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.273 22:40:41 -- setup/common.sh@32 -- # [[ Inactive(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:50.273 22:40:41 -- setup/common.sh@32 -- # continue 00:02:50.273 22:40:41 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.273 22:40:41 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.273 22:40:41 -- setup/common.sh@32 -- # [[ Unevictable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:50.273 22:40:41 -- setup/common.sh@32 -- # continue 00:02:50.273 22:40:41 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.273 22:40:41 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.273 22:40:41 -- setup/common.sh@32 -- # [[ Mlocked == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:50.273 22:40:41 -- setup/common.sh@32 -- # continue 00:02:50.273 22:40:41 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.273 22:40:41 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.273 22:40:41 -- setup/common.sh@32 -- # [[ SwapTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:50.273 22:40:41 -- setup/common.sh@32 -- # continue 00:02:50.273 22:40:41 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.273 22:40:41 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.273 22:40:41 -- setup/common.sh@32 -- # [[ SwapFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:50.273 22:40:41 -- setup/common.sh@32 -- # continue 00:02:50.273 22:40:41 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.273 22:40:41 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.273 22:40:41 -- setup/common.sh@32 -- # [[ Zswap == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:50.273 22:40:41 -- setup/common.sh@32 -- # continue 00:02:50.273 22:40:41 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.273 22:40:41 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.273 22:40:41 -- setup/common.sh@32 -- # [[ Zswapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:50.273 22:40:41 -- setup/common.sh@32 -- # continue 00:02:50.273 22:40:41 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.273 22:40:41 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.273 22:40:41 -- setup/common.sh@32 -- # [[ Dirty == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:50.273 22:40:41 -- setup/common.sh@32 -- # continue 00:02:50.273 22:40:41 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.273 22:40:41 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.273 22:40:41 -- setup/common.sh@32 -- # [[ Writeback == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:50.273 22:40:41 -- setup/common.sh@32 -- # continue 00:02:50.273 22:40:41 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.273 22:40:41 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.273 22:40:41 -- setup/common.sh@32 -- # [[ AnonPages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:50.273 22:40:41 -- setup/common.sh@32 -- # continue 00:02:50.273 22:40:41 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.273 22:40:41 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.273 22:40:41 -- setup/common.sh@32 -- # [[ Mapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:50.273 22:40:41 -- setup/common.sh@32 -- # continue 00:02:50.273 22:40:41 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.273 22:40:41 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.273 22:40:41 -- setup/common.sh@32 -- # [[ Shmem == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:50.273 22:40:41 -- setup/common.sh@32 -- # continue 00:02:50.273 22:40:41 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.273 22:40:41 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.273 22:40:41 -- setup/common.sh@32 -- # [[ KReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:50.273 22:40:41 -- setup/common.sh@32 -- # continue 00:02:50.273 22:40:41 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.273 22:40:41 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.273 22:40:41 -- setup/common.sh@32 -- # [[ Slab == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:50.273 22:40:41 -- setup/common.sh@32 -- # continue 00:02:50.273 22:40:41 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.273 22:40:41 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.273 22:40:41 -- setup/common.sh@32 -- # [[ SReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:50.273 22:40:41 -- setup/common.sh@32 -- # continue 00:02:50.273 22:40:41 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.273 22:40:41 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.273 22:40:41 -- setup/common.sh@32 -- # [[ SUnreclaim == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:50.273 22:40:41 -- setup/common.sh@32 -- # continue 00:02:50.273 22:40:41 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.273 22:40:41 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.273 22:40:41 -- setup/common.sh@32 -- # [[ KernelStack == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:50.273 22:40:41 -- setup/common.sh@32 -- # continue 00:02:50.273 22:40:41 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.273 22:40:41 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.273 22:40:41 -- setup/common.sh@32 -- # [[ PageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:50.273 22:40:41 -- setup/common.sh@32 -- # continue 00:02:50.273 22:40:41 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.273 22:40:41 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.273 22:40:41 -- setup/common.sh@32 -- # [[ SecPageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:50.273 22:40:41 -- setup/common.sh@32 -- # continue 00:02:50.273 22:40:41 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.273 22:40:41 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.273 22:40:41 -- setup/common.sh@32 -- # [[ NFS_Unstable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:50.273 22:40:41 -- setup/common.sh@32 -- # continue 00:02:50.273 22:40:41 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.273 22:40:41 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.273 22:40:41 -- setup/common.sh@32 -- # [[ Bounce == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:50.273 22:40:41 -- setup/common.sh@32 -- # continue 00:02:50.273 22:40:41 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.273 22:40:41 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.273 22:40:41 -- setup/common.sh@32 -- # [[ WritebackTmp == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:50.273 22:40:41 -- setup/common.sh@32 -- # continue 00:02:50.273 22:40:41 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.273 22:40:41 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.273 22:40:41 -- setup/common.sh@32 -- # [[ CommitLimit == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:50.273 22:40:41 -- setup/common.sh@32 -- # continue 00:02:50.273 22:40:41 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.273 22:40:41 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.273 22:40:41 -- setup/common.sh@32 -- # [[ Committed_AS == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:50.273 22:40:41 -- setup/common.sh@32 -- # continue 00:02:50.273 22:40:41 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.273 22:40:41 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.273 22:40:41 -- setup/common.sh@32 -- # [[ VmallocTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:50.273 22:40:41 -- setup/common.sh@32 -- # continue 00:02:50.273 22:40:41 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.273 22:40:41 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.273 22:40:41 -- setup/common.sh@32 -- # [[ VmallocUsed == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:50.273 22:40:41 -- setup/common.sh@32 -- # continue 00:02:50.273 22:40:41 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.273 22:40:41 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.273 22:40:41 -- setup/common.sh@32 -- # [[ VmallocChunk == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:50.273 22:40:41 -- setup/common.sh@32 -- # continue 00:02:50.273 22:40:41 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.273 22:40:41 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.273 22:40:41 -- setup/common.sh@32 -- # [[ Percpu == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:50.273 22:40:41 -- setup/common.sh@32 -- # continue 00:02:50.273 22:40:41 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.273 22:40:41 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.273 22:40:41 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:50.273 22:40:41 -- setup/common.sh@32 -- # continue 00:02:50.273 22:40:41 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.273 22:40:41 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.273 22:40:41 -- setup/common.sh@32 -- # [[ AnonHugePages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:50.273 22:40:41 -- setup/common.sh@33 -- # echo 0 00:02:50.273 22:40:41 -- setup/common.sh@33 -- # return 0 00:02:50.273 22:40:41 -- setup/hugepages.sh@97 -- # anon=0 00:02:50.273 22:40:41 -- setup/hugepages.sh@99 -- # get_meminfo HugePages_Surp 00:02:50.273 22:40:41 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:02:50.273 22:40:41 -- setup/common.sh@18 -- # local node= 00:02:50.273 22:40:41 -- setup/common.sh@19 -- # local var val 00:02:50.273 22:40:41 -- setup/common.sh@20 -- # local mem_f mem 00:02:50.273 22:40:41 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:02:50.273 22:40:41 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:02:50.273 22:40:41 -- setup/common.sh@25 -- # [[ -n '' ]] 00:02:50.273 22:40:41 -- setup/common.sh@28 -- # mapfile -t mem 00:02:50.273 22:40:41 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:02:50.273 22:40:41 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.273 22:40:41 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.274 22:40:41 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60541736 kB' 'MemFree: 43349016 kB' 'MemAvailable: 47340404 kB' 'Buffers: 2696 kB' 'Cached: 12518588 kB' 'SwapCached: 0 kB' 'Active: 9323268 kB' 'Inactive: 3655836 kB' 'Active(anon): 8758952 kB' 'Inactive(anon): 0 kB' 'Active(file): 564316 kB' 'Inactive(file): 3655836 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 461032 kB' 'Mapped: 201508 kB' 'Shmem: 8301132 kB' 'KReclaimable: 415672 kB' 'Slab: 807136 kB' 'SReclaimable: 415672 kB' 'SUnreclaim: 391464 kB' 'KernelStack: 12816 kB' 'PageTables: 8008 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37610896 kB' 'Committed_AS: 9884944 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 197116 kB' 'VmallocChunk: 0 kB' 'Percpu: 38592 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 2506332 kB' 'DirectMap2M: 24676352 kB' 'DirectMap1G: 41943040 kB' 00:02:50.274 22:40:41 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:50.274 22:40:41 -- setup/common.sh@32 -- # continue 00:02:50.274 22:40:41 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.274 22:40:41 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.274 22:40:41 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:50.274 22:40:41 -- setup/common.sh@32 -- # continue 00:02:50.274 22:40:41 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.274 22:40:41 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.274 22:40:41 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:50.274 22:40:41 -- setup/common.sh@32 -- # continue 00:02:50.274 22:40:41 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.274 22:40:41 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.274 22:40:41 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:50.274 22:40:41 -- setup/common.sh@32 -- # continue 00:02:50.274 22:40:41 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.274 22:40:41 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.274 22:40:41 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:50.274 22:40:41 -- setup/common.sh@32 -- # continue 00:02:50.274 22:40:41 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.274 22:40:41 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.274 22:40:41 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:50.274 22:40:41 -- setup/common.sh@32 -- # continue 00:02:50.274 22:40:41 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.274 22:40:41 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.274 22:40:41 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:50.274 22:40:41 -- setup/common.sh@32 -- # continue 00:02:50.274 22:40:41 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.274 22:40:41 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.274 22:40:41 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:50.274 22:40:41 -- setup/common.sh@32 -- # continue 00:02:50.274 22:40:41 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.274 22:40:41 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.274 22:40:41 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:50.274 22:40:41 -- setup/common.sh@32 -- # continue 00:02:50.274 22:40:41 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.274 22:40:41 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.274 22:40:41 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:50.274 22:40:41 -- setup/common.sh@32 -- # continue 00:02:50.274 22:40:41 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.274 22:40:41 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.274 22:40:41 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:50.274 22:40:41 -- setup/common.sh@32 -- # continue 00:02:50.274 22:40:41 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.274 22:40:41 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.274 22:40:41 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:50.274 22:40:41 -- setup/common.sh@32 -- # continue 00:02:50.274 22:40:41 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.274 22:40:41 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.274 22:40:41 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:50.274 22:40:41 -- setup/common.sh@32 -- # continue 00:02:50.274 22:40:41 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.274 22:40:41 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.274 22:40:41 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:50.274 22:40:41 -- setup/common.sh@32 -- # continue 00:02:50.274 22:40:41 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.274 22:40:41 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.274 22:40:41 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:50.274 22:40:41 -- setup/common.sh@32 -- # continue 00:02:50.274 22:40:41 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.274 22:40:41 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.274 22:40:41 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:50.274 22:40:41 -- setup/common.sh@32 -- # continue 00:02:50.274 22:40:41 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.274 22:40:41 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.274 22:40:41 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:50.274 22:40:41 -- setup/common.sh@32 -- # continue 00:02:50.274 22:40:41 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.274 22:40:41 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.274 22:40:41 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:50.274 22:40:41 -- setup/common.sh@32 -- # continue 00:02:50.274 22:40:41 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.274 22:40:41 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.274 22:40:41 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:50.274 22:40:41 -- setup/common.sh@32 -- # continue 00:02:50.274 22:40:41 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.274 22:40:41 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.274 22:40:41 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:50.274 22:40:41 -- setup/common.sh@32 -- # continue 00:02:50.274 22:40:41 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.274 22:40:41 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.274 22:40:41 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:50.274 22:40:41 -- setup/common.sh@32 -- # continue 00:02:50.274 22:40:41 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.274 22:40:41 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.274 22:40:41 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:50.274 22:40:41 -- setup/common.sh@32 -- # continue 00:02:50.274 22:40:41 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.274 22:40:41 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.274 22:40:41 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:50.274 22:40:41 -- setup/common.sh@32 -- # continue 00:02:50.274 22:40:41 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.274 22:40:41 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.274 22:40:41 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:50.274 22:40:41 -- setup/common.sh@32 -- # continue 00:02:50.274 22:40:41 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.274 22:40:41 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.274 22:40:41 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:50.274 22:40:41 -- setup/common.sh@32 -- # continue 00:02:50.274 22:40:41 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.274 22:40:41 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.274 22:40:41 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:50.274 22:40:41 -- setup/common.sh@32 -- # continue 00:02:50.274 22:40:41 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.274 22:40:41 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.274 22:40:41 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:50.274 22:40:41 -- setup/common.sh@32 -- # continue 00:02:50.274 22:40:41 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.274 22:40:41 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.274 22:40:41 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:50.274 22:40:41 -- setup/common.sh@32 -- # continue 00:02:50.274 22:40:41 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.274 22:40:41 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.274 22:40:41 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:50.274 22:40:41 -- setup/common.sh@32 -- # continue 00:02:50.274 22:40:41 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.274 22:40:41 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.274 22:40:41 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:50.274 22:40:41 -- setup/common.sh@32 -- # continue 00:02:50.274 22:40:41 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.274 22:40:41 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.274 22:40:41 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:50.274 22:40:41 -- setup/common.sh@32 -- # continue 00:02:50.274 22:40:41 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.274 22:40:41 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.274 22:40:41 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:50.274 22:40:41 -- setup/common.sh@32 -- # continue 00:02:50.274 22:40:41 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.274 22:40:41 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.274 22:40:41 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:50.274 22:40:41 -- setup/common.sh@32 -- # continue 00:02:50.274 22:40:41 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.274 22:40:41 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.274 22:40:41 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:50.274 22:40:41 -- setup/common.sh@32 -- # continue 00:02:50.274 22:40:41 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.274 22:40:41 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.274 22:40:41 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:50.274 22:40:41 -- setup/common.sh@32 -- # continue 00:02:50.274 22:40:41 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.274 22:40:41 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.274 22:40:41 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:50.274 22:40:41 -- setup/common.sh@32 -- # continue 00:02:50.274 22:40:41 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.274 22:40:41 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.274 22:40:41 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:50.274 22:40:41 -- setup/common.sh@32 -- # continue 00:02:50.274 22:40:41 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.274 22:40:41 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.274 22:40:41 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:50.274 22:40:41 -- setup/common.sh@32 -- # continue 00:02:50.274 22:40:41 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.274 22:40:41 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.274 22:40:41 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:50.274 22:40:41 -- setup/common.sh@32 -- # continue 00:02:50.274 22:40:41 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.274 22:40:41 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.274 22:40:41 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:50.274 22:40:41 -- setup/common.sh@32 -- # continue 00:02:50.274 22:40:41 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.274 22:40:41 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.274 22:40:41 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:50.274 22:40:41 -- setup/common.sh@32 -- # continue 00:02:50.275 22:40:41 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.275 22:40:41 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.275 22:40:41 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:50.275 22:40:41 -- setup/common.sh@32 -- # continue 00:02:50.275 22:40:41 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.275 22:40:41 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.275 22:40:41 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:50.275 22:40:41 -- setup/common.sh@32 -- # continue 00:02:50.275 22:40:41 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.275 22:40:41 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.275 22:40:41 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:50.275 22:40:41 -- setup/common.sh@32 -- # continue 00:02:50.275 22:40:41 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.275 22:40:41 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.275 22:40:41 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:50.275 22:40:41 -- setup/common.sh@32 -- # continue 00:02:50.275 22:40:41 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.275 22:40:41 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.275 22:40:41 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:50.275 22:40:41 -- setup/common.sh@32 -- # continue 00:02:50.275 22:40:41 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.275 22:40:41 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.275 22:40:41 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:50.275 22:40:41 -- setup/common.sh@32 -- # continue 00:02:50.275 22:40:41 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.275 22:40:41 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.275 22:40:41 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:50.275 22:40:41 -- setup/common.sh@32 -- # continue 00:02:50.275 22:40:41 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.275 22:40:41 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.275 22:40:41 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:50.275 22:40:41 -- setup/common.sh@32 -- # continue 00:02:50.275 22:40:41 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.275 22:40:41 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.275 22:40:41 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:50.275 22:40:41 -- setup/common.sh@32 -- # continue 00:02:50.275 22:40:41 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.275 22:40:41 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.275 22:40:41 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:50.275 22:40:41 -- setup/common.sh@32 -- # continue 00:02:50.275 22:40:41 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.275 22:40:41 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.275 22:40:41 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:50.275 22:40:41 -- setup/common.sh@33 -- # echo 0 00:02:50.275 22:40:41 -- setup/common.sh@33 -- # return 0 00:02:50.275 22:40:41 -- setup/hugepages.sh@99 -- # surp=0 00:02:50.275 22:40:41 -- setup/hugepages.sh@100 -- # get_meminfo HugePages_Rsvd 00:02:50.275 22:40:41 -- setup/common.sh@17 -- # local get=HugePages_Rsvd 00:02:50.275 22:40:41 -- setup/common.sh@18 -- # local node= 00:02:50.275 22:40:41 -- setup/common.sh@19 -- # local var val 00:02:50.275 22:40:41 -- setup/common.sh@20 -- # local mem_f mem 00:02:50.275 22:40:41 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:02:50.275 22:40:41 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:02:50.275 22:40:41 -- setup/common.sh@25 -- # [[ -n '' ]] 00:02:50.275 22:40:41 -- setup/common.sh@28 -- # mapfile -t mem 00:02:50.275 22:40:41 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:02:50.275 22:40:41 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.275 22:40:41 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.275 22:40:41 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60541736 kB' 'MemFree: 43347976 kB' 'MemAvailable: 47339364 kB' 'Buffers: 2696 kB' 'Cached: 12518604 kB' 'SwapCached: 0 kB' 'Active: 9322524 kB' 'Inactive: 3655836 kB' 'Active(anon): 8758208 kB' 'Inactive(anon): 0 kB' 'Active(file): 564316 kB' 'Inactive(file): 3655836 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 460292 kB' 'Mapped: 201472 kB' 'Shmem: 8301148 kB' 'KReclaimable: 415672 kB' 'Slab: 807156 kB' 'SReclaimable: 415672 kB' 'SUnreclaim: 391484 kB' 'KernelStack: 12832 kB' 'PageTables: 8016 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37610896 kB' 'Committed_AS: 9884960 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 197132 kB' 'VmallocChunk: 0 kB' 'Percpu: 38592 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 2506332 kB' 'DirectMap2M: 24676352 kB' 'DirectMap1G: 41943040 kB' 00:02:50.275 22:40:41 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:50.275 22:40:41 -- setup/common.sh@32 -- # continue 00:02:50.275 22:40:41 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.275 22:40:41 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.275 22:40:41 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:50.275 22:40:41 -- setup/common.sh@32 -- # continue 00:02:50.275 22:40:41 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.275 22:40:41 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.275 22:40:41 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:50.275 22:40:41 -- setup/common.sh@32 -- # continue 00:02:50.275 22:40:41 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.275 22:40:41 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.275 22:40:41 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:50.275 22:40:41 -- setup/common.sh@32 -- # continue 00:02:50.275 22:40:41 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.275 22:40:41 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.275 22:40:41 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:50.275 22:40:41 -- setup/common.sh@32 -- # continue 00:02:50.275 22:40:41 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.275 22:40:41 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.275 22:40:41 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:50.275 22:40:41 -- setup/common.sh@32 -- # continue 00:02:50.275 22:40:41 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.275 22:40:41 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.275 22:40:41 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:50.275 22:40:41 -- setup/common.sh@32 -- # continue 00:02:50.275 22:40:41 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.275 22:40:41 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.275 22:40:41 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:50.275 22:40:41 -- setup/common.sh@32 -- # continue 00:02:50.275 22:40:41 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.275 22:40:41 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.275 22:40:41 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:50.275 22:40:41 -- setup/common.sh@32 -- # continue 00:02:50.275 22:40:41 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.275 22:40:41 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.275 22:40:41 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:50.275 22:40:41 -- setup/common.sh@32 -- # continue 00:02:50.275 22:40:41 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.275 22:40:41 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.275 22:40:41 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:50.275 22:40:41 -- setup/common.sh@32 -- # continue 00:02:50.275 22:40:41 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.275 22:40:41 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.275 22:40:41 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:50.275 22:40:41 -- setup/common.sh@32 -- # continue 00:02:50.275 22:40:41 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.275 22:40:41 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.275 22:40:41 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:50.275 22:40:41 -- setup/common.sh@32 -- # continue 00:02:50.275 22:40:41 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.275 22:40:41 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.275 22:40:41 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:50.275 22:40:41 -- setup/common.sh@32 -- # continue 00:02:50.275 22:40:41 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.275 22:40:41 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.275 22:40:41 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:50.275 22:40:41 -- setup/common.sh@32 -- # continue 00:02:50.275 22:40:41 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.275 22:40:41 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.275 22:40:41 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:50.275 22:40:41 -- setup/common.sh@32 -- # continue 00:02:50.275 22:40:41 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.275 22:40:41 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.275 22:40:41 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:50.275 22:40:41 -- setup/common.sh@32 -- # continue 00:02:50.275 22:40:41 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.275 22:40:41 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.275 22:40:41 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:50.275 22:40:41 -- setup/common.sh@32 -- # continue 00:02:50.275 22:40:41 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.275 22:40:41 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.275 22:40:41 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:50.275 22:40:41 -- setup/common.sh@32 -- # continue 00:02:50.275 22:40:41 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.275 22:40:41 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.275 22:40:41 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:50.275 22:40:41 -- setup/common.sh@32 -- # continue 00:02:50.275 22:40:41 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.275 22:40:41 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.275 22:40:41 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:50.275 22:40:41 -- setup/common.sh@32 -- # continue 00:02:50.275 22:40:41 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.275 22:40:41 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.275 22:40:41 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:50.275 22:40:41 -- setup/common.sh@32 -- # continue 00:02:50.275 22:40:41 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.275 22:40:41 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.276 22:40:41 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:50.276 22:40:41 -- setup/common.sh@32 -- # continue 00:02:50.276 22:40:41 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.276 22:40:41 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.276 22:40:41 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:50.276 22:40:41 -- setup/common.sh@32 -- # continue 00:02:50.276 22:40:41 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.276 22:40:41 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.276 22:40:41 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:50.276 22:40:41 -- setup/common.sh@32 -- # continue 00:02:50.276 22:40:41 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.276 22:40:41 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.276 22:40:41 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:50.276 22:40:41 -- setup/common.sh@32 -- # continue 00:02:50.276 22:40:41 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.276 22:40:41 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.276 22:40:41 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:50.276 22:40:41 -- setup/common.sh@32 -- # continue 00:02:50.276 22:40:41 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.276 22:40:41 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.276 22:40:41 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:50.276 22:40:41 -- setup/common.sh@32 -- # continue 00:02:50.276 22:40:41 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.276 22:40:41 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.276 22:40:41 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:50.276 22:40:41 -- setup/common.sh@32 -- # continue 00:02:50.276 22:40:41 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.276 22:40:41 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.276 22:40:41 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:50.276 22:40:41 -- setup/common.sh@32 -- # continue 00:02:50.276 22:40:41 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.276 22:40:41 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.276 22:40:41 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:50.276 22:40:41 -- setup/common.sh@32 -- # continue 00:02:50.276 22:40:41 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.276 22:40:41 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.276 22:40:41 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:50.276 22:40:41 -- setup/common.sh@32 -- # continue 00:02:50.276 22:40:41 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.276 22:40:41 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.276 22:40:41 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:50.276 22:40:41 -- setup/common.sh@32 -- # continue 00:02:50.276 22:40:41 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.276 22:40:41 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.276 22:40:41 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:50.276 22:40:41 -- setup/common.sh@32 -- # continue 00:02:50.276 22:40:41 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.276 22:40:41 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.276 22:40:41 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:50.276 22:40:41 -- setup/common.sh@32 -- # continue 00:02:50.276 22:40:41 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.276 22:40:41 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.276 22:40:41 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:50.276 22:40:41 -- setup/common.sh@32 -- # continue 00:02:50.276 22:40:41 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.276 22:40:41 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.276 22:40:41 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:50.276 22:40:41 -- setup/common.sh@32 -- # continue 00:02:50.276 22:40:41 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.276 22:40:41 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.276 22:40:41 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:50.276 22:40:41 -- setup/common.sh@32 -- # continue 00:02:50.276 22:40:41 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.276 22:40:41 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.276 22:40:41 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:50.276 22:40:41 -- setup/common.sh@32 -- # continue 00:02:50.276 22:40:41 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.276 22:40:41 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.276 22:40:41 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:50.276 22:40:41 -- setup/common.sh@32 -- # continue 00:02:50.276 22:40:41 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.276 22:40:41 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.276 22:40:41 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:50.276 22:40:41 -- setup/common.sh@32 -- # continue 00:02:50.276 22:40:41 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.276 22:40:41 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.276 22:40:41 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:50.276 22:40:41 -- setup/common.sh@32 -- # continue 00:02:50.276 22:40:41 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.276 22:40:41 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.276 22:40:41 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:50.276 22:40:41 -- setup/common.sh@32 -- # continue 00:02:50.276 22:40:41 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.276 22:40:41 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.276 22:40:41 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:50.276 22:40:41 -- setup/common.sh@32 -- # continue 00:02:50.276 22:40:41 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.276 22:40:41 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.276 22:40:41 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:50.276 22:40:41 -- setup/common.sh@32 -- # continue 00:02:50.276 22:40:41 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.276 22:40:41 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.276 22:40:41 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:50.276 22:40:41 -- setup/common.sh@32 -- # continue 00:02:50.276 22:40:41 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.276 22:40:41 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.276 22:40:41 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:50.276 22:40:41 -- setup/common.sh@32 -- # continue 00:02:50.276 22:40:41 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.276 22:40:41 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.276 22:40:41 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:50.276 22:40:41 -- setup/common.sh@32 -- # continue 00:02:50.276 22:40:41 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.276 22:40:41 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.276 22:40:41 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:50.276 22:40:41 -- setup/common.sh@32 -- # continue 00:02:50.276 22:40:41 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.276 22:40:41 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.276 22:40:41 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:50.276 22:40:41 -- setup/common.sh@32 -- # continue 00:02:50.276 22:40:41 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.276 22:40:41 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.276 22:40:41 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:50.276 22:40:41 -- setup/common.sh@33 -- # echo 0 00:02:50.276 22:40:41 -- setup/common.sh@33 -- # return 0 00:02:50.276 22:40:41 -- setup/hugepages.sh@100 -- # resv=0 00:02:50.276 22:40:41 -- setup/hugepages.sh@102 -- # echo nr_hugepages=1024 00:02:50.276 nr_hugepages=1024 00:02:50.276 22:40:41 -- setup/hugepages.sh@103 -- # echo resv_hugepages=0 00:02:50.276 resv_hugepages=0 00:02:50.276 22:40:41 -- setup/hugepages.sh@104 -- # echo surplus_hugepages=0 00:02:50.276 surplus_hugepages=0 00:02:50.276 22:40:41 -- setup/hugepages.sh@105 -- # echo anon_hugepages=0 00:02:50.276 anon_hugepages=0 00:02:50.276 22:40:41 -- setup/hugepages.sh@107 -- # (( 1024 == nr_hugepages + surp + resv )) 00:02:50.276 22:40:41 -- setup/hugepages.sh@109 -- # (( 1024 == nr_hugepages )) 00:02:50.276 22:40:41 -- setup/hugepages.sh@110 -- # get_meminfo HugePages_Total 00:02:50.276 22:40:41 -- setup/common.sh@17 -- # local get=HugePages_Total 00:02:50.276 22:40:41 -- setup/common.sh@18 -- # local node= 00:02:50.276 22:40:41 -- setup/common.sh@19 -- # local var val 00:02:50.276 22:40:41 -- setup/common.sh@20 -- # local mem_f mem 00:02:50.276 22:40:41 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:02:50.276 22:40:41 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:02:50.276 22:40:41 -- setup/common.sh@25 -- # [[ -n '' ]] 00:02:50.276 22:40:41 -- setup/common.sh@28 -- # mapfile -t mem 00:02:50.276 22:40:41 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:02:50.276 22:40:41 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.276 22:40:41 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.276 22:40:41 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60541736 kB' 'MemFree: 43347976 kB' 'MemAvailable: 47339364 kB' 'Buffers: 2696 kB' 'Cached: 12518616 kB' 'SwapCached: 0 kB' 'Active: 9322540 kB' 'Inactive: 3655836 kB' 'Active(anon): 8758224 kB' 'Inactive(anon): 0 kB' 'Active(file): 564316 kB' 'Inactive(file): 3655836 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 460288 kB' 'Mapped: 201472 kB' 'Shmem: 8301160 kB' 'KReclaimable: 415672 kB' 'Slab: 807156 kB' 'SReclaimable: 415672 kB' 'SUnreclaim: 391484 kB' 'KernelStack: 12832 kB' 'PageTables: 8016 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37610896 kB' 'Committed_AS: 9884976 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 197132 kB' 'VmallocChunk: 0 kB' 'Percpu: 38592 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 2506332 kB' 'DirectMap2M: 24676352 kB' 'DirectMap1G: 41943040 kB' 00:02:50.276 22:40:41 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:50.276 22:40:41 -- setup/common.sh@32 -- # continue 00:02:50.276 22:40:41 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.276 22:40:41 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.276 22:40:41 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:50.276 22:40:41 -- setup/common.sh@32 -- # continue 00:02:50.276 22:40:41 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.276 22:40:41 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.276 22:40:41 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:50.276 22:40:41 -- setup/common.sh@32 -- # continue 00:02:50.276 22:40:41 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.277 22:40:41 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.277 22:40:41 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:50.277 22:40:41 -- setup/common.sh@32 -- # continue 00:02:50.277 22:40:41 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.277 22:40:41 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.277 22:40:41 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:50.277 22:40:41 -- setup/common.sh@32 -- # continue 00:02:50.277 22:40:41 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.277 22:40:41 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.277 22:40:41 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:50.277 22:40:41 -- setup/common.sh@32 -- # continue 00:02:50.277 22:40:41 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.277 22:40:41 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.277 22:40:41 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:50.277 22:40:41 -- setup/common.sh@32 -- # continue 00:02:50.277 22:40:41 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.277 22:40:41 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.277 22:40:41 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:50.277 22:40:41 -- setup/common.sh@32 -- # continue 00:02:50.277 22:40:41 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.277 22:40:41 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.277 22:40:41 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:50.277 22:40:41 -- setup/common.sh@32 -- # continue 00:02:50.277 22:40:41 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.277 22:40:41 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.277 22:40:41 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:50.277 22:40:41 -- setup/common.sh@32 -- # continue 00:02:50.277 22:40:41 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.277 22:40:41 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.277 22:40:41 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:50.277 22:40:41 -- setup/common.sh@32 -- # continue 00:02:50.277 22:40:41 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.277 22:40:41 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.277 22:40:41 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:50.277 22:40:41 -- setup/common.sh@32 -- # continue 00:02:50.277 22:40:41 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.277 22:40:41 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.277 22:40:41 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:50.277 22:40:41 -- setup/common.sh@32 -- # continue 00:02:50.277 22:40:41 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.277 22:40:41 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.277 22:40:41 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:50.277 22:40:41 -- setup/common.sh@32 -- # continue 00:02:50.277 22:40:41 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.277 22:40:41 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.277 22:40:41 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:50.277 22:40:41 -- setup/common.sh@32 -- # continue 00:02:50.277 22:40:41 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.277 22:40:41 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.277 22:40:41 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:50.277 22:40:41 -- setup/common.sh@32 -- # continue 00:02:50.277 22:40:41 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.277 22:40:41 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.277 22:40:41 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:50.277 22:40:41 -- setup/common.sh@32 -- # continue 00:02:50.277 22:40:41 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.277 22:40:41 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.277 22:40:41 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:50.277 22:40:41 -- setup/common.sh@32 -- # continue 00:02:50.277 22:40:41 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.277 22:40:41 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.277 22:40:41 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:50.277 22:40:41 -- setup/common.sh@32 -- # continue 00:02:50.277 22:40:41 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.277 22:40:41 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.277 22:40:41 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:50.277 22:40:41 -- setup/common.sh@32 -- # continue 00:02:50.277 22:40:41 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.277 22:40:41 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.277 22:40:41 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:50.277 22:40:41 -- setup/common.sh@32 -- # continue 00:02:50.277 22:40:41 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.277 22:40:41 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.277 22:40:41 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:50.277 22:40:41 -- setup/common.sh@32 -- # continue 00:02:50.277 22:40:41 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.277 22:40:41 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.277 22:40:41 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:50.277 22:40:41 -- setup/common.sh@32 -- # continue 00:02:50.277 22:40:41 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.277 22:40:41 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.277 22:40:41 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:50.277 22:40:41 -- setup/common.sh@32 -- # continue 00:02:50.277 22:40:41 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.277 22:40:41 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.277 22:40:41 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:50.277 22:40:41 -- setup/common.sh@32 -- # continue 00:02:50.277 22:40:41 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.277 22:40:41 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.277 22:40:41 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:50.277 22:40:41 -- setup/common.sh@32 -- # continue 00:02:50.277 22:40:41 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.277 22:40:41 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.277 22:40:41 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:50.277 22:40:41 -- setup/common.sh@32 -- # continue 00:02:50.277 22:40:41 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.277 22:40:41 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.277 22:40:41 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:50.277 22:40:41 -- setup/common.sh@32 -- # continue 00:02:50.277 22:40:41 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.277 22:40:41 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.277 22:40:41 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:50.277 22:40:41 -- setup/common.sh@32 -- # continue 00:02:50.277 22:40:41 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.277 22:40:41 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.277 22:40:41 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:50.277 22:40:41 -- setup/common.sh@32 -- # continue 00:02:50.277 22:40:41 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.277 22:40:41 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.277 22:40:41 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:50.277 22:40:41 -- setup/common.sh@32 -- # continue 00:02:50.277 22:40:41 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.277 22:40:41 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.277 22:40:41 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:50.277 22:40:41 -- setup/common.sh@32 -- # continue 00:02:50.277 22:40:41 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.277 22:40:41 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.277 22:40:41 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:50.277 22:40:41 -- setup/common.sh@32 -- # continue 00:02:50.277 22:40:41 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.277 22:40:41 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.277 22:40:41 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:50.277 22:40:41 -- setup/common.sh@32 -- # continue 00:02:50.277 22:40:41 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.277 22:40:41 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.277 22:40:41 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:50.277 22:40:41 -- setup/common.sh@32 -- # continue 00:02:50.277 22:40:41 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.277 22:40:41 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.277 22:40:41 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:50.277 22:40:41 -- setup/common.sh@32 -- # continue 00:02:50.277 22:40:41 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.277 22:40:41 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.277 22:40:41 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:50.277 22:40:41 -- setup/common.sh@32 -- # continue 00:02:50.277 22:40:41 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.277 22:40:41 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.278 22:40:41 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:50.278 22:40:41 -- setup/common.sh@32 -- # continue 00:02:50.278 22:40:41 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.278 22:40:41 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.278 22:40:41 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:50.278 22:40:41 -- setup/common.sh@32 -- # continue 00:02:50.278 22:40:41 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.278 22:40:41 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.278 22:40:41 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:50.278 22:40:41 -- setup/common.sh@32 -- # continue 00:02:50.278 22:40:41 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.278 22:40:41 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.278 22:40:41 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:50.278 22:40:41 -- setup/common.sh@32 -- # continue 00:02:50.278 22:40:41 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.278 22:40:41 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.278 22:40:41 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:50.278 22:40:41 -- setup/common.sh@32 -- # continue 00:02:50.278 22:40:41 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.278 22:40:41 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.278 22:40:41 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:50.278 22:40:41 -- setup/common.sh@32 -- # continue 00:02:50.278 22:40:41 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.278 22:40:41 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.278 22:40:41 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:50.278 22:40:41 -- setup/common.sh@32 -- # continue 00:02:50.278 22:40:41 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.278 22:40:41 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.278 22:40:41 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:50.278 22:40:41 -- setup/common.sh@32 -- # continue 00:02:50.278 22:40:41 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.278 22:40:41 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.278 22:40:41 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:50.278 22:40:41 -- setup/common.sh@32 -- # continue 00:02:50.278 22:40:41 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.278 22:40:41 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.278 22:40:41 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:50.278 22:40:41 -- setup/common.sh@32 -- # continue 00:02:50.278 22:40:41 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.278 22:40:41 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.278 22:40:41 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:50.278 22:40:41 -- setup/common.sh@32 -- # continue 00:02:50.278 22:40:41 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.278 22:40:41 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.278 22:40:41 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:50.278 22:40:41 -- setup/common.sh@33 -- # echo 1024 00:02:50.278 22:40:41 -- setup/common.sh@33 -- # return 0 00:02:50.278 22:40:41 -- setup/hugepages.sh@110 -- # (( 1024 == nr_hugepages + surp + resv )) 00:02:50.278 22:40:41 -- setup/hugepages.sh@112 -- # get_nodes 00:02:50.278 22:40:41 -- setup/hugepages.sh@27 -- # local node 00:02:50.278 22:40:41 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:02:50.278 22:40:41 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=1024 00:02:50.278 22:40:41 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:02:50.278 22:40:41 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=0 00:02:50.278 22:40:41 -- setup/hugepages.sh@32 -- # no_nodes=2 00:02:50.278 22:40:41 -- setup/hugepages.sh@33 -- # (( no_nodes > 0 )) 00:02:50.278 22:40:41 -- setup/hugepages.sh@115 -- # for node in "${!nodes_test[@]}" 00:02:50.278 22:40:41 -- setup/hugepages.sh@116 -- # (( nodes_test[node] += resv )) 00:02:50.278 22:40:41 -- setup/hugepages.sh@117 -- # get_meminfo HugePages_Surp 0 00:02:50.278 22:40:41 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:02:50.278 22:40:41 -- setup/common.sh@18 -- # local node=0 00:02:50.278 22:40:41 -- setup/common.sh@19 -- # local var val 00:02:50.278 22:40:41 -- setup/common.sh@20 -- # local mem_f mem 00:02:50.278 22:40:41 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:02:50.278 22:40:41 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node0/meminfo ]] 00:02:50.278 22:40:41 -- setup/common.sh@24 -- # mem_f=/sys/devices/system/node/node0/meminfo 00:02:50.278 22:40:41 -- setup/common.sh@28 -- # mapfile -t mem 00:02:50.278 22:40:41 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:02:50.278 22:40:41 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.278 22:40:41 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.278 22:40:41 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 32829884 kB' 'MemFree: 19104040 kB' 'MemUsed: 13725844 kB' 'SwapCached: 0 kB' 'Active: 6998572 kB' 'Inactive: 3490860 kB' 'Active(anon): 6617360 kB' 'Inactive(anon): 0 kB' 'Active(file): 381212 kB' 'Inactive(file): 3490860 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'FilePages: 10244416 kB' 'Mapped: 156432 kB' 'AnonPages: 248108 kB' 'Shmem: 6372344 kB' 'KernelStack: 6664 kB' 'PageTables: 4532 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'KReclaimable: 272596 kB' 'Slab: 485072 kB' 'SReclaimable: 272596 kB' 'SUnreclaim: 212476 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Surp: 0' 00:02:50.278 22:40:41 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:50.278 22:40:41 -- setup/common.sh@32 -- # continue 00:02:50.278 22:40:41 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.278 22:40:41 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.278 22:40:41 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:50.278 22:40:41 -- setup/common.sh@32 -- # continue 00:02:50.278 22:40:41 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.278 22:40:41 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.278 22:40:41 -- setup/common.sh@32 -- # [[ MemUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:50.278 22:40:41 -- setup/common.sh@32 -- # continue 00:02:50.278 22:40:41 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.278 22:40:41 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.278 22:40:41 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:50.278 22:40:41 -- setup/common.sh@32 -- # continue 00:02:50.278 22:40:41 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.278 22:40:41 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.278 22:40:41 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:50.278 22:40:41 -- setup/common.sh@32 -- # continue 00:02:50.278 22:40:41 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.278 22:40:41 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.278 22:40:41 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:50.278 22:40:41 -- setup/common.sh@32 -- # continue 00:02:50.278 22:40:41 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.278 22:40:41 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.278 22:40:41 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:50.278 22:40:41 -- setup/common.sh@32 -- # continue 00:02:50.278 22:40:41 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.278 22:40:41 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.278 22:40:41 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:50.278 22:40:41 -- setup/common.sh@32 -- # continue 00:02:50.278 22:40:41 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.278 22:40:41 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.278 22:40:41 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:50.278 22:40:41 -- setup/common.sh@32 -- # continue 00:02:50.278 22:40:41 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.278 22:40:41 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.278 22:40:41 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:50.278 22:40:41 -- setup/common.sh@32 -- # continue 00:02:50.278 22:40:41 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.278 22:40:41 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.278 22:40:41 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:50.278 22:40:41 -- setup/common.sh@32 -- # continue 00:02:50.278 22:40:41 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.278 22:40:41 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.278 22:40:41 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:50.278 22:40:41 -- setup/common.sh@32 -- # continue 00:02:50.278 22:40:41 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.278 22:40:41 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.278 22:40:41 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:50.278 22:40:41 -- setup/common.sh@32 -- # continue 00:02:50.278 22:40:41 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.278 22:40:41 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.278 22:40:41 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:50.278 22:40:41 -- setup/common.sh@32 -- # continue 00:02:50.278 22:40:41 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.278 22:40:41 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.278 22:40:41 -- setup/common.sh@32 -- # [[ FilePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:50.278 22:40:41 -- setup/common.sh@32 -- # continue 00:02:50.278 22:40:41 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.278 22:40:41 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.278 22:40:41 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:50.278 22:40:41 -- setup/common.sh@32 -- # continue 00:02:50.278 22:40:41 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.278 22:40:41 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.278 22:40:41 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:50.278 22:40:41 -- setup/common.sh@32 -- # continue 00:02:50.278 22:40:41 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.278 22:40:41 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.278 22:40:41 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:50.278 22:40:41 -- setup/common.sh@32 -- # continue 00:02:50.278 22:40:41 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.278 22:40:41 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.278 22:40:41 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:50.278 22:40:41 -- setup/common.sh@32 -- # continue 00:02:50.278 22:40:41 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.278 22:40:41 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.278 22:40:41 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:50.278 22:40:41 -- setup/common.sh@32 -- # continue 00:02:50.278 22:40:41 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.278 22:40:41 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.278 22:40:41 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:50.278 22:40:41 -- setup/common.sh@32 -- # continue 00:02:50.279 22:40:41 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.279 22:40:41 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.279 22:40:41 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:50.279 22:40:41 -- setup/common.sh@32 -- # continue 00:02:50.279 22:40:41 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.279 22:40:41 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.279 22:40:41 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:50.279 22:40:41 -- setup/common.sh@32 -- # continue 00:02:50.279 22:40:41 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.279 22:40:41 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.279 22:40:41 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:50.279 22:40:41 -- setup/common.sh@32 -- # continue 00:02:50.279 22:40:41 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.279 22:40:41 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.279 22:40:41 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:50.279 22:40:41 -- setup/common.sh@32 -- # continue 00:02:50.279 22:40:41 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.279 22:40:41 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.279 22:40:41 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:50.279 22:40:41 -- setup/common.sh@32 -- # continue 00:02:50.279 22:40:41 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.279 22:40:41 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.279 22:40:41 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:50.279 22:40:41 -- setup/common.sh@32 -- # continue 00:02:50.279 22:40:41 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.279 22:40:41 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.279 22:40:41 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:50.279 22:40:41 -- setup/common.sh@32 -- # continue 00:02:50.279 22:40:41 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.279 22:40:41 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.279 22:40:41 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:50.279 22:40:41 -- setup/common.sh@32 -- # continue 00:02:50.279 22:40:41 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.279 22:40:41 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.279 22:40:41 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:50.279 22:40:41 -- setup/common.sh@32 -- # continue 00:02:50.279 22:40:41 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.279 22:40:41 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.279 22:40:41 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:50.279 22:40:41 -- setup/common.sh@32 -- # continue 00:02:50.279 22:40:41 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.279 22:40:41 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.279 22:40:41 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:50.279 22:40:41 -- setup/common.sh@32 -- # continue 00:02:50.279 22:40:41 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.279 22:40:41 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.279 22:40:41 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:50.279 22:40:41 -- setup/common.sh@32 -- # continue 00:02:50.279 22:40:41 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.279 22:40:41 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.279 22:40:41 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:50.279 22:40:41 -- setup/common.sh@32 -- # continue 00:02:50.279 22:40:41 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.279 22:40:41 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.279 22:40:41 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:50.279 22:40:41 -- setup/common.sh@32 -- # continue 00:02:50.279 22:40:41 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.279 22:40:41 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.279 22:40:41 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:50.279 22:40:41 -- setup/common.sh@32 -- # continue 00:02:50.279 22:40:41 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.279 22:40:41 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.279 22:40:41 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:50.279 22:40:41 -- setup/common.sh@33 -- # echo 0 00:02:50.279 22:40:41 -- setup/common.sh@33 -- # return 0 00:02:50.279 22:40:41 -- setup/hugepages.sh@117 -- # (( nodes_test[node] += 0 )) 00:02:50.279 22:40:41 -- setup/hugepages.sh@126 -- # for node in "${!nodes_test[@]}" 00:02:50.279 22:40:41 -- setup/hugepages.sh@127 -- # sorted_t[nodes_test[node]]=1 00:02:50.279 22:40:41 -- setup/hugepages.sh@127 -- # sorted_s[nodes_sys[node]]=1 00:02:50.279 22:40:41 -- setup/hugepages.sh@128 -- # echo 'node0=1024 expecting 1024' 00:02:50.279 node0=1024 expecting 1024 00:02:50.279 22:40:41 -- setup/hugepages.sh@130 -- # [[ 1024 == \1\0\2\4 ]] 00:02:50.279 22:40:41 -- setup/hugepages.sh@202 -- # CLEAR_HUGE=no 00:02:50.279 22:40:41 -- setup/hugepages.sh@202 -- # NRHUGE=512 00:02:50.279 22:40:41 -- setup/hugepages.sh@202 -- # setup output 00:02:50.279 22:40:41 -- setup/common.sh@9 -- # [[ output == output ]] 00:02:50.279 22:40:41 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh 00:02:51.677 0000:00:04.7 (8086 0e27): Already using the vfio-pci driver 00:02:51.677 0000:88:00.0 (8086 0a54): Already using the vfio-pci driver 00:02:51.678 0000:00:04.6 (8086 0e26): Already using the vfio-pci driver 00:02:51.678 0000:00:04.5 (8086 0e25): Already using the vfio-pci driver 00:02:51.678 0000:00:04.4 (8086 0e24): Already using the vfio-pci driver 00:02:51.678 0000:00:04.3 (8086 0e23): Already using the vfio-pci driver 00:02:51.678 0000:00:04.2 (8086 0e22): Already using the vfio-pci driver 00:02:51.678 0000:00:04.1 (8086 0e21): Already using the vfio-pci driver 00:02:51.678 0000:00:04.0 (8086 0e20): Already using the vfio-pci driver 00:02:51.678 0000:80:04.7 (8086 0e27): Already using the vfio-pci driver 00:02:51.678 0000:80:04.6 (8086 0e26): Already using the vfio-pci driver 00:02:51.678 0000:80:04.5 (8086 0e25): Already using the vfio-pci driver 00:02:51.678 0000:80:04.4 (8086 0e24): Already using the vfio-pci driver 00:02:51.678 0000:80:04.3 (8086 0e23): Already using the vfio-pci driver 00:02:51.678 0000:80:04.2 (8086 0e22): Already using the vfio-pci driver 00:02:51.678 0000:80:04.1 (8086 0e21): Already using the vfio-pci driver 00:02:51.678 0000:80:04.0 (8086 0e20): Already using the vfio-pci driver 00:02:51.678 INFO: Requested 512 hugepages but 1024 already allocated on node0 00:02:51.678 22:40:42 -- setup/hugepages.sh@204 -- # verify_nr_hugepages 00:02:51.678 22:40:42 -- setup/hugepages.sh@89 -- # local node 00:02:51.678 22:40:42 -- setup/hugepages.sh@90 -- # local sorted_t 00:02:51.678 22:40:42 -- setup/hugepages.sh@91 -- # local sorted_s 00:02:51.678 22:40:42 -- setup/hugepages.sh@92 -- # local surp 00:02:51.678 22:40:42 -- setup/hugepages.sh@93 -- # local resv 00:02:51.678 22:40:42 -- setup/hugepages.sh@94 -- # local anon 00:02:51.678 22:40:42 -- setup/hugepages.sh@96 -- # [[ always [madvise] never != *\[\n\e\v\e\r\]* ]] 00:02:51.678 22:40:42 -- setup/hugepages.sh@97 -- # get_meminfo AnonHugePages 00:02:51.678 22:40:42 -- setup/common.sh@17 -- # local get=AnonHugePages 00:02:51.678 22:40:42 -- setup/common.sh@18 -- # local node= 00:02:51.678 22:40:42 -- setup/common.sh@19 -- # local var val 00:02:51.678 22:40:42 -- setup/common.sh@20 -- # local mem_f mem 00:02:51.678 22:40:42 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:02:51.678 22:40:42 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:02:51.678 22:40:42 -- setup/common.sh@25 -- # [[ -n '' ]] 00:02:51.678 22:40:42 -- setup/common.sh@28 -- # mapfile -t mem 00:02:51.678 22:40:42 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:02:51.678 22:40:42 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.678 22:40:42 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.678 22:40:42 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60541736 kB' 'MemFree: 43335356 kB' 'MemAvailable: 47326744 kB' 'Buffers: 2696 kB' 'Cached: 12518668 kB' 'SwapCached: 0 kB' 'Active: 9325916 kB' 'Inactive: 3655836 kB' 'Active(anon): 8761600 kB' 'Inactive(anon): 0 kB' 'Active(file): 564316 kB' 'Inactive(file): 3655836 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 463612 kB' 'Mapped: 202308 kB' 'Shmem: 8301212 kB' 'KReclaimable: 415672 kB' 'Slab: 807064 kB' 'SReclaimable: 415672 kB' 'SUnreclaim: 391392 kB' 'KernelStack: 12848 kB' 'PageTables: 8100 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37610896 kB' 'Committed_AS: 9888408 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 197148 kB' 'VmallocChunk: 0 kB' 'Percpu: 38592 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 2506332 kB' 'DirectMap2M: 24676352 kB' 'DirectMap1G: 41943040 kB' 00:02:51.678 22:40:42 -- setup/common.sh@32 -- # [[ MemTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:51.678 22:40:42 -- setup/common.sh@32 -- # continue 00:02:51.678 22:40:42 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.678 22:40:42 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.678 22:40:42 -- setup/common.sh@32 -- # [[ MemFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:51.678 22:40:42 -- setup/common.sh@32 -- # continue 00:02:51.678 22:40:42 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.678 22:40:42 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.678 22:40:42 -- setup/common.sh@32 -- # [[ MemAvailable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:51.678 22:40:42 -- setup/common.sh@32 -- # continue 00:02:51.678 22:40:42 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.678 22:40:42 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.678 22:40:42 -- setup/common.sh@32 -- # [[ Buffers == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:51.678 22:40:42 -- setup/common.sh@32 -- # continue 00:02:51.678 22:40:42 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.678 22:40:42 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.678 22:40:42 -- setup/common.sh@32 -- # [[ Cached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:51.678 22:40:42 -- setup/common.sh@32 -- # continue 00:02:51.678 22:40:42 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.678 22:40:42 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.678 22:40:42 -- setup/common.sh@32 -- # [[ SwapCached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:51.678 22:40:42 -- setup/common.sh@32 -- # continue 00:02:51.678 22:40:42 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.678 22:40:42 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.678 22:40:42 -- setup/common.sh@32 -- # [[ Active == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:51.678 22:40:42 -- setup/common.sh@32 -- # continue 00:02:51.678 22:40:42 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.678 22:40:42 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.678 22:40:42 -- setup/common.sh@32 -- # [[ Inactive == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:51.678 22:40:42 -- setup/common.sh@32 -- # continue 00:02:51.678 22:40:42 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.678 22:40:42 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.678 22:40:42 -- setup/common.sh@32 -- # [[ Active(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:51.678 22:40:42 -- setup/common.sh@32 -- # continue 00:02:51.678 22:40:42 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.678 22:40:42 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.678 22:40:42 -- setup/common.sh@32 -- # [[ Inactive(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:51.678 22:40:42 -- setup/common.sh@32 -- # continue 00:02:51.678 22:40:42 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.678 22:40:42 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.678 22:40:42 -- setup/common.sh@32 -- # [[ Active(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:51.678 22:40:42 -- setup/common.sh@32 -- # continue 00:02:51.678 22:40:42 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.678 22:40:42 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.678 22:40:42 -- setup/common.sh@32 -- # [[ Inactive(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:51.678 22:40:42 -- setup/common.sh@32 -- # continue 00:02:51.678 22:40:42 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.678 22:40:42 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.678 22:40:42 -- setup/common.sh@32 -- # [[ Unevictable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:51.678 22:40:42 -- setup/common.sh@32 -- # continue 00:02:51.678 22:40:42 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.678 22:40:42 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.678 22:40:42 -- setup/common.sh@32 -- # [[ Mlocked == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:51.678 22:40:42 -- setup/common.sh@32 -- # continue 00:02:51.678 22:40:42 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.678 22:40:42 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.678 22:40:42 -- setup/common.sh@32 -- # [[ SwapTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:51.678 22:40:42 -- setup/common.sh@32 -- # continue 00:02:51.678 22:40:42 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.678 22:40:42 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.678 22:40:42 -- setup/common.sh@32 -- # [[ SwapFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:51.678 22:40:42 -- setup/common.sh@32 -- # continue 00:02:51.678 22:40:42 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.678 22:40:42 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.678 22:40:42 -- setup/common.sh@32 -- # [[ Zswap == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:51.678 22:40:42 -- setup/common.sh@32 -- # continue 00:02:51.678 22:40:42 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.678 22:40:42 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.678 22:40:42 -- setup/common.sh@32 -- # [[ Zswapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:51.678 22:40:42 -- setup/common.sh@32 -- # continue 00:02:51.678 22:40:42 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.678 22:40:42 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.678 22:40:42 -- setup/common.sh@32 -- # [[ Dirty == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:51.678 22:40:42 -- setup/common.sh@32 -- # continue 00:02:51.678 22:40:42 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.678 22:40:42 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.678 22:40:42 -- setup/common.sh@32 -- # [[ Writeback == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:51.678 22:40:42 -- setup/common.sh@32 -- # continue 00:02:51.678 22:40:42 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.678 22:40:42 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.678 22:40:42 -- setup/common.sh@32 -- # [[ AnonPages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:51.678 22:40:42 -- setup/common.sh@32 -- # continue 00:02:51.678 22:40:42 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.678 22:40:42 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.678 22:40:42 -- setup/common.sh@32 -- # [[ Mapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:51.678 22:40:42 -- setup/common.sh@32 -- # continue 00:02:51.678 22:40:42 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.678 22:40:42 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.678 22:40:42 -- setup/common.sh@32 -- # [[ Shmem == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:51.678 22:40:42 -- setup/common.sh@32 -- # continue 00:02:51.678 22:40:42 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.678 22:40:42 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.678 22:40:42 -- setup/common.sh@32 -- # [[ KReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:51.678 22:40:42 -- setup/common.sh@32 -- # continue 00:02:51.678 22:40:42 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.678 22:40:42 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.678 22:40:42 -- setup/common.sh@32 -- # [[ Slab == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:51.678 22:40:42 -- setup/common.sh@32 -- # continue 00:02:51.678 22:40:42 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.678 22:40:42 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.678 22:40:42 -- setup/common.sh@32 -- # [[ SReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:51.678 22:40:42 -- setup/common.sh@32 -- # continue 00:02:51.678 22:40:42 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.678 22:40:42 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.678 22:40:42 -- setup/common.sh@32 -- # [[ SUnreclaim == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:51.678 22:40:42 -- setup/common.sh@32 -- # continue 00:02:51.678 22:40:42 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.678 22:40:42 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.678 22:40:42 -- setup/common.sh@32 -- # [[ KernelStack == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:51.678 22:40:42 -- setup/common.sh@32 -- # continue 00:02:51.678 22:40:42 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.679 22:40:42 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.679 22:40:42 -- setup/common.sh@32 -- # [[ PageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:51.679 22:40:42 -- setup/common.sh@32 -- # continue 00:02:51.679 22:40:42 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.679 22:40:42 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.679 22:40:42 -- setup/common.sh@32 -- # [[ SecPageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:51.679 22:40:42 -- setup/common.sh@32 -- # continue 00:02:51.679 22:40:42 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.679 22:40:42 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.679 22:40:42 -- setup/common.sh@32 -- # [[ NFS_Unstable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:51.679 22:40:42 -- setup/common.sh@32 -- # continue 00:02:51.679 22:40:42 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.679 22:40:42 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.679 22:40:42 -- setup/common.sh@32 -- # [[ Bounce == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:51.679 22:40:42 -- setup/common.sh@32 -- # continue 00:02:51.679 22:40:42 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.679 22:40:42 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.679 22:40:42 -- setup/common.sh@32 -- # [[ WritebackTmp == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:51.679 22:40:42 -- setup/common.sh@32 -- # continue 00:02:51.679 22:40:42 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.679 22:40:42 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.679 22:40:42 -- setup/common.sh@32 -- # [[ CommitLimit == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:51.679 22:40:42 -- setup/common.sh@32 -- # continue 00:02:51.679 22:40:42 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.679 22:40:42 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.679 22:40:42 -- setup/common.sh@32 -- # [[ Committed_AS == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:51.679 22:40:42 -- setup/common.sh@32 -- # continue 00:02:51.679 22:40:42 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.679 22:40:42 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.679 22:40:42 -- setup/common.sh@32 -- # [[ VmallocTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:51.679 22:40:42 -- setup/common.sh@32 -- # continue 00:02:51.679 22:40:42 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.679 22:40:42 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.679 22:40:42 -- setup/common.sh@32 -- # [[ VmallocUsed == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:51.679 22:40:42 -- setup/common.sh@32 -- # continue 00:02:51.679 22:40:42 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.679 22:40:42 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.679 22:40:42 -- setup/common.sh@32 -- # [[ VmallocChunk == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:51.679 22:40:42 -- setup/common.sh@32 -- # continue 00:02:51.679 22:40:42 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.679 22:40:42 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.679 22:40:42 -- setup/common.sh@32 -- # [[ Percpu == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:51.679 22:40:42 -- setup/common.sh@32 -- # continue 00:02:51.679 22:40:42 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.679 22:40:42 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.679 22:40:42 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:51.679 22:40:42 -- setup/common.sh@32 -- # continue 00:02:51.679 22:40:42 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.679 22:40:42 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.679 22:40:42 -- setup/common.sh@32 -- # [[ AnonHugePages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:51.679 22:40:42 -- setup/common.sh@33 -- # echo 0 00:02:51.679 22:40:42 -- setup/common.sh@33 -- # return 0 00:02:51.679 22:40:42 -- setup/hugepages.sh@97 -- # anon=0 00:02:51.679 22:40:42 -- setup/hugepages.sh@99 -- # get_meminfo HugePages_Surp 00:02:51.679 22:40:42 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:02:51.679 22:40:42 -- setup/common.sh@18 -- # local node= 00:02:51.679 22:40:42 -- setup/common.sh@19 -- # local var val 00:02:51.679 22:40:42 -- setup/common.sh@20 -- # local mem_f mem 00:02:51.679 22:40:42 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:02:51.679 22:40:42 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:02:51.679 22:40:42 -- setup/common.sh@25 -- # [[ -n '' ]] 00:02:51.679 22:40:42 -- setup/common.sh@28 -- # mapfile -t mem 00:02:51.679 22:40:42 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:02:51.679 22:40:42 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.679 22:40:42 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.679 22:40:42 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60541736 kB' 'MemFree: 43332140 kB' 'MemAvailable: 47323528 kB' 'Buffers: 2696 kB' 'Cached: 12518668 kB' 'SwapCached: 0 kB' 'Active: 9328844 kB' 'Inactive: 3655836 kB' 'Active(anon): 8764528 kB' 'Inactive(anon): 0 kB' 'Active(file): 564316 kB' 'Inactive(file): 3655836 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 466660 kB' 'Mapped: 202392 kB' 'Shmem: 8301212 kB' 'KReclaimable: 415672 kB' 'Slab: 807080 kB' 'SReclaimable: 415672 kB' 'SUnreclaim: 391408 kB' 'KernelStack: 12832 kB' 'PageTables: 8024 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37610896 kB' 'Committed_AS: 9891072 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 197120 kB' 'VmallocChunk: 0 kB' 'Percpu: 38592 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 2506332 kB' 'DirectMap2M: 24676352 kB' 'DirectMap1G: 41943040 kB' 00:02:51.679 22:40:42 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:51.679 22:40:42 -- setup/common.sh@32 -- # continue 00:02:51.679 22:40:42 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.679 22:40:42 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.679 22:40:42 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:51.679 22:40:42 -- setup/common.sh@32 -- # continue 00:02:51.679 22:40:42 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.679 22:40:42 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.679 22:40:42 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:51.679 22:40:42 -- setup/common.sh@32 -- # continue 00:02:51.679 22:40:42 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.679 22:40:42 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.679 22:40:42 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:51.679 22:40:42 -- setup/common.sh@32 -- # continue 00:02:51.679 22:40:42 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.679 22:40:42 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.679 22:40:42 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:51.679 22:40:42 -- setup/common.sh@32 -- # continue 00:02:51.679 22:40:42 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.679 22:40:42 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.679 22:40:42 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:51.679 22:40:42 -- setup/common.sh@32 -- # continue 00:02:51.679 22:40:42 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.679 22:40:42 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.679 22:40:42 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:51.679 22:40:42 -- setup/common.sh@32 -- # continue 00:02:51.679 22:40:42 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.679 22:40:42 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.679 22:40:42 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:51.679 22:40:42 -- setup/common.sh@32 -- # continue 00:02:51.679 22:40:42 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.679 22:40:42 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.679 22:40:42 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:51.679 22:40:42 -- setup/common.sh@32 -- # continue 00:02:51.679 22:40:42 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.679 22:40:42 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.679 22:40:42 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:51.679 22:40:42 -- setup/common.sh@32 -- # continue 00:02:51.679 22:40:42 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.679 22:40:42 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.679 22:40:42 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:51.679 22:40:42 -- setup/common.sh@32 -- # continue 00:02:51.679 22:40:42 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.679 22:40:42 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.679 22:40:42 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:51.679 22:40:42 -- setup/common.sh@32 -- # continue 00:02:51.679 22:40:42 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.679 22:40:42 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.679 22:40:42 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:51.679 22:40:42 -- setup/common.sh@32 -- # continue 00:02:51.679 22:40:42 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.679 22:40:42 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.679 22:40:42 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:51.679 22:40:42 -- setup/common.sh@32 -- # continue 00:02:51.679 22:40:42 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.679 22:40:42 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.679 22:40:42 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:51.679 22:40:42 -- setup/common.sh@32 -- # continue 00:02:51.679 22:40:42 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.679 22:40:42 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.679 22:40:42 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:51.679 22:40:42 -- setup/common.sh@32 -- # continue 00:02:51.679 22:40:42 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.679 22:40:42 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.679 22:40:42 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:51.679 22:40:42 -- setup/common.sh@32 -- # continue 00:02:51.679 22:40:42 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.679 22:40:42 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.679 22:40:42 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:51.679 22:40:42 -- setup/common.sh@32 -- # continue 00:02:51.679 22:40:42 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.679 22:40:42 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.679 22:40:42 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:51.679 22:40:42 -- setup/common.sh@32 -- # continue 00:02:51.679 22:40:42 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.679 22:40:42 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.679 22:40:42 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:51.679 22:40:42 -- setup/common.sh@32 -- # continue 00:02:51.679 22:40:42 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.679 22:40:42 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.680 22:40:42 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:51.680 22:40:42 -- setup/common.sh@32 -- # continue 00:02:51.680 22:40:42 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.680 22:40:42 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.680 22:40:42 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:51.680 22:40:42 -- setup/common.sh@32 -- # continue 00:02:51.680 22:40:42 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.680 22:40:42 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.680 22:40:42 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:51.680 22:40:42 -- setup/common.sh@32 -- # continue 00:02:51.680 22:40:42 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.680 22:40:42 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.680 22:40:42 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:51.680 22:40:42 -- setup/common.sh@32 -- # continue 00:02:51.680 22:40:42 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.680 22:40:42 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.680 22:40:42 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:51.680 22:40:42 -- setup/common.sh@32 -- # continue 00:02:51.680 22:40:42 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.680 22:40:42 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.680 22:40:42 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:51.680 22:40:42 -- setup/common.sh@32 -- # continue 00:02:51.680 22:40:42 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.680 22:40:42 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.680 22:40:42 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:51.680 22:40:42 -- setup/common.sh@32 -- # continue 00:02:51.680 22:40:42 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.680 22:40:42 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.680 22:40:42 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:51.680 22:40:42 -- setup/common.sh@32 -- # continue 00:02:51.680 22:40:42 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.680 22:40:42 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.680 22:40:42 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:51.680 22:40:42 -- setup/common.sh@32 -- # continue 00:02:51.680 22:40:42 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.680 22:40:42 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.680 22:40:42 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:51.680 22:40:42 -- setup/common.sh@32 -- # continue 00:02:51.680 22:40:42 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.680 22:40:42 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.680 22:40:42 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:51.680 22:40:42 -- setup/common.sh@32 -- # continue 00:02:51.680 22:40:42 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.680 22:40:42 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.680 22:40:42 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:51.680 22:40:42 -- setup/common.sh@32 -- # continue 00:02:51.680 22:40:42 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.680 22:40:42 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.680 22:40:42 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:51.680 22:40:42 -- setup/common.sh@32 -- # continue 00:02:51.680 22:40:42 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.680 22:40:42 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.680 22:40:42 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:51.680 22:40:42 -- setup/common.sh@32 -- # continue 00:02:51.680 22:40:42 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.680 22:40:42 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.680 22:40:42 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:51.680 22:40:42 -- setup/common.sh@32 -- # continue 00:02:51.680 22:40:42 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.680 22:40:42 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.680 22:40:42 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:51.680 22:40:42 -- setup/common.sh@32 -- # continue 00:02:51.680 22:40:42 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.680 22:40:42 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.680 22:40:42 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:51.680 22:40:42 -- setup/common.sh@32 -- # continue 00:02:51.680 22:40:42 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.680 22:40:42 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.680 22:40:42 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:51.680 22:40:42 -- setup/common.sh@32 -- # continue 00:02:51.680 22:40:42 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.680 22:40:42 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.680 22:40:42 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:51.680 22:40:42 -- setup/common.sh@32 -- # continue 00:02:51.680 22:40:42 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.680 22:40:42 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.680 22:40:42 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:51.680 22:40:42 -- setup/common.sh@32 -- # continue 00:02:51.680 22:40:42 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.680 22:40:42 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.680 22:40:42 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:51.680 22:40:42 -- setup/common.sh@32 -- # continue 00:02:51.680 22:40:42 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.680 22:40:42 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.680 22:40:42 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:51.680 22:40:42 -- setup/common.sh@32 -- # continue 00:02:51.680 22:40:42 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.680 22:40:42 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.680 22:40:42 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:51.680 22:40:42 -- setup/common.sh@32 -- # continue 00:02:51.680 22:40:42 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.680 22:40:42 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.680 22:40:42 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:51.680 22:40:42 -- setup/common.sh@32 -- # continue 00:02:51.680 22:40:42 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.680 22:40:42 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.680 22:40:42 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:51.680 22:40:42 -- setup/common.sh@32 -- # continue 00:02:51.680 22:40:42 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.680 22:40:42 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.680 22:40:42 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:51.680 22:40:42 -- setup/common.sh@32 -- # continue 00:02:51.680 22:40:42 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.680 22:40:42 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.680 22:40:42 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:51.680 22:40:42 -- setup/common.sh@32 -- # continue 00:02:51.680 22:40:42 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.680 22:40:42 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.680 22:40:42 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:51.680 22:40:42 -- setup/common.sh@32 -- # continue 00:02:51.680 22:40:42 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.680 22:40:42 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.680 22:40:42 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:51.680 22:40:42 -- setup/common.sh@32 -- # continue 00:02:51.680 22:40:42 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.680 22:40:42 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.680 22:40:42 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:51.680 22:40:42 -- setup/common.sh@32 -- # continue 00:02:51.680 22:40:42 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.680 22:40:42 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.680 22:40:42 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:51.680 22:40:42 -- setup/common.sh@32 -- # continue 00:02:51.680 22:40:42 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.680 22:40:42 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.680 22:40:42 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:51.680 22:40:42 -- setup/common.sh@33 -- # echo 0 00:02:51.680 22:40:42 -- setup/common.sh@33 -- # return 0 00:02:51.680 22:40:42 -- setup/hugepages.sh@99 -- # surp=0 00:02:51.680 22:40:42 -- setup/hugepages.sh@100 -- # get_meminfo HugePages_Rsvd 00:02:51.680 22:40:42 -- setup/common.sh@17 -- # local get=HugePages_Rsvd 00:02:51.680 22:40:42 -- setup/common.sh@18 -- # local node= 00:02:51.680 22:40:42 -- setup/common.sh@19 -- # local var val 00:02:51.680 22:40:42 -- setup/common.sh@20 -- # local mem_f mem 00:02:51.680 22:40:42 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:02:51.680 22:40:42 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:02:51.680 22:40:42 -- setup/common.sh@25 -- # [[ -n '' ]] 00:02:51.680 22:40:42 -- setup/common.sh@28 -- # mapfile -t mem 00:02:51.680 22:40:42 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:02:51.680 22:40:42 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.680 22:40:42 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.680 22:40:42 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60541736 kB' 'MemFree: 43333920 kB' 'MemAvailable: 47325308 kB' 'Buffers: 2696 kB' 'Cached: 12518684 kB' 'SwapCached: 0 kB' 'Active: 9328288 kB' 'Inactive: 3655836 kB' 'Active(anon): 8763972 kB' 'Inactive(anon): 0 kB' 'Active(file): 564316 kB' 'Inactive(file): 3655836 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 465960 kB' 'Mapped: 202396 kB' 'Shmem: 8301228 kB' 'KReclaimable: 415672 kB' 'Slab: 807084 kB' 'SReclaimable: 415672 kB' 'SUnreclaim: 391412 kB' 'KernelStack: 12816 kB' 'PageTables: 7996 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37610896 kB' 'Committed_AS: 9891456 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 197120 kB' 'VmallocChunk: 0 kB' 'Percpu: 38592 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 2506332 kB' 'DirectMap2M: 24676352 kB' 'DirectMap1G: 41943040 kB' 00:02:51.680 22:40:42 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:51.680 22:40:42 -- setup/common.sh@32 -- # continue 00:02:51.680 22:40:42 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.680 22:40:42 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.680 22:40:42 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:51.680 22:40:42 -- setup/common.sh@32 -- # continue 00:02:51.681 22:40:42 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.681 22:40:42 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.681 22:40:42 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:51.681 22:40:42 -- setup/common.sh@32 -- # continue 00:02:51.681 22:40:42 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.681 22:40:42 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.681 22:40:42 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:51.681 22:40:42 -- setup/common.sh@32 -- # continue 00:02:51.681 22:40:42 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.681 22:40:42 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.681 22:40:42 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:51.681 22:40:42 -- setup/common.sh@32 -- # continue 00:02:51.681 22:40:42 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.681 22:40:42 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.681 22:40:42 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:51.681 22:40:42 -- setup/common.sh@32 -- # continue 00:02:51.681 22:40:42 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.681 22:40:42 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.681 22:40:42 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:51.681 22:40:42 -- setup/common.sh@32 -- # continue 00:02:51.681 22:40:42 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.681 22:40:42 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.681 22:40:42 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:51.681 22:40:42 -- setup/common.sh@32 -- # continue 00:02:51.681 22:40:42 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.681 22:40:42 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.681 22:40:42 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:51.681 22:40:42 -- setup/common.sh@32 -- # continue 00:02:51.681 22:40:42 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.681 22:40:42 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.681 22:40:42 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:51.681 22:40:42 -- setup/common.sh@32 -- # continue 00:02:51.681 22:40:42 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.681 22:40:42 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.681 22:40:42 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:51.681 22:40:42 -- setup/common.sh@32 -- # continue 00:02:51.681 22:40:42 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.681 22:40:42 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.681 22:40:42 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:51.681 22:40:42 -- setup/common.sh@32 -- # continue 00:02:51.681 22:40:42 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.681 22:40:42 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.681 22:40:42 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:51.681 22:40:42 -- setup/common.sh@32 -- # continue 00:02:51.681 22:40:42 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.681 22:40:42 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.681 22:40:42 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:51.681 22:40:42 -- setup/common.sh@32 -- # continue 00:02:51.681 22:40:42 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.681 22:40:42 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.681 22:40:42 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:51.681 22:40:42 -- setup/common.sh@32 -- # continue 00:02:51.681 22:40:42 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.681 22:40:42 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.681 22:40:42 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:51.681 22:40:42 -- setup/common.sh@32 -- # continue 00:02:51.681 22:40:42 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.681 22:40:42 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.681 22:40:42 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:51.681 22:40:42 -- setup/common.sh@32 -- # continue 00:02:51.681 22:40:42 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.681 22:40:42 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.681 22:40:42 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:51.681 22:40:42 -- setup/common.sh@32 -- # continue 00:02:51.681 22:40:42 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.681 22:40:42 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.681 22:40:42 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:51.681 22:40:42 -- setup/common.sh@32 -- # continue 00:02:51.681 22:40:42 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.681 22:40:42 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.681 22:40:42 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:51.681 22:40:42 -- setup/common.sh@32 -- # continue 00:02:51.681 22:40:42 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.681 22:40:42 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.681 22:40:42 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:51.681 22:40:42 -- setup/common.sh@32 -- # continue 00:02:51.681 22:40:42 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.681 22:40:42 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.681 22:40:42 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:51.681 22:40:42 -- setup/common.sh@32 -- # continue 00:02:51.681 22:40:42 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.681 22:40:42 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.681 22:40:42 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:51.681 22:40:42 -- setup/common.sh@32 -- # continue 00:02:51.681 22:40:42 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.681 22:40:42 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.681 22:40:42 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:51.681 22:40:42 -- setup/common.sh@32 -- # continue 00:02:51.681 22:40:42 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.681 22:40:42 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.681 22:40:42 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:51.681 22:40:42 -- setup/common.sh@32 -- # continue 00:02:51.681 22:40:42 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.681 22:40:42 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.681 22:40:42 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:51.681 22:40:42 -- setup/common.sh@32 -- # continue 00:02:51.681 22:40:42 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.681 22:40:42 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.681 22:40:42 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:51.681 22:40:42 -- setup/common.sh@32 -- # continue 00:02:51.681 22:40:42 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.681 22:40:42 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.681 22:40:42 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:51.681 22:40:42 -- setup/common.sh@32 -- # continue 00:02:51.681 22:40:42 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.681 22:40:42 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.681 22:40:42 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:51.681 22:40:42 -- setup/common.sh@32 -- # continue 00:02:51.681 22:40:42 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.681 22:40:42 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.681 22:40:42 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:51.681 22:40:42 -- setup/common.sh@32 -- # continue 00:02:51.681 22:40:42 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.681 22:40:42 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.681 22:40:42 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:51.681 22:40:42 -- setup/common.sh@32 -- # continue 00:02:51.681 22:40:42 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.681 22:40:42 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.681 22:40:42 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:51.681 22:40:42 -- setup/common.sh@32 -- # continue 00:02:51.681 22:40:42 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.681 22:40:42 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.681 22:40:42 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:51.681 22:40:42 -- setup/common.sh@32 -- # continue 00:02:51.681 22:40:42 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.681 22:40:42 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.681 22:40:42 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:51.681 22:40:42 -- setup/common.sh@32 -- # continue 00:02:51.681 22:40:42 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.681 22:40:42 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.681 22:40:42 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:51.681 22:40:42 -- setup/common.sh@32 -- # continue 00:02:51.681 22:40:42 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.681 22:40:42 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.681 22:40:42 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:51.681 22:40:42 -- setup/common.sh@32 -- # continue 00:02:51.681 22:40:42 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.681 22:40:42 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.681 22:40:42 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:51.681 22:40:42 -- setup/common.sh@32 -- # continue 00:02:51.681 22:40:42 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.681 22:40:42 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.681 22:40:42 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:51.681 22:40:42 -- setup/common.sh@32 -- # continue 00:02:51.681 22:40:42 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.681 22:40:42 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.681 22:40:42 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:51.681 22:40:42 -- setup/common.sh@32 -- # continue 00:02:51.681 22:40:42 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.681 22:40:42 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.681 22:40:42 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:51.681 22:40:42 -- setup/common.sh@32 -- # continue 00:02:51.681 22:40:42 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.681 22:40:42 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.681 22:40:42 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:51.681 22:40:42 -- setup/common.sh@32 -- # continue 00:02:51.681 22:40:42 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.681 22:40:42 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.681 22:40:42 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:51.681 22:40:42 -- setup/common.sh@32 -- # continue 00:02:51.681 22:40:42 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.681 22:40:42 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.681 22:40:42 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:51.681 22:40:42 -- setup/common.sh@32 -- # continue 00:02:51.681 22:40:42 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.681 22:40:42 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.682 22:40:42 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:51.682 22:40:42 -- setup/common.sh@32 -- # continue 00:02:51.682 22:40:42 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.682 22:40:42 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.682 22:40:42 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:51.682 22:40:42 -- setup/common.sh@32 -- # continue 00:02:51.682 22:40:42 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.682 22:40:42 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.682 22:40:42 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:51.682 22:40:42 -- setup/common.sh@32 -- # continue 00:02:51.682 22:40:42 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.682 22:40:42 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.682 22:40:42 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:51.682 22:40:42 -- setup/common.sh@32 -- # continue 00:02:51.682 22:40:42 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.682 22:40:42 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.682 22:40:42 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:51.682 22:40:42 -- setup/common.sh@32 -- # continue 00:02:51.682 22:40:42 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.682 22:40:42 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.682 22:40:42 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:51.682 22:40:42 -- setup/common.sh@32 -- # continue 00:02:51.682 22:40:42 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.682 22:40:42 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.682 22:40:42 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:51.682 22:40:42 -- setup/common.sh@32 -- # continue 00:02:51.682 22:40:42 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.682 22:40:42 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.682 22:40:42 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:51.682 22:40:42 -- setup/common.sh@33 -- # echo 0 00:02:51.682 22:40:42 -- setup/common.sh@33 -- # return 0 00:02:51.682 22:40:42 -- setup/hugepages.sh@100 -- # resv=0 00:02:51.682 22:40:42 -- setup/hugepages.sh@102 -- # echo nr_hugepages=1024 00:02:51.682 nr_hugepages=1024 00:02:51.682 22:40:42 -- setup/hugepages.sh@103 -- # echo resv_hugepages=0 00:02:51.682 resv_hugepages=0 00:02:51.682 22:40:42 -- setup/hugepages.sh@104 -- # echo surplus_hugepages=0 00:02:51.682 surplus_hugepages=0 00:02:51.682 22:40:42 -- setup/hugepages.sh@105 -- # echo anon_hugepages=0 00:02:51.682 anon_hugepages=0 00:02:51.682 22:40:42 -- setup/hugepages.sh@107 -- # (( 1024 == nr_hugepages + surp + resv )) 00:02:51.682 22:40:42 -- setup/hugepages.sh@109 -- # (( 1024 == nr_hugepages )) 00:02:51.682 22:40:42 -- setup/hugepages.sh@110 -- # get_meminfo HugePages_Total 00:02:51.682 22:40:42 -- setup/common.sh@17 -- # local get=HugePages_Total 00:02:51.682 22:40:42 -- setup/common.sh@18 -- # local node= 00:02:51.682 22:40:42 -- setup/common.sh@19 -- # local var val 00:02:51.682 22:40:42 -- setup/common.sh@20 -- # local mem_f mem 00:02:51.682 22:40:42 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:02:51.682 22:40:42 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:02:51.682 22:40:42 -- setup/common.sh@25 -- # [[ -n '' ]] 00:02:51.682 22:40:42 -- setup/common.sh@28 -- # mapfile -t mem 00:02:51.682 22:40:42 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:02:51.682 22:40:42 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.682 22:40:42 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.682 22:40:42 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60541736 kB' 'MemFree: 43334300 kB' 'MemAvailable: 47325688 kB' 'Buffers: 2696 kB' 'Cached: 12518696 kB' 'SwapCached: 0 kB' 'Active: 9325816 kB' 'Inactive: 3655836 kB' 'Active(anon): 8761500 kB' 'Inactive(anon): 0 kB' 'Active(file): 564316 kB' 'Inactive(file): 3655836 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 463488 kB' 'Mapped: 201960 kB' 'Shmem: 8301240 kB' 'KReclaimable: 415672 kB' 'Slab: 807084 kB' 'SReclaimable: 415672 kB' 'SUnreclaim: 391412 kB' 'KernelStack: 12816 kB' 'PageTables: 8036 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37610896 kB' 'Committed_AS: 9888820 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 197132 kB' 'VmallocChunk: 0 kB' 'Percpu: 38592 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 2506332 kB' 'DirectMap2M: 24676352 kB' 'DirectMap1G: 41943040 kB' 00:02:51.682 22:40:42 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:51.682 22:40:42 -- setup/common.sh@32 -- # continue 00:02:51.682 22:40:42 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.682 22:40:42 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.682 22:40:42 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:51.682 22:40:42 -- setup/common.sh@32 -- # continue 00:02:51.682 22:40:42 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.682 22:40:42 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.682 22:40:42 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:51.682 22:40:42 -- setup/common.sh@32 -- # continue 00:02:51.682 22:40:42 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.682 22:40:42 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.682 22:40:42 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:51.682 22:40:42 -- setup/common.sh@32 -- # continue 00:02:51.682 22:40:42 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.682 22:40:42 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.682 22:40:42 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:51.682 22:40:42 -- setup/common.sh@32 -- # continue 00:02:51.682 22:40:42 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.682 22:40:42 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.682 22:40:42 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:51.682 22:40:42 -- setup/common.sh@32 -- # continue 00:02:51.682 22:40:42 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.682 22:40:42 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.682 22:40:42 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:51.682 22:40:42 -- setup/common.sh@32 -- # continue 00:02:51.682 22:40:42 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.682 22:40:42 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.682 22:40:42 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:51.682 22:40:42 -- setup/common.sh@32 -- # continue 00:02:51.682 22:40:42 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.682 22:40:42 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.682 22:40:42 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:51.682 22:40:42 -- setup/common.sh@32 -- # continue 00:02:51.682 22:40:42 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.682 22:40:42 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.682 22:40:42 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:51.682 22:40:42 -- setup/common.sh@32 -- # continue 00:02:51.682 22:40:42 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.682 22:40:42 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.682 22:40:42 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:51.682 22:40:42 -- setup/common.sh@32 -- # continue 00:02:51.682 22:40:42 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.682 22:40:42 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.682 22:40:42 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:51.682 22:40:42 -- setup/common.sh@32 -- # continue 00:02:51.682 22:40:42 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.682 22:40:42 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.682 22:40:42 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:51.682 22:40:42 -- setup/common.sh@32 -- # continue 00:02:51.682 22:40:42 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.682 22:40:42 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.682 22:40:42 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:51.682 22:40:42 -- setup/common.sh@32 -- # continue 00:02:51.682 22:40:42 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.682 22:40:42 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.682 22:40:42 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:51.682 22:40:42 -- setup/common.sh@32 -- # continue 00:02:51.682 22:40:42 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.682 22:40:42 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.682 22:40:42 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:51.682 22:40:42 -- setup/common.sh@32 -- # continue 00:02:51.682 22:40:42 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.683 22:40:42 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.683 22:40:42 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:51.683 22:40:42 -- setup/common.sh@32 -- # continue 00:02:51.683 22:40:42 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.683 22:40:42 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.683 22:40:42 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:51.683 22:40:42 -- setup/common.sh@32 -- # continue 00:02:51.683 22:40:42 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.683 22:40:42 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.683 22:40:42 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:51.683 22:40:42 -- setup/common.sh@32 -- # continue 00:02:51.683 22:40:42 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.683 22:40:42 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.683 22:40:42 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:51.683 22:40:42 -- setup/common.sh@32 -- # continue 00:02:51.683 22:40:42 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.683 22:40:42 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.683 22:40:42 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:51.683 22:40:42 -- setup/common.sh@32 -- # continue 00:02:51.683 22:40:42 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.683 22:40:42 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.683 22:40:42 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:51.683 22:40:42 -- setup/common.sh@32 -- # continue 00:02:51.683 22:40:42 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.683 22:40:42 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.683 22:40:42 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:51.683 22:40:42 -- setup/common.sh@32 -- # continue 00:02:51.683 22:40:42 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.683 22:40:42 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.683 22:40:42 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:51.683 22:40:42 -- setup/common.sh@32 -- # continue 00:02:51.683 22:40:42 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.683 22:40:42 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.683 22:40:42 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:51.683 22:40:42 -- setup/common.sh@32 -- # continue 00:02:51.683 22:40:42 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.683 22:40:42 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.683 22:40:42 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:51.683 22:40:42 -- setup/common.sh@32 -- # continue 00:02:51.683 22:40:42 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.683 22:40:42 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.683 22:40:42 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:51.683 22:40:42 -- setup/common.sh@32 -- # continue 00:02:51.683 22:40:42 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.683 22:40:42 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.683 22:40:42 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:51.683 22:40:42 -- setup/common.sh@32 -- # continue 00:02:51.683 22:40:42 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.683 22:40:42 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.683 22:40:42 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:51.683 22:40:42 -- setup/common.sh@32 -- # continue 00:02:51.683 22:40:42 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.683 22:40:42 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.683 22:40:42 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:51.683 22:40:42 -- setup/common.sh@32 -- # continue 00:02:51.683 22:40:42 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.683 22:40:42 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.683 22:40:42 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:51.683 22:40:42 -- setup/common.sh@32 -- # continue 00:02:51.683 22:40:42 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.683 22:40:42 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.683 22:40:42 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:51.683 22:40:42 -- setup/common.sh@32 -- # continue 00:02:51.683 22:40:42 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.683 22:40:42 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.683 22:40:42 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:51.683 22:40:42 -- setup/common.sh@32 -- # continue 00:02:51.683 22:40:42 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.683 22:40:42 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.683 22:40:42 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:51.683 22:40:42 -- setup/common.sh@32 -- # continue 00:02:51.683 22:40:42 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.683 22:40:42 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.683 22:40:42 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:51.683 22:40:42 -- setup/common.sh@32 -- # continue 00:02:51.683 22:40:42 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.683 22:40:42 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.683 22:40:42 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:51.683 22:40:42 -- setup/common.sh@32 -- # continue 00:02:51.683 22:40:42 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.683 22:40:42 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.683 22:40:42 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:51.683 22:40:42 -- setup/common.sh@32 -- # continue 00:02:51.683 22:40:42 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.683 22:40:42 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.683 22:40:42 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:51.683 22:40:42 -- setup/common.sh@32 -- # continue 00:02:51.683 22:40:42 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.683 22:40:42 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.683 22:40:42 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:51.683 22:40:42 -- setup/common.sh@32 -- # continue 00:02:51.683 22:40:42 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.683 22:40:42 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.683 22:40:42 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:51.683 22:40:42 -- setup/common.sh@32 -- # continue 00:02:51.683 22:40:42 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.683 22:40:42 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.683 22:40:42 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:51.683 22:40:42 -- setup/common.sh@32 -- # continue 00:02:51.683 22:40:42 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.683 22:40:42 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.683 22:40:42 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:51.683 22:40:42 -- setup/common.sh@32 -- # continue 00:02:51.683 22:40:42 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.683 22:40:42 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.683 22:40:42 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:51.683 22:40:42 -- setup/common.sh@32 -- # continue 00:02:51.683 22:40:42 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.683 22:40:42 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.683 22:40:42 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:51.683 22:40:42 -- setup/common.sh@32 -- # continue 00:02:51.683 22:40:42 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.683 22:40:42 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.683 22:40:42 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:51.683 22:40:42 -- setup/common.sh@32 -- # continue 00:02:51.683 22:40:42 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.683 22:40:42 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.683 22:40:42 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:51.683 22:40:42 -- setup/common.sh@32 -- # continue 00:02:51.683 22:40:42 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.683 22:40:42 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.683 22:40:42 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:51.683 22:40:42 -- setup/common.sh@32 -- # continue 00:02:51.683 22:40:42 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.683 22:40:42 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.683 22:40:42 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:51.683 22:40:42 -- setup/common.sh@32 -- # continue 00:02:51.683 22:40:42 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.683 22:40:42 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.683 22:40:42 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:51.683 22:40:42 -- setup/common.sh@33 -- # echo 1024 00:02:51.683 22:40:42 -- setup/common.sh@33 -- # return 0 00:02:51.683 22:40:42 -- setup/hugepages.sh@110 -- # (( 1024 == nr_hugepages + surp + resv )) 00:02:51.683 22:40:42 -- setup/hugepages.sh@112 -- # get_nodes 00:02:51.683 22:40:42 -- setup/hugepages.sh@27 -- # local node 00:02:51.683 22:40:42 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:02:51.683 22:40:42 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=1024 00:02:51.683 22:40:42 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:02:51.683 22:40:42 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=0 00:02:51.683 22:40:42 -- setup/hugepages.sh@32 -- # no_nodes=2 00:02:51.683 22:40:42 -- setup/hugepages.sh@33 -- # (( no_nodes > 0 )) 00:02:51.683 22:40:42 -- setup/hugepages.sh@115 -- # for node in "${!nodes_test[@]}" 00:02:51.683 22:40:42 -- setup/hugepages.sh@116 -- # (( nodes_test[node] += resv )) 00:02:51.683 22:40:42 -- setup/hugepages.sh@117 -- # get_meminfo HugePages_Surp 0 00:02:51.683 22:40:42 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:02:51.683 22:40:42 -- setup/common.sh@18 -- # local node=0 00:02:51.683 22:40:42 -- setup/common.sh@19 -- # local var val 00:02:51.683 22:40:42 -- setup/common.sh@20 -- # local mem_f mem 00:02:51.683 22:40:42 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:02:51.683 22:40:42 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node0/meminfo ]] 00:02:51.683 22:40:42 -- setup/common.sh@24 -- # mem_f=/sys/devices/system/node/node0/meminfo 00:02:51.683 22:40:42 -- setup/common.sh@28 -- # mapfile -t mem 00:02:51.683 22:40:42 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:02:51.683 22:40:42 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.683 22:40:42 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.684 22:40:42 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 32829884 kB' 'MemFree: 19089920 kB' 'MemUsed: 13739964 kB' 'SwapCached: 0 kB' 'Active: 7003340 kB' 'Inactive: 3490860 kB' 'Active(anon): 6622128 kB' 'Inactive(anon): 0 kB' 'Active(file): 381212 kB' 'Inactive(file): 3490860 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'FilePages: 10244468 kB' 'Mapped: 156920 kB' 'AnonPages: 252856 kB' 'Shmem: 6372396 kB' 'KernelStack: 6632 kB' 'PageTables: 4472 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'KReclaimable: 272596 kB' 'Slab: 485024 kB' 'SReclaimable: 272596 kB' 'SUnreclaim: 212428 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Surp: 0' 00:02:51.684 22:40:42 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:51.684 22:40:42 -- setup/common.sh@32 -- # continue 00:02:51.684 22:40:42 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.684 22:40:42 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.684 22:40:42 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:51.684 22:40:42 -- setup/common.sh@32 -- # continue 00:02:51.684 22:40:42 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.684 22:40:42 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.684 22:40:42 -- setup/common.sh@32 -- # [[ MemUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:51.684 22:40:42 -- setup/common.sh@32 -- # continue 00:02:51.684 22:40:42 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.684 22:40:42 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.684 22:40:42 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:51.684 22:40:42 -- setup/common.sh@32 -- # continue 00:02:51.684 22:40:42 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.684 22:40:42 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.684 22:40:42 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:51.684 22:40:42 -- setup/common.sh@32 -- # continue 00:02:51.684 22:40:42 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.684 22:40:42 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.684 22:40:42 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:51.684 22:40:42 -- setup/common.sh@32 -- # continue 00:02:51.684 22:40:42 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.684 22:40:42 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.684 22:40:42 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:51.684 22:40:42 -- setup/common.sh@32 -- # continue 00:02:51.684 22:40:42 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.684 22:40:42 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.684 22:40:42 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:51.684 22:40:42 -- setup/common.sh@32 -- # continue 00:02:51.684 22:40:42 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.684 22:40:42 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.684 22:40:42 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:51.684 22:40:42 -- setup/common.sh@32 -- # continue 00:02:51.684 22:40:42 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.684 22:40:42 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.684 22:40:42 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:51.684 22:40:42 -- setup/common.sh@32 -- # continue 00:02:51.684 22:40:42 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.684 22:40:42 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.684 22:40:42 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:51.684 22:40:42 -- setup/common.sh@32 -- # continue 00:02:51.684 22:40:42 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.684 22:40:42 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.684 22:40:42 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:51.684 22:40:42 -- setup/common.sh@32 -- # continue 00:02:51.684 22:40:42 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.684 22:40:42 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.684 22:40:42 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:51.684 22:40:42 -- setup/common.sh@32 -- # continue 00:02:51.684 22:40:42 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.684 22:40:42 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.684 22:40:42 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:51.684 22:40:42 -- setup/common.sh@32 -- # continue 00:02:51.684 22:40:42 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.684 22:40:42 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.684 22:40:42 -- setup/common.sh@32 -- # [[ FilePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:51.684 22:40:42 -- setup/common.sh@32 -- # continue 00:02:51.684 22:40:42 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.684 22:40:42 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.684 22:40:42 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:51.684 22:40:42 -- setup/common.sh@32 -- # continue 00:02:51.684 22:40:42 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.684 22:40:42 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.684 22:40:42 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:51.684 22:40:42 -- setup/common.sh@32 -- # continue 00:02:51.684 22:40:42 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.684 22:40:42 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.684 22:40:42 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:51.684 22:40:42 -- setup/common.sh@32 -- # continue 00:02:51.684 22:40:42 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.684 22:40:42 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.684 22:40:42 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:51.684 22:40:42 -- setup/common.sh@32 -- # continue 00:02:51.684 22:40:42 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.684 22:40:42 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.684 22:40:42 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:51.684 22:40:42 -- setup/common.sh@32 -- # continue 00:02:51.684 22:40:42 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.684 22:40:42 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.684 22:40:42 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:51.684 22:40:42 -- setup/common.sh@32 -- # continue 00:02:51.684 22:40:42 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.684 22:40:42 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.684 22:40:42 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:51.684 22:40:42 -- setup/common.sh@32 -- # continue 00:02:51.684 22:40:42 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.684 22:40:42 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.684 22:40:42 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:51.684 22:40:42 -- setup/common.sh@32 -- # continue 00:02:51.684 22:40:42 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.684 22:40:42 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.684 22:40:42 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:51.684 22:40:42 -- setup/common.sh@32 -- # continue 00:02:51.684 22:40:42 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.684 22:40:42 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.684 22:40:42 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:51.684 22:40:42 -- setup/common.sh@32 -- # continue 00:02:51.684 22:40:42 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.684 22:40:42 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.684 22:40:42 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:51.684 22:40:42 -- setup/common.sh@32 -- # continue 00:02:51.684 22:40:42 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.684 22:40:42 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.684 22:40:42 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:51.684 22:40:42 -- setup/common.sh@32 -- # continue 00:02:51.684 22:40:42 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.684 22:40:42 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.684 22:40:42 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:51.684 22:40:42 -- setup/common.sh@32 -- # continue 00:02:51.684 22:40:42 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.684 22:40:42 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.684 22:40:42 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:51.684 22:40:42 -- setup/common.sh@32 -- # continue 00:02:51.684 22:40:42 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.684 22:40:42 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.684 22:40:42 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:51.684 22:40:42 -- setup/common.sh@32 -- # continue 00:02:51.684 22:40:42 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.684 22:40:42 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.684 22:40:42 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:51.684 22:40:42 -- setup/common.sh@32 -- # continue 00:02:51.684 22:40:42 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.684 22:40:42 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.684 22:40:42 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:51.684 22:40:42 -- setup/common.sh@32 -- # continue 00:02:51.684 22:40:42 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.684 22:40:42 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.684 22:40:42 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:51.684 22:40:42 -- setup/common.sh@32 -- # continue 00:02:51.684 22:40:42 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.684 22:40:42 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.684 22:40:42 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:51.684 22:40:42 -- setup/common.sh@32 -- # continue 00:02:51.684 22:40:42 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.684 22:40:42 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.684 22:40:42 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:51.684 22:40:42 -- setup/common.sh@32 -- # continue 00:02:51.684 22:40:42 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.684 22:40:42 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.684 22:40:42 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:51.684 22:40:42 -- setup/common.sh@32 -- # continue 00:02:51.684 22:40:42 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.684 22:40:42 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.684 22:40:42 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:51.684 22:40:42 -- setup/common.sh@33 -- # echo 0 00:02:51.684 22:40:42 -- setup/common.sh@33 -- # return 0 00:02:51.684 22:40:42 -- setup/hugepages.sh@117 -- # (( nodes_test[node] += 0 )) 00:02:51.684 22:40:42 -- setup/hugepages.sh@126 -- # for node in "${!nodes_test[@]}" 00:02:51.684 22:40:42 -- setup/hugepages.sh@127 -- # sorted_t[nodes_test[node]]=1 00:02:51.684 22:40:42 -- setup/hugepages.sh@127 -- # sorted_s[nodes_sys[node]]=1 00:02:51.684 22:40:42 -- setup/hugepages.sh@128 -- # echo 'node0=1024 expecting 1024' 00:02:51.684 node0=1024 expecting 1024 00:02:51.684 22:40:42 -- setup/hugepages.sh@130 -- # [[ 1024 == \1\0\2\4 ]] 00:02:51.684 00:02:51.684 real 0m2.763s 00:02:51.684 user 0m1.108s 00:02:51.684 sys 0m1.580s 00:02:51.684 22:40:42 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:02:51.684 22:40:42 -- common/autotest_common.sh@10 -- # set +x 00:02:51.684 ************************************ 00:02:51.684 END TEST no_shrink_alloc 00:02:51.684 ************************************ 00:02:51.684 22:40:42 -- setup/hugepages.sh@217 -- # clear_hp 00:02:51.684 22:40:42 -- setup/hugepages.sh@37 -- # local node hp 00:02:51.684 22:40:42 -- setup/hugepages.sh@39 -- # for node in "${!nodes_sys[@]}" 00:02:51.685 22:40:42 -- setup/hugepages.sh@40 -- # for hp in "/sys/devices/system/node/node$node/hugepages/hugepages-"* 00:02:51.685 22:40:42 -- setup/hugepages.sh@41 -- # echo 0 00:02:51.685 22:40:42 -- setup/hugepages.sh@40 -- # for hp in "/sys/devices/system/node/node$node/hugepages/hugepages-"* 00:02:51.685 22:40:42 -- setup/hugepages.sh@41 -- # echo 0 00:02:51.685 22:40:42 -- setup/hugepages.sh@39 -- # for node in "${!nodes_sys[@]}" 00:02:51.685 22:40:42 -- setup/hugepages.sh@40 -- # for hp in "/sys/devices/system/node/node$node/hugepages/hugepages-"* 00:02:51.685 22:40:42 -- setup/hugepages.sh@41 -- # echo 0 00:02:51.685 22:40:42 -- setup/hugepages.sh@40 -- # for hp in "/sys/devices/system/node/node$node/hugepages/hugepages-"* 00:02:51.685 22:40:42 -- setup/hugepages.sh@41 -- # echo 0 00:02:51.685 22:40:42 -- setup/hugepages.sh@45 -- # export CLEAR_HUGE=yes 00:02:51.685 22:40:42 -- setup/hugepages.sh@45 -- # CLEAR_HUGE=yes 00:02:51.685 00:02:51.685 real 0m10.960s 00:02:51.685 user 0m4.225s 00:02:51.685 sys 0m5.561s 00:02:51.685 22:40:42 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:02:51.685 22:40:42 -- common/autotest_common.sh@10 -- # set +x 00:02:51.685 ************************************ 00:02:51.685 END TEST hugepages 00:02:51.685 ************************************ 00:02:51.685 22:40:42 -- setup/test-setup.sh@14 -- # run_test driver /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/driver.sh 00:02:51.685 22:40:42 -- common/autotest_common.sh@1077 -- # '[' 2 -le 1 ']' 00:02:51.685 22:40:42 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:02:51.685 22:40:42 -- common/autotest_common.sh@10 -- # set +x 00:02:51.685 ************************************ 00:02:51.685 START TEST driver 00:02:51.685 ************************************ 00:02:51.685 22:40:42 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/driver.sh 00:02:51.943 * Looking for test storage... 00:02:51.943 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup 00:02:51.943 22:40:42 -- setup/driver.sh@68 -- # setup reset 00:02:51.943 22:40:42 -- setup/common.sh@9 -- # [[ reset == output ]] 00:02:51.943 22:40:42 -- setup/common.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh reset 00:02:54.481 22:40:45 -- setup/driver.sh@69 -- # run_test guess_driver guess_driver 00:02:54.481 22:40:45 -- common/autotest_common.sh@1077 -- # '[' 2 -le 1 ']' 00:02:54.481 22:40:45 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:02:54.481 22:40:45 -- common/autotest_common.sh@10 -- # set +x 00:02:54.481 ************************************ 00:02:54.481 START TEST guess_driver 00:02:54.481 ************************************ 00:02:54.481 22:40:45 -- common/autotest_common.sh@1104 -- # guess_driver 00:02:54.481 22:40:45 -- setup/driver.sh@46 -- # local driver setup_driver marker 00:02:54.481 22:40:45 -- setup/driver.sh@47 -- # local fail=0 00:02:54.481 22:40:45 -- setup/driver.sh@49 -- # pick_driver 00:02:54.481 22:40:45 -- setup/driver.sh@36 -- # vfio 00:02:54.481 22:40:45 -- setup/driver.sh@21 -- # local iommu_grups 00:02:54.481 22:40:45 -- setup/driver.sh@22 -- # local unsafe_vfio 00:02:54.481 22:40:45 -- setup/driver.sh@24 -- # [[ -e /sys/module/vfio/parameters/enable_unsafe_noiommu_mode ]] 00:02:54.481 22:40:45 -- setup/driver.sh@25 -- # unsafe_vfio=N 00:02:54.481 22:40:45 -- setup/driver.sh@27 -- # iommu_groups=(/sys/kernel/iommu_groups/*) 00:02:54.481 22:40:45 -- setup/driver.sh@29 -- # (( 141 > 0 )) 00:02:54.481 22:40:45 -- setup/driver.sh@30 -- # is_driver vfio_pci 00:02:54.481 22:40:45 -- setup/driver.sh@14 -- # mod vfio_pci 00:02:54.481 22:40:45 -- setup/driver.sh@12 -- # dep vfio_pci 00:02:54.481 22:40:45 -- setup/driver.sh@11 -- # modprobe --show-depends vfio_pci 00:02:54.481 22:40:45 -- setup/driver.sh@12 -- # [[ insmod /lib/modules/6.7.0-68.fc38.x86_64/kernel/virt/lib/irqbypass.ko.xz 00:02:54.481 insmod /lib/modules/6.7.0-68.fc38.x86_64/kernel/drivers/iommu/iommufd/iommufd.ko.xz 00:02:54.481 insmod /lib/modules/6.7.0-68.fc38.x86_64/kernel/drivers/vfio/vfio.ko.xz 00:02:54.481 insmod /lib/modules/6.7.0-68.fc38.x86_64/kernel/drivers/iommu/iommufd/iommufd.ko.xz 00:02:54.481 insmod /lib/modules/6.7.0-68.fc38.x86_64/kernel/drivers/vfio/vfio.ko.xz 00:02:54.481 insmod /lib/modules/6.7.0-68.fc38.x86_64/kernel/drivers/vfio/vfio_iommu_type1.ko.xz 00:02:54.481 insmod /lib/modules/6.7.0-68.fc38.x86_64/kernel/drivers/vfio/pci/vfio-pci-core.ko.xz 00:02:54.481 insmod /lib/modules/6.7.0-68.fc38.x86_64/kernel/drivers/vfio/pci/vfio-pci.ko.xz == *\.\k\o* ]] 00:02:54.481 22:40:45 -- setup/driver.sh@30 -- # return 0 00:02:54.481 22:40:45 -- setup/driver.sh@37 -- # echo vfio-pci 00:02:54.481 22:40:45 -- setup/driver.sh@49 -- # driver=vfio-pci 00:02:54.481 22:40:45 -- setup/driver.sh@51 -- # [[ vfio-pci == \N\o\ \v\a\l\i\d\ \d\r\i\v\e\r\ \f\o\u\n\d ]] 00:02:54.481 22:40:45 -- setup/driver.sh@56 -- # echo 'Looking for driver=vfio-pci' 00:02:54.481 Looking for driver=vfio-pci 00:02:54.481 22:40:45 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:02:54.481 22:40:45 -- setup/driver.sh@45 -- # setup output config 00:02:54.481 22:40:45 -- setup/common.sh@9 -- # [[ output == output ]] 00:02:54.481 22:40:45 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh config 00:02:55.415 22:40:46 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:02:55.415 22:40:46 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:02:55.415 22:40:46 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:02:55.415 22:40:46 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:02:55.415 22:40:46 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:02:55.415 22:40:46 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:02:55.415 22:40:46 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:02:55.415 22:40:46 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:02:55.415 22:40:46 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:02:55.415 22:40:46 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:02:55.415 22:40:46 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:02:55.415 22:40:46 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:02:55.415 22:40:46 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:02:55.415 22:40:46 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:02:55.415 22:40:46 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:02:55.415 22:40:46 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:02:55.415 22:40:46 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:02:55.415 22:40:46 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:02:55.415 22:40:46 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:02:55.415 22:40:46 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:02:55.416 22:40:46 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:02:55.416 22:40:46 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:02:55.416 22:40:46 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:02:55.416 22:40:46 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:02:55.416 22:40:46 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:02:55.416 22:40:46 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:02:55.416 22:40:46 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:02:55.416 22:40:46 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:02:55.416 22:40:46 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:02:55.416 22:40:46 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:02:55.416 22:40:46 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:02:55.416 22:40:46 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:02:55.416 22:40:46 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:02:55.416 22:40:46 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:02:55.416 22:40:46 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:02:55.416 22:40:46 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:02:55.416 22:40:46 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:02:55.416 22:40:46 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:02:55.416 22:40:46 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:02:55.416 22:40:46 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:02:55.416 22:40:46 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:02:55.416 22:40:46 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:02:55.416 22:40:46 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:02:55.416 22:40:46 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:02:55.416 22:40:46 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:02:55.416 22:40:46 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:02:55.416 22:40:46 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:02:55.416 22:40:46 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:02:56.350 22:40:47 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:02:56.350 22:40:47 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:02:56.350 22:40:47 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:02:56.350 22:40:47 -- setup/driver.sh@64 -- # (( fail == 0 )) 00:02:56.350 22:40:47 -- setup/driver.sh@65 -- # setup reset 00:02:56.350 22:40:47 -- setup/common.sh@9 -- # [[ reset == output ]] 00:02:56.350 22:40:47 -- setup/common.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh reset 00:02:58.876 00:02:58.876 real 0m4.615s 00:02:58.876 user 0m1.015s 00:02:58.876 sys 0m1.769s 00:02:58.876 22:40:49 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:02:58.876 22:40:49 -- common/autotest_common.sh@10 -- # set +x 00:02:58.876 ************************************ 00:02:58.876 END TEST guess_driver 00:02:58.876 ************************************ 00:02:58.876 00:02:58.876 real 0m6.924s 00:02:58.876 user 0m1.503s 00:02:58.876 sys 0m2.730s 00:02:58.876 22:40:49 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:02:58.876 22:40:49 -- common/autotest_common.sh@10 -- # set +x 00:02:58.876 ************************************ 00:02:58.876 END TEST driver 00:02:58.876 ************************************ 00:02:58.876 22:40:49 -- setup/test-setup.sh@15 -- # run_test devices /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/devices.sh 00:02:58.876 22:40:49 -- common/autotest_common.sh@1077 -- # '[' 2 -le 1 ']' 00:02:58.876 22:40:49 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:02:58.876 22:40:49 -- common/autotest_common.sh@10 -- # set +x 00:02:58.877 ************************************ 00:02:58.877 START TEST devices 00:02:58.877 ************************************ 00:02:58.877 22:40:49 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/devices.sh 00:02:58.877 * Looking for test storage... 00:02:58.877 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup 00:02:58.877 22:40:49 -- setup/devices.sh@190 -- # trap cleanup EXIT 00:02:58.877 22:40:49 -- setup/devices.sh@192 -- # setup reset 00:02:58.877 22:40:49 -- setup/common.sh@9 -- # [[ reset == output ]] 00:02:58.877 22:40:49 -- setup/common.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh reset 00:03:00.252 22:40:51 -- setup/devices.sh@194 -- # get_zoned_devs 00:03:00.252 22:40:51 -- common/autotest_common.sh@1654 -- # zoned_devs=() 00:03:00.252 22:40:51 -- common/autotest_common.sh@1654 -- # local -gA zoned_devs 00:03:00.252 22:40:51 -- common/autotest_common.sh@1655 -- # local nvme bdf 00:03:00.252 22:40:51 -- common/autotest_common.sh@1657 -- # for nvme in /sys/block/nvme* 00:03:00.252 22:40:51 -- common/autotest_common.sh@1658 -- # is_block_zoned nvme0n1 00:03:00.253 22:40:51 -- common/autotest_common.sh@1647 -- # local device=nvme0n1 00:03:00.253 22:40:51 -- common/autotest_common.sh@1649 -- # [[ -e /sys/block/nvme0n1/queue/zoned ]] 00:03:00.253 22:40:51 -- common/autotest_common.sh@1650 -- # [[ none != none ]] 00:03:00.253 22:40:51 -- setup/devices.sh@196 -- # blocks=() 00:03:00.253 22:40:51 -- setup/devices.sh@196 -- # declare -a blocks 00:03:00.253 22:40:51 -- setup/devices.sh@197 -- # blocks_to_pci=() 00:03:00.253 22:40:51 -- setup/devices.sh@197 -- # declare -A blocks_to_pci 00:03:00.253 22:40:51 -- setup/devices.sh@198 -- # min_disk_size=3221225472 00:03:00.253 22:40:51 -- setup/devices.sh@200 -- # for block in "/sys/block/nvme"!(*c*) 00:03:00.253 22:40:51 -- setup/devices.sh@201 -- # ctrl=nvme0n1 00:03:00.253 22:40:51 -- setup/devices.sh@201 -- # ctrl=nvme0 00:03:00.253 22:40:51 -- setup/devices.sh@202 -- # pci=0000:88:00.0 00:03:00.253 22:40:51 -- setup/devices.sh@203 -- # [[ '' == *\0\0\0\0\:\8\8\:\0\0\.\0* ]] 00:03:00.253 22:40:51 -- setup/devices.sh@204 -- # block_in_use nvme0n1 00:03:00.253 22:40:51 -- scripts/common.sh@380 -- # local block=nvme0n1 pt 00:03:00.253 22:40:51 -- scripts/common.sh@389 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/spdk-gpt.py nvme0n1 00:03:00.253 No valid GPT data, bailing 00:03:00.253 22:40:51 -- scripts/common.sh@393 -- # blkid -s PTTYPE -o value /dev/nvme0n1 00:03:00.253 22:40:51 -- scripts/common.sh@393 -- # pt= 00:03:00.253 22:40:51 -- scripts/common.sh@394 -- # return 1 00:03:00.253 22:40:51 -- setup/devices.sh@204 -- # sec_size_to_bytes nvme0n1 00:03:00.253 22:40:51 -- setup/common.sh@76 -- # local dev=nvme0n1 00:03:00.253 22:40:51 -- setup/common.sh@78 -- # [[ -e /sys/block/nvme0n1 ]] 00:03:00.253 22:40:51 -- setup/common.sh@80 -- # echo 1000204886016 00:03:00.253 22:40:51 -- setup/devices.sh@204 -- # (( 1000204886016 >= min_disk_size )) 00:03:00.253 22:40:51 -- setup/devices.sh@205 -- # blocks+=("${block##*/}") 00:03:00.253 22:40:51 -- setup/devices.sh@206 -- # blocks_to_pci["${block##*/}"]=0000:88:00.0 00:03:00.253 22:40:51 -- setup/devices.sh@209 -- # (( 1 > 0 )) 00:03:00.253 22:40:51 -- setup/devices.sh@211 -- # declare -r test_disk=nvme0n1 00:03:00.253 22:40:51 -- setup/devices.sh@213 -- # run_test nvme_mount nvme_mount 00:03:00.253 22:40:51 -- common/autotest_common.sh@1077 -- # '[' 2 -le 1 ']' 00:03:00.253 22:40:51 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:03:00.253 22:40:51 -- common/autotest_common.sh@10 -- # set +x 00:03:00.253 ************************************ 00:03:00.253 START TEST nvme_mount 00:03:00.253 ************************************ 00:03:00.253 22:40:51 -- common/autotest_common.sh@1104 -- # nvme_mount 00:03:00.253 22:40:51 -- setup/devices.sh@95 -- # nvme_disk=nvme0n1 00:03:00.253 22:40:51 -- setup/devices.sh@96 -- # nvme_disk_p=nvme0n1p1 00:03:00.253 22:40:51 -- setup/devices.sh@97 -- # nvme_mount=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount 00:03:00.253 22:40:51 -- setup/devices.sh@98 -- # nvme_dummy_test_file=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount/test_nvme 00:03:00.253 22:40:51 -- setup/devices.sh@101 -- # partition_drive nvme0n1 1 00:03:00.253 22:40:51 -- setup/common.sh@39 -- # local disk=nvme0n1 00:03:00.253 22:40:51 -- setup/common.sh@40 -- # local part_no=1 00:03:00.253 22:40:51 -- setup/common.sh@41 -- # local size=1073741824 00:03:00.253 22:40:51 -- setup/common.sh@43 -- # local part part_start=0 part_end=0 00:03:00.253 22:40:51 -- setup/common.sh@44 -- # parts=() 00:03:00.253 22:40:51 -- setup/common.sh@44 -- # local parts 00:03:00.253 22:40:51 -- setup/common.sh@46 -- # (( part = 1 )) 00:03:00.253 22:40:51 -- setup/common.sh@46 -- # (( part <= part_no )) 00:03:00.253 22:40:51 -- setup/common.sh@47 -- # parts+=("${disk}p$part") 00:03:00.253 22:40:51 -- setup/common.sh@46 -- # (( part++ )) 00:03:00.253 22:40:51 -- setup/common.sh@46 -- # (( part <= part_no )) 00:03:00.253 22:40:51 -- setup/common.sh@51 -- # (( size /= 512 )) 00:03:00.253 22:40:51 -- setup/common.sh@56 -- # sgdisk /dev/nvme0n1 --zap-all 00:03:00.253 22:40:51 -- setup/common.sh@53 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/sync_dev_uevents.sh block/partition nvme0n1p1 00:03:01.190 Creating new GPT entries in memory. 00:03:01.190 GPT data structures destroyed! You may now partition the disk using fdisk or 00:03:01.190 other utilities. 00:03:01.190 22:40:52 -- setup/common.sh@57 -- # (( part = 1 )) 00:03:01.190 22:40:52 -- setup/common.sh@57 -- # (( part <= part_no )) 00:03:01.190 22:40:52 -- setup/common.sh@58 -- # (( part_start = part_start == 0 ? 2048 : part_end + 1 )) 00:03:01.190 22:40:52 -- setup/common.sh@59 -- # (( part_end = part_start + size - 1 )) 00:03:01.190 22:40:52 -- setup/common.sh@60 -- # flock /dev/nvme0n1 sgdisk /dev/nvme0n1 --new=1:2048:2099199 00:03:02.568 Creating new GPT entries in memory. 00:03:02.568 The operation has completed successfully. 00:03:02.568 22:40:53 -- setup/common.sh@57 -- # (( part++ )) 00:03:02.568 22:40:53 -- setup/common.sh@57 -- # (( part <= part_no )) 00:03:02.568 22:40:53 -- setup/common.sh@62 -- # wait 141388 00:03:02.568 22:40:53 -- setup/devices.sh@102 -- # mkfs /dev/nvme0n1p1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount 00:03:02.568 22:40:53 -- setup/common.sh@66 -- # local dev=/dev/nvme0n1p1 mount=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount size= 00:03:02.568 22:40:53 -- setup/common.sh@68 -- # mkdir -p /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount 00:03:02.568 22:40:53 -- setup/common.sh@70 -- # [[ -e /dev/nvme0n1p1 ]] 00:03:02.568 22:40:53 -- setup/common.sh@71 -- # mkfs.ext4 -qF /dev/nvme0n1p1 00:03:02.568 22:40:53 -- setup/common.sh@72 -- # mount /dev/nvme0n1p1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount 00:03:02.568 22:40:53 -- setup/devices.sh@105 -- # verify 0000:88:00.0 nvme0n1:nvme0n1p1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount/test_nvme 00:03:02.568 22:40:53 -- setup/devices.sh@48 -- # local dev=0000:88:00.0 00:03:02.568 22:40:53 -- setup/devices.sh@49 -- # local mounts=nvme0n1:nvme0n1p1 00:03:02.568 22:40:53 -- setup/devices.sh@50 -- # local mount_point=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount 00:03:02.568 22:40:53 -- setup/devices.sh@51 -- # local test_file=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount/test_nvme 00:03:02.568 22:40:53 -- setup/devices.sh@53 -- # local found=0 00:03:02.568 22:40:53 -- setup/devices.sh@55 -- # [[ -n /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount/test_nvme ]] 00:03:02.568 22:40:53 -- setup/devices.sh@56 -- # : 00:03:02.568 22:40:53 -- setup/devices.sh@59 -- # local pci status 00:03:02.568 22:40:53 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:02.568 22:40:53 -- setup/devices.sh@47 -- # PCI_ALLOWED=0000:88:00.0 00:03:02.568 22:40:53 -- setup/devices.sh@47 -- # setup output config 00:03:02.568 22:40:53 -- setup/common.sh@9 -- # [[ output == output ]] 00:03:02.568 22:40:53 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh config 00:03:03.505 22:40:54 -- setup/devices.sh@62 -- # [[ 0000:88:00.0 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:03.505 22:40:54 -- setup/devices.sh@62 -- # [[ Active devices: mount@nvme0n1:nvme0n1p1, so not binding PCI dev == *\A\c\t\i\v\e\ \d\e\v\i\c\e\s\:\ *\n\v\m\e\0\n\1\:\n\v\m\e\0\n\1\p\1* ]] 00:03:03.505 22:40:54 -- setup/devices.sh@63 -- # found=1 00:03:03.505 22:40:54 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:03.505 22:40:54 -- setup/devices.sh@62 -- # [[ 0000:00:04.0 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:03.505 22:40:54 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:03.505 22:40:54 -- setup/devices.sh@62 -- # [[ 0000:80:04.0 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:03.505 22:40:54 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:03.505 22:40:54 -- setup/devices.sh@62 -- # [[ 0000:00:04.1 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:03.505 22:40:54 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:03.505 22:40:54 -- setup/devices.sh@62 -- # [[ 0000:80:04.1 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:03.505 22:40:54 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:03.505 22:40:54 -- setup/devices.sh@62 -- # [[ 0000:00:04.2 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:03.505 22:40:54 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:03.505 22:40:54 -- setup/devices.sh@62 -- # [[ 0000:80:04.2 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:03.505 22:40:54 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:03.505 22:40:54 -- setup/devices.sh@62 -- # [[ 0000:00:04.3 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:03.505 22:40:54 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:03.505 22:40:54 -- setup/devices.sh@62 -- # [[ 0000:80:04.3 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:03.505 22:40:54 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:03.505 22:40:54 -- setup/devices.sh@62 -- # [[ 0000:00:04.4 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:03.505 22:40:54 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:03.505 22:40:54 -- setup/devices.sh@62 -- # [[ 0000:80:04.4 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:03.505 22:40:54 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:03.505 22:40:54 -- setup/devices.sh@62 -- # [[ 0000:00:04.5 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:03.505 22:40:54 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:03.505 22:40:54 -- setup/devices.sh@62 -- # [[ 0000:80:04.5 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:03.505 22:40:54 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:03.505 22:40:54 -- setup/devices.sh@62 -- # [[ 0000:00:04.6 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:03.505 22:40:54 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:03.505 22:40:54 -- setup/devices.sh@62 -- # [[ 0000:80:04.6 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:03.505 22:40:54 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:03.505 22:40:54 -- setup/devices.sh@62 -- # [[ 0000:00:04.7 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:03.505 22:40:54 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:03.505 22:40:54 -- setup/devices.sh@62 -- # [[ 0000:80:04.7 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:03.505 22:40:54 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:03.505 22:40:54 -- setup/devices.sh@66 -- # (( found == 1 )) 00:03:03.505 22:40:54 -- setup/devices.sh@68 -- # [[ -n /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount ]] 00:03:03.505 22:40:54 -- setup/devices.sh@71 -- # mountpoint -q /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount 00:03:03.505 22:40:54 -- setup/devices.sh@73 -- # [[ -e /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount/test_nvme ]] 00:03:03.505 22:40:54 -- setup/devices.sh@74 -- # rm /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount/test_nvme 00:03:03.505 22:40:54 -- setup/devices.sh@110 -- # cleanup_nvme 00:03:03.505 22:40:54 -- setup/devices.sh@20 -- # mountpoint -q /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount 00:03:03.505 22:40:54 -- setup/devices.sh@21 -- # umount /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount 00:03:03.505 22:40:54 -- setup/devices.sh@24 -- # [[ -b /dev/nvme0n1p1 ]] 00:03:03.505 22:40:54 -- setup/devices.sh@25 -- # wipefs --all /dev/nvme0n1p1 00:03:03.505 /dev/nvme0n1p1: 2 bytes were erased at offset 0x00000438 (ext4): 53 ef 00:03:03.505 22:40:54 -- setup/devices.sh@27 -- # [[ -b /dev/nvme0n1 ]] 00:03:03.505 22:40:54 -- setup/devices.sh@28 -- # wipefs --all /dev/nvme0n1 00:03:03.763 /dev/nvme0n1: 8 bytes were erased at offset 0x00000200 (gpt): 45 46 49 20 50 41 52 54 00:03:03.763 /dev/nvme0n1: 8 bytes were erased at offset 0xe8e0db5e00 (gpt): 45 46 49 20 50 41 52 54 00:03:03.763 /dev/nvme0n1: 2 bytes were erased at offset 0x000001fe (PMBR): 55 aa 00:03:03.763 /dev/nvme0n1: calling ioctl to re-read partition table: Success 00:03:03.763 22:40:54 -- setup/devices.sh@113 -- # mkfs /dev/nvme0n1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount 1024M 00:03:03.763 22:40:54 -- setup/common.sh@66 -- # local dev=/dev/nvme0n1 mount=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount size=1024M 00:03:03.763 22:40:54 -- setup/common.sh@68 -- # mkdir -p /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount 00:03:03.763 22:40:54 -- setup/common.sh@70 -- # [[ -e /dev/nvme0n1 ]] 00:03:03.763 22:40:54 -- setup/common.sh@71 -- # mkfs.ext4 -qF /dev/nvme0n1 1024M 00:03:03.763 22:40:54 -- setup/common.sh@72 -- # mount /dev/nvme0n1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount 00:03:04.021 22:40:54 -- setup/devices.sh@116 -- # verify 0000:88:00.0 nvme0n1:nvme0n1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount/test_nvme 00:03:04.021 22:40:54 -- setup/devices.sh@48 -- # local dev=0000:88:00.0 00:03:04.021 22:40:54 -- setup/devices.sh@49 -- # local mounts=nvme0n1:nvme0n1 00:03:04.021 22:40:54 -- setup/devices.sh@50 -- # local mount_point=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount 00:03:04.021 22:40:54 -- setup/devices.sh@51 -- # local test_file=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount/test_nvme 00:03:04.021 22:40:54 -- setup/devices.sh@53 -- # local found=0 00:03:04.021 22:40:54 -- setup/devices.sh@55 -- # [[ -n /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount/test_nvme ]] 00:03:04.021 22:40:54 -- setup/devices.sh@56 -- # : 00:03:04.021 22:40:54 -- setup/devices.sh@59 -- # local pci status 00:03:04.021 22:40:54 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:04.021 22:40:54 -- setup/devices.sh@47 -- # PCI_ALLOWED=0000:88:00.0 00:03:04.021 22:40:54 -- setup/devices.sh@47 -- # setup output config 00:03:04.021 22:40:54 -- setup/common.sh@9 -- # [[ output == output ]] 00:03:04.021 22:40:54 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh config 00:03:04.955 22:40:55 -- setup/devices.sh@62 -- # [[ 0000:88:00.0 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:04.955 22:40:55 -- setup/devices.sh@62 -- # [[ Active devices: mount@nvme0n1:nvme0n1, so not binding PCI dev == *\A\c\t\i\v\e\ \d\e\v\i\c\e\s\:\ *\n\v\m\e\0\n\1\:\n\v\m\e\0\n\1* ]] 00:03:04.955 22:40:55 -- setup/devices.sh@63 -- # found=1 00:03:04.955 22:40:55 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:04.955 22:40:55 -- setup/devices.sh@62 -- # [[ 0000:00:04.0 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:04.955 22:40:55 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:04.955 22:40:55 -- setup/devices.sh@62 -- # [[ 0000:80:04.0 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:04.955 22:40:55 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:04.955 22:40:55 -- setup/devices.sh@62 -- # [[ 0000:00:04.1 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:04.955 22:40:55 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:04.955 22:40:55 -- setup/devices.sh@62 -- # [[ 0000:80:04.1 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:04.955 22:40:55 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:04.955 22:40:55 -- setup/devices.sh@62 -- # [[ 0000:00:04.2 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:04.955 22:40:55 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:04.955 22:40:55 -- setup/devices.sh@62 -- # [[ 0000:80:04.2 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:04.956 22:40:55 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:04.956 22:40:55 -- setup/devices.sh@62 -- # [[ 0000:00:04.3 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:04.956 22:40:55 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:04.956 22:40:55 -- setup/devices.sh@62 -- # [[ 0000:80:04.3 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:04.956 22:40:55 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:04.956 22:40:56 -- setup/devices.sh@62 -- # [[ 0000:00:04.4 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:04.956 22:40:56 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:04.956 22:40:56 -- setup/devices.sh@62 -- # [[ 0000:80:04.4 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:04.956 22:40:56 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:04.956 22:40:56 -- setup/devices.sh@62 -- # [[ 0000:00:04.5 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:04.956 22:40:56 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:04.956 22:40:56 -- setup/devices.sh@62 -- # [[ 0000:80:04.5 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:04.956 22:40:56 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:04.956 22:40:56 -- setup/devices.sh@62 -- # [[ 0000:00:04.6 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:04.956 22:40:56 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:04.956 22:40:56 -- setup/devices.sh@62 -- # [[ 0000:80:04.6 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:04.956 22:40:56 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:04.956 22:40:56 -- setup/devices.sh@62 -- # [[ 0000:00:04.7 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:04.956 22:40:56 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:04.956 22:40:56 -- setup/devices.sh@62 -- # [[ 0000:80:04.7 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:04.956 22:40:56 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:05.213 22:40:56 -- setup/devices.sh@66 -- # (( found == 1 )) 00:03:05.213 22:40:56 -- setup/devices.sh@68 -- # [[ -n /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount ]] 00:03:05.213 22:40:56 -- setup/devices.sh@71 -- # mountpoint -q /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount 00:03:05.213 22:40:56 -- setup/devices.sh@73 -- # [[ -e /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount/test_nvme ]] 00:03:05.213 22:40:56 -- setup/devices.sh@74 -- # rm /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount/test_nvme 00:03:05.213 22:40:56 -- setup/devices.sh@123 -- # umount /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount 00:03:05.213 22:40:56 -- setup/devices.sh@125 -- # verify 0000:88:00.0 data@nvme0n1 '' '' 00:03:05.213 22:40:56 -- setup/devices.sh@48 -- # local dev=0000:88:00.0 00:03:05.213 22:40:56 -- setup/devices.sh@49 -- # local mounts=data@nvme0n1 00:03:05.213 22:40:56 -- setup/devices.sh@50 -- # local mount_point= 00:03:05.213 22:40:56 -- setup/devices.sh@51 -- # local test_file= 00:03:05.213 22:40:56 -- setup/devices.sh@53 -- # local found=0 00:03:05.213 22:40:56 -- setup/devices.sh@55 -- # [[ -n '' ]] 00:03:05.213 22:40:56 -- setup/devices.sh@59 -- # local pci status 00:03:05.213 22:40:56 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:05.213 22:40:56 -- setup/devices.sh@47 -- # PCI_ALLOWED=0000:88:00.0 00:03:05.213 22:40:56 -- setup/devices.sh@47 -- # setup output config 00:03:05.213 22:40:56 -- setup/common.sh@9 -- # [[ output == output ]] 00:03:05.213 22:40:56 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh config 00:03:06.147 22:40:57 -- setup/devices.sh@62 -- # [[ 0000:88:00.0 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:06.147 22:40:57 -- setup/devices.sh@62 -- # [[ Active devices: data@nvme0n1, so not binding PCI dev == *\A\c\t\i\v\e\ \d\e\v\i\c\e\s\:\ *\d\a\t\a\@\n\v\m\e\0\n\1* ]] 00:03:06.147 22:40:57 -- setup/devices.sh@63 -- # found=1 00:03:06.148 22:40:57 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:06.148 22:40:57 -- setup/devices.sh@62 -- # [[ 0000:00:04.0 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:06.148 22:40:57 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:06.148 22:40:57 -- setup/devices.sh@62 -- # [[ 0000:80:04.0 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:06.148 22:40:57 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:06.148 22:40:57 -- setup/devices.sh@62 -- # [[ 0000:00:04.1 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:06.148 22:40:57 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:06.148 22:40:57 -- setup/devices.sh@62 -- # [[ 0000:80:04.1 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:06.148 22:40:57 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:06.148 22:40:57 -- setup/devices.sh@62 -- # [[ 0000:00:04.2 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:06.148 22:40:57 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:06.148 22:40:57 -- setup/devices.sh@62 -- # [[ 0000:80:04.2 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:06.148 22:40:57 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:06.148 22:40:57 -- setup/devices.sh@62 -- # [[ 0000:00:04.3 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:06.148 22:40:57 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:06.148 22:40:57 -- setup/devices.sh@62 -- # [[ 0000:80:04.3 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:06.148 22:40:57 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:06.148 22:40:57 -- setup/devices.sh@62 -- # [[ 0000:00:04.4 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:06.148 22:40:57 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:06.148 22:40:57 -- setup/devices.sh@62 -- # [[ 0000:80:04.4 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:06.148 22:40:57 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:06.148 22:40:57 -- setup/devices.sh@62 -- # [[ 0000:00:04.5 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:06.148 22:40:57 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:06.406 22:40:57 -- setup/devices.sh@62 -- # [[ 0000:80:04.5 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:06.406 22:40:57 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:06.406 22:40:57 -- setup/devices.sh@62 -- # [[ 0000:00:04.6 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:06.406 22:40:57 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:06.406 22:40:57 -- setup/devices.sh@62 -- # [[ 0000:80:04.6 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:06.406 22:40:57 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:06.406 22:40:57 -- setup/devices.sh@62 -- # [[ 0000:00:04.7 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:06.406 22:40:57 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:06.406 22:40:57 -- setup/devices.sh@62 -- # [[ 0000:80:04.7 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:06.406 22:40:57 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:06.406 22:40:57 -- setup/devices.sh@66 -- # (( found == 1 )) 00:03:06.406 22:40:57 -- setup/devices.sh@68 -- # [[ -n '' ]] 00:03:06.406 22:40:57 -- setup/devices.sh@68 -- # return 0 00:03:06.406 22:40:57 -- setup/devices.sh@128 -- # cleanup_nvme 00:03:06.406 22:40:57 -- setup/devices.sh@20 -- # mountpoint -q /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount 00:03:06.406 22:40:57 -- setup/devices.sh@24 -- # [[ -b /dev/nvme0n1p1 ]] 00:03:06.406 22:40:57 -- setup/devices.sh@27 -- # [[ -b /dev/nvme0n1 ]] 00:03:06.406 22:40:57 -- setup/devices.sh@28 -- # wipefs --all /dev/nvme0n1 00:03:06.406 /dev/nvme0n1: 2 bytes were erased at offset 0x00000438 (ext4): 53 ef 00:03:06.406 00:03:06.406 real 0m6.183s 00:03:06.406 user 0m1.438s 00:03:06.406 sys 0m2.327s 00:03:06.406 22:40:57 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:03:06.406 22:40:57 -- common/autotest_common.sh@10 -- # set +x 00:03:06.406 ************************************ 00:03:06.406 END TEST nvme_mount 00:03:06.406 ************************************ 00:03:06.406 22:40:57 -- setup/devices.sh@214 -- # run_test dm_mount dm_mount 00:03:06.406 22:40:57 -- common/autotest_common.sh@1077 -- # '[' 2 -le 1 ']' 00:03:06.406 22:40:57 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:03:06.406 22:40:57 -- common/autotest_common.sh@10 -- # set +x 00:03:06.406 ************************************ 00:03:06.406 START TEST dm_mount 00:03:06.406 ************************************ 00:03:06.406 22:40:57 -- common/autotest_common.sh@1104 -- # dm_mount 00:03:06.406 22:40:57 -- setup/devices.sh@144 -- # pv=nvme0n1 00:03:06.406 22:40:57 -- setup/devices.sh@145 -- # pv0=nvme0n1p1 00:03:06.406 22:40:57 -- setup/devices.sh@146 -- # pv1=nvme0n1p2 00:03:06.406 22:40:57 -- setup/devices.sh@148 -- # partition_drive nvme0n1 00:03:06.406 22:40:57 -- setup/common.sh@39 -- # local disk=nvme0n1 00:03:06.406 22:40:57 -- setup/common.sh@40 -- # local part_no=2 00:03:06.406 22:40:57 -- setup/common.sh@41 -- # local size=1073741824 00:03:06.406 22:40:57 -- setup/common.sh@43 -- # local part part_start=0 part_end=0 00:03:06.406 22:40:57 -- setup/common.sh@44 -- # parts=() 00:03:06.406 22:40:57 -- setup/common.sh@44 -- # local parts 00:03:06.406 22:40:57 -- setup/common.sh@46 -- # (( part = 1 )) 00:03:06.406 22:40:57 -- setup/common.sh@46 -- # (( part <= part_no )) 00:03:06.406 22:40:57 -- setup/common.sh@47 -- # parts+=("${disk}p$part") 00:03:06.406 22:40:57 -- setup/common.sh@46 -- # (( part++ )) 00:03:06.406 22:40:57 -- setup/common.sh@46 -- # (( part <= part_no )) 00:03:06.406 22:40:57 -- setup/common.sh@47 -- # parts+=("${disk}p$part") 00:03:06.406 22:40:57 -- setup/common.sh@46 -- # (( part++ )) 00:03:06.406 22:40:57 -- setup/common.sh@46 -- # (( part <= part_no )) 00:03:06.406 22:40:57 -- setup/common.sh@51 -- # (( size /= 512 )) 00:03:06.406 22:40:57 -- setup/common.sh@56 -- # sgdisk /dev/nvme0n1 --zap-all 00:03:06.406 22:40:57 -- setup/common.sh@53 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/sync_dev_uevents.sh block/partition nvme0n1p1 nvme0n1p2 00:03:07.783 Creating new GPT entries in memory. 00:03:07.783 GPT data structures destroyed! You may now partition the disk using fdisk or 00:03:07.783 other utilities. 00:03:07.783 22:40:58 -- setup/common.sh@57 -- # (( part = 1 )) 00:03:07.783 22:40:58 -- setup/common.sh@57 -- # (( part <= part_no )) 00:03:07.783 22:40:58 -- setup/common.sh@58 -- # (( part_start = part_start == 0 ? 2048 : part_end + 1 )) 00:03:07.783 22:40:58 -- setup/common.sh@59 -- # (( part_end = part_start + size - 1 )) 00:03:07.783 22:40:58 -- setup/common.sh@60 -- # flock /dev/nvme0n1 sgdisk /dev/nvme0n1 --new=1:2048:2099199 00:03:08.718 Creating new GPT entries in memory. 00:03:08.718 The operation has completed successfully. 00:03:08.718 22:40:59 -- setup/common.sh@57 -- # (( part++ )) 00:03:08.718 22:40:59 -- setup/common.sh@57 -- # (( part <= part_no )) 00:03:08.718 22:40:59 -- setup/common.sh@58 -- # (( part_start = part_start == 0 ? 2048 : part_end + 1 )) 00:03:08.718 22:40:59 -- setup/common.sh@59 -- # (( part_end = part_start + size - 1 )) 00:03:08.718 22:40:59 -- setup/common.sh@60 -- # flock /dev/nvme0n1 sgdisk /dev/nvme0n1 --new=2:2099200:4196351 00:03:09.652 The operation has completed successfully. 00:03:09.652 22:41:00 -- setup/common.sh@57 -- # (( part++ )) 00:03:09.652 22:41:00 -- setup/common.sh@57 -- # (( part <= part_no )) 00:03:09.652 22:41:00 -- setup/common.sh@62 -- # wait 143779 00:03:09.652 22:41:00 -- setup/devices.sh@150 -- # dm_name=nvme_dm_test 00:03:09.652 22:41:00 -- setup/devices.sh@151 -- # dm_mount=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount 00:03:09.652 22:41:00 -- setup/devices.sh@152 -- # dm_dummy_test_file=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount/test_dm 00:03:09.652 22:41:00 -- setup/devices.sh@155 -- # dmsetup create nvme_dm_test 00:03:09.652 22:41:00 -- setup/devices.sh@160 -- # for t in {1..5} 00:03:09.652 22:41:00 -- setup/devices.sh@161 -- # [[ -e /dev/mapper/nvme_dm_test ]] 00:03:09.652 22:41:00 -- setup/devices.sh@161 -- # break 00:03:09.652 22:41:00 -- setup/devices.sh@164 -- # [[ -e /dev/mapper/nvme_dm_test ]] 00:03:09.652 22:41:00 -- setup/devices.sh@165 -- # readlink -f /dev/mapper/nvme_dm_test 00:03:09.652 22:41:00 -- setup/devices.sh@165 -- # dm=/dev/dm-0 00:03:09.652 22:41:00 -- setup/devices.sh@166 -- # dm=dm-0 00:03:09.652 22:41:00 -- setup/devices.sh@168 -- # [[ -e /sys/class/block/nvme0n1p1/holders/dm-0 ]] 00:03:09.652 22:41:00 -- setup/devices.sh@169 -- # [[ -e /sys/class/block/nvme0n1p2/holders/dm-0 ]] 00:03:09.652 22:41:00 -- setup/devices.sh@171 -- # mkfs /dev/mapper/nvme_dm_test /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount 00:03:09.652 22:41:00 -- setup/common.sh@66 -- # local dev=/dev/mapper/nvme_dm_test mount=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount size= 00:03:09.652 22:41:00 -- setup/common.sh@68 -- # mkdir -p /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount 00:03:09.652 22:41:00 -- setup/common.sh@70 -- # [[ -e /dev/mapper/nvme_dm_test ]] 00:03:09.652 22:41:00 -- setup/common.sh@71 -- # mkfs.ext4 -qF /dev/mapper/nvme_dm_test 00:03:09.652 22:41:00 -- setup/common.sh@72 -- # mount /dev/mapper/nvme_dm_test /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount 00:03:09.652 22:41:00 -- setup/devices.sh@174 -- # verify 0000:88:00.0 nvme0n1:nvme_dm_test /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount/test_dm 00:03:09.652 22:41:00 -- setup/devices.sh@48 -- # local dev=0000:88:00.0 00:03:09.652 22:41:00 -- setup/devices.sh@49 -- # local mounts=nvme0n1:nvme_dm_test 00:03:09.652 22:41:00 -- setup/devices.sh@50 -- # local mount_point=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount 00:03:09.652 22:41:00 -- setup/devices.sh@51 -- # local test_file=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount/test_dm 00:03:09.652 22:41:00 -- setup/devices.sh@53 -- # local found=0 00:03:09.652 22:41:00 -- setup/devices.sh@55 -- # [[ -n /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount/test_dm ]] 00:03:09.652 22:41:00 -- setup/devices.sh@56 -- # : 00:03:09.652 22:41:00 -- setup/devices.sh@59 -- # local pci status 00:03:09.652 22:41:00 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:09.652 22:41:00 -- setup/devices.sh@47 -- # PCI_ALLOWED=0000:88:00.0 00:03:09.652 22:41:00 -- setup/devices.sh@47 -- # setup output config 00:03:09.652 22:41:00 -- setup/common.sh@9 -- # [[ output == output ]] 00:03:09.652 22:41:00 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh config 00:03:10.585 22:41:01 -- setup/devices.sh@62 -- # [[ 0000:88:00.0 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:10.585 22:41:01 -- setup/devices.sh@62 -- # [[ Active devices: holder@nvme0n1p1:dm-0,holder@nvme0n1p2:dm-0,mount@nvme0n1:nvme_dm_test, so not binding PCI dev == *\A\c\t\i\v\e\ \d\e\v\i\c\e\s\:\ *\n\v\m\e\0\n\1\:\n\v\m\e\_\d\m\_\t\e\s\t* ]] 00:03:10.585 22:41:01 -- setup/devices.sh@63 -- # found=1 00:03:10.585 22:41:01 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:10.585 22:41:01 -- setup/devices.sh@62 -- # [[ 0000:00:04.0 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:10.585 22:41:01 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:10.585 22:41:01 -- setup/devices.sh@62 -- # [[ 0000:80:04.0 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:10.585 22:41:01 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:10.585 22:41:01 -- setup/devices.sh@62 -- # [[ 0000:00:04.1 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:10.585 22:41:01 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:10.585 22:41:01 -- setup/devices.sh@62 -- # [[ 0000:80:04.1 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:10.585 22:41:01 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:10.585 22:41:01 -- setup/devices.sh@62 -- # [[ 0000:00:04.2 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:10.585 22:41:01 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:10.585 22:41:01 -- setup/devices.sh@62 -- # [[ 0000:80:04.2 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:10.585 22:41:01 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:10.585 22:41:01 -- setup/devices.sh@62 -- # [[ 0000:00:04.3 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:10.585 22:41:01 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:10.585 22:41:01 -- setup/devices.sh@62 -- # [[ 0000:80:04.3 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:10.585 22:41:01 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:10.585 22:41:01 -- setup/devices.sh@62 -- # [[ 0000:00:04.4 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:10.585 22:41:01 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:10.585 22:41:01 -- setup/devices.sh@62 -- # [[ 0000:80:04.4 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:10.585 22:41:01 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:10.585 22:41:01 -- setup/devices.sh@62 -- # [[ 0000:00:04.5 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:10.585 22:41:01 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:10.585 22:41:01 -- setup/devices.sh@62 -- # [[ 0000:80:04.5 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:10.585 22:41:01 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:10.585 22:41:01 -- setup/devices.sh@62 -- # [[ 0000:00:04.6 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:10.585 22:41:01 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:10.585 22:41:01 -- setup/devices.sh@62 -- # [[ 0000:80:04.6 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:10.585 22:41:01 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:10.585 22:41:01 -- setup/devices.sh@62 -- # [[ 0000:00:04.7 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:10.585 22:41:01 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:10.585 22:41:01 -- setup/devices.sh@62 -- # [[ 0000:80:04.7 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:10.585 22:41:01 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:10.844 22:41:01 -- setup/devices.sh@66 -- # (( found == 1 )) 00:03:10.844 22:41:01 -- setup/devices.sh@68 -- # [[ -n /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount ]] 00:03:10.844 22:41:01 -- setup/devices.sh@71 -- # mountpoint -q /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount 00:03:10.844 22:41:01 -- setup/devices.sh@73 -- # [[ -e /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount/test_dm ]] 00:03:10.844 22:41:01 -- setup/devices.sh@74 -- # rm /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount/test_dm 00:03:10.844 22:41:01 -- setup/devices.sh@182 -- # umount /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount 00:03:10.844 22:41:01 -- setup/devices.sh@184 -- # verify 0000:88:00.0 holder@nvme0n1p1:dm-0,holder@nvme0n1p2:dm-0 '' '' 00:03:10.844 22:41:01 -- setup/devices.sh@48 -- # local dev=0000:88:00.0 00:03:10.844 22:41:01 -- setup/devices.sh@49 -- # local mounts=holder@nvme0n1p1:dm-0,holder@nvme0n1p2:dm-0 00:03:10.844 22:41:01 -- setup/devices.sh@50 -- # local mount_point= 00:03:10.844 22:41:01 -- setup/devices.sh@51 -- # local test_file= 00:03:10.844 22:41:01 -- setup/devices.sh@53 -- # local found=0 00:03:10.844 22:41:01 -- setup/devices.sh@55 -- # [[ -n '' ]] 00:03:10.844 22:41:01 -- setup/devices.sh@59 -- # local pci status 00:03:10.844 22:41:01 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:10.844 22:41:01 -- setup/devices.sh@47 -- # PCI_ALLOWED=0000:88:00.0 00:03:10.844 22:41:01 -- setup/devices.sh@47 -- # setup output config 00:03:10.844 22:41:01 -- setup/common.sh@9 -- # [[ output == output ]] 00:03:10.844 22:41:01 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh config 00:03:11.831 22:41:02 -- setup/devices.sh@62 -- # [[ 0000:88:00.0 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:11.831 22:41:02 -- setup/devices.sh@62 -- # [[ Active devices: holder@nvme0n1p1:dm-0,holder@nvme0n1p2:dm-0, so not binding PCI dev == *\A\c\t\i\v\e\ \d\e\v\i\c\e\s\:\ *\h\o\l\d\e\r\@\n\v\m\e\0\n\1\p\1\:\d\m\-\0\,\h\o\l\d\e\r\@\n\v\m\e\0\n\1\p\2\:\d\m\-\0* ]] 00:03:11.831 22:41:02 -- setup/devices.sh@63 -- # found=1 00:03:11.831 22:41:02 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:11.831 22:41:02 -- setup/devices.sh@62 -- # [[ 0000:00:04.0 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:11.831 22:41:02 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:11.831 22:41:02 -- setup/devices.sh@62 -- # [[ 0000:80:04.0 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:11.831 22:41:02 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:11.831 22:41:02 -- setup/devices.sh@62 -- # [[ 0000:00:04.1 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:11.831 22:41:02 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:11.831 22:41:02 -- setup/devices.sh@62 -- # [[ 0000:80:04.1 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:11.831 22:41:02 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:11.831 22:41:02 -- setup/devices.sh@62 -- # [[ 0000:00:04.2 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:11.831 22:41:02 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:11.831 22:41:02 -- setup/devices.sh@62 -- # [[ 0000:80:04.2 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:11.831 22:41:02 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:11.831 22:41:02 -- setup/devices.sh@62 -- # [[ 0000:00:04.3 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:11.831 22:41:02 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:11.831 22:41:02 -- setup/devices.sh@62 -- # [[ 0000:80:04.3 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:11.831 22:41:02 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:11.831 22:41:02 -- setup/devices.sh@62 -- # [[ 0000:00:04.4 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:11.831 22:41:02 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:11.831 22:41:02 -- setup/devices.sh@62 -- # [[ 0000:80:04.4 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:11.831 22:41:02 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:11.831 22:41:02 -- setup/devices.sh@62 -- # [[ 0000:00:04.5 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:11.831 22:41:02 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:11.831 22:41:02 -- setup/devices.sh@62 -- # [[ 0000:80:04.5 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:11.831 22:41:02 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:11.831 22:41:02 -- setup/devices.sh@62 -- # [[ 0000:00:04.6 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:11.831 22:41:02 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:11.831 22:41:02 -- setup/devices.sh@62 -- # [[ 0000:80:04.6 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:11.831 22:41:02 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:11.831 22:41:02 -- setup/devices.sh@62 -- # [[ 0000:00:04.7 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:11.831 22:41:02 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:11.831 22:41:02 -- setup/devices.sh@62 -- # [[ 0000:80:04.7 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:11.831 22:41:02 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:12.091 22:41:03 -- setup/devices.sh@66 -- # (( found == 1 )) 00:03:12.091 22:41:03 -- setup/devices.sh@68 -- # [[ -n '' ]] 00:03:12.091 22:41:03 -- setup/devices.sh@68 -- # return 0 00:03:12.091 22:41:03 -- setup/devices.sh@187 -- # cleanup_dm 00:03:12.091 22:41:03 -- setup/devices.sh@33 -- # mountpoint -q /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount 00:03:12.091 22:41:03 -- setup/devices.sh@36 -- # [[ -L /dev/mapper/nvme_dm_test ]] 00:03:12.091 22:41:03 -- setup/devices.sh@37 -- # dmsetup remove --force nvme_dm_test 00:03:12.091 22:41:03 -- setup/devices.sh@39 -- # [[ -b /dev/nvme0n1p1 ]] 00:03:12.091 22:41:03 -- setup/devices.sh@40 -- # wipefs --all /dev/nvme0n1p1 00:03:12.091 /dev/nvme0n1p1: 2 bytes were erased at offset 0x00000438 (ext4): 53 ef 00:03:12.091 22:41:03 -- setup/devices.sh@42 -- # [[ -b /dev/nvme0n1p2 ]] 00:03:12.091 22:41:03 -- setup/devices.sh@43 -- # wipefs --all /dev/nvme0n1p2 00:03:12.091 00:03:12.091 real 0m5.609s 00:03:12.091 user 0m0.968s 00:03:12.091 sys 0m1.528s 00:03:12.091 22:41:03 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:03:12.091 22:41:03 -- common/autotest_common.sh@10 -- # set +x 00:03:12.091 ************************************ 00:03:12.091 END TEST dm_mount 00:03:12.091 ************************************ 00:03:12.091 22:41:03 -- setup/devices.sh@1 -- # cleanup 00:03:12.091 22:41:03 -- setup/devices.sh@11 -- # cleanup_nvme 00:03:12.091 22:41:03 -- setup/devices.sh@20 -- # mountpoint -q /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount 00:03:12.091 22:41:03 -- setup/devices.sh@24 -- # [[ -b /dev/nvme0n1p1 ]] 00:03:12.091 22:41:03 -- setup/devices.sh@25 -- # wipefs --all /dev/nvme0n1p1 00:03:12.091 22:41:03 -- setup/devices.sh@27 -- # [[ -b /dev/nvme0n1 ]] 00:03:12.091 22:41:03 -- setup/devices.sh@28 -- # wipefs --all /dev/nvme0n1 00:03:12.350 /dev/nvme0n1: 8 bytes were erased at offset 0x00000200 (gpt): 45 46 49 20 50 41 52 54 00:03:12.350 /dev/nvme0n1: 8 bytes were erased at offset 0xe8e0db5e00 (gpt): 45 46 49 20 50 41 52 54 00:03:12.350 /dev/nvme0n1: 2 bytes were erased at offset 0x000001fe (PMBR): 55 aa 00:03:12.350 /dev/nvme0n1: calling ioctl to re-read partition table: Success 00:03:12.350 22:41:03 -- setup/devices.sh@12 -- # cleanup_dm 00:03:12.350 22:41:03 -- setup/devices.sh@33 -- # mountpoint -q /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount 00:03:12.350 22:41:03 -- setup/devices.sh@36 -- # [[ -L /dev/mapper/nvme_dm_test ]] 00:03:12.350 22:41:03 -- setup/devices.sh@39 -- # [[ -b /dev/nvme0n1p1 ]] 00:03:12.350 22:41:03 -- setup/devices.sh@42 -- # [[ -b /dev/nvme0n1p2 ]] 00:03:12.350 22:41:03 -- setup/devices.sh@14 -- # [[ -b /dev/nvme0n1 ]] 00:03:12.350 22:41:03 -- setup/devices.sh@15 -- # wipefs --all /dev/nvme0n1 00:03:12.350 00:03:12.350 real 0m13.682s 00:03:12.350 user 0m3.066s 00:03:12.350 sys 0m4.853s 00:03:12.350 22:41:03 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:03:12.350 22:41:03 -- common/autotest_common.sh@10 -- # set +x 00:03:12.350 ************************************ 00:03:12.350 END TEST devices 00:03:12.350 ************************************ 00:03:12.350 00:03:12.350 real 0m41.786s 00:03:12.350 user 0m11.954s 00:03:12.350 sys 0m18.396s 00:03:12.350 22:41:03 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:03:12.350 22:41:03 -- common/autotest_common.sh@10 -- # set +x 00:03:12.350 ************************************ 00:03:12.350 END TEST setup.sh 00:03:12.350 ************************************ 00:03:12.350 22:41:03 -- spdk/autotest.sh@139 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh status 00:03:13.295 Hugepages 00:03:13.295 node hugesize free / total 00:03:13.295 node0 1048576kB 0 / 0 00:03:13.295 node0 2048kB 2048 / 2048 00:03:13.295 node1 1048576kB 0 / 0 00:03:13.295 node1 2048kB 0 / 0 00:03:13.295 00:03:13.295 Type BDF Vendor Device NUMA Driver Device Block devices 00:03:13.295 I/OAT 0000:00:04.0 8086 0e20 0 ioatdma - - 00:03:13.295 I/OAT 0000:00:04.1 8086 0e21 0 ioatdma - - 00:03:13.295 I/OAT 0000:00:04.2 8086 0e22 0 ioatdma - - 00:03:13.295 I/OAT 0000:00:04.3 8086 0e23 0 ioatdma - - 00:03:13.295 I/OAT 0000:00:04.4 8086 0e24 0 ioatdma - - 00:03:13.295 I/OAT 0000:00:04.5 8086 0e25 0 ioatdma - - 00:03:13.295 I/OAT 0000:00:04.6 8086 0e26 0 ioatdma - - 00:03:13.295 I/OAT 0000:00:04.7 8086 0e27 0 ioatdma - - 00:03:13.295 I/OAT 0000:80:04.0 8086 0e20 1 ioatdma - - 00:03:13.295 I/OAT 0000:80:04.1 8086 0e21 1 ioatdma - - 00:03:13.296 I/OAT 0000:80:04.2 8086 0e22 1 ioatdma - - 00:03:13.296 I/OAT 0000:80:04.3 8086 0e23 1 ioatdma - - 00:03:13.296 I/OAT 0000:80:04.4 8086 0e24 1 ioatdma - - 00:03:13.296 I/OAT 0000:80:04.5 8086 0e25 1 ioatdma - - 00:03:13.296 I/OAT 0000:80:04.6 8086 0e26 1 ioatdma - - 00:03:13.296 I/OAT 0000:80:04.7 8086 0e27 1 ioatdma - - 00:03:13.562 NVMe 0000:88:00.0 8086 0a54 1 nvme nvme0 nvme0n1 00:03:13.562 22:41:04 -- spdk/autotest.sh@141 -- # uname -s 00:03:13.562 22:41:04 -- spdk/autotest.sh@141 -- # [[ Linux == Linux ]] 00:03:13.562 22:41:04 -- spdk/autotest.sh@143 -- # nvme_namespace_revert 00:03:13.562 22:41:04 -- common/autotest_common.sh@1516 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh 00:03:14.497 0000:00:04.7 (8086 0e27): ioatdma -> vfio-pci 00:03:14.497 0000:00:04.6 (8086 0e26): ioatdma -> vfio-pci 00:03:14.497 0000:00:04.5 (8086 0e25): ioatdma -> vfio-pci 00:03:14.497 0000:00:04.4 (8086 0e24): ioatdma -> vfio-pci 00:03:14.497 0000:00:04.3 (8086 0e23): ioatdma -> vfio-pci 00:03:14.497 0000:00:04.2 (8086 0e22): ioatdma -> vfio-pci 00:03:14.497 0000:00:04.1 (8086 0e21): ioatdma -> vfio-pci 00:03:14.497 0000:00:04.0 (8086 0e20): ioatdma -> vfio-pci 00:03:14.497 0000:80:04.7 (8086 0e27): ioatdma -> vfio-pci 00:03:14.497 0000:80:04.6 (8086 0e26): ioatdma -> vfio-pci 00:03:14.497 0000:80:04.5 (8086 0e25): ioatdma -> vfio-pci 00:03:14.497 0000:80:04.4 (8086 0e24): ioatdma -> vfio-pci 00:03:14.497 0000:80:04.3 (8086 0e23): ioatdma -> vfio-pci 00:03:14.497 0000:80:04.2 (8086 0e22): ioatdma -> vfio-pci 00:03:14.497 0000:80:04.1 (8086 0e21): ioatdma -> vfio-pci 00:03:14.497 0000:80:04.0 (8086 0e20): ioatdma -> vfio-pci 00:03:15.875 0000:88:00.0 (8086 0a54): nvme -> vfio-pci 00:03:15.875 22:41:06 -- common/autotest_common.sh@1517 -- # sleep 1 00:03:16.811 22:41:07 -- common/autotest_common.sh@1518 -- # bdfs=() 00:03:16.811 22:41:07 -- common/autotest_common.sh@1518 -- # local bdfs 00:03:16.811 22:41:07 -- common/autotest_common.sh@1519 -- # bdfs=($(get_nvme_bdfs)) 00:03:16.811 22:41:07 -- common/autotest_common.sh@1519 -- # get_nvme_bdfs 00:03:16.811 22:41:07 -- common/autotest_common.sh@1498 -- # bdfs=() 00:03:16.811 22:41:07 -- common/autotest_common.sh@1498 -- # local bdfs 00:03:16.811 22:41:07 -- common/autotest_common.sh@1499 -- # bdfs=($("$rootdir/scripts/gen_nvme.sh" | jq -r '.config[].params.traddr')) 00:03:16.811 22:41:07 -- common/autotest_common.sh@1499 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/gen_nvme.sh 00:03:16.811 22:41:07 -- common/autotest_common.sh@1499 -- # jq -r '.config[].params.traddr' 00:03:16.811 22:41:07 -- common/autotest_common.sh@1500 -- # (( 1 == 0 )) 00:03:16.811 22:41:07 -- common/autotest_common.sh@1504 -- # printf '%s\n' 0000:88:00.0 00:03:16.811 22:41:07 -- common/autotest_common.sh@1521 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh reset 00:03:17.744 Waiting for block devices as requested 00:03:18.002 0000:88:00.0 (8086 0a54): vfio-pci -> nvme 00:03:18.002 0000:00:04.7 (8086 0e27): vfio-pci -> ioatdma 00:03:18.002 0000:00:04.6 (8086 0e26): vfio-pci -> ioatdma 00:03:18.002 0000:00:04.5 (8086 0e25): vfio-pci -> ioatdma 00:03:18.260 0000:00:04.4 (8086 0e24): vfio-pci -> ioatdma 00:03:18.260 0000:00:04.3 (8086 0e23): vfio-pci -> ioatdma 00:03:18.260 0000:00:04.2 (8086 0e22): vfio-pci -> ioatdma 00:03:18.260 0000:00:04.1 (8086 0e21): vfio-pci -> ioatdma 00:03:18.518 0000:00:04.0 (8086 0e20): vfio-pci -> ioatdma 00:03:18.518 0000:80:04.7 (8086 0e27): vfio-pci -> ioatdma 00:03:18.518 0000:80:04.6 (8086 0e26): vfio-pci -> ioatdma 00:03:18.518 0000:80:04.5 (8086 0e25): vfio-pci -> ioatdma 00:03:18.776 0000:80:04.4 (8086 0e24): vfio-pci -> ioatdma 00:03:18.776 0000:80:04.3 (8086 0e23): vfio-pci -> ioatdma 00:03:18.776 0000:80:04.2 (8086 0e22): vfio-pci -> ioatdma 00:03:19.035 0000:80:04.1 (8086 0e21): vfio-pci -> ioatdma 00:03:19.035 0000:80:04.0 (8086 0e20): vfio-pci -> ioatdma 00:03:19.035 22:41:10 -- common/autotest_common.sh@1523 -- # for bdf in "${bdfs[@]}" 00:03:19.035 22:41:10 -- common/autotest_common.sh@1524 -- # get_nvme_ctrlr_from_bdf 0000:88:00.0 00:03:19.035 22:41:10 -- common/autotest_common.sh@1487 -- # grep 0000:88:00.0/nvme/nvme 00:03:19.035 22:41:10 -- common/autotest_common.sh@1487 -- # readlink -f /sys/class/nvme/nvme0 00:03:19.035 22:41:10 -- common/autotest_common.sh@1487 -- # bdf_sysfs_path=/sys/devices/pci0000:80/0000:80:03.0/0000:88:00.0/nvme/nvme0 00:03:19.035 22:41:10 -- common/autotest_common.sh@1488 -- # [[ -z /sys/devices/pci0000:80/0000:80:03.0/0000:88:00.0/nvme/nvme0 ]] 00:03:19.035 22:41:10 -- common/autotest_common.sh@1492 -- # basename /sys/devices/pci0000:80/0000:80:03.0/0000:88:00.0/nvme/nvme0 00:03:19.035 22:41:10 -- common/autotest_common.sh@1492 -- # printf '%s\n' nvme0 00:03:19.035 22:41:10 -- common/autotest_common.sh@1524 -- # nvme_ctrlr=/dev/nvme0 00:03:19.035 22:41:10 -- common/autotest_common.sh@1525 -- # [[ -z /dev/nvme0 ]] 00:03:19.035 22:41:10 -- common/autotest_common.sh@1530 -- # nvme id-ctrl /dev/nvme0 00:03:19.035 22:41:10 -- common/autotest_common.sh@1530 -- # grep oacs 00:03:19.035 22:41:10 -- common/autotest_common.sh@1530 -- # cut -d: -f2 00:03:19.035 22:41:10 -- common/autotest_common.sh@1530 -- # oacs=' 0xf' 00:03:19.035 22:41:10 -- common/autotest_common.sh@1531 -- # oacs_ns_manage=8 00:03:19.035 22:41:10 -- common/autotest_common.sh@1533 -- # [[ 8 -ne 0 ]] 00:03:19.035 22:41:10 -- common/autotest_common.sh@1539 -- # nvme id-ctrl /dev/nvme0 00:03:19.035 22:41:10 -- common/autotest_common.sh@1539 -- # grep unvmcap 00:03:19.035 22:41:10 -- common/autotest_common.sh@1539 -- # cut -d: -f2 00:03:19.035 22:41:10 -- common/autotest_common.sh@1539 -- # unvmcap=' 0' 00:03:19.035 22:41:10 -- common/autotest_common.sh@1540 -- # [[ 0 -eq 0 ]] 00:03:19.035 22:41:10 -- common/autotest_common.sh@1542 -- # continue 00:03:19.035 22:41:10 -- spdk/autotest.sh@146 -- # timing_exit pre_cleanup 00:03:19.035 22:41:10 -- common/autotest_common.sh@718 -- # xtrace_disable 00:03:19.035 22:41:10 -- common/autotest_common.sh@10 -- # set +x 00:03:19.035 22:41:10 -- spdk/autotest.sh@149 -- # timing_enter afterboot 00:03:19.035 22:41:10 -- common/autotest_common.sh@712 -- # xtrace_disable 00:03:19.035 22:41:10 -- common/autotest_common.sh@10 -- # set +x 00:03:19.035 22:41:10 -- spdk/autotest.sh@150 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh 00:03:20.406 0000:00:04.7 (8086 0e27): ioatdma -> vfio-pci 00:03:20.406 0000:00:04.6 (8086 0e26): ioatdma -> vfio-pci 00:03:20.406 0000:00:04.5 (8086 0e25): ioatdma -> vfio-pci 00:03:20.406 0000:00:04.4 (8086 0e24): ioatdma -> vfio-pci 00:03:20.406 0000:00:04.3 (8086 0e23): ioatdma -> vfio-pci 00:03:20.406 0000:00:04.2 (8086 0e22): ioatdma -> vfio-pci 00:03:20.406 0000:00:04.1 (8086 0e21): ioatdma -> vfio-pci 00:03:20.406 0000:00:04.0 (8086 0e20): ioatdma -> vfio-pci 00:03:20.406 0000:80:04.7 (8086 0e27): ioatdma -> vfio-pci 00:03:20.406 0000:80:04.6 (8086 0e26): ioatdma -> vfio-pci 00:03:20.406 0000:80:04.5 (8086 0e25): ioatdma -> vfio-pci 00:03:20.406 0000:80:04.4 (8086 0e24): ioatdma -> vfio-pci 00:03:20.406 0000:80:04.3 (8086 0e23): ioatdma -> vfio-pci 00:03:20.406 0000:80:04.2 (8086 0e22): ioatdma -> vfio-pci 00:03:20.406 0000:80:04.1 (8086 0e21): ioatdma -> vfio-pci 00:03:20.406 0000:80:04.0 (8086 0e20): ioatdma -> vfio-pci 00:03:21.338 0000:88:00.0 (8086 0a54): nvme -> vfio-pci 00:03:21.338 22:41:12 -- spdk/autotest.sh@151 -- # timing_exit afterboot 00:03:21.338 22:41:12 -- common/autotest_common.sh@718 -- # xtrace_disable 00:03:21.338 22:41:12 -- common/autotest_common.sh@10 -- # set +x 00:03:21.338 22:41:12 -- spdk/autotest.sh@155 -- # opal_revert_cleanup 00:03:21.338 22:41:12 -- common/autotest_common.sh@1576 -- # mapfile -t bdfs 00:03:21.338 22:41:12 -- common/autotest_common.sh@1576 -- # get_nvme_bdfs_by_id 0x0a54 00:03:21.338 22:41:12 -- common/autotest_common.sh@1562 -- # bdfs=() 00:03:21.338 22:41:12 -- common/autotest_common.sh@1562 -- # local bdfs 00:03:21.338 22:41:12 -- common/autotest_common.sh@1564 -- # get_nvme_bdfs 00:03:21.338 22:41:12 -- common/autotest_common.sh@1498 -- # bdfs=() 00:03:21.338 22:41:12 -- common/autotest_common.sh@1498 -- # local bdfs 00:03:21.338 22:41:12 -- common/autotest_common.sh@1499 -- # bdfs=($("$rootdir/scripts/gen_nvme.sh" | jq -r '.config[].params.traddr')) 00:03:21.338 22:41:12 -- common/autotest_common.sh@1499 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/gen_nvme.sh 00:03:21.338 22:41:12 -- common/autotest_common.sh@1499 -- # jq -r '.config[].params.traddr' 00:03:21.338 22:41:12 -- common/autotest_common.sh@1500 -- # (( 1 == 0 )) 00:03:21.338 22:41:12 -- common/autotest_common.sh@1504 -- # printf '%s\n' 0000:88:00.0 00:03:21.594 22:41:12 -- common/autotest_common.sh@1564 -- # for bdf in $(get_nvme_bdfs) 00:03:21.594 22:41:12 -- common/autotest_common.sh@1565 -- # cat /sys/bus/pci/devices/0000:88:00.0/device 00:03:21.594 22:41:12 -- common/autotest_common.sh@1565 -- # device=0x0a54 00:03:21.594 22:41:12 -- common/autotest_common.sh@1566 -- # [[ 0x0a54 == \0\x\0\a\5\4 ]] 00:03:21.594 22:41:12 -- common/autotest_common.sh@1567 -- # bdfs+=($bdf) 00:03:21.594 22:41:12 -- common/autotest_common.sh@1571 -- # printf '%s\n' 0000:88:00.0 00:03:21.594 22:41:12 -- common/autotest_common.sh@1577 -- # [[ -z 0000:88:00.0 ]] 00:03:21.594 22:41:12 -- common/autotest_common.sh@1582 -- # spdk_tgt_pid=149135 00:03:21.594 22:41:12 -- common/autotest_common.sh@1581 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt 00:03:21.594 22:41:12 -- common/autotest_common.sh@1583 -- # waitforlisten 149135 00:03:21.594 22:41:12 -- common/autotest_common.sh@819 -- # '[' -z 149135 ']' 00:03:21.594 22:41:12 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk.sock 00:03:21.594 22:41:12 -- common/autotest_common.sh@824 -- # local max_retries=100 00:03:21.594 22:41:12 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:03:21.595 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:03:21.595 22:41:12 -- common/autotest_common.sh@828 -- # xtrace_disable 00:03:21.595 22:41:12 -- common/autotest_common.sh@10 -- # set +x 00:03:21.595 [2024-04-16 22:41:12.516897] Starting SPDK v24.01.1-pre git sha1 4b134b4ab / DPDK 23.11.0 initialization... 00:03:21.595 [2024-04-16 22:41:12.517000] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid149135 ] 00:03:21.595 EAL: No free 2048 kB hugepages reported on node 1 00:03:21.595 [2024-04-16 22:41:12.581375] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:03:21.595 [2024-04-16 22:41:12.694437] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:03:21.595 [2024-04-16 22:41:12.694628] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:03:22.526 22:41:13 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:03:22.526 22:41:13 -- common/autotest_common.sh@852 -- # return 0 00:03:22.526 22:41:13 -- common/autotest_common.sh@1585 -- # bdf_id=0 00:03:22.526 22:41:13 -- common/autotest_common.sh@1586 -- # for bdf in "${bdfs[@]}" 00:03:22.526 22:41:13 -- common/autotest_common.sh@1587 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_nvme_attach_controller -b nvme0 -t pcie -a 0000:88:00.0 00:03:25.799 nvme0n1 00:03:25.799 22:41:16 -- common/autotest_common.sh@1589 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_nvme_opal_revert -b nvme0 -p test 00:03:25.799 [2024-04-16 22:41:16.715348] nvme_opal.c:2059:spdk_opal_cmd_revert_tper: *ERROR*: Error on starting admin SP session with error 18 00:03:25.799 [2024-04-16 22:41:16.715394] vbdev_opal_rpc.c: 134:rpc_bdev_nvme_opal_revert: *ERROR*: Revert TPer failure: 18 00:03:25.799 request: 00:03:25.799 { 00:03:25.799 "nvme_ctrlr_name": "nvme0", 00:03:25.799 "password": "test", 00:03:25.799 "method": "bdev_nvme_opal_revert", 00:03:25.799 "req_id": 1 00:03:25.799 } 00:03:25.799 Got JSON-RPC error response 00:03:25.799 response: 00:03:25.799 { 00:03:25.799 "code": -32603, 00:03:25.799 "message": "Internal error" 00:03:25.799 } 00:03:25.799 22:41:16 -- common/autotest_common.sh@1589 -- # true 00:03:25.799 22:41:16 -- common/autotest_common.sh@1590 -- # (( ++bdf_id )) 00:03:25.799 22:41:16 -- common/autotest_common.sh@1593 -- # killprocess 149135 00:03:25.799 22:41:16 -- common/autotest_common.sh@926 -- # '[' -z 149135 ']' 00:03:25.799 22:41:16 -- common/autotest_common.sh@930 -- # kill -0 149135 00:03:25.799 22:41:16 -- common/autotest_common.sh@931 -- # uname 00:03:25.799 22:41:16 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:03:25.800 22:41:16 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 149135 00:03:25.800 22:41:16 -- common/autotest_common.sh@932 -- # process_name=reactor_0 00:03:25.800 22:41:16 -- common/autotest_common.sh@936 -- # '[' reactor_0 = sudo ']' 00:03:25.800 22:41:16 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 149135' 00:03:25.800 killing process with pid 149135 00:03:25.800 22:41:16 -- common/autotest_common.sh@945 -- # kill 149135 00:03:25.800 22:41:16 -- common/autotest_common.sh@950 -- # wait 149135 00:03:27.695 22:41:18 -- spdk/autotest.sh@161 -- # '[' 0 -eq 1 ']' 00:03:27.695 22:41:18 -- spdk/autotest.sh@165 -- # '[' 1 -eq 1 ']' 00:03:27.695 22:41:18 -- spdk/autotest.sh@166 -- # [[ 0 -eq 1 ]] 00:03:27.695 22:41:18 -- spdk/autotest.sh@166 -- # [[ 0 -eq 1 ]] 00:03:27.695 22:41:18 -- spdk/autotest.sh@173 -- # timing_enter lib 00:03:27.695 22:41:18 -- common/autotest_common.sh@712 -- # xtrace_disable 00:03:27.695 22:41:18 -- common/autotest_common.sh@10 -- # set +x 00:03:27.695 22:41:18 -- spdk/autotest.sh@175 -- # run_test env /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/env/env.sh 00:03:27.695 22:41:18 -- common/autotest_common.sh@1077 -- # '[' 2 -le 1 ']' 00:03:27.695 22:41:18 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:03:27.695 22:41:18 -- common/autotest_common.sh@10 -- # set +x 00:03:27.695 ************************************ 00:03:27.695 START TEST env 00:03:27.695 ************************************ 00:03:27.695 22:41:18 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/env/env.sh 00:03:27.695 * Looking for test storage... 00:03:27.695 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/env 00:03:27.695 22:41:18 -- env/env.sh@10 -- # run_test env_memory /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/env/memory/memory_ut 00:03:27.695 22:41:18 -- common/autotest_common.sh@1077 -- # '[' 2 -le 1 ']' 00:03:27.695 22:41:18 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:03:27.695 22:41:18 -- common/autotest_common.sh@10 -- # set +x 00:03:27.695 ************************************ 00:03:27.695 START TEST env_memory 00:03:27.695 ************************************ 00:03:27.695 22:41:18 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/env/memory/memory_ut 00:03:27.695 00:03:27.695 00:03:27.695 CUnit - A unit testing framework for C - Version 2.1-3 00:03:27.695 http://cunit.sourceforge.net/ 00:03:27.695 00:03:27.695 00:03:27.695 Suite: memory 00:03:27.695 Test: alloc and free memory map ...[2024-04-16 22:41:18.639779] /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/env_dpdk/memory.c: 283:spdk_mem_map_alloc: *ERROR*: Initial mem_map notify failed 00:03:27.695 passed 00:03:27.695 Test: mem map translation ...[2024-04-16 22:41:18.660484] /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/env_dpdk/memory.c: 590:spdk_mem_map_set_translation: *ERROR*: invalid spdk_mem_map_set_translation parameters, vaddr=2097152 len=1234 00:03:27.695 [2024-04-16 22:41:18.660506] /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/env_dpdk/memory.c: 590:spdk_mem_map_set_translation: *ERROR*: invalid spdk_mem_map_set_translation parameters, vaddr=1234 len=2097152 00:03:27.695 [2024-04-16 22:41:18.660546] /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/env_dpdk/memory.c: 584:spdk_mem_map_set_translation: *ERROR*: invalid usermode virtual address 281474976710656 00:03:27.695 [2024-04-16 22:41:18.660557] /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/env_dpdk/memory.c: 600:spdk_mem_map_set_translation: *ERROR*: could not get 0xffffffe00000 map 00:03:27.695 passed 00:03:27.695 Test: mem map registration ...[2024-04-16 22:41:18.700980] /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/env_dpdk/memory.c: 346:spdk_mem_register: *ERROR*: invalid spdk_mem_register parameters, vaddr=0x200000 len=1234 00:03:27.695 [2024-04-16 22:41:18.700999] /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/env_dpdk/memory.c: 346:spdk_mem_register: *ERROR*: invalid spdk_mem_register parameters, vaddr=0x4d2 len=2097152 00:03:27.695 passed 00:03:27.695 Test: mem map adjacent registrations ...passed 00:03:27.695 00:03:27.695 Run Summary: Type Total Ran Passed Failed Inactive 00:03:27.695 suites 1 1 n/a 0 0 00:03:27.695 tests 4 4 4 0 0 00:03:27.695 asserts 152 152 152 0 n/a 00:03:27.695 00:03:27.695 Elapsed time = 0.139 seconds 00:03:27.695 00:03:27.695 real 0m0.145s 00:03:27.695 user 0m0.137s 00:03:27.695 sys 0m0.008s 00:03:27.695 22:41:18 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:03:27.695 22:41:18 -- common/autotest_common.sh@10 -- # set +x 00:03:27.695 ************************************ 00:03:27.695 END TEST env_memory 00:03:27.695 ************************************ 00:03:27.695 22:41:18 -- env/env.sh@11 -- # run_test env_vtophys /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/env/vtophys/vtophys 00:03:27.695 22:41:18 -- common/autotest_common.sh@1077 -- # '[' 2 -le 1 ']' 00:03:27.695 22:41:18 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:03:27.695 22:41:18 -- common/autotest_common.sh@10 -- # set +x 00:03:27.695 ************************************ 00:03:27.695 START TEST env_vtophys 00:03:27.695 ************************************ 00:03:27.695 22:41:18 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/env/vtophys/vtophys 00:03:27.695 EAL: lib.eal log level changed from notice to debug 00:03:27.695 EAL: Detected lcore 0 as core 0 on socket 0 00:03:27.695 EAL: Detected lcore 1 as core 1 on socket 0 00:03:27.695 EAL: Detected lcore 2 as core 2 on socket 0 00:03:27.695 EAL: Detected lcore 3 as core 3 on socket 0 00:03:27.695 EAL: Detected lcore 4 as core 4 on socket 0 00:03:27.695 EAL: Detected lcore 5 as core 5 on socket 0 00:03:27.695 EAL: Detected lcore 6 as core 8 on socket 0 00:03:27.695 EAL: Detected lcore 7 as core 9 on socket 0 00:03:27.695 EAL: Detected lcore 8 as core 10 on socket 0 00:03:27.695 EAL: Detected lcore 9 as core 11 on socket 0 00:03:27.695 EAL: Detected lcore 10 as core 12 on socket 0 00:03:27.695 EAL: Detected lcore 11 as core 13 on socket 0 00:03:27.695 EAL: Detected lcore 12 as core 0 on socket 1 00:03:27.695 EAL: Detected lcore 13 as core 1 on socket 1 00:03:27.695 EAL: Detected lcore 14 as core 2 on socket 1 00:03:27.695 EAL: Detected lcore 15 as core 3 on socket 1 00:03:27.695 EAL: Detected lcore 16 as core 4 on socket 1 00:03:27.695 EAL: Detected lcore 17 as core 5 on socket 1 00:03:27.695 EAL: Detected lcore 18 as core 8 on socket 1 00:03:27.695 EAL: Detected lcore 19 as core 9 on socket 1 00:03:27.695 EAL: Detected lcore 20 as core 10 on socket 1 00:03:27.696 EAL: Detected lcore 21 as core 11 on socket 1 00:03:27.696 EAL: Detected lcore 22 as core 12 on socket 1 00:03:27.696 EAL: Detected lcore 23 as core 13 on socket 1 00:03:27.696 EAL: Detected lcore 24 as core 0 on socket 0 00:03:27.696 EAL: Detected lcore 25 as core 1 on socket 0 00:03:27.696 EAL: Detected lcore 26 as core 2 on socket 0 00:03:27.696 EAL: Detected lcore 27 as core 3 on socket 0 00:03:27.696 EAL: Detected lcore 28 as core 4 on socket 0 00:03:27.696 EAL: Detected lcore 29 as core 5 on socket 0 00:03:27.696 EAL: Detected lcore 30 as core 8 on socket 0 00:03:27.696 EAL: Detected lcore 31 as core 9 on socket 0 00:03:27.696 EAL: Detected lcore 32 as core 10 on socket 0 00:03:27.696 EAL: Detected lcore 33 as core 11 on socket 0 00:03:27.696 EAL: Detected lcore 34 as core 12 on socket 0 00:03:27.696 EAL: Detected lcore 35 as core 13 on socket 0 00:03:27.696 EAL: Detected lcore 36 as core 0 on socket 1 00:03:27.696 EAL: Detected lcore 37 as core 1 on socket 1 00:03:27.696 EAL: Detected lcore 38 as core 2 on socket 1 00:03:27.696 EAL: Detected lcore 39 as core 3 on socket 1 00:03:27.696 EAL: Detected lcore 40 as core 4 on socket 1 00:03:27.696 EAL: Detected lcore 41 as core 5 on socket 1 00:03:27.696 EAL: Detected lcore 42 as core 8 on socket 1 00:03:27.696 EAL: Detected lcore 43 as core 9 on socket 1 00:03:27.696 EAL: Detected lcore 44 as core 10 on socket 1 00:03:27.696 EAL: Detected lcore 45 as core 11 on socket 1 00:03:27.696 EAL: Detected lcore 46 as core 12 on socket 1 00:03:27.696 EAL: Detected lcore 47 as core 13 on socket 1 00:03:27.696 EAL: Maximum logical cores by configuration: 128 00:03:27.696 EAL: Detected CPU lcores: 48 00:03:27.696 EAL: Detected NUMA nodes: 2 00:03:27.696 EAL: Checking presence of .so 'librte_eal.so.24.0' 00:03:27.696 EAL: Detected shared linkage of DPDK 00:03:27.696 EAL: No shared files mode enabled, IPC will be disabled 00:03:27.696 EAL: Bus pci wants IOVA as 'DC' 00:03:27.696 EAL: Buses did not request a specific IOVA mode. 00:03:27.696 EAL: IOMMU is available, selecting IOVA as VA mode. 00:03:27.696 EAL: Selected IOVA mode 'VA' 00:03:27.696 EAL: No free 2048 kB hugepages reported on node 1 00:03:27.696 EAL: Probing VFIO support... 00:03:27.696 EAL: IOMMU type 1 (Type 1) is supported 00:03:27.696 EAL: IOMMU type 7 (sPAPR) is not supported 00:03:27.696 EAL: IOMMU type 8 (No-IOMMU) is not supported 00:03:27.696 EAL: VFIO support initialized 00:03:27.696 EAL: Ask a virtual area of 0x2e000 bytes 00:03:27.696 EAL: Virtual area found at 0x200000000000 (size = 0x2e000) 00:03:27.696 EAL: Setting up physically contiguous memory... 00:03:27.696 EAL: Setting maximum number of open files to 524288 00:03:27.696 EAL: Detected memory type: socket_id:0 hugepage_sz:2097152 00:03:27.696 EAL: Detected memory type: socket_id:1 hugepage_sz:2097152 00:03:27.696 EAL: Creating 4 segment lists: n_segs:8192 socket_id:0 hugepage_sz:2097152 00:03:27.696 EAL: Ask a virtual area of 0x61000 bytes 00:03:27.696 EAL: Virtual area found at 0x20000002e000 (size = 0x61000) 00:03:27.696 EAL: Memseg list allocated at socket 0, page size 0x800kB 00:03:27.696 EAL: Ask a virtual area of 0x400000000 bytes 00:03:27.696 EAL: Virtual area found at 0x200000200000 (size = 0x400000000) 00:03:27.696 EAL: VA reserved for memseg list at 0x200000200000, size 400000000 00:03:27.696 EAL: Ask a virtual area of 0x61000 bytes 00:03:27.696 EAL: Virtual area found at 0x200400200000 (size = 0x61000) 00:03:27.696 EAL: Memseg list allocated at socket 0, page size 0x800kB 00:03:27.696 EAL: Ask a virtual area of 0x400000000 bytes 00:03:27.696 EAL: Virtual area found at 0x200400400000 (size = 0x400000000) 00:03:27.696 EAL: VA reserved for memseg list at 0x200400400000, size 400000000 00:03:27.696 EAL: Ask a virtual area of 0x61000 bytes 00:03:27.696 EAL: Virtual area found at 0x200800400000 (size = 0x61000) 00:03:27.696 EAL: Memseg list allocated at socket 0, page size 0x800kB 00:03:27.696 EAL: Ask a virtual area of 0x400000000 bytes 00:03:27.696 EAL: Virtual area found at 0x200800600000 (size = 0x400000000) 00:03:27.696 EAL: VA reserved for memseg list at 0x200800600000, size 400000000 00:03:27.696 EAL: Ask a virtual area of 0x61000 bytes 00:03:27.696 EAL: Virtual area found at 0x200c00600000 (size = 0x61000) 00:03:27.696 EAL: Memseg list allocated at socket 0, page size 0x800kB 00:03:27.696 EAL: Ask a virtual area of 0x400000000 bytes 00:03:27.696 EAL: Virtual area found at 0x200c00800000 (size = 0x400000000) 00:03:27.696 EAL: VA reserved for memseg list at 0x200c00800000, size 400000000 00:03:27.696 EAL: Creating 4 segment lists: n_segs:8192 socket_id:1 hugepage_sz:2097152 00:03:27.696 EAL: Ask a virtual area of 0x61000 bytes 00:03:27.696 EAL: Virtual area found at 0x201000800000 (size = 0x61000) 00:03:27.954 EAL: Memseg list allocated at socket 1, page size 0x800kB 00:03:27.954 EAL: Ask a virtual area of 0x400000000 bytes 00:03:27.954 EAL: Virtual area found at 0x201000a00000 (size = 0x400000000) 00:03:27.954 EAL: VA reserved for memseg list at 0x201000a00000, size 400000000 00:03:27.954 EAL: Ask a virtual area of 0x61000 bytes 00:03:27.954 EAL: Virtual area found at 0x201400a00000 (size = 0x61000) 00:03:27.954 EAL: Memseg list allocated at socket 1, page size 0x800kB 00:03:27.954 EAL: Ask a virtual area of 0x400000000 bytes 00:03:27.954 EAL: Virtual area found at 0x201400c00000 (size = 0x400000000) 00:03:27.954 EAL: VA reserved for memseg list at 0x201400c00000, size 400000000 00:03:27.954 EAL: Ask a virtual area of 0x61000 bytes 00:03:27.954 EAL: Virtual area found at 0x201800c00000 (size = 0x61000) 00:03:27.954 EAL: Memseg list allocated at socket 1, page size 0x800kB 00:03:27.954 EAL: Ask a virtual area of 0x400000000 bytes 00:03:27.954 EAL: Virtual area found at 0x201800e00000 (size = 0x400000000) 00:03:27.954 EAL: VA reserved for memseg list at 0x201800e00000, size 400000000 00:03:27.954 EAL: Ask a virtual area of 0x61000 bytes 00:03:27.954 EAL: Virtual area found at 0x201c00e00000 (size = 0x61000) 00:03:27.954 EAL: Memseg list allocated at socket 1, page size 0x800kB 00:03:27.954 EAL: Ask a virtual area of 0x400000000 bytes 00:03:27.954 EAL: Virtual area found at 0x201c01000000 (size = 0x400000000) 00:03:27.954 EAL: VA reserved for memseg list at 0x201c01000000, size 400000000 00:03:27.954 EAL: Hugepages will be freed exactly as allocated. 00:03:27.954 EAL: No shared files mode enabled, IPC is disabled 00:03:27.954 EAL: No shared files mode enabled, IPC is disabled 00:03:27.954 EAL: TSC frequency is ~2700000 KHz 00:03:27.954 EAL: Main lcore 0 is ready (tid=7f32c00c0a00;cpuset=[0]) 00:03:27.954 EAL: Trying to obtain current memory policy. 00:03:27.954 EAL: Setting policy MPOL_PREFERRED for socket 0 00:03:27.954 EAL: Restoring previous memory policy: 0 00:03:27.954 EAL: request: mp_malloc_sync 00:03:27.954 EAL: No shared files mode enabled, IPC is disabled 00:03:27.954 EAL: Heap on socket 0 was expanded by 2MB 00:03:27.954 EAL: No shared files mode enabled, IPC is disabled 00:03:27.954 EAL: No PCI address specified using 'addr=' in: bus=pci 00:03:27.954 EAL: Mem event callback 'spdk:(nil)' registered 00:03:27.954 00:03:27.954 00:03:27.954 CUnit - A unit testing framework for C - Version 2.1-3 00:03:27.954 http://cunit.sourceforge.net/ 00:03:27.954 00:03:27.954 00:03:27.954 Suite: components_suite 00:03:27.954 Test: vtophys_malloc_test ...passed 00:03:27.954 Test: vtophys_spdk_malloc_test ...EAL: Trying to obtain current memory policy. 00:03:27.954 EAL: Setting policy MPOL_PREFERRED for socket 0 00:03:27.954 EAL: Restoring previous memory policy: 4 00:03:27.954 EAL: Calling mem event callback 'spdk:(nil)' 00:03:27.954 EAL: request: mp_malloc_sync 00:03:27.954 EAL: No shared files mode enabled, IPC is disabled 00:03:27.954 EAL: Heap on socket 0 was expanded by 4MB 00:03:27.954 EAL: Calling mem event callback 'spdk:(nil)' 00:03:27.954 EAL: request: mp_malloc_sync 00:03:27.954 EAL: No shared files mode enabled, IPC is disabled 00:03:27.954 EAL: Heap on socket 0 was shrunk by 4MB 00:03:27.954 EAL: Trying to obtain current memory policy. 00:03:27.954 EAL: Setting policy MPOL_PREFERRED for socket 0 00:03:27.954 EAL: Restoring previous memory policy: 4 00:03:27.954 EAL: Calling mem event callback 'spdk:(nil)' 00:03:27.954 EAL: request: mp_malloc_sync 00:03:27.954 EAL: No shared files mode enabled, IPC is disabled 00:03:27.954 EAL: Heap on socket 0 was expanded by 6MB 00:03:27.954 EAL: Calling mem event callback 'spdk:(nil)' 00:03:27.954 EAL: request: mp_malloc_sync 00:03:27.954 EAL: No shared files mode enabled, IPC is disabled 00:03:27.954 EAL: Heap on socket 0 was shrunk by 6MB 00:03:27.954 EAL: Trying to obtain current memory policy. 00:03:27.954 EAL: Setting policy MPOL_PREFERRED for socket 0 00:03:27.954 EAL: Restoring previous memory policy: 4 00:03:27.955 EAL: Calling mem event callback 'spdk:(nil)' 00:03:27.955 EAL: request: mp_malloc_sync 00:03:27.955 EAL: No shared files mode enabled, IPC is disabled 00:03:27.955 EAL: Heap on socket 0 was expanded by 10MB 00:03:27.955 EAL: Calling mem event callback 'spdk:(nil)' 00:03:27.955 EAL: request: mp_malloc_sync 00:03:27.955 EAL: No shared files mode enabled, IPC is disabled 00:03:27.955 EAL: Heap on socket 0 was shrunk by 10MB 00:03:27.955 EAL: Trying to obtain current memory policy. 00:03:27.955 EAL: Setting policy MPOL_PREFERRED for socket 0 00:03:27.955 EAL: Restoring previous memory policy: 4 00:03:27.955 EAL: Calling mem event callback 'spdk:(nil)' 00:03:27.955 EAL: request: mp_malloc_sync 00:03:27.955 EAL: No shared files mode enabled, IPC is disabled 00:03:27.955 EAL: Heap on socket 0 was expanded by 18MB 00:03:27.955 EAL: Calling mem event callback 'spdk:(nil)' 00:03:27.955 EAL: request: mp_malloc_sync 00:03:27.955 EAL: No shared files mode enabled, IPC is disabled 00:03:27.955 EAL: Heap on socket 0 was shrunk by 18MB 00:03:27.955 EAL: Trying to obtain current memory policy. 00:03:27.955 EAL: Setting policy MPOL_PREFERRED for socket 0 00:03:27.955 EAL: Restoring previous memory policy: 4 00:03:27.955 EAL: Calling mem event callback 'spdk:(nil)' 00:03:27.955 EAL: request: mp_malloc_sync 00:03:27.955 EAL: No shared files mode enabled, IPC is disabled 00:03:27.955 EAL: Heap on socket 0 was expanded by 34MB 00:03:27.955 EAL: Calling mem event callback 'spdk:(nil)' 00:03:27.955 EAL: request: mp_malloc_sync 00:03:27.955 EAL: No shared files mode enabled, IPC is disabled 00:03:27.955 EAL: Heap on socket 0 was shrunk by 34MB 00:03:27.955 EAL: Trying to obtain current memory policy. 00:03:27.955 EAL: Setting policy MPOL_PREFERRED for socket 0 00:03:27.955 EAL: Restoring previous memory policy: 4 00:03:27.955 EAL: Calling mem event callback 'spdk:(nil)' 00:03:27.955 EAL: request: mp_malloc_sync 00:03:27.955 EAL: No shared files mode enabled, IPC is disabled 00:03:27.955 EAL: Heap on socket 0 was expanded by 66MB 00:03:27.955 EAL: Calling mem event callback 'spdk:(nil)' 00:03:27.955 EAL: request: mp_malloc_sync 00:03:27.955 EAL: No shared files mode enabled, IPC is disabled 00:03:27.955 EAL: Heap on socket 0 was shrunk by 66MB 00:03:27.955 EAL: Trying to obtain current memory policy. 00:03:27.955 EAL: Setting policy MPOL_PREFERRED for socket 0 00:03:27.955 EAL: Restoring previous memory policy: 4 00:03:27.955 EAL: Calling mem event callback 'spdk:(nil)' 00:03:27.955 EAL: request: mp_malloc_sync 00:03:27.955 EAL: No shared files mode enabled, IPC is disabled 00:03:27.955 EAL: Heap on socket 0 was expanded by 130MB 00:03:27.955 EAL: Calling mem event callback 'spdk:(nil)' 00:03:27.955 EAL: request: mp_malloc_sync 00:03:27.955 EAL: No shared files mode enabled, IPC is disabled 00:03:27.955 EAL: Heap on socket 0 was shrunk by 130MB 00:03:27.955 EAL: Trying to obtain current memory policy. 00:03:27.955 EAL: Setting policy MPOL_PREFERRED for socket 0 00:03:27.955 EAL: Restoring previous memory policy: 4 00:03:27.955 EAL: Calling mem event callback 'spdk:(nil)' 00:03:27.955 EAL: request: mp_malloc_sync 00:03:27.955 EAL: No shared files mode enabled, IPC is disabled 00:03:27.955 EAL: Heap on socket 0 was expanded by 258MB 00:03:28.213 EAL: Calling mem event callback 'spdk:(nil)' 00:03:28.213 EAL: request: mp_malloc_sync 00:03:28.213 EAL: No shared files mode enabled, IPC is disabled 00:03:28.213 EAL: Heap on socket 0 was shrunk by 258MB 00:03:28.213 EAL: Trying to obtain current memory policy. 00:03:28.213 EAL: Setting policy MPOL_PREFERRED for socket 0 00:03:28.213 EAL: Restoring previous memory policy: 4 00:03:28.213 EAL: Calling mem event callback 'spdk:(nil)' 00:03:28.213 EAL: request: mp_malloc_sync 00:03:28.213 EAL: No shared files mode enabled, IPC is disabled 00:03:28.213 EAL: Heap on socket 0 was expanded by 514MB 00:03:28.470 EAL: Calling mem event callback 'spdk:(nil)' 00:03:28.470 EAL: request: mp_malloc_sync 00:03:28.470 EAL: No shared files mode enabled, IPC is disabled 00:03:28.470 EAL: Heap on socket 0 was shrunk by 514MB 00:03:28.470 EAL: Trying to obtain current memory policy. 00:03:28.470 EAL: Setting policy MPOL_PREFERRED for socket 0 00:03:28.727 EAL: Restoring previous memory policy: 4 00:03:28.727 EAL: Calling mem event callback 'spdk:(nil)' 00:03:28.727 EAL: request: mp_malloc_sync 00:03:28.727 EAL: No shared files mode enabled, IPC is disabled 00:03:28.727 EAL: Heap on socket 0 was expanded by 1026MB 00:03:28.985 EAL: Calling mem event callback 'spdk:(nil)' 00:03:29.244 EAL: request: mp_malloc_sync 00:03:29.244 EAL: No shared files mode enabled, IPC is disabled 00:03:29.244 EAL: Heap on socket 0 was shrunk by 1026MB 00:03:29.244 passed 00:03:29.244 00:03:29.244 Run Summary: Type Total Ran Passed Failed Inactive 00:03:29.244 suites 1 1 n/a 0 0 00:03:29.244 tests 2 2 2 0 0 00:03:29.244 asserts 497 497 497 0 n/a 00:03:29.244 00:03:29.244 Elapsed time = 1.356 seconds 00:03:29.244 EAL: Calling mem event callback 'spdk:(nil)' 00:03:29.244 EAL: request: mp_malloc_sync 00:03:29.244 EAL: No shared files mode enabled, IPC is disabled 00:03:29.244 EAL: Heap on socket 0 was shrunk by 2MB 00:03:29.244 EAL: No shared files mode enabled, IPC is disabled 00:03:29.244 EAL: No shared files mode enabled, IPC is disabled 00:03:29.244 EAL: No shared files mode enabled, IPC is disabled 00:03:29.244 00:03:29.244 real 0m1.474s 00:03:29.244 user 0m0.857s 00:03:29.244 sys 0m0.584s 00:03:29.244 22:41:20 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:03:29.244 22:41:20 -- common/autotest_common.sh@10 -- # set +x 00:03:29.244 ************************************ 00:03:29.244 END TEST env_vtophys 00:03:29.244 ************************************ 00:03:29.244 22:41:20 -- env/env.sh@12 -- # run_test env_pci /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/env/pci/pci_ut 00:03:29.244 22:41:20 -- common/autotest_common.sh@1077 -- # '[' 2 -le 1 ']' 00:03:29.244 22:41:20 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:03:29.244 22:41:20 -- common/autotest_common.sh@10 -- # set +x 00:03:29.244 ************************************ 00:03:29.244 START TEST env_pci 00:03:29.244 ************************************ 00:03:29.244 22:41:20 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/env/pci/pci_ut 00:03:29.244 00:03:29.244 00:03:29.244 CUnit - A unit testing framework for C - Version 2.1-3 00:03:29.244 http://cunit.sourceforge.net/ 00:03:29.244 00:03:29.244 00:03:29.244 Suite: pci 00:03:29.244 Test: pci_hook ...[2024-04-16 22:41:20.291258] /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/env_dpdk/pci.c:1040:spdk_pci_device_claim: *ERROR*: Cannot create lock on device /var/tmp/spdk_pci_lock_10000:00:01.0, probably process 150140 has claimed it 00:03:29.244 EAL: Cannot find device (10000:00:01.0) 00:03:29.244 EAL: Failed to attach device on primary process 00:03:29.244 passed 00:03:29.244 00:03:29.244 Run Summary: Type Total Ran Passed Failed Inactive 00:03:29.244 suites 1 1 n/a 0 0 00:03:29.244 tests 1 1 1 0 0 00:03:29.244 asserts 25 25 25 0 n/a 00:03:29.244 00:03:29.244 Elapsed time = 0.022 seconds 00:03:29.244 00:03:29.244 real 0m0.036s 00:03:29.244 user 0m0.009s 00:03:29.244 sys 0m0.026s 00:03:29.244 22:41:20 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:03:29.244 22:41:20 -- common/autotest_common.sh@10 -- # set +x 00:03:29.244 ************************************ 00:03:29.244 END TEST env_pci 00:03:29.244 ************************************ 00:03:29.244 22:41:20 -- env/env.sh@14 -- # argv='-c 0x1 ' 00:03:29.244 22:41:20 -- env/env.sh@15 -- # uname 00:03:29.245 22:41:20 -- env/env.sh@15 -- # '[' Linux = Linux ']' 00:03:29.245 22:41:20 -- env/env.sh@22 -- # argv+=--base-virtaddr=0x200000000000 00:03:29.245 22:41:20 -- env/env.sh@24 -- # run_test env_dpdk_post_init /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/env/env_dpdk_post_init/env_dpdk_post_init -c 0x1 --base-virtaddr=0x200000000000 00:03:29.245 22:41:20 -- common/autotest_common.sh@1077 -- # '[' 5 -le 1 ']' 00:03:29.245 22:41:20 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:03:29.245 22:41:20 -- common/autotest_common.sh@10 -- # set +x 00:03:29.245 ************************************ 00:03:29.245 START TEST env_dpdk_post_init 00:03:29.245 ************************************ 00:03:29.245 22:41:20 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/env/env_dpdk_post_init/env_dpdk_post_init -c 0x1 --base-virtaddr=0x200000000000 00:03:29.245 EAL: Detected CPU lcores: 48 00:03:29.245 EAL: Detected NUMA nodes: 2 00:03:29.245 EAL: Detected shared linkage of DPDK 00:03:29.245 EAL: Multi-process socket /var/run/dpdk/rte/mp_socket 00:03:29.505 EAL: Selected IOVA mode 'VA' 00:03:29.505 EAL: No free 2048 kB hugepages reported on node 1 00:03:29.505 EAL: VFIO support initialized 00:03:29.505 TELEMETRY: No legacy callbacks, legacy socket not created 00:03:29.505 EAL: Using IOMMU type 1 (Type 1) 00:03:29.505 EAL: Probe PCI driver: spdk_ioat (8086:0e20) device: 0000:00:04.0 (socket 0) 00:03:29.505 EAL: Probe PCI driver: spdk_ioat (8086:0e21) device: 0000:00:04.1 (socket 0) 00:03:29.505 EAL: Probe PCI driver: spdk_ioat (8086:0e22) device: 0000:00:04.2 (socket 0) 00:03:29.505 EAL: Probe PCI driver: spdk_ioat (8086:0e23) device: 0000:00:04.3 (socket 0) 00:03:29.505 EAL: Probe PCI driver: spdk_ioat (8086:0e24) device: 0000:00:04.4 (socket 0) 00:03:29.505 EAL: Probe PCI driver: spdk_ioat (8086:0e25) device: 0000:00:04.5 (socket 0) 00:03:29.505 EAL: Probe PCI driver: spdk_ioat (8086:0e26) device: 0000:00:04.6 (socket 0) 00:03:29.505 EAL: Probe PCI driver: spdk_ioat (8086:0e27) device: 0000:00:04.7 (socket 0) 00:03:29.505 EAL: Probe PCI driver: spdk_ioat (8086:0e20) device: 0000:80:04.0 (socket 1) 00:03:29.505 EAL: Probe PCI driver: spdk_ioat (8086:0e21) device: 0000:80:04.1 (socket 1) 00:03:29.505 EAL: Probe PCI driver: spdk_ioat (8086:0e22) device: 0000:80:04.2 (socket 1) 00:03:29.505 EAL: Probe PCI driver: spdk_ioat (8086:0e23) device: 0000:80:04.3 (socket 1) 00:03:29.505 EAL: Probe PCI driver: spdk_ioat (8086:0e24) device: 0000:80:04.4 (socket 1) 00:03:29.505 EAL: Probe PCI driver: spdk_ioat (8086:0e25) device: 0000:80:04.5 (socket 1) 00:03:29.505 EAL: Probe PCI driver: spdk_ioat (8086:0e26) device: 0000:80:04.6 (socket 1) 00:03:29.792 EAL: Probe PCI driver: spdk_ioat (8086:0e27) device: 0000:80:04.7 (socket 1) 00:03:30.359 EAL: Probe PCI driver: spdk_nvme (8086:0a54) device: 0000:88:00.0 (socket 1) 00:03:33.636 EAL: Releasing PCI mapped resource for 0000:88:00.0 00:03:33.636 EAL: Calling pci_unmap_resource for 0000:88:00.0 at 0x202001040000 00:03:33.636 Starting DPDK initialization... 00:03:33.636 Starting SPDK post initialization... 00:03:33.636 SPDK NVMe probe 00:03:33.636 Attaching to 0000:88:00.0 00:03:33.636 Attached to 0000:88:00.0 00:03:33.636 Cleaning up... 00:03:33.636 00:03:33.636 real 0m4.383s 00:03:33.636 user 0m3.239s 00:03:33.636 sys 0m0.202s 00:03:33.636 22:41:24 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:03:33.636 22:41:24 -- common/autotest_common.sh@10 -- # set +x 00:03:33.636 ************************************ 00:03:33.636 END TEST env_dpdk_post_init 00:03:33.636 ************************************ 00:03:33.636 22:41:24 -- env/env.sh@26 -- # uname 00:03:33.636 22:41:24 -- env/env.sh@26 -- # '[' Linux = Linux ']' 00:03:33.636 22:41:24 -- env/env.sh@29 -- # run_test env_mem_callbacks /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/env/mem_callbacks/mem_callbacks 00:03:33.636 22:41:24 -- common/autotest_common.sh@1077 -- # '[' 2 -le 1 ']' 00:03:33.636 22:41:24 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:03:33.636 22:41:24 -- common/autotest_common.sh@10 -- # set +x 00:03:33.636 ************************************ 00:03:33.636 START TEST env_mem_callbacks 00:03:33.636 ************************************ 00:03:33.636 22:41:24 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/env/mem_callbacks/mem_callbacks 00:03:33.894 EAL: Detected CPU lcores: 48 00:03:33.894 EAL: Detected NUMA nodes: 2 00:03:33.894 EAL: Detected shared linkage of DPDK 00:03:33.894 EAL: Multi-process socket /var/run/dpdk/rte/mp_socket 00:03:33.894 EAL: Selected IOVA mode 'VA' 00:03:33.894 EAL: No free 2048 kB hugepages reported on node 1 00:03:33.894 EAL: VFIO support initialized 00:03:33.894 TELEMETRY: No legacy callbacks, legacy socket not created 00:03:33.894 00:03:33.894 00:03:33.894 CUnit - A unit testing framework for C - Version 2.1-3 00:03:33.894 http://cunit.sourceforge.net/ 00:03:33.894 00:03:33.894 00:03:33.894 Suite: memory 00:03:33.894 Test: test ... 00:03:33.894 register 0x200000200000 2097152 00:03:33.894 malloc 3145728 00:03:33.894 register 0x200000400000 4194304 00:03:33.894 buf 0x200000500000 len 3145728 PASSED 00:03:33.894 malloc 64 00:03:33.894 buf 0x2000004fff40 len 64 PASSED 00:03:33.894 malloc 4194304 00:03:33.894 register 0x200000800000 6291456 00:03:33.894 buf 0x200000a00000 len 4194304 PASSED 00:03:33.894 free 0x200000500000 3145728 00:03:33.894 free 0x2000004fff40 64 00:03:33.894 unregister 0x200000400000 4194304 PASSED 00:03:33.894 free 0x200000a00000 4194304 00:03:33.894 unregister 0x200000800000 6291456 PASSED 00:03:33.894 malloc 8388608 00:03:33.894 register 0x200000400000 10485760 00:03:33.894 buf 0x200000600000 len 8388608 PASSED 00:03:33.894 free 0x200000600000 8388608 00:03:33.894 unregister 0x200000400000 10485760 PASSED 00:03:33.894 passed 00:03:33.894 00:03:33.894 Run Summary: Type Total Ran Passed Failed Inactive 00:03:33.894 suites 1 1 n/a 0 0 00:03:33.894 tests 1 1 1 0 0 00:03:33.894 asserts 15 15 15 0 n/a 00:03:33.894 00:03:33.894 Elapsed time = 0.005 seconds 00:03:33.894 00:03:33.894 real 0m0.047s 00:03:33.894 user 0m0.013s 00:03:33.894 sys 0m0.034s 00:03:33.894 22:41:24 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:03:33.894 22:41:24 -- common/autotest_common.sh@10 -- # set +x 00:03:33.894 ************************************ 00:03:33.894 END TEST env_mem_callbacks 00:03:33.894 ************************************ 00:03:33.894 00:03:33.894 real 0m6.256s 00:03:33.894 user 0m4.327s 00:03:33.894 sys 0m0.977s 00:03:33.894 22:41:24 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:03:33.894 22:41:24 -- common/autotest_common.sh@10 -- # set +x 00:03:33.894 ************************************ 00:03:33.894 END TEST env 00:03:33.894 ************************************ 00:03:33.894 22:41:24 -- spdk/autotest.sh@176 -- # run_test rpc /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc/rpc.sh 00:03:33.894 22:41:24 -- common/autotest_common.sh@1077 -- # '[' 2 -le 1 ']' 00:03:33.894 22:41:24 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:03:33.894 22:41:24 -- common/autotest_common.sh@10 -- # set +x 00:03:33.894 ************************************ 00:03:33.894 START TEST rpc 00:03:33.894 ************************************ 00:03:33.894 22:41:24 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc/rpc.sh 00:03:33.894 * Looking for test storage... 00:03:33.894 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc 00:03:33.894 22:41:24 -- rpc/rpc.sh@65 -- # spdk_pid=150831 00:03:33.894 22:41:24 -- rpc/rpc.sh@64 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -e bdev 00:03:33.894 22:41:24 -- rpc/rpc.sh@66 -- # trap 'killprocess $spdk_pid; exit 1' SIGINT SIGTERM EXIT 00:03:33.894 22:41:24 -- rpc/rpc.sh@67 -- # waitforlisten 150831 00:03:33.894 22:41:24 -- common/autotest_common.sh@819 -- # '[' -z 150831 ']' 00:03:33.894 22:41:24 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk.sock 00:03:33.894 22:41:24 -- common/autotest_common.sh@824 -- # local max_retries=100 00:03:33.894 22:41:24 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:03:33.894 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:03:33.894 22:41:24 -- common/autotest_common.sh@828 -- # xtrace_disable 00:03:33.894 22:41:24 -- common/autotest_common.sh@10 -- # set +x 00:03:33.894 [2024-04-16 22:41:24.947878] Starting SPDK v24.01.1-pre git sha1 4b134b4ab / DPDK 23.11.0 initialization... 00:03:33.894 [2024-04-16 22:41:24.947968] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid150831 ] 00:03:33.894 EAL: No free 2048 kB hugepages reported on node 1 00:03:33.894 [2024-04-16 22:41:25.004304] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:03:34.151 [2024-04-16 22:41:25.109860] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:03:34.151 [2024-04-16 22:41:25.110007] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask bdev specified. 00:03:34.151 [2024-04-16 22:41:25.110024] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s spdk_tgt -p 150831' to capture a snapshot of events at runtime. 00:03:34.151 [2024-04-16 22:41:25.110036] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/spdk_tgt_trace.pid150831 for offline analysis/debug. 00:03:34.151 [2024-04-16 22:41:25.110072] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:03:35.084 22:41:25 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:03:35.084 22:41:25 -- common/autotest_common.sh@852 -- # return 0 00:03:35.084 22:41:25 -- rpc/rpc.sh@69 -- # export PYTHONPATH=:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/python:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc_plugins:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/python:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc_plugins:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc 00:03:35.084 22:41:25 -- rpc/rpc.sh@69 -- # PYTHONPATH=:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/python:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc_plugins:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/python:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc_plugins:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc 00:03:35.084 22:41:25 -- rpc/rpc.sh@72 -- # rpc=rpc_cmd 00:03:35.084 22:41:25 -- rpc/rpc.sh@73 -- # run_test rpc_integrity rpc_integrity 00:03:35.084 22:41:25 -- common/autotest_common.sh@1077 -- # '[' 2 -le 1 ']' 00:03:35.084 22:41:25 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:03:35.084 22:41:25 -- common/autotest_common.sh@10 -- # set +x 00:03:35.084 ************************************ 00:03:35.084 START TEST rpc_integrity 00:03:35.084 ************************************ 00:03:35.084 22:41:25 -- common/autotest_common.sh@1104 -- # rpc_integrity 00:03:35.084 22:41:25 -- rpc/rpc.sh@12 -- # rpc_cmd bdev_get_bdevs 00:03:35.084 22:41:25 -- common/autotest_common.sh@551 -- # xtrace_disable 00:03:35.084 22:41:25 -- common/autotest_common.sh@10 -- # set +x 00:03:35.084 22:41:25 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:03:35.084 22:41:25 -- rpc/rpc.sh@12 -- # bdevs='[]' 00:03:35.084 22:41:25 -- rpc/rpc.sh@13 -- # jq length 00:03:35.084 22:41:25 -- rpc/rpc.sh@13 -- # '[' 0 == 0 ']' 00:03:35.084 22:41:25 -- rpc/rpc.sh@15 -- # rpc_cmd bdev_malloc_create 8 512 00:03:35.084 22:41:25 -- common/autotest_common.sh@551 -- # xtrace_disable 00:03:35.084 22:41:25 -- common/autotest_common.sh@10 -- # set +x 00:03:35.084 22:41:25 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:03:35.084 22:41:25 -- rpc/rpc.sh@15 -- # malloc=Malloc0 00:03:35.084 22:41:25 -- rpc/rpc.sh@16 -- # rpc_cmd bdev_get_bdevs 00:03:35.084 22:41:25 -- common/autotest_common.sh@551 -- # xtrace_disable 00:03:35.084 22:41:25 -- common/autotest_common.sh@10 -- # set +x 00:03:35.084 22:41:25 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:03:35.084 22:41:25 -- rpc/rpc.sh@16 -- # bdevs='[ 00:03:35.084 { 00:03:35.084 "name": "Malloc0", 00:03:35.084 "aliases": [ 00:03:35.084 "a1a5434c-b218-4836-9e02-80dba4a88ab4" 00:03:35.084 ], 00:03:35.084 "product_name": "Malloc disk", 00:03:35.084 "block_size": 512, 00:03:35.084 "num_blocks": 16384, 00:03:35.084 "uuid": "a1a5434c-b218-4836-9e02-80dba4a88ab4", 00:03:35.084 "assigned_rate_limits": { 00:03:35.084 "rw_ios_per_sec": 0, 00:03:35.084 "rw_mbytes_per_sec": 0, 00:03:35.084 "r_mbytes_per_sec": 0, 00:03:35.084 "w_mbytes_per_sec": 0 00:03:35.084 }, 00:03:35.084 "claimed": false, 00:03:35.084 "zoned": false, 00:03:35.084 "supported_io_types": { 00:03:35.084 "read": true, 00:03:35.084 "write": true, 00:03:35.084 "unmap": true, 00:03:35.084 "write_zeroes": true, 00:03:35.084 "flush": true, 00:03:35.084 "reset": true, 00:03:35.084 "compare": false, 00:03:35.084 "compare_and_write": false, 00:03:35.084 "abort": true, 00:03:35.084 "nvme_admin": false, 00:03:35.084 "nvme_io": false 00:03:35.084 }, 00:03:35.084 "memory_domains": [ 00:03:35.084 { 00:03:35.084 "dma_device_id": "SPDK_ACCEL_DMA_DEVICE", 00:03:35.084 "dma_device_type": 2 00:03:35.084 } 00:03:35.084 ], 00:03:35.084 "driver_specific": {} 00:03:35.084 } 00:03:35.084 ]' 00:03:35.084 22:41:25 -- rpc/rpc.sh@17 -- # jq length 00:03:35.084 22:41:25 -- rpc/rpc.sh@17 -- # '[' 1 == 1 ']' 00:03:35.084 22:41:25 -- rpc/rpc.sh@19 -- # rpc_cmd bdev_passthru_create -b Malloc0 -p Passthru0 00:03:35.084 22:41:25 -- common/autotest_common.sh@551 -- # xtrace_disable 00:03:35.084 22:41:25 -- common/autotest_common.sh@10 -- # set +x 00:03:35.084 [2024-04-16 22:41:25.990568] vbdev_passthru.c: 607:vbdev_passthru_register: *NOTICE*: Match on Malloc0 00:03:35.084 [2024-04-16 22:41:25.990614] vbdev_passthru.c: 636:vbdev_passthru_register: *NOTICE*: base bdev opened 00:03:35.084 [2024-04-16 22:41:25.990640] vbdev_passthru.c: 676:vbdev_passthru_register: *NOTICE*: io_device created at: 0x0x1dfaf60 00:03:35.084 [2024-04-16 22:41:25.990655] vbdev_passthru.c: 691:vbdev_passthru_register: *NOTICE*: bdev claimed 00:03:35.084 [2024-04-16 22:41:25.992165] vbdev_passthru.c: 704:vbdev_passthru_register: *NOTICE*: pt_bdev registered 00:03:35.084 [2024-04-16 22:41:25.992202] vbdev_passthru.c: 705:vbdev_passthru_register: *NOTICE*: created pt_bdev for: Passthru0 00:03:35.084 Passthru0 00:03:35.084 22:41:25 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:03:35.084 22:41:25 -- rpc/rpc.sh@20 -- # rpc_cmd bdev_get_bdevs 00:03:35.084 22:41:25 -- common/autotest_common.sh@551 -- # xtrace_disable 00:03:35.084 22:41:25 -- common/autotest_common.sh@10 -- # set +x 00:03:35.084 22:41:26 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:03:35.084 22:41:26 -- rpc/rpc.sh@20 -- # bdevs='[ 00:03:35.084 { 00:03:35.084 "name": "Malloc0", 00:03:35.084 "aliases": [ 00:03:35.084 "a1a5434c-b218-4836-9e02-80dba4a88ab4" 00:03:35.084 ], 00:03:35.084 "product_name": "Malloc disk", 00:03:35.084 "block_size": 512, 00:03:35.084 "num_blocks": 16384, 00:03:35.084 "uuid": "a1a5434c-b218-4836-9e02-80dba4a88ab4", 00:03:35.084 "assigned_rate_limits": { 00:03:35.084 "rw_ios_per_sec": 0, 00:03:35.084 "rw_mbytes_per_sec": 0, 00:03:35.084 "r_mbytes_per_sec": 0, 00:03:35.084 "w_mbytes_per_sec": 0 00:03:35.084 }, 00:03:35.084 "claimed": true, 00:03:35.084 "claim_type": "exclusive_write", 00:03:35.085 "zoned": false, 00:03:35.085 "supported_io_types": { 00:03:35.085 "read": true, 00:03:35.085 "write": true, 00:03:35.085 "unmap": true, 00:03:35.085 "write_zeroes": true, 00:03:35.085 "flush": true, 00:03:35.085 "reset": true, 00:03:35.085 "compare": false, 00:03:35.085 "compare_and_write": false, 00:03:35.085 "abort": true, 00:03:35.085 "nvme_admin": false, 00:03:35.085 "nvme_io": false 00:03:35.085 }, 00:03:35.085 "memory_domains": [ 00:03:35.085 { 00:03:35.085 "dma_device_id": "SPDK_ACCEL_DMA_DEVICE", 00:03:35.085 "dma_device_type": 2 00:03:35.085 } 00:03:35.085 ], 00:03:35.085 "driver_specific": {} 00:03:35.085 }, 00:03:35.085 { 00:03:35.085 "name": "Passthru0", 00:03:35.085 "aliases": [ 00:03:35.085 "eec174d0-885f-5a1b-ac3b-86bfb28975e3" 00:03:35.085 ], 00:03:35.085 "product_name": "passthru", 00:03:35.085 "block_size": 512, 00:03:35.085 "num_blocks": 16384, 00:03:35.085 "uuid": "eec174d0-885f-5a1b-ac3b-86bfb28975e3", 00:03:35.085 "assigned_rate_limits": { 00:03:35.085 "rw_ios_per_sec": 0, 00:03:35.085 "rw_mbytes_per_sec": 0, 00:03:35.085 "r_mbytes_per_sec": 0, 00:03:35.085 "w_mbytes_per_sec": 0 00:03:35.085 }, 00:03:35.085 "claimed": false, 00:03:35.085 "zoned": false, 00:03:35.085 "supported_io_types": { 00:03:35.085 "read": true, 00:03:35.085 "write": true, 00:03:35.085 "unmap": true, 00:03:35.085 "write_zeroes": true, 00:03:35.085 "flush": true, 00:03:35.085 "reset": true, 00:03:35.085 "compare": false, 00:03:35.085 "compare_and_write": false, 00:03:35.085 "abort": true, 00:03:35.085 "nvme_admin": false, 00:03:35.085 "nvme_io": false 00:03:35.085 }, 00:03:35.085 "memory_domains": [ 00:03:35.085 { 00:03:35.085 "dma_device_id": "SPDK_ACCEL_DMA_DEVICE", 00:03:35.085 "dma_device_type": 2 00:03:35.085 } 00:03:35.085 ], 00:03:35.085 "driver_specific": { 00:03:35.085 "passthru": { 00:03:35.085 "name": "Passthru0", 00:03:35.085 "base_bdev_name": "Malloc0" 00:03:35.085 } 00:03:35.085 } 00:03:35.085 } 00:03:35.085 ]' 00:03:35.085 22:41:26 -- rpc/rpc.sh@21 -- # jq length 00:03:35.085 22:41:26 -- rpc/rpc.sh@21 -- # '[' 2 == 2 ']' 00:03:35.085 22:41:26 -- rpc/rpc.sh@23 -- # rpc_cmd bdev_passthru_delete Passthru0 00:03:35.085 22:41:26 -- common/autotest_common.sh@551 -- # xtrace_disable 00:03:35.085 22:41:26 -- common/autotest_common.sh@10 -- # set +x 00:03:35.085 22:41:26 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:03:35.085 22:41:26 -- rpc/rpc.sh@24 -- # rpc_cmd bdev_malloc_delete Malloc0 00:03:35.085 22:41:26 -- common/autotest_common.sh@551 -- # xtrace_disable 00:03:35.085 22:41:26 -- common/autotest_common.sh@10 -- # set +x 00:03:35.085 22:41:26 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:03:35.085 22:41:26 -- rpc/rpc.sh@25 -- # rpc_cmd bdev_get_bdevs 00:03:35.085 22:41:26 -- common/autotest_common.sh@551 -- # xtrace_disable 00:03:35.085 22:41:26 -- common/autotest_common.sh@10 -- # set +x 00:03:35.085 22:41:26 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:03:35.085 22:41:26 -- rpc/rpc.sh@25 -- # bdevs='[]' 00:03:35.085 22:41:26 -- rpc/rpc.sh@26 -- # jq length 00:03:35.085 22:41:26 -- rpc/rpc.sh@26 -- # '[' 0 == 0 ']' 00:03:35.085 00:03:35.085 real 0m0.225s 00:03:35.085 user 0m0.147s 00:03:35.085 sys 0m0.021s 00:03:35.085 22:41:26 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:03:35.085 22:41:26 -- common/autotest_common.sh@10 -- # set +x 00:03:35.085 ************************************ 00:03:35.085 END TEST rpc_integrity 00:03:35.085 ************************************ 00:03:35.085 22:41:26 -- rpc/rpc.sh@74 -- # run_test rpc_plugins rpc_plugins 00:03:35.085 22:41:26 -- common/autotest_common.sh@1077 -- # '[' 2 -le 1 ']' 00:03:35.085 22:41:26 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:03:35.085 22:41:26 -- common/autotest_common.sh@10 -- # set +x 00:03:35.085 ************************************ 00:03:35.085 START TEST rpc_plugins 00:03:35.085 ************************************ 00:03:35.085 22:41:26 -- common/autotest_common.sh@1104 -- # rpc_plugins 00:03:35.085 22:41:26 -- rpc/rpc.sh@30 -- # rpc_cmd --plugin rpc_plugin create_malloc 00:03:35.085 22:41:26 -- common/autotest_common.sh@551 -- # xtrace_disable 00:03:35.085 22:41:26 -- common/autotest_common.sh@10 -- # set +x 00:03:35.085 22:41:26 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:03:35.085 22:41:26 -- rpc/rpc.sh@30 -- # malloc=Malloc1 00:03:35.085 22:41:26 -- rpc/rpc.sh@31 -- # rpc_cmd bdev_get_bdevs 00:03:35.085 22:41:26 -- common/autotest_common.sh@551 -- # xtrace_disable 00:03:35.085 22:41:26 -- common/autotest_common.sh@10 -- # set +x 00:03:35.085 22:41:26 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:03:35.085 22:41:26 -- rpc/rpc.sh@31 -- # bdevs='[ 00:03:35.085 { 00:03:35.085 "name": "Malloc1", 00:03:35.085 "aliases": [ 00:03:35.085 "abdbed1d-9c47-4229-8604-23e4f668d49c" 00:03:35.085 ], 00:03:35.085 "product_name": "Malloc disk", 00:03:35.085 "block_size": 4096, 00:03:35.085 "num_blocks": 256, 00:03:35.085 "uuid": "abdbed1d-9c47-4229-8604-23e4f668d49c", 00:03:35.085 "assigned_rate_limits": { 00:03:35.085 "rw_ios_per_sec": 0, 00:03:35.085 "rw_mbytes_per_sec": 0, 00:03:35.085 "r_mbytes_per_sec": 0, 00:03:35.085 "w_mbytes_per_sec": 0 00:03:35.085 }, 00:03:35.085 "claimed": false, 00:03:35.085 "zoned": false, 00:03:35.085 "supported_io_types": { 00:03:35.085 "read": true, 00:03:35.085 "write": true, 00:03:35.085 "unmap": true, 00:03:35.085 "write_zeroes": true, 00:03:35.085 "flush": true, 00:03:35.085 "reset": true, 00:03:35.085 "compare": false, 00:03:35.085 "compare_and_write": false, 00:03:35.085 "abort": true, 00:03:35.085 "nvme_admin": false, 00:03:35.085 "nvme_io": false 00:03:35.085 }, 00:03:35.085 "memory_domains": [ 00:03:35.085 { 00:03:35.085 "dma_device_id": "SPDK_ACCEL_DMA_DEVICE", 00:03:35.085 "dma_device_type": 2 00:03:35.085 } 00:03:35.085 ], 00:03:35.085 "driver_specific": {} 00:03:35.085 } 00:03:35.085 ]' 00:03:35.085 22:41:26 -- rpc/rpc.sh@32 -- # jq length 00:03:35.085 22:41:26 -- rpc/rpc.sh@32 -- # '[' 1 == 1 ']' 00:03:35.085 22:41:26 -- rpc/rpc.sh@34 -- # rpc_cmd --plugin rpc_plugin delete_malloc Malloc1 00:03:35.085 22:41:26 -- common/autotest_common.sh@551 -- # xtrace_disable 00:03:35.085 22:41:26 -- common/autotest_common.sh@10 -- # set +x 00:03:35.085 22:41:26 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:03:35.085 22:41:26 -- rpc/rpc.sh@35 -- # rpc_cmd bdev_get_bdevs 00:03:35.085 22:41:26 -- common/autotest_common.sh@551 -- # xtrace_disable 00:03:35.085 22:41:26 -- common/autotest_common.sh@10 -- # set +x 00:03:35.085 22:41:26 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:03:35.085 22:41:26 -- rpc/rpc.sh@35 -- # bdevs='[]' 00:03:35.085 22:41:26 -- rpc/rpc.sh@36 -- # jq length 00:03:35.342 22:41:26 -- rpc/rpc.sh@36 -- # '[' 0 == 0 ']' 00:03:35.342 00:03:35.342 real 0m0.111s 00:03:35.342 user 0m0.071s 00:03:35.342 sys 0m0.011s 00:03:35.342 22:41:26 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:03:35.342 22:41:26 -- common/autotest_common.sh@10 -- # set +x 00:03:35.342 ************************************ 00:03:35.342 END TEST rpc_plugins 00:03:35.342 ************************************ 00:03:35.342 22:41:26 -- rpc/rpc.sh@75 -- # run_test rpc_trace_cmd_test rpc_trace_cmd_test 00:03:35.342 22:41:26 -- common/autotest_common.sh@1077 -- # '[' 2 -le 1 ']' 00:03:35.342 22:41:26 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:03:35.342 22:41:26 -- common/autotest_common.sh@10 -- # set +x 00:03:35.342 ************************************ 00:03:35.342 START TEST rpc_trace_cmd_test 00:03:35.343 ************************************ 00:03:35.343 22:41:26 -- common/autotest_common.sh@1104 -- # rpc_trace_cmd_test 00:03:35.343 22:41:26 -- rpc/rpc.sh@40 -- # local info 00:03:35.343 22:41:26 -- rpc/rpc.sh@42 -- # rpc_cmd trace_get_info 00:03:35.343 22:41:26 -- common/autotest_common.sh@551 -- # xtrace_disable 00:03:35.343 22:41:26 -- common/autotest_common.sh@10 -- # set +x 00:03:35.343 22:41:26 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:03:35.343 22:41:26 -- rpc/rpc.sh@42 -- # info='{ 00:03:35.343 "tpoint_shm_path": "/dev/shm/spdk_tgt_trace.pid150831", 00:03:35.343 "tpoint_group_mask": "0x8", 00:03:35.343 "iscsi_conn": { 00:03:35.343 "mask": "0x2", 00:03:35.343 "tpoint_mask": "0x0" 00:03:35.343 }, 00:03:35.343 "scsi": { 00:03:35.343 "mask": "0x4", 00:03:35.343 "tpoint_mask": "0x0" 00:03:35.343 }, 00:03:35.343 "bdev": { 00:03:35.343 "mask": "0x8", 00:03:35.343 "tpoint_mask": "0xffffffffffffffff" 00:03:35.343 }, 00:03:35.343 "nvmf_rdma": { 00:03:35.343 "mask": "0x10", 00:03:35.343 "tpoint_mask": "0x0" 00:03:35.343 }, 00:03:35.343 "nvmf_tcp": { 00:03:35.343 "mask": "0x20", 00:03:35.343 "tpoint_mask": "0x0" 00:03:35.343 }, 00:03:35.343 "ftl": { 00:03:35.343 "mask": "0x40", 00:03:35.343 "tpoint_mask": "0x0" 00:03:35.343 }, 00:03:35.343 "blobfs": { 00:03:35.343 "mask": "0x80", 00:03:35.343 "tpoint_mask": "0x0" 00:03:35.343 }, 00:03:35.343 "dsa": { 00:03:35.343 "mask": "0x200", 00:03:35.343 "tpoint_mask": "0x0" 00:03:35.343 }, 00:03:35.343 "thread": { 00:03:35.343 "mask": "0x400", 00:03:35.343 "tpoint_mask": "0x0" 00:03:35.343 }, 00:03:35.343 "nvme_pcie": { 00:03:35.343 "mask": "0x800", 00:03:35.343 "tpoint_mask": "0x0" 00:03:35.343 }, 00:03:35.343 "iaa": { 00:03:35.343 "mask": "0x1000", 00:03:35.343 "tpoint_mask": "0x0" 00:03:35.343 }, 00:03:35.343 "nvme_tcp": { 00:03:35.343 "mask": "0x2000", 00:03:35.343 "tpoint_mask": "0x0" 00:03:35.343 }, 00:03:35.343 "bdev_nvme": { 00:03:35.343 "mask": "0x4000", 00:03:35.343 "tpoint_mask": "0x0" 00:03:35.343 } 00:03:35.343 }' 00:03:35.343 22:41:26 -- rpc/rpc.sh@43 -- # jq length 00:03:35.343 22:41:26 -- rpc/rpc.sh@43 -- # '[' 15 -gt 2 ']' 00:03:35.343 22:41:26 -- rpc/rpc.sh@44 -- # jq 'has("tpoint_group_mask")' 00:03:35.343 22:41:26 -- rpc/rpc.sh@44 -- # '[' true = true ']' 00:03:35.343 22:41:26 -- rpc/rpc.sh@45 -- # jq 'has("tpoint_shm_path")' 00:03:35.343 22:41:26 -- rpc/rpc.sh@45 -- # '[' true = true ']' 00:03:35.343 22:41:26 -- rpc/rpc.sh@46 -- # jq 'has("bdev")' 00:03:35.343 22:41:26 -- rpc/rpc.sh@46 -- # '[' true = true ']' 00:03:35.343 22:41:26 -- rpc/rpc.sh@47 -- # jq -r .bdev.tpoint_mask 00:03:35.343 22:41:26 -- rpc/rpc.sh@47 -- # '[' 0xffffffffffffffff '!=' 0x0 ']' 00:03:35.343 00:03:35.343 real 0m0.194s 00:03:35.343 user 0m0.164s 00:03:35.343 sys 0m0.022s 00:03:35.343 22:41:26 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:03:35.343 22:41:26 -- common/autotest_common.sh@10 -- # set +x 00:03:35.343 ************************************ 00:03:35.343 END TEST rpc_trace_cmd_test 00:03:35.343 ************************************ 00:03:35.601 22:41:26 -- rpc/rpc.sh@76 -- # [[ 0 -eq 1 ]] 00:03:35.601 22:41:26 -- rpc/rpc.sh@80 -- # rpc=rpc_cmd 00:03:35.601 22:41:26 -- rpc/rpc.sh@81 -- # run_test rpc_daemon_integrity rpc_integrity 00:03:35.601 22:41:26 -- common/autotest_common.sh@1077 -- # '[' 2 -le 1 ']' 00:03:35.601 22:41:26 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:03:35.601 22:41:26 -- common/autotest_common.sh@10 -- # set +x 00:03:35.601 ************************************ 00:03:35.601 START TEST rpc_daemon_integrity 00:03:35.601 ************************************ 00:03:35.601 22:41:26 -- common/autotest_common.sh@1104 -- # rpc_integrity 00:03:35.601 22:41:26 -- rpc/rpc.sh@12 -- # rpc_cmd bdev_get_bdevs 00:03:35.601 22:41:26 -- common/autotest_common.sh@551 -- # xtrace_disable 00:03:35.601 22:41:26 -- common/autotest_common.sh@10 -- # set +x 00:03:35.601 22:41:26 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:03:35.601 22:41:26 -- rpc/rpc.sh@12 -- # bdevs='[]' 00:03:35.601 22:41:26 -- rpc/rpc.sh@13 -- # jq length 00:03:35.601 22:41:26 -- rpc/rpc.sh@13 -- # '[' 0 == 0 ']' 00:03:35.601 22:41:26 -- rpc/rpc.sh@15 -- # rpc_cmd bdev_malloc_create 8 512 00:03:35.601 22:41:26 -- common/autotest_common.sh@551 -- # xtrace_disable 00:03:35.601 22:41:26 -- common/autotest_common.sh@10 -- # set +x 00:03:35.601 22:41:26 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:03:35.601 22:41:26 -- rpc/rpc.sh@15 -- # malloc=Malloc2 00:03:35.601 22:41:26 -- rpc/rpc.sh@16 -- # rpc_cmd bdev_get_bdevs 00:03:35.601 22:41:26 -- common/autotest_common.sh@551 -- # xtrace_disable 00:03:35.601 22:41:26 -- common/autotest_common.sh@10 -- # set +x 00:03:35.601 22:41:26 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:03:35.601 22:41:26 -- rpc/rpc.sh@16 -- # bdevs='[ 00:03:35.601 { 00:03:35.601 "name": "Malloc2", 00:03:35.601 "aliases": [ 00:03:35.601 "43529d50-5634-451d-bd4f-dc660f699f2c" 00:03:35.601 ], 00:03:35.601 "product_name": "Malloc disk", 00:03:35.601 "block_size": 512, 00:03:35.601 "num_blocks": 16384, 00:03:35.601 "uuid": "43529d50-5634-451d-bd4f-dc660f699f2c", 00:03:35.601 "assigned_rate_limits": { 00:03:35.601 "rw_ios_per_sec": 0, 00:03:35.601 "rw_mbytes_per_sec": 0, 00:03:35.601 "r_mbytes_per_sec": 0, 00:03:35.601 "w_mbytes_per_sec": 0 00:03:35.601 }, 00:03:35.601 "claimed": false, 00:03:35.601 "zoned": false, 00:03:35.601 "supported_io_types": { 00:03:35.601 "read": true, 00:03:35.601 "write": true, 00:03:35.601 "unmap": true, 00:03:35.601 "write_zeroes": true, 00:03:35.601 "flush": true, 00:03:35.601 "reset": true, 00:03:35.601 "compare": false, 00:03:35.601 "compare_and_write": false, 00:03:35.601 "abort": true, 00:03:35.601 "nvme_admin": false, 00:03:35.601 "nvme_io": false 00:03:35.601 }, 00:03:35.601 "memory_domains": [ 00:03:35.601 { 00:03:35.601 "dma_device_id": "SPDK_ACCEL_DMA_DEVICE", 00:03:35.601 "dma_device_type": 2 00:03:35.601 } 00:03:35.601 ], 00:03:35.601 "driver_specific": {} 00:03:35.601 } 00:03:35.601 ]' 00:03:35.601 22:41:26 -- rpc/rpc.sh@17 -- # jq length 00:03:35.601 22:41:26 -- rpc/rpc.sh@17 -- # '[' 1 == 1 ']' 00:03:35.601 22:41:26 -- rpc/rpc.sh@19 -- # rpc_cmd bdev_passthru_create -b Malloc2 -p Passthru0 00:03:35.601 22:41:26 -- common/autotest_common.sh@551 -- # xtrace_disable 00:03:35.601 22:41:26 -- common/autotest_common.sh@10 -- # set +x 00:03:35.601 [2024-04-16 22:41:26.592376] vbdev_passthru.c: 607:vbdev_passthru_register: *NOTICE*: Match on Malloc2 00:03:35.601 [2024-04-16 22:41:26.592418] vbdev_passthru.c: 636:vbdev_passthru_register: *NOTICE*: base bdev opened 00:03:35.601 [2024-04-16 22:41:26.592444] vbdev_passthru.c: 676:vbdev_passthru_register: *NOTICE*: io_device created at: 0x0x1dfb990 00:03:35.601 [2024-04-16 22:41:26.592476] vbdev_passthru.c: 691:vbdev_passthru_register: *NOTICE*: bdev claimed 00:03:35.601 [2024-04-16 22:41:26.593838] vbdev_passthru.c: 704:vbdev_passthru_register: *NOTICE*: pt_bdev registered 00:03:35.601 [2024-04-16 22:41:26.593866] vbdev_passthru.c: 705:vbdev_passthru_register: *NOTICE*: created pt_bdev for: Passthru0 00:03:35.601 Passthru0 00:03:35.601 22:41:26 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:03:35.601 22:41:26 -- rpc/rpc.sh@20 -- # rpc_cmd bdev_get_bdevs 00:03:35.601 22:41:26 -- common/autotest_common.sh@551 -- # xtrace_disable 00:03:35.601 22:41:26 -- common/autotest_common.sh@10 -- # set +x 00:03:35.601 22:41:26 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:03:35.601 22:41:26 -- rpc/rpc.sh@20 -- # bdevs='[ 00:03:35.601 { 00:03:35.601 "name": "Malloc2", 00:03:35.601 "aliases": [ 00:03:35.601 "43529d50-5634-451d-bd4f-dc660f699f2c" 00:03:35.601 ], 00:03:35.601 "product_name": "Malloc disk", 00:03:35.601 "block_size": 512, 00:03:35.601 "num_blocks": 16384, 00:03:35.601 "uuid": "43529d50-5634-451d-bd4f-dc660f699f2c", 00:03:35.601 "assigned_rate_limits": { 00:03:35.601 "rw_ios_per_sec": 0, 00:03:35.601 "rw_mbytes_per_sec": 0, 00:03:35.601 "r_mbytes_per_sec": 0, 00:03:35.601 "w_mbytes_per_sec": 0 00:03:35.601 }, 00:03:35.601 "claimed": true, 00:03:35.601 "claim_type": "exclusive_write", 00:03:35.601 "zoned": false, 00:03:35.601 "supported_io_types": { 00:03:35.601 "read": true, 00:03:35.601 "write": true, 00:03:35.601 "unmap": true, 00:03:35.601 "write_zeroes": true, 00:03:35.601 "flush": true, 00:03:35.601 "reset": true, 00:03:35.601 "compare": false, 00:03:35.601 "compare_and_write": false, 00:03:35.601 "abort": true, 00:03:35.601 "nvme_admin": false, 00:03:35.601 "nvme_io": false 00:03:35.601 }, 00:03:35.601 "memory_domains": [ 00:03:35.601 { 00:03:35.601 "dma_device_id": "SPDK_ACCEL_DMA_DEVICE", 00:03:35.601 "dma_device_type": 2 00:03:35.601 } 00:03:35.601 ], 00:03:35.601 "driver_specific": {} 00:03:35.601 }, 00:03:35.601 { 00:03:35.601 "name": "Passthru0", 00:03:35.601 "aliases": [ 00:03:35.601 "da2f73d6-f75f-5b4f-bdcf-278d7ca146df" 00:03:35.601 ], 00:03:35.601 "product_name": "passthru", 00:03:35.601 "block_size": 512, 00:03:35.601 "num_blocks": 16384, 00:03:35.601 "uuid": "da2f73d6-f75f-5b4f-bdcf-278d7ca146df", 00:03:35.601 "assigned_rate_limits": { 00:03:35.601 "rw_ios_per_sec": 0, 00:03:35.601 "rw_mbytes_per_sec": 0, 00:03:35.601 "r_mbytes_per_sec": 0, 00:03:35.601 "w_mbytes_per_sec": 0 00:03:35.601 }, 00:03:35.601 "claimed": false, 00:03:35.601 "zoned": false, 00:03:35.601 "supported_io_types": { 00:03:35.601 "read": true, 00:03:35.601 "write": true, 00:03:35.601 "unmap": true, 00:03:35.601 "write_zeroes": true, 00:03:35.601 "flush": true, 00:03:35.601 "reset": true, 00:03:35.601 "compare": false, 00:03:35.601 "compare_and_write": false, 00:03:35.601 "abort": true, 00:03:35.601 "nvme_admin": false, 00:03:35.601 "nvme_io": false 00:03:35.601 }, 00:03:35.601 "memory_domains": [ 00:03:35.601 { 00:03:35.601 "dma_device_id": "SPDK_ACCEL_DMA_DEVICE", 00:03:35.601 "dma_device_type": 2 00:03:35.601 } 00:03:35.601 ], 00:03:35.601 "driver_specific": { 00:03:35.601 "passthru": { 00:03:35.601 "name": "Passthru0", 00:03:35.601 "base_bdev_name": "Malloc2" 00:03:35.601 } 00:03:35.601 } 00:03:35.601 } 00:03:35.601 ]' 00:03:35.601 22:41:26 -- rpc/rpc.sh@21 -- # jq length 00:03:35.601 22:41:26 -- rpc/rpc.sh@21 -- # '[' 2 == 2 ']' 00:03:35.601 22:41:26 -- rpc/rpc.sh@23 -- # rpc_cmd bdev_passthru_delete Passthru0 00:03:35.601 22:41:26 -- common/autotest_common.sh@551 -- # xtrace_disable 00:03:35.601 22:41:26 -- common/autotest_common.sh@10 -- # set +x 00:03:35.601 22:41:26 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:03:35.601 22:41:26 -- rpc/rpc.sh@24 -- # rpc_cmd bdev_malloc_delete Malloc2 00:03:35.601 22:41:26 -- common/autotest_common.sh@551 -- # xtrace_disable 00:03:35.601 22:41:26 -- common/autotest_common.sh@10 -- # set +x 00:03:35.601 22:41:26 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:03:35.601 22:41:26 -- rpc/rpc.sh@25 -- # rpc_cmd bdev_get_bdevs 00:03:35.601 22:41:26 -- common/autotest_common.sh@551 -- # xtrace_disable 00:03:35.601 22:41:26 -- common/autotest_common.sh@10 -- # set +x 00:03:35.601 22:41:26 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:03:35.601 22:41:26 -- rpc/rpc.sh@25 -- # bdevs='[]' 00:03:35.601 22:41:26 -- rpc/rpc.sh@26 -- # jq length 00:03:35.601 22:41:26 -- rpc/rpc.sh@26 -- # '[' 0 == 0 ']' 00:03:35.601 00:03:35.601 real 0m0.219s 00:03:35.601 user 0m0.145s 00:03:35.601 sys 0m0.021s 00:03:35.601 22:41:26 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:03:35.601 22:41:26 -- common/autotest_common.sh@10 -- # set +x 00:03:35.601 ************************************ 00:03:35.601 END TEST rpc_daemon_integrity 00:03:35.601 ************************************ 00:03:35.601 22:41:26 -- rpc/rpc.sh@83 -- # trap - SIGINT SIGTERM EXIT 00:03:35.601 22:41:26 -- rpc/rpc.sh@84 -- # killprocess 150831 00:03:35.601 22:41:26 -- common/autotest_common.sh@926 -- # '[' -z 150831 ']' 00:03:35.601 22:41:26 -- common/autotest_common.sh@930 -- # kill -0 150831 00:03:35.601 22:41:26 -- common/autotest_common.sh@931 -- # uname 00:03:35.859 22:41:26 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:03:35.859 22:41:26 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 150831 00:03:35.859 22:41:26 -- common/autotest_common.sh@932 -- # process_name=reactor_0 00:03:35.859 22:41:26 -- common/autotest_common.sh@936 -- # '[' reactor_0 = sudo ']' 00:03:35.859 22:41:26 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 150831' 00:03:35.859 killing process with pid 150831 00:03:35.859 22:41:26 -- common/autotest_common.sh@945 -- # kill 150831 00:03:35.859 22:41:26 -- common/autotest_common.sh@950 -- # wait 150831 00:03:36.118 00:03:36.118 real 0m2.356s 00:03:36.118 user 0m2.997s 00:03:36.118 sys 0m0.557s 00:03:36.118 22:41:27 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:03:36.118 22:41:27 -- common/autotest_common.sh@10 -- # set +x 00:03:36.118 ************************************ 00:03:36.118 END TEST rpc 00:03:36.118 ************************************ 00:03:36.118 22:41:27 -- spdk/autotest.sh@177 -- # run_test rpc_client /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc_client/rpc_client.sh 00:03:36.118 22:41:27 -- common/autotest_common.sh@1077 -- # '[' 2 -le 1 ']' 00:03:36.118 22:41:27 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:03:36.118 22:41:27 -- common/autotest_common.sh@10 -- # set +x 00:03:36.118 ************************************ 00:03:36.118 START TEST rpc_client 00:03:36.118 ************************************ 00:03:36.118 22:41:27 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc_client/rpc_client.sh 00:03:36.376 * Looking for test storage... 00:03:36.376 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc_client 00:03:36.376 22:41:27 -- rpc_client/rpc_client.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc_client/rpc_client_test 00:03:36.376 OK 00:03:36.376 22:41:27 -- rpc_client/rpc_client.sh@12 -- # trap - SIGINT SIGTERM EXIT 00:03:36.376 00:03:36.376 real 0m0.066s 00:03:36.376 user 0m0.027s 00:03:36.376 sys 0m0.045s 00:03:36.376 22:41:27 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:03:36.376 22:41:27 -- common/autotest_common.sh@10 -- # set +x 00:03:36.376 ************************************ 00:03:36.376 END TEST rpc_client 00:03:36.376 ************************************ 00:03:36.376 22:41:27 -- spdk/autotest.sh@178 -- # run_test json_config /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/json_config.sh 00:03:36.376 22:41:27 -- common/autotest_common.sh@1077 -- # '[' 2 -le 1 ']' 00:03:36.376 22:41:27 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:03:36.376 22:41:27 -- common/autotest_common.sh@10 -- # set +x 00:03:36.376 ************************************ 00:03:36.376 START TEST json_config 00:03:36.376 ************************************ 00:03:36.376 22:41:27 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/json_config.sh 00:03:36.376 22:41:27 -- json_config/json_config.sh@8 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:03:36.376 22:41:27 -- nvmf/common.sh@7 -- # uname -s 00:03:36.376 22:41:27 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:03:36.376 22:41:27 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:03:36.376 22:41:27 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:03:36.376 22:41:27 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:03:36.376 22:41:27 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:03:36.376 22:41:27 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:03:36.376 22:41:27 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:03:36.376 22:41:27 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:03:36.376 22:41:27 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:03:36.376 22:41:27 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:03:36.376 22:41:27 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:03:36.376 22:41:27 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:03:36.376 22:41:27 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:03:36.376 22:41:27 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:03:36.376 22:41:27 -- nvmf/common.sh@21 -- # NET_TYPE=phy-fallback 00:03:36.376 22:41:27 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:03:36.376 22:41:27 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:03:36.376 22:41:27 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:03:36.376 22:41:27 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:03:36.376 22:41:27 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:03:36.376 22:41:27 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:03:36.376 22:41:27 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:03:36.376 22:41:27 -- paths/export.sh@5 -- # export PATH 00:03:36.376 22:41:27 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:03:36.376 22:41:27 -- nvmf/common.sh@46 -- # : 0 00:03:36.376 22:41:27 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:03:36.376 22:41:27 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:03:36.376 22:41:27 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:03:36.376 22:41:27 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:03:36.376 22:41:27 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:03:36.376 22:41:27 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:03:36.376 22:41:27 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:03:36.376 22:41:27 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:03:36.376 22:41:27 -- json_config/json_config.sh@10 -- # [[ 0 -eq 1 ]] 00:03:36.376 22:41:27 -- json_config/json_config.sh@14 -- # [[ 0 -ne 1 ]] 00:03:36.376 22:41:27 -- json_config/json_config.sh@14 -- # [[ 0 -eq 1 ]] 00:03:36.376 22:41:27 -- json_config/json_config.sh@25 -- # (( SPDK_TEST_BLOCKDEV + SPDK_TEST_ISCSI + SPDK_TEST_NVMF + SPDK_TEST_VHOST + SPDK_TEST_VHOST_INIT + SPDK_TEST_RBD == 0 )) 00:03:36.376 22:41:27 -- json_config/json_config.sh@30 -- # app_pid=(['target']='' ['initiator']='') 00:03:36.376 22:41:27 -- json_config/json_config.sh@30 -- # declare -A app_pid 00:03:36.376 22:41:27 -- json_config/json_config.sh@31 -- # app_socket=(['target']='/var/tmp/spdk_tgt.sock' ['initiator']='/var/tmp/spdk_initiator.sock') 00:03:36.376 22:41:27 -- json_config/json_config.sh@31 -- # declare -A app_socket 00:03:36.376 22:41:27 -- json_config/json_config.sh@32 -- # app_params=(['target']='-m 0x1 -s 1024' ['initiator']='-m 0x2 -g -u -s 1024') 00:03:36.376 22:41:27 -- json_config/json_config.sh@32 -- # declare -A app_params 00:03:36.376 22:41:27 -- json_config/json_config.sh@33 -- # configs_path=(['target']='/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/spdk_tgt_config.json' ['initiator']='/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/spdk_initiator_config.json') 00:03:36.376 22:41:27 -- json_config/json_config.sh@33 -- # declare -A configs_path 00:03:36.376 22:41:27 -- json_config/json_config.sh@43 -- # last_event_id=0 00:03:36.376 22:41:27 -- json_config/json_config.sh@418 -- # trap 'on_error_exit "${FUNCNAME}" "${LINENO}"' ERR 00:03:36.376 22:41:27 -- json_config/json_config.sh@419 -- # echo 'INFO: JSON configuration test init' 00:03:36.376 INFO: JSON configuration test init 00:03:36.376 22:41:27 -- json_config/json_config.sh@420 -- # json_config_test_init 00:03:36.376 22:41:27 -- json_config/json_config.sh@315 -- # timing_enter json_config_test_init 00:03:36.376 22:41:27 -- common/autotest_common.sh@712 -- # xtrace_disable 00:03:36.376 22:41:27 -- common/autotest_common.sh@10 -- # set +x 00:03:36.376 22:41:27 -- json_config/json_config.sh@316 -- # timing_enter json_config_setup_target 00:03:36.376 22:41:27 -- common/autotest_common.sh@712 -- # xtrace_disable 00:03:36.376 22:41:27 -- common/autotest_common.sh@10 -- # set +x 00:03:36.376 22:41:27 -- json_config/json_config.sh@318 -- # json_config_test_start_app target --wait-for-rpc 00:03:36.376 22:41:27 -- json_config/json_config.sh@98 -- # local app=target 00:03:36.376 22:41:27 -- json_config/json_config.sh@99 -- # shift 00:03:36.376 22:41:27 -- json_config/json_config.sh@101 -- # [[ -n 22 ]] 00:03:36.376 22:41:27 -- json_config/json_config.sh@102 -- # [[ -z '' ]] 00:03:36.376 22:41:27 -- json_config/json_config.sh@104 -- # local app_extra_params= 00:03:36.376 22:41:27 -- json_config/json_config.sh@105 -- # [[ 0 -eq 1 ]] 00:03:36.376 22:41:27 -- json_config/json_config.sh@105 -- # [[ 0 -eq 1 ]] 00:03:36.376 22:41:27 -- json_config/json_config.sh@111 -- # app_pid[$app]=151315 00:03:36.376 22:41:27 -- json_config/json_config.sh@110 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x1 -s 1024 -r /var/tmp/spdk_tgt.sock --wait-for-rpc 00:03:36.376 22:41:27 -- json_config/json_config.sh@113 -- # echo 'Waiting for target to run...' 00:03:36.376 Waiting for target to run... 00:03:36.377 22:41:27 -- json_config/json_config.sh@114 -- # waitforlisten 151315 /var/tmp/spdk_tgt.sock 00:03:36.377 22:41:27 -- common/autotest_common.sh@819 -- # '[' -z 151315 ']' 00:03:36.377 22:41:27 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk_tgt.sock 00:03:36.377 22:41:27 -- common/autotest_common.sh@824 -- # local max_retries=100 00:03:36.377 22:41:27 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk_tgt.sock...' 00:03:36.377 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk_tgt.sock... 00:03:36.377 22:41:27 -- common/autotest_common.sh@828 -- # xtrace_disable 00:03:36.377 22:41:27 -- common/autotest_common.sh@10 -- # set +x 00:03:36.377 [2024-04-16 22:41:27.421970] Starting SPDK v24.01.1-pre git sha1 4b134b4ab / DPDK 23.11.0 initialization... 00:03:36.377 [2024-04-16 22:41:27.422062] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 -m 1024 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid151315 ] 00:03:36.377 EAL: No free 2048 kB hugepages reported on node 1 00:03:36.943 [2024-04-16 22:41:27.917952] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:03:36.943 [2024-04-16 22:41:28.022638] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:03:36.943 [2024-04-16 22:41:28.022823] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:03:37.507 22:41:28 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:03:37.507 22:41:28 -- common/autotest_common.sh@852 -- # return 0 00:03:37.507 22:41:28 -- json_config/json_config.sh@115 -- # echo '' 00:03:37.507 00:03:37.507 22:41:28 -- json_config/json_config.sh@322 -- # create_accel_config 00:03:37.507 22:41:28 -- json_config/json_config.sh@146 -- # timing_enter create_accel_config 00:03:37.507 22:41:28 -- common/autotest_common.sh@712 -- # xtrace_disable 00:03:37.507 22:41:28 -- common/autotest_common.sh@10 -- # set +x 00:03:37.507 22:41:28 -- json_config/json_config.sh@148 -- # [[ 0 -eq 1 ]] 00:03:37.507 22:41:28 -- json_config/json_config.sh@154 -- # timing_exit create_accel_config 00:03:37.507 22:41:28 -- common/autotest_common.sh@718 -- # xtrace_disable 00:03:37.507 22:41:28 -- common/autotest_common.sh@10 -- # set +x 00:03:37.507 22:41:28 -- json_config/json_config.sh@326 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/gen_nvme.sh --json-with-subsystems 00:03:37.507 22:41:28 -- json_config/json_config.sh@327 -- # tgt_rpc load_config 00:03:37.507 22:41:28 -- json_config/json_config.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock load_config 00:03:40.786 22:41:31 -- json_config/json_config.sh@329 -- # tgt_check_notification_types 00:03:40.786 22:41:31 -- json_config/json_config.sh@46 -- # timing_enter tgt_check_notification_types 00:03:40.786 22:41:31 -- common/autotest_common.sh@712 -- # xtrace_disable 00:03:40.786 22:41:31 -- common/autotest_common.sh@10 -- # set +x 00:03:40.786 22:41:31 -- json_config/json_config.sh@48 -- # local ret=0 00:03:40.786 22:41:31 -- json_config/json_config.sh@49 -- # enabled_types=('bdev_register' 'bdev_unregister') 00:03:40.786 22:41:31 -- json_config/json_config.sh@49 -- # local enabled_types 00:03:40.786 22:41:31 -- json_config/json_config.sh@51 -- # tgt_rpc notify_get_types 00:03:40.786 22:41:31 -- json_config/json_config.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock notify_get_types 00:03:40.786 22:41:31 -- json_config/json_config.sh@51 -- # jq -r '.[]' 00:03:40.786 22:41:31 -- json_config/json_config.sh@51 -- # get_types=('bdev_register' 'bdev_unregister') 00:03:40.786 22:41:31 -- json_config/json_config.sh@51 -- # local get_types 00:03:40.786 22:41:31 -- json_config/json_config.sh@52 -- # [[ bdev_register bdev_unregister != \b\d\e\v\_\r\e\g\i\s\t\e\r\ \b\d\e\v\_\u\n\r\e\g\i\s\t\e\r ]] 00:03:40.786 22:41:31 -- json_config/json_config.sh@57 -- # timing_exit tgt_check_notification_types 00:03:40.786 22:41:31 -- common/autotest_common.sh@718 -- # xtrace_disable 00:03:40.786 22:41:31 -- common/autotest_common.sh@10 -- # set +x 00:03:40.786 22:41:31 -- json_config/json_config.sh@58 -- # return 0 00:03:40.786 22:41:31 -- json_config/json_config.sh@331 -- # [[ 0 -eq 1 ]] 00:03:40.786 22:41:31 -- json_config/json_config.sh@335 -- # [[ 0 -eq 1 ]] 00:03:40.786 22:41:31 -- json_config/json_config.sh@339 -- # [[ 0 -eq 1 ]] 00:03:40.786 22:41:31 -- json_config/json_config.sh@343 -- # [[ 1 -eq 1 ]] 00:03:40.786 22:41:31 -- json_config/json_config.sh@344 -- # create_nvmf_subsystem_config 00:03:40.786 22:41:31 -- json_config/json_config.sh@283 -- # timing_enter create_nvmf_subsystem_config 00:03:40.786 22:41:31 -- common/autotest_common.sh@712 -- # xtrace_disable 00:03:40.786 22:41:31 -- common/autotest_common.sh@10 -- # set +x 00:03:40.786 22:41:31 -- json_config/json_config.sh@285 -- # NVMF_FIRST_TARGET_IP=127.0.0.1 00:03:40.786 22:41:31 -- json_config/json_config.sh@286 -- # [[ tcp == \r\d\m\a ]] 00:03:40.786 22:41:31 -- json_config/json_config.sh@290 -- # [[ -z 127.0.0.1 ]] 00:03:40.786 22:41:31 -- json_config/json_config.sh@295 -- # tgt_rpc bdev_malloc_create 8 512 --name MallocForNvmf0 00:03:40.786 22:41:31 -- json_config/json_config.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock bdev_malloc_create 8 512 --name MallocForNvmf0 00:03:41.043 MallocForNvmf0 00:03:41.043 22:41:32 -- json_config/json_config.sh@296 -- # tgt_rpc bdev_malloc_create 4 1024 --name MallocForNvmf1 00:03:41.043 22:41:32 -- json_config/json_config.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock bdev_malloc_create 4 1024 --name MallocForNvmf1 00:03:41.301 MallocForNvmf1 00:03:41.301 22:41:32 -- json_config/json_config.sh@298 -- # tgt_rpc nvmf_create_transport -t tcp -u 8192 -c 0 00:03:41.301 22:41:32 -- json_config/json_config.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock nvmf_create_transport -t tcp -u 8192 -c 0 00:03:41.558 [2024-04-16 22:41:32.498620] tcp.c: 659:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:03:41.558 22:41:32 -- json_config/json_config.sh@299 -- # tgt_rpc nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:03:41.558 22:41:32 -- json_config/json_config.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:03:41.815 22:41:32 -- json_config/json_config.sh@300 -- # tgt_rpc nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 MallocForNvmf0 00:03:41.815 22:41:32 -- json_config/json_config.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 MallocForNvmf0 00:03:42.073 22:41:32 -- json_config/json_config.sh@301 -- # tgt_rpc nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 MallocForNvmf1 00:03:42.073 22:41:32 -- json_config/json_config.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 MallocForNvmf1 00:03:42.330 22:41:33 -- json_config/json_config.sh@302 -- # tgt_rpc nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 127.0.0.1 -s 4420 00:03:42.330 22:41:33 -- json_config/json_config.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 127.0.0.1 -s 4420 00:03:42.330 [2024-04-16 22:41:33.437767] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 127.0.0.1 port 4420 *** 00:03:42.330 22:41:33 -- json_config/json_config.sh@304 -- # timing_exit create_nvmf_subsystem_config 00:03:42.330 22:41:33 -- common/autotest_common.sh@718 -- # xtrace_disable 00:03:42.330 22:41:33 -- common/autotest_common.sh@10 -- # set +x 00:03:42.587 22:41:33 -- json_config/json_config.sh@346 -- # timing_exit json_config_setup_target 00:03:42.587 22:41:33 -- common/autotest_common.sh@718 -- # xtrace_disable 00:03:42.587 22:41:33 -- common/autotest_common.sh@10 -- # set +x 00:03:42.587 22:41:33 -- json_config/json_config.sh@348 -- # [[ 0 -eq 1 ]] 00:03:42.587 22:41:33 -- json_config/json_config.sh@353 -- # tgt_rpc bdev_malloc_create 8 512 --name MallocBdevForConfigChangeCheck 00:03:42.587 22:41:33 -- json_config/json_config.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock bdev_malloc_create 8 512 --name MallocBdevForConfigChangeCheck 00:03:42.587 MallocBdevForConfigChangeCheck 00:03:42.845 22:41:33 -- json_config/json_config.sh@355 -- # timing_exit json_config_test_init 00:03:42.845 22:41:33 -- common/autotest_common.sh@718 -- # xtrace_disable 00:03:42.845 22:41:33 -- common/autotest_common.sh@10 -- # set +x 00:03:42.845 22:41:33 -- json_config/json_config.sh@422 -- # tgt_rpc save_config 00:03:42.845 22:41:33 -- json_config/json_config.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock save_config 00:03:43.102 22:41:34 -- json_config/json_config.sh@424 -- # echo 'INFO: shutting down applications...' 00:03:43.102 INFO: shutting down applications... 00:03:43.102 22:41:34 -- json_config/json_config.sh@425 -- # [[ 0 -eq 1 ]] 00:03:43.102 22:41:34 -- json_config/json_config.sh@431 -- # json_config_clear target 00:03:43.102 22:41:34 -- json_config/json_config.sh@385 -- # [[ -n 22 ]] 00:03:43.102 22:41:34 -- json_config/json_config.sh@386 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/clear_config.py -s /var/tmp/spdk_tgt.sock clear_config 00:03:44.997 Calling clear_iscsi_subsystem 00:03:44.997 Calling clear_nvmf_subsystem 00:03:44.997 Calling clear_nbd_subsystem 00:03:44.997 Calling clear_ublk_subsystem 00:03:44.997 Calling clear_vhost_blk_subsystem 00:03:44.997 Calling clear_vhost_scsi_subsystem 00:03:44.997 Calling clear_scheduler_subsystem 00:03:44.997 Calling clear_bdev_subsystem 00:03:44.997 Calling clear_accel_subsystem 00:03:44.997 Calling clear_vmd_subsystem 00:03:44.997 Calling clear_sock_subsystem 00:03:44.997 Calling clear_iobuf_subsystem 00:03:44.997 22:41:35 -- json_config/json_config.sh@390 -- # local config_filter=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/config_filter.py 00:03:44.997 22:41:35 -- json_config/json_config.sh@396 -- # count=100 00:03:44.997 22:41:35 -- json_config/json_config.sh@397 -- # '[' 100 -gt 0 ']' 00:03:44.997 22:41:35 -- json_config/json_config.sh@398 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock save_config 00:03:44.997 22:41:35 -- json_config/json_config.sh@398 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/config_filter.py -method delete_global_parameters 00:03:44.997 22:41:35 -- json_config/json_config.sh@398 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/config_filter.py -method check_empty 00:03:44.997 22:41:36 -- json_config/json_config.sh@398 -- # break 00:03:44.997 22:41:36 -- json_config/json_config.sh@403 -- # '[' 100 -eq 0 ']' 00:03:44.997 22:41:36 -- json_config/json_config.sh@432 -- # json_config_test_shutdown_app target 00:03:44.997 22:41:36 -- json_config/json_config.sh@120 -- # local app=target 00:03:44.997 22:41:36 -- json_config/json_config.sh@123 -- # [[ -n 22 ]] 00:03:44.997 22:41:36 -- json_config/json_config.sh@124 -- # [[ -n 151315 ]] 00:03:44.997 22:41:36 -- json_config/json_config.sh@127 -- # kill -SIGINT 151315 00:03:44.998 22:41:36 -- json_config/json_config.sh@129 -- # (( i = 0 )) 00:03:44.998 22:41:36 -- json_config/json_config.sh@129 -- # (( i < 30 )) 00:03:44.998 22:41:36 -- json_config/json_config.sh@130 -- # kill -0 151315 00:03:44.998 22:41:36 -- json_config/json_config.sh@134 -- # sleep 0.5 00:03:45.564 22:41:36 -- json_config/json_config.sh@129 -- # (( i++ )) 00:03:45.564 22:41:36 -- json_config/json_config.sh@129 -- # (( i < 30 )) 00:03:45.564 22:41:36 -- json_config/json_config.sh@130 -- # kill -0 151315 00:03:45.564 22:41:36 -- json_config/json_config.sh@131 -- # app_pid[$app]= 00:03:45.564 22:41:36 -- json_config/json_config.sh@132 -- # break 00:03:45.564 22:41:36 -- json_config/json_config.sh@137 -- # [[ -n '' ]] 00:03:45.564 22:41:36 -- json_config/json_config.sh@142 -- # echo 'SPDK target shutdown done' 00:03:45.564 SPDK target shutdown done 00:03:45.564 22:41:36 -- json_config/json_config.sh@434 -- # echo 'INFO: relaunching applications...' 00:03:45.564 INFO: relaunching applications... 00:03:45.564 22:41:36 -- json_config/json_config.sh@435 -- # json_config_test_start_app target --json /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/spdk_tgt_config.json 00:03:45.564 22:41:36 -- json_config/json_config.sh@98 -- # local app=target 00:03:45.564 22:41:36 -- json_config/json_config.sh@99 -- # shift 00:03:45.564 22:41:36 -- json_config/json_config.sh@101 -- # [[ -n 22 ]] 00:03:45.564 22:41:36 -- json_config/json_config.sh@102 -- # [[ -z '' ]] 00:03:45.564 22:41:36 -- json_config/json_config.sh@104 -- # local app_extra_params= 00:03:45.564 22:41:36 -- json_config/json_config.sh@105 -- # [[ 0 -eq 1 ]] 00:03:45.564 22:41:36 -- json_config/json_config.sh@105 -- # [[ 0 -eq 1 ]] 00:03:45.564 22:41:36 -- json_config/json_config.sh@111 -- # app_pid[$app]=152536 00:03:45.564 22:41:36 -- json_config/json_config.sh@110 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x1 -s 1024 -r /var/tmp/spdk_tgt.sock --json /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/spdk_tgt_config.json 00:03:45.564 22:41:36 -- json_config/json_config.sh@113 -- # echo 'Waiting for target to run...' 00:03:45.564 Waiting for target to run... 00:03:45.564 22:41:36 -- json_config/json_config.sh@114 -- # waitforlisten 152536 /var/tmp/spdk_tgt.sock 00:03:45.564 22:41:36 -- common/autotest_common.sh@819 -- # '[' -z 152536 ']' 00:03:45.564 22:41:36 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk_tgt.sock 00:03:45.565 22:41:36 -- common/autotest_common.sh@824 -- # local max_retries=100 00:03:45.565 22:41:36 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk_tgt.sock...' 00:03:45.565 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk_tgt.sock... 00:03:45.565 22:41:36 -- common/autotest_common.sh@828 -- # xtrace_disable 00:03:45.565 22:41:36 -- common/autotest_common.sh@10 -- # set +x 00:03:45.565 [2024-04-16 22:41:36.634278] Starting SPDK v24.01.1-pre git sha1 4b134b4ab / DPDK 23.11.0 initialization... 00:03:45.565 [2024-04-16 22:41:36.634364] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 -m 1024 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid152536 ] 00:03:45.565 EAL: No free 2048 kB hugepages reported on node 1 00:03:46.131 [2024-04-16 22:41:37.154562] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:03:46.131 [2024-04-16 22:41:37.256296] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:03:46.131 [2024-04-16 22:41:37.256453] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:03:49.412 [2024-04-16 22:41:40.292232] tcp.c: 659:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:03:49.413 [2024-04-16 22:41:40.324683] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 127.0.0.1 port 4420 *** 00:03:49.413 22:41:40 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:03:49.413 22:41:40 -- common/autotest_common.sh@852 -- # return 0 00:03:49.413 22:41:40 -- json_config/json_config.sh@115 -- # echo '' 00:03:49.413 00:03:49.413 22:41:40 -- json_config/json_config.sh@436 -- # [[ 0 -eq 1 ]] 00:03:49.413 22:41:40 -- json_config/json_config.sh@440 -- # echo 'INFO: Checking if target configuration is the same...' 00:03:49.413 INFO: Checking if target configuration is the same... 00:03:49.413 22:41:40 -- json_config/json_config.sh@441 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/json_diff.sh /dev/fd/62 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/spdk_tgt_config.json 00:03:49.413 22:41:40 -- json_config/json_config.sh@441 -- # tgt_rpc save_config 00:03:49.413 22:41:40 -- json_config/json_config.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock save_config 00:03:49.413 + '[' 2 -ne 2 ']' 00:03:49.413 +++ dirname /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/json_diff.sh 00:03:49.413 ++ readlink -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/../.. 00:03:49.413 + rootdir=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:03:49.413 +++ basename /dev/fd/62 00:03:49.413 ++ mktemp /tmp/62.XXX 00:03:49.413 + tmp_file_1=/tmp/62.6kU 00:03:49.413 +++ basename /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/spdk_tgt_config.json 00:03:49.413 ++ mktemp /tmp/spdk_tgt_config.json.XXX 00:03:49.413 + tmp_file_2=/tmp/spdk_tgt_config.json.cxW 00:03:49.413 + ret=0 00:03:49.413 + /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/config_filter.py -method sort 00:03:49.980 + /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/config_filter.py -method sort 00:03:49.980 + diff -u /tmp/62.6kU /tmp/spdk_tgt_config.json.cxW 00:03:49.980 + echo 'INFO: JSON config files are the same' 00:03:49.980 INFO: JSON config files are the same 00:03:49.980 + rm /tmp/62.6kU /tmp/spdk_tgt_config.json.cxW 00:03:49.980 + exit 0 00:03:49.980 22:41:40 -- json_config/json_config.sh@442 -- # [[ 0 -eq 1 ]] 00:03:49.980 22:41:40 -- json_config/json_config.sh@447 -- # echo 'INFO: changing configuration and checking if this can be detected...' 00:03:49.980 INFO: changing configuration and checking if this can be detected... 00:03:49.980 22:41:40 -- json_config/json_config.sh@449 -- # tgt_rpc bdev_malloc_delete MallocBdevForConfigChangeCheck 00:03:49.980 22:41:40 -- json_config/json_config.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock bdev_malloc_delete MallocBdevForConfigChangeCheck 00:03:49.980 22:41:41 -- json_config/json_config.sh@450 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/json_diff.sh /dev/fd/62 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/spdk_tgt_config.json 00:03:49.980 22:41:41 -- json_config/json_config.sh@450 -- # tgt_rpc save_config 00:03:49.980 22:41:41 -- json_config/json_config.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock save_config 00:03:49.980 + '[' 2 -ne 2 ']' 00:03:50.269 +++ dirname /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/json_diff.sh 00:03:50.269 ++ readlink -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/../.. 00:03:50.269 + rootdir=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:03:50.269 +++ basename /dev/fd/62 00:03:50.269 ++ mktemp /tmp/62.XXX 00:03:50.269 + tmp_file_1=/tmp/62.UlU 00:03:50.269 +++ basename /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/spdk_tgt_config.json 00:03:50.269 ++ mktemp /tmp/spdk_tgt_config.json.XXX 00:03:50.269 + tmp_file_2=/tmp/spdk_tgt_config.json.N51 00:03:50.269 + ret=0 00:03:50.269 + /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/config_filter.py -method sort 00:03:50.528 + /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/config_filter.py -method sort 00:03:50.528 + diff -u /tmp/62.UlU /tmp/spdk_tgt_config.json.N51 00:03:50.528 + ret=1 00:03:50.528 + echo '=== Start of file: /tmp/62.UlU ===' 00:03:50.528 + cat /tmp/62.UlU 00:03:50.528 + echo '=== End of file: /tmp/62.UlU ===' 00:03:50.528 + echo '' 00:03:50.528 + echo '=== Start of file: /tmp/spdk_tgt_config.json.N51 ===' 00:03:50.528 + cat /tmp/spdk_tgt_config.json.N51 00:03:50.528 + echo '=== End of file: /tmp/spdk_tgt_config.json.N51 ===' 00:03:50.528 + echo '' 00:03:50.528 + rm /tmp/62.UlU /tmp/spdk_tgt_config.json.N51 00:03:50.528 + exit 1 00:03:50.528 22:41:41 -- json_config/json_config.sh@454 -- # echo 'INFO: configuration change detected.' 00:03:50.528 INFO: configuration change detected. 00:03:50.528 22:41:41 -- json_config/json_config.sh@457 -- # json_config_test_fini 00:03:50.528 22:41:41 -- json_config/json_config.sh@359 -- # timing_enter json_config_test_fini 00:03:50.528 22:41:41 -- common/autotest_common.sh@712 -- # xtrace_disable 00:03:50.528 22:41:41 -- common/autotest_common.sh@10 -- # set +x 00:03:50.528 22:41:41 -- json_config/json_config.sh@360 -- # local ret=0 00:03:50.528 22:41:41 -- json_config/json_config.sh@362 -- # [[ -n '' ]] 00:03:50.528 22:41:41 -- json_config/json_config.sh@370 -- # [[ -n 152536 ]] 00:03:50.528 22:41:41 -- json_config/json_config.sh@373 -- # cleanup_bdev_subsystem_config 00:03:50.528 22:41:41 -- json_config/json_config.sh@237 -- # timing_enter cleanup_bdev_subsystem_config 00:03:50.528 22:41:41 -- common/autotest_common.sh@712 -- # xtrace_disable 00:03:50.529 22:41:41 -- common/autotest_common.sh@10 -- # set +x 00:03:50.529 22:41:41 -- json_config/json_config.sh@239 -- # [[ 0 -eq 1 ]] 00:03:50.529 22:41:41 -- json_config/json_config.sh@246 -- # uname -s 00:03:50.529 22:41:41 -- json_config/json_config.sh@246 -- # [[ Linux = Linux ]] 00:03:50.529 22:41:41 -- json_config/json_config.sh@247 -- # rm -f /sample_aio 00:03:50.529 22:41:41 -- json_config/json_config.sh@250 -- # [[ 0 -eq 1 ]] 00:03:50.529 22:41:41 -- json_config/json_config.sh@254 -- # timing_exit cleanup_bdev_subsystem_config 00:03:50.529 22:41:41 -- common/autotest_common.sh@718 -- # xtrace_disable 00:03:50.529 22:41:41 -- common/autotest_common.sh@10 -- # set +x 00:03:50.529 22:41:41 -- json_config/json_config.sh@376 -- # killprocess 152536 00:03:50.529 22:41:41 -- common/autotest_common.sh@926 -- # '[' -z 152536 ']' 00:03:50.529 22:41:41 -- common/autotest_common.sh@930 -- # kill -0 152536 00:03:50.529 22:41:41 -- common/autotest_common.sh@931 -- # uname 00:03:50.529 22:41:41 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:03:50.529 22:41:41 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 152536 00:03:50.529 22:41:41 -- common/autotest_common.sh@932 -- # process_name=reactor_0 00:03:50.529 22:41:41 -- common/autotest_common.sh@936 -- # '[' reactor_0 = sudo ']' 00:03:50.529 22:41:41 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 152536' 00:03:50.529 killing process with pid 152536 00:03:50.529 22:41:41 -- common/autotest_common.sh@945 -- # kill 152536 00:03:50.529 22:41:41 -- common/autotest_common.sh@950 -- # wait 152536 00:03:52.426 22:41:43 -- json_config/json_config.sh@379 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/spdk_initiator_config.json /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/spdk_tgt_config.json 00:03:52.426 22:41:43 -- json_config/json_config.sh@380 -- # timing_exit json_config_test_fini 00:03:52.426 22:41:43 -- common/autotest_common.sh@718 -- # xtrace_disable 00:03:52.426 22:41:43 -- common/autotest_common.sh@10 -- # set +x 00:03:52.426 22:41:43 -- json_config/json_config.sh@381 -- # return 0 00:03:52.426 22:41:43 -- json_config/json_config.sh@459 -- # echo 'INFO: Success' 00:03:52.426 INFO: Success 00:03:52.426 00:03:52.426 real 0m15.941s 00:03:52.426 user 0m18.022s 00:03:52.426 sys 0m2.231s 00:03:52.426 22:41:43 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:03:52.426 22:41:43 -- common/autotest_common.sh@10 -- # set +x 00:03:52.426 ************************************ 00:03:52.426 END TEST json_config 00:03:52.426 ************************************ 00:03:52.426 22:41:43 -- spdk/autotest.sh@179 -- # run_test json_config_extra_key /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/json_config_extra_key.sh 00:03:52.426 22:41:43 -- common/autotest_common.sh@1077 -- # '[' 2 -le 1 ']' 00:03:52.426 22:41:43 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:03:52.426 22:41:43 -- common/autotest_common.sh@10 -- # set +x 00:03:52.426 ************************************ 00:03:52.426 START TEST json_config_extra_key 00:03:52.426 ************************************ 00:03:52.426 22:41:43 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/json_config_extra_key.sh 00:03:52.426 22:41:43 -- json_config/json_config_extra_key.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:03:52.426 22:41:43 -- nvmf/common.sh@7 -- # uname -s 00:03:52.426 22:41:43 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:03:52.426 22:41:43 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:03:52.426 22:41:43 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:03:52.426 22:41:43 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:03:52.426 22:41:43 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:03:52.426 22:41:43 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:03:52.426 22:41:43 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:03:52.426 22:41:43 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:03:52.426 22:41:43 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:03:52.426 22:41:43 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:03:52.426 22:41:43 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:03:52.426 22:41:43 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:03:52.426 22:41:43 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:03:52.426 22:41:43 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:03:52.426 22:41:43 -- nvmf/common.sh@21 -- # NET_TYPE=phy-fallback 00:03:52.426 22:41:43 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:03:52.426 22:41:43 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:03:52.426 22:41:43 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:03:52.426 22:41:43 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:03:52.426 22:41:43 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:03:52.426 22:41:43 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:03:52.426 22:41:43 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:03:52.426 22:41:43 -- paths/export.sh@5 -- # export PATH 00:03:52.426 22:41:43 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:03:52.426 22:41:43 -- nvmf/common.sh@46 -- # : 0 00:03:52.426 22:41:43 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:03:52.426 22:41:43 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:03:52.426 22:41:43 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:03:52.426 22:41:43 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:03:52.426 22:41:43 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:03:52.427 22:41:43 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:03:52.427 22:41:43 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:03:52.427 22:41:43 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:03:52.427 22:41:43 -- json_config/json_config_extra_key.sh@16 -- # app_pid=(['target']='') 00:03:52.427 22:41:43 -- json_config/json_config_extra_key.sh@16 -- # declare -A app_pid 00:03:52.427 22:41:43 -- json_config/json_config_extra_key.sh@17 -- # app_socket=(['target']='/var/tmp/spdk_tgt.sock') 00:03:52.427 22:41:43 -- json_config/json_config_extra_key.sh@17 -- # declare -A app_socket 00:03:52.427 22:41:43 -- json_config/json_config_extra_key.sh@18 -- # app_params=(['target']='-m 0x1 -s 1024') 00:03:52.427 22:41:43 -- json_config/json_config_extra_key.sh@18 -- # declare -A app_params 00:03:52.427 22:41:43 -- json_config/json_config_extra_key.sh@19 -- # configs_path=(['target']='/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/extra_key.json') 00:03:52.427 22:41:43 -- json_config/json_config_extra_key.sh@19 -- # declare -A configs_path 00:03:52.427 22:41:43 -- json_config/json_config_extra_key.sh@74 -- # trap 'on_error_exit "${FUNCNAME}" "${LINENO}"' ERR 00:03:52.427 22:41:43 -- json_config/json_config_extra_key.sh@76 -- # echo 'INFO: launching applications...' 00:03:52.427 INFO: launching applications... 00:03:52.427 22:41:43 -- json_config/json_config_extra_key.sh@77 -- # json_config_test_start_app target --json /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/extra_key.json 00:03:52.427 22:41:43 -- json_config/json_config_extra_key.sh@24 -- # local app=target 00:03:52.427 22:41:43 -- json_config/json_config_extra_key.sh@25 -- # shift 00:03:52.427 22:41:43 -- json_config/json_config_extra_key.sh@27 -- # [[ -n 22 ]] 00:03:52.427 22:41:43 -- json_config/json_config_extra_key.sh@28 -- # [[ -z '' ]] 00:03:52.427 22:41:43 -- json_config/json_config_extra_key.sh@31 -- # app_pid[$app]=153477 00:03:52.427 22:41:43 -- json_config/json_config_extra_key.sh@33 -- # echo 'Waiting for target to run...' 00:03:52.427 22:41:43 -- json_config/json_config_extra_key.sh@30 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x1 -s 1024 -r /var/tmp/spdk_tgt.sock --json /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/extra_key.json 00:03:52.427 Waiting for target to run... 00:03:52.427 22:41:43 -- json_config/json_config_extra_key.sh@34 -- # waitforlisten 153477 /var/tmp/spdk_tgt.sock 00:03:52.427 22:41:43 -- common/autotest_common.sh@819 -- # '[' -z 153477 ']' 00:03:52.427 22:41:43 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk_tgt.sock 00:03:52.427 22:41:43 -- common/autotest_common.sh@824 -- # local max_retries=100 00:03:52.427 22:41:43 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk_tgt.sock...' 00:03:52.427 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk_tgt.sock... 00:03:52.427 22:41:43 -- common/autotest_common.sh@828 -- # xtrace_disable 00:03:52.427 22:41:43 -- common/autotest_common.sh@10 -- # set +x 00:03:52.427 [2024-04-16 22:41:43.381721] Starting SPDK v24.01.1-pre git sha1 4b134b4ab / DPDK 23.11.0 initialization... 00:03:52.427 [2024-04-16 22:41:43.381815] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 -m 1024 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid153477 ] 00:03:52.427 EAL: No free 2048 kB hugepages reported on node 1 00:03:52.685 [2024-04-16 22:41:43.727033] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:03:52.943 [2024-04-16 22:41:43.815401] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:03:52.943 [2024-04-16 22:41:43.815573] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:03:53.201 22:41:44 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:03:53.201 22:41:44 -- common/autotest_common.sh@852 -- # return 0 00:03:53.201 22:41:44 -- json_config/json_config_extra_key.sh@35 -- # echo '' 00:03:53.201 00:03:53.201 22:41:44 -- json_config/json_config_extra_key.sh@79 -- # echo 'INFO: shutting down applications...' 00:03:53.201 INFO: shutting down applications... 00:03:53.201 22:41:44 -- json_config/json_config_extra_key.sh@80 -- # json_config_test_shutdown_app target 00:03:53.201 22:41:44 -- json_config/json_config_extra_key.sh@40 -- # local app=target 00:03:53.201 22:41:44 -- json_config/json_config_extra_key.sh@43 -- # [[ -n 22 ]] 00:03:53.201 22:41:44 -- json_config/json_config_extra_key.sh@44 -- # [[ -n 153477 ]] 00:03:53.201 22:41:44 -- json_config/json_config_extra_key.sh@47 -- # kill -SIGINT 153477 00:03:53.201 22:41:44 -- json_config/json_config_extra_key.sh@49 -- # (( i = 0 )) 00:03:53.201 22:41:44 -- json_config/json_config_extra_key.sh@49 -- # (( i < 30 )) 00:03:53.201 22:41:44 -- json_config/json_config_extra_key.sh@50 -- # kill -0 153477 00:03:53.201 22:41:44 -- json_config/json_config_extra_key.sh@54 -- # sleep 0.5 00:03:53.767 22:41:44 -- json_config/json_config_extra_key.sh@49 -- # (( i++ )) 00:03:53.767 22:41:44 -- json_config/json_config_extra_key.sh@49 -- # (( i < 30 )) 00:03:53.767 22:41:44 -- json_config/json_config_extra_key.sh@50 -- # kill -0 153477 00:03:53.767 22:41:44 -- json_config/json_config_extra_key.sh@54 -- # sleep 0.5 00:03:54.333 22:41:45 -- json_config/json_config_extra_key.sh@49 -- # (( i++ )) 00:03:54.333 22:41:45 -- json_config/json_config_extra_key.sh@49 -- # (( i < 30 )) 00:03:54.333 22:41:45 -- json_config/json_config_extra_key.sh@50 -- # kill -0 153477 00:03:54.333 22:41:45 -- json_config/json_config_extra_key.sh@51 -- # app_pid[$app]= 00:03:54.333 22:41:45 -- json_config/json_config_extra_key.sh@52 -- # break 00:03:54.333 22:41:45 -- json_config/json_config_extra_key.sh@57 -- # [[ -n '' ]] 00:03:54.333 22:41:45 -- json_config/json_config_extra_key.sh@62 -- # echo 'SPDK target shutdown done' 00:03:54.333 SPDK target shutdown done 00:03:54.333 22:41:45 -- json_config/json_config_extra_key.sh@82 -- # echo Success 00:03:54.333 Success 00:03:54.333 00:03:54.333 real 0m2.017s 00:03:54.333 user 0m1.511s 00:03:54.333 sys 0m0.425s 00:03:54.334 22:41:45 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:03:54.334 22:41:45 -- common/autotest_common.sh@10 -- # set +x 00:03:54.334 ************************************ 00:03:54.334 END TEST json_config_extra_key 00:03:54.334 ************************************ 00:03:54.334 22:41:45 -- spdk/autotest.sh@180 -- # run_test alias_rpc /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/alias_rpc/alias_rpc.sh 00:03:54.334 22:41:45 -- common/autotest_common.sh@1077 -- # '[' 2 -le 1 ']' 00:03:54.334 22:41:45 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:03:54.334 22:41:45 -- common/autotest_common.sh@10 -- # set +x 00:03:54.334 ************************************ 00:03:54.334 START TEST alias_rpc 00:03:54.334 ************************************ 00:03:54.334 22:41:45 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/alias_rpc/alias_rpc.sh 00:03:54.334 * Looking for test storage... 00:03:54.334 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/alias_rpc 00:03:54.334 22:41:45 -- alias_rpc/alias_rpc.sh@10 -- # trap 'killprocess $spdk_tgt_pid; exit 1' ERR 00:03:54.334 22:41:45 -- alias_rpc/alias_rpc.sh@13 -- # spdk_tgt_pid=153795 00:03:54.334 22:41:45 -- alias_rpc/alias_rpc.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt 00:03:54.334 22:41:45 -- alias_rpc/alias_rpc.sh@14 -- # waitforlisten 153795 00:03:54.334 22:41:45 -- common/autotest_common.sh@819 -- # '[' -z 153795 ']' 00:03:54.334 22:41:45 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk.sock 00:03:54.334 22:41:45 -- common/autotest_common.sh@824 -- # local max_retries=100 00:03:54.334 22:41:45 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:03:54.334 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:03:54.334 22:41:45 -- common/autotest_common.sh@828 -- # xtrace_disable 00:03:54.334 22:41:45 -- common/autotest_common.sh@10 -- # set +x 00:03:54.334 [2024-04-16 22:41:45.427446] Starting SPDK v24.01.1-pre git sha1 4b134b4ab / DPDK 23.11.0 initialization... 00:03:54.334 [2024-04-16 22:41:45.427551] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid153795 ] 00:03:54.334 EAL: No free 2048 kB hugepages reported on node 1 00:03:54.592 [2024-04-16 22:41:45.483975] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:03:54.592 [2024-04-16 22:41:45.587947] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:03:54.592 [2024-04-16 22:41:45.588107] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:03:55.524 22:41:46 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:03:55.524 22:41:46 -- common/autotest_common.sh@852 -- # return 0 00:03:55.524 22:41:46 -- alias_rpc/alias_rpc.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py load_config -i 00:03:55.524 22:41:46 -- alias_rpc/alias_rpc.sh@19 -- # killprocess 153795 00:03:55.524 22:41:46 -- common/autotest_common.sh@926 -- # '[' -z 153795 ']' 00:03:55.524 22:41:46 -- common/autotest_common.sh@930 -- # kill -0 153795 00:03:55.524 22:41:46 -- common/autotest_common.sh@931 -- # uname 00:03:55.524 22:41:46 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:03:55.524 22:41:46 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 153795 00:03:55.524 22:41:46 -- common/autotest_common.sh@932 -- # process_name=reactor_0 00:03:55.524 22:41:46 -- common/autotest_common.sh@936 -- # '[' reactor_0 = sudo ']' 00:03:55.524 22:41:46 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 153795' 00:03:55.524 killing process with pid 153795 00:03:55.524 22:41:46 -- common/autotest_common.sh@945 -- # kill 153795 00:03:55.524 22:41:46 -- common/autotest_common.sh@950 -- # wait 153795 00:03:56.089 00:03:56.089 real 0m1.765s 00:03:56.089 user 0m2.021s 00:03:56.089 sys 0m0.450s 00:03:56.089 22:41:47 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:03:56.089 22:41:47 -- common/autotest_common.sh@10 -- # set +x 00:03:56.089 ************************************ 00:03:56.089 END TEST alias_rpc 00:03:56.089 ************************************ 00:03:56.089 22:41:47 -- spdk/autotest.sh@182 -- # [[ 0 -eq 0 ]] 00:03:56.089 22:41:47 -- spdk/autotest.sh@183 -- # run_test spdkcli_tcp /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/spdkcli/tcp.sh 00:03:56.089 22:41:47 -- common/autotest_common.sh@1077 -- # '[' 2 -le 1 ']' 00:03:56.089 22:41:47 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:03:56.089 22:41:47 -- common/autotest_common.sh@10 -- # set +x 00:03:56.089 ************************************ 00:03:56.089 START TEST spdkcli_tcp 00:03:56.089 ************************************ 00:03:56.089 22:41:47 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/spdkcli/tcp.sh 00:03:56.089 * Looking for test storage... 00:03:56.089 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/spdkcli 00:03:56.089 22:41:47 -- spdkcli/tcp.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/spdkcli/common.sh 00:03:56.089 22:41:47 -- spdkcli/common.sh@6 -- # spdkcli_job=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/spdkcli/spdkcli_job.py 00:03:56.089 22:41:47 -- spdkcli/common.sh@7 -- # spdk_clear_config_py=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/clear_config.py 00:03:56.089 22:41:47 -- spdkcli/tcp.sh@18 -- # IP_ADDRESS=127.0.0.1 00:03:56.089 22:41:47 -- spdkcli/tcp.sh@19 -- # PORT=9998 00:03:56.089 22:41:47 -- spdkcli/tcp.sh@21 -- # trap 'err_cleanup; exit 1' SIGINT SIGTERM EXIT 00:03:56.089 22:41:47 -- spdkcli/tcp.sh@23 -- # timing_enter run_spdk_tgt_tcp 00:03:56.089 22:41:47 -- common/autotest_common.sh@712 -- # xtrace_disable 00:03:56.089 22:41:47 -- common/autotest_common.sh@10 -- # set +x 00:03:56.089 22:41:47 -- spdkcli/tcp.sh@25 -- # spdk_tgt_pid=154017 00:03:56.089 22:41:47 -- spdkcli/tcp.sh@24 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x3 -p 0 00:03:56.089 22:41:47 -- spdkcli/tcp.sh@27 -- # waitforlisten 154017 00:03:56.089 22:41:47 -- common/autotest_common.sh@819 -- # '[' -z 154017 ']' 00:03:56.089 22:41:47 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk.sock 00:03:56.089 22:41:47 -- common/autotest_common.sh@824 -- # local max_retries=100 00:03:56.089 22:41:47 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:03:56.089 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:03:56.089 22:41:47 -- common/autotest_common.sh@828 -- # xtrace_disable 00:03:56.089 22:41:47 -- common/autotest_common.sh@10 -- # set +x 00:03:56.347 [2024-04-16 22:41:47.220712] Starting SPDK v24.01.1-pre git sha1 4b134b4ab / DPDK 23.11.0 initialization... 00:03:56.347 [2024-04-16 22:41:47.220799] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x3 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid154017 ] 00:03:56.347 EAL: No free 2048 kB hugepages reported on node 1 00:03:56.347 [2024-04-16 22:41:47.286328] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 2 00:03:56.347 [2024-04-16 22:41:47.391010] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:03:56.347 [2024-04-16 22:41:47.391312] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:03:56.347 [2024-04-16 22:41:47.391317] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:03:57.279 22:41:48 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:03:57.279 22:41:48 -- common/autotest_common.sh@852 -- # return 0 00:03:57.279 22:41:48 -- spdkcli/tcp.sh@31 -- # socat_pid=154132 00:03:57.279 22:41:48 -- spdkcli/tcp.sh@30 -- # socat TCP-LISTEN:9998 UNIX-CONNECT:/var/tmp/spdk.sock 00:03:57.279 22:41:48 -- spdkcli/tcp.sh@33 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -r 100 -t 2 -s 127.0.0.1 -p 9998 rpc_get_methods 00:03:57.537 [ 00:03:57.537 "bdev_malloc_delete", 00:03:57.537 "bdev_malloc_create", 00:03:57.537 "bdev_null_resize", 00:03:57.537 "bdev_null_delete", 00:03:57.537 "bdev_null_create", 00:03:57.537 "bdev_nvme_cuse_unregister", 00:03:57.537 "bdev_nvme_cuse_register", 00:03:57.537 "bdev_opal_new_user", 00:03:57.537 "bdev_opal_set_lock_state", 00:03:57.537 "bdev_opal_delete", 00:03:57.537 "bdev_opal_get_info", 00:03:57.537 "bdev_opal_create", 00:03:57.537 "bdev_nvme_opal_revert", 00:03:57.537 "bdev_nvme_opal_init", 00:03:57.537 "bdev_nvme_send_cmd", 00:03:57.537 "bdev_nvme_get_path_iostat", 00:03:57.537 "bdev_nvme_get_mdns_discovery_info", 00:03:57.537 "bdev_nvme_stop_mdns_discovery", 00:03:57.537 "bdev_nvme_start_mdns_discovery", 00:03:57.537 "bdev_nvme_set_multipath_policy", 00:03:57.537 "bdev_nvme_set_preferred_path", 00:03:57.537 "bdev_nvme_get_io_paths", 00:03:57.537 "bdev_nvme_remove_error_injection", 00:03:57.537 "bdev_nvme_add_error_injection", 00:03:57.537 "bdev_nvme_get_discovery_info", 00:03:57.537 "bdev_nvme_stop_discovery", 00:03:57.537 "bdev_nvme_start_discovery", 00:03:57.537 "bdev_nvme_get_controller_health_info", 00:03:57.537 "bdev_nvme_disable_controller", 00:03:57.537 "bdev_nvme_enable_controller", 00:03:57.537 "bdev_nvme_reset_controller", 00:03:57.537 "bdev_nvme_get_transport_statistics", 00:03:57.537 "bdev_nvme_apply_firmware", 00:03:57.537 "bdev_nvme_detach_controller", 00:03:57.537 "bdev_nvme_get_controllers", 00:03:57.537 "bdev_nvme_attach_controller", 00:03:57.537 "bdev_nvme_set_hotplug", 00:03:57.537 "bdev_nvme_set_options", 00:03:57.537 "bdev_passthru_delete", 00:03:57.537 "bdev_passthru_create", 00:03:57.537 "bdev_lvol_grow_lvstore", 00:03:57.537 "bdev_lvol_get_lvols", 00:03:57.537 "bdev_lvol_get_lvstores", 00:03:57.537 "bdev_lvol_delete", 00:03:57.537 "bdev_lvol_set_read_only", 00:03:57.537 "bdev_lvol_resize", 00:03:57.537 "bdev_lvol_decouple_parent", 00:03:57.537 "bdev_lvol_inflate", 00:03:57.537 "bdev_lvol_rename", 00:03:57.537 "bdev_lvol_clone_bdev", 00:03:57.537 "bdev_lvol_clone", 00:03:57.537 "bdev_lvol_snapshot", 00:03:57.537 "bdev_lvol_create", 00:03:57.537 "bdev_lvol_delete_lvstore", 00:03:57.537 "bdev_lvol_rename_lvstore", 00:03:57.537 "bdev_lvol_create_lvstore", 00:03:57.537 "bdev_raid_set_options", 00:03:57.537 "bdev_raid_remove_base_bdev", 00:03:57.537 "bdev_raid_add_base_bdev", 00:03:57.537 "bdev_raid_delete", 00:03:57.537 "bdev_raid_create", 00:03:57.537 "bdev_raid_get_bdevs", 00:03:57.537 "bdev_error_inject_error", 00:03:57.537 "bdev_error_delete", 00:03:57.537 "bdev_error_create", 00:03:57.537 "bdev_split_delete", 00:03:57.537 "bdev_split_create", 00:03:57.537 "bdev_delay_delete", 00:03:57.537 "bdev_delay_create", 00:03:57.537 "bdev_delay_update_latency", 00:03:57.537 "bdev_zone_block_delete", 00:03:57.537 "bdev_zone_block_create", 00:03:57.537 "blobfs_create", 00:03:57.537 "blobfs_detect", 00:03:57.537 "blobfs_set_cache_size", 00:03:57.537 "bdev_aio_delete", 00:03:57.537 "bdev_aio_rescan", 00:03:57.537 "bdev_aio_create", 00:03:57.537 "bdev_ftl_set_property", 00:03:57.537 "bdev_ftl_get_properties", 00:03:57.537 "bdev_ftl_get_stats", 00:03:57.537 "bdev_ftl_unmap", 00:03:57.537 "bdev_ftl_unload", 00:03:57.537 "bdev_ftl_delete", 00:03:57.537 "bdev_ftl_load", 00:03:57.537 "bdev_ftl_create", 00:03:57.537 "bdev_virtio_attach_controller", 00:03:57.537 "bdev_virtio_scsi_get_devices", 00:03:57.537 "bdev_virtio_detach_controller", 00:03:57.537 "bdev_virtio_blk_set_hotplug", 00:03:57.537 "bdev_iscsi_delete", 00:03:57.537 "bdev_iscsi_create", 00:03:57.537 "bdev_iscsi_set_options", 00:03:57.537 "accel_error_inject_error", 00:03:57.537 "ioat_scan_accel_module", 00:03:57.537 "dsa_scan_accel_module", 00:03:57.537 "iaa_scan_accel_module", 00:03:57.537 "iscsi_set_options", 00:03:57.537 "iscsi_get_auth_groups", 00:03:57.537 "iscsi_auth_group_remove_secret", 00:03:57.537 "iscsi_auth_group_add_secret", 00:03:57.537 "iscsi_delete_auth_group", 00:03:57.537 "iscsi_create_auth_group", 00:03:57.537 "iscsi_set_discovery_auth", 00:03:57.537 "iscsi_get_options", 00:03:57.537 "iscsi_target_node_request_logout", 00:03:57.537 "iscsi_target_node_set_redirect", 00:03:57.537 "iscsi_target_node_set_auth", 00:03:57.538 "iscsi_target_node_add_lun", 00:03:57.538 "iscsi_get_connections", 00:03:57.538 "iscsi_portal_group_set_auth", 00:03:57.538 "iscsi_start_portal_group", 00:03:57.538 "iscsi_delete_portal_group", 00:03:57.538 "iscsi_create_portal_group", 00:03:57.538 "iscsi_get_portal_groups", 00:03:57.538 "iscsi_delete_target_node", 00:03:57.538 "iscsi_target_node_remove_pg_ig_maps", 00:03:57.538 "iscsi_target_node_add_pg_ig_maps", 00:03:57.538 "iscsi_create_target_node", 00:03:57.538 "iscsi_get_target_nodes", 00:03:57.538 "iscsi_delete_initiator_group", 00:03:57.538 "iscsi_initiator_group_remove_initiators", 00:03:57.538 "iscsi_initiator_group_add_initiators", 00:03:57.538 "iscsi_create_initiator_group", 00:03:57.538 "iscsi_get_initiator_groups", 00:03:57.538 "nvmf_set_crdt", 00:03:57.538 "nvmf_set_config", 00:03:57.538 "nvmf_set_max_subsystems", 00:03:57.538 "nvmf_subsystem_get_listeners", 00:03:57.538 "nvmf_subsystem_get_qpairs", 00:03:57.538 "nvmf_subsystem_get_controllers", 00:03:57.538 "nvmf_get_stats", 00:03:57.538 "nvmf_get_transports", 00:03:57.538 "nvmf_create_transport", 00:03:57.538 "nvmf_get_targets", 00:03:57.538 "nvmf_delete_target", 00:03:57.538 "nvmf_create_target", 00:03:57.538 "nvmf_subsystem_allow_any_host", 00:03:57.538 "nvmf_subsystem_remove_host", 00:03:57.538 "nvmf_subsystem_add_host", 00:03:57.538 "nvmf_subsystem_remove_ns", 00:03:57.538 "nvmf_subsystem_add_ns", 00:03:57.538 "nvmf_subsystem_listener_set_ana_state", 00:03:57.538 "nvmf_discovery_get_referrals", 00:03:57.538 "nvmf_discovery_remove_referral", 00:03:57.538 "nvmf_discovery_add_referral", 00:03:57.538 "nvmf_subsystem_remove_listener", 00:03:57.538 "nvmf_subsystem_add_listener", 00:03:57.538 "nvmf_delete_subsystem", 00:03:57.538 "nvmf_create_subsystem", 00:03:57.538 "nvmf_get_subsystems", 00:03:57.538 "env_dpdk_get_mem_stats", 00:03:57.538 "nbd_get_disks", 00:03:57.538 "nbd_stop_disk", 00:03:57.538 "nbd_start_disk", 00:03:57.538 "ublk_recover_disk", 00:03:57.538 "ublk_get_disks", 00:03:57.538 "ublk_stop_disk", 00:03:57.538 "ublk_start_disk", 00:03:57.538 "ublk_destroy_target", 00:03:57.538 "ublk_create_target", 00:03:57.538 "virtio_blk_create_transport", 00:03:57.538 "virtio_blk_get_transports", 00:03:57.538 "vhost_controller_set_coalescing", 00:03:57.538 "vhost_get_controllers", 00:03:57.538 "vhost_delete_controller", 00:03:57.538 "vhost_create_blk_controller", 00:03:57.538 "vhost_scsi_controller_remove_target", 00:03:57.538 "vhost_scsi_controller_add_target", 00:03:57.538 "vhost_start_scsi_controller", 00:03:57.538 "vhost_create_scsi_controller", 00:03:57.538 "thread_set_cpumask", 00:03:57.538 "framework_get_scheduler", 00:03:57.538 "framework_set_scheduler", 00:03:57.538 "framework_get_reactors", 00:03:57.538 "thread_get_io_channels", 00:03:57.538 "thread_get_pollers", 00:03:57.538 "thread_get_stats", 00:03:57.538 "framework_monitor_context_switch", 00:03:57.538 "spdk_kill_instance", 00:03:57.538 "log_enable_timestamps", 00:03:57.538 "log_get_flags", 00:03:57.538 "log_clear_flag", 00:03:57.538 "log_set_flag", 00:03:57.538 "log_get_level", 00:03:57.538 "log_set_level", 00:03:57.538 "log_get_print_level", 00:03:57.538 "log_set_print_level", 00:03:57.538 "framework_enable_cpumask_locks", 00:03:57.538 "framework_disable_cpumask_locks", 00:03:57.538 "framework_wait_init", 00:03:57.538 "framework_start_init", 00:03:57.538 "scsi_get_devices", 00:03:57.538 "bdev_get_histogram", 00:03:57.538 "bdev_enable_histogram", 00:03:57.538 "bdev_set_qos_limit", 00:03:57.538 "bdev_set_qd_sampling_period", 00:03:57.538 "bdev_get_bdevs", 00:03:57.538 "bdev_reset_iostat", 00:03:57.538 "bdev_get_iostat", 00:03:57.538 "bdev_examine", 00:03:57.538 "bdev_wait_for_examine", 00:03:57.538 "bdev_set_options", 00:03:57.538 "notify_get_notifications", 00:03:57.538 "notify_get_types", 00:03:57.538 "accel_get_stats", 00:03:57.538 "accel_set_options", 00:03:57.538 "accel_set_driver", 00:03:57.538 "accel_crypto_key_destroy", 00:03:57.538 "accel_crypto_keys_get", 00:03:57.538 "accel_crypto_key_create", 00:03:57.538 "accel_assign_opc", 00:03:57.538 "accel_get_module_info", 00:03:57.538 "accel_get_opc_assignments", 00:03:57.538 "vmd_rescan", 00:03:57.538 "vmd_remove_device", 00:03:57.538 "vmd_enable", 00:03:57.538 "sock_set_default_impl", 00:03:57.538 "sock_impl_set_options", 00:03:57.538 "sock_impl_get_options", 00:03:57.538 "iobuf_get_stats", 00:03:57.538 "iobuf_set_options", 00:03:57.538 "framework_get_pci_devices", 00:03:57.538 "framework_get_config", 00:03:57.538 "framework_get_subsystems", 00:03:57.538 "trace_get_info", 00:03:57.538 "trace_get_tpoint_group_mask", 00:03:57.538 "trace_disable_tpoint_group", 00:03:57.538 "trace_enable_tpoint_group", 00:03:57.538 "trace_clear_tpoint_mask", 00:03:57.538 "trace_set_tpoint_mask", 00:03:57.538 "spdk_get_version", 00:03:57.538 "rpc_get_methods" 00:03:57.538 ] 00:03:57.538 22:41:48 -- spdkcli/tcp.sh@35 -- # timing_exit run_spdk_tgt_tcp 00:03:57.538 22:41:48 -- common/autotest_common.sh@718 -- # xtrace_disable 00:03:57.538 22:41:48 -- common/autotest_common.sh@10 -- # set +x 00:03:57.538 22:41:48 -- spdkcli/tcp.sh@37 -- # trap - SIGINT SIGTERM EXIT 00:03:57.538 22:41:48 -- spdkcli/tcp.sh@38 -- # killprocess 154017 00:03:57.538 22:41:48 -- common/autotest_common.sh@926 -- # '[' -z 154017 ']' 00:03:57.538 22:41:48 -- common/autotest_common.sh@930 -- # kill -0 154017 00:03:57.538 22:41:48 -- common/autotest_common.sh@931 -- # uname 00:03:57.538 22:41:48 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:03:57.538 22:41:48 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 154017 00:03:57.538 22:41:48 -- common/autotest_common.sh@932 -- # process_name=reactor_0 00:03:57.538 22:41:48 -- common/autotest_common.sh@936 -- # '[' reactor_0 = sudo ']' 00:03:57.538 22:41:48 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 154017' 00:03:57.538 killing process with pid 154017 00:03:57.538 22:41:48 -- common/autotest_common.sh@945 -- # kill 154017 00:03:57.538 22:41:48 -- common/autotest_common.sh@950 -- # wait 154017 00:03:58.102 00:03:58.103 real 0m1.826s 00:03:58.103 user 0m3.524s 00:03:58.103 sys 0m0.492s 00:03:58.103 22:41:48 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:03:58.103 22:41:48 -- common/autotest_common.sh@10 -- # set +x 00:03:58.103 ************************************ 00:03:58.103 END TEST spdkcli_tcp 00:03:58.103 ************************************ 00:03:58.103 22:41:48 -- spdk/autotest.sh@186 -- # run_test dpdk_mem_utility /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/dpdk_memory_utility/test_dpdk_mem_info.sh 00:03:58.103 22:41:48 -- common/autotest_common.sh@1077 -- # '[' 2 -le 1 ']' 00:03:58.103 22:41:48 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:03:58.103 22:41:48 -- common/autotest_common.sh@10 -- # set +x 00:03:58.103 ************************************ 00:03:58.103 START TEST dpdk_mem_utility 00:03:58.103 ************************************ 00:03:58.103 22:41:48 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/dpdk_memory_utility/test_dpdk_mem_info.sh 00:03:58.103 * Looking for test storage... 00:03:58.103 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/dpdk_memory_utility 00:03:58.103 22:41:49 -- dpdk_memory_utility/test_dpdk_mem_info.sh@10 -- # MEM_SCRIPT=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/dpdk_mem_info.py 00:03:58.103 22:41:49 -- dpdk_memory_utility/test_dpdk_mem_info.sh@13 -- # spdkpid=154325 00:03:58.103 22:41:49 -- dpdk_memory_utility/test_dpdk_mem_info.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt 00:03:58.103 22:41:49 -- dpdk_memory_utility/test_dpdk_mem_info.sh@15 -- # waitforlisten 154325 00:03:58.103 22:41:49 -- common/autotest_common.sh@819 -- # '[' -z 154325 ']' 00:03:58.103 22:41:49 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk.sock 00:03:58.103 22:41:49 -- common/autotest_common.sh@824 -- # local max_retries=100 00:03:58.103 22:41:49 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:03:58.103 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:03:58.103 22:41:49 -- common/autotest_common.sh@828 -- # xtrace_disable 00:03:58.103 22:41:49 -- common/autotest_common.sh@10 -- # set +x 00:03:58.103 [2024-04-16 22:41:49.061610] Starting SPDK v24.01.1-pre git sha1 4b134b4ab / DPDK 23.11.0 initialization... 00:03:58.103 [2024-04-16 22:41:49.061709] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid154325 ] 00:03:58.103 EAL: No free 2048 kB hugepages reported on node 1 00:03:58.103 [2024-04-16 22:41:49.123671] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:03:58.361 [2024-04-16 22:41:49.240183] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:03:58.361 [2024-04-16 22:41:49.240340] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:03:58.926 22:41:49 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:03:58.926 22:41:49 -- common/autotest_common.sh@852 -- # return 0 00:03:58.926 22:41:49 -- dpdk_memory_utility/test_dpdk_mem_info.sh@17 -- # trap 'killprocess $spdkpid' SIGINT SIGTERM EXIT 00:03:58.926 22:41:49 -- dpdk_memory_utility/test_dpdk_mem_info.sh@19 -- # rpc_cmd env_dpdk_get_mem_stats 00:03:58.926 22:41:49 -- common/autotest_common.sh@551 -- # xtrace_disable 00:03:58.926 22:41:49 -- common/autotest_common.sh@10 -- # set +x 00:03:58.926 { 00:03:58.926 "filename": "/tmp/spdk_mem_dump.txt" 00:03:58.926 } 00:03:58.926 22:41:49 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:03:58.926 22:41:49 -- dpdk_memory_utility/test_dpdk_mem_info.sh@21 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/dpdk_mem_info.py 00:03:58.926 DPDK memory size 814.000000 MiB in 1 heap(s) 00:03:58.926 1 heaps totaling size 814.000000 MiB 00:03:58.926 size: 814.000000 MiB heap id: 0 00:03:58.926 end heaps---------- 00:03:58.926 8 mempools totaling size 598.116089 MiB 00:03:58.926 size: 212.674988 MiB name: PDU_immediate_data_Pool 00:03:58.926 size: 158.602051 MiB name: PDU_data_out_Pool 00:03:58.926 size: 84.521057 MiB name: bdev_io_154325 00:03:58.926 size: 51.011292 MiB name: evtpool_154325 00:03:58.926 size: 50.003479 MiB name: msgpool_154325 00:03:58.926 size: 21.763794 MiB name: PDU_Pool 00:03:58.926 size: 19.513306 MiB name: SCSI_TASK_Pool 00:03:58.926 size: 0.026123 MiB name: Session_Pool 00:03:58.926 end mempools------- 00:03:58.926 6 memzones totaling size 4.142822 MiB 00:03:58.926 size: 1.000366 MiB name: RG_ring_0_154325 00:03:58.926 size: 1.000366 MiB name: RG_ring_1_154325 00:03:58.926 size: 1.000366 MiB name: RG_ring_4_154325 00:03:58.926 size: 1.000366 MiB name: RG_ring_5_154325 00:03:58.926 size: 0.125366 MiB name: RG_ring_2_154325 00:03:58.926 size: 0.015991 MiB name: RG_ring_3_154325 00:03:58.926 end memzones------- 00:03:58.926 22:41:50 -- dpdk_memory_utility/test_dpdk_mem_info.sh@23 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/dpdk_mem_info.py -m 0 00:03:59.184 heap id: 0 total size: 814.000000 MiB number of busy elements: 41 number of free elements: 15 00:03:59.184 list of free elements. size: 12.519348 MiB 00:03:59.184 element at address: 0x200000400000 with size: 1.999512 MiB 00:03:59.184 element at address: 0x200018e00000 with size: 0.999878 MiB 00:03:59.184 element at address: 0x200019000000 with size: 0.999878 MiB 00:03:59.184 element at address: 0x200003e00000 with size: 0.996277 MiB 00:03:59.184 element at address: 0x200031c00000 with size: 0.994446 MiB 00:03:59.184 element at address: 0x200013800000 with size: 0.978699 MiB 00:03:59.184 element at address: 0x200007000000 with size: 0.959839 MiB 00:03:59.184 element at address: 0x200019200000 with size: 0.936584 MiB 00:03:59.184 element at address: 0x200000200000 with size: 0.841614 MiB 00:03:59.184 element at address: 0x20001aa00000 with size: 0.582886 MiB 00:03:59.184 element at address: 0x20000b200000 with size: 0.490723 MiB 00:03:59.184 element at address: 0x200000800000 with size: 0.487793 MiB 00:03:59.184 element at address: 0x200019400000 with size: 0.485657 MiB 00:03:59.184 element at address: 0x200027e00000 with size: 0.410034 MiB 00:03:59.184 element at address: 0x200003a00000 with size: 0.355530 MiB 00:03:59.184 list of standard malloc elements. size: 199.218079 MiB 00:03:59.184 element at address: 0x20000b3fff80 with size: 132.000122 MiB 00:03:59.184 element at address: 0x2000071fff80 with size: 64.000122 MiB 00:03:59.184 element at address: 0x200018efff80 with size: 1.000122 MiB 00:03:59.184 element at address: 0x2000190fff80 with size: 1.000122 MiB 00:03:59.184 element at address: 0x2000192fff80 with size: 1.000122 MiB 00:03:59.184 element at address: 0x2000003d9f00 with size: 0.140747 MiB 00:03:59.184 element at address: 0x2000192eff00 with size: 0.062622 MiB 00:03:59.184 element at address: 0x2000003fdf80 with size: 0.007935 MiB 00:03:59.184 element at address: 0x2000192efdc0 with size: 0.000305 MiB 00:03:59.184 element at address: 0x2000002d7740 with size: 0.000183 MiB 00:03:59.184 element at address: 0x2000002d7800 with size: 0.000183 MiB 00:03:59.184 element at address: 0x2000002d78c0 with size: 0.000183 MiB 00:03:59.184 element at address: 0x2000002d7ac0 with size: 0.000183 MiB 00:03:59.184 element at address: 0x2000002d7b80 with size: 0.000183 MiB 00:03:59.184 element at address: 0x2000002d7c40 with size: 0.000183 MiB 00:03:59.184 element at address: 0x2000003d9e40 with size: 0.000183 MiB 00:03:59.184 element at address: 0x20000087ce00 with size: 0.000183 MiB 00:03:59.184 element at address: 0x20000087cec0 with size: 0.000183 MiB 00:03:59.184 element at address: 0x2000008fd180 with size: 0.000183 MiB 00:03:59.184 element at address: 0x200003a5b040 with size: 0.000183 MiB 00:03:59.184 element at address: 0x200003adb300 with size: 0.000183 MiB 00:03:59.184 element at address: 0x200003adb500 with size: 0.000183 MiB 00:03:59.184 element at address: 0x200003adf7c0 with size: 0.000183 MiB 00:03:59.184 element at address: 0x200003affa80 with size: 0.000183 MiB 00:03:59.184 element at address: 0x200003affb40 with size: 0.000183 MiB 00:03:59.184 element at address: 0x200003eff0c0 with size: 0.000183 MiB 00:03:59.184 element at address: 0x2000070fdd80 with size: 0.000183 MiB 00:03:59.184 element at address: 0x20000b27da00 with size: 0.000183 MiB 00:03:59.184 element at address: 0x20000b27dac0 with size: 0.000183 MiB 00:03:59.184 element at address: 0x20000b2fdd80 with size: 0.000183 MiB 00:03:59.184 element at address: 0x2000138fa8c0 with size: 0.000183 MiB 00:03:59.184 element at address: 0x2000192efc40 with size: 0.000183 MiB 00:03:59.184 element at address: 0x2000192efd00 with size: 0.000183 MiB 00:03:59.184 element at address: 0x2000194bc740 with size: 0.000183 MiB 00:03:59.184 element at address: 0x20001aa95380 with size: 0.000183 MiB 00:03:59.184 element at address: 0x20001aa95440 with size: 0.000183 MiB 00:03:59.184 element at address: 0x200027e68f80 with size: 0.000183 MiB 00:03:59.184 element at address: 0x200027e69040 with size: 0.000183 MiB 00:03:59.184 element at address: 0x200027e6fc40 with size: 0.000183 MiB 00:03:59.184 element at address: 0x200027e6fe40 with size: 0.000183 MiB 00:03:59.184 element at address: 0x200027e6ff00 with size: 0.000183 MiB 00:03:59.184 list of memzone associated elements. size: 602.262573 MiB 00:03:59.184 element at address: 0x20001aa95500 with size: 211.416748 MiB 00:03:59.184 associated memzone info: size: 211.416626 MiB name: MP_PDU_immediate_data_Pool_0 00:03:59.184 element at address: 0x200027e6ffc0 with size: 157.562561 MiB 00:03:59.184 associated memzone info: size: 157.562439 MiB name: MP_PDU_data_out_Pool_0 00:03:59.184 element at address: 0x2000139fab80 with size: 84.020630 MiB 00:03:59.184 associated memzone info: size: 84.020508 MiB name: MP_bdev_io_154325_0 00:03:59.184 element at address: 0x2000009ff380 with size: 48.003052 MiB 00:03:59.184 associated memzone info: size: 48.002930 MiB name: MP_evtpool_154325_0 00:03:59.184 element at address: 0x200003fff380 with size: 48.003052 MiB 00:03:59.185 associated memzone info: size: 48.002930 MiB name: MP_msgpool_154325_0 00:03:59.185 element at address: 0x2000195be940 with size: 20.255554 MiB 00:03:59.185 associated memzone info: size: 20.255432 MiB name: MP_PDU_Pool_0 00:03:59.185 element at address: 0x200031dfeb40 with size: 18.005066 MiB 00:03:59.185 associated memzone info: size: 18.004944 MiB name: MP_SCSI_TASK_Pool_0 00:03:59.185 element at address: 0x2000005ffe00 with size: 2.000488 MiB 00:03:59.185 associated memzone info: size: 2.000366 MiB name: RG_MP_evtpool_154325 00:03:59.185 element at address: 0x200003bffe00 with size: 2.000488 MiB 00:03:59.185 associated memzone info: size: 2.000366 MiB name: RG_MP_msgpool_154325 00:03:59.185 element at address: 0x2000002d7d00 with size: 1.008118 MiB 00:03:59.185 associated memzone info: size: 1.007996 MiB name: MP_evtpool_154325 00:03:59.185 element at address: 0x20000b2fde40 with size: 1.008118 MiB 00:03:59.185 associated memzone info: size: 1.007996 MiB name: MP_PDU_Pool 00:03:59.185 element at address: 0x2000194bc800 with size: 1.008118 MiB 00:03:59.185 associated memzone info: size: 1.007996 MiB name: MP_PDU_immediate_data_Pool 00:03:59.185 element at address: 0x2000070fde40 with size: 1.008118 MiB 00:03:59.185 associated memzone info: size: 1.007996 MiB name: MP_PDU_data_out_Pool 00:03:59.185 element at address: 0x2000008fd240 with size: 1.008118 MiB 00:03:59.185 associated memzone info: size: 1.007996 MiB name: MP_SCSI_TASK_Pool 00:03:59.185 element at address: 0x200003eff180 with size: 1.000488 MiB 00:03:59.185 associated memzone info: size: 1.000366 MiB name: RG_ring_0_154325 00:03:59.185 element at address: 0x200003affc00 with size: 1.000488 MiB 00:03:59.185 associated memzone info: size: 1.000366 MiB name: RG_ring_1_154325 00:03:59.185 element at address: 0x2000138fa980 with size: 1.000488 MiB 00:03:59.185 associated memzone info: size: 1.000366 MiB name: RG_ring_4_154325 00:03:59.185 element at address: 0x200031cfe940 with size: 1.000488 MiB 00:03:59.185 associated memzone info: size: 1.000366 MiB name: RG_ring_5_154325 00:03:59.185 element at address: 0x200003a5b100 with size: 0.500488 MiB 00:03:59.185 associated memzone info: size: 0.500366 MiB name: RG_MP_bdev_io_154325 00:03:59.185 element at address: 0x20000b27db80 with size: 0.500488 MiB 00:03:59.185 associated memzone info: size: 0.500366 MiB name: RG_MP_PDU_Pool 00:03:59.185 element at address: 0x20000087cf80 with size: 0.500488 MiB 00:03:59.185 associated memzone info: size: 0.500366 MiB name: RG_MP_SCSI_TASK_Pool 00:03:59.185 element at address: 0x20001947c540 with size: 0.250488 MiB 00:03:59.185 associated memzone info: size: 0.250366 MiB name: RG_MP_PDU_immediate_data_Pool 00:03:59.185 element at address: 0x200003adf880 with size: 0.125488 MiB 00:03:59.185 associated memzone info: size: 0.125366 MiB name: RG_ring_2_154325 00:03:59.185 element at address: 0x2000070f5b80 with size: 0.031738 MiB 00:03:59.185 associated memzone info: size: 0.031616 MiB name: RG_MP_PDU_data_out_Pool 00:03:59.185 element at address: 0x200027e69100 with size: 0.023743 MiB 00:03:59.185 associated memzone info: size: 0.023621 MiB name: MP_Session_Pool_0 00:03:59.185 element at address: 0x200003adb5c0 with size: 0.016113 MiB 00:03:59.185 associated memzone info: size: 0.015991 MiB name: RG_ring_3_154325 00:03:59.185 element at address: 0x200027e6f240 with size: 0.002441 MiB 00:03:59.185 associated memzone info: size: 0.002319 MiB name: RG_MP_Session_Pool 00:03:59.185 element at address: 0x2000002d7980 with size: 0.000305 MiB 00:03:59.185 associated memzone info: size: 0.000183 MiB name: MP_msgpool_154325 00:03:59.185 element at address: 0x200003adb3c0 with size: 0.000305 MiB 00:03:59.185 associated memzone info: size: 0.000183 MiB name: MP_bdev_io_154325 00:03:59.185 element at address: 0x200027e6fd00 with size: 0.000305 MiB 00:03:59.185 associated memzone info: size: 0.000183 MiB name: MP_Session_Pool 00:03:59.185 22:41:50 -- dpdk_memory_utility/test_dpdk_mem_info.sh@25 -- # trap - SIGINT SIGTERM EXIT 00:03:59.185 22:41:50 -- dpdk_memory_utility/test_dpdk_mem_info.sh@26 -- # killprocess 154325 00:03:59.185 22:41:50 -- common/autotest_common.sh@926 -- # '[' -z 154325 ']' 00:03:59.185 22:41:50 -- common/autotest_common.sh@930 -- # kill -0 154325 00:03:59.185 22:41:50 -- common/autotest_common.sh@931 -- # uname 00:03:59.185 22:41:50 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:03:59.185 22:41:50 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 154325 00:03:59.185 22:41:50 -- common/autotest_common.sh@932 -- # process_name=reactor_0 00:03:59.185 22:41:50 -- common/autotest_common.sh@936 -- # '[' reactor_0 = sudo ']' 00:03:59.185 22:41:50 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 154325' 00:03:59.185 killing process with pid 154325 00:03:59.185 22:41:50 -- common/autotest_common.sh@945 -- # kill 154325 00:03:59.185 22:41:50 -- common/autotest_common.sh@950 -- # wait 154325 00:03:59.750 00:03:59.750 real 0m1.603s 00:03:59.750 user 0m1.751s 00:03:59.750 sys 0m0.432s 00:03:59.750 22:41:50 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:03:59.750 22:41:50 -- common/autotest_common.sh@10 -- # set +x 00:03:59.750 ************************************ 00:03:59.750 END TEST dpdk_mem_utility 00:03:59.750 ************************************ 00:03:59.750 22:41:50 -- spdk/autotest.sh@187 -- # run_test event /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/event.sh 00:03:59.750 22:41:50 -- common/autotest_common.sh@1077 -- # '[' 2 -le 1 ']' 00:03:59.750 22:41:50 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:03:59.750 22:41:50 -- common/autotest_common.sh@10 -- # set +x 00:03:59.750 ************************************ 00:03:59.750 START TEST event 00:03:59.750 ************************************ 00:03:59.750 22:41:50 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/event.sh 00:03:59.750 * Looking for test storage... 00:03:59.750 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event 00:03:59.750 22:41:50 -- event/event.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/bdev/nbd_common.sh 00:03:59.750 22:41:50 -- bdev/nbd_common.sh@6 -- # set -e 00:03:59.750 22:41:50 -- event/event.sh@45 -- # run_test event_perf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/event_perf/event_perf -m 0xF -t 1 00:03:59.750 22:41:50 -- common/autotest_common.sh@1077 -- # '[' 6 -le 1 ']' 00:03:59.750 22:41:50 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:03:59.750 22:41:50 -- common/autotest_common.sh@10 -- # set +x 00:03:59.750 ************************************ 00:03:59.750 START TEST event_perf 00:03:59.750 ************************************ 00:03:59.750 22:41:50 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/event_perf/event_perf -m 0xF -t 1 00:03:59.750 Running I/O for 1 seconds...[2024-04-16 22:41:50.664058] Starting SPDK v24.01.1-pre git sha1 4b134b4ab / DPDK 23.11.0 initialization... 00:03:59.750 [2024-04-16 22:41:50.664133] [ DPDK EAL parameters: event_perf --no-shconf -c 0xF --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid154648 ] 00:03:59.750 EAL: No free 2048 kB hugepages reported on node 1 00:03:59.750 [2024-04-16 22:41:50.726085] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:03:59.750 [2024-04-16 22:41:50.842481] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:03:59.750 [2024-04-16 22:41:50.842535] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:03:59.750 [2024-04-16 22:41:50.842651] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:03:59.750 [2024-04-16 22:41:50.842653] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:04:01.150 Running I/O for 1 seconds... 00:04:01.150 lcore 0: 226415 00:04:01.150 lcore 1: 226413 00:04:01.150 lcore 2: 226414 00:04:01.150 lcore 3: 226415 00:04:01.150 done. 00:04:01.150 00:04:01.150 real 0m1.317s 00:04:01.150 user 0m4.229s 00:04:01.150 sys 0m0.083s 00:04:01.150 22:41:51 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:04:01.150 22:41:51 -- common/autotest_common.sh@10 -- # set +x 00:04:01.150 ************************************ 00:04:01.150 END TEST event_perf 00:04:01.150 ************************************ 00:04:01.150 22:41:51 -- event/event.sh@46 -- # run_test event_reactor /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/reactor/reactor -t 1 00:04:01.150 22:41:51 -- common/autotest_common.sh@1077 -- # '[' 4 -le 1 ']' 00:04:01.150 22:41:51 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:04:01.150 22:41:51 -- common/autotest_common.sh@10 -- # set +x 00:04:01.150 ************************************ 00:04:01.150 START TEST event_reactor 00:04:01.150 ************************************ 00:04:01.150 22:41:51 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/reactor/reactor -t 1 00:04:01.150 [2024-04-16 22:41:52.006700] Starting SPDK v24.01.1-pre git sha1 4b134b4ab / DPDK 23.11.0 initialization... 00:04:01.150 [2024-04-16 22:41:52.006784] [ DPDK EAL parameters: reactor --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid154806 ] 00:04:01.150 EAL: No free 2048 kB hugepages reported on node 1 00:04:01.150 [2024-04-16 22:41:52.071448] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:04:01.150 [2024-04-16 22:41:52.187982] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:04:02.523 test_start 00:04:02.523 oneshot 00:04:02.523 tick 100 00:04:02.523 tick 100 00:04:02.523 tick 250 00:04:02.523 tick 100 00:04:02.523 tick 100 00:04:02.523 tick 250 00:04:02.523 tick 500 00:04:02.523 tick 100 00:04:02.523 tick 100 00:04:02.523 tick 100 00:04:02.523 tick 250 00:04:02.523 tick 100 00:04:02.523 tick 100 00:04:02.523 test_end 00:04:02.523 00:04:02.523 real 0m1.317s 00:04:02.523 user 0m1.234s 00:04:02.523 sys 0m0.078s 00:04:02.523 22:41:53 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:04:02.523 22:41:53 -- common/autotest_common.sh@10 -- # set +x 00:04:02.523 ************************************ 00:04:02.523 END TEST event_reactor 00:04:02.523 ************************************ 00:04:02.523 22:41:53 -- event/event.sh@47 -- # run_test event_reactor_perf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/reactor_perf/reactor_perf -t 1 00:04:02.523 22:41:53 -- common/autotest_common.sh@1077 -- # '[' 4 -le 1 ']' 00:04:02.523 22:41:53 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:04:02.523 22:41:53 -- common/autotest_common.sh@10 -- # set +x 00:04:02.523 ************************************ 00:04:02.523 START TEST event_reactor_perf 00:04:02.523 ************************************ 00:04:02.523 22:41:53 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/reactor_perf/reactor_perf -t 1 00:04:02.523 [2024-04-16 22:41:53.350436] Starting SPDK v24.01.1-pre git sha1 4b134b4ab / DPDK 23.11.0 initialization... 00:04:02.523 [2024-04-16 22:41:53.350530] [ DPDK EAL parameters: reactor_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid154968 ] 00:04:02.523 EAL: No free 2048 kB hugepages reported on node 1 00:04:02.523 [2024-04-16 22:41:53.412549] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:04:02.523 [2024-04-16 22:41:53.529508] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:04:03.897 test_start 00:04:03.897 test_end 00:04:03.897 Performance: 352895 events per second 00:04:03.897 00:04:03.897 real 0m1.316s 00:04:03.897 user 0m1.232s 00:04:03.897 sys 0m0.078s 00:04:03.897 22:41:54 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:04:03.897 22:41:54 -- common/autotest_common.sh@10 -- # set +x 00:04:03.897 ************************************ 00:04:03.897 END TEST event_reactor_perf 00:04:03.897 ************************************ 00:04:03.897 22:41:54 -- event/event.sh@49 -- # uname -s 00:04:03.897 22:41:54 -- event/event.sh@49 -- # '[' Linux = Linux ']' 00:04:03.897 22:41:54 -- event/event.sh@50 -- # run_test event_scheduler /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/scheduler/scheduler.sh 00:04:03.897 22:41:54 -- common/autotest_common.sh@1077 -- # '[' 2 -le 1 ']' 00:04:03.897 22:41:54 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:04:03.897 22:41:54 -- common/autotest_common.sh@10 -- # set +x 00:04:03.897 ************************************ 00:04:03.897 START TEST event_scheduler 00:04:03.897 ************************************ 00:04:03.897 22:41:54 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/scheduler/scheduler.sh 00:04:03.897 * Looking for test storage... 00:04:03.897 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/scheduler 00:04:03.897 22:41:54 -- scheduler/scheduler.sh@29 -- # rpc=rpc_cmd 00:04:03.897 22:41:54 -- scheduler/scheduler.sh@35 -- # scheduler_pid=155147 00:04:03.897 22:41:54 -- scheduler/scheduler.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/scheduler/scheduler -m 0xF -p 0x2 --wait-for-rpc -f 00:04:03.897 22:41:54 -- scheduler/scheduler.sh@36 -- # trap 'killprocess $scheduler_pid; exit 1' SIGINT SIGTERM EXIT 00:04:03.897 22:41:54 -- scheduler/scheduler.sh@37 -- # waitforlisten 155147 00:04:03.897 22:41:54 -- common/autotest_common.sh@819 -- # '[' -z 155147 ']' 00:04:03.897 22:41:54 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk.sock 00:04:03.897 22:41:54 -- common/autotest_common.sh@824 -- # local max_retries=100 00:04:03.897 22:41:54 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:04:03.897 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:04:03.897 22:41:54 -- common/autotest_common.sh@828 -- # xtrace_disable 00:04:03.897 22:41:54 -- common/autotest_common.sh@10 -- # set +x 00:04:03.897 [2024-04-16 22:41:54.767652] Starting SPDK v24.01.1-pre git sha1 4b134b4ab / DPDK 23.11.0 initialization... 00:04:03.897 [2024-04-16 22:41:54.767738] [ DPDK EAL parameters: scheduler --no-shconf -c 0xF --main-lcore=2 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid155147 ] 00:04:03.897 EAL: No free 2048 kB hugepages reported on node 1 00:04:03.897 [2024-04-16 22:41:54.825605] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:04:03.897 [2024-04-16 22:41:54.932780] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:04:03.897 [2024-04-16 22:41:54.932838] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:04:03.897 [2024-04-16 22:41:54.932902] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:04:03.897 [2024-04-16 22:41:54.932905] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:04:03.897 22:41:54 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:04:03.897 22:41:54 -- common/autotest_common.sh@852 -- # return 0 00:04:03.897 22:41:54 -- scheduler/scheduler.sh@39 -- # rpc_cmd framework_set_scheduler dynamic 00:04:03.897 22:41:54 -- common/autotest_common.sh@551 -- # xtrace_disable 00:04:03.897 22:41:54 -- common/autotest_common.sh@10 -- # set +x 00:04:03.897 POWER: Env isn't set yet! 00:04:03.897 POWER: Attempting to initialise ACPI cpufreq power management... 00:04:03.897 POWER: failed to open /sys/devices/system/cpu/cpu%u/cpufreq/scaling_available_frequencies 00:04:03.897 POWER: Cannot get available frequencies of lcore 0 00:04:03.897 POWER: Attempting to initialise PSTAT power management... 00:04:03.897 POWER: Power management governor of lcore 0 has been set to 'performance' successfully 00:04:03.897 POWER: Initialized successfully for lcore 0 power management 00:04:03.897 POWER: Power management governor of lcore 1 has been set to 'performance' successfully 00:04:03.897 POWER: Initialized successfully for lcore 1 power management 00:04:03.897 POWER: Power management governor of lcore 2 has been set to 'performance' successfully 00:04:03.897 POWER: Initialized successfully for lcore 2 power management 00:04:03.897 POWER: Power management governor of lcore 3 has been set to 'performance' successfully 00:04:03.897 POWER: Initialized successfully for lcore 3 power management 00:04:03.897 22:41:55 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:04:03.897 22:41:55 -- scheduler/scheduler.sh@40 -- # rpc_cmd framework_start_init 00:04:03.897 22:41:55 -- common/autotest_common.sh@551 -- # xtrace_disable 00:04:03.897 22:41:55 -- common/autotest_common.sh@10 -- # set +x 00:04:04.155 [2024-04-16 22:41:55.110665] scheduler.c: 382:test_start: *NOTICE*: Scheduler test application started. 00:04:04.155 22:41:55 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:04:04.155 22:41:55 -- scheduler/scheduler.sh@43 -- # run_test scheduler_create_thread scheduler_create_thread 00:04:04.155 22:41:55 -- common/autotest_common.sh@1077 -- # '[' 2 -le 1 ']' 00:04:04.155 22:41:55 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:04:04.155 22:41:55 -- common/autotest_common.sh@10 -- # set +x 00:04:04.155 ************************************ 00:04:04.155 START TEST scheduler_create_thread 00:04:04.155 ************************************ 00:04:04.155 22:41:55 -- common/autotest_common.sh@1104 -- # scheduler_create_thread 00:04:04.155 22:41:55 -- scheduler/scheduler.sh@12 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_create -n active_pinned -m 0x1 -a 100 00:04:04.155 22:41:55 -- common/autotest_common.sh@551 -- # xtrace_disable 00:04:04.155 22:41:55 -- common/autotest_common.sh@10 -- # set +x 00:04:04.155 2 00:04:04.155 22:41:55 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:04:04.155 22:41:55 -- scheduler/scheduler.sh@13 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_create -n active_pinned -m 0x2 -a 100 00:04:04.155 22:41:55 -- common/autotest_common.sh@551 -- # xtrace_disable 00:04:04.155 22:41:55 -- common/autotest_common.sh@10 -- # set +x 00:04:04.155 3 00:04:04.155 22:41:55 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:04:04.155 22:41:55 -- scheduler/scheduler.sh@14 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_create -n active_pinned -m 0x4 -a 100 00:04:04.155 22:41:55 -- common/autotest_common.sh@551 -- # xtrace_disable 00:04:04.155 22:41:55 -- common/autotest_common.sh@10 -- # set +x 00:04:04.155 4 00:04:04.155 22:41:55 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:04:04.155 22:41:55 -- scheduler/scheduler.sh@15 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_create -n active_pinned -m 0x8 -a 100 00:04:04.155 22:41:55 -- common/autotest_common.sh@551 -- # xtrace_disable 00:04:04.155 22:41:55 -- common/autotest_common.sh@10 -- # set +x 00:04:04.155 5 00:04:04.155 22:41:55 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:04:04.156 22:41:55 -- scheduler/scheduler.sh@16 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_create -n idle_pinned -m 0x1 -a 0 00:04:04.156 22:41:55 -- common/autotest_common.sh@551 -- # xtrace_disable 00:04:04.156 22:41:55 -- common/autotest_common.sh@10 -- # set +x 00:04:04.156 6 00:04:04.156 22:41:55 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:04:04.156 22:41:55 -- scheduler/scheduler.sh@17 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_create -n idle_pinned -m 0x2 -a 0 00:04:04.156 22:41:55 -- common/autotest_common.sh@551 -- # xtrace_disable 00:04:04.156 22:41:55 -- common/autotest_common.sh@10 -- # set +x 00:04:04.156 7 00:04:04.156 22:41:55 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:04:04.156 22:41:55 -- scheduler/scheduler.sh@18 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_create -n idle_pinned -m 0x4 -a 0 00:04:04.156 22:41:55 -- common/autotest_common.sh@551 -- # xtrace_disable 00:04:04.156 22:41:55 -- common/autotest_common.sh@10 -- # set +x 00:04:04.156 8 00:04:04.156 22:41:55 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:04:04.156 22:41:55 -- scheduler/scheduler.sh@19 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_create -n idle_pinned -m 0x8 -a 0 00:04:04.156 22:41:55 -- common/autotest_common.sh@551 -- # xtrace_disable 00:04:04.156 22:41:55 -- common/autotest_common.sh@10 -- # set +x 00:04:04.156 9 00:04:04.156 22:41:55 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:04:04.156 22:41:55 -- scheduler/scheduler.sh@21 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_create -n one_third_active -a 30 00:04:04.156 22:41:55 -- common/autotest_common.sh@551 -- # xtrace_disable 00:04:04.156 22:41:55 -- common/autotest_common.sh@10 -- # set +x 00:04:04.156 10 00:04:04.156 22:41:55 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:04:04.156 22:41:55 -- scheduler/scheduler.sh@22 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_create -n half_active -a 0 00:04:04.156 22:41:55 -- common/autotest_common.sh@551 -- # xtrace_disable 00:04:04.156 22:41:55 -- common/autotest_common.sh@10 -- # set +x 00:04:04.156 22:41:55 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:04:04.156 22:41:55 -- scheduler/scheduler.sh@22 -- # thread_id=11 00:04:04.156 22:41:55 -- scheduler/scheduler.sh@23 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_set_active 11 50 00:04:04.156 22:41:55 -- common/autotest_common.sh@551 -- # xtrace_disable 00:04:04.156 22:41:55 -- common/autotest_common.sh@10 -- # set +x 00:04:04.156 22:41:55 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:04:04.156 22:41:55 -- scheduler/scheduler.sh@25 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_create -n deleted -a 100 00:04:04.156 22:41:55 -- common/autotest_common.sh@551 -- # xtrace_disable 00:04:04.156 22:41:55 -- common/autotest_common.sh@10 -- # set +x 00:04:06.052 22:41:56 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:04:06.052 22:41:56 -- scheduler/scheduler.sh@25 -- # thread_id=12 00:04:06.052 22:41:56 -- scheduler/scheduler.sh@26 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_delete 12 00:04:06.053 22:41:56 -- common/autotest_common.sh@551 -- # xtrace_disable 00:04:06.053 22:41:56 -- common/autotest_common.sh@10 -- # set +x 00:04:06.618 22:41:57 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:04:06.618 00:04:06.618 real 0m2.617s 00:04:06.618 user 0m0.009s 00:04:06.618 sys 0m0.003s 00:04:06.618 22:41:57 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:04:06.618 22:41:57 -- common/autotest_common.sh@10 -- # set +x 00:04:06.618 ************************************ 00:04:06.618 END TEST scheduler_create_thread 00:04:06.618 ************************************ 00:04:06.875 22:41:57 -- scheduler/scheduler.sh@45 -- # trap - SIGINT SIGTERM EXIT 00:04:06.875 22:41:57 -- scheduler/scheduler.sh@46 -- # killprocess 155147 00:04:06.875 22:41:57 -- common/autotest_common.sh@926 -- # '[' -z 155147 ']' 00:04:06.875 22:41:57 -- common/autotest_common.sh@930 -- # kill -0 155147 00:04:06.875 22:41:57 -- common/autotest_common.sh@931 -- # uname 00:04:06.875 22:41:57 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:04:06.875 22:41:57 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 155147 00:04:06.875 22:41:57 -- common/autotest_common.sh@932 -- # process_name=reactor_2 00:04:06.875 22:41:57 -- common/autotest_common.sh@936 -- # '[' reactor_2 = sudo ']' 00:04:06.875 22:41:57 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 155147' 00:04:06.875 killing process with pid 155147 00:04:06.875 22:41:57 -- common/autotest_common.sh@945 -- # kill 155147 00:04:06.875 22:41:57 -- common/autotest_common.sh@950 -- # wait 155147 00:04:07.133 [2024-04-16 22:41:58.213419] scheduler.c: 360:test_shutdown: *NOTICE*: Scheduler test application stopped. 00:04:07.393 POWER: Power management governor of lcore 0 has been set to 'userspace' successfully 00:04:07.393 POWER: Power management of lcore 0 has exited from 'performance' mode and been set back to the original 00:04:07.393 POWER: Power management governor of lcore 1 has been set to 'schedutil' successfully 00:04:07.393 POWER: Power management of lcore 1 has exited from 'performance' mode and been set back to the original 00:04:07.393 POWER: Power management governor of lcore 2 has been set to 'schedutil' successfully 00:04:07.393 POWER: Power management of lcore 2 has exited from 'performance' mode and been set back to the original 00:04:07.393 POWER: Power management governor of lcore 3 has been set to 'schedutil' successfully 00:04:07.393 POWER: Power management of lcore 3 has exited from 'performance' mode and been set back to the original 00:04:07.393 00:04:07.393 real 0m3.804s 00:04:07.393 user 0m5.745s 00:04:07.393 sys 0m0.282s 00:04:07.393 22:41:58 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:04:07.393 22:41:58 -- common/autotest_common.sh@10 -- # set +x 00:04:07.393 ************************************ 00:04:07.393 END TEST event_scheduler 00:04:07.393 ************************************ 00:04:07.393 22:41:58 -- event/event.sh@51 -- # modprobe -n nbd 00:04:07.393 22:41:58 -- event/event.sh@52 -- # run_test app_repeat app_repeat_test 00:04:07.393 22:41:58 -- common/autotest_common.sh@1077 -- # '[' 2 -le 1 ']' 00:04:07.393 22:41:58 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:04:07.393 22:41:58 -- common/autotest_common.sh@10 -- # set +x 00:04:07.393 ************************************ 00:04:07.393 START TEST app_repeat 00:04:07.393 ************************************ 00:04:07.393 22:41:58 -- common/autotest_common.sh@1104 -- # app_repeat_test 00:04:07.393 22:41:58 -- event/event.sh@12 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:04:07.393 22:41:58 -- event/event.sh@13 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:04:07.393 22:41:58 -- event/event.sh@13 -- # local nbd_list 00:04:07.393 22:41:58 -- event/event.sh@14 -- # bdev_list=('Malloc0' 'Malloc1') 00:04:07.393 22:41:58 -- event/event.sh@14 -- # local bdev_list 00:04:07.393 22:41:58 -- event/event.sh@15 -- # local repeat_times=4 00:04:07.393 22:41:58 -- event/event.sh@17 -- # modprobe nbd 00:04:07.393 22:41:58 -- event/event.sh@19 -- # repeat_pid=155738 00:04:07.393 22:41:58 -- event/event.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/app_repeat/app_repeat -r /var/tmp/spdk-nbd.sock -m 0x3 -t 4 00:04:07.393 22:41:58 -- event/event.sh@20 -- # trap 'killprocess $repeat_pid; exit 1' SIGINT SIGTERM EXIT 00:04:07.393 22:41:58 -- event/event.sh@21 -- # echo 'Process app_repeat pid: 155738' 00:04:07.393 Process app_repeat pid: 155738 00:04:07.393 22:41:58 -- event/event.sh@23 -- # for i in {0..2} 00:04:07.393 22:41:58 -- event/event.sh@24 -- # echo 'spdk_app_start Round 0' 00:04:07.393 spdk_app_start Round 0 00:04:07.393 22:41:58 -- event/event.sh@25 -- # waitforlisten 155738 /var/tmp/spdk-nbd.sock 00:04:07.393 22:41:58 -- common/autotest_common.sh@819 -- # '[' -z 155738 ']' 00:04:07.393 22:41:58 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk-nbd.sock 00:04:07.393 22:41:58 -- common/autotest_common.sh@824 -- # local max_retries=100 00:04:07.393 22:41:58 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk-nbd.sock...' 00:04:07.393 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk-nbd.sock... 00:04:07.393 22:41:58 -- common/autotest_common.sh@828 -- # xtrace_disable 00:04:07.393 22:41:58 -- common/autotest_common.sh@10 -- # set +x 00:04:07.651 [2024-04-16 22:41:58.538036] Starting SPDK v24.01.1-pre git sha1 4b134b4ab / DPDK 23.11.0 initialization... 00:04:07.651 [2024-04-16 22:41:58.538123] [ DPDK EAL parameters: app_repeat --no-shconf -c 0x3 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid155738 ] 00:04:07.652 EAL: No free 2048 kB hugepages reported on node 1 00:04:07.652 [2024-04-16 22:41:58.601428] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 2 00:04:07.652 [2024-04-16 22:41:58.714897] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:04:07.652 [2024-04-16 22:41:58.714903] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:04:08.587 22:41:59 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:04:08.587 22:41:59 -- common/autotest_common.sh@852 -- # return 0 00:04:08.587 22:41:59 -- event/event.sh@27 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock bdev_malloc_create 64 4096 00:04:08.845 Malloc0 00:04:08.845 22:41:59 -- event/event.sh@28 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock bdev_malloc_create 64 4096 00:04:09.104 Malloc1 00:04:09.104 22:42:00 -- event/event.sh@30 -- # nbd_rpc_data_verify /var/tmp/spdk-nbd.sock 'Malloc0 Malloc1' '/dev/nbd0 /dev/nbd1' 00:04:09.104 22:42:00 -- bdev/nbd_common.sh@90 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:04:09.104 22:42:00 -- bdev/nbd_common.sh@91 -- # bdev_list=('Malloc0' 'Malloc1') 00:04:09.104 22:42:00 -- bdev/nbd_common.sh@91 -- # local bdev_list 00:04:09.104 22:42:00 -- bdev/nbd_common.sh@92 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:04:09.104 22:42:00 -- bdev/nbd_common.sh@92 -- # local nbd_list 00:04:09.104 22:42:00 -- bdev/nbd_common.sh@94 -- # nbd_start_disks /var/tmp/spdk-nbd.sock 'Malloc0 Malloc1' '/dev/nbd0 /dev/nbd1' 00:04:09.104 22:42:00 -- bdev/nbd_common.sh@9 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:04:09.104 22:42:00 -- bdev/nbd_common.sh@10 -- # bdev_list=('Malloc0' 'Malloc1') 00:04:09.104 22:42:00 -- bdev/nbd_common.sh@10 -- # local bdev_list 00:04:09.104 22:42:00 -- bdev/nbd_common.sh@11 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:04:09.104 22:42:00 -- bdev/nbd_common.sh@11 -- # local nbd_list 00:04:09.104 22:42:00 -- bdev/nbd_common.sh@12 -- # local i 00:04:09.104 22:42:00 -- bdev/nbd_common.sh@14 -- # (( i = 0 )) 00:04:09.104 22:42:00 -- bdev/nbd_common.sh@14 -- # (( i < 2 )) 00:04:09.104 22:42:00 -- bdev/nbd_common.sh@15 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_start_disk Malloc0 /dev/nbd0 00:04:09.362 /dev/nbd0 00:04:09.362 22:42:00 -- bdev/nbd_common.sh@17 -- # basename /dev/nbd0 00:04:09.362 22:42:00 -- bdev/nbd_common.sh@17 -- # waitfornbd nbd0 00:04:09.362 22:42:00 -- common/autotest_common.sh@856 -- # local nbd_name=nbd0 00:04:09.362 22:42:00 -- common/autotest_common.sh@857 -- # local i 00:04:09.362 22:42:00 -- common/autotest_common.sh@859 -- # (( i = 1 )) 00:04:09.362 22:42:00 -- common/autotest_common.sh@859 -- # (( i <= 20 )) 00:04:09.362 22:42:00 -- common/autotest_common.sh@860 -- # grep -q -w nbd0 /proc/partitions 00:04:09.362 22:42:00 -- common/autotest_common.sh@861 -- # break 00:04:09.362 22:42:00 -- common/autotest_common.sh@872 -- # (( i = 1 )) 00:04:09.362 22:42:00 -- common/autotest_common.sh@872 -- # (( i <= 20 )) 00:04:09.362 22:42:00 -- common/autotest_common.sh@873 -- # dd if=/dev/nbd0 of=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest bs=4096 count=1 iflag=direct 00:04:09.362 1+0 records in 00:04:09.362 1+0 records out 00:04:09.362 4096 bytes (4.1 kB, 4.0 KiB) copied, 0.000141436 s, 29.0 MB/s 00:04:09.362 22:42:00 -- common/autotest_common.sh@874 -- # stat -c %s /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest 00:04:09.362 22:42:00 -- common/autotest_common.sh@874 -- # size=4096 00:04:09.362 22:42:00 -- common/autotest_common.sh@875 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest 00:04:09.362 22:42:00 -- common/autotest_common.sh@876 -- # '[' 4096 '!=' 0 ']' 00:04:09.362 22:42:00 -- common/autotest_common.sh@877 -- # return 0 00:04:09.362 22:42:00 -- bdev/nbd_common.sh@14 -- # (( i++ )) 00:04:09.362 22:42:00 -- bdev/nbd_common.sh@14 -- # (( i < 2 )) 00:04:09.362 22:42:00 -- bdev/nbd_common.sh@15 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_start_disk Malloc1 /dev/nbd1 00:04:09.619 /dev/nbd1 00:04:09.619 22:42:00 -- bdev/nbd_common.sh@17 -- # basename /dev/nbd1 00:04:09.619 22:42:00 -- bdev/nbd_common.sh@17 -- # waitfornbd nbd1 00:04:09.619 22:42:00 -- common/autotest_common.sh@856 -- # local nbd_name=nbd1 00:04:09.619 22:42:00 -- common/autotest_common.sh@857 -- # local i 00:04:09.619 22:42:00 -- common/autotest_common.sh@859 -- # (( i = 1 )) 00:04:09.619 22:42:00 -- common/autotest_common.sh@859 -- # (( i <= 20 )) 00:04:09.620 22:42:00 -- common/autotest_common.sh@860 -- # grep -q -w nbd1 /proc/partitions 00:04:09.620 22:42:00 -- common/autotest_common.sh@861 -- # break 00:04:09.620 22:42:00 -- common/autotest_common.sh@872 -- # (( i = 1 )) 00:04:09.620 22:42:00 -- common/autotest_common.sh@872 -- # (( i <= 20 )) 00:04:09.620 22:42:00 -- common/autotest_common.sh@873 -- # dd if=/dev/nbd1 of=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest bs=4096 count=1 iflag=direct 00:04:09.620 1+0 records in 00:04:09.620 1+0 records out 00:04:09.620 4096 bytes (4.1 kB, 4.0 KiB) copied, 0.000193428 s, 21.2 MB/s 00:04:09.620 22:42:00 -- common/autotest_common.sh@874 -- # stat -c %s /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest 00:04:09.620 22:42:00 -- common/autotest_common.sh@874 -- # size=4096 00:04:09.620 22:42:00 -- common/autotest_common.sh@875 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest 00:04:09.620 22:42:00 -- common/autotest_common.sh@876 -- # '[' 4096 '!=' 0 ']' 00:04:09.620 22:42:00 -- common/autotest_common.sh@877 -- # return 0 00:04:09.620 22:42:00 -- bdev/nbd_common.sh@14 -- # (( i++ )) 00:04:09.620 22:42:00 -- bdev/nbd_common.sh@14 -- # (( i < 2 )) 00:04:09.620 22:42:00 -- bdev/nbd_common.sh@95 -- # nbd_get_count /var/tmp/spdk-nbd.sock 00:04:09.620 22:42:00 -- bdev/nbd_common.sh@61 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:04:09.620 22:42:00 -- bdev/nbd_common.sh@63 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_get_disks 00:04:09.878 22:42:00 -- bdev/nbd_common.sh@63 -- # nbd_disks_json='[ 00:04:09.878 { 00:04:09.878 "nbd_device": "/dev/nbd0", 00:04:09.878 "bdev_name": "Malloc0" 00:04:09.878 }, 00:04:09.878 { 00:04:09.878 "nbd_device": "/dev/nbd1", 00:04:09.878 "bdev_name": "Malloc1" 00:04:09.878 } 00:04:09.878 ]' 00:04:09.878 22:42:00 -- bdev/nbd_common.sh@64 -- # echo '[ 00:04:09.878 { 00:04:09.878 "nbd_device": "/dev/nbd0", 00:04:09.878 "bdev_name": "Malloc0" 00:04:09.878 }, 00:04:09.878 { 00:04:09.878 "nbd_device": "/dev/nbd1", 00:04:09.878 "bdev_name": "Malloc1" 00:04:09.878 } 00:04:09.878 ]' 00:04:09.878 22:42:00 -- bdev/nbd_common.sh@64 -- # jq -r '.[] | .nbd_device' 00:04:09.878 22:42:00 -- bdev/nbd_common.sh@64 -- # nbd_disks_name='/dev/nbd0 00:04:09.878 /dev/nbd1' 00:04:09.878 22:42:00 -- bdev/nbd_common.sh@65 -- # echo '/dev/nbd0 00:04:09.878 /dev/nbd1' 00:04:09.878 22:42:00 -- bdev/nbd_common.sh@65 -- # grep -c /dev/nbd 00:04:09.878 22:42:00 -- bdev/nbd_common.sh@65 -- # count=2 00:04:09.878 22:42:00 -- bdev/nbd_common.sh@66 -- # echo 2 00:04:09.878 22:42:00 -- bdev/nbd_common.sh@95 -- # count=2 00:04:09.878 22:42:00 -- bdev/nbd_common.sh@96 -- # '[' 2 -ne 2 ']' 00:04:09.878 22:42:00 -- bdev/nbd_common.sh@100 -- # nbd_dd_data_verify '/dev/nbd0 /dev/nbd1' write 00:04:09.878 22:42:00 -- bdev/nbd_common.sh@70 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:04:09.878 22:42:00 -- bdev/nbd_common.sh@70 -- # local nbd_list 00:04:09.878 22:42:00 -- bdev/nbd_common.sh@71 -- # local operation=write 00:04:09.878 22:42:00 -- bdev/nbd_common.sh@72 -- # local tmp_file=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest 00:04:09.878 22:42:00 -- bdev/nbd_common.sh@74 -- # '[' write = write ']' 00:04:09.878 22:42:00 -- bdev/nbd_common.sh@76 -- # dd if=/dev/urandom of=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest bs=4096 count=256 00:04:09.878 256+0 records in 00:04:09.878 256+0 records out 00:04:09.878 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00502529 s, 209 MB/s 00:04:09.878 22:42:00 -- bdev/nbd_common.sh@77 -- # for i in "${nbd_list[@]}" 00:04:09.878 22:42:00 -- bdev/nbd_common.sh@78 -- # dd if=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest of=/dev/nbd0 bs=4096 count=256 oflag=direct 00:04:09.878 256+0 records in 00:04:09.878 256+0 records out 00:04:09.878 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0211116 s, 49.7 MB/s 00:04:09.878 22:42:00 -- bdev/nbd_common.sh@77 -- # for i in "${nbd_list[@]}" 00:04:09.878 22:42:00 -- bdev/nbd_common.sh@78 -- # dd if=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest of=/dev/nbd1 bs=4096 count=256 oflag=direct 00:04:09.878 256+0 records in 00:04:09.878 256+0 records out 00:04:09.878 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0251502 s, 41.7 MB/s 00:04:09.878 22:42:00 -- bdev/nbd_common.sh@101 -- # nbd_dd_data_verify '/dev/nbd0 /dev/nbd1' verify 00:04:09.878 22:42:00 -- bdev/nbd_common.sh@70 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:04:09.878 22:42:00 -- bdev/nbd_common.sh@70 -- # local nbd_list 00:04:09.878 22:42:00 -- bdev/nbd_common.sh@71 -- # local operation=verify 00:04:09.878 22:42:00 -- bdev/nbd_common.sh@72 -- # local tmp_file=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest 00:04:09.878 22:42:00 -- bdev/nbd_common.sh@74 -- # '[' verify = write ']' 00:04:09.878 22:42:00 -- bdev/nbd_common.sh@80 -- # '[' verify = verify ']' 00:04:09.878 22:42:00 -- bdev/nbd_common.sh@82 -- # for i in "${nbd_list[@]}" 00:04:09.878 22:42:00 -- bdev/nbd_common.sh@83 -- # cmp -b -n 1M /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest /dev/nbd0 00:04:09.878 22:42:00 -- bdev/nbd_common.sh@82 -- # for i in "${nbd_list[@]}" 00:04:09.878 22:42:00 -- bdev/nbd_common.sh@83 -- # cmp -b -n 1M /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest /dev/nbd1 00:04:09.878 22:42:00 -- bdev/nbd_common.sh@85 -- # rm /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest 00:04:09.878 22:42:00 -- bdev/nbd_common.sh@103 -- # nbd_stop_disks /var/tmp/spdk-nbd.sock '/dev/nbd0 /dev/nbd1' 00:04:09.878 22:42:00 -- bdev/nbd_common.sh@49 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:04:09.878 22:42:00 -- bdev/nbd_common.sh@50 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:04:09.878 22:42:00 -- bdev/nbd_common.sh@50 -- # local nbd_list 00:04:09.878 22:42:00 -- bdev/nbd_common.sh@51 -- # local i 00:04:09.878 22:42:00 -- bdev/nbd_common.sh@53 -- # for i in "${nbd_list[@]}" 00:04:09.878 22:42:00 -- bdev/nbd_common.sh@54 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_stop_disk /dev/nbd0 00:04:10.137 22:42:01 -- bdev/nbd_common.sh@55 -- # basename /dev/nbd0 00:04:10.137 22:42:01 -- bdev/nbd_common.sh@55 -- # waitfornbd_exit nbd0 00:04:10.137 22:42:01 -- bdev/nbd_common.sh@35 -- # local nbd_name=nbd0 00:04:10.137 22:42:01 -- bdev/nbd_common.sh@37 -- # (( i = 1 )) 00:04:10.137 22:42:01 -- bdev/nbd_common.sh@37 -- # (( i <= 20 )) 00:04:10.137 22:42:01 -- bdev/nbd_common.sh@38 -- # grep -q -w nbd0 /proc/partitions 00:04:10.137 22:42:01 -- bdev/nbd_common.sh@41 -- # break 00:04:10.137 22:42:01 -- bdev/nbd_common.sh@45 -- # return 0 00:04:10.137 22:42:01 -- bdev/nbd_common.sh@53 -- # for i in "${nbd_list[@]}" 00:04:10.137 22:42:01 -- bdev/nbd_common.sh@54 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_stop_disk /dev/nbd1 00:04:10.395 22:42:01 -- bdev/nbd_common.sh@55 -- # basename /dev/nbd1 00:04:10.395 22:42:01 -- bdev/nbd_common.sh@55 -- # waitfornbd_exit nbd1 00:04:10.395 22:42:01 -- bdev/nbd_common.sh@35 -- # local nbd_name=nbd1 00:04:10.395 22:42:01 -- bdev/nbd_common.sh@37 -- # (( i = 1 )) 00:04:10.395 22:42:01 -- bdev/nbd_common.sh@37 -- # (( i <= 20 )) 00:04:10.395 22:42:01 -- bdev/nbd_common.sh@38 -- # grep -q -w nbd1 /proc/partitions 00:04:10.395 22:42:01 -- bdev/nbd_common.sh@41 -- # break 00:04:10.395 22:42:01 -- bdev/nbd_common.sh@45 -- # return 0 00:04:10.395 22:42:01 -- bdev/nbd_common.sh@104 -- # nbd_get_count /var/tmp/spdk-nbd.sock 00:04:10.395 22:42:01 -- bdev/nbd_common.sh@61 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:04:10.395 22:42:01 -- bdev/nbd_common.sh@63 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_get_disks 00:04:10.653 22:42:01 -- bdev/nbd_common.sh@63 -- # nbd_disks_json='[]' 00:04:10.653 22:42:01 -- bdev/nbd_common.sh@64 -- # echo '[]' 00:04:10.653 22:42:01 -- bdev/nbd_common.sh@64 -- # jq -r '.[] | .nbd_device' 00:04:10.653 22:42:01 -- bdev/nbd_common.sh@64 -- # nbd_disks_name= 00:04:10.653 22:42:01 -- bdev/nbd_common.sh@65 -- # echo '' 00:04:10.653 22:42:01 -- bdev/nbd_common.sh@65 -- # grep -c /dev/nbd 00:04:10.653 22:42:01 -- bdev/nbd_common.sh@65 -- # true 00:04:10.653 22:42:01 -- bdev/nbd_common.sh@65 -- # count=0 00:04:10.653 22:42:01 -- bdev/nbd_common.sh@66 -- # echo 0 00:04:10.653 22:42:01 -- bdev/nbd_common.sh@104 -- # count=0 00:04:10.653 22:42:01 -- bdev/nbd_common.sh@105 -- # '[' 0 -ne 0 ']' 00:04:10.653 22:42:01 -- bdev/nbd_common.sh@109 -- # return 0 00:04:10.653 22:42:01 -- event/event.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock spdk_kill_instance SIGTERM 00:04:10.910 22:42:02 -- event/event.sh@35 -- # sleep 3 00:04:11.168 [2024-04-16 22:42:02.291159] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 2 00:04:11.426 [2024-04-16 22:42:02.405038] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:04:11.426 [2024-04-16 22:42:02.405039] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:04:11.426 [2024-04-16 22:42:02.466776] notify.c: 45:spdk_notify_type_register: *NOTICE*: Notification type 'bdev_register' already registered. 00:04:11.426 [2024-04-16 22:42:02.466850] notify.c: 45:spdk_notify_type_register: *NOTICE*: Notification type 'bdev_unregister' already registered. 00:04:13.953 22:42:05 -- event/event.sh@23 -- # for i in {0..2} 00:04:13.953 22:42:05 -- event/event.sh@24 -- # echo 'spdk_app_start Round 1' 00:04:13.953 spdk_app_start Round 1 00:04:13.953 22:42:05 -- event/event.sh@25 -- # waitforlisten 155738 /var/tmp/spdk-nbd.sock 00:04:13.953 22:42:05 -- common/autotest_common.sh@819 -- # '[' -z 155738 ']' 00:04:13.953 22:42:05 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk-nbd.sock 00:04:13.953 22:42:05 -- common/autotest_common.sh@824 -- # local max_retries=100 00:04:13.953 22:42:05 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk-nbd.sock...' 00:04:13.953 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk-nbd.sock... 00:04:13.953 22:42:05 -- common/autotest_common.sh@828 -- # xtrace_disable 00:04:13.953 22:42:05 -- common/autotest_common.sh@10 -- # set +x 00:04:14.211 22:42:05 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:04:14.211 22:42:05 -- common/autotest_common.sh@852 -- # return 0 00:04:14.211 22:42:05 -- event/event.sh@27 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock bdev_malloc_create 64 4096 00:04:14.468 Malloc0 00:04:14.468 22:42:05 -- event/event.sh@28 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock bdev_malloc_create 64 4096 00:04:14.726 Malloc1 00:04:14.726 22:42:05 -- event/event.sh@30 -- # nbd_rpc_data_verify /var/tmp/spdk-nbd.sock 'Malloc0 Malloc1' '/dev/nbd0 /dev/nbd1' 00:04:14.726 22:42:05 -- bdev/nbd_common.sh@90 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:04:14.726 22:42:05 -- bdev/nbd_common.sh@91 -- # bdev_list=('Malloc0' 'Malloc1') 00:04:14.726 22:42:05 -- bdev/nbd_common.sh@91 -- # local bdev_list 00:04:14.726 22:42:05 -- bdev/nbd_common.sh@92 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:04:14.726 22:42:05 -- bdev/nbd_common.sh@92 -- # local nbd_list 00:04:14.726 22:42:05 -- bdev/nbd_common.sh@94 -- # nbd_start_disks /var/tmp/spdk-nbd.sock 'Malloc0 Malloc1' '/dev/nbd0 /dev/nbd1' 00:04:14.726 22:42:05 -- bdev/nbd_common.sh@9 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:04:14.726 22:42:05 -- bdev/nbd_common.sh@10 -- # bdev_list=('Malloc0' 'Malloc1') 00:04:14.726 22:42:05 -- bdev/nbd_common.sh@10 -- # local bdev_list 00:04:14.726 22:42:05 -- bdev/nbd_common.sh@11 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:04:14.726 22:42:05 -- bdev/nbd_common.sh@11 -- # local nbd_list 00:04:14.726 22:42:05 -- bdev/nbd_common.sh@12 -- # local i 00:04:14.726 22:42:05 -- bdev/nbd_common.sh@14 -- # (( i = 0 )) 00:04:14.726 22:42:05 -- bdev/nbd_common.sh@14 -- # (( i < 2 )) 00:04:14.726 22:42:05 -- bdev/nbd_common.sh@15 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_start_disk Malloc0 /dev/nbd0 00:04:14.984 /dev/nbd0 00:04:14.984 22:42:06 -- bdev/nbd_common.sh@17 -- # basename /dev/nbd0 00:04:14.984 22:42:06 -- bdev/nbd_common.sh@17 -- # waitfornbd nbd0 00:04:14.984 22:42:06 -- common/autotest_common.sh@856 -- # local nbd_name=nbd0 00:04:14.984 22:42:06 -- common/autotest_common.sh@857 -- # local i 00:04:14.984 22:42:06 -- common/autotest_common.sh@859 -- # (( i = 1 )) 00:04:14.984 22:42:06 -- common/autotest_common.sh@859 -- # (( i <= 20 )) 00:04:14.984 22:42:06 -- common/autotest_common.sh@860 -- # grep -q -w nbd0 /proc/partitions 00:04:14.984 22:42:06 -- common/autotest_common.sh@861 -- # break 00:04:14.984 22:42:06 -- common/autotest_common.sh@872 -- # (( i = 1 )) 00:04:14.984 22:42:06 -- common/autotest_common.sh@872 -- # (( i <= 20 )) 00:04:14.984 22:42:06 -- common/autotest_common.sh@873 -- # dd if=/dev/nbd0 of=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest bs=4096 count=1 iflag=direct 00:04:14.984 1+0 records in 00:04:14.984 1+0 records out 00:04:14.984 4096 bytes (4.1 kB, 4.0 KiB) copied, 0.000181044 s, 22.6 MB/s 00:04:14.984 22:42:06 -- common/autotest_common.sh@874 -- # stat -c %s /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest 00:04:14.984 22:42:06 -- common/autotest_common.sh@874 -- # size=4096 00:04:14.984 22:42:06 -- common/autotest_common.sh@875 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest 00:04:14.984 22:42:06 -- common/autotest_common.sh@876 -- # '[' 4096 '!=' 0 ']' 00:04:14.984 22:42:06 -- common/autotest_common.sh@877 -- # return 0 00:04:14.984 22:42:06 -- bdev/nbd_common.sh@14 -- # (( i++ )) 00:04:14.984 22:42:06 -- bdev/nbd_common.sh@14 -- # (( i < 2 )) 00:04:14.984 22:42:06 -- bdev/nbd_common.sh@15 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_start_disk Malloc1 /dev/nbd1 00:04:15.242 /dev/nbd1 00:04:15.242 22:42:06 -- bdev/nbd_common.sh@17 -- # basename /dev/nbd1 00:04:15.242 22:42:06 -- bdev/nbd_common.sh@17 -- # waitfornbd nbd1 00:04:15.242 22:42:06 -- common/autotest_common.sh@856 -- # local nbd_name=nbd1 00:04:15.242 22:42:06 -- common/autotest_common.sh@857 -- # local i 00:04:15.242 22:42:06 -- common/autotest_common.sh@859 -- # (( i = 1 )) 00:04:15.242 22:42:06 -- common/autotest_common.sh@859 -- # (( i <= 20 )) 00:04:15.242 22:42:06 -- common/autotest_common.sh@860 -- # grep -q -w nbd1 /proc/partitions 00:04:15.242 22:42:06 -- common/autotest_common.sh@861 -- # break 00:04:15.242 22:42:06 -- common/autotest_common.sh@872 -- # (( i = 1 )) 00:04:15.242 22:42:06 -- common/autotest_common.sh@872 -- # (( i <= 20 )) 00:04:15.242 22:42:06 -- common/autotest_common.sh@873 -- # dd if=/dev/nbd1 of=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest bs=4096 count=1 iflag=direct 00:04:15.242 1+0 records in 00:04:15.242 1+0 records out 00:04:15.242 4096 bytes (4.1 kB, 4.0 KiB) copied, 0.000176433 s, 23.2 MB/s 00:04:15.242 22:42:06 -- common/autotest_common.sh@874 -- # stat -c %s /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest 00:04:15.242 22:42:06 -- common/autotest_common.sh@874 -- # size=4096 00:04:15.242 22:42:06 -- common/autotest_common.sh@875 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest 00:04:15.242 22:42:06 -- common/autotest_common.sh@876 -- # '[' 4096 '!=' 0 ']' 00:04:15.242 22:42:06 -- common/autotest_common.sh@877 -- # return 0 00:04:15.242 22:42:06 -- bdev/nbd_common.sh@14 -- # (( i++ )) 00:04:15.242 22:42:06 -- bdev/nbd_common.sh@14 -- # (( i < 2 )) 00:04:15.242 22:42:06 -- bdev/nbd_common.sh@95 -- # nbd_get_count /var/tmp/spdk-nbd.sock 00:04:15.242 22:42:06 -- bdev/nbd_common.sh@61 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:04:15.242 22:42:06 -- bdev/nbd_common.sh@63 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_get_disks 00:04:15.499 22:42:06 -- bdev/nbd_common.sh@63 -- # nbd_disks_json='[ 00:04:15.499 { 00:04:15.499 "nbd_device": "/dev/nbd0", 00:04:15.499 "bdev_name": "Malloc0" 00:04:15.499 }, 00:04:15.499 { 00:04:15.499 "nbd_device": "/dev/nbd1", 00:04:15.499 "bdev_name": "Malloc1" 00:04:15.499 } 00:04:15.499 ]' 00:04:15.499 22:42:06 -- bdev/nbd_common.sh@64 -- # echo '[ 00:04:15.499 { 00:04:15.499 "nbd_device": "/dev/nbd0", 00:04:15.499 "bdev_name": "Malloc0" 00:04:15.499 }, 00:04:15.499 { 00:04:15.499 "nbd_device": "/dev/nbd1", 00:04:15.499 "bdev_name": "Malloc1" 00:04:15.499 } 00:04:15.499 ]' 00:04:15.499 22:42:06 -- bdev/nbd_common.sh@64 -- # jq -r '.[] | .nbd_device' 00:04:15.499 22:42:06 -- bdev/nbd_common.sh@64 -- # nbd_disks_name='/dev/nbd0 00:04:15.499 /dev/nbd1' 00:04:15.499 22:42:06 -- bdev/nbd_common.sh@65 -- # echo '/dev/nbd0 00:04:15.499 /dev/nbd1' 00:04:15.499 22:42:06 -- bdev/nbd_common.sh@65 -- # grep -c /dev/nbd 00:04:15.499 22:42:06 -- bdev/nbd_common.sh@65 -- # count=2 00:04:15.499 22:42:06 -- bdev/nbd_common.sh@66 -- # echo 2 00:04:15.499 22:42:06 -- bdev/nbd_common.sh@95 -- # count=2 00:04:15.499 22:42:06 -- bdev/nbd_common.sh@96 -- # '[' 2 -ne 2 ']' 00:04:15.499 22:42:06 -- bdev/nbd_common.sh@100 -- # nbd_dd_data_verify '/dev/nbd0 /dev/nbd1' write 00:04:15.499 22:42:06 -- bdev/nbd_common.sh@70 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:04:15.499 22:42:06 -- bdev/nbd_common.sh@70 -- # local nbd_list 00:04:15.499 22:42:06 -- bdev/nbd_common.sh@71 -- # local operation=write 00:04:15.499 22:42:06 -- bdev/nbd_common.sh@72 -- # local tmp_file=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest 00:04:15.499 22:42:06 -- bdev/nbd_common.sh@74 -- # '[' write = write ']' 00:04:15.499 22:42:06 -- bdev/nbd_common.sh@76 -- # dd if=/dev/urandom of=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest bs=4096 count=256 00:04:15.499 256+0 records in 00:04:15.499 256+0 records out 00:04:15.499 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00506666 s, 207 MB/s 00:04:15.499 22:42:06 -- bdev/nbd_common.sh@77 -- # for i in "${nbd_list[@]}" 00:04:15.499 22:42:06 -- bdev/nbd_common.sh@78 -- # dd if=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest of=/dev/nbd0 bs=4096 count=256 oflag=direct 00:04:15.757 256+0 records in 00:04:15.757 256+0 records out 00:04:15.757 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0209983 s, 49.9 MB/s 00:04:15.757 22:42:06 -- bdev/nbd_common.sh@77 -- # for i in "${nbd_list[@]}" 00:04:15.757 22:42:06 -- bdev/nbd_common.sh@78 -- # dd if=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest of=/dev/nbd1 bs=4096 count=256 oflag=direct 00:04:15.757 256+0 records in 00:04:15.757 256+0 records out 00:04:15.757 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0243476 s, 43.1 MB/s 00:04:15.757 22:42:06 -- bdev/nbd_common.sh@101 -- # nbd_dd_data_verify '/dev/nbd0 /dev/nbd1' verify 00:04:15.757 22:42:06 -- bdev/nbd_common.sh@70 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:04:15.757 22:42:06 -- bdev/nbd_common.sh@70 -- # local nbd_list 00:04:15.757 22:42:06 -- bdev/nbd_common.sh@71 -- # local operation=verify 00:04:15.757 22:42:06 -- bdev/nbd_common.sh@72 -- # local tmp_file=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest 00:04:15.757 22:42:06 -- bdev/nbd_common.sh@74 -- # '[' verify = write ']' 00:04:15.757 22:42:06 -- bdev/nbd_common.sh@80 -- # '[' verify = verify ']' 00:04:15.757 22:42:06 -- bdev/nbd_common.sh@82 -- # for i in "${nbd_list[@]}" 00:04:15.757 22:42:06 -- bdev/nbd_common.sh@83 -- # cmp -b -n 1M /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest /dev/nbd0 00:04:15.757 22:42:06 -- bdev/nbd_common.sh@82 -- # for i in "${nbd_list[@]}" 00:04:15.757 22:42:06 -- bdev/nbd_common.sh@83 -- # cmp -b -n 1M /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest /dev/nbd1 00:04:15.757 22:42:06 -- bdev/nbd_common.sh@85 -- # rm /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest 00:04:15.757 22:42:06 -- bdev/nbd_common.sh@103 -- # nbd_stop_disks /var/tmp/spdk-nbd.sock '/dev/nbd0 /dev/nbd1' 00:04:15.757 22:42:06 -- bdev/nbd_common.sh@49 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:04:15.757 22:42:06 -- bdev/nbd_common.sh@50 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:04:15.757 22:42:06 -- bdev/nbd_common.sh@50 -- # local nbd_list 00:04:15.757 22:42:06 -- bdev/nbd_common.sh@51 -- # local i 00:04:15.757 22:42:06 -- bdev/nbd_common.sh@53 -- # for i in "${nbd_list[@]}" 00:04:15.757 22:42:06 -- bdev/nbd_common.sh@54 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_stop_disk /dev/nbd0 00:04:16.014 22:42:06 -- bdev/nbd_common.sh@55 -- # basename /dev/nbd0 00:04:16.014 22:42:06 -- bdev/nbd_common.sh@55 -- # waitfornbd_exit nbd0 00:04:16.014 22:42:06 -- bdev/nbd_common.sh@35 -- # local nbd_name=nbd0 00:04:16.014 22:42:06 -- bdev/nbd_common.sh@37 -- # (( i = 1 )) 00:04:16.014 22:42:06 -- bdev/nbd_common.sh@37 -- # (( i <= 20 )) 00:04:16.014 22:42:06 -- bdev/nbd_common.sh@38 -- # grep -q -w nbd0 /proc/partitions 00:04:16.014 22:42:06 -- bdev/nbd_common.sh@41 -- # break 00:04:16.014 22:42:06 -- bdev/nbd_common.sh@45 -- # return 0 00:04:16.014 22:42:06 -- bdev/nbd_common.sh@53 -- # for i in "${nbd_list[@]}" 00:04:16.014 22:42:06 -- bdev/nbd_common.sh@54 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_stop_disk /dev/nbd1 00:04:16.272 22:42:07 -- bdev/nbd_common.sh@55 -- # basename /dev/nbd1 00:04:16.272 22:42:07 -- bdev/nbd_common.sh@55 -- # waitfornbd_exit nbd1 00:04:16.272 22:42:07 -- bdev/nbd_common.sh@35 -- # local nbd_name=nbd1 00:04:16.272 22:42:07 -- bdev/nbd_common.sh@37 -- # (( i = 1 )) 00:04:16.272 22:42:07 -- bdev/nbd_common.sh@37 -- # (( i <= 20 )) 00:04:16.272 22:42:07 -- bdev/nbd_common.sh@38 -- # grep -q -w nbd1 /proc/partitions 00:04:16.272 22:42:07 -- bdev/nbd_common.sh@41 -- # break 00:04:16.272 22:42:07 -- bdev/nbd_common.sh@45 -- # return 0 00:04:16.272 22:42:07 -- bdev/nbd_common.sh@104 -- # nbd_get_count /var/tmp/spdk-nbd.sock 00:04:16.272 22:42:07 -- bdev/nbd_common.sh@61 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:04:16.272 22:42:07 -- bdev/nbd_common.sh@63 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_get_disks 00:04:16.529 22:42:07 -- bdev/nbd_common.sh@63 -- # nbd_disks_json='[]' 00:04:16.529 22:42:07 -- bdev/nbd_common.sh@64 -- # echo '[]' 00:04:16.529 22:42:07 -- bdev/nbd_common.sh@64 -- # jq -r '.[] | .nbd_device' 00:04:16.529 22:42:07 -- bdev/nbd_common.sh@64 -- # nbd_disks_name= 00:04:16.529 22:42:07 -- bdev/nbd_common.sh@65 -- # echo '' 00:04:16.529 22:42:07 -- bdev/nbd_common.sh@65 -- # grep -c /dev/nbd 00:04:16.529 22:42:07 -- bdev/nbd_common.sh@65 -- # true 00:04:16.529 22:42:07 -- bdev/nbd_common.sh@65 -- # count=0 00:04:16.529 22:42:07 -- bdev/nbd_common.sh@66 -- # echo 0 00:04:16.529 22:42:07 -- bdev/nbd_common.sh@104 -- # count=0 00:04:16.529 22:42:07 -- bdev/nbd_common.sh@105 -- # '[' 0 -ne 0 ']' 00:04:16.529 22:42:07 -- bdev/nbd_common.sh@109 -- # return 0 00:04:16.529 22:42:07 -- event/event.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock spdk_kill_instance SIGTERM 00:04:16.787 22:42:07 -- event/event.sh@35 -- # sleep 3 00:04:17.045 [2024-04-16 22:42:08.017993] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 2 00:04:17.045 [2024-04-16 22:42:08.130068] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:04:17.045 [2024-04-16 22:42:08.130074] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:04:17.303 [2024-04-16 22:42:08.192016] notify.c: 45:spdk_notify_type_register: *NOTICE*: Notification type 'bdev_register' already registered. 00:04:17.303 [2024-04-16 22:42:08.192089] notify.c: 45:spdk_notify_type_register: *NOTICE*: Notification type 'bdev_unregister' already registered. 00:04:19.829 22:42:10 -- event/event.sh@23 -- # for i in {0..2} 00:04:19.829 22:42:10 -- event/event.sh@24 -- # echo 'spdk_app_start Round 2' 00:04:19.829 spdk_app_start Round 2 00:04:19.829 22:42:10 -- event/event.sh@25 -- # waitforlisten 155738 /var/tmp/spdk-nbd.sock 00:04:19.829 22:42:10 -- common/autotest_common.sh@819 -- # '[' -z 155738 ']' 00:04:19.829 22:42:10 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk-nbd.sock 00:04:19.829 22:42:10 -- common/autotest_common.sh@824 -- # local max_retries=100 00:04:19.829 22:42:10 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk-nbd.sock...' 00:04:19.829 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk-nbd.sock... 00:04:19.829 22:42:10 -- common/autotest_common.sh@828 -- # xtrace_disable 00:04:19.829 22:42:10 -- common/autotest_common.sh@10 -- # set +x 00:04:20.086 22:42:10 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:04:20.086 22:42:10 -- common/autotest_common.sh@852 -- # return 0 00:04:20.086 22:42:10 -- event/event.sh@27 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock bdev_malloc_create 64 4096 00:04:20.345 Malloc0 00:04:20.345 22:42:11 -- event/event.sh@28 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock bdev_malloc_create 64 4096 00:04:20.604 Malloc1 00:04:20.604 22:42:11 -- event/event.sh@30 -- # nbd_rpc_data_verify /var/tmp/spdk-nbd.sock 'Malloc0 Malloc1' '/dev/nbd0 /dev/nbd1' 00:04:20.604 22:42:11 -- bdev/nbd_common.sh@90 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:04:20.604 22:42:11 -- bdev/nbd_common.sh@91 -- # bdev_list=('Malloc0' 'Malloc1') 00:04:20.604 22:42:11 -- bdev/nbd_common.sh@91 -- # local bdev_list 00:04:20.604 22:42:11 -- bdev/nbd_common.sh@92 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:04:20.604 22:42:11 -- bdev/nbd_common.sh@92 -- # local nbd_list 00:04:20.605 22:42:11 -- bdev/nbd_common.sh@94 -- # nbd_start_disks /var/tmp/spdk-nbd.sock 'Malloc0 Malloc1' '/dev/nbd0 /dev/nbd1' 00:04:20.605 22:42:11 -- bdev/nbd_common.sh@9 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:04:20.605 22:42:11 -- bdev/nbd_common.sh@10 -- # bdev_list=('Malloc0' 'Malloc1') 00:04:20.605 22:42:11 -- bdev/nbd_common.sh@10 -- # local bdev_list 00:04:20.605 22:42:11 -- bdev/nbd_common.sh@11 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:04:20.605 22:42:11 -- bdev/nbd_common.sh@11 -- # local nbd_list 00:04:20.605 22:42:11 -- bdev/nbd_common.sh@12 -- # local i 00:04:20.605 22:42:11 -- bdev/nbd_common.sh@14 -- # (( i = 0 )) 00:04:20.605 22:42:11 -- bdev/nbd_common.sh@14 -- # (( i < 2 )) 00:04:20.605 22:42:11 -- bdev/nbd_common.sh@15 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_start_disk Malloc0 /dev/nbd0 00:04:20.863 /dev/nbd0 00:04:20.863 22:42:11 -- bdev/nbd_common.sh@17 -- # basename /dev/nbd0 00:04:20.863 22:42:11 -- bdev/nbd_common.sh@17 -- # waitfornbd nbd0 00:04:20.863 22:42:11 -- common/autotest_common.sh@856 -- # local nbd_name=nbd0 00:04:20.863 22:42:11 -- common/autotest_common.sh@857 -- # local i 00:04:20.863 22:42:11 -- common/autotest_common.sh@859 -- # (( i = 1 )) 00:04:20.863 22:42:11 -- common/autotest_common.sh@859 -- # (( i <= 20 )) 00:04:20.863 22:42:11 -- common/autotest_common.sh@860 -- # grep -q -w nbd0 /proc/partitions 00:04:20.863 22:42:11 -- common/autotest_common.sh@861 -- # break 00:04:20.863 22:42:11 -- common/autotest_common.sh@872 -- # (( i = 1 )) 00:04:20.863 22:42:11 -- common/autotest_common.sh@872 -- # (( i <= 20 )) 00:04:20.863 22:42:11 -- common/autotest_common.sh@873 -- # dd if=/dev/nbd0 of=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest bs=4096 count=1 iflag=direct 00:04:20.863 1+0 records in 00:04:20.863 1+0 records out 00:04:20.863 4096 bytes (4.1 kB, 4.0 KiB) copied, 0.000201911 s, 20.3 MB/s 00:04:20.863 22:42:11 -- common/autotest_common.sh@874 -- # stat -c %s /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest 00:04:20.863 22:42:11 -- common/autotest_common.sh@874 -- # size=4096 00:04:20.863 22:42:11 -- common/autotest_common.sh@875 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest 00:04:20.863 22:42:11 -- common/autotest_common.sh@876 -- # '[' 4096 '!=' 0 ']' 00:04:20.863 22:42:11 -- common/autotest_common.sh@877 -- # return 0 00:04:20.863 22:42:11 -- bdev/nbd_common.sh@14 -- # (( i++ )) 00:04:20.863 22:42:11 -- bdev/nbd_common.sh@14 -- # (( i < 2 )) 00:04:20.863 22:42:11 -- bdev/nbd_common.sh@15 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_start_disk Malloc1 /dev/nbd1 00:04:21.122 /dev/nbd1 00:04:21.122 22:42:12 -- bdev/nbd_common.sh@17 -- # basename /dev/nbd1 00:04:21.122 22:42:12 -- bdev/nbd_common.sh@17 -- # waitfornbd nbd1 00:04:21.122 22:42:12 -- common/autotest_common.sh@856 -- # local nbd_name=nbd1 00:04:21.122 22:42:12 -- common/autotest_common.sh@857 -- # local i 00:04:21.122 22:42:12 -- common/autotest_common.sh@859 -- # (( i = 1 )) 00:04:21.122 22:42:12 -- common/autotest_common.sh@859 -- # (( i <= 20 )) 00:04:21.122 22:42:12 -- common/autotest_common.sh@860 -- # grep -q -w nbd1 /proc/partitions 00:04:21.122 22:42:12 -- common/autotest_common.sh@861 -- # break 00:04:21.122 22:42:12 -- common/autotest_common.sh@872 -- # (( i = 1 )) 00:04:21.122 22:42:12 -- common/autotest_common.sh@872 -- # (( i <= 20 )) 00:04:21.122 22:42:12 -- common/autotest_common.sh@873 -- # dd if=/dev/nbd1 of=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest bs=4096 count=1 iflag=direct 00:04:21.122 1+0 records in 00:04:21.122 1+0 records out 00:04:21.122 4096 bytes (4.1 kB, 4.0 KiB) copied, 0.000217621 s, 18.8 MB/s 00:04:21.122 22:42:12 -- common/autotest_common.sh@874 -- # stat -c %s /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest 00:04:21.122 22:42:12 -- common/autotest_common.sh@874 -- # size=4096 00:04:21.122 22:42:12 -- common/autotest_common.sh@875 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest 00:04:21.122 22:42:12 -- common/autotest_common.sh@876 -- # '[' 4096 '!=' 0 ']' 00:04:21.122 22:42:12 -- common/autotest_common.sh@877 -- # return 0 00:04:21.122 22:42:12 -- bdev/nbd_common.sh@14 -- # (( i++ )) 00:04:21.122 22:42:12 -- bdev/nbd_common.sh@14 -- # (( i < 2 )) 00:04:21.122 22:42:12 -- bdev/nbd_common.sh@95 -- # nbd_get_count /var/tmp/spdk-nbd.sock 00:04:21.122 22:42:12 -- bdev/nbd_common.sh@61 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:04:21.122 22:42:12 -- bdev/nbd_common.sh@63 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_get_disks 00:04:21.380 22:42:12 -- bdev/nbd_common.sh@63 -- # nbd_disks_json='[ 00:04:21.380 { 00:04:21.380 "nbd_device": "/dev/nbd0", 00:04:21.380 "bdev_name": "Malloc0" 00:04:21.381 }, 00:04:21.381 { 00:04:21.381 "nbd_device": "/dev/nbd1", 00:04:21.381 "bdev_name": "Malloc1" 00:04:21.381 } 00:04:21.381 ]' 00:04:21.381 22:42:12 -- bdev/nbd_common.sh@64 -- # echo '[ 00:04:21.381 { 00:04:21.381 "nbd_device": "/dev/nbd0", 00:04:21.381 "bdev_name": "Malloc0" 00:04:21.381 }, 00:04:21.381 { 00:04:21.381 "nbd_device": "/dev/nbd1", 00:04:21.381 "bdev_name": "Malloc1" 00:04:21.381 } 00:04:21.381 ]' 00:04:21.381 22:42:12 -- bdev/nbd_common.sh@64 -- # jq -r '.[] | .nbd_device' 00:04:21.381 22:42:12 -- bdev/nbd_common.sh@64 -- # nbd_disks_name='/dev/nbd0 00:04:21.381 /dev/nbd1' 00:04:21.381 22:42:12 -- bdev/nbd_common.sh@65 -- # echo '/dev/nbd0 00:04:21.381 /dev/nbd1' 00:04:21.381 22:42:12 -- bdev/nbd_common.sh@65 -- # grep -c /dev/nbd 00:04:21.381 22:42:12 -- bdev/nbd_common.sh@65 -- # count=2 00:04:21.381 22:42:12 -- bdev/nbd_common.sh@66 -- # echo 2 00:04:21.381 22:42:12 -- bdev/nbd_common.sh@95 -- # count=2 00:04:21.381 22:42:12 -- bdev/nbd_common.sh@96 -- # '[' 2 -ne 2 ']' 00:04:21.381 22:42:12 -- bdev/nbd_common.sh@100 -- # nbd_dd_data_verify '/dev/nbd0 /dev/nbd1' write 00:04:21.381 22:42:12 -- bdev/nbd_common.sh@70 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:04:21.381 22:42:12 -- bdev/nbd_common.sh@70 -- # local nbd_list 00:04:21.381 22:42:12 -- bdev/nbd_common.sh@71 -- # local operation=write 00:04:21.381 22:42:12 -- bdev/nbd_common.sh@72 -- # local tmp_file=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest 00:04:21.381 22:42:12 -- bdev/nbd_common.sh@74 -- # '[' write = write ']' 00:04:21.381 22:42:12 -- bdev/nbd_common.sh@76 -- # dd if=/dev/urandom of=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest bs=4096 count=256 00:04:21.381 256+0 records in 00:04:21.381 256+0 records out 00:04:21.381 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00467258 s, 224 MB/s 00:04:21.381 22:42:12 -- bdev/nbd_common.sh@77 -- # for i in "${nbd_list[@]}" 00:04:21.381 22:42:12 -- bdev/nbd_common.sh@78 -- # dd if=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest of=/dev/nbd0 bs=4096 count=256 oflag=direct 00:04:21.381 256+0 records in 00:04:21.381 256+0 records out 00:04:21.381 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0237192 s, 44.2 MB/s 00:04:21.381 22:42:12 -- bdev/nbd_common.sh@77 -- # for i in "${nbd_list[@]}" 00:04:21.381 22:42:12 -- bdev/nbd_common.sh@78 -- # dd if=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest of=/dev/nbd1 bs=4096 count=256 oflag=direct 00:04:21.381 256+0 records in 00:04:21.381 256+0 records out 00:04:21.381 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.022013 s, 47.6 MB/s 00:04:21.381 22:42:12 -- bdev/nbd_common.sh@101 -- # nbd_dd_data_verify '/dev/nbd0 /dev/nbd1' verify 00:04:21.381 22:42:12 -- bdev/nbd_common.sh@70 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:04:21.381 22:42:12 -- bdev/nbd_common.sh@70 -- # local nbd_list 00:04:21.381 22:42:12 -- bdev/nbd_common.sh@71 -- # local operation=verify 00:04:21.381 22:42:12 -- bdev/nbd_common.sh@72 -- # local tmp_file=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest 00:04:21.381 22:42:12 -- bdev/nbd_common.sh@74 -- # '[' verify = write ']' 00:04:21.381 22:42:12 -- bdev/nbd_common.sh@80 -- # '[' verify = verify ']' 00:04:21.381 22:42:12 -- bdev/nbd_common.sh@82 -- # for i in "${nbd_list[@]}" 00:04:21.381 22:42:12 -- bdev/nbd_common.sh@83 -- # cmp -b -n 1M /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest /dev/nbd0 00:04:21.381 22:42:12 -- bdev/nbd_common.sh@82 -- # for i in "${nbd_list[@]}" 00:04:21.381 22:42:12 -- bdev/nbd_common.sh@83 -- # cmp -b -n 1M /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest /dev/nbd1 00:04:21.381 22:42:12 -- bdev/nbd_common.sh@85 -- # rm /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest 00:04:21.381 22:42:12 -- bdev/nbd_common.sh@103 -- # nbd_stop_disks /var/tmp/spdk-nbd.sock '/dev/nbd0 /dev/nbd1' 00:04:21.381 22:42:12 -- bdev/nbd_common.sh@49 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:04:21.381 22:42:12 -- bdev/nbd_common.sh@50 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:04:21.381 22:42:12 -- bdev/nbd_common.sh@50 -- # local nbd_list 00:04:21.381 22:42:12 -- bdev/nbd_common.sh@51 -- # local i 00:04:21.381 22:42:12 -- bdev/nbd_common.sh@53 -- # for i in "${nbd_list[@]}" 00:04:21.381 22:42:12 -- bdev/nbd_common.sh@54 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_stop_disk /dev/nbd0 00:04:21.639 22:42:12 -- bdev/nbd_common.sh@55 -- # basename /dev/nbd0 00:04:21.639 22:42:12 -- bdev/nbd_common.sh@55 -- # waitfornbd_exit nbd0 00:04:21.639 22:42:12 -- bdev/nbd_common.sh@35 -- # local nbd_name=nbd0 00:04:21.639 22:42:12 -- bdev/nbd_common.sh@37 -- # (( i = 1 )) 00:04:21.639 22:42:12 -- bdev/nbd_common.sh@37 -- # (( i <= 20 )) 00:04:21.639 22:42:12 -- bdev/nbd_common.sh@38 -- # grep -q -w nbd0 /proc/partitions 00:04:21.639 22:42:12 -- bdev/nbd_common.sh@41 -- # break 00:04:21.639 22:42:12 -- bdev/nbd_common.sh@45 -- # return 0 00:04:21.639 22:42:12 -- bdev/nbd_common.sh@53 -- # for i in "${nbd_list[@]}" 00:04:21.639 22:42:12 -- bdev/nbd_common.sh@54 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_stop_disk /dev/nbd1 00:04:21.897 22:42:12 -- bdev/nbd_common.sh@55 -- # basename /dev/nbd1 00:04:21.897 22:42:12 -- bdev/nbd_common.sh@55 -- # waitfornbd_exit nbd1 00:04:21.897 22:42:12 -- bdev/nbd_common.sh@35 -- # local nbd_name=nbd1 00:04:21.897 22:42:12 -- bdev/nbd_common.sh@37 -- # (( i = 1 )) 00:04:21.897 22:42:12 -- bdev/nbd_common.sh@37 -- # (( i <= 20 )) 00:04:21.897 22:42:12 -- bdev/nbd_common.sh@38 -- # grep -q -w nbd1 /proc/partitions 00:04:21.897 22:42:12 -- bdev/nbd_common.sh@41 -- # break 00:04:21.897 22:42:12 -- bdev/nbd_common.sh@45 -- # return 0 00:04:21.897 22:42:12 -- bdev/nbd_common.sh@104 -- # nbd_get_count /var/tmp/spdk-nbd.sock 00:04:21.897 22:42:12 -- bdev/nbd_common.sh@61 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:04:21.897 22:42:12 -- bdev/nbd_common.sh@63 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_get_disks 00:04:22.155 22:42:13 -- bdev/nbd_common.sh@63 -- # nbd_disks_json='[]' 00:04:22.155 22:42:13 -- bdev/nbd_common.sh@64 -- # echo '[]' 00:04:22.155 22:42:13 -- bdev/nbd_common.sh@64 -- # jq -r '.[] | .nbd_device' 00:04:22.155 22:42:13 -- bdev/nbd_common.sh@64 -- # nbd_disks_name= 00:04:22.155 22:42:13 -- bdev/nbd_common.sh@65 -- # echo '' 00:04:22.155 22:42:13 -- bdev/nbd_common.sh@65 -- # grep -c /dev/nbd 00:04:22.155 22:42:13 -- bdev/nbd_common.sh@65 -- # true 00:04:22.155 22:42:13 -- bdev/nbd_common.sh@65 -- # count=0 00:04:22.155 22:42:13 -- bdev/nbd_common.sh@66 -- # echo 0 00:04:22.155 22:42:13 -- bdev/nbd_common.sh@104 -- # count=0 00:04:22.155 22:42:13 -- bdev/nbd_common.sh@105 -- # '[' 0 -ne 0 ']' 00:04:22.155 22:42:13 -- bdev/nbd_common.sh@109 -- # return 0 00:04:22.155 22:42:13 -- event/event.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock spdk_kill_instance SIGTERM 00:04:22.415 22:42:13 -- event/event.sh@35 -- # sleep 3 00:04:22.675 [2024-04-16 22:42:13.697236] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 2 00:04:22.933 [2024-04-16 22:42:13.812017] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:04:22.933 [2024-04-16 22:42:13.812022] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:04:22.933 [2024-04-16 22:42:13.873679] notify.c: 45:spdk_notify_type_register: *NOTICE*: Notification type 'bdev_register' already registered. 00:04:22.933 [2024-04-16 22:42:13.873755] notify.c: 45:spdk_notify_type_register: *NOTICE*: Notification type 'bdev_unregister' already registered. 00:04:25.502 22:42:16 -- event/event.sh@38 -- # waitforlisten 155738 /var/tmp/spdk-nbd.sock 00:04:25.502 22:42:16 -- common/autotest_common.sh@819 -- # '[' -z 155738 ']' 00:04:25.502 22:42:16 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk-nbd.sock 00:04:25.502 22:42:16 -- common/autotest_common.sh@824 -- # local max_retries=100 00:04:25.502 22:42:16 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk-nbd.sock...' 00:04:25.502 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk-nbd.sock... 00:04:25.502 22:42:16 -- common/autotest_common.sh@828 -- # xtrace_disable 00:04:25.502 22:42:16 -- common/autotest_common.sh@10 -- # set +x 00:04:25.760 22:42:16 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:04:25.760 22:42:16 -- common/autotest_common.sh@852 -- # return 0 00:04:25.760 22:42:16 -- event/event.sh@39 -- # killprocess 155738 00:04:25.760 22:42:16 -- common/autotest_common.sh@926 -- # '[' -z 155738 ']' 00:04:25.760 22:42:16 -- common/autotest_common.sh@930 -- # kill -0 155738 00:04:25.760 22:42:16 -- common/autotest_common.sh@931 -- # uname 00:04:25.760 22:42:16 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:04:25.760 22:42:16 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 155738 00:04:25.760 22:42:16 -- common/autotest_common.sh@932 -- # process_name=reactor_0 00:04:25.760 22:42:16 -- common/autotest_common.sh@936 -- # '[' reactor_0 = sudo ']' 00:04:25.760 22:42:16 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 155738' 00:04:25.760 killing process with pid 155738 00:04:25.760 22:42:16 -- common/autotest_common.sh@945 -- # kill 155738 00:04:25.760 22:42:16 -- common/autotest_common.sh@950 -- # wait 155738 00:04:26.019 spdk_app_start is called in Round 0. 00:04:26.019 Shutdown signal received, stop current app iteration 00:04:26.019 Starting SPDK v24.01.1-pre git sha1 4b134b4ab / DPDK 23.11.0 reinitialization... 00:04:26.019 spdk_app_start is called in Round 1. 00:04:26.019 Shutdown signal received, stop current app iteration 00:04:26.019 Starting SPDK v24.01.1-pre git sha1 4b134b4ab / DPDK 23.11.0 reinitialization... 00:04:26.019 spdk_app_start is called in Round 2. 00:04:26.019 Shutdown signal received, stop current app iteration 00:04:26.019 Starting SPDK v24.01.1-pre git sha1 4b134b4ab / DPDK 23.11.0 reinitialization... 00:04:26.019 spdk_app_start is called in Round 3. 00:04:26.019 Shutdown signal received, stop current app iteration 00:04:26.019 22:42:16 -- event/event.sh@40 -- # trap - SIGINT SIGTERM EXIT 00:04:26.019 22:42:16 -- event/event.sh@42 -- # return 0 00:04:26.019 00:04:26.019 real 0m18.430s 00:04:26.019 user 0m40.226s 00:04:26.019 sys 0m3.351s 00:04:26.019 22:42:16 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:04:26.019 22:42:16 -- common/autotest_common.sh@10 -- # set +x 00:04:26.019 ************************************ 00:04:26.019 END TEST app_repeat 00:04:26.019 ************************************ 00:04:26.019 22:42:16 -- event/event.sh@54 -- # (( SPDK_TEST_CRYPTO == 0 )) 00:04:26.019 22:42:16 -- event/event.sh@55 -- # run_test cpu_locks /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/cpu_locks.sh 00:04:26.019 22:42:16 -- common/autotest_common.sh@1077 -- # '[' 2 -le 1 ']' 00:04:26.019 22:42:16 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:04:26.019 22:42:16 -- common/autotest_common.sh@10 -- # set +x 00:04:26.019 ************************************ 00:04:26.019 START TEST cpu_locks 00:04:26.019 ************************************ 00:04:26.019 22:42:16 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/cpu_locks.sh 00:04:26.019 * Looking for test storage... 00:04:26.019 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event 00:04:26.019 22:42:17 -- event/cpu_locks.sh@11 -- # rpc_sock1=/var/tmp/spdk.sock 00:04:26.019 22:42:17 -- event/cpu_locks.sh@12 -- # rpc_sock2=/var/tmp/spdk2.sock 00:04:26.019 22:42:17 -- event/cpu_locks.sh@164 -- # trap cleanup EXIT SIGTERM SIGINT 00:04:26.019 22:42:17 -- event/cpu_locks.sh@166 -- # run_test default_locks default_locks 00:04:26.019 22:42:17 -- common/autotest_common.sh@1077 -- # '[' 2 -le 1 ']' 00:04:26.019 22:42:17 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:04:26.019 22:42:17 -- common/autotest_common.sh@10 -- # set +x 00:04:26.019 ************************************ 00:04:26.019 START TEST default_locks 00:04:26.019 ************************************ 00:04:26.019 22:42:17 -- common/autotest_common.sh@1104 -- # default_locks 00:04:26.019 22:42:17 -- event/cpu_locks.sh@46 -- # spdk_tgt_pid=158772 00:04:26.019 22:42:17 -- event/cpu_locks.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x1 00:04:26.019 22:42:17 -- event/cpu_locks.sh@47 -- # waitforlisten 158772 00:04:26.019 22:42:17 -- common/autotest_common.sh@819 -- # '[' -z 158772 ']' 00:04:26.019 22:42:17 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk.sock 00:04:26.019 22:42:17 -- common/autotest_common.sh@824 -- # local max_retries=100 00:04:26.019 22:42:17 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:04:26.019 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:04:26.019 22:42:17 -- common/autotest_common.sh@828 -- # xtrace_disable 00:04:26.019 22:42:17 -- common/autotest_common.sh@10 -- # set +x 00:04:26.019 [2024-04-16 22:42:17.071411] Starting SPDK v24.01.1-pre git sha1 4b134b4ab / DPDK 23.11.0 initialization... 00:04:26.019 [2024-04-16 22:42:17.071506] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid158772 ] 00:04:26.019 EAL: No free 2048 kB hugepages reported on node 1 00:04:26.019 [2024-04-16 22:42:17.127454] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:04:26.277 [2024-04-16 22:42:17.231255] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:04:26.278 [2024-04-16 22:42:17.231409] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:04:27.215 22:42:17 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:04:27.215 22:42:17 -- common/autotest_common.sh@852 -- # return 0 00:04:27.215 22:42:17 -- event/cpu_locks.sh@49 -- # locks_exist 158772 00:04:27.215 22:42:17 -- event/cpu_locks.sh@22 -- # lslocks -p 158772 00:04:27.215 22:42:17 -- event/cpu_locks.sh@22 -- # grep -q spdk_cpu_lock 00:04:27.215 lslocks: write error 00:04:27.215 22:42:18 -- event/cpu_locks.sh@50 -- # killprocess 158772 00:04:27.215 22:42:18 -- common/autotest_common.sh@926 -- # '[' -z 158772 ']' 00:04:27.215 22:42:18 -- common/autotest_common.sh@930 -- # kill -0 158772 00:04:27.215 22:42:18 -- common/autotest_common.sh@931 -- # uname 00:04:27.215 22:42:18 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:04:27.215 22:42:18 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 158772 00:04:27.215 22:42:18 -- common/autotest_common.sh@932 -- # process_name=reactor_0 00:04:27.215 22:42:18 -- common/autotest_common.sh@936 -- # '[' reactor_0 = sudo ']' 00:04:27.216 22:42:18 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 158772' 00:04:27.216 killing process with pid 158772 00:04:27.216 22:42:18 -- common/autotest_common.sh@945 -- # kill 158772 00:04:27.216 22:42:18 -- common/autotest_common.sh@950 -- # wait 158772 00:04:27.784 22:42:18 -- event/cpu_locks.sh@52 -- # NOT waitforlisten 158772 00:04:27.784 22:42:18 -- common/autotest_common.sh@640 -- # local es=0 00:04:27.784 22:42:18 -- common/autotest_common.sh@642 -- # valid_exec_arg waitforlisten 158772 00:04:27.784 22:42:18 -- common/autotest_common.sh@628 -- # local arg=waitforlisten 00:04:27.784 22:42:18 -- common/autotest_common.sh@632 -- # case "$(type -t "$arg")" in 00:04:27.784 22:42:18 -- common/autotest_common.sh@632 -- # type -t waitforlisten 00:04:27.784 22:42:18 -- common/autotest_common.sh@632 -- # case "$(type -t "$arg")" in 00:04:27.784 22:42:18 -- common/autotest_common.sh@643 -- # waitforlisten 158772 00:04:27.784 22:42:18 -- common/autotest_common.sh@819 -- # '[' -z 158772 ']' 00:04:27.784 22:42:18 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk.sock 00:04:27.784 22:42:18 -- common/autotest_common.sh@824 -- # local max_retries=100 00:04:27.784 22:42:18 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:04:27.785 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:04:27.785 22:42:18 -- common/autotest_common.sh@828 -- # xtrace_disable 00:04:27.785 22:42:18 -- common/autotest_common.sh@10 -- # set +x 00:04:27.785 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/autotest_common.sh: line 834: kill: (158772) - No such process 00:04:27.785 ERROR: process (pid: 158772) is no longer running 00:04:27.785 22:42:18 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:04:27.785 22:42:18 -- common/autotest_common.sh@852 -- # return 1 00:04:27.785 22:42:18 -- common/autotest_common.sh@643 -- # es=1 00:04:27.785 22:42:18 -- common/autotest_common.sh@651 -- # (( es > 128 )) 00:04:27.785 22:42:18 -- common/autotest_common.sh@662 -- # [[ -n '' ]] 00:04:27.785 22:42:18 -- common/autotest_common.sh@667 -- # (( !es == 0 )) 00:04:27.785 22:42:18 -- event/cpu_locks.sh@54 -- # no_locks 00:04:27.785 22:42:18 -- event/cpu_locks.sh@26 -- # lock_files=() 00:04:27.785 22:42:18 -- event/cpu_locks.sh@26 -- # local lock_files 00:04:27.785 22:42:18 -- event/cpu_locks.sh@27 -- # (( 0 != 0 )) 00:04:27.785 00:04:27.785 real 0m1.676s 00:04:27.785 user 0m1.780s 00:04:27.785 sys 0m0.536s 00:04:27.785 22:42:18 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:04:27.785 22:42:18 -- common/autotest_common.sh@10 -- # set +x 00:04:27.785 ************************************ 00:04:27.785 END TEST default_locks 00:04:27.785 ************************************ 00:04:27.785 22:42:18 -- event/cpu_locks.sh@167 -- # run_test default_locks_via_rpc default_locks_via_rpc 00:04:27.785 22:42:18 -- common/autotest_common.sh@1077 -- # '[' 2 -le 1 ']' 00:04:27.785 22:42:18 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:04:27.785 22:42:18 -- common/autotest_common.sh@10 -- # set +x 00:04:27.785 ************************************ 00:04:27.785 START TEST default_locks_via_rpc 00:04:27.785 ************************************ 00:04:27.785 22:42:18 -- common/autotest_common.sh@1104 -- # default_locks_via_rpc 00:04:27.785 22:42:18 -- event/cpu_locks.sh@62 -- # spdk_tgt_pid=159069 00:04:27.785 22:42:18 -- event/cpu_locks.sh@61 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x1 00:04:27.785 22:42:18 -- event/cpu_locks.sh@63 -- # waitforlisten 159069 00:04:27.785 22:42:18 -- common/autotest_common.sh@819 -- # '[' -z 159069 ']' 00:04:27.785 22:42:18 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk.sock 00:04:27.785 22:42:18 -- common/autotest_common.sh@824 -- # local max_retries=100 00:04:27.785 22:42:18 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:04:27.785 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:04:27.785 22:42:18 -- common/autotest_common.sh@828 -- # xtrace_disable 00:04:27.785 22:42:18 -- common/autotest_common.sh@10 -- # set +x 00:04:27.785 [2024-04-16 22:42:18.770147] Starting SPDK v24.01.1-pre git sha1 4b134b4ab / DPDK 23.11.0 initialization... 00:04:27.785 [2024-04-16 22:42:18.770265] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid159069 ] 00:04:27.785 EAL: No free 2048 kB hugepages reported on node 1 00:04:27.785 [2024-04-16 22:42:18.827313] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:04:28.044 [2024-04-16 22:42:18.936383] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:04:28.044 [2024-04-16 22:42:18.936549] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:04:28.611 22:42:19 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:04:28.611 22:42:19 -- common/autotest_common.sh@852 -- # return 0 00:04:28.611 22:42:19 -- event/cpu_locks.sh@65 -- # rpc_cmd framework_disable_cpumask_locks 00:04:28.611 22:42:19 -- common/autotest_common.sh@551 -- # xtrace_disable 00:04:28.611 22:42:19 -- common/autotest_common.sh@10 -- # set +x 00:04:28.611 22:42:19 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:04:28.611 22:42:19 -- event/cpu_locks.sh@67 -- # no_locks 00:04:28.612 22:42:19 -- event/cpu_locks.sh@26 -- # lock_files=() 00:04:28.612 22:42:19 -- event/cpu_locks.sh@26 -- # local lock_files 00:04:28.612 22:42:19 -- event/cpu_locks.sh@27 -- # (( 0 != 0 )) 00:04:28.612 22:42:19 -- event/cpu_locks.sh@69 -- # rpc_cmd framework_enable_cpumask_locks 00:04:28.612 22:42:19 -- common/autotest_common.sh@551 -- # xtrace_disable 00:04:28.612 22:42:19 -- common/autotest_common.sh@10 -- # set +x 00:04:28.612 22:42:19 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:04:28.612 22:42:19 -- event/cpu_locks.sh@71 -- # locks_exist 159069 00:04:28.612 22:42:19 -- event/cpu_locks.sh@22 -- # lslocks -p 159069 00:04:28.612 22:42:19 -- event/cpu_locks.sh@22 -- # grep -q spdk_cpu_lock 00:04:29.179 22:42:20 -- event/cpu_locks.sh@73 -- # killprocess 159069 00:04:29.179 22:42:20 -- common/autotest_common.sh@926 -- # '[' -z 159069 ']' 00:04:29.179 22:42:20 -- common/autotest_common.sh@930 -- # kill -0 159069 00:04:29.179 22:42:20 -- common/autotest_common.sh@931 -- # uname 00:04:29.179 22:42:20 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:04:29.179 22:42:20 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 159069 00:04:29.179 22:42:20 -- common/autotest_common.sh@932 -- # process_name=reactor_0 00:04:29.179 22:42:20 -- common/autotest_common.sh@936 -- # '[' reactor_0 = sudo ']' 00:04:29.179 22:42:20 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 159069' 00:04:29.179 killing process with pid 159069 00:04:29.179 22:42:20 -- common/autotest_common.sh@945 -- # kill 159069 00:04:29.179 22:42:20 -- common/autotest_common.sh@950 -- # wait 159069 00:04:29.746 00:04:29.746 real 0m1.938s 00:04:29.746 user 0m2.070s 00:04:29.746 sys 0m0.604s 00:04:29.746 22:42:20 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:04:29.746 22:42:20 -- common/autotest_common.sh@10 -- # set +x 00:04:29.746 ************************************ 00:04:29.746 END TEST default_locks_via_rpc 00:04:29.746 ************************************ 00:04:29.746 22:42:20 -- event/cpu_locks.sh@168 -- # run_test non_locking_app_on_locked_coremask non_locking_app_on_locked_coremask 00:04:29.746 22:42:20 -- common/autotest_common.sh@1077 -- # '[' 2 -le 1 ']' 00:04:29.747 22:42:20 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:04:29.747 22:42:20 -- common/autotest_common.sh@10 -- # set +x 00:04:29.747 ************************************ 00:04:29.747 START TEST non_locking_app_on_locked_coremask 00:04:29.747 ************************************ 00:04:29.747 22:42:20 -- common/autotest_common.sh@1104 -- # non_locking_app_on_locked_coremask 00:04:29.747 22:42:20 -- event/cpu_locks.sh@80 -- # spdk_tgt_pid=159246 00:04:29.747 22:42:20 -- event/cpu_locks.sh@79 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x1 00:04:29.747 22:42:20 -- event/cpu_locks.sh@81 -- # waitforlisten 159246 /var/tmp/spdk.sock 00:04:29.747 22:42:20 -- common/autotest_common.sh@819 -- # '[' -z 159246 ']' 00:04:29.747 22:42:20 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk.sock 00:04:29.747 22:42:20 -- common/autotest_common.sh@824 -- # local max_retries=100 00:04:29.747 22:42:20 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:04:29.747 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:04:29.747 22:42:20 -- common/autotest_common.sh@828 -- # xtrace_disable 00:04:29.747 22:42:20 -- common/autotest_common.sh@10 -- # set +x 00:04:29.747 [2024-04-16 22:42:20.734223] Starting SPDK v24.01.1-pre git sha1 4b134b4ab / DPDK 23.11.0 initialization... 00:04:29.747 [2024-04-16 22:42:20.734318] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid159246 ] 00:04:29.747 EAL: No free 2048 kB hugepages reported on node 1 00:04:29.747 [2024-04-16 22:42:20.792607] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:04:30.006 [2024-04-16 22:42:20.903044] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:04:30.006 [2024-04-16 22:42:20.903233] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:04:30.946 22:42:21 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:04:30.946 22:42:21 -- common/autotest_common.sh@852 -- # return 0 00:04:30.946 22:42:21 -- event/cpu_locks.sh@84 -- # spdk_tgt_pid2=159386 00:04:30.946 22:42:21 -- event/cpu_locks.sh@83 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x1 --disable-cpumask-locks -r /var/tmp/spdk2.sock 00:04:30.946 22:42:21 -- event/cpu_locks.sh@85 -- # waitforlisten 159386 /var/tmp/spdk2.sock 00:04:30.946 22:42:21 -- common/autotest_common.sh@819 -- # '[' -z 159386 ']' 00:04:30.946 22:42:21 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk2.sock 00:04:30.946 22:42:21 -- common/autotest_common.sh@824 -- # local max_retries=100 00:04:30.946 22:42:21 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk2.sock...' 00:04:30.946 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk2.sock... 00:04:30.947 22:42:21 -- common/autotest_common.sh@828 -- # xtrace_disable 00:04:30.947 22:42:21 -- common/autotest_common.sh@10 -- # set +x 00:04:30.947 [2024-04-16 22:42:21.761294] Starting SPDK v24.01.1-pre git sha1 4b134b4ab / DPDK 23.11.0 initialization... 00:04:30.947 [2024-04-16 22:42:21.761375] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid159386 ] 00:04:30.947 EAL: No free 2048 kB hugepages reported on node 1 00:04:30.947 [2024-04-16 22:42:21.856461] app.c: 795:spdk_app_start: *NOTICE*: CPU core locks deactivated. 00:04:30.947 [2024-04-16 22:42:21.856493] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:04:31.206 [2024-04-16 22:42:22.093278] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:04:31.206 [2024-04-16 22:42:22.093445] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:04:31.774 22:42:22 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:04:31.774 22:42:22 -- common/autotest_common.sh@852 -- # return 0 00:04:31.774 22:42:22 -- event/cpu_locks.sh@87 -- # locks_exist 159246 00:04:31.774 22:42:22 -- event/cpu_locks.sh@22 -- # lslocks -p 159246 00:04:31.774 22:42:22 -- event/cpu_locks.sh@22 -- # grep -q spdk_cpu_lock 00:04:32.341 lslocks: write error 00:04:32.341 22:42:23 -- event/cpu_locks.sh@89 -- # killprocess 159246 00:04:32.341 22:42:23 -- common/autotest_common.sh@926 -- # '[' -z 159246 ']' 00:04:32.341 22:42:23 -- common/autotest_common.sh@930 -- # kill -0 159246 00:04:32.341 22:42:23 -- common/autotest_common.sh@931 -- # uname 00:04:32.341 22:42:23 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:04:32.341 22:42:23 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 159246 00:04:32.341 22:42:23 -- common/autotest_common.sh@932 -- # process_name=reactor_0 00:04:32.341 22:42:23 -- common/autotest_common.sh@936 -- # '[' reactor_0 = sudo ']' 00:04:32.341 22:42:23 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 159246' 00:04:32.341 killing process with pid 159246 00:04:32.341 22:42:23 -- common/autotest_common.sh@945 -- # kill 159246 00:04:32.341 22:42:23 -- common/autotest_common.sh@950 -- # wait 159246 00:04:33.279 22:42:24 -- event/cpu_locks.sh@90 -- # killprocess 159386 00:04:33.279 22:42:24 -- common/autotest_common.sh@926 -- # '[' -z 159386 ']' 00:04:33.279 22:42:24 -- common/autotest_common.sh@930 -- # kill -0 159386 00:04:33.279 22:42:24 -- common/autotest_common.sh@931 -- # uname 00:04:33.279 22:42:24 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:04:33.279 22:42:24 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 159386 00:04:33.279 22:42:24 -- common/autotest_common.sh@932 -- # process_name=reactor_0 00:04:33.279 22:42:24 -- common/autotest_common.sh@936 -- # '[' reactor_0 = sudo ']' 00:04:33.279 22:42:24 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 159386' 00:04:33.279 killing process with pid 159386 00:04:33.279 22:42:24 -- common/autotest_common.sh@945 -- # kill 159386 00:04:33.279 22:42:24 -- common/autotest_common.sh@950 -- # wait 159386 00:04:33.849 00:04:33.849 real 0m4.020s 00:04:33.849 user 0m4.359s 00:04:33.849 sys 0m1.123s 00:04:33.849 22:42:24 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:04:33.849 22:42:24 -- common/autotest_common.sh@10 -- # set +x 00:04:33.849 ************************************ 00:04:33.849 END TEST non_locking_app_on_locked_coremask 00:04:33.849 ************************************ 00:04:33.849 22:42:24 -- event/cpu_locks.sh@169 -- # run_test locking_app_on_unlocked_coremask locking_app_on_unlocked_coremask 00:04:33.849 22:42:24 -- common/autotest_common.sh@1077 -- # '[' 2 -le 1 ']' 00:04:33.849 22:42:24 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:04:33.849 22:42:24 -- common/autotest_common.sh@10 -- # set +x 00:04:33.849 ************************************ 00:04:33.849 START TEST locking_app_on_unlocked_coremask 00:04:33.849 ************************************ 00:04:33.849 22:42:24 -- common/autotest_common.sh@1104 -- # locking_app_on_unlocked_coremask 00:04:33.849 22:42:24 -- event/cpu_locks.sh@98 -- # spdk_tgt_pid=159822 00:04:33.849 22:42:24 -- event/cpu_locks.sh@97 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x1 --disable-cpumask-locks 00:04:33.849 22:42:24 -- event/cpu_locks.sh@99 -- # waitforlisten 159822 /var/tmp/spdk.sock 00:04:33.849 22:42:24 -- common/autotest_common.sh@819 -- # '[' -z 159822 ']' 00:04:33.849 22:42:24 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk.sock 00:04:33.849 22:42:24 -- common/autotest_common.sh@824 -- # local max_retries=100 00:04:33.849 22:42:24 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:04:33.849 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:04:33.849 22:42:24 -- common/autotest_common.sh@828 -- # xtrace_disable 00:04:33.849 22:42:24 -- common/autotest_common.sh@10 -- # set +x 00:04:33.849 [2024-04-16 22:42:24.785342] Starting SPDK v24.01.1-pre git sha1 4b134b4ab / DPDK 23.11.0 initialization... 00:04:33.849 [2024-04-16 22:42:24.785429] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid159822 ] 00:04:33.849 EAL: No free 2048 kB hugepages reported on node 1 00:04:33.849 [2024-04-16 22:42:24.847795] app.c: 795:spdk_app_start: *NOTICE*: CPU core locks deactivated. 00:04:33.849 [2024-04-16 22:42:24.847837] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:04:33.849 [2024-04-16 22:42:24.962912] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:04:33.849 [2024-04-16 22:42:24.963076] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:04:34.783 22:42:25 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:04:34.783 22:42:25 -- common/autotest_common.sh@852 -- # return 0 00:04:34.783 22:42:25 -- event/cpu_locks.sh@102 -- # spdk_tgt_pid2=159962 00:04:34.783 22:42:25 -- event/cpu_locks.sh@101 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x1 -r /var/tmp/spdk2.sock 00:04:34.783 22:42:25 -- event/cpu_locks.sh@103 -- # waitforlisten 159962 /var/tmp/spdk2.sock 00:04:34.783 22:42:25 -- common/autotest_common.sh@819 -- # '[' -z 159962 ']' 00:04:34.783 22:42:25 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk2.sock 00:04:34.783 22:42:25 -- common/autotest_common.sh@824 -- # local max_retries=100 00:04:34.783 22:42:25 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk2.sock...' 00:04:34.783 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk2.sock... 00:04:34.783 22:42:25 -- common/autotest_common.sh@828 -- # xtrace_disable 00:04:34.783 22:42:25 -- common/autotest_common.sh@10 -- # set +x 00:04:34.783 [2024-04-16 22:42:25.752961] Starting SPDK v24.01.1-pre git sha1 4b134b4ab / DPDK 23.11.0 initialization... 00:04:34.783 [2024-04-16 22:42:25.753039] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid159962 ] 00:04:34.783 EAL: No free 2048 kB hugepages reported on node 1 00:04:34.783 [2024-04-16 22:42:25.846945] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:04:35.042 [2024-04-16 22:42:26.079850] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:04:35.042 [2024-04-16 22:42:26.080021] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:04:35.607 22:42:26 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:04:35.607 22:42:26 -- common/autotest_common.sh@852 -- # return 0 00:04:35.607 22:42:26 -- event/cpu_locks.sh@105 -- # locks_exist 159962 00:04:35.607 22:42:26 -- event/cpu_locks.sh@22 -- # lslocks -p 159962 00:04:35.607 22:42:26 -- event/cpu_locks.sh@22 -- # grep -q spdk_cpu_lock 00:04:36.172 lslocks: write error 00:04:36.172 22:42:27 -- event/cpu_locks.sh@107 -- # killprocess 159822 00:04:36.172 22:42:27 -- common/autotest_common.sh@926 -- # '[' -z 159822 ']' 00:04:36.172 22:42:27 -- common/autotest_common.sh@930 -- # kill -0 159822 00:04:36.172 22:42:27 -- common/autotest_common.sh@931 -- # uname 00:04:36.172 22:42:27 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:04:36.172 22:42:27 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 159822 00:04:36.172 22:42:27 -- common/autotest_common.sh@932 -- # process_name=reactor_0 00:04:36.172 22:42:27 -- common/autotest_common.sh@936 -- # '[' reactor_0 = sudo ']' 00:04:36.172 22:42:27 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 159822' 00:04:36.172 killing process with pid 159822 00:04:36.173 22:42:27 -- common/autotest_common.sh@945 -- # kill 159822 00:04:36.173 22:42:27 -- common/autotest_common.sh@950 -- # wait 159822 00:04:37.109 22:42:28 -- event/cpu_locks.sh@108 -- # killprocess 159962 00:04:37.109 22:42:28 -- common/autotest_common.sh@926 -- # '[' -z 159962 ']' 00:04:37.109 22:42:28 -- common/autotest_common.sh@930 -- # kill -0 159962 00:04:37.109 22:42:28 -- common/autotest_common.sh@931 -- # uname 00:04:37.109 22:42:28 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:04:37.109 22:42:28 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 159962 00:04:37.109 22:42:28 -- common/autotest_common.sh@932 -- # process_name=reactor_0 00:04:37.109 22:42:28 -- common/autotest_common.sh@936 -- # '[' reactor_0 = sudo ']' 00:04:37.109 22:42:28 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 159962' 00:04:37.109 killing process with pid 159962 00:04:37.109 22:42:28 -- common/autotest_common.sh@945 -- # kill 159962 00:04:37.109 22:42:28 -- common/autotest_common.sh@950 -- # wait 159962 00:04:37.677 00:04:37.677 real 0m3.889s 00:04:37.677 user 0m4.169s 00:04:37.677 sys 0m1.101s 00:04:37.677 22:42:28 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:04:37.677 22:42:28 -- common/autotest_common.sh@10 -- # set +x 00:04:37.677 ************************************ 00:04:37.677 END TEST locking_app_on_unlocked_coremask 00:04:37.677 ************************************ 00:04:37.677 22:42:28 -- event/cpu_locks.sh@170 -- # run_test locking_app_on_locked_coremask locking_app_on_locked_coremask 00:04:37.677 22:42:28 -- common/autotest_common.sh@1077 -- # '[' 2 -le 1 ']' 00:04:37.677 22:42:28 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:04:37.677 22:42:28 -- common/autotest_common.sh@10 -- # set +x 00:04:37.677 ************************************ 00:04:37.677 START TEST locking_app_on_locked_coremask 00:04:37.677 ************************************ 00:04:37.677 22:42:28 -- common/autotest_common.sh@1104 -- # locking_app_on_locked_coremask 00:04:37.677 22:42:28 -- event/cpu_locks.sh@115 -- # spdk_tgt_pid=160334 00:04:37.677 22:42:28 -- event/cpu_locks.sh@114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x1 00:04:37.677 22:42:28 -- event/cpu_locks.sh@116 -- # waitforlisten 160334 /var/tmp/spdk.sock 00:04:37.677 22:42:28 -- common/autotest_common.sh@819 -- # '[' -z 160334 ']' 00:04:37.677 22:42:28 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk.sock 00:04:37.677 22:42:28 -- common/autotest_common.sh@824 -- # local max_retries=100 00:04:37.677 22:42:28 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:04:37.677 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:04:37.677 22:42:28 -- common/autotest_common.sh@828 -- # xtrace_disable 00:04:37.677 22:42:28 -- common/autotest_common.sh@10 -- # set +x 00:04:37.677 [2024-04-16 22:42:28.699294] Starting SPDK v24.01.1-pre git sha1 4b134b4ab / DPDK 23.11.0 initialization... 00:04:37.677 [2024-04-16 22:42:28.699374] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid160334 ] 00:04:37.677 EAL: No free 2048 kB hugepages reported on node 1 00:04:37.677 [2024-04-16 22:42:28.756540] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:04:37.937 [2024-04-16 22:42:28.863930] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:04:37.937 [2024-04-16 22:42:28.864091] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:04:38.877 22:42:29 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:04:38.877 22:42:29 -- common/autotest_common.sh@852 -- # return 0 00:04:38.877 22:42:29 -- event/cpu_locks.sh@119 -- # spdk_tgt_pid2=160420 00:04:38.877 22:42:29 -- event/cpu_locks.sh@120 -- # NOT waitforlisten 160420 /var/tmp/spdk2.sock 00:04:38.877 22:42:29 -- event/cpu_locks.sh@118 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x1 -r /var/tmp/spdk2.sock 00:04:38.877 22:42:29 -- common/autotest_common.sh@640 -- # local es=0 00:04:38.877 22:42:29 -- common/autotest_common.sh@642 -- # valid_exec_arg waitforlisten 160420 /var/tmp/spdk2.sock 00:04:38.877 22:42:29 -- common/autotest_common.sh@628 -- # local arg=waitforlisten 00:04:38.877 22:42:29 -- common/autotest_common.sh@632 -- # case "$(type -t "$arg")" in 00:04:38.877 22:42:29 -- common/autotest_common.sh@632 -- # type -t waitforlisten 00:04:38.877 22:42:29 -- common/autotest_common.sh@632 -- # case "$(type -t "$arg")" in 00:04:38.877 22:42:29 -- common/autotest_common.sh@643 -- # waitforlisten 160420 /var/tmp/spdk2.sock 00:04:38.877 22:42:29 -- common/autotest_common.sh@819 -- # '[' -z 160420 ']' 00:04:38.877 22:42:29 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk2.sock 00:04:38.877 22:42:29 -- common/autotest_common.sh@824 -- # local max_retries=100 00:04:38.877 22:42:29 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk2.sock...' 00:04:38.877 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk2.sock... 00:04:38.877 22:42:29 -- common/autotest_common.sh@828 -- # xtrace_disable 00:04:38.877 22:42:29 -- common/autotest_common.sh@10 -- # set +x 00:04:38.877 [2024-04-16 22:42:29.686300] Starting SPDK v24.01.1-pre git sha1 4b134b4ab / DPDK 23.11.0 initialization... 00:04:38.877 [2024-04-16 22:42:29.686387] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid160420 ] 00:04:38.877 EAL: No free 2048 kB hugepages reported on node 1 00:04:38.877 [2024-04-16 22:42:29.776981] app.c: 665:claim_cpu_cores: *ERROR*: Cannot create lock on core 0, probably process 160334 has claimed it. 00:04:38.877 [2024-04-16 22:42:29.777031] app.c: 791:spdk_app_start: *ERROR*: Unable to acquire lock on assigned core mask - exiting. 00:04:39.446 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/autotest_common.sh: line 834: kill: (160420) - No such process 00:04:39.446 ERROR: process (pid: 160420) is no longer running 00:04:39.446 22:42:30 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:04:39.446 22:42:30 -- common/autotest_common.sh@852 -- # return 1 00:04:39.446 22:42:30 -- common/autotest_common.sh@643 -- # es=1 00:04:39.446 22:42:30 -- common/autotest_common.sh@651 -- # (( es > 128 )) 00:04:39.446 22:42:30 -- common/autotest_common.sh@662 -- # [[ -n '' ]] 00:04:39.446 22:42:30 -- common/autotest_common.sh@667 -- # (( !es == 0 )) 00:04:39.446 22:42:30 -- event/cpu_locks.sh@122 -- # locks_exist 160334 00:04:39.446 22:42:30 -- event/cpu_locks.sh@22 -- # lslocks -p 160334 00:04:39.446 22:42:30 -- event/cpu_locks.sh@22 -- # grep -q spdk_cpu_lock 00:04:39.704 lslocks: write error 00:04:39.704 22:42:30 -- event/cpu_locks.sh@124 -- # killprocess 160334 00:04:39.704 22:42:30 -- common/autotest_common.sh@926 -- # '[' -z 160334 ']' 00:04:39.704 22:42:30 -- common/autotest_common.sh@930 -- # kill -0 160334 00:04:39.704 22:42:30 -- common/autotest_common.sh@931 -- # uname 00:04:39.704 22:42:30 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:04:39.704 22:42:30 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 160334 00:04:39.704 22:42:30 -- common/autotest_common.sh@932 -- # process_name=reactor_0 00:04:39.704 22:42:30 -- common/autotest_common.sh@936 -- # '[' reactor_0 = sudo ']' 00:04:39.704 22:42:30 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 160334' 00:04:39.704 killing process with pid 160334 00:04:39.704 22:42:30 -- common/autotest_common.sh@945 -- # kill 160334 00:04:39.704 22:42:30 -- common/autotest_common.sh@950 -- # wait 160334 00:04:40.273 00:04:40.273 real 0m2.551s 00:04:40.273 user 0m2.887s 00:04:40.273 sys 0m0.691s 00:04:40.273 22:42:31 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:04:40.273 22:42:31 -- common/autotest_common.sh@10 -- # set +x 00:04:40.273 ************************************ 00:04:40.273 END TEST locking_app_on_locked_coremask 00:04:40.273 ************************************ 00:04:40.273 22:42:31 -- event/cpu_locks.sh@171 -- # run_test locking_overlapped_coremask locking_overlapped_coremask 00:04:40.273 22:42:31 -- common/autotest_common.sh@1077 -- # '[' 2 -le 1 ']' 00:04:40.273 22:42:31 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:04:40.273 22:42:31 -- common/autotest_common.sh@10 -- # set +x 00:04:40.273 ************************************ 00:04:40.273 START TEST locking_overlapped_coremask 00:04:40.273 ************************************ 00:04:40.273 22:42:31 -- common/autotest_common.sh@1104 -- # locking_overlapped_coremask 00:04:40.273 22:42:31 -- event/cpu_locks.sh@132 -- # spdk_tgt_pid=160709 00:04:40.273 22:42:31 -- event/cpu_locks.sh@131 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x7 00:04:40.273 22:42:31 -- event/cpu_locks.sh@133 -- # waitforlisten 160709 /var/tmp/spdk.sock 00:04:40.273 22:42:31 -- common/autotest_common.sh@819 -- # '[' -z 160709 ']' 00:04:40.273 22:42:31 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk.sock 00:04:40.273 22:42:31 -- common/autotest_common.sh@824 -- # local max_retries=100 00:04:40.273 22:42:31 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:04:40.273 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:04:40.273 22:42:31 -- common/autotest_common.sh@828 -- # xtrace_disable 00:04:40.273 22:42:31 -- common/autotest_common.sh@10 -- # set +x 00:04:40.273 [2024-04-16 22:42:31.277462] Starting SPDK v24.01.1-pre git sha1 4b134b4ab / DPDK 23.11.0 initialization... 00:04:40.273 [2024-04-16 22:42:31.277564] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x7 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid160709 ] 00:04:40.273 EAL: No free 2048 kB hugepages reported on node 1 00:04:40.273 [2024-04-16 22:42:31.338989] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 3 00:04:40.532 [2024-04-16 22:42:31.451697] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:04:40.532 [2024-04-16 22:42:31.451901] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:04:40.532 [2024-04-16 22:42:31.451971] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:04:40.532 [2024-04-16 22:42:31.451974] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:04:41.097 22:42:32 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:04:41.097 22:42:32 -- common/autotest_common.sh@852 -- # return 0 00:04:41.097 22:42:32 -- event/cpu_locks.sh@136 -- # spdk_tgt_pid2=160851 00:04:41.097 22:42:32 -- event/cpu_locks.sh@135 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x1c -r /var/tmp/spdk2.sock 00:04:41.097 22:42:32 -- event/cpu_locks.sh@137 -- # NOT waitforlisten 160851 /var/tmp/spdk2.sock 00:04:41.097 22:42:32 -- common/autotest_common.sh@640 -- # local es=0 00:04:41.097 22:42:32 -- common/autotest_common.sh@642 -- # valid_exec_arg waitforlisten 160851 /var/tmp/spdk2.sock 00:04:41.097 22:42:32 -- common/autotest_common.sh@628 -- # local arg=waitforlisten 00:04:41.097 22:42:32 -- common/autotest_common.sh@632 -- # case "$(type -t "$arg")" in 00:04:41.097 22:42:32 -- common/autotest_common.sh@632 -- # type -t waitforlisten 00:04:41.097 22:42:32 -- common/autotest_common.sh@632 -- # case "$(type -t "$arg")" in 00:04:41.097 22:42:32 -- common/autotest_common.sh@643 -- # waitforlisten 160851 /var/tmp/spdk2.sock 00:04:41.097 22:42:32 -- common/autotest_common.sh@819 -- # '[' -z 160851 ']' 00:04:41.097 22:42:32 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk2.sock 00:04:41.097 22:42:32 -- common/autotest_common.sh@824 -- # local max_retries=100 00:04:41.097 22:42:32 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk2.sock...' 00:04:41.097 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk2.sock... 00:04:41.097 22:42:32 -- common/autotest_common.sh@828 -- # xtrace_disable 00:04:41.097 22:42:32 -- common/autotest_common.sh@10 -- # set +x 00:04:41.357 [2024-04-16 22:42:32.245804] Starting SPDK v24.01.1-pre git sha1 4b134b4ab / DPDK 23.11.0 initialization... 00:04:41.357 [2024-04-16 22:42:32.245880] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1c --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid160851 ] 00:04:41.357 EAL: No free 2048 kB hugepages reported on node 1 00:04:41.357 [2024-04-16 22:42:32.330745] app.c: 665:claim_cpu_cores: *ERROR*: Cannot create lock on core 2, probably process 160709 has claimed it. 00:04:41.357 [2024-04-16 22:42:32.330808] app.c: 791:spdk_app_start: *ERROR*: Unable to acquire lock on assigned core mask - exiting. 00:04:41.926 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/autotest_common.sh: line 834: kill: (160851) - No such process 00:04:41.926 ERROR: process (pid: 160851) is no longer running 00:04:41.926 22:42:32 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:04:41.926 22:42:32 -- common/autotest_common.sh@852 -- # return 1 00:04:41.926 22:42:32 -- common/autotest_common.sh@643 -- # es=1 00:04:41.926 22:42:32 -- common/autotest_common.sh@651 -- # (( es > 128 )) 00:04:41.926 22:42:32 -- common/autotest_common.sh@662 -- # [[ -n '' ]] 00:04:41.926 22:42:32 -- common/autotest_common.sh@667 -- # (( !es == 0 )) 00:04:41.926 22:42:32 -- event/cpu_locks.sh@139 -- # check_remaining_locks 00:04:41.926 22:42:32 -- event/cpu_locks.sh@36 -- # locks=(/var/tmp/spdk_cpu_lock_*) 00:04:41.926 22:42:32 -- event/cpu_locks.sh@37 -- # locks_expected=(/var/tmp/spdk_cpu_lock_{000..002}) 00:04:41.926 22:42:32 -- event/cpu_locks.sh@38 -- # [[ /var/tmp/spdk_cpu_lock_000 /var/tmp/spdk_cpu_lock_001 /var/tmp/spdk_cpu_lock_002 == \/\v\a\r\/\t\m\p\/\s\p\d\k\_\c\p\u\_\l\o\c\k\_\0\0\0\ \/\v\a\r\/\t\m\p\/\s\p\d\k\_\c\p\u\_\l\o\c\k\_\0\0\1\ \/\v\a\r\/\t\m\p\/\s\p\d\k\_\c\p\u\_\l\o\c\k\_\0\0\2 ]] 00:04:41.926 22:42:32 -- event/cpu_locks.sh@141 -- # killprocess 160709 00:04:41.926 22:42:32 -- common/autotest_common.sh@926 -- # '[' -z 160709 ']' 00:04:41.926 22:42:32 -- common/autotest_common.sh@930 -- # kill -0 160709 00:04:41.926 22:42:32 -- common/autotest_common.sh@931 -- # uname 00:04:41.926 22:42:32 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:04:41.926 22:42:32 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 160709 00:04:41.926 22:42:32 -- common/autotest_common.sh@932 -- # process_name=reactor_0 00:04:41.926 22:42:32 -- common/autotest_common.sh@936 -- # '[' reactor_0 = sudo ']' 00:04:41.926 22:42:32 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 160709' 00:04:41.926 killing process with pid 160709 00:04:41.926 22:42:32 -- common/autotest_common.sh@945 -- # kill 160709 00:04:41.926 22:42:32 -- common/autotest_common.sh@950 -- # wait 160709 00:04:42.526 00:04:42.526 real 0m2.163s 00:04:42.526 user 0m6.038s 00:04:42.526 sys 0m0.480s 00:04:42.526 22:42:33 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:04:42.526 22:42:33 -- common/autotest_common.sh@10 -- # set +x 00:04:42.526 ************************************ 00:04:42.526 END TEST locking_overlapped_coremask 00:04:42.526 ************************************ 00:04:42.526 22:42:33 -- event/cpu_locks.sh@172 -- # run_test locking_overlapped_coremask_via_rpc locking_overlapped_coremask_via_rpc 00:04:42.526 22:42:33 -- common/autotest_common.sh@1077 -- # '[' 2 -le 1 ']' 00:04:42.526 22:42:33 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:04:42.526 22:42:33 -- common/autotest_common.sh@10 -- # set +x 00:04:42.526 ************************************ 00:04:42.526 START TEST locking_overlapped_coremask_via_rpc 00:04:42.526 ************************************ 00:04:42.526 22:42:33 -- common/autotest_common.sh@1104 -- # locking_overlapped_coremask_via_rpc 00:04:42.526 22:42:33 -- event/cpu_locks.sh@148 -- # spdk_tgt_pid=161018 00:04:42.526 22:42:33 -- event/cpu_locks.sh@147 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x7 --disable-cpumask-locks 00:04:42.526 22:42:33 -- event/cpu_locks.sh@149 -- # waitforlisten 161018 /var/tmp/spdk.sock 00:04:42.526 22:42:33 -- common/autotest_common.sh@819 -- # '[' -z 161018 ']' 00:04:42.526 22:42:33 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk.sock 00:04:42.526 22:42:33 -- common/autotest_common.sh@824 -- # local max_retries=100 00:04:42.526 22:42:33 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:04:42.526 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:04:42.526 22:42:33 -- common/autotest_common.sh@828 -- # xtrace_disable 00:04:42.526 22:42:33 -- common/autotest_common.sh@10 -- # set +x 00:04:42.526 [2024-04-16 22:42:33.469140] Starting SPDK v24.01.1-pre git sha1 4b134b4ab / DPDK 23.11.0 initialization... 00:04:42.526 [2024-04-16 22:42:33.469255] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x7 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid161018 ] 00:04:42.526 EAL: No free 2048 kB hugepages reported on node 1 00:04:42.526 [2024-04-16 22:42:33.530989] app.c: 795:spdk_app_start: *NOTICE*: CPU core locks deactivated. 00:04:42.526 [2024-04-16 22:42:33.531034] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 3 00:04:42.526 [2024-04-16 22:42:33.642506] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:04:42.526 [2024-04-16 22:42:33.642740] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:04:42.526 [2024-04-16 22:42:33.642807] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:04:42.526 [2024-04-16 22:42:33.642810] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:04:43.461 22:42:34 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:04:43.462 22:42:34 -- common/autotest_common.sh@852 -- # return 0 00:04:43.462 22:42:34 -- event/cpu_locks.sh@152 -- # spdk_tgt_pid2=161161 00:04:43.462 22:42:34 -- event/cpu_locks.sh@151 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x1c -r /var/tmp/spdk2.sock --disable-cpumask-locks 00:04:43.462 22:42:34 -- event/cpu_locks.sh@153 -- # waitforlisten 161161 /var/tmp/spdk2.sock 00:04:43.462 22:42:34 -- common/autotest_common.sh@819 -- # '[' -z 161161 ']' 00:04:43.462 22:42:34 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk2.sock 00:04:43.462 22:42:34 -- common/autotest_common.sh@824 -- # local max_retries=100 00:04:43.462 22:42:34 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk2.sock...' 00:04:43.462 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk2.sock... 00:04:43.462 22:42:34 -- common/autotest_common.sh@828 -- # xtrace_disable 00:04:43.462 22:42:34 -- common/autotest_common.sh@10 -- # set +x 00:04:43.462 [2024-04-16 22:42:34.445323] Starting SPDK v24.01.1-pre git sha1 4b134b4ab / DPDK 23.11.0 initialization... 00:04:43.462 [2024-04-16 22:42:34.445401] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1c --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid161161 ] 00:04:43.462 EAL: No free 2048 kB hugepages reported on node 1 00:04:43.462 [2024-04-16 22:42:34.532753] app.c: 795:spdk_app_start: *NOTICE*: CPU core locks deactivated. 00:04:43.462 [2024-04-16 22:42:34.532789] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 3 00:04:43.720 [2024-04-16 22:42:34.750688] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:04:43.720 [2024-04-16 22:42:34.750919] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:04:43.720 [2024-04-16 22:42:34.754268] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 4 00:04:43.720 [2024-04-16 22:42:34.754271] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:04:44.289 22:42:35 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:04:44.289 22:42:35 -- common/autotest_common.sh@852 -- # return 0 00:04:44.289 22:42:35 -- event/cpu_locks.sh@155 -- # rpc_cmd framework_enable_cpumask_locks 00:04:44.289 22:42:35 -- common/autotest_common.sh@551 -- # xtrace_disable 00:04:44.289 22:42:35 -- common/autotest_common.sh@10 -- # set +x 00:04:44.289 22:42:35 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:04:44.289 22:42:35 -- event/cpu_locks.sh@156 -- # NOT rpc_cmd -s /var/tmp/spdk2.sock framework_enable_cpumask_locks 00:04:44.289 22:42:35 -- common/autotest_common.sh@640 -- # local es=0 00:04:44.289 22:42:35 -- common/autotest_common.sh@642 -- # valid_exec_arg rpc_cmd -s /var/tmp/spdk2.sock framework_enable_cpumask_locks 00:04:44.289 22:42:35 -- common/autotest_common.sh@628 -- # local arg=rpc_cmd 00:04:44.289 22:42:35 -- common/autotest_common.sh@632 -- # case "$(type -t "$arg")" in 00:04:44.289 22:42:35 -- common/autotest_common.sh@632 -- # type -t rpc_cmd 00:04:44.289 22:42:35 -- common/autotest_common.sh@632 -- # case "$(type -t "$arg")" in 00:04:44.289 22:42:35 -- common/autotest_common.sh@643 -- # rpc_cmd -s /var/tmp/spdk2.sock framework_enable_cpumask_locks 00:04:44.289 22:42:35 -- common/autotest_common.sh@551 -- # xtrace_disable 00:04:44.289 22:42:35 -- common/autotest_common.sh@10 -- # set +x 00:04:44.289 [2024-04-16 22:42:35.391271] app.c: 665:claim_cpu_cores: *ERROR*: Cannot create lock on core 2, probably process 161018 has claimed it. 00:04:44.289 request: 00:04:44.289 { 00:04:44.289 "method": "framework_enable_cpumask_locks", 00:04:44.289 "req_id": 1 00:04:44.289 } 00:04:44.289 Got JSON-RPC error response 00:04:44.289 response: 00:04:44.289 { 00:04:44.289 "code": -32603, 00:04:44.289 "message": "Failed to claim CPU core: 2" 00:04:44.289 } 00:04:44.289 22:42:35 -- common/autotest_common.sh@579 -- # [[ 1 == 0 ]] 00:04:44.289 22:42:35 -- common/autotest_common.sh@643 -- # es=1 00:04:44.289 22:42:35 -- common/autotest_common.sh@651 -- # (( es > 128 )) 00:04:44.289 22:42:35 -- common/autotest_common.sh@662 -- # [[ -n '' ]] 00:04:44.289 22:42:35 -- common/autotest_common.sh@667 -- # (( !es == 0 )) 00:04:44.289 22:42:35 -- event/cpu_locks.sh@158 -- # waitforlisten 161018 /var/tmp/spdk.sock 00:04:44.289 22:42:35 -- common/autotest_common.sh@819 -- # '[' -z 161018 ']' 00:04:44.289 22:42:35 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk.sock 00:04:44.289 22:42:35 -- common/autotest_common.sh@824 -- # local max_retries=100 00:04:44.289 22:42:35 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:04:44.289 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:04:44.289 22:42:35 -- common/autotest_common.sh@828 -- # xtrace_disable 00:04:44.289 22:42:35 -- common/autotest_common.sh@10 -- # set +x 00:04:44.547 22:42:35 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:04:44.547 22:42:35 -- common/autotest_common.sh@852 -- # return 0 00:04:44.547 22:42:35 -- event/cpu_locks.sh@159 -- # waitforlisten 161161 /var/tmp/spdk2.sock 00:04:44.547 22:42:35 -- common/autotest_common.sh@819 -- # '[' -z 161161 ']' 00:04:44.547 22:42:35 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk2.sock 00:04:44.547 22:42:35 -- common/autotest_common.sh@824 -- # local max_retries=100 00:04:44.547 22:42:35 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk2.sock...' 00:04:44.547 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk2.sock... 00:04:44.547 22:42:35 -- common/autotest_common.sh@828 -- # xtrace_disable 00:04:44.547 22:42:35 -- common/autotest_common.sh@10 -- # set +x 00:04:44.806 22:42:35 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:04:44.806 22:42:35 -- common/autotest_common.sh@852 -- # return 0 00:04:44.806 22:42:35 -- event/cpu_locks.sh@161 -- # check_remaining_locks 00:04:44.806 22:42:35 -- event/cpu_locks.sh@36 -- # locks=(/var/tmp/spdk_cpu_lock_*) 00:04:44.806 22:42:35 -- event/cpu_locks.sh@37 -- # locks_expected=(/var/tmp/spdk_cpu_lock_{000..002}) 00:04:44.806 22:42:35 -- event/cpu_locks.sh@38 -- # [[ /var/tmp/spdk_cpu_lock_000 /var/tmp/spdk_cpu_lock_001 /var/tmp/spdk_cpu_lock_002 == \/\v\a\r\/\t\m\p\/\s\p\d\k\_\c\p\u\_\l\o\c\k\_\0\0\0\ \/\v\a\r\/\t\m\p\/\s\p\d\k\_\c\p\u\_\l\o\c\k\_\0\0\1\ \/\v\a\r\/\t\m\p\/\s\p\d\k\_\c\p\u\_\l\o\c\k\_\0\0\2 ]] 00:04:44.806 00:04:44.806 real 0m2.443s 00:04:44.806 user 0m1.182s 00:04:44.806 sys 0m0.197s 00:04:44.806 22:42:35 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:04:44.806 22:42:35 -- common/autotest_common.sh@10 -- # set +x 00:04:44.806 ************************************ 00:04:44.806 END TEST locking_overlapped_coremask_via_rpc 00:04:44.806 ************************************ 00:04:44.806 22:42:35 -- event/cpu_locks.sh@174 -- # cleanup 00:04:44.806 22:42:35 -- event/cpu_locks.sh@15 -- # [[ -z 161018 ]] 00:04:44.806 22:42:35 -- event/cpu_locks.sh@15 -- # killprocess 161018 00:04:44.806 22:42:35 -- common/autotest_common.sh@926 -- # '[' -z 161018 ']' 00:04:44.806 22:42:35 -- common/autotest_common.sh@930 -- # kill -0 161018 00:04:44.806 22:42:35 -- common/autotest_common.sh@931 -- # uname 00:04:44.806 22:42:35 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:04:44.807 22:42:35 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 161018 00:04:44.807 22:42:35 -- common/autotest_common.sh@932 -- # process_name=reactor_0 00:04:44.807 22:42:35 -- common/autotest_common.sh@936 -- # '[' reactor_0 = sudo ']' 00:04:44.807 22:42:35 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 161018' 00:04:44.807 killing process with pid 161018 00:04:44.807 22:42:35 -- common/autotest_common.sh@945 -- # kill 161018 00:04:44.807 22:42:35 -- common/autotest_common.sh@950 -- # wait 161018 00:04:45.374 22:42:36 -- event/cpu_locks.sh@16 -- # [[ -z 161161 ]] 00:04:45.374 22:42:36 -- event/cpu_locks.sh@16 -- # killprocess 161161 00:04:45.374 22:42:36 -- common/autotest_common.sh@926 -- # '[' -z 161161 ']' 00:04:45.374 22:42:36 -- common/autotest_common.sh@930 -- # kill -0 161161 00:04:45.374 22:42:36 -- common/autotest_common.sh@931 -- # uname 00:04:45.374 22:42:36 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:04:45.374 22:42:36 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 161161 00:04:45.374 22:42:36 -- common/autotest_common.sh@932 -- # process_name=reactor_2 00:04:45.374 22:42:36 -- common/autotest_common.sh@936 -- # '[' reactor_2 = sudo ']' 00:04:45.374 22:42:36 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 161161' 00:04:45.374 killing process with pid 161161 00:04:45.374 22:42:36 -- common/autotest_common.sh@945 -- # kill 161161 00:04:45.374 22:42:36 -- common/autotest_common.sh@950 -- # wait 161161 00:04:45.945 22:42:36 -- event/cpu_locks.sh@18 -- # rm -f 00:04:45.945 22:42:36 -- event/cpu_locks.sh@1 -- # cleanup 00:04:45.945 22:42:36 -- event/cpu_locks.sh@15 -- # [[ -z 161018 ]] 00:04:45.945 22:42:36 -- event/cpu_locks.sh@15 -- # killprocess 161018 00:04:45.945 22:42:36 -- common/autotest_common.sh@926 -- # '[' -z 161018 ']' 00:04:45.945 22:42:36 -- common/autotest_common.sh@930 -- # kill -0 161018 00:04:45.945 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/autotest_common.sh: line 930: kill: (161018) - No such process 00:04:45.945 22:42:36 -- common/autotest_common.sh@953 -- # echo 'Process with pid 161018 is not found' 00:04:45.945 Process with pid 161018 is not found 00:04:45.945 22:42:36 -- event/cpu_locks.sh@16 -- # [[ -z 161161 ]] 00:04:45.945 22:42:36 -- event/cpu_locks.sh@16 -- # killprocess 161161 00:04:45.945 22:42:36 -- common/autotest_common.sh@926 -- # '[' -z 161161 ']' 00:04:45.945 22:42:36 -- common/autotest_common.sh@930 -- # kill -0 161161 00:04:45.945 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/autotest_common.sh: line 930: kill: (161161) - No such process 00:04:45.945 22:42:36 -- common/autotest_common.sh@953 -- # echo 'Process with pid 161161 is not found' 00:04:45.945 Process with pid 161161 is not found 00:04:45.945 22:42:36 -- event/cpu_locks.sh@18 -- # rm -f 00:04:45.945 00:04:45.945 real 0m19.869s 00:04:45.945 user 0m34.686s 00:04:45.945 sys 0m5.543s 00:04:45.945 22:42:36 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:04:45.945 22:42:36 -- common/autotest_common.sh@10 -- # set +x 00:04:45.945 ************************************ 00:04:45.945 END TEST cpu_locks 00:04:45.945 ************************************ 00:04:45.945 00:04:45.945 real 0m46.264s 00:04:45.945 user 1m27.440s 00:04:45.945 sys 0m9.567s 00:04:45.945 22:42:36 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:04:45.945 22:42:36 -- common/autotest_common.sh@10 -- # set +x 00:04:45.945 ************************************ 00:04:45.945 END TEST event 00:04:45.945 ************************************ 00:04:45.945 22:42:36 -- spdk/autotest.sh@188 -- # run_test thread /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/thread/thread.sh 00:04:45.945 22:42:36 -- common/autotest_common.sh@1077 -- # '[' 2 -le 1 ']' 00:04:45.945 22:42:36 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:04:45.945 22:42:36 -- common/autotest_common.sh@10 -- # set +x 00:04:45.945 ************************************ 00:04:45.945 START TEST thread 00:04:45.945 ************************************ 00:04:45.945 22:42:36 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/thread/thread.sh 00:04:45.945 * Looking for test storage... 00:04:45.945 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/thread 00:04:45.945 22:42:36 -- thread/thread.sh@11 -- # run_test thread_poller_perf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/thread/poller_perf/poller_perf -b 1000 -l 1 -t 1 00:04:45.945 22:42:36 -- common/autotest_common.sh@1077 -- # '[' 8 -le 1 ']' 00:04:45.945 22:42:36 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:04:45.945 22:42:36 -- common/autotest_common.sh@10 -- # set +x 00:04:45.945 ************************************ 00:04:45.945 START TEST thread_poller_perf 00:04:45.945 ************************************ 00:04:45.945 22:42:36 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/thread/poller_perf/poller_perf -b 1000 -l 1 -t 1 00:04:45.945 [2024-04-16 22:42:36.955406] Starting SPDK v24.01.1-pre git sha1 4b134b4ab / DPDK 23.11.0 initialization... 00:04:45.945 [2024-04-16 22:42:36.955499] [ DPDK EAL parameters: poller_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid161533 ] 00:04:45.945 EAL: No free 2048 kB hugepages reported on node 1 00:04:45.945 [2024-04-16 22:42:37.017027] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:04:46.205 [2024-04-16 22:42:37.137059] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:04:46.205 Running 1000 pollers for 1 seconds with 1 microseconds period. 00:04:47.142 ====================================== 00:04:47.142 busy:2710606243 (cyc) 00:04:47.142 total_run_count: 280000 00:04:47.142 tsc_hz: 2700000000 (cyc) 00:04:47.142 ====================================== 00:04:47.142 poller_cost: 9680 (cyc), 3585 (nsec) 00:04:47.142 00:04:47.142 real 0m1.329s 00:04:47.142 user 0m1.242s 00:04:47.142 sys 0m0.080s 00:04:47.142 22:42:38 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:04:47.142 22:42:38 -- common/autotest_common.sh@10 -- # set +x 00:04:47.142 ************************************ 00:04:47.142 END TEST thread_poller_perf 00:04:47.142 ************************************ 00:04:47.401 22:42:38 -- thread/thread.sh@12 -- # run_test thread_poller_perf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/thread/poller_perf/poller_perf -b 1000 -l 0 -t 1 00:04:47.401 22:42:38 -- common/autotest_common.sh@1077 -- # '[' 8 -le 1 ']' 00:04:47.401 22:42:38 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:04:47.401 22:42:38 -- common/autotest_common.sh@10 -- # set +x 00:04:47.401 ************************************ 00:04:47.401 START TEST thread_poller_perf 00:04:47.401 ************************************ 00:04:47.401 22:42:38 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/thread/poller_perf/poller_perf -b 1000 -l 0 -t 1 00:04:47.401 [2024-04-16 22:42:38.310009] Starting SPDK v24.01.1-pre git sha1 4b134b4ab / DPDK 23.11.0 initialization... 00:04:47.401 [2024-04-16 22:42:38.310102] [ DPDK EAL parameters: poller_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid161690 ] 00:04:47.401 EAL: No free 2048 kB hugepages reported on node 1 00:04:47.401 [2024-04-16 22:42:38.374867] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:04:47.401 [2024-04-16 22:42:38.488818] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:04:47.401 Running 1000 pollers for 1 seconds with 0 microseconds period. 00:04:48.781 ====================================== 00:04:48.781 busy:2703904752 (cyc) 00:04:48.781 total_run_count: 3841000 00:04:48.781 tsc_hz: 2700000000 (cyc) 00:04:48.781 ====================================== 00:04:48.781 poller_cost: 703 (cyc), 260 (nsec) 00:04:48.781 00:04:48.781 real 0m1.319s 00:04:48.781 user 0m1.226s 00:04:48.781 sys 0m0.086s 00:04:48.781 22:42:39 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:04:48.781 22:42:39 -- common/autotest_common.sh@10 -- # set +x 00:04:48.781 ************************************ 00:04:48.781 END TEST thread_poller_perf 00:04:48.781 ************************************ 00:04:48.781 22:42:39 -- thread/thread.sh@17 -- # [[ y != \y ]] 00:04:48.781 00:04:48.781 real 0m2.753s 00:04:48.781 user 0m2.506s 00:04:48.781 sys 0m0.249s 00:04:48.781 22:42:39 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:04:48.781 22:42:39 -- common/autotest_common.sh@10 -- # set +x 00:04:48.781 ************************************ 00:04:48.781 END TEST thread 00:04:48.781 ************************************ 00:04:48.781 22:42:39 -- spdk/autotest.sh@189 -- # run_test accel /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/accel.sh 00:04:48.781 22:42:39 -- common/autotest_common.sh@1077 -- # '[' 2 -le 1 ']' 00:04:48.781 22:42:39 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:04:48.781 22:42:39 -- common/autotest_common.sh@10 -- # set +x 00:04:48.781 ************************************ 00:04:48.781 START TEST accel 00:04:48.781 ************************************ 00:04:48.781 22:42:39 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/accel.sh 00:04:48.781 * Looking for test storage... 00:04:48.781 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel 00:04:48.781 22:42:39 -- accel/accel.sh@73 -- # declare -A expected_opcs 00:04:48.781 22:42:39 -- accel/accel.sh@74 -- # get_expected_opcs 00:04:48.781 22:42:39 -- accel/accel.sh@57 -- # trap 'killprocess $spdk_tgt_pid; exit 1' ERR 00:04:48.781 22:42:39 -- accel/accel.sh@59 -- # spdk_tgt_pid=161882 00:04:48.781 22:42:39 -- accel/accel.sh@60 -- # waitforlisten 161882 00:04:48.781 22:42:39 -- common/autotest_common.sh@819 -- # '[' -z 161882 ']' 00:04:48.781 22:42:39 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk.sock 00:04:48.781 22:42:39 -- accel/accel.sh@58 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -c /dev/fd/63 00:04:48.781 22:42:39 -- common/autotest_common.sh@824 -- # local max_retries=100 00:04:48.781 22:42:39 -- accel/accel.sh@58 -- # build_accel_config 00:04:48.781 22:42:39 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:04:48.781 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:04:48.781 22:42:39 -- common/autotest_common.sh@828 -- # xtrace_disable 00:04:48.781 22:42:39 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:04:48.781 22:42:39 -- common/autotest_common.sh@10 -- # set +x 00:04:48.781 22:42:39 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:04:48.781 22:42:39 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:04:48.781 22:42:39 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:04:48.781 22:42:39 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:04:48.781 22:42:39 -- accel/accel.sh@41 -- # local IFS=, 00:04:48.781 22:42:39 -- accel/accel.sh@42 -- # jq -r . 00:04:48.781 [2024-04-16 22:42:39.764059] Starting SPDK v24.01.1-pre git sha1 4b134b4ab / DPDK 23.11.0 initialization... 00:04:48.781 [2024-04-16 22:42:39.764136] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid161882 ] 00:04:48.781 EAL: No free 2048 kB hugepages reported on node 1 00:04:48.781 [2024-04-16 22:42:39.822910] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:04:49.041 [2024-04-16 22:42:39.938017] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:04:49.041 [2024-04-16 22:42:39.938169] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:04:49.609 22:42:40 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:04:49.609 22:42:40 -- common/autotest_common.sh@852 -- # return 0 00:04:49.609 22:42:40 -- accel/accel.sh@62 -- # exp_opcs=($($rpc_py accel_get_opc_assignments | jq -r ". | to_entries | map(\"\(.key)=\(.value)\") | .[]")) 00:04:49.609 22:42:40 -- accel/accel.sh@62 -- # rpc_cmd accel_get_opc_assignments 00:04:49.609 22:42:40 -- common/autotest_common.sh@551 -- # xtrace_disable 00:04:49.610 22:42:40 -- common/autotest_common.sh@10 -- # set +x 00:04:49.610 22:42:40 -- accel/accel.sh@62 -- # jq -r '. | to_entries | map("\(.key)=\(.value)") | .[]' 00:04:49.610 22:42:40 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:04:49.868 22:42:40 -- accel/accel.sh@63 -- # for opc_opt in "${exp_opcs[@]}" 00:04:49.868 22:42:40 -- accel/accel.sh@64 -- # IFS== 00:04:49.868 22:42:40 -- accel/accel.sh@64 -- # read -r opc module 00:04:49.868 22:42:40 -- accel/accel.sh@65 -- # expected_opcs["$opc"]=software 00:04:49.868 22:42:40 -- accel/accel.sh@63 -- # for opc_opt in "${exp_opcs[@]}" 00:04:49.868 22:42:40 -- accel/accel.sh@64 -- # IFS== 00:04:49.868 22:42:40 -- accel/accel.sh@64 -- # read -r opc module 00:04:49.868 22:42:40 -- accel/accel.sh@65 -- # expected_opcs["$opc"]=software 00:04:49.868 22:42:40 -- accel/accel.sh@63 -- # for opc_opt in "${exp_opcs[@]}" 00:04:49.868 22:42:40 -- accel/accel.sh@64 -- # IFS== 00:04:49.868 22:42:40 -- accel/accel.sh@64 -- # read -r opc module 00:04:49.868 22:42:40 -- accel/accel.sh@65 -- # expected_opcs["$opc"]=software 00:04:49.868 22:42:40 -- accel/accel.sh@63 -- # for opc_opt in "${exp_opcs[@]}" 00:04:49.868 22:42:40 -- accel/accel.sh@64 -- # IFS== 00:04:49.868 22:42:40 -- accel/accel.sh@64 -- # read -r opc module 00:04:49.868 22:42:40 -- accel/accel.sh@65 -- # expected_opcs["$opc"]=software 00:04:49.868 22:42:40 -- accel/accel.sh@63 -- # for opc_opt in "${exp_opcs[@]}" 00:04:49.868 22:42:40 -- accel/accel.sh@64 -- # IFS== 00:04:49.868 22:42:40 -- accel/accel.sh@64 -- # read -r opc module 00:04:49.868 22:42:40 -- accel/accel.sh@65 -- # expected_opcs["$opc"]=software 00:04:49.868 22:42:40 -- accel/accel.sh@63 -- # for opc_opt in "${exp_opcs[@]}" 00:04:49.868 22:42:40 -- accel/accel.sh@64 -- # IFS== 00:04:49.868 22:42:40 -- accel/accel.sh@64 -- # read -r opc module 00:04:49.868 22:42:40 -- accel/accel.sh@65 -- # expected_opcs["$opc"]=software 00:04:49.868 22:42:40 -- accel/accel.sh@63 -- # for opc_opt in "${exp_opcs[@]}" 00:04:49.868 22:42:40 -- accel/accel.sh@64 -- # IFS== 00:04:49.868 22:42:40 -- accel/accel.sh@64 -- # read -r opc module 00:04:49.868 22:42:40 -- accel/accel.sh@65 -- # expected_opcs["$opc"]=software 00:04:49.868 22:42:40 -- accel/accel.sh@63 -- # for opc_opt in "${exp_opcs[@]}" 00:04:49.868 22:42:40 -- accel/accel.sh@64 -- # IFS== 00:04:49.868 22:42:40 -- accel/accel.sh@64 -- # read -r opc module 00:04:49.868 22:42:40 -- accel/accel.sh@65 -- # expected_opcs["$opc"]=software 00:04:49.868 22:42:40 -- accel/accel.sh@63 -- # for opc_opt in "${exp_opcs[@]}" 00:04:49.868 22:42:40 -- accel/accel.sh@64 -- # IFS== 00:04:49.868 22:42:40 -- accel/accel.sh@64 -- # read -r opc module 00:04:49.868 22:42:40 -- accel/accel.sh@65 -- # expected_opcs["$opc"]=software 00:04:49.868 22:42:40 -- accel/accel.sh@63 -- # for opc_opt in "${exp_opcs[@]}" 00:04:49.868 22:42:40 -- accel/accel.sh@64 -- # IFS== 00:04:49.868 22:42:40 -- accel/accel.sh@64 -- # read -r opc module 00:04:49.868 22:42:40 -- accel/accel.sh@65 -- # expected_opcs["$opc"]=software 00:04:49.868 22:42:40 -- accel/accel.sh@63 -- # for opc_opt in "${exp_opcs[@]}" 00:04:49.868 22:42:40 -- accel/accel.sh@64 -- # IFS== 00:04:49.868 22:42:40 -- accel/accel.sh@64 -- # read -r opc module 00:04:49.868 22:42:40 -- accel/accel.sh@65 -- # expected_opcs["$opc"]=software 00:04:49.868 22:42:40 -- accel/accel.sh@63 -- # for opc_opt in "${exp_opcs[@]}" 00:04:49.868 22:42:40 -- accel/accel.sh@64 -- # IFS== 00:04:49.868 22:42:40 -- accel/accel.sh@64 -- # read -r opc module 00:04:49.868 22:42:40 -- accel/accel.sh@65 -- # expected_opcs["$opc"]=software 00:04:49.868 22:42:40 -- accel/accel.sh@63 -- # for opc_opt in "${exp_opcs[@]}" 00:04:49.868 22:42:40 -- accel/accel.sh@64 -- # IFS== 00:04:49.868 22:42:40 -- accel/accel.sh@64 -- # read -r opc module 00:04:49.868 22:42:40 -- accel/accel.sh@65 -- # expected_opcs["$opc"]=software 00:04:49.868 22:42:40 -- accel/accel.sh@63 -- # for opc_opt in "${exp_opcs[@]}" 00:04:49.868 22:42:40 -- accel/accel.sh@64 -- # IFS== 00:04:49.868 22:42:40 -- accel/accel.sh@64 -- # read -r opc module 00:04:49.868 22:42:40 -- accel/accel.sh@65 -- # expected_opcs["$opc"]=software 00:04:49.868 22:42:40 -- accel/accel.sh@67 -- # killprocess 161882 00:04:49.868 22:42:40 -- common/autotest_common.sh@926 -- # '[' -z 161882 ']' 00:04:49.868 22:42:40 -- common/autotest_common.sh@930 -- # kill -0 161882 00:04:49.868 22:42:40 -- common/autotest_common.sh@931 -- # uname 00:04:49.868 22:42:40 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:04:49.868 22:42:40 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 161882 00:04:49.868 22:42:40 -- common/autotest_common.sh@932 -- # process_name=reactor_0 00:04:49.868 22:42:40 -- common/autotest_common.sh@936 -- # '[' reactor_0 = sudo ']' 00:04:49.868 22:42:40 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 161882' 00:04:49.868 killing process with pid 161882 00:04:49.868 22:42:40 -- common/autotest_common.sh@945 -- # kill 161882 00:04:49.868 22:42:40 -- common/autotest_common.sh@950 -- # wait 161882 00:04:50.127 22:42:41 -- accel/accel.sh@68 -- # trap - ERR 00:04:50.127 22:42:41 -- accel/accel.sh@81 -- # run_test accel_help accel_perf -h 00:04:50.127 22:42:41 -- common/autotest_common.sh@1077 -- # '[' 3 -le 1 ']' 00:04:50.127 22:42:41 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:04:50.127 22:42:41 -- common/autotest_common.sh@10 -- # set +x 00:04:50.127 22:42:41 -- common/autotest_common.sh@1104 -- # accel_perf -h 00:04:50.127 22:42:41 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -h 00:04:50.127 22:42:41 -- accel/accel.sh@12 -- # build_accel_config 00:04:50.127 22:42:41 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:04:50.127 22:42:41 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:04:50.127 22:42:41 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:04:50.127 22:42:41 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:04:50.127 22:42:41 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:04:50.127 22:42:41 -- accel/accel.sh@41 -- # local IFS=, 00:04:50.127 22:42:41 -- accel/accel.sh@42 -- # jq -r . 00:04:50.387 22:42:41 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:04:50.387 22:42:41 -- common/autotest_common.sh@10 -- # set +x 00:04:50.387 22:42:41 -- accel/accel.sh@83 -- # run_test accel_missing_filename NOT accel_perf -t 1 -w compress 00:04:50.387 22:42:41 -- common/autotest_common.sh@1077 -- # '[' 7 -le 1 ']' 00:04:50.387 22:42:41 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:04:50.387 22:42:41 -- common/autotest_common.sh@10 -- # set +x 00:04:50.387 ************************************ 00:04:50.387 START TEST accel_missing_filename 00:04:50.387 ************************************ 00:04:50.387 22:42:41 -- common/autotest_common.sh@1104 -- # NOT accel_perf -t 1 -w compress 00:04:50.387 22:42:41 -- common/autotest_common.sh@640 -- # local es=0 00:04:50.387 22:42:41 -- common/autotest_common.sh@642 -- # valid_exec_arg accel_perf -t 1 -w compress 00:04:50.387 22:42:41 -- common/autotest_common.sh@628 -- # local arg=accel_perf 00:04:50.387 22:42:41 -- common/autotest_common.sh@632 -- # case "$(type -t "$arg")" in 00:04:50.387 22:42:41 -- common/autotest_common.sh@632 -- # type -t accel_perf 00:04:50.387 22:42:41 -- common/autotest_common.sh@632 -- # case "$(type -t "$arg")" in 00:04:50.387 22:42:41 -- common/autotest_common.sh@643 -- # accel_perf -t 1 -w compress 00:04:50.387 22:42:41 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w compress 00:04:50.387 22:42:41 -- accel/accel.sh@12 -- # build_accel_config 00:04:50.387 22:42:41 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:04:50.387 22:42:41 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:04:50.387 22:42:41 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:04:50.387 22:42:41 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:04:50.387 22:42:41 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:04:50.387 22:42:41 -- accel/accel.sh@41 -- # local IFS=, 00:04:50.387 22:42:41 -- accel/accel.sh@42 -- # jq -r . 00:04:50.387 [2024-04-16 22:42:41.305316] Starting SPDK v24.01.1-pre git sha1 4b134b4ab / DPDK 23.11.0 initialization... 00:04:50.387 [2024-04-16 22:42:41.305391] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid162189 ] 00:04:50.387 EAL: No free 2048 kB hugepages reported on node 1 00:04:50.387 [2024-04-16 22:42:41.365906] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:04:50.387 [2024-04-16 22:42:41.482944] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:04:50.646 [2024-04-16 22:42:41.544931] app.c: 910:spdk_app_stop: *WARNING*: spdk_app_stop'd on non-zero 00:04:50.646 [2024-04-16 22:42:41.633411] accel_perf.c:1385:main: *ERROR*: ERROR starting application 00:04:50.646 A filename is required. 00:04:50.646 22:42:41 -- common/autotest_common.sh@643 -- # es=234 00:04:50.646 22:42:41 -- common/autotest_common.sh@651 -- # (( es > 128 )) 00:04:50.646 22:42:41 -- common/autotest_common.sh@652 -- # es=106 00:04:50.646 22:42:41 -- common/autotest_common.sh@653 -- # case "$es" in 00:04:50.646 22:42:41 -- common/autotest_common.sh@660 -- # es=1 00:04:50.646 22:42:41 -- common/autotest_common.sh@667 -- # (( !es == 0 )) 00:04:50.646 00:04:50.646 real 0m0.467s 00:04:50.646 user 0m0.361s 00:04:50.646 sys 0m0.136s 00:04:50.646 22:42:41 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:04:50.646 22:42:41 -- common/autotest_common.sh@10 -- # set +x 00:04:50.646 ************************************ 00:04:50.646 END TEST accel_missing_filename 00:04:50.646 ************************************ 00:04:50.905 22:42:41 -- accel/accel.sh@85 -- # run_test accel_compress_verify NOT accel_perf -t 1 -w compress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y 00:04:50.905 22:42:41 -- common/autotest_common.sh@1077 -- # '[' 10 -le 1 ']' 00:04:50.905 22:42:41 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:04:50.905 22:42:41 -- common/autotest_common.sh@10 -- # set +x 00:04:50.905 ************************************ 00:04:50.905 START TEST accel_compress_verify 00:04:50.905 ************************************ 00:04:50.905 22:42:41 -- common/autotest_common.sh@1104 -- # NOT accel_perf -t 1 -w compress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y 00:04:50.905 22:42:41 -- common/autotest_common.sh@640 -- # local es=0 00:04:50.905 22:42:41 -- common/autotest_common.sh@642 -- # valid_exec_arg accel_perf -t 1 -w compress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y 00:04:50.905 22:42:41 -- common/autotest_common.sh@628 -- # local arg=accel_perf 00:04:50.905 22:42:41 -- common/autotest_common.sh@632 -- # case "$(type -t "$arg")" in 00:04:50.905 22:42:41 -- common/autotest_common.sh@632 -- # type -t accel_perf 00:04:50.905 22:42:41 -- common/autotest_common.sh@632 -- # case "$(type -t "$arg")" in 00:04:50.905 22:42:41 -- common/autotest_common.sh@643 -- # accel_perf -t 1 -w compress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y 00:04:50.905 22:42:41 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w compress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y 00:04:50.905 22:42:41 -- accel/accel.sh@12 -- # build_accel_config 00:04:50.905 22:42:41 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:04:50.905 22:42:41 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:04:50.905 22:42:41 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:04:50.905 22:42:41 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:04:50.905 22:42:41 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:04:50.905 22:42:41 -- accel/accel.sh@41 -- # local IFS=, 00:04:50.905 22:42:41 -- accel/accel.sh@42 -- # jq -r . 00:04:50.905 [2024-04-16 22:42:41.798323] Starting SPDK v24.01.1-pre git sha1 4b134b4ab / DPDK 23.11.0 initialization... 00:04:50.905 [2024-04-16 22:42:41.798397] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid162214 ] 00:04:50.905 EAL: No free 2048 kB hugepages reported on node 1 00:04:50.905 [2024-04-16 22:42:41.860102] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:04:50.905 [2024-04-16 22:42:41.977030] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:04:51.164 [2024-04-16 22:42:42.039356] app.c: 910:spdk_app_stop: *WARNING*: spdk_app_stop'd on non-zero 00:04:51.164 [2024-04-16 22:42:42.124021] accel_perf.c:1385:main: *ERROR*: ERROR starting application 00:04:51.164 00:04:51.164 Compression does not support the verify option, aborting. 00:04:51.164 22:42:42 -- common/autotest_common.sh@643 -- # es=161 00:04:51.164 22:42:42 -- common/autotest_common.sh@651 -- # (( es > 128 )) 00:04:51.164 22:42:42 -- common/autotest_common.sh@652 -- # es=33 00:04:51.164 22:42:42 -- common/autotest_common.sh@653 -- # case "$es" in 00:04:51.164 22:42:42 -- common/autotest_common.sh@660 -- # es=1 00:04:51.164 22:42:42 -- common/autotest_common.sh@667 -- # (( !es == 0 )) 00:04:51.164 00:04:51.164 real 0m0.463s 00:04:51.164 user 0m0.357s 00:04:51.164 sys 0m0.140s 00:04:51.164 22:42:42 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:04:51.164 22:42:42 -- common/autotest_common.sh@10 -- # set +x 00:04:51.164 ************************************ 00:04:51.164 END TEST accel_compress_verify 00:04:51.164 ************************************ 00:04:51.164 22:42:42 -- accel/accel.sh@87 -- # run_test accel_wrong_workload NOT accel_perf -t 1 -w foobar 00:04:51.164 22:42:42 -- common/autotest_common.sh@1077 -- # '[' 7 -le 1 ']' 00:04:51.164 22:42:42 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:04:51.164 22:42:42 -- common/autotest_common.sh@10 -- # set +x 00:04:51.164 ************************************ 00:04:51.164 START TEST accel_wrong_workload 00:04:51.164 ************************************ 00:04:51.164 22:42:42 -- common/autotest_common.sh@1104 -- # NOT accel_perf -t 1 -w foobar 00:04:51.164 22:42:42 -- common/autotest_common.sh@640 -- # local es=0 00:04:51.164 22:42:42 -- common/autotest_common.sh@642 -- # valid_exec_arg accel_perf -t 1 -w foobar 00:04:51.164 22:42:42 -- common/autotest_common.sh@628 -- # local arg=accel_perf 00:04:51.164 22:42:42 -- common/autotest_common.sh@632 -- # case "$(type -t "$arg")" in 00:04:51.164 22:42:42 -- common/autotest_common.sh@632 -- # type -t accel_perf 00:04:51.164 22:42:42 -- common/autotest_common.sh@632 -- # case "$(type -t "$arg")" in 00:04:51.164 22:42:42 -- common/autotest_common.sh@643 -- # accel_perf -t 1 -w foobar 00:04:51.164 22:42:42 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w foobar 00:04:51.164 22:42:42 -- accel/accel.sh@12 -- # build_accel_config 00:04:51.164 22:42:42 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:04:51.164 22:42:42 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:04:51.164 22:42:42 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:04:51.164 22:42:42 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:04:51.164 22:42:42 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:04:51.164 22:42:42 -- accel/accel.sh@41 -- # local IFS=, 00:04:51.164 22:42:42 -- accel/accel.sh@42 -- # jq -r . 00:04:51.164 Unsupported workload type: foobar 00:04:51.164 [2024-04-16 22:42:42.282763] app.c:1292:spdk_app_parse_args: *ERROR*: Parsing app-specific command line parameter 'w' failed: 1 00:04:51.164 accel_perf options: 00:04:51.164 [-h help message] 00:04:51.164 [-q queue depth per core] 00:04:51.164 [-C for supported workloads, use this value to configure the io vector size to test (default 1) 00:04:51.165 [-T number of threads per core 00:04:51.165 [-o transfer size in bytes (default: 4KiB. For compress/decompress, 0 means the input file size)] 00:04:51.165 [-t time in seconds] 00:04:51.165 [-w workload type must be one of these: copy, fill, crc32c, copy_crc32c, compare, compress, decompress, dualcast, xor, 00:04:51.165 [ dif_verify, , dif_generate, dif_generate_copy 00:04:51.165 [-M assign module to the operation, not compatible with accel_assign_opc RPC 00:04:51.165 [-l for compress/decompress workloads, name of uncompressed input file 00:04:51.165 [-S for crc32c workload, use this seed value (default 0) 00:04:51.165 [-P for compare workload, percentage of operations that should miscompare (percent, default 0) 00:04:51.165 [-f for fill workload, use this BYTE value (default 255) 00:04:51.165 [-x for xor workload, use this number of source buffers (default, minimum: 2)] 00:04:51.165 [-y verify result if this switch is on] 00:04:51.165 [-a tasks to allocate per core (default: same value as -q)] 00:04:51.165 Can be used to spread operations across a wider range of memory. 00:04:51.165 22:42:42 -- common/autotest_common.sh@643 -- # es=1 00:04:51.165 22:42:42 -- common/autotest_common.sh@651 -- # (( es > 128 )) 00:04:51.165 22:42:42 -- common/autotest_common.sh@662 -- # [[ -n '' ]] 00:04:51.165 22:42:42 -- common/autotest_common.sh@667 -- # (( !es == 0 )) 00:04:51.165 00:04:51.165 real 0m0.022s 00:04:51.165 user 0m0.010s 00:04:51.165 sys 0m0.012s 00:04:51.165 22:42:42 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:04:51.165 22:42:42 -- common/autotest_common.sh@10 -- # set +x 00:04:51.165 ************************************ 00:04:51.165 END TEST accel_wrong_workload 00:04:51.165 ************************************ 00:04:51.424 22:42:42 -- accel/accel.sh@89 -- # run_test accel_negative_buffers NOT accel_perf -t 1 -w xor -y -x -1 00:04:51.424 Error: writing output failed: Broken pipe 00:04:51.424 22:42:42 -- common/autotest_common.sh@1077 -- # '[' 10 -le 1 ']' 00:04:51.424 22:42:42 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:04:51.424 22:42:42 -- common/autotest_common.sh@10 -- # set +x 00:04:51.424 ************************************ 00:04:51.424 START TEST accel_negative_buffers 00:04:51.424 ************************************ 00:04:51.424 22:42:42 -- common/autotest_common.sh@1104 -- # NOT accel_perf -t 1 -w xor -y -x -1 00:04:51.424 22:42:42 -- common/autotest_common.sh@640 -- # local es=0 00:04:51.424 22:42:42 -- common/autotest_common.sh@642 -- # valid_exec_arg accel_perf -t 1 -w xor -y -x -1 00:04:51.424 22:42:42 -- common/autotest_common.sh@628 -- # local arg=accel_perf 00:04:51.424 22:42:42 -- common/autotest_common.sh@632 -- # case "$(type -t "$arg")" in 00:04:51.424 22:42:42 -- common/autotest_common.sh@632 -- # type -t accel_perf 00:04:51.424 22:42:42 -- common/autotest_common.sh@632 -- # case "$(type -t "$arg")" in 00:04:51.424 22:42:42 -- common/autotest_common.sh@643 -- # accel_perf -t 1 -w xor -y -x -1 00:04:51.424 22:42:42 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w xor -y -x -1 00:04:51.424 22:42:42 -- accel/accel.sh@12 -- # build_accel_config 00:04:51.424 22:42:42 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:04:51.424 22:42:42 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:04:51.424 22:42:42 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:04:51.424 22:42:42 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:04:51.424 22:42:42 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:04:51.424 22:42:42 -- accel/accel.sh@41 -- # local IFS=, 00:04:51.424 22:42:42 -- accel/accel.sh@42 -- # jq -r . 00:04:51.424 -x option must be non-negative. 00:04:51.424 [2024-04-16 22:42:42.324646] app.c:1292:spdk_app_parse_args: *ERROR*: Parsing app-specific command line parameter 'x' failed: 1 00:04:51.424 accel_perf options: 00:04:51.424 [-h help message] 00:04:51.424 [-q queue depth per core] 00:04:51.424 [-C for supported workloads, use this value to configure the io vector size to test (default 1) 00:04:51.424 [-T number of threads per core 00:04:51.424 [-o transfer size in bytes (default: 4KiB. For compress/decompress, 0 means the input file size)] 00:04:51.424 [-t time in seconds] 00:04:51.424 [-w workload type must be one of these: copy, fill, crc32c, copy_crc32c, compare, compress, decompress, dualcast, xor, 00:04:51.424 [ dif_verify, , dif_generate, dif_generate_copy 00:04:51.424 [-M assign module to the operation, not compatible with accel_assign_opc RPC 00:04:51.425 [-l for compress/decompress workloads, name of uncompressed input file 00:04:51.425 [-S for crc32c workload, use this seed value (default 0) 00:04:51.425 [-P for compare workload, percentage of operations that should miscompare (percent, default 0) 00:04:51.425 [-f for fill workload, use this BYTE value (default 255) 00:04:51.425 [-x for xor workload, use this number of source buffers (default, minimum: 2)] 00:04:51.425 [-y verify result if this switch is on] 00:04:51.425 [-a tasks to allocate per core (default: same value as -q)] 00:04:51.425 Can be used to spread operations across a wider range of memory. 00:04:51.425 22:42:42 -- common/autotest_common.sh@643 -- # es=1 00:04:51.425 22:42:42 -- common/autotest_common.sh@651 -- # (( es > 128 )) 00:04:51.425 22:42:42 -- common/autotest_common.sh@662 -- # [[ -n '' ]] 00:04:51.425 22:42:42 -- common/autotest_common.sh@667 -- # (( !es == 0 )) 00:04:51.425 00:04:51.425 real 0m0.021s 00:04:51.425 user 0m0.013s 00:04:51.425 sys 0m0.008s 00:04:51.425 22:42:42 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:04:51.425 22:42:42 -- common/autotest_common.sh@10 -- # set +x 00:04:51.425 ************************************ 00:04:51.425 END TEST accel_negative_buffers 00:04:51.425 ************************************ 00:04:51.425 Error: writing output failed: Broken pipe 00:04:51.425 22:42:42 -- accel/accel.sh@93 -- # run_test accel_crc32c accel_test -t 1 -w crc32c -S 32 -y 00:04:51.425 22:42:42 -- common/autotest_common.sh@1077 -- # '[' 9 -le 1 ']' 00:04:51.425 22:42:42 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:04:51.425 22:42:42 -- common/autotest_common.sh@10 -- # set +x 00:04:51.425 ************************************ 00:04:51.425 START TEST accel_crc32c 00:04:51.425 ************************************ 00:04:51.425 22:42:42 -- common/autotest_common.sh@1104 -- # accel_test -t 1 -w crc32c -S 32 -y 00:04:51.425 22:42:42 -- accel/accel.sh@16 -- # local accel_opc 00:04:51.425 22:42:42 -- accel/accel.sh@17 -- # local accel_module 00:04:51.425 22:42:42 -- accel/accel.sh@18 -- # accel_perf -t 1 -w crc32c -S 32 -y 00:04:51.425 22:42:42 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w crc32c -S 32 -y 00:04:51.425 22:42:42 -- accel/accel.sh@12 -- # build_accel_config 00:04:51.425 22:42:42 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:04:51.425 22:42:42 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:04:51.425 22:42:42 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:04:51.425 22:42:42 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:04:51.425 22:42:42 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:04:51.425 22:42:42 -- accel/accel.sh@41 -- # local IFS=, 00:04:51.425 22:42:42 -- accel/accel.sh@42 -- # jq -r . 00:04:51.425 [2024-04-16 22:42:42.367546] Starting SPDK v24.01.1-pre git sha1 4b134b4ab / DPDK 23.11.0 initialization... 00:04:51.425 [2024-04-16 22:42:42.367609] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid162396 ] 00:04:51.425 EAL: No free 2048 kB hugepages reported on node 1 00:04:51.425 [2024-04-16 22:42:42.429471] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:04:51.425 [2024-04-16 22:42:42.546267] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:04:52.806 22:42:43 -- accel/accel.sh@18 -- # out=' 00:04:52.806 SPDK Configuration: 00:04:52.806 Core mask: 0x1 00:04:52.806 00:04:52.806 Accel Perf Configuration: 00:04:52.806 Workload Type: crc32c 00:04:52.806 CRC-32C seed: 32 00:04:52.806 Transfer size: 4096 bytes 00:04:52.806 Vector count 1 00:04:52.806 Module: software 00:04:52.806 Queue depth: 32 00:04:52.806 Allocate depth: 32 00:04:52.806 # threads/core: 1 00:04:52.806 Run time: 1 seconds 00:04:52.806 Verify: Yes 00:04:52.806 00:04:52.806 Running for 1 seconds... 00:04:52.806 00:04:52.806 Core,Thread Transfers Bandwidth Failed Miscompares 00:04:52.806 ------------------------------------------------------------------------------------ 00:04:52.806 0,0 404832/s 1581 MiB/s 0 0 00:04:52.806 ==================================================================================== 00:04:52.806 Total 404832/s 1581 MiB/s 0 0' 00:04:52.806 22:42:43 -- accel/accel.sh@20 -- # IFS=: 00:04:52.806 22:42:43 -- accel/accel.sh@15 -- # accel_perf -t 1 -w crc32c -S 32 -y 00:04:52.806 22:42:43 -- accel/accel.sh@20 -- # read -r var val 00:04:52.806 22:42:43 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w crc32c -S 32 -y 00:04:52.806 22:42:43 -- accel/accel.sh@12 -- # build_accel_config 00:04:52.806 22:42:43 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:04:52.806 22:42:43 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:04:52.806 22:42:43 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:04:52.806 22:42:43 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:04:52.806 22:42:43 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:04:52.806 22:42:43 -- accel/accel.sh@41 -- # local IFS=, 00:04:52.806 22:42:43 -- accel/accel.sh@42 -- # jq -r . 00:04:52.806 [2024-04-16 22:42:43.840878] Starting SPDK v24.01.1-pre git sha1 4b134b4ab / DPDK 23.11.0 initialization... 00:04:52.806 [2024-04-16 22:42:43.840959] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid162540 ] 00:04:52.806 EAL: No free 2048 kB hugepages reported on node 1 00:04:52.806 [2024-04-16 22:42:43.901773] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:04:53.066 [2024-04-16 22:42:44.019027] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:04:53.066 22:42:44 -- accel/accel.sh@21 -- # val= 00:04:53.066 22:42:44 -- accel/accel.sh@22 -- # case "$var" in 00:04:53.066 22:42:44 -- accel/accel.sh@20 -- # IFS=: 00:04:53.066 22:42:44 -- accel/accel.sh@20 -- # read -r var val 00:04:53.066 22:42:44 -- accel/accel.sh@21 -- # val= 00:04:53.066 22:42:44 -- accel/accel.sh@22 -- # case "$var" in 00:04:53.066 22:42:44 -- accel/accel.sh@20 -- # IFS=: 00:04:53.066 22:42:44 -- accel/accel.sh@20 -- # read -r var val 00:04:53.066 22:42:44 -- accel/accel.sh@21 -- # val=0x1 00:04:53.066 22:42:44 -- accel/accel.sh@22 -- # case "$var" in 00:04:53.066 22:42:44 -- accel/accel.sh@20 -- # IFS=: 00:04:53.066 22:42:44 -- accel/accel.sh@20 -- # read -r var val 00:04:53.066 22:42:44 -- accel/accel.sh@21 -- # val= 00:04:53.066 22:42:44 -- accel/accel.sh@22 -- # case "$var" in 00:04:53.066 22:42:44 -- accel/accel.sh@20 -- # IFS=: 00:04:53.066 22:42:44 -- accel/accel.sh@20 -- # read -r var val 00:04:53.066 22:42:44 -- accel/accel.sh@21 -- # val= 00:04:53.066 22:42:44 -- accel/accel.sh@22 -- # case "$var" in 00:04:53.066 22:42:44 -- accel/accel.sh@20 -- # IFS=: 00:04:53.066 22:42:44 -- accel/accel.sh@20 -- # read -r var val 00:04:53.066 22:42:44 -- accel/accel.sh@21 -- # val=crc32c 00:04:53.066 22:42:44 -- accel/accel.sh@22 -- # case "$var" in 00:04:53.066 22:42:44 -- accel/accel.sh@24 -- # accel_opc=crc32c 00:04:53.066 22:42:44 -- accel/accel.sh@20 -- # IFS=: 00:04:53.066 22:42:44 -- accel/accel.sh@20 -- # read -r var val 00:04:53.066 22:42:44 -- accel/accel.sh@21 -- # val=32 00:04:53.066 22:42:44 -- accel/accel.sh@22 -- # case "$var" in 00:04:53.066 22:42:44 -- accel/accel.sh@20 -- # IFS=: 00:04:53.066 22:42:44 -- accel/accel.sh@20 -- # read -r var val 00:04:53.066 22:42:44 -- accel/accel.sh@21 -- # val='4096 bytes' 00:04:53.066 22:42:44 -- accel/accel.sh@22 -- # case "$var" in 00:04:53.066 22:42:44 -- accel/accel.sh@20 -- # IFS=: 00:04:53.066 22:42:44 -- accel/accel.sh@20 -- # read -r var val 00:04:53.066 22:42:44 -- accel/accel.sh@21 -- # val= 00:04:53.066 22:42:44 -- accel/accel.sh@22 -- # case "$var" in 00:04:53.066 22:42:44 -- accel/accel.sh@20 -- # IFS=: 00:04:53.066 22:42:44 -- accel/accel.sh@20 -- # read -r var val 00:04:53.066 22:42:44 -- accel/accel.sh@21 -- # val=software 00:04:53.066 22:42:44 -- accel/accel.sh@22 -- # case "$var" in 00:04:53.066 22:42:44 -- accel/accel.sh@23 -- # accel_module=software 00:04:53.066 22:42:44 -- accel/accel.sh@20 -- # IFS=: 00:04:53.066 22:42:44 -- accel/accel.sh@20 -- # read -r var val 00:04:53.066 22:42:44 -- accel/accel.sh@21 -- # val=32 00:04:53.066 22:42:44 -- accel/accel.sh@22 -- # case "$var" in 00:04:53.066 22:42:44 -- accel/accel.sh@20 -- # IFS=: 00:04:53.066 22:42:44 -- accel/accel.sh@20 -- # read -r var val 00:04:53.066 22:42:44 -- accel/accel.sh@21 -- # val=32 00:04:53.066 22:42:44 -- accel/accel.sh@22 -- # case "$var" in 00:04:53.066 22:42:44 -- accel/accel.sh@20 -- # IFS=: 00:04:53.066 22:42:44 -- accel/accel.sh@20 -- # read -r var val 00:04:53.066 22:42:44 -- accel/accel.sh@21 -- # val=1 00:04:53.066 22:42:44 -- accel/accel.sh@22 -- # case "$var" in 00:04:53.066 22:42:44 -- accel/accel.sh@20 -- # IFS=: 00:04:53.066 22:42:44 -- accel/accel.sh@20 -- # read -r var val 00:04:53.066 22:42:44 -- accel/accel.sh@21 -- # val='1 seconds' 00:04:53.066 22:42:44 -- accel/accel.sh@22 -- # case "$var" in 00:04:53.066 22:42:44 -- accel/accel.sh@20 -- # IFS=: 00:04:53.066 22:42:44 -- accel/accel.sh@20 -- # read -r var val 00:04:53.066 22:42:44 -- accel/accel.sh@21 -- # val=Yes 00:04:53.066 22:42:44 -- accel/accel.sh@22 -- # case "$var" in 00:04:53.066 22:42:44 -- accel/accel.sh@20 -- # IFS=: 00:04:53.066 22:42:44 -- accel/accel.sh@20 -- # read -r var val 00:04:53.066 22:42:44 -- accel/accel.sh@21 -- # val= 00:04:53.066 22:42:44 -- accel/accel.sh@22 -- # case "$var" in 00:04:53.066 22:42:44 -- accel/accel.sh@20 -- # IFS=: 00:04:53.066 22:42:44 -- accel/accel.sh@20 -- # read -r var val 00:04:53.066 22:42:44 -- accel/accel.sh@21 -- # val= 00:04:53.066 22:42:44 -- accel/accel.sh@22 -- # case "$var" in 00:04:53.066 22:42:44 -- accel/accel.sh@20 -- # IFS=: 00:04:53.066 22:42:44 -- accel/accel.sh@20 -- # read -r var val 00:04:54.447 22:42:45 -- accel/accel.sh@21 -- # val= 00:04:54.447 22:42:45 -- accel/accel.sh@22 -- # case "$var" in 00:04:54.447 22:42:45 -- accel/accel.sh@20 -- # IFS=: 00:04:54.447 22:42:45 -- accel/accel.sh@20 -- # read -r var val 00:04:54.447 22:42:45 -- accel/accel.sh@21 -- # val= 00:04:54.447 22:42:45 -- accel/accel.sh@22 -- # case "$var" in 00:04:54.447 22:42:45 -- accel/accel.sh@20 -- # IFS=: 00:04:54.447 22:42:45 -- accel/accel.sh@20 -- # read -r var val 00:04:54.447 22:42:45 -- accel/accel.sh@21 -- # val= 00:04:54.447 22:42:45 -- accel/accel.sh@22 -- # case "$var" in 00:04:54.447 22:42:45 -- accel/accel.sh@20 -- # IFS=: 00:04:54.447 22:42:45 -- accel/accel.sh@20 -- # read -r var val 00:04:54.447 22:42:45 -- accel/accel.sh@21 -- # val= 00:04:54.447 22:42:45 -- accel/accel.sh@22 -- # case "$var" in 00:04:54.447 22:42:45 -- accel/accel.sh@20 -- # IFS=: 00:04:54.447 22:42:45 -- accel/accel.sh@20 -- # read -r var val 00:04:54.447 22:42:45 -- accel/accel.sh@21 -- # val= 00:04:54.447 22:42:45 -- accel/accel.sh@22 -- # case "$var" in 00:04:54.447 22:42:45 -- accel/accel.sh@20 -- # IFS=: 00:04:54.447 22:42:45 -- accel/accel.sh@20 -- # read -r var val 00:04:54.447 22:42:45 -- accel/accel.sh@21 -- # val= 00:04:54.447 22:42:45 -- accel/accel.sh@22 -- # case "$var" in 00:04:54.447 22:42:45 -- accel/accel.sh@20 -- # IFS=: 00:04:54.447 22:42:45 -- accel/accel.sh@20 -- # read -r var val 00:04:54.447 22:42:45 -- accel/accel.sh@28 -- # [[ -n software ]] 00:04:54.447 22:42:45 -- accel/accel.sh@28 -- # [[ -n crc32c ]] 00:04:54.447 22:42:45 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:04:54.447 00:04:54.447 real 0m2.942s 00:04:54.447 user 0m2.647s 00:04:54.447 sys 0m0.288s 00:04:54.447 22:42:45 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:04:54.447 22:42:45 -- common/autotest_common.sh@10 -- # set +x 00:04:54.447 ************************************ 00:04:54.447 END TEST accel_crc32c 00:04:54.447 ************************************ 00:04:54.447 22:42:45 -- accel/accel.sh@94 -- # run_test accel_crc32c_C2 accel_test -t 1 -w crc32c -y -C 2 00:04:54.447 22:42:45 -- common/autotest_common.sh@1077 -- # '[' 9 -le 1 ']' 00:04:54.447 22:42:45 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:04:54.447 22:42:45 -- common/autotest_common.sh@10 -- # set +x 00:04:54.447 ************************************ 00:04:54.447 START TEST accel_crc32c_C2 00:04:54.447 ************************************ 00:04:54.447 22:42:45 -- common/autotest_common.sh@1104 -- # accel_test -t 1 -w crc32c -y -C 2 00:04:54.447 22:42:45 -- accel/accel.sh@16 -- # local accel_opc 00:04:54.447 22:42:45 -- accel/accel.sh@17 -- # local accel_module 00:04:54.447 22:42:45 -- accel/accel.sh@18 -- # accel_perf -t 1 -w crc32c -y -C 2 00:04:54.447 22:42:45 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w crc32c -y -C 2 00:04:54.447 22:42:45 -- accel/accel.sh@12 -- # build_accel_config 00:04:54.447 22:42:45 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:04:54.447 22:42:45 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:04:54.447 22:42:45 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:04:54.447 22:42:45 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:04:54.447 22:42:45 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:04:54.447 22:42:45 -- accel/accel.sh@41 -- # local IFS=, 00:04:54.447 22:42:45 -- accel/accel.sh@42 -- # jq -r . 00:04:54.447 [2024-04-16 22:42:45.333962] Starting SPDK v24.01.1-pre git sha1 4b134b4ab / DPDK 23.11.0 initialization... 00:04:54.447 [2024-04-16 22:42:45.334039] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid162695 ] 00:04:54.447 EAL: No free 2048 kB hugepages reported on node 1 00:04:54.447 [2024-04-16 22:42:45.394637] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:04:54.447 [2024-04-16 22:42:45.512536] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:04:55.828 22:42:46 -- accel/accel.sh@18 -- # out=' 00:04:55.828 SPDK Configuration: 00:04:55.828 Core mask: 0x1 00:04:55.828 00:04:55.828 Accel Perf Configuration: 00:04:55.828 Workload Type: crc32c 00:04:55.828 CRC-32C seed: 0 00:04:55.828 Transfer size: 4096 bytes 00:04:55.828 Vector count 2 00:04:55.828 Module: software 00:04:55.828 Queue depth: 32 00:04:55.828 Allocate depth: 32 00:04:55.828 # threads/core: 1 00:04:55.828 Run time: 1 seconds 00:04:55.828 Verify: Yes 00:04:55.828 00:04:55.828 Running for 1 seconds... 00:04:55.828 00:04:55.828 Core,Thread Transfers Bandwidth Failed Miscompares 00:04:55.828 ------------------------------------------------------------------------------------ 00:04:55.828 0,0 313536/s 2449 MiB/s 0 0 00:04:55.828 ==================================================================================== 00:04:55.828 Total 313536/s 1224 MiB/s 0 0' 00:04:55.828 22:42:46 -- accel/accel.sh@20 -- # IFS=: 00:04:55.828 22:42:46 -- accel/accel.sh@15 -- # accel_perf -t 1 -w crc32c -y -C 2 00:04:55.828 22:42:46 -- accel/accel.sh@20 -- # read -r var val 00:04:55.828 22:42:46 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w crc32c -y -C 2 00:04:55.828 22:42:46 -- accel/accel.sh@12 -- # build_accel_config 00:04:55.828 22:42:46 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:04:55.828 22:42:46 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:04:55.828 22:42:46 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:04:55.828 22:42:46 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:04:55.828 22:42:46 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:04:55.828 22:42:46 -- accel/accel.sh@41 -- # local IFS=, 00:04:55.828 22:42:46 -- accel/accel.sh@42 -- # jq -r . 00:04:55.828 [2024-04-16 22:42:46.792636] Starting SPDK v24.01.1-pre git sha1 4b134b4ab / DPDK 23.11.0 initialization... 00:04:55.828 [2024-04-16 22:42:46.792706] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid162960 ] 00:04:55.828 EAL: No free 2048 kB hugepages reported on node 1 00:04:55.828 [2024-04-16 22:42:46.851084] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:04:56.088 [2024-04-16 22:42:46.969161] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:04:56.088 22:42:47 -- accel/accel.sh@21 -- # val= 00:04:56.088 22:42:47 -- accel/accel.sh@22 -- # case "$var" in 00:04:56.088 22:42:47 -- accel/accel.sh@20 -- # IFS=: 00:04:56.088 22:42:47 -- accel/accel.sh@20 -- # read -r var val 00:04:56.088 22:42:47 -- accel/accel.sh@21 -- # val= 00:04:56.088 22:42:47 -- accel/accel.sh@22 -- # case "$var" in 00:04:56.088 22:42:47 -- accel/accel.sh@20 -- # IFS=: 00:04:56.088 22:42:47 -- accel/accel.sh@20 -- # read -r var val 00:04:56.088 22:42:47 -- accel/accel.sh@21 -- # val=0x1 00:04:56.088 22:42:47 -- accel/accel.sh@22 -- # case "$var" in 00:04:56.088 22:42:47 -- accel/accel.sh@20 -- # IFS=: 00:04:56.088 22:42:47 -- accel/accel.sh@20 -- # read -r var val 00:04:56.088 22:42:47 -- accel/accel.sh@21 -- # val= 00:04:56.088 22:42:47 -- accel/accel.sh@22 -- # case "$var" in 00:04:56.088 22:42:47 -- accel/accel.sh@20 -- # IFS=: 00:04:56.088 22:42:47 -- accel/accel.sh@20 -- # read -r var val 00:04:56.088 22:42:47 -- accel/accel.sh@21 -- # val= 00:04:56.088 22:42:47 -- accel/accel.sh@22 -- # case "$var" in 00:04:56.088 22:42:47 -- accel/accel.sh@20 -- # IFS=: 00:04:56.088 22:42:47 -- accel/accel.sh@20 -- # read -r var val 00:04:56.088 22:42:47 -- accel/accel.sh@21 -- # val=crc32c 00:04:56.088 22:42:47 -- accel/accel.sh@22 -- # case "$var" in 00:04:56.088 22:42:47 -- accel/accel.sh@24 -- # accel_opc=crc32c 00:04:56.088 22:42:47 -- accel/accel.sh@20 -- # IFS=: 00:04:56.088 22:42:47 -- accel/accel.sh@20 -- # read -r var val 00:04:56.088 22:42:47 -- accel/accel.sh@21 -- # val=0 00:04:56.088 22:42:47 -- accel/accel.sh@22 -- # case "$var" in 00:04:56.088 22:42:47 -- accel/accel.sh@20 -- # IFS=: 00:04:56.088 22:42:47 -- accel/accel.sh@20 -- # read -r var val 00:04:56.088 22:42:47 -- accel/accel.sh@21 -- # val='4096 bytes' 00:04:56.088 22:42:47 -- accel/accel.sh@22 -- # case "$var" in 00:04:56.088 22:42:47 -- accel/accel.sh@20 -- # IFS=: 00:04:56.088 22:42:47 -- accel/accel.sh@20 -- # read -r var val 00:04:56.088 22:42:47 -- accel/accel.sh@21 -- # val= 00:04:56.088 22:42:47 -- accel/accel.sh@22 -- # case "$var" in 00:04:56.088 22:42:47 -- accel/accel.sh@20 -- # IFS=: 00:04:56.088 22:42:47 -- accel/accel.sh@20 -- # read -r var val 00:04:56.088 22:42:47 -- accel/accel.sh@21 -- # val=software 00:04:56.088 22:42:47 -- accel/accel.sh@22 -- # case "$var" in 00:04:56.088 22:42:47 -- accel/accel.sh@23 -- # accel_module=software 00:04:56.088 22:42:47 -- accel/accel.sh@20 -- # IFS=: 00:04:56.088 22:42:47 -- accel/accel.sh@20 -- # read -r var val 00:04:56.088 22:42:47 -- accel/accel.sh@21 -- # val=32 00:04:56.088 22:42:47 -- accel/accel.sh@22 -- # case "$var" in 00:04:56.088 22:42:47 -- accel/accel.sh@20 -- # IFS=: 00:04:56.088 22:42:47 -- accel/accel.sh@20 -- # read -r var val 00:04:56.088 22:42:47 -- accel/accel.sh@21 -- # val=32 00:04:56.088 22:42:47 -- accel/accel.sh@22 -- # case "$var" in 00:04:56.088 22:42:47 -- accel/accel.sh@20 -- # IFS=: 00:04:56.088 22:42:47 -- accel/accel.sh@20 -- # read -r var val 00:04:56.088 22:42:47 -- accel/accel.sh@21 -- # val=1 00:04:56.088 22:42:47 -- accel/accel.sh@22 -- # case "$var" in 00:04:56.088 22:42:47 -- accel/accel.sh@20 -- # IFS=: 00:04:56.088 22:42:47 -- accel/accel.sh@20 -- # read -r var val 00:04:56.088 22:42:47 -- accel/accel.sh@21 -- # val='1 seconds' 00:04:56.088 22:42:47 -- accel/accel.sh@22 -- # case "$var" in 00:04:56.088 22:42:47 -- accel/accel.sh@20 -- # IFS=: 00:04:56.088 22:42:47 -- accel/accel.sh@20 -- # read -r var val 00:04:56.088 22:42:47 -- accel/accel.sh@21 -- # val=Yes 00:04:56.088 22:42:47 -- accel/accel.sh@22 -- # case "$var" in 00:04:56.088 22:42:47 -- accel/accel.sh@20 -- # IFS=: 00:04:56.088 22:42:47 -- accel/accel.sh@20 -- # read -r var val 00:04:56.088 22:42:47 -- accel/accel.sh@21 -- # val= 00:04:56.088 22:42:47 -- accel/accel.sh@22 -- # case "$var" in 00:04:56.088 22:42:47 -- accel/accel.sh@20 -- # IFS=: 00:04:56.088 22:42:47 -- accel/accel.sh@20 -- # read -r var val 00:04:56.088 22:42:47 -- accel/accel.sh@21 -- # val= 00:04:56.088 22:42:47 -- accel/accel.sh@22 -- # case "$var" in 00:04:56.088 22:42:47 -- accel/accel.sh@20 -- # IFS=: 00:04:56.088 22:42:47 -- accel/accel.sh@20 -- # read -r var val 00:04:57.469 22:42:48 -- accel/accel.sh@21 -- # val= 00:04:57.469 22:42:48 -- accel/accel.sh@22 -- # case "$var" in 00:04:57.469 22:42:48 -- accel/accel.sh@20 -- # IFS=: 00:04:57.469 22:42:48 -- accel/accel.sh@20 -- # read -r var val 00:04:57.469 22:42:48 -- accel/accel.sh@21 -- # val= 00:04:57.469 22:42:48 -- accel/accel.sh@22 -- # case "$var" in 00:04:57.469 22:42:48 -- accel/accel.sh@20 -- # IFS=: 00:04:57.469 22:42:48 -- accel/accel.sh@20 -- # read -r var val 00:04:57.469 22:42:48 -- accel/accel.sh@21 -- # val= 00:04:57.469 22:42:48 -- accel/accel.sh@22 -- # case "$var" in 00:04:57.469 22:42:48 -- accel/accel.sh@20 -- # IFS=: 00:04:57.469 22:42:48 -- accel/accel.sh@20 -- # read -r var val 00:04:57.469 22:42:48 -- accel/accel.sh@21 -- # val= 00:04:57.469 22:42:48 -- accel/accel.sh@22 -- # case "$var" in 00:04:57.469 22:42:48 -- accel/accel.sh@20 -- # IFS=: 00:04:57.469 22:42:48 -- accel/accel.sh@20 -- # read -r var val 00:04:57.469 22:42:48 -- accel/accel.sh@21 -- # val= 00:04:57.469 22:42:48 -- accel/accel.sh@22 -- # case "$var" in 00:04:57.469 22:42:48 -- accel/accel.sh@20 -- # IFS=: 00:04:57.469 22:42:48 -- accel/accel.sh@20 -- # read -r var val 00:04:57.469 22:42:48 -- accel/accel.sh@21 -- # val= 00:04:57.469 22:42:48 -- accel/accel.sh@22 -- # case "$var" in 00:04:57.469 22:42:48 -- accel/accel.sh@20 -- # IFS=: 00:04:57.469 22:42:48 -- accel/accel.sh@20 -- # read -r var val 00:04:57.469 22:42:48 -- accel/accel.sh@28 -- # [[ -n software ]] 00:04:57.469 22:42:48 -- accel/accel.sh@28 -- # [[ -n crc32c ]] 00:04:57.469 22:42:48 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:04:57.469 00:04:57.469 real 0m2.927s 00:04:57.469 user 0m2.641s 00:04:57.469 sys 0m0.278s 00:04:57.469 22:42:48 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:04:57.469 22:42:48 -- common/autotest_common.sh@10 -- # set +x 00:04:57.469 ************************************ 00:04:57.469 END TEST accel_crc32c_C2 00:04:57.469 ************************************ 00:04:57.469 22:42:48 -- accel/accel.sh@95 -- # run_test accel_copy accel_test -t 1 -w copy -y 00:04:57.469 22:42:48 -- common/autotest_common.sh@1077 -- # '[' 7 -le 1 ']' 00:04:57.469 22:42:48 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:04:57.469 22:42:48 -- common/autotest_common.sh@10 -- # set +x 00:04:57.469 ************************************ 00:04:57.469 START TEST accel_copy 00:04:57.469 ************************************ 00:04:57.469 22:42:48 -- common/autotest_common.sh@1104 -- # accel_test -t 1 -w copy -y 00:04:57.469 22:42:48 -- accel/accel.sh@16 -- # local accel_opc 00:04:57.469 22:42:48 -- accel/accel.sh@17 -- # local accel_module 00:04:57.469 22:42:48 -- accel/accel.sh@18 -- # accel_perf -t 1 -w copy -y 00:04:57.469 22:42:48 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w copy -y 00:04:57.469 22:42:48 -- accel/accel.sh@12 -- # build_accel_config 00:04:57.469 22:42:48 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:04:57.469 22:42:48 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:04:57.469 22:42:48 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:04:57.469 22:42:48 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:04:57.469 22:42:48 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:04:57.469 22:42:48 -- accel/accel.sh@41 -- # local IFS=, 00:04:57.469 22:42:48 -- accel/accel.sh@42 -- # jq -r . 00:04:57.469 [2024-04-16 22:42:48.284688] Starting SPDK v24.01.1-pre git sha1 4b134b4ab / DPDK 23.11.0 initialization... 00:04:57.469 [2024-04-16 22:42:48.284768] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid163123 ] 00:04:57.469 EAL: No free 2048 kB hugepages reported on node 1 00:04:57.469 [2024-04-16 22:42:48.345742] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:04:57.469 [2024-04-16 22:42:48.463030] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:04:58.850 22:42:49 -- accel/accel.sh@18 -- # out=' 00:04:58.850 SPDK Configuration: 00:04:58.850 Core mask: 0x1 00:04:58.850 00:04:58.850 Accel Perf Configuration: 00:04:58.850 Workload Type: copy 00:04:58.850 Transfer size: 4096 bytes 00:04:58.850 Vector count 1 00:04:58.850 Module: software 00:04:58.850 Queue depth: 32 00:04:58.850 Allocate depth: 32 00:04:58.850 # threads/core: 1 00:04:58.850 Run time: 1 seconds 00:04:58.850 Verify: Yes 00:04:58.850 00:04:58.850 Running for 1 seconds... 00:04:58.850 00:04:58.850 Core,Thread Transfers Bandwidth Failed Miscompares 00:04:58.850 ------------------------------------------------------------------------------------ 00:04:58.850 0,0 277952/s 1085 MiB/s 0 0 00:04:58.850 ==================================================================================== 00:04:58.850 Total 277952/s 1085 MiB/s 0 0' 00:04:58.850 22:42:49 -- accel/accel.sh@20 -- # IFS=: 00:04:58.850 22:42:49 -- accel/accel.sh@15 -- # accel_perf -t 1 -w copy -y 00:04:58.850 22:42:49 -- accel/accel.sh@20 -- # read -r var val 00:04:58.850 22:42:49 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w copy -y 00:04:58.850 22:42:49 -- accel/accel.sh@12 -- # build_accel_config 00:04:58.850 22:42:49 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:04:58.850 22:42:49 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:04:58.850 22:42:49 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:04:58.850 22:42:49 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:04:58.850 22:42:49 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:04:58.850 22:42:49 -- accel/accel.sh@41 -- # local IFS=, 00:04:58.850 22:42:49 -- accel/accel.sh@42 -- # jq -r . 00:04:58.850 [2024-04-16 22:42:49.751631] Starting SPDK v24.01.1-pre git sha1 4b134b4ab / DPDK 23.11.0 initialization... 00:04:58.850 [2024-04-16 22:42:49.751722] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid163261 ] 00:04:58.850 EAL: No free 2048 kB hugepages reported on node 1 00:04:58.850 [2024-04-16 22:42:49.812238] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:04:58.850 [2024-04-16 22:42:49.930796] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:04:59.109 22:42:49 -- accel/accel.sh@21 -- # val= 00:04:59.109 22:42:49 -- accel/accel.sh@22 -- # case "$var" in 00:04:59.110 22:42:49 -- accel/accel.sh@20 -- # IFS=: 00:04:59.110 22:42:49 -- accel/accel.sh@20 -- # read -r var val 00:04:59.110 22:42:49 -- accel/accel.sh@21 -- # val= 00:04:59.110 22:42:49 -- accel/accel.sh@22 -- # case "$var" in 00:04:59.110 22:42:49 -- accel/accel.sh@20 -- # IFS=: 00:04:59.110 22:42:49 -- accel/accel.sh@20 -- # read -r var val 00:04:59.110 22:42:49 -- accel/accel.sh@21 -- # val=0x1 00:04:59.110 22:42:49 -- accel/accel.sh@22 -- # case "$var" in 00:04:59.110 22:42:49 -- accel/accel.sh@20 -- # IFS=: 00:04:59.110 22:42:49 -- accel/accel.sh@20 -- # read -r var val 00:04:59.110 22:42:49 -- accel/accel.sh@21 -- # val= 00:04:59.110 22:42:49 -- accel/accel.sh@22 -- # case "$var" in 00:04:59.110 22:42:49 -- accel/accel.sh@20 -- # IFS=: 00:04:59.110 22:42:49 -- accel/accel.sh@20 -- # read -r var val 00:04:59.110 22:42:49 -- accel/accel.sh@21 -- # val= 00:04:59.110 22:42:49 -- accel/accel.sh@22 -- # case "$var" in 00:04:59.110 22:42:49 -- accel/accel.sh@20 -- # IFS=: 00:04:59.110 22:42:49 -- accel/accel.sh@20 -- # read -r var val 00:04:59.110 22:42:49 -- accel/accel.sh@21 -- # val=copy 00:04:59.110 22:42:49 -- accel/accel.sh@22 -- # case "$var" in 00:04:59.110 22:42:49 -- accel/accel.sh@24 -- # accel_opc=copy 00:04:59.110 22:42:49 -- accel/accel.sh@20 -- # IFS=: 00:04:59.110 22:42:49 -- accel/accel.sh@20 -- # read -r var val 00:04:59.110 22:42:49 -- accel/accel.sh@21 -- # val='4096 bytes' 00:04:59.110 22:42:49 -- accel/accel.sh@22 -- # case "$var" in 00:04:59.110 22:42:49 -- accel/accel.sh@20 -- # IFS=: 00:04:59.110 22:42:49 -- accel/accel.sh@20 -- # read -r var val 00:04:59.110 22:42:49 -- accel/accel.sh@21 -- # val= 00:04:59.110 22:42:49 -- accel/accel.sh@22 -- # case "$var" in 00:04:59.110 22:42:49 -- accel/accel.sh@20 -- # IFS=: 00:04:59.110 22:42:49 -- accel/accel.sh@20 -- # read -r var val 00:04:59.110 22:42:49 -- accel/accel.sh@21 -- # val=software 00:04:59.110 22:42:49 -- accel/accel.sh@22 -- # case "$var" in 00:04:59.110 22:42:49 -- accel/accel.sh@23 -- # accel_module=software 00:04:59.110 22:42:49 -- accel/accel.sh@20 -- # IFS=: 00:04:59.110 22:42:49 -- accel/accel.sh@20 -- # read -r var val 00:04:59.110 22:42:49 -- accel/accel.sh@21 -- # val=32 00:04:59.110 22:42:49 -- accel/accel.sh@22 -- # case "$var" in 00:04:59.110 22:42:49 -- accel/accel.sh@20 -- # IFS=: 00:04:59.110 22:42:49 -- accel/accel.sh@20 -- # read -r var val 00:04:59.110 22:42:49 -- accel/accel.sh@21 -- # val=32 00:04:59.110 22:42:49 -- accel/accel.sh@22 -- # case "$var" in 00:04:59.110 22:42:49 -- accel/accel.sh@20 -- # IFS=: 00:04:59.110 22:42:49 -- accel/accel.sh@20 -- # read -r var val 00:04:59.110 22:42:49 -- accel/accel.sh@21 -- # val=1 00:04:59.110 22:42:49 -- accel/accel.sh@22 -- # case "$var" in 00:04:59.110 22:42:49 -- accel/accel.sh@20 -- # IFS=: 00:04:59.110 22:42:49 -- accel/accel.sh@20 -- # read -r var val 00:04:59.110 22:42:49 -- accel/accel.sh@21 -- # val='1 seconds' 00:04:59.110 22:42:49 -- accel/accel.sh@22 -- # case "$var" in 00:04:59.110 22:42:49 -- accel/accel.sh@20 -- # IFS=: 00:04:59.110 22:42:49 -- accel/accel.sh@20 -- # read -r var val 00:04:59.110 22:42:49 -- accel/accel.sh@21 -- # val=Yes 00:04:59.110 22:42:49 -- accel/accel.sh@22 -- # case "$var" in 00:04:59.110 22:42:49 -- accel/accel.sh@20 -- # IFS=: 00:04:59.110 22:42:49 -- accel/accel.sh@20 -- # read -r var val 00:04:59.110 22:42:50 -- accel/accel.sh@21 -- # val= 00:04:59.110 22:42:50 -- accel/accel.sh@22 -- # case "$var" in 00:04:59.110 22:42:50 -- accel/accel.sh@20 -- # IFS=: 00:04:59.110 22:42:50 -- accel/accel.sh@20 -- # read -r var val 00:04:59.110 22:42:50 -- accel/accel.sh@21 -- # val= 00:04:59.110 22:42:50 -- accel/accel.sh@22 -- # case "$var" in 00:04:59.110 22:42:50 -- accel/accel.sh@20 -- # IFS=: 00:04:59.110 22:42:50 -- accel/accel.sh@20 -- # read -r var val 00:05:00.520 22:42:51 -- accel/accel.sh@21 -- # val= 00:05:00.520 22:42:51 -- accel/accel.sh@22 -- # case "$var" in 00:05:00.520 22:42:51 -- accel/accel.sh@20 -- # IFS=: 00:05:00.520 22:42:51 -- accel/accel.sh@20 -- # read -r var val 00:05:00.520 22:42:51 -- accel/accel.sh@21 -- # val= 00:05:00.520 22:42:51 -- accel/accel.sh@22 -- # case "$var" in 00:05:00.520 22:42:51 -- accel/accel.sh@20 -- # IFS=: 00:05:00.520 22:42:51 -- accel/accel.sh@20 -- # read -r var val 00:05:00.520 22:42:51 -- accel/accel.sh@21 -- # val= 00:05:00.520 22:42:51 -- accel/accel.sh@22 -- # case "$var" in 00:05:00.520 22:42:51 -- accel/accel.sh@20 -- # IFS=: 00:05:00.520 22:42:51 -- accel/accel.sh@20 -- # read -r var val 00:05:00.520 22:42:51 -- accel/accel.sh@21 -- # val= 00:05:00.520 22:42:51 -- accel/accel.sh@22 -- # case "$var" in 00:05:00.520 22:42:51 -- accel/accel.sh@20 -- # IFS=: 00:05:00.520 22:42:51 -- accel/accel.sh@20 -- # read -r var val 00:05:00.520 22:42:51 -- accel/accel.sh@21 -- # val= 00:05:00.520 22:42:51 -- accel/accel.sh@22 -- # case "$var" in 00:05:00.520 22:42:51 -- accel/accel.sh@20 -- # IFS=: 00:05:00.520 22:42:51 -- accel/accel.sh@20 -- # read -r var val 00:05:00.520 22:42:51 -- accel/accel.sh@21 -- # val= 00:05:00.520 22:42:51 -- accel/accel.sh@22 -- # case "$var" in 00:05:00.520 22:42:51 -- accel/accel.sh@20 -- # IFS=: 00:05:00.520 22:42:51 -- accel/accel.sh@20 -- # read -r var val 00:05:00.520 22:42:51 -- accel/accel.sh@28 -- # [[ -n software ]] 00:05:00.520 22:42:51 -- accel/accel.sh@28 -- # [[ -n copy ]] 00:05:00.520 22:42:51 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:05:00.520 00:05:00.520 real 0m2.938s 00:05:00.520 user 0m2.635s 00:05:00.520 sys 0m0.294s 00:05:00.520 22:42:51 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:05:00.520 22:42:51 -- common/autotest_common.sh@10 -- # set +x 00:05:00.520 ************************************ 00:05:00.520 END TEST accel_copy 00:05:00.521 ************************************ 00:05:00.521 22:42:51 -- accel/accel.sh@96 -- # run_test accel_fill accel_test -t 1 -w fill -f 128 -q 64 -a 64 -y 00:05:00.521 22:42:51 -- common/autotest_common.sh@1077 -- # '[' 13 -le 1 ']' 00:05:00.521 22:42:51 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:05:00.521 22:42:51 -- common/autotest_common.sh@10 -- # set +x 00:05:00.521 ************************************ 00:05:00.521 START TEST accel_fill 00:05:00.521 ************************************ 00:05:00.521 22:42:51 -- common/autotest_common.sh@1104 -- # accel_test -t 1 -w fill -f 128 -q 64 -a 64 -y 00:05:00.521 22:42:51 -- accel/accel.sh@16 -- # local accel_opc 00:05:00.521 22:42:51 -- accel/accel.sh@17 -- # local accel_module 00:05:00.521 22:42:51 -- accel/accel.sh@18 -- # accel_perf -t 1 -w fill -f 128 -q 64 -a 64 -y 00:05:00.521 22:42:51 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w fill -f 128 -q 64 -a 64 -y 00:05:00.521 22:42:51 -- accel/accel.sh@12 -- # build_accel_config 00:05:00.521 22:42:51 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:05:00.521 22:42:51 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:00.521 22:42:51 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:00.521 22:42:51 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:05:00.521 22:42:51 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:05:00.521 22:42:51 -- accel/accel.sh@41 -- # local IFS=, 00:05:00.521 22:42:51 -- accel/accel.sh@42 -- # jq -r . 00:05:00.521 [2024-04-16 22:42:51.247934] Starting SPDK v24.01.1-pre git sha1 4b134b4ab / DPDK 23.11.0 initialization... 00:05:00.521 [2024-04-16 22:42:51.248023] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid163542 ] 00:05:00.521 EAL: No free 2048 kB hugepages reported on node 1 00:05:00.521 [2024-04-16 22:42:51.309791] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:00.521 [2024-04-16 22:42:51.422024] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:01.898 22:42:52 -- accel/accel.sh@18 -- # out=' 00:05:01.898 SPDK Configuration: 00:05:01.898 Core mask: 0x1 00:05:01.898 00:05:01.898 Accel Perf Configuration: 00:05:01.898 Workload Type: fill 00:05:01.898 Fill pattern: 0x80 00:05:01.898 Transfer size: 4096 bytes 00:05:01.898 Vector count 1 00:05:01.898 Module: software 00:05:01.898 Queue depth: 64 00:05:01.898 Allocate depth: 64 00:05:01.898 # threads/core: 1 00:05:01.898 Run time: 1 seconds 00:05:01.898 Verify: Yes 00:05:01.898 00:05:01.898 Running for 1 seconds... 00:05:01.898 00:05:01.898 Core,Thread Transfers Bandwidth Failed Miscompares 00:05:01.898 ------------------------------------------------------------------------------------ 00:05:01.898 0,0 399168/s 1559 MiB/s 0 0 00:05:01.898 ==================================================================================== 00:05:01.898 Total 399168/s 1559 MiB/s 0 0' 00:05:01.898 22:42:52 -- accel/accel.sh@20 -- # IFS=: 00:05:01.898 22:42:52 -- accel/accel.sh@15 -- # accel_perf -t 1 -w fill -f 128 -q 64 -a 64 -y 00:05:01.898 22:42:52 -- accel/accel.sh@20 -- # read -r var val 00:05:01.898 22:42:52 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w fill -f 128 -q 64 -a 64 -y 00:05:01.898 22:42:52 -- accel/accel.sh@12 -- # build_accel_config 00:05:01.898 22:42:52 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:05:01.898 22:42:52 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:01.898 22:42:52 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:01.898 22:42:52 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:05:01.898 22:42:52 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:05:01.898 22:42:52 -- accel/accel.sh@41 -- # local IFS=, 00:05:01.898 22:42:52 -- accel/accel.sh@42 -- # jq -r . 00:05:01.898 [2024-04-16 22:42:52.712620] Starting SPDK v24.01.1-pre git sha1 4b134b4ab / DPDK 23.11.0 initialization... 00:05:01.898 [2024-04-16 22:42:52.712703] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid163691 ] 00:05:01.898 EAL: No free 2048 kB hugepages reported on node 1 00:05:01.898 [2024-04-16 22:42:52.772610] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:01.898 [2024-04-16 22:42:52.893767] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:01.898 22:42:52 -- accel/accel.sh@21 -- # val= 00:05:01.898 22:42:52 -- accel/accel.sh@22 -- # case "$var" in 00:05:01.898 22:42:52 -- accel/accel.sh@20 -- # IFS=: 00:05:01.898 22:42:52 -- accel/accel.sh@20 -- # read -r var val 00:05:01.898 22:42:52 -- accel/accel.sh@21 -- # val= 00:05:01.898 22:42:52 -- accel/accel.sh@22 -- # case "$var" in 00:05:01.898 22:42:52 -- accel/accel.sh@20 -- # IFS=: 00:05:01.898 22:42:52 -- accel/accel.sh@20 -- # read -r var val 00:05:01.898 22:42:52 -- accel/accel.sh@21 -- # val=0x1 00:05:01.898 22:42:52 -- accel/accel.sh@22 -- # case "$var" in 00:05:01.898 22:42:52 -- accel/accel.sh@20 -- # IFS=: 00:05:01.898 22:42:52 -- accel/accel.sh@20 -- # read -r var val 00:05:01.898 22:42:52 -- accel/accel.sh@21 -- # val= 00:05:01.898 22:42:52 -- accel/accel.sh@22 -- # case "$var" in 00:05:01.898 22:42:52 -- accel/accel.sh@20 -- # IFS=: 00:05:01.898 22:42:52 -- accel/accel.sh@20 -- # read -r var val 00:05:01.898 22:42:52 -- accel/accel.sh@21 -- # val= 00:05:01.898 22:42:52 -- accel/accel.sh@22 -- # case "$var" in 00:05:01.898 22:42:52 -- accel/accel.sh@20 -- # IFS=: 00:05:01.898 22:42:52 -- accel/accel.sh@20 -- # read -r var val 00:05:01.898 22:42:52 -- accel/accel.sh@21 -- # val=fill 00:05:01.898 22:42:52 -- accel/accel.sh@22 -- # case "$var" in 00:05:01.898 22:42:52 -- accel/accel.sh@24 -- # accel_opc=fill 00:05:01.898 22:42:52 -- accel/accel.sh@20 -- # IFS=: 00:05:01.898 22:42:52 -- accel/accel.sh@20 -- # read -r var val 00:05:01.898 22:42:52 -- accel/accel.sh@21 -- # val=0x80 00:05:01.898 22:42:52 -- accel/accel.sh@22 -- # case "$var" in 00:05:01.898 22:42:52 -- accel/accel.sh@20 -- # IFS=: 00:05:01.898 22:42:52 -- accel/accel.sh@20 -- # read -r var val 00:05:01.898 22:42:52 -- accel/accel.sh@21 -- # val='4096 bytes' 00:05:01.898 22:42:52 -- accel/accel.sh@22 -- # case "$var" in 00:05:01.898 22:42:52 -- accel/accel.sh@20 -- # IFS=: 00:05:01.898 22:42:52 -- accel/accel.sh@20 -- # read -r var val 00:05:01.898 22:42:52 -- accel/accel.sh@21 -- # val= 00:05:01.898 22:42:52 -- accel/accel.sh@22 -- # case "$var" in 00:05:01.898 22:42:52 -- accel/accel.sh@20 -- # IFS=: 00:05:01.898 22:42:52 -- accel/accel.sh@20 -- # read -r var val 00:05:01.898 22:42:52 -- accel/accel.sh@21 -- # val=software 00:05:01.898 22:42:52 -- accel/accel.sh@22 -- # case "$var" in 00:05:01.898 22:42:52 -- accel/accel.sh@23 -- # accel_module=software 00:05:01.898 22:42:52 -- accel/accel.sh@20 -- # IFS=: 00:05:01.898 22:42:52 -- accel/accel.sh@20 -- # read -r var val 00:05:01.898 22:42:52 -- accel/accel.sh@21 -- # val=64 00:05:01.898 22:42:52 -- accel/accel.sh@22 -- # case "$var" in 00:05:01.898 22:42:52 -- accel/accel.sh@20 -- # IFS=: 00:05:01.898 22:42:52 -- accel/accel.sh@20 -- # read -r var val 00:05:01.898 22:42:52 -- accel/accel.sh@21 -- # val=64 00:05:01.898 22:42:52 -- accel/accel.sh@22 -- # case "$var" in 00:05:01.898 22:42:52 -- accel/accel.sh@20 -- # IFS=: 00:05:01.898 22:42:52 -- accel/accel.sh@20 -- # read -r var val 00:05:01.898 22:42:52 -- accel/accel.sh@21 -- # val=1 00:05:01.898 22:42:52 -- accel/accel.sh@22 -- # case "$var" in 00:05:01.898 22:42:52 -- accel/accel.sh@20 -- # IFS=: 00:05:01.898 22:42:52 -- accel/accel.sh@20 -- # read -r var val 00:05:01.898 22:42:52 -- accel/accel.sh@21 -- # val='1 seconds' 00:05:01.898 22:42:52 -- accel/accel.sh@22 -- # case "$var" in 00:05:01.898 22:42:52 -- accel/accel.sh@20 -- # IFS=: 00:05:01.898 22:42:52 -- accel/accel.sh@20 -- # read -r var val 00:05:01.898 22:42:52 -- accel/accel.sh@21 -- # val=Yes 00:05:01.898 22:42:52 -- accel/accel.sh@22 -- # case "$var" in 00:05:01.898 22:42:52 -- accel/accel.sh@20 -- # IFS=: 00:05:01.898 22:42:52 -- accel/accel.sh@20 -- # read -r var val 00:05:01.898 22:42:52 -- accel/accel.sh@21 -- # val= 00:05:01.898 22:42:52 -- accel/accel.sh@22 -- # case "$var" in 00:05:01.898 22:42:52 -- accel/accel.sh@20 -- # IFS=: 00:05:01.898 22:42:52 -- accel/accel.sh@20 -- # read -r var val 00:05:01.898 22:42:52 -- accel/accel.sh@21 -- # val= 00:05:01.898 22:42:52 -- accel/accel.sh@22 -- # case "$var" in 00:05:01.898 22:42:52 -- accel/accel.sh@20 -- # IFS=: 00:05:01.898 22:42:52 -- accel/accel.sh@20 -- # read -r var val 00:05:03.277 22:42:54 -- accel/accel.sh@21 -- # val= 00:05:03.277 22:42:54 -- accel/accel.sh@22 -- # case "$var" in 00:05:03.277 22:42:54 -- accel/accel.sh@20 -- # IFS=: 00:05:03.277 22:42:54 -- accel/accel.sh@20 -- # read -r var val 00:05:03.277 22:42:54 -- accel/accel.sh@21 -- # val= 00:05:03.277 22:42:54 -- accel/accel.sh@22 -- # case "$var" in 00:05:03.277 22:42:54 -- accel/accel.sh@20 -- # IFS=: 00:05:03.277 22:42:54 -- accel/accel.sh@20 -- # read -r var val 00:05:03.277 22:42:54 -- accel/accel.sh@21 -- # val= 00:05:03.277 22:42:54 -- accel/accel.sh@22 -- # case "$var" in 00:05:03.277 22:42:54 -- accel/accel.sh@20 -- # IFS=: 00:05:03.277 22:42:54 -- accel/accel.sh@20 -- # read -r var val 00:05:03.277 22:42:54 -- accel/accel.sh@21 -- # val= 00:05:03.277 22:42:54 -- accel/accel.sh@22 -- # case "$var" in 00:05:03.277 22:42:54 -- accel/accel.sh@20 -- # IFS=: 00:05:03.277 22:42:54 -- accel/accel.sh@20 -- # read -r var val 00:05:03.277 22:42:54 -- accel/accel.sh@21 -- # val= 00:05:03.277 22:42:54 -- accel/accel.sh@22 -- # case "$var" in 00:05:03.277 22:42:54 -- accel/accel.sh@20 -- # IFS=: 00:05:03.277 22:42:54 -- accel/accel.sh@20 -- # read -r var val 00:05:03.278 22:42:54 -- accel/accel.sh@21 -- # val= 00:05:03.278 22:42:54 -- accel/accel.sh@22 -- # case "$var" in 00:05:03.278 22:42:54 -- accel/accel.sh@20 -- # IFS=: 00:05:03.278 22:42:54 -- accel/accel.sh@20 -- # read -r var val 00:05:03.278 22:42:54 -- accel/accel.sh@28 -- # [[ -n software ]] 00:05:03.278 22:42:54 -- accel/accel.sh@28 -- # [[ -n fill ]] 00:05:03.278 22:42:54 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:05:03.278 00:05:03.278 real 0m2.951s 00:05:03.278 user 0m2.653s 00:05:03.278 sys 0m0.289s 00:05:03.278 22:42:54 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:05:03.278 22:42:54 -- common/autotest_common.sh@10 -- # set +x 00:05:03.278 ************************************ 00:05:03.278 END TEST accel_fill 00:05:03.278 ************************************ 00:05:03.278 22:42:54 -- accel/accel.sh@97 -- # run_test accel_copy_crc32c accel_test -t 1 -w copy_crc32c -y 00:05:03.278 22:42:54 -- common/autotest_common.sh@1077 -- # '[' 7 -le 1 ']' 00:05:03.278 22:42:54 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:05:03.278 22:42:54 -- common/autotest_common.sh@10 -- # set +x 00:05:03.278 ************************************ 00:05:03.278 START TEST accel_copy_crc32c 00:05:03.278 ************************************ 00:05:03.278 22:42:54 -- common/autotest_common.sh@1104 -- # accel_test -t 1 -w copy_crc32c -y 00:05:03.278 22:42:54 -- accel/accel.sh@16 -- # local accel_opc 00:05:03.278 22:42:54 -- accel/accel.sh@17 -- # local accel_module 00:05:03.278 22:42:54 -- accel/accel.sh@18 -- # accel_perf -t 1 -w copy_crc32c -y 00:05:03.278 22:42:54 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w copy_crc32c -y 00:05:03.278 22:42:54 -- accel/accel.sh@12 -- # build_accel_config 00:05:03.278 22:42:54 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:05:03.278 22:42:54 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:03.278 22:42:54 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:03.278 22:42:54 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:05:03.278 22:42:54 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:05:03.278 22:42:54 -- accel/accel.sh@41 -- # local IFS=, 00:05:03.278 22:42:54 -- accel/accel.sh@42 -- # jq -r . 00:05:03.278 [2024-04-16 22:42:54.225402] Starting SPDK v24.01.1-pre git sha1 4b134b4ab / DPDK 23.11.0 initialization... 00:05:03.278 [2024-04-16 22:42:54.225492] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid163852 ] 00:05:03.278 EAL: No free 2048 kB hugepages reported on node 1 00:05:03.278 [2024-04-16 22:42:54.288743] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:03.543 [2024-04-16 22:42:54.407927] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:04.922 22:42:55 -- accel/accel.sh@18 -- # out=' 00:05:04.922 SPDK Configuration: 00:05:04.922 Core mask: 0x1 00:05:04.922 00:05:04.922 Accel Perf Configuration: 00:05:04.922 Workload Type: copy_crc32c 00:05:04.922 CRC-32C seed: 0 00:05:04.922 Vector size: 4096 bytes 00:05:04.922 Transfer size: 4096 bytes 00:05:04.922 Vector count 1 00:05:04.922 Module: software 00:05:04.922 Queue depth: 32 00:05:04.922 Allocate depth: 32 00:05:04.922 # threads/core: 1 00:05:04.922 Run time: 1 seconds 00:05:04.922 Verify: Yes 00:05:04.922 00:05:04.922 Running for 1 seconds... 00:05:04.922 00:05:04.922 Core,Thread Transfers Bandwidth Failed Miscompares 00:05:04.922 ------------------------------------------------------------------------------------ 00:05:04.922 0,0 218144/s 852 MiB/s 0 0 00:05:04.922 ==================================================================================== 00:05:04.922 Total 218144/s 852 MiB/s 0 0' 00:05:04.922 22:42:55 -- accel/accel.sh@20 -- # IFS=: 00:05:04.922 22:42:55 -- accel/accel.sh@15 -- # accel_perf -t 1 -w copy_crc32c -y 00:05:04.923 22:42:55 -- accel/accel.sh@20 -- # read -r var val 00:05:04.923 22:42:55 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w copy_crc32c -y 00:05:04.923 22:42:55 -- accel/accel.sh@12 -- # build_accel_config 00:05:04.923 22:42:55 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:05:04.923 22:42:55 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:04.923 22:42:55 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:04.923 22:42:55 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:05:04.923 22:42:55 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:05:04.923 22:42:55 -- accel/accel.sh@41 -- # local IFS=, 00:05:04.923 22:42:55 -- accel/accel.sh@42 -- # jq -r . 00:05:04.923 [2024-04-16 22:42:55.707868] Starting SPDK v24.01.1-pre git sha1 4b134b4ab / DPDK 23.11.0 initialization... 00:05:04.923 [2024-04-16 22:42:55.707955] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid164080 ] 00:05:04.923 EAL: No free 2048 kB hugepages reported on node 1 00:05:04.923 [2024-04-16 22:42:55.769382] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:04.923 [2024-04-16 22:42:55.893550] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:04.923 22:42:55 -- accel/accel.sh@21 -- # val= 00:05:04.923 22:42:55 -- accel/accel.sh@22 -- # case "$var" in 00:05:04.923 22:42:55 -- accel/accel.sh@20 -- # IFS=: 00:05:04.923 22:42:55 -- accel/accel.sh@20 -- # read -r var val 00:05:04.923 22:42:55 -- accel/accel.sh@21 -- # val= 00:05:04.923 22:42:55 -- accel/accel.sh@22 -- # case "$var" in 00:05:04.923 22:42:55 -- accel/accel.sh@20 -- # IFS=: 00:05:04.923 22:42:55 -- accel/accel.sh@20 -- # read -r var val 00:05:04.923 22:42:55 -- accel/accel.sh@21 -- # val=0x1 00:05:04.923 22:42:55 -- accel/accel.sh@22 -- # case "$var" in 00:05:04.923 22:42:55 -- accel/accel.sh@20 -- # IFS=: 00:05:04.923 22:42:55 -- accel/accel.sh@20 -- # read -r var val 00:05:04.923 22:42:55 -- accel/accel.sh@21 -- # val= 00:05:04.923 22:42:55 -- accel/accel.sh@22 -- # case "$var" in 00:05:04.923 22:42:55 -- accel/accel.sh@20 -- # IFS=: 00:05:04.923 22:42:55 -- accel/accel.sh@20 -- # read -r var val 00:05:04.923 22:42:55 -- accel/accel.sh@21 -- # val= 00:05:04.923 22:42:55 -- accel/accel.sh@22 -- # case "$var" in 00:05:04.923 22:42:55 -- accel/accel.sh@20 -- # IFS=: 00:05:04.923 22:42:55 -- accel/accel.sh@20 -- # read -r var val 00:05:04.923 22:42:55 -- accel/accel.sh@21 -- # val=copy_crc32c 00:05:04.923 22:42:55 -- accel/accel.sh@22 -- # case "$var" in 00:05:04.923 22:42:55 -- accel/accel.sh@24 -- # accel_opc=copy_crc32c 00:05:04.923 22:42:55 -- accel/accel.sh@20 -- # IFS=: 00:05:04.923 22:42:55 -- accel/accel.sh@20 -- # read -r var val 00:05:04.923 22:42:55 -- accel/accel.sh@21 -- # val=0 00:05:04.923 22:42:55 -- accel/accel.sh@22 -- # case "$var" in 00:05:04.923 22:42:55 -- accel/accel.sh@20 -- # IFS=: 00:05:04.923 22:42:55 -- accel/accel.sh@20 -- # read -r var val 00:05:04.923 22:42:55 -- accel/accel.sh@21 -- # val='4096 bytes' 00:05:04.923 22:42:55 -- accel/accel.sh@22 -- # case "$var" in 00:05:04.923 22:42:55 -- accel/accel.sh@20 -- # IFS=: 00:05:04.923 22:42:55 -- accel/accel.sh@20 -- # read -r var val 00:05:04.923 22:42:55 -- accel/accel.sh@21 -- # val='4096 bytes' 00:05:04.923 22:42:55 -- accel/accel.sh@22 -- # case "$var" in 00:05:04.923 22:42:55 -- accel/accel.sh@20 -- # IFS=: 00:05:04.923 22:42:55 -- accel/accel.sh@20 -- # read -r var val 00:05:04.923 22:42:55 -- accel/accel.sh@21 -- # val= 00:05:04.923 22:42:55 -- accel/accel.sh@22 -- # case "$var" in 00:05:04.923 22:42:55 -- accel/accel.sh@20 -- # IFS=: 00:05:04.923 22:42:55 -- accel/accel.sh@20 -- # read -r var val 00:05:04.923 22:42:55 -- accel/accel.sh@21 -- # val=software 00:05:04.923 22:42:55 -- accel/accel.sh@22 -- # case "$var" in 00:05:04.923 22:42:55 -- accel/accel.sh@23 -- # accel_module=software 00:05:04.923 22:42:55 -- accel/accel.sh@20 -- # IFS=: 00:05:04.923 22:42:55 -- accel/accel.sh@20 -- # read -r var val 00:05:04.923 22:42:55 -- accel/accel.sh@21 -- # val=32 00:05:04.923 22:42:55 -- accel/accel.sh@22 -- # case "$var" in 00:05:04.923 22:42:55 -- accel/accel.sh@20 -- # IFS=: 00:05:04.923 22:42:55 -- accel/accel.sh@20 -- # read -r var val 00:05:04.923 22:42:55 -- accel/accel.sh@21 -- # val=32 00:05:04.923 22:42:55 -- accel/accel.sh@22 -- # case "$var" in 00:05:04.923 22:42:55 -- accel/accel.sh@20 -- # IFS=: 00:05:04.923 22:42:55 -- accel/accel.sh@20 -- # read -r var val 00:05:04.923 22:42:55 -- accel/accel.sh@21 -- # val=1 00:05:04.923 22:42:55 -- accel/accel.sh@22 -- # case "$var" in 00:05:04.923 22:42:55 -- accel/accel.sh@20 -- # IFS=: 00:05:04.923 22:42:55 -- accel/accel.sh@20 -- # read -r var val 00:05:04.923 22:42:55 -- accel/accel.sh@21 -- # val='1 seconds' 00:05:04.923 22:42:55 -- accel/accel.sh@22 -- # case "$var" in 00:05:04.923 22:42:55 -- accel/accel.sh@20 -- # IFS=: 00:05:04.923 22:42:55 -- accel/accel.sh@20 -- # read -r var val 00:05:04.923 22:42:55 -- accel/accel.sh@21 -- # val=Yes 00:05:04.923 22:42:55 -- accel/accel.sh@22 -- # case "$var" in 00:05:04.923 22:42:55 -- accel/accel.sh@20 -- # IFS=: 00:05:04.923 22:42:55 -- accel/accel.sh@20 -- # read -r var val 00:05:04.923 22:42:55 -- accel/accel.sh@21 -- # val= 00:05:04.923 22:42:55 -- accel/accel.sh@22 -- # case "$var" in 00:05:04.923 22:42:55 -- accel/accel.sh@20 -- # IFS=: 00:05:04.923 22:42:55 -- accel/accel.sh@20 -- # read -r var val 00:05:04.923 22:42:55 -- accel/accel.sh@21 -- # val= 00:05:04.923 22:42:55 -- accel/accel.sh@22 -- # case "$var" in 00:05:04.923 22:42:55 -- accel/accel.sh@20 -- # IFS=: 00:05:04.923 22:42:55 -- accel/accel.sh@20 -- # read -r var val 00:05:06.302 22:42:57 -- accel/accel.sh@21 -- # val= 00:05:06.302 22:42:57 -- accel/accel.sh@22 -- # case "$var" in 00:05:06.302 22:42:57 -- accel/accel.sh@20 -- # IFS=: 00:05:06.302 22:42:57 -- accel/accel.sh@20 -- # read -r var val 00:05:06.302 22:42:57 -- accel/accel.sh@21 -- # val= 00:05:06.302 22:42:57 -- accel/accel.sh@22 -- # case "$var" in 00:05:06.302 22:42:57 -- accel/accel.sh@20 -- # IFS=: 00:05:06.302 22:42:57 -- accel/accel.sh@20 -- # read -r var val 00:05:06.302 22:42:57 -- accel/accel.sh@21 -- # val= 00:05:06.302 22:42:57 -- accel/accel.sh@22 -- # case "$var" in 00:05:06.302 22:42:57 -- accel/accel.sh@20 -- # IFS=: 00:05:06.302 22:42:57 -- accel/accel.sh@20 -- # read -r var val 00:05:06.302 22:42:57 -- accel/accel.sh@21 -- # val= 00:05:06.302 22:42:57 -- accel/accel.sh@22 -- # case "$var" in 00:05:06.302 22:42:57 -- accel/accel.sh@20 -- # IFS=: 00:05:06.302 22:42:57 -- accel/accel.sh@20 -- # read -r var val 00:05:06.302 22:42:57 -- accel/accel.sh@21 -- # val= 00:05:06.302 22:42:57 -- accel/accel.sh@22 -- # case "$var" in 00:05:06.302 22:42:57 -- accel/accel.sh@20 -- # IFS=: 00:05:06.302 22:42:57 -- accel/accel.sh@20 -- # read -r var val 00:05:06.302 22:42:57 -- accel/accel.sh@21 -- # val= 00:05:06.302 22:42:57 -- accel/accel.sh@22 -- # case "$var" in 00:05:06.302 22:42:57 -- accel/accel.sh@20 -- # IFS=: 00:05:06.302 22:42:57 -- accel/accel.sh@20 -- # read -r var val 00:05:06.302 22:42:57 -- accel/accel.sh@28 -- # [[ -n software ]] 00:05:06.302 22:42:57 -- accel/accel.sh@28 -- # [[ -n copy_crc32c ]] 00:05:06.302 22:42:57 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:05:06.302 00:05:06.302 real 0m2.958s 00:05:06.302 user 0m2.670s 00:05:06.302 sys 0m0.278s 00:05:06.302 22:42:57 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:05:06.302 22:42:57 -- common/autotest_common.sh@10 -- # set +x 00:05:06.302 ************************************ 00:05:06.302 END TEST accel_copy_crc32c 00:05:06.302 ************************************ 00:05:06.302 22:42:57 -- accel/accel.sh@98 -- # run_test accel_copy_crc32c_C2 accel_test -t 1 -w copy_crc32c -y -C 2 00:05:06.302 22:42:57 -- common/autotest_common.sh@1077 -- # '[' 9 -le 1 ']' 00:05:06.302 22:42:57 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:05:06.303 22:42:57 -- common/autotest_common.sh@10 -- # set +x 00:05:06.303 ************************************ 00:05:06.303 START TEST accel_copy_crc32c_C2 00:05:06.303 ************************************ 00:05:06.303 22:42:57 -- common/autotest_common.sh@1104 -- # accel_test -t 1 -w copy_crc32c -y -C 2 00:05:06.303 22:42:57 -- accel/accel.sh@16 -- # local accel_opc 00:05:06.303 22:42:57 -- accel/accel.sh@17 -- # local accel_module 00:05:06.303 22:42:57 -- accel/accel.sh@18 -- # accel_perf -t 1 -w copy_crc32c -y -C 2 00:05:06.303 22:42:57 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w copy_crc32c -y -C 2 00:05:06.303 22:42:57 -- accel/accel.sh@12 -- # build_accel_config 00:05:06.303 22:42:57 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:05:06.303 22:42:57 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:06.303 22:42:57 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:06.303 22:42:57 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:05:06.303 22:42:57 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:05:06.303 22:42:57 -- accel/accel.sh@41 -- # local IFS=, 00:05:06.303 22:42:57 -- accel/accel.sh@42 -- # jq -r . 00:05:06.303 [2024-04-16 22:42:57.204712] Starting SPDK v24.01.1-pre git sha1 4b134b4ab / DPDK 23.11.0 initialization... 00:05:06.303 [2024-04-16 22:42:57.204793] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid164280 ] 00:05:06.303 EAL: No free 2048 kB hugepages reported on node 1 00:05:06.303 [2024-04-16 22:42:57.265542] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:06.303 [2024-04-16 22:42:57.386277] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:07.683 22:42:58 -- accel/accel.sh@18 -- # out=' 00:05:07.683 SPDK Configuration: 00:05:07.683 Core mask: 0x1 00:05:07.683 00:05:07.683 Accel Perf Configuration: 00:05:07.683 Workload Type: copy_crc32c 00:05:07.683 CRC-32C seed: 0 00:05:07.683 Vector size: 4096 bytes 00:05:07.683 Transfer size: 8192 bytes 00:05:07.683 Vector count 2 00:05:07.683 Module: software 00:05:07.683 Queue depth: 32 00:05:07.683 Allocate depth: 32 00:05:07.683 # threads/core: 1 00:05:07.683 Run time: 1 seconds 00:05:07.683 Verify: Yes 00:05:07.683 00:05:07.683 Running for 1 seconds... 00:05:07.683 00:05:07.683 Core,Thread Transfers Bandwidth Failed Miscompares 00:05:07.683 ------------------------------------------------------------------------------------ 00:05:07.683 0,0 152736/s 1193 MiB/s 0 0 00:05:07.683 ==================================================================================== 00:05:07.683 Total 152736/s 596 MiB/s 0 0' 00:05:07.683 22:42:58 -- accel/accel.sh@20 -- # IFS=: 00:05:07.683 22:42:58 -- accel/accel.sh@15 -- # accel_perf -t 1 -w copy_crc32c -y -C 2 00:05:07.683 22:42:58 -- accel/accel.sh@20 -- # read -r var val 00:05:07.683 22:42:58 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w copy_crc32c -y -C 2 00:05:07.683 22:42:58 -- accel/accel.sh@12 -- # build_accel_config 00:05:07.683 22:42:58 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:05:07.683 22:42:58 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:07.683 22:42:58 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:07.683 22:42:58 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:05:07.683 22:42:58 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:05:07.683 22:42:58 -- accel/accel.sh@41 -- # local IFS=, 00:05:07.683 22:42:58 -- accel/accel.sh@42 -- # jq -r . 00:05:07.683 [2024-04-16 22:42:58.687586] Starting SPDK v24.01.1-pre git sha1 4b134b4ab / DPDK 23.11.0 initialization... 00:05:07.683 [2024-04-16 22:42:58.687672] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid164420 ] 00:05:07.683 EAL: No free 2048 kB hugepages reported on node 1 00:05:07.683 [2024-04-16 22:42:58.752397] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:07.942 [2024-04-16 22:42:58.873251] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:07.942 22:42:58 -- accel/accel.sh@21 -- # val= 00:05:07.942 22:42:58 -- accel/accel.sh@22 -- # case "$var" in 00:05:07.942 22:42:58 -- accel/accel.sh@20 -- # IFS=: 00:05:07.942 22:42:58 -- accel/accel.sh@20 -- # read -r var val 00:05:07.942 22:42:58 -- accel/accel.sh@21 -- # val= 00:05:07.942 22:42:58 -- accel/accel.sh@22 -- # case "$var" in 00:05:07.942 22:42:58 -- accel/accel.sh@20 -- # IFS=: 00:05:07.942 22:42:58 -- accel/accel.sh@20 -- # read -r var val 00:05:07.942 22:42:58 -- accel/accel.sh@21 -- # val=0x1 00:05:07.942 22:42:58 -- accel/accel.sh@22 -- # case "$var" in 00:05:07.942 22:42:58 -- accel/accel.sh@20 -- # IFS=: 00:05:07.942 22:42:58 -- accel/accel.sh@20 -- # read -r var val 00:05:07.942 22:42:58 -- accel/accel.sh@21 -- # val= 00:05:07.942 22:42:58 -- accel/accel.sh@22 -- # case "$var" in 00:05:07.942 22:42:58 -- accel/accel.sh@20 -- # IFS=: 00:05:07.942 22:42:58 -- accel/accel.sh@20 -- # read -r var val 00:05:07.942 22:42:58 -- accel/accel.sh@21 -- # val= 00:05:07.942 22:42:58 -- accel/accel.sh@22 -- # case "$var" in 00:05:07.942 22:42:58 -- accel/accel.sh@20 -- # IFS=: 00:05:07.942 22:42:58 -- accel/accel.sh@20 -- # read -r var val 00:05:07.942 22:42:58 -- accel/accel.sh@21 -- # val=copy_crc32c 00:05:07.942 22:42:58 -- accel/accel.sh@22 -- # case "$var" in 00:05:07.942 22:42:58 -- accel/accel.sh@24 -- # accel_opc=copy_crc32c 00:05:07.942 22:42:58 -- accel/accel.sh@20 -- # IFS=: 00:05:07.942 22:42:58 -- accel/accel.sh@20 -- # read -r var val 00:05:07.942 22:42:58 -- accel/accel.sh@21 -- # val=0 00:05:07.942 22:42:58 -- accel/accel.sh@22 -- # case "$var" in 00:05:07.942 22:42:58 -- accel/accel.sh@20 -- # IFS=: 00:05:07.942 22:42:58 -- accel/accel.sh@20 -- # read -r var val 00:05:07.942 22:42:58 -- accel/accel.sh@21 -- # val='4096 bytes' 00:05:07.942 22:42:58 -- accel/accel.sh@22 -- # case "$var" in 00:05:07.942 22:42:58 -- accel/accel.sh@20 -- # IFS=: 00:05:07.942 22:42:58 -- accel/accel.sh@20 -- # read -r var val 00:05:07.942 22:42:58 -- accel/accel.sh@21 -- # val='8192 bytes' 00:05:07.942 22:42:58 -- accel/accel.sh@22 -- # case "$var" in 00:05:07.942 22:42:58 -- accel/accel.sh@20 -- # IFS=: 00:05:07.942 22:42:58 -- accel/accel.sh@20 -- # read -r var val 00:05:07.942 22:42:58 -- accel/accel.sh@21 -- # val= 00:05:07.942 22:42:58 -- accel/accel.sh@22 -- # case "$var" in 00:05:07.942 22:42:58 -- accel/accel.sh@20 -- # IFS=: 00:05:07.942 22:42:58 -- accel/accel.sh@20 -- # read -r var val 00:05:07.942 22:42:58 -- accel/accel.sh@21 -- # val=software 00:05:07.942 22:42:58 -- accel/accel.sh@22 -- # case "$var" in 00:05:07.942 22:42:58 -- accel/accel.sh@23 -- # accel_module=software 00:05:07.942 22:42:58 -- accel/accel.sh@20 -- # IFS=: 00:05:07.942 22:42:58 -- accel/accel.sh@20 -- # read -r var val 00:05:07.942 22:42:58 -- accel/accel.sh@21 -- # val=32 00:05:07.942 22:42:58 -- accel/accel.sh@22 -- # case "$var" in 00:05:07.942 22:42:58 -- accel/accel.sh@20 -- # IFS=: 00:05:07.942 22:42:58 -- accel/accel.sh@20 -- # read -r var val 00:05:07.942 22:42:58 -- accel/accel.sh@21 -- # val=32 00:05:07.942 22:42:58 -- accel/accel.sh@22 -- # case "$var" in 00:05:07.942 22:42:58 -- accel/accel.sh@20 -- # IFS=: 00:05:07.942 22:42:58 -- accel/accel.sh@20 -- # read -r var val 00:05:07.942 22:42:58 -- accel/accel.sh@21 -- # val=1 00:05:07.942 22:42:58 -- accel/accel.sh@22 -- # case "$var" in 00:05:07.942 22:42:58 -- accel/accel.sh@20 -- # IFS=: 00:05:07.942 22:42:58 -- accel/accel.sh@20 -- # read -r var val 00:05:07.942 22:42:58 -- accel/accel.sh@21 -- # val='1 seconds' 00:05:07.942 22:42:58 -- accel/accel.sh@22 -- # case "$var" in 00:05:07.942 22:42:58 -- accel/accel.sh@20 -- # IFS=: 00:05:07.942 22:42:58 -- accel/accel.sh@20 -- # read -r var val 00:05:07.942 22:42:58 -- accel/accel.sh@21 -- # val=Yes 00:05:07.942 22:42:58 -- accel/accel.sh@22 -- # case "$var" in 00:05:07.942 22:42:58 -- accel/accel.sh@20 -- # IFS=: 00:05:07.942 22:42:58 -- accel/accel.sh@20 -- # read -r var val 00:05:07.942 22:42:58 -- accel/accel.sh@21 -- # val= 00:05:07.942 22:42:58 -- accel/accel.sh@22 -- # case "$var" in 00:05:07.942 22:42:58 -- accel/accel.sh@20 -- # IFS=: 00:05:07.942 22:42:58 -- accel/accel.sh@20 -- # read -r var val 00:05:07.942 22:42:58 -- accel/accel.sh@21 -- # val= 00:05:07.942 22:42:58 -- accel/accel.sh@22 -- # case "$var" in 00:05:07.942 22:42:58 -- accel/accel.sh@20 -- # IFS=: 00:05:07.942 22:42:58 -- accel/accel.sh@20 -- # read -r var val 00:05:09.320 22:43:00 -- accel/accel.sh@21 -- # val= 00:05:09.320 22:43:00 -- accel/accel.sh@22 -- # case "$var" in 00:05:09.320 22:43:00 -- accel/accel.sh@20 -- # IFS=: 00:05:09.320 22:43:00 -- accel/accel.sh@20 -- # read -r var val 00:05:09.320 22:43:00 -- accel/accel.sh@21 -- # val= 00:05:09.320 22:43:00 -- accel/accel.sh@22 -- # case "$var" in 00:05:09.320 22:43:00 -- accel/accel.sh@20 -- # IFS=: 00:05:09.320 22:43:00 -- accel/accel.sh@20 -- # read -r var val 00:05:09.320 22:43:00 -- accel/accel.sh@21 -- # val= 00:05:09.320 22:43:00 -- accel/accel.sh@22 -- # case "$var" in 00:05:09.320 22:43:00 -- accel/accel.sh@20 -- # IFS=: 00:05:09.320 22:43:00 -- accel/accel.sh@20 -- # read -r var val 00:05:09.320 22:43:00 -- accel/accel.sh@21 -- # val= 00:05:09.320 22:43:00 -- accel/accel.sh@22 -- # case "$var" in 00:05:09.320 22:43:00 -- accel/accel.sh@20 -- # IFS=: 00:05:09.320 22:43:00 -- accel/accel.sh@20 -- # read -r var val 00:05:09.320 22:43:00 -- accel/accel.sh@21 -- # val= 00:05:09.320 22:43:00 -- accel/accel.sh@22 -- # case "$var" in 00:05:09.320 22:43:00 -- accel/accel.sh@20 -- # IFS=: 00:05:09.320 22:43:00 -- accel/accel.sh@20 -- # read -r var val 00:05:09.320 22:43:00 -- accel/accel.sh@21 -- # val= 00:05:09.320 22:43:00 -- accel/accel.sh@22 -- # case "$var" in 00:05:09.320 22:43:00 -- accel/accel.sh@20 -- # IFS=: 00:05:09.320 22:43:00 -- accel/accel.sh@20 -- # read -r var val 00:05:09.320 22:43:00 -- accel/accel.sh@28 -- # [[ -n software ]] 00:05:09.320 22:43:00 -- accel/accel.sh@28 -- # [[ -n copy_crc32c ]] 00:05:09.320 22:43:00 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:05:09.320 00:05:09.320 real 0m2.971s 00:05:09.320 user 0m2.671s 00:05:09.320 sys 0m0.291s 00:05:09.320 22:43:00 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:05:09.320 22:43:00 -- common/autotest_common.sh@10 -- # set +x 00:05:09.320 ************************************ 00:05:09.320 END TEST accel_copy_crc32c_C2 00:05:09.320 ************************************ 00:05:09.320 22:43:00 -- accel/accel.sh@99 -- # run_test accel_dualcast accel_test -t 1 -w dualcast -y 00:05:09.320 22:43:00 -- common/autotest_common.sh@1077 -- # '[' 7 -le 1 ']' 00:05:09.320 22:43:00 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:05:09.320 22:43:00 -- common/autotest_common.sh@10 -- # set +x 00:05:09.320 ************************************ 00:05:09.320 START TEST accel_dualcast 00:05:09.320 ************************************ 00:05:09.320 22:43:00 -- common/autotest_common.sh@1104 -- # accel_test -t 1 -w dualcast -y 00:05:09.320 22:43:00 -- accel/accel.sh@16 -- # local accel_opc 00:05:09.320 22:43:00 -- accel/accel.sh@17 -- # local accel_module 00:05:09.320 22:43:00 -- accel/accel.sh@18 -- # accel_perf -t 1 -w dualcast -y 00:05:09.320 22:43:00 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w dualcast -y 00:05:09.320 22:43:00 -- accel/accel.sh@12 -- # build_accel_config 00:05:09.320 22:43:00 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:05:09.320 22:43:00 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:09.320 22:43:00 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:09.320 22:43:00 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:05:09.320 22:43:00 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:05:09.320 22:43:00 -- accel/accel.sh@41 -- # local IFS=, 00:05:09.320 22:43:00 -- accel/accel.sh@42 -- # jq -r . 00:05:09.320 [2024-04-16 22:43:00.202478] Starting SPDK v24.01.1-pre git sha1 4b134b4ab / DPDK 23.11.0 initialization... 00:05:09.320 [2024-04-16 22:43:00.202558] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid164620 ] 00:05:09.320 EAL: No free 2048 kB hugepages reported on node 1 00:05:09.320 [2024-04-16 22:43:00.267343] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:09.320 [2024-04-16 22:43:00.389792] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:10.701 22:43:01 -- accel/accel.sh@18 -- # out=' 00:05:10.701 SPDK Configuration: 00:05:10.701 Core mask: 0x1 00:05:10.701 00:05:10.701 Accel Perf Configuration: 00:05:10.701 Workload Type: dualcast 00:05:10.701 Transfer size: 4096 bytes 00:05:10.701 Vector count 1 00:05:10.701 Module: software 00:05:10.701 Queue depth: 32 00:05:10.701 Allocate depth: 32 00:05:10.701 # threads/core: 1 00:05:10.701 Run time: 1 seconds 00:05:10.701 Verify: Yes 00:05:10.701 00:05:10.701 Running for 1 seconds... 00:05:10.701 00:05:10.701 Core,Thread Transfers Bandwidth Failed Miscompares 00:05:10.701 ------------------------------------------------------------------------------------ 00:05:10.701 0,0 297344/s 1161 MiB/s 0 0 00:05:10.701 ==================================================================================== 00:05:10.701 Total 297344/s 1161 MiB/s 0 0' 00:05:10.701 22:43:01 -- accel/accel.sh@20 -- # IFS=: 00:05:10.701 22:43:01 -- accel/accel.sh@15 -- # accel_perf -t 1 -w dualcast -y 00:05:10.701 22:43:01 -- accel/accel.sh@20 -- # read -r var val 00:05:10.701 22:43:01 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w dualcast -y 00:05:10.701 22:43:01 -- accel/accel.sh@12 -- # build_accel_config 00:05:10.701 22:43:01 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:05:10.701 22:43:01 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:10.701 22:43:01 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:10.701 22:43:01 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:05:10.701 22:43:01 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:05:10.701 22:43:01 -- accel/accel.sh@41 -- # local IFS=, 00:05:10.701 22:43:01 -- accel/accel.sh@42 -- # jq -r . 00:05:10.701 [2024-04-16 22:43:01.685794] Starting SPDK v24.01.1-pre git sha1 4b134b4ab / DPDK 23.11.0 initialization... 00:05:10.701 [2024-04-16 22:43:01.685874] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid164846 ] 00:05:10.701 EAL: No free 2048 kB hugepages reported on node 1 00:05:10.701 [2024-04-16 22:43:01.744548] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:10.961 [2024-04-16 22:43:01.865594] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:10.961 22:43:01 -- accel/accel.sh@21 -- # val= 00:05:10.961 22:43:01 -- accel/accel.sh@22 -- # case "$var" in 00:05:10.961 22:43:01 -- accel/accel.sh@20 -- # IFS=: 00:05:10.961 22:43:01 -- accel/accel.sh@20 -- # read -r var val 00:05:10.961 22:43:01 -- accel/accel.sh@21 -- # val= 00:05:10.961 22:43:01 -- accel/accel.sh@22 -- # case "$var" in 00:05:10.961 22:43:01 -- accel/accel.sh@20 -- # IFS=: 00:05:10.961 22:43:01 -- accel/accel.sh@20 -- # read -r var val 00:05:10.961 22:43:01 -- accel/accel.sh@21 -- # val=0x1 00:05:10.961 22:43:01 -- accel/accel.sh@22 -- # case "$var" in 00:05:10.961 22:43:01 -- accel/accel.sh@20 -- # IFS=: 00:05:10.961 22:43:01 -- accel/accel.sh@20 -- # read -r var val 00:05:10.961 22:43:01 -- accel/accel.sh@21 -- # val= 00:05:10.961 22:43:01 -- accel/accel.sh@22 -- # case "$var" in 00:05:10.961 22:43:01 -- accel/accel.sh@20 -- # IFS=: 00:05:10.961 22:43:01 -- accel/accel.sh@20 -- # read -r var val 00:05:10.961 22:43:01 -- accel/accel.sh@21 -- # val= 00:05:10.961 22:43:01 -- accel/accel.sh@22 -- # case "$var" in 00:05:10.961 22:43:01 -- accel/accel.sh@20 -- # IFS=: 00:05:10.961 22:43:01 -- accel/accel.sh@20 -- # read -r var val 00:05:10.961 22:43:01 -- accel/accel.sh@21 -- # val=dualcast 00:05:10.961 22:43:01 -- accel/accel.sh@22 -- # case "$var" in 00:05:10.961 22:43:01 -- accel/accel.sh@24 -- # accel_opc=dualcast 00:05:10.961 22:43:01 -- accel/accel.sh@20 -- # IFS=: 00:05:10.961 22:43:01 -- accel/accel.sh@20 -- # read -r var val 00:05:10.961 22:43:01 -- accel/accel.sh@21 -- # val='4096 bytes' 00:05:10.961 22:43:01 -- accel/accel.sh@22 -- # case "$var" in 00:05:10.961 22:43:01 -- accel/accel.sh@20 -- # IFS=: 00:05:10.961 22:43:01 -- accel/accel.sh@20 -- # read -r var val 00:05:10.961 22:43:01 -- accel/accel.sh@21 -- # val= 00:05:10.961 22:43:01 -- accel/accel.sh@22 -- # case "$var" in 00:05:10.961 22:43:01 -- accel/accel.sh@20 -- # IFS=: 00:05:10.961 22:43:01 -- accel/accel.sh@20 -- # read -r var val 00:05:10.961 22:43:01 -- accel/accel.sh@21 -- # val=software 00:05:10.961 22:43:01 -- accel/accel.sh@22 -- # case "$var" in 00:05:10.961 22:43:01 -- accel/accel.sh@23 -- # accel_module=software 00:05:10.961 22:43:01 -- accel/accel.sh@20 -- # IFS=: 00:05:10.961 22:43:01 -- accel/accel.sh@20 -- # read -r var val 00:05:10.961 22:43:01 -- accel/accel.sh@21 -- # val=32 00:05:10.961 22:43:01 -- accel/accel.sh@22 -- # case "$var" in 00:05:10.961 22:43:01 -- accel/accel.sh@20 -- # IFS=: 00:05:10.961 22:43:01 -- accel/accel.sh@20 -- # read -r var val 00:05:10.961 22:43:01 -- accel/accel.sh@21 -- # val=32 00:05:10.961 22:43:01 -- accel/accel.sh@22 -- # case "$var" in 00:05:10.961 22:43:01 -- accel/accel.sh@20 -- # IFS=: 00:05:10.961 22:43:01 -- accel/accel.sh@20 -- # read -r var val 00:05:10.961 22:43:01 -- accel/accel.sh@21 -- # val=1 00:05:10.961 22:43:01 -- accel/accel.sh@22 -- # case "$var" in 00:05:10.961 22:43:01 -- accel/accel.sh@20 -- # IFS=: 00:05:10.961 22:43:01 -- accel/accel.sh@20 -- # read -r var val 00:05:10.961 22:43:01 -- accel/accel.sh@21 -- # val='1 seconds' 00:05:10.961 22:43:01 -- accel/accel.sh@22 -- # case "$var" in 00:05:10.961 22:43:01 -- accel/accel.sh@20 -- # IFS=: 00:05:10.961 22:43:01 -- accel/accel.sh@20 -- # read -r var val 00:05:10.961 22:43:01 -- accel/accel.sh@21 -- # val=Yes 00:05:10.961 22:43:01 -- accel/accel.sh@22 -- # case "$var" in 00:05:10.961 22:43:01 -- accel/accel.sh@20 -- # IFS=: 00:05:10.961 22:43:01 -- accel/accel.sh@20 -- # read -r var val 00:05:10.961 22:43:01 -- accel/accel.sh@21 -- # val= 00:05:10.961 22:43:01 -- accel/accel.sh@22 -- # case "$var" in 00:05:10.961 22:43:01 -- accel/accel.sh@20 -- # IFS=: 00:05:10.961 22:43:01 -- accel/accel.sh@20 -- # read -r var val 00:05:10.961 22:43:01 -- accel/accel.sh@21 -- # val= 00:05:10.961 22:43:01 -- accel/accel.sh@22 -- # case "$var" in 00:05:10.961 22:43:01 -- accel/accel.sh@20 -- # IFS=: 00:05:10.961 22:43:01 -- accel/accel.sh@20 -- # read -r var val 00:05:12.343 22:43:03 -- accel/accel.sh@21 -- # val= 00:05:12.344 22:43:03 -- accel/accel.sh@22 -- # case "$var" in 00:05:12.344 22:43:03 -- accel/accel.sh@20 -- # IFS=: 00:05:12.344 22:43:03 -- accel/accel.sh@20 -- # read -r var val 00:05:12.344 22:43:03 -- accel/accel.sh@21 -- # val= 00:05:12.344 22:43:03 -- accel/accel.sh@22 -- # case "$var" in 00:05:12.344 22:43:03 -- accel/accel.sh@20 -- # IFS=: 00:05:12.344 22:43:03 -- accel/accel.sh@20 -- # read -r var val 00:05:12.344 22:43:03 -- accel/accel.sh@21 -- # val= 00:05:12.344 22:43:03 -- accel/accel.sh@22 -- # case "$var" in 00:05:12.344 22:43:03 -- accel/accel.sh@20 -- # IFS=: 00:05:12.344 22:43:03 -- accel/accel.sh@20 -- # read -r var val 00:05:12.344 22:43:03 -- accel/accel.sh@21 -- # val= 00:05:12.344 22:43:03 -- accel/accel.sh@22 -- # case "$var" in 00:05:12.344 22:43:03 -- accel/accel.sh@20 -- # IFS=: 00:05:12.344 22:43:03 -- accel/accel.sh@20 -- # read -r var val 00:05:12.344 22:43:03 -- accel/accel.sh@21 -- # val= 00:05:12.344 22:43:03 -- accel/accel.sh@22 -- # case "$var" in 00:05:12.344 22:43:03 -- accel/accel.sh@20 -- # IFS=: 00:05:12.344 22:43:03 -- accel/accel.sh@20 -- # read -r var val 00:05:12.344 22:43:03 -- accel/accel.sh@21 -- # val= 00:05:12.344 22:43:03 -- accel/accel.sh@22 -- # case "$var" in 00:05:12.344 22:43:03 -- accel/accel.sh@20 -- # IFS=: 00:05:12.344 22:43:03 -- accel/accel.sh@20 -- # read -r var val 00:05:12.344 22:43:03 -- accel/accel.sh@28 -- # [[ -n software ]] 00:05:12.344 22:43:03 -- accel/accel.sh@28 -- # [[ -n dualcast ]] 00:05:12.344 22:43:03 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:05:12.344 00:05:12.344 real 0m2.966s 00:05:12.344 user 0m2.672s 00:05:12.344 sys 0m0.284s 00:05:12.344 22:43:03 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:05:12.344 22:43:03 -- common/autotest_common.sh@10 -- # set +x 00:05:12.344 ************************************ 00:05:12.344 END TEST accel_dualcast 00:05:12.344 ************************************ 00:05:12.344 22:43:03 -- accel/accel.sh@100 -- # run_test accel_compare accel_test -t 1 -w compare -y 00:05:12.344 22:43:03 -- common/autotest_common.sh@1077 -- # '[' 7 -le 1 ']' 00:05:12.344 22:43:03 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:05:12.344 22:43:03 -- common/autotest_common.sh@10 -- # set +x 00:05:12.344 ************************************ 00:05:12.344 START TEST accel_compare 00:05:12.344 ************************************ 00:05:12.344 22:43:03 -- common/autotest_common.sh@1104 -- # accel_test -t 1 -w compare -y 00:05:12.344 22:43:03 -- accel/accel.sh@16 -- # local accel_opc 00:05:12.344 22:43:03 -- accel/accel.sh@17 -- # local accel_module 00:05:12.344 22:43:03 -- accel/accel.sh@18 -- # accel_perf -t 1 -w compare -y 00:05:12.344 22:43:03 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w compare -y 00:05:12.344 22:43:03 -- accel/accel.sh@12 -- # build_accel_config 00:05:12.344 22:43:03 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:05:12.344 22:43:03 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:12.344 22:43:03 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:12.344 22:43:03 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:05:12.344 22:43:03 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:05:12.344 22:43:03 -- accel/accel.sh@41 -- # local IFS=, 00:05:12.344 22:43:03 -- accel/accel.sh@42 -- # jq -r . 00:05:12.344 [2024-04-16 22:43:03.190605] Starting SPDK v24.01.1-pre git sha1 4b134b4ab / DPDK 23.11.0 initialization... 00:05:12.344 [2024-04-16 22:43:03.190684] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid165009 ] 00:05:12.344 EAL: No free 2048 kB hugepages reported on node 1 00:05:12.344 [2024-04-16 22:43:03.254653] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:12.344 [2024-04-16 22:43:03.374903] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:13.737 22:43:04 -- accel/accel.sh@18 -- # out=' 00:05:13.737 SPDK Configuration: 00:05:13.737 Core mask: 0x1 00:05:13.737 00:05:13.737 Accel Perf Configuration: 00:05:13.737 Workload Type: compare 00:05:13.737 Transfer size: 4096 bytes 00:05:13.737 Vector count 1 00:05:13.737 Module: software 00:05:13.737 Queue depth: 32 00:05:13.737 Allocate depth: 32 00:05:13.737 # threads/core: 1 00:05:13.737 Run time: 1 seconds 00:05:13.737 Verify: Yes 00:05:13.737 00:05:13.737 Running for 1 seconds... 00:05:13.737 00:05:13.737 Core,Thread Transfers Bandwidth Failed Miscompares 00:05:13.737 ------------------------------------------------------------------------------------ 00:05:13.737 0,0 395648/s 1545 MiB/s 0 0 00:05:13.737 ==================================================================================== 00:05:13.737 Total 395648/s 1545 MiB/s 0 0' 00:05:13.737 22:43:04 -- accel/accel.sh@20 -- # IFS=: 00:05:13.737 22:43:04 -- accel/accel.sh@15 -- # accel_perf -t 1 -w compare -y 00:05:13.737 22:43:04 -- accel/accel.sh@20 -- # read -r var val 00:05:13.737 22:43:04 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w compare -y 00:05:13.737 22:43:04 -- accel/accel.sh@12 -- # build_accel_config 00:05:13.737 22:43:04 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:05:13.737 22:43:04 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:13.737 22:43:04 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:13.737 22:43:04 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:05:13.737 22:43:04 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:05:13.737 22:43:04 -- accel/accel.sh@41 -- # local IFS=, 00:05:13.737 22:43:04 -- accel/accel.sh@42 -- # jq -r . 00:05:13.737 [2024-04-16 22:43:04.674870] Starting SPDK v24.01.1-pre git sha1 4b134b4ab / DPDK 23.11.0 initialization... 00:05:13.737 [2024-04-16 22:43:04.674953] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid165147 ] 00:05:13.737 EAL: No free 2048 kB hugepages reported on node 1 00:05:13.737 [2024-04-16 22:43:04.740640] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:13.737 [2024-04-16 22:43:04.859517] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:13.995 22:43:04 -- accel/accel.sh@21 -- # val= 00:05:13.995 22:43:04 -- accel/accel.sh@22 -- # case "$var" in 00:05:13.995 22:43:04 -- accel/accel.sh@20 -- # IFS=: 00:05:13.995 22:43:04 -- accel/accel.sh@20 -- # read -r var val 00:05:13.995 22:43:04 -- accel/accel.sh@21 -- # val= 00:05:13.995 22:43:04 -- accel/accel.sh@22 -- # case "$var" in 00:05:13.995 22:43:04 -- accel/accel.sh@20 -- # IFS=: 00:05:13.995 22:43:04 -- accel/accel.sh@20 -- # read -r var val 00:05:13.995 22:43:04 -- accel/accel.sh@21 -- # val=0x1 00:05:13.995 22:43:04 -- accel/accel.sh@22 -- # case "$var" in 00:05:13.995 22:43:04 -- accel/accel.sh@20 -- # IFS=: 00:05:13.995 22:43:04 -- accel/accel.sh@20 -- # read -r var val 00:05:13.995 22:43:04 -- accel/accel.sh@21 -- # val= 00:05:13.995 22:43:04 -- accel/accel.sh@22 -- # case "$var" in 00:05:13.995 22:43:04 -- accel/accel.sh@20 -- # IFS=: 00:05:13.995 22:43:04 -- accel/accel.sh@20 -- # read -r var val 00:05:13.995 22:43:04 -- accel/accel.sh@21 -- # val= 00:05:13.995 22:43:04 -- accel/accel.sh@22 -- # case "$var" in 00:05:13.995 22:43:04 -- accel/accel.sh@20 -- # IFS=: 00:05:13.995 22:43:04 -- accel/accel.sh@20 -- # read -r var val 00:05:13.995 22:43:04 -- accel/accel.sh@21 -- # val=compare 00:05:13.995 22:43:04 -- accel/accel.sh@22 -- # case "$var" in 00:05:13.995 22:43:04 -- accel/accel.sh@24 -- # accel_opc=compare 00:05:13.995 22:43:04 -- accel/accel.sh@20 -- # IFS=: 00:05:13.995 22:43:04 -- accel/accel.sh@20 -- # read -r var val 00:05:13.995 22:43:04 -- accel/accel.sh@21 -- # val='4096 bytes' 00:05:13.995 22:43:04 -- accel/accel.sh@22 -- # case "$var" in 00:05:13.995 22:43:04 -- accel/accel.sh@20 -- # IFS=: 00:05:13.995 22:43:04 -- accel/accel.sh@20 -- # read -r var val 00:05:13.995 22:43:04 -- accel/accel.sh@21 -- # val= 00:05:13.995 22:43:04 -- accel/accel.sh@22 -- # case "$var" in 00:05:13.995 22:43:04 -- accel/accel.sh@20 -- # IFS=: 00:05:13.995 22:43:04 -- accel/accel.sh@20 -- # read -r var val 00:05:13.995 22:43:04 -- accel/accel.sh@21 -- # val=software 00:05:13.995 22:43:04 -- accel/accel.sh@22 -- # case "$var" in 00:05:13.995 22:43:04 -- accel/accel.sh@23 -- # accel_module=software 00:05:13.995 22:43:04 -- accel/accel.sh@20 -- # IFS=: 00:05:13.995 22:43:04 -- accel/accel.sh@20 -- # read -r var val 00:05:13.995 22:43:04 -- accel/accel.sh@21 -- # val=32 00:05:13.995 22:43:04 -- accel/accel.sh@22 -- # case "$var" in 00:05:13.995 22:43:04 -- accel/accel.sh@20 -- # IFS=: 00:05:13.995 22:43:04 -- accel/accel.sh@20 -- # read -r var val 00:05:13.995 22:43:04 -- accel/accel.sh@21 -- # val=32 00:05:13.995 22:43:04 -- accel/accel.sh@22 -- # case "$var" in 00:05:13.995 22:43:04 -- accel/accel.sh@20 -- # IFS=: 00:05:13.995 22:43:04 -- accel/accel.sh@20 -- # read -r var val 00:05:13.995 22:43:04 -- accel/accel.sh@21 -- # val=1 00:05:13.995 22:43:04 -- accel/accel.sh@22 -- # case "$var" in 00:05:13.995 22:43:04 -- accel/accel.sh@20 -- # IFS=: 00:05:13.995 22:43:04 -- accel/accel.sh@20 -- # read -r var val 00:05:13.995 22:43:04 -- accel/accel.sh@21 -- # val='1 seconds' 00:05:13.995 22:43:04 -- accel/accel.sh@22 -- # case "$var" in 00:05:13.995 22:43:04 -- accel/accel.sh@20 -- # IFS=: 00:05:13.995 22:43:04 -- accel/accel.sh@20 -- # read -r var val 00:05:13.995 22:43:04 -- accel/accel.sh@21 -- # val=Yes 00:05:13.995 22:43:04 -- accel/accel.sh@22 -- # case "$var" in 00:05:13.995 22:43:04 -- accel/accel.sh@20 -- # IFS=: 00:05:13.995 22:43:04 -- accel/accel.sh@20 -- # read -r var val 00:05:13.995 22:43:04 -- accel/accel.sh@21 -- # val= 00:05:13.995 22:43:04 -- accel/accel.sh@22 -- # case "$var" in 00:05:13.995 22:43:04 -- accel/accel.sh@20 -- # IFS=: 00:05:13.995 22:43:04 -- accel/accel.sh@20 -- # read -r var val 00:05:13.995 22:43:04 -- accel/accel.sh@21 -- # val= 00:05:13.995 22:43:04 -- accel/accel.sh@22 -- # case "$var" in 00:05:13.995 22:43:04 -- accel/accel.sh@20 -- # IFS=: 00:05:13.995 22:43:04 -- accel/accel.sh@20 -- # read -r var val 00:05:15.376 22:43:06 -- accel/accel.sh@21 -- # val= 00:05:15.376 22:43:06 -- accel/accel.sh@22 -- # case "$var" in 00:05:15.376 22:43:06 -- accel/accel.sh@20 -- # IFS=: 00:05:15.376 22:43:06 -- accel/accel.sh@20 -- # read -r var val 00:05:15.376 22:43:06 -- accel/accel.sh@21 -- # val= 00:05:15.376 22:43:06 -- accel/accel.sh@22 -- # case "$var" in 00:05:15.376 22:43:06 -- accel/accel.sh@20 -- # IFS=: 00:05:15.376 22:43:06 -- accel/accel.sh@20 -- # read -r var val 00:05:15.376 22:43:06 -- accel/accel.sh@21 -- # val= 00:05:15.376 22:43:06 -- accel/accel.sh@22 -- # case "$var" in 00:05:15.376 22:43:06 -- accel/accel.sh@20 -- # IFS=: 00:05:15.376 22:43:06 -- accel/accel.sh@20 -- # read -r var val 00:05:15.376 22:43:06 -- accel/accel.sh@21 -- # val= 00:05:15.376 22:43:06 -- accel/accel.sh@22 -- # case "$var" in 00:05:15.376 22:43:06 -- accel/accel.sh@20 -- # IFS=: 00:05:15.376 22:43:06 -- accel/accel.sh@20 -- # read -r var val 00:05:15.376 22:43:06 -- accel/accel.sh@21 -- # val= 00:05:15.376 22:43:06 -- accel/accel.sh@22 -- # case "$var" in 00:05:15.376 22:43:06 -- accel/accel.sh@20 -- # IFS=: 00:05:15.376 22:43:06 -- accel/accel.sh@20 -- # read -r var val 00:05:15.376 22:43:06 -- accel/accel.sh@21 -- # val= 00:05:15.376 22:43:06 -- accel/accel.sh@22 -- # case "$var" in 00:05:15.376 22:43:06 -- accel/accel.sh@20 -- # IFS=: 00:05:15.376 22:43:06 -- accel/accel.sh@20 -- # read -r var val 00:05:15.376 22:43:06 -- accel/accel.sh@28 -- # [[ -n software ]] 00:05:15.376 22:43:06 -- accel/accel.sh@28 -- # [[ -n compare ]] 00:05:15.376 22:43:06 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:05:15.376 00:05:15.376 real 0m2.969s 00:05:15.376 user 0m2.671s 00:05:15.376 sys 0m0.288s 00:05:15.376 22:43:06 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:05:15.376 22:43:06 -- common/autotest_common.sh@10 -- # set +x 00:05:15.376 ************************************ 00:05:15.376 END TEST accel_compare 00:05:15.376 ************************************ 00:05:15.376 22:43:06 -- accel/accel.sh@101 -- # run_test accel_xor accel_test -t 1 -w xor -y 00:05:15.376 22:43:06 -- common/autotest_common.sh@1077 -- # '[' 7 -le 1 ']' 00:05:15.376 22:43:06 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:05:15.376 22:43:06 -- common/autotest_common.sh@10 -- # set +x 00:05:15.376 ************************************ 00:05:15.376 START TEST accel_xor 00:05:15.376 ************************************ 00:05:15.376 22:43:06 -- common/autotest_common.sh@1104 -- # accel_test -t 1 -w xor -y 00:05:15.376 22:43:06 -- accel/accel.sh@16 -- # local accel_opc 00:05:15.376 22:43:06 -- accel/accel.sh@17 -- # local accel_module 00:05:15.377 22:43:06 -- accel/accel.sh@18 -- # accel_perf -t 1 -w xor -y 00:05:15.377 22:43:06 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w xor -y 00:05:15.377 22:43:06 -- accel/accel.sh@12 -- # build_accel_config 00:05:15.377 22:43:06 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:05:15.377 22:43:06 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:15.377 22:43:06 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:15.377 22:43:06 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:05:15.377 22:43:06 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:05:15.377 22:43:06 -- accel/accel.sh@41 -- # local IFS=, 00:05:15.377 22:43:06 -- accel/accel.sh@42 -- # jq -r . 00:05:15.377 [2024-04-16 22:43:06.183637] Starting SPDK v24.01.1-pre git sha1 4b134b4ab / DPDK 23.11.0 initialization... 00:05:15.377 [2024-04-16 22:43:06.183714] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid165429 ] 00:05:15.377 EAL: No free 2048 kB hugepages reported on node 1 00:05:15.377 [2024-04-16 22:43:06.245900] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:15.377 [2024-04-16 22:43:06.376023] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:16.755 22:43:07 -- accel/accel.sh@18 -- # out=' 00:05:16.755 SPDK Configuration: 00:05:16.755 Core mask: 0x1 00:05:16.755 00:05:16.755 Accel Perf Configuration: 00:05:16.755 Workload Type: xor 00:05:16.755 Source buffers: 2 00:05:16.755 Transfer size: 4096 bytes 00:05:16.755 Vector count 1 00:05:16.755 Module: software 00:05:16.755 Queue depth: 32 00:05:16.755 Allocate depth: 32 00:05:16.755 # threads/core: 1 00:05:16.755 Run time: 1 seconds 00:05:16.755 Verify: Yes 00:05:16.755 00:05:16.755 Running for 1 seconds... 00:05:16.755 00:05:16.755 Core,Thread Transfers Bandwidth Failed Miscompares 00:05:16.755 ------------------------------------------------------------------------------------ 00:05:16.755 0,0 192544/s 752 MiB/s 0 0 00:05:16.755 ==================================================================================== 00:05:16.755 Total 192544/s 752 MiB/s 0 0' 00:05:16.755 22:43:07 -- accel/accel.sh@20 -- # IFS=: 00:05:16.755 22:43:07 -- accel/accel.sh@20 -- # read -r var val 00:05:16.755 22:43:07 -- accel/accel.sh@15 -- # accel_perf -t 1 -w xor -y 00:05:16.755 22:43:07 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w xor -y 00:05:16.755 22:43:07 -- accel/accel.sh@12 -- # build_accel_config 00:05:16.755 22:43:07 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:05:16.755 22:43:07 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:16.755 22:43:07 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:16.755 22:43:07 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:05:16.755 22:43:07 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:05:16.756 22:43:07 -- accel/accel.sh@41 -- # local IFS=, 00:05:16.756 22:43:07 -- accel/accel.sh@42 -- # jq -r . 00:05:16.756 [2024-04-16 22:43:07.665666] Starting SPDK v24.01.1-pre git sha1 4b134b4ab / DPDK 23.11.0 initialization... 00:05:16.756 [2024-04-16 22:43:07.665749] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid165575 ] 00:05:16.756 EAL: No free 2048 kB hugepages reported on node 1 00:05:16.756 [2024-04-16 22:43:07.725265] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:16.756 [2024-04-16 22:43:07.845797] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:17.014 22:43:07 -- accel/accel.sh@21 -- # val= 00:05:17.014 22:43:07 -- accel/accel.sh@22 -- # case "$var" in 00:05:17.015 22:43:07 -- accel/accel.sh@20 -- # IFS=: 00:05:17.015 22:43:07 -- accel/accel.sh@20 -- # read -r var val 00:05:17.015 22:43:07 -- accel/accel.sh@21 -- # val= 00:05:17.015 22:43:07 -- accel/accel.sh@22 -- # case "$var" in 00:05:17.015 22:43:07 -- accel/accel.sh@20 -- # IFS=: 00:05:17.015 22:43:07 -- accel/accel.sh@20 -- # read -r var val 00:05:17.015 22:43:07 -- accel/accel.sh@21 -- # val=0x1 00:05:17.015 22:43:07 -- accel/accel.sh@22 -- # case "$var" in 00:05:17.015 22:43:07 -- accel/accel.sh@20 -- # IFS=: 00:05:17.015 22:43:07 -- accel/accel.sh@20 -- # read -r var val 00:05:17.015 22:43:07 -- accel/accel.sh@21 -- # val= 00:05:17.015 22:43:07 -- accel/accel.sh@22 -- # case "$var" in 00:05:17.015 22:43:07 -- accel/accel.sh@20 -- # IFS=: 00:05:17.015 22:43:07 -- accel/accel.sh@20 -- # read -r var val 00:05:17.015 22:43:07 -- accel/accel.sh@21 -- # val= 00:05:17.015 22:43:07 -- accel/accel.sh@22 -- # case "$var" in 00:05:17.015 22:43:07 -- accel/accel.sh@20 -- # IFS=: 00:05:17.015 22:43:07 -- accel/accel.sh@20 -- # read -r var val 00:05:17.015 22:43:07 -- accel/accel.sh@21 -- # val=xor 00:05:17.015 22:43:07 -- accel/accel.sh@22 -- # case "$var" in 00:05:17.015 22:43:07 -- accel/accel.sh@24 -- # accel_opc=xor 00:05:17.015 22:43:07 -- accel/accel.sh@20 -- # IFS=: 00:05:17.015 22:43:07 -- accel/accel.sh@20 -- # read -r var val 00:05:17.015 22:43:07 -- accel/accel.sh@21 -- # val=2 00:05:17.015 22:43:07 -- accel/accel.sh@22 -- # case "$var" in 00:05:17.015 22:43:07 -- accel/accel.sh@20 -- # IFS=: 00:05:17.015 22:43:07 -- accel/accel.sh@20 -- # read -r var val 00:05:17.015 22:43:07 -- accel/accel.sh@21 -- # val='4096 bytes' 00:05:17.015 22:43:07 -- accel/accel.sh@22 -- # case "$var" in 00:05:17.015 22:43:07 -- accel/accel.sh@20 -- # IFS=: 00:05:17.015 22:43:07 -- accel/accel.sh@20 -- # read -r var val 00:05:17.015 22:43:07 -- accel/accel.sh@21 -- # val= 00:05:17.015 22:43:07 -- accel/accel.sh@22 -- # case "$var" in 00:05:17.015 22:43:07 -- accel/accel.sh@20 -- # IFS=: 00:05:17.015 22:43:07 -- accel/accel.sh@20 -- # read -r var val 00:05:17.015 22:43:07 -- accel/accel.sh@21 -- # val=software 00:05:17.015 22:43:07 -- accel/accel.sh@22 -- # case "$var" in 00:05:17.015 22:43:07 -- accel/accel.sh@23 -- # accel_module=software 00:05:17.015 22:43:07 -- accel/accel.sh@20 -- # IFS=: 00:05:17.015 22:43:07 -- accel/accel.sh@20 -- # read -r var val 00:05:17.015 22:43:07 -- accel/accel.sh@21 -- # val=32 00:05:17.015 22:43:07 -- accel/accel.sh@22 -- # case "$var" in 00:05:17.015 22:43:07 -- accel/accel.sh@20 -- # IFS=: 00:05:17.015 22:43:07 -- accel/accel.sh@20 -- # read -r var val 00:05:17.015 22:43:07 -- accel/accel.sh@21 -- # val=32 00:05:17.015 22:43:07 -- accel/accel.sh@22 -- # case "$var" in 00:05:17.015 22:43:07 -- accel/accel.sh@20 -- # IFS=: 00:05:17.015 22:43:07 -- accel/accel.sh@20 -- # read -r var val 00:05:17.015 22:43:07 -- accel/accel.sh@21 -- # val=1 00:05:17.015 22:43:07 -- accel/accel.sh@22 -- # case "$var" in 00:05:17.015 22:43:07 -- accel/accel.sh@20 -- # IFS=: 00:05:17.015 22:43:07 -- accel/accel.sh@20 -- # read -r var val 00:05:17.015 22:43:07 -- accel/accel.sh@21 -- # val='1 seconds' 00:05:17.015 22:43:07 -- accel/accel.sh@22 -- # case "$var" in 00:05:17.015 22:43:07 -- accel/accel.sh@20 -- # IFS=: 00:05:17.015 22:43:07 -- accel/accel.sh@20 -- # read -r var val 00:05:17.015 22:43:07 -- accel/accel.sh@21 -- # val=Yes 00:05:17.015 22:43:07 -- accel/accel.sh@22 -- # case "$var" in 00:05:17.015 22:43:07 -- accel/accel.sh@20 -- # IFS=: 00:05:17.015 22:43:07 -- accel/accel.sh@20 -- # read -r var val 00:05:17.015 22:43:07 -- accel/accel.sh@21 -- # val= 00:05:17.015 22:43:07 -- accel/accel.sh@22 -- # case "$var" in 00:05:17.015 22:43:07 -- accel/accel.sh@20 -- # IFS=: 00:05:17.015 22:43:07 -- accel/accel.sh@20 -- # read -r var val 00:05:17.015 22:43:07 -- accel/accel.sh@21 -- # val= 00:05:17.015 22:43:07 -- accel/accel.sh@22 -- # case "$var" in 00:05:17.015 22:43:07 -- accel/accel.sh@20 -- # IFS=: 00:05:17.015 22:43:07 -- accel/accel.sh@20 -- # read -r var val 00:05:18.394 22:43:09 -- accel/accel.sh@21 -- # val= 00:05:18.394 22:43:09 -- accel/accel.sh@22 -- # case "$var" in 00:05:18.394 22:43:09 -- accel/accel.sh@20 -- # IFS=: 00:05:18.394 22:43:09 -- accel/accel.sh@20 -- # read -r var val 00:05:18.394 22:43:09 -- accel/accel.sh@21 -- # val= 00:05:18.394 22:43:09 -- accel/accel.sh@22 -- # case "$var" in 00:05:18.394 22:43:09 -- accel/accel.sh@20 -- # IFS=: 00:05:18.394 22:43:09 -- accel/accel.sh@20 -- # read -r var val 00:05:18.394 22:43:09 -- accel/accel.sh@21 -- # val= 00:05:18.394 22:43:09 -- accel/accel.sh@22 -- # case "$var" in 00:05:18.394 22:43:09 -- accel/accel.sh@20 -- # IFS=: 00:05:18.394 22:43:09 -- accel/accel.sh@20 -- # read -r var val 00:05:18.394 22:43:09 -- accel/accel.sh@21 -- # val= 00:05:18.394 22:43:09 -- accel/accel.sh@22 -- # case "$var" in 00:05:18.394 22:43:09 -- accel/accel.sh@20 -- # IFS=: 00:05:18.394 22:43:09 -- accel/accel.sh@20 -- # read -r var val 00:05:18.394 22:43:09 -- accel/accel.sh@21 -- # val= 00:05:18.394 22:43:09 -- accel/accel.sh@22 -- # case "$var" in 00:05:18.394 22:43:09 -- accel/accel.sh@20 -- # IFS=: 00:05:18.394 22:43:09 -- accel/accel.sh@20 -- # read -r var val 00:05:18.394 22:43:09 -- accel/accel.sh@21 -- # val= 00:05:18.394 22:43:09 -- accel/accel.sh@22 -- # case "$var" in 00:05:18.394 22:43:09 -- accel/accel.sh@20 -- # IFS=: 00:05:18.394 22:43:09 -- accel/accel.sh@20 -- # read -r var val 00:05:18.394 22:43:09 -- accel/accel.sh@28 -- # [[ -n software ]] 00:05:18.394 22:43:09 -- accel/accel.sh@28 -- # [[ -n xor ]] 00:05:18.394 22:43:09 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:05:18.394 00:05:18.394 real 0m2.964s 00:05:18.394 user 0m2.667s 00:05:18.394 sys 0m0.288s 00:05:18.394 22:43:09 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:05:18.394 22:43:09 -- common/autotest_common.sh@10 -- # set +x 00:05:18.394 ************************************ 00:05:18.394 END TEST accel_xor 00:05:18.394 ************************************ 00:05:18.394 22:43:09 -- accel/accel.sh@102 -- # run_test accel_xor accel_test -t 1 -w xor -y -x 3 00:05:18.394 22:43:09 -- common/autotest_common.sh@1077 -- # '[' 9 -le 1 ']' 00:05:18.394 22:43:09 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:05:18.394 22:43:09 -- common/autotest_common.sh@10 -- # set +x 00:05:18.394 ************************************ 00:05:18.394 START TEST accel_xor 00:05:18.394 ************************************ 00:05:18.394 22:43:09 -- common/autotest_common.sh@1104 -- # accel_test -t 1 -w xor -y -x 3 00:05:18.394 22:43:09 -- accel/accel.sh@16 -- # local accel_opc 00:05:18.394 22:43:09 -- accel/accel.sh@17 -- # local accel_module 00:05:18.394 22:43:09 -- accel/accel.sh@18 -- # accel_perf -t 1 -w xor -y -x 3 00:05:18.394 22:43:09 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w xor -y -x 3 00:05:18.394 22:43:09 -- accel/accel.sh@12 -- # build_accel_config 00:05:18.394 22:43:09 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:05:18.394 22:43:09 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:18.394 22:43:09 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:18.394 22:43:09 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:05:18.394 22:43:09 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:05:18.394 22:43:09 -- accel/accel.sh@41 -- # local IFS=, 00:05:18.394 22:43:09 -- accel/accel.sh@42 -- # jq -r . 00:05:18.394 [2024-04-16 22:43:09.174836] Starting SPDK v24.01.1-pre git sha1 4b134b4ab / DPDK 23.11.0 initialization... 00:05:18.394 [2024-04-16 22:43:09.174914] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid165737 ] 00:05:18.394 EAL: No free 2048 kB hugepages reported on node 1 00:05:18.394 [2024-04-16 22:43:09.235686] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:18.394 [2024-04-16 22:43:09.357304] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:19.813 22:43:10 -- accel/accel.sh@18 -- # out=' 00:05:19.813 SPDK Configuration: 00:05:19.813 Core mask: 0x1 00:05:19.813 00:05:19.813 Accel Perf Configuration: 00:05:19.813 Workload Type: xor 00:05:19.813 Source buffers: 3 00:05:19.813 Transfer size: 4096 bytes 00:05:19.813 Vector count 1 00:05:19.813 Module: software 00:05:19.813 Queue depth: 32 00:05:19.813 Allocate depth: 32 00:05:19.813 # threads/core: 1 00:05:19.813 Run time: 1 seconds 00:05:19.813 Verify: Yes 00:05:19.813 00:05:19.813 Running for 1 seconds... 00:05:19.813 00:05:19.813 Core,Thread Transfers Bandwidth Failed Miscompares 00:05:19.813 ------------------------------------------------------------------------------------ 00:05:19.813 0,0 182016/s 711 MiB/s 0 0 00:05:19.813 ==================================================================================== 00:05:19.813 Total 182016/s 711 MiB/s 0 0' 00:05:19.813 22:43:10 -- accel/accel.sh@20 -- # IFS=: 00:05:19.813 22:43:10 -- accel/accel.sh@15 -- # accel_perf -t 1 -w xor -y -x 3 00:05:19.813 22:43:10 -- accel/accel.sh@20 -- # read -r var val 00:05:19.813 22:43:10 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w xor -y -x 3 00:05:19.813 22:43:10 -- accel/accel.sh@12 -- # build_accel_config 00:05:19.813 22:43:10 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:05:19.813 22:43:10 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:19.813 22:43:10 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:19.813 22:43:10 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:05:19.813 22:43:10 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:05:19.813 22:43:10 -- accel/accel.sh@41 -- # local IFS=, 00:05:19.813 22:43:10 -- accel/accel.sh@42 -- # jq -r . 00:05:19.813 [2024-04-16 22:43:10.652715] Starting SPDK v24.01.1-pre git sha1 4b134b4ab / DPDK 23.11.0 initialization... 00:05:19.813 [2024-04-16 22:43:10.652798] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid165994 ] 00:05:19.813 EAL: No free 2048 kB hugepages reported on node 1 00:05:19.813 [2024-04-16 22:43:10.714184] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:19.813 [2024-04-16 22:43:10.833396] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:19.813 22:43:10 -- accel/accel.sh@21 -- # val= 00:05:19.813 22:43:10 -- accel/accel.sh@22 -- # case "$var" in 00:05:19.813 22:43:10 -- accel/accel.sh@20 -- # IFS=: 00:05:19.813 22:43:10 -- accel/accel.sh@20 -- # read -r var val 00:05:19.813 22:43:10 -- accel/accel.sh@21 -- # val= 00:05:19.813 22:43:10 -- accel/accel.sh@22 -- # case "$var" in 00:05:19.813 22:43:10 -- accel/accel.sh@20 -- # IFS=: 00:05:19.813 22:43:10 -- accel/accel.sh@20 -- # read -r var val 00:05:19.813 22:43:10 -- accel/accel.sh@21 -- # val=0x1 00:05:19.813 22:43:10 -- accel/accel.sh@22 -- # case "$var" in 00:05:19.813 22:43:10 -- accel/accel.sh@20 -- # IFS=: 00:05:19.813 22:43:10 -- accel/accel.sh@20 -- # read -r var val 00:05:19.813 22:43:10 -- accel/accel.sh@21 -- # val= 00:05:19.813 22:43:10 -- accel/accel.sh@22 -- # case "$var" in 00:05:19.813 22:43:10 -- accel/accel.sh@20 -- # IFS=: 00:05:19.813 22:43:10 -- accel/accel.sh@20 -- # read -r var val 00:05:19.813 22:43:10 -- accel/accel.sh@21 -- # val= 00:05:19.813 22:43:10 -- accel/accel.sh@22 -- # case "$var" in 00:05:19.813 22:43:10 -- accel/accel.sh@20 -- # IFS=: 00:05:19.813 22:43:10 -- accel/accel.sh@20 -- # read -r var val 00:05:19.813 22:43:10 -- accel/accel.sh@21 -- # val=xor 00:05:19.813 22:43:10 -- accel/accel.sh@22 -- # case "$var" in 00:05:19.813 22:43:10 -- accel/accel.sh@24 -- # accel_opc=xor 00:05:19.813 22:43:10 -- accel/accel.sh@20 -- # IFS=: 00:05:19.813 22:43:10 -- accel/accel.sh@20 -- # read -r var val 00:05:19.813 22:43:10 -- accel/accel.sh@21 -- # val=3 00:05:19.813 22:43:10 -- accel/accel.sh@22 -- # case "$var" in 00:05:19.813 22:43:10 -- accel/accel.sh@20 -- # IFS=: 00:05:19.813 22:43:10 -- accel/accel.sh@20 -- # read -r var val 00:05:19.813 22:43:10 -- accel/accel.sh@21 -- # val='4096 bytes' 00:05:19.813 22:43:10 -- accel/accel.sh@22 -- # case "$var" in 00:05:19.813 22:43:10 -- accel/accel.sh@20 -- # IFS=: 00:05:19.813 22:43:10 -- accel/accel.sh@20 -- # read -r var val 00:05:19.813 22:43:10 -- accel/accel.sh@21 -- # val= 00:05:19.813 22:43:10 -- accel/accel.sh@22 -- # case "$var" in 00:05:19.813 22:43:10 -- accel/accel.sh@20 -- # IFS=: 00:05:19.813 22:43:10 -- accel/accel.sh@20 -- # read -r var val 00:05:19.813 22:43:10 -- accel/accel.sh@21 -- # val=software 00:05:19.813 22:43:10 -- accel/accel.sh@22 -- # case "$var" in 00:05:19.813 22:43:10 -- accel/accel.sh@23 -- # accel_module=software 00:05:19.813 22:43:10 -- accel/accel.sh@20 -- # IFS=: 00:05:19.813 22:43:10 -- accel/accel.sh@20 -- # read -r var val 00:05:19.813 22:43:10 -- accel/accel.sh@21 -- # val=32 00:05:19.813 22:43:10 -- accel/accel.sh@22 -- # case "$var" in 00:05:19.813 22:43:10 -- accel/accel.sh@20 -- # IFS=: 00:05:19.813 22:43:10 -- accel/accel.sh@20 -- # read -r var val 00:05:19.813 22:43:10 -- accel/accel.sh@21 -- # val=32 00:05:19.813 22:43:10 -- accel/accel.sh@22 -- # case "$var" in 00:05:19.813 22:43:10 -- accel/accel.sh@20 -- # IFS=: 00:05:19.813 22:43:10 -- accel/accel.sh@20 -- # read -r var val 00:05:19.813 22:43:10 -- accel/accel.sh@21 -- # val=1 00:05:19.813 22:43:10 -- accel/accel.sh@22 -- # case "$var" in 00:05:19.813 22:43:10 -- accel/accel.sh@20 -- # IFS=: 00:05:19.813 22:43:10 -- accel/accel.sh@20 -- # read -r var val 00:05:19.813 22:43:10 -- accel/accel.sh@21 -- # val='1 seconds' 00:05:19.813 22:43:10 -- accel/accel.sh@22 -- # case "$var" in 00:05:19.813 22:43:10 -- accel/accel.sh@20 -- # IFS=: 00:05:19.813 22:43:10 -- accel/accel.sh@20 -- # read -r var val 00:05:19.813 22:43:10 -- accel/accel.sh@21 -- # val=Yes 00:05:19.813 22:43:10 -- accel/accel.sh@22 -- # case "$var" in 00:05:19.813 22:43:10 -- accel/accel.sh@20 -- # IFS=: 00:05:19.813 22:43:10 -- accel/accel.sh@20 -- # read -r var val 00:05:19.813 22:43:10 -- accel/accel.sh@21 -- # val= 00:05:19.813 22:43:10 -- accel/accel.sh@22 -- # case "$var" in 00:05:19.813 22:43:10 -- accel/accel.sh@20 -- # IFS=: 00:05:19.813 22:43:10 -- accel/accel.sh@20 -- # read -r var val 00:05:19.813 22:43:10 -- accel/accel.sh@21 -- # val= 00:05:19.813 22:43:10 -- accel/accel.sh@22 -- # case "$var" in 00:05:19.813 22:43:10 -- accel/accel.sh@20 -- # IFS=: 00:05:19.813 22:43:10 -- accel/accel.sh@20 -- # read -r var val 00:05:21.193 22:43:12 -- accel/accel.sh@21 -- # val= 00:05:21.193 22:43:12 -- accel/accel.sh@22 -- # case "$var" in 00:05:21.193 22:43:12 -- accel/accel.sh@20 -- # IFS=: 00:05:21.193 22:43:12 -- accel/accel.sh@20 -- # read -r var val 00:05:21.193 22:43:12 -- accel/accel.sh@21 -- # val= 00:05:21.193 22:43:12 -- accel/accel.sh@22 -- # case "$var" in 00:05:21.193 22:43:12 -- accel/accel.sh@20 -- # IFS=: 00:05:21.193 22:43:12 -- accel/accel.sh@20 -- # read -r var val 00:05:21.193 22:43:12 -- accel/accel.sh@21 -- # val= 00:05:21.193 22:43:12 -- accel/accel.sh@22 -- # case "$var" in 00:05:21.193 22:43:12 -- accel/accel.sh@20 -- # IFS=: 00:05:21.193 22:43:12 -- accel/accel.sh@20 -- # read -r var val 00:05:21.193 22:43:12 -- accel/accel.sh@21 -- # val= 00:05:21.193 22:43:12 -- accel/accel.sh@22 -- # case "$var" in 00:05:21.193 22:43:12 -- accel/accel.sh@20 -- # IFS=: 00:05:21.193 22:43:12 -- accel/accel.sh@20 -- # read -r var val 00:05:21.193 22:43:12 -- accel/accel.sh@21 -- # val= 00:05:21.193 22:43:12 -- accel/accel.sh@22 -- # case "$var" in 00:05:21.193 22:43:12 -- accel/accel.sh@20 -- # IFS=: 00:05:21.193 22:43:12 -- accel/accel.sh@20 -- # read -r var val 00:05:21.193 22:43:12 -- accel/accel.sh@21 -- # val= 00:05:21.193 22:43:12 -- accel/accel.sh@22 -- # case "$var" in 00:05:21.193 22:43:12 -- accel/accel.sh@20 -- # IFS=: 00:05:21.193 22:43:12 -- accel/accel.sh@20 -- # read -r var val 00:05:21.193 22:43:12 -- accel/accel.sh@28 -- # [[ -n software ]] 00:05:21.193 22:43:12 -- accel/accel.sh@28 -- # [[ -n xor ]] 00:05:21.193 22:43:12 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:05:21.193 00:05:21.193 real 0m2.951s 00:05:21.193 user 0m2.658s 00:05:21.193 sys 0m0.283s 00:05:21.193 22:43:12 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:05:21.193 22:43:12 -- common/autotest_common.sh@10 -- # set +x 00:05:21.193 ************************************ 00:05:21.193 END TEST accel_xor 00:05:21.193 ************************************ 00:05:21.193 22:43:12 -- accel/accel.sh@103 -- # run_test accel_dif_verify accel_test -t 1 -w dif_verify 00:05:21.193 22:43:12 -- common/autotest_common.sh@1077 -- # '[' 6 -le 1 ']' 00:05:21.193 22:43:12 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:05:21.193 22:43:12 -- common/autotest_common.sh@10 -- # set +x 00:05:21.193 ************************************ 00:05:21.193 START TEST accel_dif_verify 00:05:21.193 ************************************ 00:05:21.193 22:43:12 -- common/autotest_common.sh@1104 -- # accel_test -t 1 -w dif_verify 00:05:21.193 22:43:12 -- accel/accel.sh@16 -- # local accel_opc 00:05:21.193 22:43:12 -- accel/accel.sh@17 -- # local accel_module 00:05:21.193 22:43:12 -- accel/accel.sh@18 -- # accel_perf -t 1 -w dif_verify 00:05:21.193 22:43:12 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w dif_verify 00:05:21.193 22:43:12 -- accel/accel.sh@12 -- # build_accel_config 00:05:21.193 22:43:12 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:05:21.193 22:43:12 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:21.193 22:43:12 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:21.193 22:43:12 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:05:21.193 22:43:12 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:05:21.193 22:43:12 -- accel/accel.sh@41 -- # local IFS=, 00:05:21.193 22:43:12 -- accel/accel.sh@42 -- # jq -r . 00:05:21.193 [2024-04-16 22:43:12.150879] Starting SPDK v24.01.1-pre git sha1 4b134b4ab / DPDK 23.11.0 initialization... 00:05:21.193 [2024-04-16 22:43:12.150958] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid166167 ] 00:05:21.193 EAL: No free 2048 kB hugepages reported on node 1 00:05:21.193 [2024-04-16 22:43:12.214831] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:21.453 [2024-04-16 22:43:12.335333] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:22.834 22:43:13 -- accel/accel.sh@18 -- # out=' 00:05:22.834 SPDK Configuration: 00:05:22.834 Core mask: 0x1 00:05:22.834 00:05:22.834 Accel Perf Configuration: 00:05:22.834 Workload Type: dif_verify 00:05:22.834 Vector size: 4096 bytes 00:05:22.834 Transfer size: 4096 bytes 00:05:22.834 Block size: 512 bytes 00:05:22.834 Metadata size: 8 bytes 00:05:22.834 Vector count 1 00:05:22.834 Module: software 00:05:22.834 Queue depth: 32 00:05:22.834 Allocate depth: 32 00:05:22.834 # threads/core: 1 00:05:22.834 Run time: 1 seconds 00:05:22.834 Verify: No 00:05:22.834 00:05:22.834 Running for 1 seconds... 00:05:22.834 00:05:22.834 Core,Thread Transfers Bandwidth Failed Miscompares 00:05:22.834 ------------------------------------------------------------------------------------ 00:05:22.834 0,0 81952/s 325 MiB/s 0 0 00:05:22.834 ==================================================================================== 00:05:22.834 Total 81952/s 320 MiB/s 0 0' 00:05:22.834 22:43:13 -- accel/accel.sh@20 -- # IFS=: 00:05:22.834 22:43:13 -- accel/accel.sh@15 -- # accel_perf -t 1 -w dif_verify 00:05:22.834 22:43:13 -- accel/accel.sh@20 -- # read -r var val 00:05:22.834 22:43:13 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w dif_verify 00:05:22.834 22:43:13 -- accel/accel.sh@12 -- # build_accel_config 00:05:22.834 22:43:13 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:05:22.834 22:43:13 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:22.834 22:43:13 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:22.834 22:43:13 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:05:22.834 22:43:13 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:05:22.834 22:43:13 -- accel/accel.sh@41 -- # local IFS=, 00:05:22.834 22:43:13 -- accel/accel.sh@42 -- # jq -r . 00:05:22.834 [2024-04-16 22:43:13.637721] Starting SPDK v24.01.1-pre git sha1 4b134b4ab / DPDK 23.11.0 initialization... 00:05:22.834 [2024-04-16 22:43:13.637805] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid166306 ] 00:05:22.834 EAL: No free 2048 kB hugepages reported on node 1 00:05:22.834 [2024-04-16 22:43:13.703152] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:22.834 [2024-04-16 22:43:13.827587] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:22.834 22:43:13 -- accel/accel.sh@21 -- # val= 00:05:22.834 22:43:13 -- accel/accel.sh@22 -- # case "$var" in 00:05:22.834 22:43:13 -- accel/accel.sh@20 -- # IFS=: 00:05:22.834 22:43:13 -- accel/accel.sh@20 -- # read -r var val 00:05:22.834 22:43:13 -- accel/accel.sh@21 -- # val= 00:05:22.834 22:43:13 -- accel/accel.sh@22 -- # case "$var" in 00:05:22.834 22:43:13 -- accel/accel.sh@20 -- # IFS=: 00:05:22.834 22:43:13 -- accel/accel.sh@20 -- # read -r var val 00:05:22.834 22:43:13 -- accel/accel.sh@21 -- # val=0x1 00:05:22.834 22:43:13 -- accel/accel.sh@22 -- # case "$var" in 00:05:22.834 22:43:13 -- accel/accel.sh@20 -- # IFS=: 00:05:22.834 22:43:13 -- accel/accel.sh@20 -- # read -r var val 00:05:22.834 22:43:13 -- accel/accel.sh@21 -- # val= 00:05:22.834 22:43:13 -- accel/accel.sh@22 -- # case "$var" in 00:05:22.834 22:43:13 -- accel/accel.sh@20 -- # IFS=: 00:05:22.834 22:43:13 -- accel/accel.sh@20 -- # read -r var val 00:05:22.834 22:43:13 -- accel/accel.sh@21 -- # val= 00:05:22.834 22:43:13 -- accel/accel.sh@22 -- # case "$var" in 00:05:22.834 22:43:13 -- accel/accel.sh@20 -- # IFS=: 00:05:22.834 22:43:13 -- accel/accel.sh@20 -- # read -r var val 00:05:22.834 22:43:13 -- accel/accel.sh@21 -- # val=dif_verify 00:05:22.834 22:43:13 -- accel/accel.sh@22 -- # case "$var" in 00:05:22.834 22:43:13 -- accel/accel.sh@24 -- # accel_opc=dif_verify 00:05:22.834 22:43:13 -- accel/accel.sh@20 -- # IFS=: 00:05:22.834 22:43:13 -- accel/accel.sh@20 -- # read -r var val 00:05:22.834 22:43:13 -- accel/accel.sh@21 -- # val='4096 bytes' 00:05:22.834 22:43:13 -- accel/accel.sh@22 -- # case "$var" in 00:05:22.834 22:43:13 -- accel/accel.sh@20 -- # IFS=: 00:05:22.834 22:43:13 -- accel/accel.sh@20 -- # read -r var val 00:05:22.834 22:43:13 -- accel/accel.sh@21 -- # val='4096 bytes' 00:05:22.834 22:43:13 -- accel/accel.sh@22 -- # case "$var" in 00:05:22.834 22:43:13 -- accel/accel.sh@20 -- # IFS=: 00:05:22.834 22:43:13 -- accel/accel.sh@20 -- # read -r var val 00:05:22.834 22:43:13 -- accel/accel.sh@21 -- # val='512 bytes' 00:05:22.834 22:43:13 -- accel/accel.sh@22 -- # case "$var" in 00:05:22.834 22:43:13 -- accel/accel.sh@20 -- # IFS=: 00:05:22.834 22:43:13 -- accel/accel.sh@20 -- # read -r var val 00:05:22.834 22:43:13 -- accel/accel.sh@21 -- # val='8 bytes' 00:05:22.834 22:43:13 -- accel/accel.sh@22 -- # case "$var" in 00:05:22.834 22:43:13 -- accel/accel.sh@20 -- # IFS=: 00:05:22.834 22:43:13 -- accel/accel.sh@20 -- # read -r var val 00:05:22.834 22:43:13 -- accel/accel.sh@21 -- # val= 00:05:22.834 22:43:13 -- accel/accel.sh@22 -- # case "$var" in 00:05:22.834 22:43:13 -- accel/accel.sh@20 -- # IFS=: 00:05:22.834 22:43:13 -- accel/accel.sh@20 -- # read -r var val 00:05:22.834 22:43:13 -- accel/accel.sh@21 -- # val=software 00:05:22.834 22:43:13 -- accel/accel.sh@22 -- # case "$var" in 00:05:22.834 22:43:13 -- accel/accel.sh@23 -- # accel_module=software 00:05:22.834 22:43:13 -- accel/accel.sh@20 -- # IFS=: 00:05:22.834 22:43:13 -- accel/accel.sh@20 -- # read -r var val 00:05:22.834 22:43:13 -- accel/accel.sh@21 -- # val=32 00:05:22.834 22:43:13 -- accel/accel.sh@22 -- # case "$var" in 00:05:22.834 22:43:13 -- accel/accel.sh@20 -- # IFS=: 00:05:22.834 22:43:13 -- accel/accel.sh@20 -- # read -r var val 00:05:22.834 22:43:13 -- accel/accel.sh@21 -- # val=32 00:05:22.834 22:43:13 -- accel/accel.sh@22 -- # case "$var" in 00:05:22.834 22:43:13 -- accel/accel.sh@20 -- # IFS=: 00:05:22.834 22:43:13 -- accel/accel.sh@20 -- # read -r var val 00:05:22.834 22:43:13 -- accel/accel.sh@21 -- # val=1 00:05:22.834 22:43:13 -- accel/accel.sh@22 -- # case "$var" in 00:05:22.834 22:43:13 -- accel/accel.sh@20 -- # IFS=: 00:05:22.834 22:43:13 -- accel/accel.sh@20 -- # read -r var val 00:05:22.834 22:43:13 -- accel/accel.sh@21 -- # val='1 seconds' 00:05:22.834 22:43:13 -- accel/accel.sh@22 -- # case "$var" in 00:05:22.834 22:43:13 -- accel/accel.sh@20 -- # IFS=: 00:05:22.834 22:43:13 -- accel/accel.sh@20 -- # read -r var val 00:05:22.834 22:43:13 -- accel/accel.sh@21 -- # val=No 00:05:22.834 22:43:13 -- accel/accel.sh@22 -- # case "$var" in 00:05:22.834 22:43:13 -- accel/accel.sh@20 -- # IFS=: 00:05:22.834 22:43:13 -- accel/accel.sh@20 -- # read -r var val 00:05:22.834 22:43:13 -- accel/accel.sh@21 -- # val= 00:05:22.834 22:43:13 -- accel/accel.sh@22 -- # case "$var" in 00:05:22.834 22:43:13 -- accel/accel.sh@20 -- # IFS=: 00:05:22.834 22:43:13 -- accel/accel.sh@20 -- # read -r var val 00:05:22.834 22:43:13 -- accel/accel.sh@21 -- # val= 00:05:22.834 22:43:13 -- accel/accel.sh@22 -- # case "$var" in 00:05:22.834 22:43:13 -- accel/accel.sh@20 -- # IFS=: 00:05:22.834 22:43:13 -- accel/accel.sh@20 -- # read -r var val 00:05:24.210 22:43:15 -- accel/accel.sh@21 -- # val= 00:05:24.210 22:43:15 -- accel/accel.sh@22 -- # case "$var" in 00:05:24.210 22:43:15 -- accel/accel.sh@20 -- # IFS=: 00:05:24.210 22:43:15 -- accel/accel.sh@20 -- # read -r var val 00:05:24.210 22:43:15 -- accel/accel.sh@21 -- # val= 00:05:24.210 22:43:15 -- accel/accel.sh@22 -- # case "$var" in 00:05:24.210 22:43:15 -- accel/accel.sh@20 -- # IFS=: 00:05:24.210 22:43:15 -- accel/accel.sh@20 -- # read -r var val 00:05:24.210 22:43:15 -- accel/accel.sh@21 -- # val= 00:05:24.210 22:43:15 -- accel/accel.sh@22 -- # case "$var" in 00:05:24.210 22:43:15 -- accel/accel.sh@20 -- # IFS=: 00:05:24.210 22:43:15 -- accel/accel.sh@20 -- # read -r var val 00:05:24.210 22:43:15 -- accel/accel.sh@21 -- # val= 00:05:24.210 22:43:15 -- accel/accel.sh@22 -- # case "$var" in 00:05:24.210 22:43:15 -- accel/accel.sh@20 -- # IFS=: 00:05:24.210 22:43:15 -- accel/accel.sh@20 -- # read -r var val 00:05:24.210 22:43:15 -- accel/accel.sh@21 -- # val= 00:05:24.210 22:43:15 -- accel/accel.sh@22 -- # case "$var" in 00:05:24.210 22:43:15 -- accel/accel.sh@20 -- # IFS=: 00:05:24.210 22:43:15 -- accel/accel.sh@20 -- # read -r var val 00:05:24.210 22:43:15 -- accel/accel.sh@21 -- # val= 00:05:24.210 22:43:15 -- accel/accel.sh@22 -- # case "$var" in 00:05:24.210 22:43:15 -- accel/accel.sh@20 -- # IFS=: 00:05:24.210 22:43:15 -- accel/accel.sh@20 -- # read -r var val 00:05:24.210 22:43:15 -- accel/accel.sh@28 -- # [[ -n software ]] 00:05:24.210 22:43:15 -- accel/accel.sh@28 -- # [[ -n dif_verify ]] 00:05:24.210 22:43:15 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:05:24.210 00:05:24.210 real 0m2.978s 00:05:24.210 user 0m2.682s 00:05:24.210 sys 0m0.289s 00:05:24.210 22:43:15 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:05:24.210 22:43:15 -- common/autotest_common.sh@10 -- # set +x 00:05:24.210 ************************************ 00:05:24.210 END TEST accel_dif_verify 00:05:24.210 ************************************ 00:05:24.210 22:43:15 -- accel/accel.sh@104 -- # run_test accel_dif_generate accel_test -t 1 -w dif_generate 00:05:24.210 22:43:15 -- common/autotest_common.sh@1077 -- # '[' 6 -le 1 ']' 00:05:24.210 22:43:15 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:05:24.210 22:43:15 -- common/autotest_common.sh@10 -- # set +x 00:05:24.210 ************************************ 00:05:24.210 START TEST accel_dif_generate 00:05:24.210 ************************************ 00:05:24.210 22:43:15 -- common/autotest_common.sh@1104 -- # accel_test -t 1 -w dif_generate 00:05:24.210 22:43:15 -- accel/accel.sh@16 -- # local accel_opc 00:05:24.210 22:43:15 -- accel/accel.sh@17 -- # local accel_module 00:05:24.210 22:43:15 -- accel/accel.sh@18 -- # accel_perf -t 1 -w dif_generate 00:05:24.210 22:43:15 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w dif_generate 00:05:24.210 22:43:15 -- accel/accel.sh@12 -- # build_accel_config 00:05:24.210 22:43:15 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:05:24.210 22:43:15 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:24.210 22:43:15 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:24.210 22:43:15 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:05:24.210 22:43:15 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:05:24.210 22:43:15 -- accel/accel.sh@41 -- # local IFS=, 00:05:24.210 22:43:15 -- accel/accel.sh@42 -- # jq -r . 00:05:24.210 [2024-04-16 22:43:15.150799] Starting SPDK v24.01.1-pre git sha1 4b134b4ab / DPDK 23.11.0 initialization... 00:05:24.210 [2024-04-16 22:43:15.150881] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid166580 ] 00:05:24.210 EAL: No free 2048 kB hugepages reported on node 1 00:05:24.210 [2024-04-16 22:43:15.212535] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:24.210 [2024-04-16 22:43:15.333158] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:25.587 22:43:16 -- accel/accel.sh@18 -- # out=' 00:05:25.587 SPDK Configuration: 00:05:25.587 Core mask: 0x1 00:05:25.587 00:05:25.587 Accel Perf Configuration: 00:05:25.587 Workload Type: dif_generate 00:05:25.587 Vector size: 4096 bytes 00:05:25.587 Transfer size: 4096 bytes 00:05:25.587 Block size: 512 bytes 00:05:25.587 Metadata size: 8 bytes 00:05:25.587 Vector count 1 00:05:25.587 Module: software 00:05:25.587 Queue depth: 32 00:05:25.587 Allocate depth: 32 00:05:25.587 # threads/core: 1 00:05:25.587 Run time: 1 seconds 00:05:25.587 Verify: No 00:05:25.587 00:05:25.587 Running for 1 seconds... 00:05:25.587 00:05:25.587 Core,Thread Transfers Bandwidth Failed Miscompares 00:05:25.587 ------------------------------------------------------------------------------------ 00:05:25.587 0,0 95616/s 379 MiB/s 0 0 00:05:25.587 ==================================================================================== 00:05:25.587 Total 95616/s 373 MiB/s 0 0' 00:05:25.587 22:43:16 -- accel/accel.sh@20 -- # IFS=: 00:05:25.587 22:43:16 -- accel/accel.sh@15 -- # accel_perf -t 1 -w dif_generate 00:05:25.587 22:43:16 -- accel/accel.sh@20 -- # read -r var val 00:05:25.587 22:43:16 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w dif_generate 00:05:25.587 22:43:16 -- accel/accel.sh@12 -- # build_accel_config 00:05:25.587 22:43:16 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:05:25.587 22:43:16 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:25.587 22:43:16 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:25.587 22:43:16 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:05:25.587 22:43:16 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:05:25.587 22:43:16 -- accel/accel.sh@41 -- # local IFS=, 00:05:25.587 22:43:16 -- accel/accel.sh@42 -- # jq -r . 00:05:25.587 [2024-04-16 22:43:16.623690] Starting SPDK v24.01.1-pre git sha1 4b134b4ab / DPDK 23.11.0 initialization... 00:05:25.587 [2024-04-16 22:43:16.623768] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid166733 ] 00:05:25.587 EAL: No free 2048 kB hugepages reported on node 1 00:05:25.587 [2024-04-16 22:43:16.689002] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:25.846 [2024-04-16 22:43:16.808224] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:25.846 22:43:16 -- accel/accel.sh@21 -- # val= 00:05:25.846 22:43:16 -- accel/accel.sh@22 -- # case "$var" in 00:05:25.846 22:43:16 -- accel/accel.sh@20 -- # IFS=: 00:05:25.846 22:43:16 -- accel/accel.sh@20 -- # read -r var val 00:05:25.846 22:43:16 -- accel/accel.sh@21 -- # val= 00:05:25.846 22:43:16 -- accel/accel.sh@22 -- # case "$var" in 00:05:25.846 22:43:16 -- accel/accel.sh@20 -- # IFS=: 00:05:25.846 22:43:16 -- accel/accel.sh@20 -- # read -r var val 00:05:25.846 22:43:16 -- accel/accel.sh@21 -- # val=0x1 00:05:25.846 22:43:16 -- accel/accel.sh@22 -- # case "$var" in 00:05:25.846 22:43:16 -- accel/accel.sh@20 -- # IFS=: 00:05:25.846 22:43:16 -- accel/accel.sh@20 -- # read -r var val 00:05:25.846 22:43:16 -- accel/accel.sh@21 -- # val= 00:05:25.846 22:43:16 -- accel/accel.sh@22 -- # case "$var" in 00:05:25.846 22:43:16 -- accel/accel.sh@20 -- # IFS=: 00:05:25.846 22:43:16 -- accel/accel.sh@20 -- # read -r var val 00:05:25.846 22:43:16 -- accel/accel.sh@21 -- # val= 00:05:25.846 22:43:16 -- accel/accel.sh@22 -- # case "$var" in 00:05:25.846 22:43:16 -- accel/accel.sh@20 -- # IFS=: 00:05:25.846 22:43:16 -- accel/accel.sh@20 -- # read -r var val 00:05:25.846 22:43:16 -- accel/accel.sh@21 -- # val=dif_generate 00:05:25.846 22:43:16 -- accel/accel.sh@22 -- # case "$var" in 00:05:25.846 22:43:16 -- accel/accel.sh@24 -- # accel_opc=dif_generate 00:05:25.846 22:43:16 -- accel/accel.sh@20 -- # IFS=: 00:05:25.846 22:43:16 -- accel/accel.sh@20 -- # read -r var val 00:05:25.846 22:43:16 -- accel/accel.sh@21 -- # val='4096 bytes' 00:05:25.846 22:43:16 -- accel/accel.sh@22 -- # case "$var" in 00:05:25.846 22:43:16 -- accel/accel.sh@20 -- # IFS=: 00:05:25.846 22:43:16 -- accel/accel.sh@20 -- # read -r var val 00:05:25.846 22:43:16 -- accel/accel.sh@21 -- # val='4096 bytes' 00:05:25.846 22:43:16 -- accel/accel.sh@22 -- # case "$var" in 00:05:25.846 22:43:16 -- accel/accel.sh@20 -- # IFS=: 00:05:25.846 22:43:16 -- accel/accel.sh@20 -- # read -r var val 00:05:25.846 22:43:16 -- accel/accel.sh@21 -- # val='512 bytes' 00:05:25.846 22:43:16 -- accel/accel.sh@22 -- # case "$var" in 00:05:25.847 22:43:16 -- accel/accel.sh@20 -- # IFS=: 00:05:25.847 22:43:16 -- accel/accel.sh@20 -- # read -r var val 00:05:25.847 22:43:16 -- accel/accel.sh@21 -- # val='8 bytes' 00:05:25.847 22:43:16 -- accel/accel.sh@22 -- # case "$var" in 00:05:25.847 22:43:16 -- accel/accel.sh@20 -- # IFS=: 00:05:25.847 22:43:16 -- accel/accel.sh@20 -- # read -r var val 00:05:25.847 22:43:16 -- accel/accel.sh@21 -- # val= 00:05:25.847 22:43:16 -- accel/accel.sh@22 -- # case "$var" in 00:05:25.847 22:43:16 -- accel/accel.sh@20 -- # IFS=: 00:05:25.847 22:43:16 -- accel/accel.sh@20 -- # read -r var val 00:05:25.847 22:43:16 -- accel/accel.sh@21 -- # val=software 00:05:25.847 22:43:16 -- accel/accel.sh@22 -- # case "$var" in 00:05:25.847 22:43:16 -- accel/accel.sh@23 -- # accel_module=software 00:05:25.847 22:43:16 -- accel/accel.sh@20 -- # IFS=: 00:05:25.847 22:43:16 -- accel/accel.sh@20 -- # read -r var val 00:05:25.847 22:43:16 -- accel/accel.sh@21 -- # val=32 00:05:25.847 22:43:16 -- accel/accel.sh@22 -- # case "$var" in 00:05:25.847 22:43:16 -- accel/accel.sh@20 -- # IFS=: 00:05:25.847 22:43:16 -- accel/accel.sh@20 -- # read -r var val 00:05:25.847 22:43:16 -- accel/accel.sh@21 -- # val=32 00:05:25.847 22:43:16 -- accel/accel.sh@22 -- # case "$var" in 00:05:25.847 22:43:16 -- accel/accel.sh@20 -- # IFS=: 00:05:25.847 22:43:16 -- accel/accel.sh@20 -- # read -r var val 00:05:25.847 22:43:16 -- accel/accel.sh@21 -- # val=1 00:05:25.847 22:43:16 -- accel/accel.sh@22 -- # case "$var" in 00:05:25.847 22:43:16 -- accel/accel.sh@20 -- # IFS=: 00:05:25.847 22:43:16 -- accel/accel.sh@20 -- # read -r var val 00:05:25.847 22:43:16 -- accel/accel.sh@21 -- # val='1 seconds' 00:05:25.847 22:43:16 -- accel/accel.sh@22 -- # case "$var" in 00:05:25.847 22:43:16 -- accel/accel.sh@20 -- # IFS=: 00:05:25.847 22:43:16 -- accel/accel.sh@20 -- # read -r var val 00:05:25.847 22:43:16 -- accel/accel.sh@21 -- # val=No 00:05:25.847 22:43:16 -- accel/accel.sh@22 -- # case "$var" in 00:05:25.847 22:43:16 -- accel/accel.sh@20 -- # IFS=: 00:05:25.847 22:43:16 -- accel/accel.sh@20 -- # read -r var val 00:05:25.847 22:43:16 -- accel/accel.sh@21 -- # val= 00:05:25.847 22:43:16 -- accel/accel.sh@22 -- # case "$var" in 00:05:25.847 22:43:16 -- accel/accel.sh@20 -- # IFS=: 00:05:25.847 22:43:16 -- accel/accel.sh@20 -- # read -r var val 00:05:25.847 22:43:16 -- accel/accel.sh@21 -- # val= 00:05:25.847 22:43:16 -- accel/accel.sh@22 -- # case "$var" in 00:05:25.847 22:43:16 -- accel/accel.sh@20 -- # IFS=: 00:05:25.847 22:43:16 -- accel/accel.sh@20 -- # read -r var val 00:05:27.224 22:43:18 -- accel/accel.sh@21 -- # val= 00:05:27.225 22:43:18 -- accel/accel.sh@22 -- # case "$var" in 00:05:27.225 22:43:18 -- accel/accel.sh@20 -- # IFS=: 00:05:27.225 22:43:18 -- accel/accel.sh@20 -- # read -r var val 00:05:27.225 22:43:18 -- accel/accel.sh@21 -- # val= 00:05:27.225 22:43:18 -- accel/accel.sh@22 -- # case "$var" in 00:05:27.225 22:43:18 -- accel/accel.sh@20 -- # IFS=: 00:05:27.225 22:43:18 -- accel/accel.sh@20 -- # read -r var val 00:05:27.225 22:43:18 -- accel/accel.sh@21 -- # val= 00:05:27.225 22:43:18 -- accel/accel.sh@22 -- # case "$var" in 00:05:27.225 22:43:18 -- accel/accel.sh@20 -- # IFS=: 00:05:27.225 22:43:18 -- accel/accel.sh@20 -- # read -r var val 00:05:27.225 22:43:18 -- accel/accel.sh@21 -- # val= 00:05:27.225 22:43:18 -- accel/accel.sh@22 -- # case "$var" in 00:05:27.225 22:43:18 -- accel/accel.sh@20 -- # IFS=: 00:05:27.225 22:43:18 -- accel/accel.sh@20 -- # read -r var val 00:05:27.225 22:43:18 -- accel/accel.sh@21 -- # val= 00:05:27.225 22:43:18 -- accel/accel.sh@22 -- # case "$var" in 00:05:27.225 22:43:18 -- accel/accel.sh@20 -- # IFS=: 00:05:27.225 22:43:18 -- accel/accel.sh@20 -- # read -r var val 00:05:27.225 22:43:18 -- accel/accel.sh@21 -- # val= 00:05:27.225 22:43:18 -- accel/accel.sh@22 -- # case "$var" in 00:05:27.225 22:43:18 -- accel/accel.sh@20 -- # IFS=: 00:05:27.225 22:43:18 -- accel/accel.sh@20 -- # read -r var val 00:05:27.225 22:43:18 -- accel/accel.sh@28 -- # [[ -n software ]] 00:05:27.225 22:43:18 -- accel/accel.sh@28 -- # [[ -n dif_generate ]] 00:05:27.225 22:43:18 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:05:27.225 00:05:27.225 real 0m2.959s 00:05:27.225 user 0m2.663s 00:05:27.225 sys 0m0.289s 00:05:27.225 22:43:18 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:05:27.225 22:43:18 -- common/autotest_common.sh@10 -- # set +x 00:05:27.225 ************************************ 00:05:27.225 END TEST accel_dif_generate 00:05:27.225 ************************************ 00:05:27.225 22:43:18 -- accel/accel.sh@105 -- # run_test accel_dif_generate_copy accel_test -t 1 -w dif_generate_copy 00:05:27.225 22:43:18 -- common/autotest_common.sh@1077 -- # '[' 6 -le 1 ']' 00:05:27.225 22:43:18 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:05:27.225 22:43:18 -- common/autotest_common.sh@10 -- # set +x 00:05:27.225 ************************************ 00:05:27.225 START TEST accel_dif_generate_copy 00:05:27.225 ************************************ 00:05:27.225 22:43:18 -- common/autotest_common.sh@1104 -- # accel_test -t 1 -w dif_generate_copy 00:05:27.225 22:43:18 -- accel/accel.sh@16 -- # local accel_opc 00:05:27.225 22:43:18 -- accel/accel.sh@17 -- # local accel_module 00:05:27.225 22:43:18 -- accel/accel.sh@18 -- # accel_perf -t 1 -w dif_generate_copy 00:05:27.225 22:43:18 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w dif_generate_copy 00:05:27.225 22:43:18 -- accel/accel.sh@12 -- # build_accel_config 00:05:27.225 22:43:18 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:05:27.225 22:43:18 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:27.225 22:43:18 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:27.225 22:43:18 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:05:27.225 22:43:18 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:05:27.225 22:43:18 -- accel/accel.sh@41 -- # local IFS=, 00:05:27.225 22:43:18 -- accel/accel.sh@42 -- # jq -r . 00:05:27.225 [2024-04-16 22:43:18.139413] Starting SPDK v24.01.1-pre git sha1 4b134b4ab / DPDK 23.11.0 initialization... 00:05:27.225 [2024-04-16 22:43:18.139491] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid166889 ] 00:05:27.225 EAL: No free 2048 kB hugepages reported on node 1 00:05:27.225 [2024-04-16 22:43:18.204349] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:27.225 [2024-04-16 22:43:18.324426] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:28.604 22:43:19 -- accel/accel.sh@18 -- # out=' 00:05:28.604 SPDK Configuration: 00:05:28.604 Core mask: 0x1 00:05:28.604 00:05:28.604 Accel Perf Configuration: 00:05:28.604 Workload Type: dif_generate_copy 00:05:28.604 Vector size: 4096 bytes 00:05:28.605 Transfer size: 4096 bytes 00:05:28.605 Vector count 1 00:05:28.605 Module: software 00:05:28.605 Queue depth: 32 00:05:28.605 Allocate depth: 32 00:05:28.605 # threads/core: 1 00:05:28.605 Run time: 1 seconds 00:05:28.605 Verify: No 00:05:28.605 00:05:28.605 Running for 1 seconds... 00:05:28.605 00:05:28.605 Core,Thread Transfers Bandwidth Failed Miscompares 00:05:28.605 ------------------------------------------------------------------------------------ 00:05:28.605 0,0 76160/s 302 MiB/s 0 0 00:05:28.605 ==================================================================================== 00:05:28.605 Total 76160/s 297 MiB/s 0 0' 00:05:28.605 22:43:19 -- accel/accel.sh@20 -- # IFS=: 00:05:28.605 22:43:19 -- accel/accel.sh@15 -- # accel_perf -t 1 -w dif_generate_copy 00:05:28.605 22:43:19 -- accel/accel.sh@20 -- # read -r var val 00:05:28.605 22:43:19 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w dif_generate_copy 00:05:28.605 22:43:19 -- accel/accel.sh@12 -- # build_accel_config 00:05:28.605 22:43:19 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:05:28.605 22:43:19 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:28.605 22:43:19 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:28.605 22:43:19 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:05:28.605 22:43:19 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:05:28.605 22:43:19 -- accel/accel.sh@41 -- # local IFS=, 00:05:28.605 22:43:19 -- accel/accel.sh@42 -- # jq -r . 00:05:28.605 [2024-04-16 22:43:19.612326] Starting SPDK v24.01.1-pre git sha1 4b134b4ab / DPDK 23.11.0 initialization... 00:05:28.605 [2024-04-16 22:43:19.612408] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid167152 ] 00:05:28.605 EAL: No free 2048 kB hugepages reported on node 1 00:05:28.605 [2024-04-16 22:43:19.677146] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:28.864 [2024-04-16 22:43:19.798029] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:28.864 22:43:19 -- accel/accel.sh@21 -- # val= 00:05:28.864 22:43:19 -- accel/accel.sh@22 -- # case "$var" in 00:05:28.864 22:43:19 -- accel/accel.sh@20 -- # IFS=: 00:05:28.864 22:43:19 -- accel/accel.sh@20 -- # read -r var val 00:05:28.864 22:43:19 -- accel/accel.sh@21 -- # val= 00:05:28.864 22:43:19 -- accel/accel.sh@22 -- # case "$var" in 00:05:28.864 22:43:19 -- accel/accel.sh@20 -- # IFS=: 00:05:28.864 22:43:19 -- accel/accel.sh@20 -- # read -r var val 00:05:28.864 22:43:19 -- accel/accel.sh@21 -- # val=0x1 00:05:28.864 22:43:19 -- accel/accel.sh@22 -- # case "$var" in 00:05:28.864 22:43:19 -- accel/accel.sh@20 -- # IFS=: 00:05:28.864 22:43:19 -- accel/accel.sh@20 -- # read -r var val 00:05:28.864 22:43:19 -- accel/accel.sh@21 -- # val= 00:05:28.864 22:43:19 -- accel/accel.sh@22 -- # case "$var" in 00:05:28.864 22:43:19 -- accel/accel.sh@20 -- # IFS=: 00:05:28.864 22:43:19 -- accel/accel.sh@20 -- # read -r var val 00:05:28.864 22:43:19 -- accel/accel.sh@21 -- # val= 00:05:28.864 22:43:19 -- accel/accel.sh@22 -- # case "$var" in 00:05:28.864 22:43:19 -- accel/accel.sh@20 -- # IFS=: 00:05:28.864 22:43:19 -- accel/accel.sh@20 -- # read -r var val 00:05:28.864 22:43:19 -- accel/accel.sh@21 -- # val=dif_generate_copy 00:05:28.864 22:43:19 -- accel/accel.sh@22 -- # case "$var" in 00:05:28.864 22:43:19 -- accel/accel.sh@24 -- # accel_opc=dif_generate_copy 00:05:28.864 22:43:19 -- accel/accel.sh@20 -- # IFS=: 00:05:28.864 22:43:19 -- accel/accel.sh@20 -- # read -r var val 00:05:28.864 22:43:19 -- accel/accel.sh@21 -- # val='4096 bytes' 00:05:28.864 22:43:19 -- accel/accel.sh@22 -- # case "$var" in 00:05:28.864 22:43:19 -- accel/accel.sh@20 -- # IFS=: 00:05:28.864 22:43:19 -- accel/accel.sh@20 -- # read -r var val 00:05:28.864 22:43:19 -- accel/accel.sh@21 -- # val='4096 bytes' 00:05:28.864 22:43:19 -- accel/accel.sh@22 -- # case "$var" in 00:05:28.864 22:43:19 -- accel/accel.sh@20 -- # IFS=: 00:05:28.864 22:43:19 -- accel/accel.sh@20 -- # read -r var val 00:05:28.864 22:43:19 -- accel/accel.sh@21 -- # val= 00:05:28.864 22:43:19 -- accel/accel.sh@22 -- # case "$var" in 00:05:28.864 22:43:19 -- accel/accel.sh@20 -- # IFS=: 00:05:28.864 22:43:19 -- accel/accel.sh@20 -- # read -r var val 00:05:28.864 22:43:19 -- accel/accel.sh@21 -- # val=software 00:05:28.864 22:43:19 -- accel/accel.sh@22 -- # case "$var" in 00:05:28.864 22:43:19 -- accel/accel.sh@23 -- # accel_module=software 00:05:28.864 22:43:19 -- accel/accel.sh@20 -- # IFS=: 00:05:28.864 22:43:19 -- accel/accel.sh@20 -- # read -r var val 00:05:28.864 22:43:19 -- accel/accel.sh@21 -- # val=32 00:05:28.864 22:43:19 -- accel/accel.sh@22 -- # case "$var" in 00:05:28.864 22:43:19 -- accel/accel.sh@20 -- # IFS=: 00:05:28.864 22:43:19 -- accel/accel.sh@20 -- # read -r var val 00:05:28.864 22:43:19 -- accel/accel.sh@21 -- # val=32 00:05:28.864 22:43:19 -- accel/accel.sh@22 -- # case "$var" in 00:05:28.864 22:43:19 -- accel/accel.sh@20 -- # IFS=: 00:05:28.864 22:43:19 -- accel/accel.sh@20 -- # read -r var val 00:05:28.864 22:43:19 -- accel/accel.sh@21 -- # val=1 00:05:28.864 22:43:19 -- accel/accel.sh@22 -- # case "$var" in 00:05:28.864 22:43:19 -- accel/accel.sh@20 -- # IFS=: 00:05:28.864 22:43:19 -- accel/accel.sh@20 -- # read -r var val 00:05:28.864 22:43:19 -- accel/accel.sh@21 -- # val='1 seconds' 00:05:28.864 22:43:19 -- accel/accel.sh@22 -- # case "$var" in 00:05:28.864 22:43:19 -- accel/accel.sh@20 -- # IFS=: 00:05:28.864 22:43:19 -- accel/accel.sh@20 -- # read -r var val 00:05:28.864 22:43:19 -- accel/accel.sh@21 -- # val=No 00:05:28.864 22:43:19 -- accel/accel.sh@22 -- # case "$var" in 00:05:28.864 22:43:19 -- accel/accel.sh@20 -- # IFS=: 00:05:28.864 22:43:19 -- accel/accel.sh@20 -- # read -r var val 00:05:28.864 22:43:19 -- accel/accel.sh@21 -- # val= 00:05:28.864 22:43:19 -- accel/accel.sh@22 -- # case "$var" in 00:05:28.864 22:43:19 -- accel/accel.sh@20 -- # IFS=: 00:05:28.864 22:43:19 -- accel/accel.sh@20 -- # read -r var val 00:05:28.864 22:43:19 -- accel/accel.sh@21 -- # val= 00:05:28.864 22:43:19 -- accel/accel.sh@22 -- # case "$var" in 00:05:28.864 22:43:19 -- accel/accel.sh@20 -- # IFS=: 00:05:28.864 22:43:19 -- accel/accel.sh@20 -- # read -r var val 00:05:30.243 22:43:21 -- accel/accel.sh@21 -- # val= 00:05:30.243 22:43:21 -- accel/accel.sh@22 -- # case "$var" in 00:05:30.243 22:43:21 -- accel/accel.sh@20 -- # IFS=: 00:05:30.243 22:43:21 -- accel/accel.sh@20 -- # read -r var val 00:05:30.243 22:43:21 -- accel/accel.sh@21 -- # val= 00:05:30.243 22:43:21 -- accel/accel.sh@22 -- # case "$var" in 00:05:30.243 22:43:21 -- accel/accel.sh@20 -- # IFS=: 00:05:30.243 22:43:21 -- accel/accel.sh@20 -- # read -r var val 00:05:30.243 22:43:21 -- accel/accel.sh@21 -- # val= 00:05:30.243 22:43:21 -- accel/accel.sh@22 -- # case "$var" in 00:05:30.243 22:43:21 -- accel/accel.sh@20 -- # IFS=: 00:05:30.243 22:43:21 -- accel/accel.sh@20 -- # read -r var val 00:05:30.243 22:43:21 -- accel/accel.sh@21 -- # val= 00:05:30.243 22:43:21 -- accel/accel.sh@22 -- # case "$var" in 00:05:30.243 22:43:21 -- accel/accel.sh@20 -- # IFS=: 00:05:30.243 22:43:21 -- accel/accel.sh@20 -- # read -r var val 00:05:30.243 22:43:21 -- accel/accel.sh@21 -- # val= 00:05:30.243 22:43:21 -- accel/accel.sh@22 -- # case "$var" in 00:05:30.243 22:43:21 -- accel/accel.sh@20 -- # IFS=: 00:05:30.243 22:43:21 -- accel/accel.sh@20 -- # read -r var val 00:05:30.243 22:43:21 -- accel/accel.sh@21 -- # val= 00:05:30.243 22:43:21 -- accel/accel.sh@22 -- # case "$var" in 00:05:30.243 22:43:21 -- accel/accel.sh@20 -- # IFS=: 00:05:30.243 22:43:21 -- accel/accel.sh@20 -- # read -r var val 00:05:30.243 22:43:21 -- accel/accel.sh@28 -- # [[ -n software ]] 00:05:30.243 22:43:21 -- accel/accel.sh@28 -- # [[ -n dif_generate_copy ]] 00:05:30.243 22:43:21 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:05:30.243 00:05:30.243 real 0m2.959s 00:05:30.243 user 0m2.661s 00:05:30.243 sys 0m0.289s 00:05:30.243 22:43:21 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:05:30.243 22:43:21 -- common/autotest_common.sh@10 -- # set +x 00:05:30.243 ************************************ 00:05:30.243 END TEST accel_dif_generate_copy 00:05:30.243 ************************************ 00:05:30.243 22:43:21 -- accel/accel.sh@107 -- # [[ y == y ]] 00:05:30.243 22:43:21 -- accel/accel.sh@108 -- # run_test accel_comp accel_test -t 1 -w compress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:05:30.243 22:43:21 -- common/autotest_common.sh@1077 -- # '[' 8 -le 1 ']' 00:05:30.243 22:43:21 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:05:30.243 22:43:21 -- common/autotest_common.sh@10 -- # set +x 00:05:30.243 ************************************ 00:05:30.243 START TEST accel_comp 00:05:30.243 ************************************ 00:05:30.243 22:43:21 -- common/autotest_common.sh@1104 -- # accel_test -t 1 -w compress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:05:30.243 22:43:21 -- accel/accel.sh@16 -- # local accel_opc 00:05:30.243 22:43:21 -- accel/accel.sh@17 -- # local accel_module 00:05:30.243 22:43:21 -- accel/accel.sh@18 -- # accel_perf -t 1 -w compress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:05:30.243 22:43:21 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w compress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:05:30.243 22:43:21 -- accel/accel.sh@12 -- # build_accel_config 00:05:30.243 22:43:21 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:05:30.243 22:43:21 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:30.243 22:43:21 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:30.243 22:43:21 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:05:30.243 22:43:21 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:05:30.243 22:43:21 -- accel/accel.sh@41 -- # local IFS=, 00:05:30.243 22:43:21 -- accel/accel.sh@42 -- # jq -r . 00:05:30.243 [2024-04-16 22:43:21.122783] Starting SPDK v24.01.1-pre git sha1 4b134b4ab / DPDK 23.11.0 initialization... 00:05:30.243 [2024-04-16 22:43:21.122861] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid167311 ] 00:05:30.243 EAL: No free 2048 kB hugepages reported on node 1 00:05:30.243 [2024-04-16 22:43:21.183822] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:30.243 [2024-04-16 22:43:21.302640] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:31.623 22:43:22 -- accel/accel.sh@18 -- # out='Preparing input file... 00:05:31.623 00:05:31.623 SPDK Configuration: 00:05:31.623 Core mask: 0x1 00:05:31.623 00:05:31.623 Accel Perf Configuration: 00:05:31.623 Workload Type: compress 00:05:31.623 Transfer size: 4096 bytes 00:05:31.623 Vector count 1 00:05:31.623 Module: software 00:05:31.623 File Name: /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:05:31.623 Queue depth: 32 00:05:31.623 Allocate depth: 32 00:05:31.623 # threads/core: 1 00:05:31.623 Run time: 1 seconds 00:05:31.623 Verify: No 00:05:31.623 00:05:31.623 Running for 1 seconds... 00:05:31.623 00:05:31.623 Core,Thread Transfers Bandwidth Failed Miscompares 00:05:31.623 ------------------------------------------------------------------------------------ 00:05:31.623 0,0 32352/s 134 MiB/s 0 0 00:05:31.623 ==================================================================================== 00:05:31.623 Total 32352/s 126 MiB/s 0 0' 00:05:31.623 22:43:22 -- accel/accel.sh@20 -- # IFS=: 00:05:31.623 22:43:22 -- accel/accel.sh@15 -- # accel_perf -t 1 -w compress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:05:31.623 22:43:22 -- accel/accel.sh@20 -- # read -r var val 00:05:31.623 22:43:22 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w compress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:05:31.623 22:43:22 -- accel/accel.sh@12 -- # build_accel_config 00:05:31.623 22:43:22 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:05:31.623 22:43:22 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:31.623 22:43:22 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:31.623 22:43:22 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:05:31.623 22:43:22 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:05:31.623 22:43:22 -- accel/accel.sh@41 -- # local IFS=, 00:05:31.623 22:43:22 -- accel/accel.sh@42 -- # jq -r . 00:05:31.623 [2024-04-16 22:43:22.590575] Starting SPDK v24.01.1-pre git sha1 4b134b4ab / DPDK 23.11.0 initialization... 00:05:31.623 [2024-04-16 22:43:22.590657] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid167461 ] 00:05:31.623 EAL: No free 2048 kB hugepages reported on node 1 00:05:31.623 [2024-04-16 22:43:22.655275] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:31.883 [2024-04-16 22:43:22.776490] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:31.883 22:43:22 -- accel/accel.sh@21 -- # val= 00:05:31.883 22:43:22 -- accel/accel.sh@22 -- # case "$var" in 00:05:31.883 22:43:22 -- accel/accel.sh@20 -- # IFS=: 00:05:31.883 22:43:22 -- accel/accel.sh@20 -- # read -r var val 00:05:31.883 22:43:22 -- accel/accel.sh@21 -- # val= 00:05:31.883 22:43:22 -- accel/accel.sh@22 -- # case "$var" in 00:05:31.883 22:43:22 -- accel/accel.sh@20 -- # IFS=: 00:05:31.883 22:43:22 -- accel/accel.sh@20 -- # read -r var val 00:05:31.883 22:43:22 -- accel/accel.sh@21 -- # val= 00:05:31.883 22:43:22 -- accel/accel.sh@22 -- # case "$var" in 00:05:31.883 22:43:22 -- accel/accel.sh@20 -- # IFS=: 00:05:31.883 22:43:22 -- accel/accel.sh@20 -- # read -r var val 00:05:31.883 22:43:22 -- accel/accel.sh@21 -- # val=0x1 00:05:31.883 22:43:22 -- accel/accel.sh@22 -- # case "$var" in 00:05:31.883 22:43:22 -- accel/accel.sh@20 -- # IFS=: 00:05:31.883 22:43:22 -- accel/accel.sh@20 -- # read -r var val 00:05:31.883 22:43:22 -- accel/accel.sh@21 -- # val= 00:05:31.883 22:43:22 -- accel/accel.sh@22 -- # case "$var" in 00:05:31.883 22:43:22 -- accel/accel.sh@20 -- # IFS=: 00:05:31.883 22:43:22 -- accel/accel.sh@20 -- # read -r var val 00:05:31.883 22:43:22 -- accel/accel.sh@21 -- # val= 00:05:31.883 22:43:22 -- accel/accel.sh@22 -- # case "$var" in 00:05:31.883 22:43:22 -- accel/accel.sh@20 -- # IFS=: 00:05:31.883 22:43:22 -- accel/accel.sh@20 -- # read -r var val 00:05:31.883 22:43:22 -- accel/accel.sh@21 -- # val=compress 00:05:31.883 22:43:22 -- accel/accel.sh@22 -- # case "$var" in 00:05:31.883 22:43:22 -- accel/accel.sh@24 -- # accel_opc=compress 00:05:31.883 22:43:22 -- accel/accel.sh@20 -- # IFS=: 00:05:31.883 22:43:22 -- accel/accel.sh@20 -- # read -r var val 00:05:31.883 22:43:22 -- accel/accel.sh@21 -- # val='4096 bytes' 00:05:31.883 22:43:22 -- accel/accel.sh@22 -- # case "$var" in 00:05:31.883 22:43:22 -- accel/accel.sh@20 -- # IFS=: 00:05:31.883 22:43:22 -- accel/accel.sh@20 -- # read -r var val 00:05:31.883 22:43:22 -- accel/accel.sh@21 -- # val= 00:05:31.883 22:43:22 -- accel/accel.sh@22 -- # case "$var" in 00:05:31.883 22:43:22 -- accel/accel.sh@20 -- # IFS=: 00:05:31.883 22:43:22 -- accel/accel.sh@20 -- # read -r var val 00:05:31.883 22:43:22 -- accel/accel.sh@21 -- # val=software 00:05:31.883 22:43:22 -- accel/accel.sh@22 -- # case "$var" in 00:05:31.883 22:43:22 -- accel/accel.sh@23 -- # accel_module=software 00:05:31.883 22:43:22 -- accel/accel.sh@20 -- # IFS=: 00:05:31.883 22:43:22 -- accel/accel.sh@20 -- # read -r var val 00:05:31.883 22:43:22 -- accel/accel.sh@21 -- # val=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:05:31.883 22:43:22 -- accel/accel.sh@22 -- # case "$var" in 00:05:31.883 22:43:22 -- accel/accel.sh@20 -- # IFS=: 00:05:31.883 22:43:22 -- accel/accel.sh@20 -- # read -r var val 00:05:31.883 22:43:22 -- accel/accel.sh@21 -- # val=32 00:05:31.883 22:43:22 -- accel/accel.sh@22 -- # case "$var" in 00:05:31.883 22:43:22 -- accel/accel.sh@20 -- # IFS=: 00:05:31.883 22:43:22 -- accel/accel.sh@20 -- # read -r var val 00:05:31.883 22:43:22 -- accel/accel.sh@21 -- # val=32 00:05:31.883 22:43:22 -- accel/accel.sh@22 -- # case "$var" in 00:05:31.883 22:43:22 -- accel/accel.sh@20 -- # IFS=: 00:05:31.883 22:43:22 -- accel/accel.sh@20 -- # read -r var val 00:05:31.883 22:43:22 -- accel/accel.sh@21 -- # val=1 00:05:31.883 22:43:22 -- accel/accel.sh@22 -- # case "$var" in 00:05:31.883 22:43:22 -- accel/accel.sh@20 -- # IFS=: 00:05:31.883 22:43:22 -- accel/accel.sh@20 -- # read -r var val 00:05:31.883 22:43:22 -- accel/accel.sh@21 -- # val='1 seconds' 00:05:31.883 22:43:22 -- accel/accel.sh@22 -- # case "$var" in 00:05:31.883 22:43:22 -- accel/accel.sh@20 -- # IFS=: 00:05:31.883 22:43:22 -- accel/accel.sh@20 -- # read -r var val 00:05:31.883 22:43:22 -- accel/accel.sh@21 -- # val=No 00:05:31.883 22:43:22 -- accel/accel.sh@22 -- # case "$var" in 00:05:31.883 22:43:22 -- accel/accel.sh@20 -- # IFS=: 00:05:31.883 22:43:22 -- accel/accel.sh@20 -- # read -r var val 00:05:31.883 22:43:22 -- accel/accel.sh@21 -- # val= 00:05:31.883 22:43:22 -- accel/accel.sh@22 -- # case "$var" in 00:05:31.883 22:43:22 -- accel/accel.sh@20 -- # IFS=: 00:05:31.883 22:43:22 -- accel/accel.sh@20 -- # read -r var val 00:05:31.883 22:43:22 -- accel/accel.sh@21 -- # val= 00:05:31.883 22:43:22 -- accel/accel.sh@22 -- # case "$var" in 00:05:31.883 22:43:22 -- accel/accel.sh@20 -- # IFS=: 00:05:31.883 22:43:22 -- accel/accel.sh@20 -- # read -r var val 00:05:33.261 22:43:24 -- accel/accel.sh@21 -- # val= 00:05:33.261 22:43:24 -- accel/accel.sh@22 -- # case "$var" in 00:05:33.261 22:43:24 -- accel/accel.sh@20 -- # IFS=: 00:05:33.261 22:43:24 -- accel/accel.sh@20 -- # read -r var val 00:05:33.261 22:43:24 -- accel/accel.sh@21 -- # val= 00:05:33.261 22:43:24 -- accel/accel.sh@22 -- # case "$var" in 00:05:33.261 22:43:24 -- accel/accel.sh@20 -- # IFS=: 00:05:33.261 22:43:24 -- accel/accel.sh@20 -- # read -r var val 00:05:33.261 22:43:24 -- accel/accel.sh@21 -- # val= 00:05:33.261 22:43:24 -- accel/accel.sh@22 -- # case "$var" in 00:05:33.261 22:43:24 -- accel/accel.sh@20 -- # IFS=: 00:05:33.261 22:43:24 -- accel/accel.sh@20 -- # read -r var val 00:05:33.261 22:43:24 -- accel/accel.sh@21 -- # val= 00:05:33.261 22:43:24 -- accel/accel.sh@22 -- # case "$var" in 00:05:33.261 22:43:24 -- accel/accel.sh@20 -- # IFS=: 00:05:33.261 22:43:24 -- accel/accel.sh@20 -- # read -r var val 00:05:33.261 22:43:24 -- accel/accel.sh@21 -- # val= 00:05:33.261 22:43:24 -- accel/accel.sh@22 -- # case "$var" in 00:05:33.261 22:43:24 -- accel/accel.sh@20 -- # IFS=: 00:05:33.261 22:43:24 -- accel/accel.sh@20 -- # read -r var val 00:05:33.261 22:43:24 -- accel/accel.sh@21 -- # val= 00:05:33.261 22:43:24 -- accel/accel.sh@22 -- # case "$var" in 00:05:33.261 22:43:24 -- accel/accel.sh@20 -- # IFS=: 00:05:33.261 22:43:24 -- accel/accel.sh@20 -- # read -r var val 00:05:33.261 22:43:24 -- accel/accel.sh@28 -- # [[ -n software ]] 00:05:33.261 22:43:24 -- accel/accel.sh@28 -- # [[ -n compress ]] 00:05:33.261 22:43:24 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:05:33.261 00:05:33.261 real 0m2.957s 00:05:33.261 user 0m2.658s 00:05:33.261 sys 0m0.291s 00:05:33.261 22:43:24 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:05:33.261 22:43:24 -- common/autotest_common.sh@10 -- # set +x 00:05:33.261 ************************************ 00:05:33.261 END TEST accel_comp 00:05:33.261 ************************************ 00:05:33.261 22:43:24 -- accel/accel.sh@109 -- # run_test accel_decomp accel_test -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y 00:05:33.261 22:43:24 -- common/autotest_common.sh@1077 -- # '[' 9 -le 1 ']' 00:05:33.261 22:43:24 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:05:33.261 22:43:24 -- common/autotest_common.sh@10 -- # set +x 00:05:33.261 ************************************ 00:05:33.261 START TEST accel_decomp 00:05:33.261 ************************************ 00:05:33.261 22:43:24 -- common/autotest_common.sh@1104 -- # accel_test -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y 00:05:33.261 22:43:24 -- accel/accel.sh@16 -- # local accel_opc 00:05:33.261 22:43:24 -- accel/accel.sh@17 -- # local accel_module 00:05:33.261 22:43:24 -- accel/accel.sh@18 -- # accel_perf -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y 00:05:33.261 22:43:24 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y 00:05:33.261 22:43:24 -- accel/accel.sh@12 -- # build_accel_config 00:05:33.261 22:43:24 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:05:33.261 22:43:24 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:33.261 22:43:24 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:33.261 22:43:24 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:05:33.261 22:43:24 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:05:33.261 22:43:24 -- accel/accel.sh@41 -- # local IFS=, 00:05:33.261 22:43:24 -- accel/accel.sh@42 -- # jq -r . 00:05:33.261 [2024-04-16 22:43:24.103647] Starting SPDK v24.01.1-pre git sha1 4b134b4ab / DPDK 23.11.0 initialization... 00:05:33.261 [2024-04-16 22:43:24.103729] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid167735 ] 00:05:33.261 EAL: No free 2048 kB hugepages reported on node 1 00:05:33.261 [2024-04-16 22:43:24.168910] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:33.261 [2024-04-16 22:43:24.289603] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:34.642 22:43:25 -- accel/accel.sh@18 -- # out='Preparing input file... 00:05:34.642 00:05:34.642 SPDK Configuration: 00:05:34.642 Core mask: 0x1 00:05:34.642 00:05:34.642 Accel Perf Configuration: 00:05:34.642 Workload Type: decompress 00:05:34.642 Transfer size: 4096 bytes 00:05:34.642 Vector count 1 00:05:34.642 Module: software 00:05:34.642 File Name: /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:05:34.642 Queue depth: 32 00:05:34.642 Allocate depth: 32 00:05:34.642 # threads/core: 1 00:05:34.642 Run time: 1 seconds 00:05:34.642 Verify: Yes 00:05:34.642 00:05:34.642 Running for 1 seconds... 00:05:34.642 00:05:34.642 Core,Thread Transfers Bandwidth Failed Miscompares 00:05:34.642 ------------------------------------------------------------------------------------ 00:05:34.642 0,0 55488/s 102 MiB/s 0 0 00:05:34.642 ==================================================================================== 00:05:34.642 Total 55488/s 216 MiB/s 0 0' 00:05:34.642 22:43:25 -- accel/accel.sh@20 -- # IFS=: 00:05:34.642 22:43:25 -- accel/accel.sh@15 -- # accel_perf -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y 00:05:34.642 22:43:25 -- accel/accel.sh@20 -- # read -r var val 00:05:34.642 22:43:25 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y 00:05:34.642 22:43:25 -- accel/accel.sh@12 -- # build_accel_config 00:05:34.642 22:43:25 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:05:34.642 22:43:25 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:34.642 22:43:25 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:34.642 22:43:25 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:05:34.642 22:43:25 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:05:34.642 22:43:25 -- accel/accel.sh@41 -- # local IFS=, 00:05:34.642 22:43:25 -- accel/accel.sh@42 -- # jq -r . 00:05:34.642 [2024-04-16 22:43:25.593376] Starting SPDK v24.01.1-pre git sha1 4b134b4ab / DPDK 23.11.0 initialization... 00:05:34.642 [2024-04-16 22:43:25.593458] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid167879 ] 00:05:34.642 EAL: No free 2048 kB hugepages reported on node 1 00:05:34.642 [2024-04-16 22:43:25.657046] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:34.902 [2024-04-16 22:43:25.775589] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:34.902 22:43:25 -- accel/accel.sh@21 -- # val= 00:05:34.902 22:43:25 -- accel/accel.sh@22 -- # case "$var" in 00:05:34.902 22:43:25 -- accel/accel.sh@20 -- # IFS=: 00:05:34.902 22:43:25 -- accel/accel.sh@20 -- # read -r var val 00:05:34.902 22:43:25 -- accel/accel.sh@21 -- # val= 00:05:34.902 22:43:25 -- accel/accel.sh@22 -- # case "$var" in 00:05:34.902 22:43:25 -- accel/accel.sh@20 -- # IFS=: 00:05:34.902 22:43:25 -- accel/accel.sh@20 -- # read -r var val 00:05:34.902 22:43:25 -- accel/accel.sh@21 -- # val= 00:05:34.902 22:43:25 -- accel/accel.sh@22 -- # case "$var" in 00:05:34.902 22:43:25 -- accel/accel.sh@20 -- # IFS=: 00:05:34.902 22:43:25 -- accel/accel.sh@20 -- # read -r var val 00:05:34.902 22:43:25 -- accel/accel.sh@21 -- # val=0x1 00:05:34.902 22:43:25 -- accel/accel.sh@22 -- # case "$var" in 00:05:34.902 22:43:25 -- accel/accel.sh@20 -- # IFS=: 00:05:34.902 22:43:25 -- accel/accel.sh@20 -- # read -r var val 00:05:34.902 22:43:25 -- accel/accel.sh@21 -- # val= 00:05:34.902 22:43:25 -- accel/accel.sh@22 -- # case "$var" in 00:05:34.902 22:43:25 -- accel/accel.sh@20 -- # IFS=: 00:05:34.902 22:43:25 -- accel/accel.sh@20 -- # read -r var val 00:05:34.902 22:43:25 -- accel/accel.sh@21 -- # val= 00:05:34.902 22:43:25 -- accel/accel.sh@22 -- # case "$var" in 00:05:34.902 22:43:25 -- accel/accel.sh@20 -- # IFS=: 00:05:34.902 22:43:25 -- accel/accel.sh@20 -- # read -r var val 00:05:34.902 22:43:25 -- accel/accel.sh@21 -- # val=decompress 00:05:34.902 22:43:25 -- accel/accel.sh@22 -- # case "$var" in 00:05:34.902 22:43:25 -- accel/accel.sh@24 -- # accel_opc=decompress 00:05:34.902 22:43:25 -- accel/accel.sh@20 -- # IFS=: 00:05:34.902 22:43:25 -- accel/accel.sh@20 -- # read -r var val 00:05:34.902 22:43:25 -- accel/accel.sh@21 -- # val='4096 bytes' 00:05:34.902 22:43:25 -- accel/accel.sh@22 -- # case "$var" in 00:05:34.902 22:43:25 -- accel/accel.sh@20 -- # IFS=: 00:05:34.902 22:43:25 -- accel/accel.sh@20 -- # read -r var val 00:05:34.902 22:43:25 -- accel/accel.sh@21 -- # val= 00:05:34.902 22:43:25 -- accel/accel.sh@22 -- # case "$var" in 00:05:34.902 22:43:25 -- accel/accel.sh@20 -- # IFS=: 00:05:34.902 22:43:25 -- accel/accel.sh@20 -- # read -r var val 00:05:34.902 22:43:25 -- accel/accel.sh@21 -- # val=software 00:05:34.902 22:43:25 -- accel/accel.sh@22 -- # case "$var" in 00:05:34.902 22:43:25 -- accel/accel.sh@23 -- # accel_module=software 00:05:34.902 22:43:25 -- accel/accel.sh@20 -- # IFS=: 00:05:34.902 22:43:25 -- accel/accel.sh@20 -- # read -r var val 00:05:34.902 22:43:25 -- accel/accel.sh@21 -- # val=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:05:34.902 22:43:25 -- accel/accel.sh@22 -- # case "$var" in 00:05:34.902 22:43:25 -- accel/accel.sh@20 -- # IFS=: 00:05:34.902 22:43:25 -- accel/accel.sh@20 -- # read -r var val 00:05:34.902 22:43:25 -- accel/accel.sh@21 -- # val=32 00:05:34.902 22:43:25 -- accel/accel.sh@22 -- # case "$var" in 00:05:34.902 22:43:25 -- accel/accel.sh@20 -- # IFS=: 00:05:34.903 22:43:25 -- accel/accel.sh@20 -- # read -r var val 00:05:34.903 22:43:25 -- accel/accel.sh@21 -- # val=32 00:05:34.903 22:43:25 -- accel/accel.sh@22 -- # case "$var" in 00:05:34.903 22:43:25 -- accel/accel.sh@20 -- # IFS=: 00:05:34.903 22:43:25 -- accel/accel.sh@20 -- # read -r var val 00:05:34.903 22:43:25 -- accel/accel.sh@21 -- # val=1 00:05:34.903 22:43:25 -- accel/accel.sh@22 -- # case "$var" in 00:05:34.903 22:43:25 -- accel/accel.sh@20 -- # IFS=: 00:05:34.903 22:43:25 -- accel/accel.sh@20 -- # read -r var val 00:05:34.903 22:43:25 -- accel/accel.sh@21 -- # val='1 seconds' 00:05:34.903 22:43:25 -- accel/accel.sh@22 -- # case "$var" in 00:05:34.903 22:43:25 -- accel/accel.sh@20 -- # IFS=: 00:05:34.903 22:43:25 -- accel/accel.sh@20 -- # read -r var val 00:05:34.903 22:43:25 -- accel/accel.sh@21 -- # val=Yes 00:05:34.903 22:43:25 -- accel/accel.sh@22 -- # case "$var" in 00:05:34.903 22:43:25 -- accel/accel.sh@20 -- # IFS=: 00:05:34.903 22:43:25 -- accel/accel.sh@20 -- # read -r var val 00:05:34.903 22:43:25 -- accel/accel.sh@21 -- # val= 00:05:34.903 22:43:25 -- accel/accel.sh@22 -- # case "$var" in 00:05:34.903 22:43:25 -- accel/accel.sh@20 -- # IFS=: 00:05:34.903 22:43:25 -- accel/accel.sh@20 -- # read -r var val 00:05:34.903 22:43:25 -- accel/accel.sh@21 -- # val= 00:05:34.903 22:43:25 -- accel/accel.sh@22 -- # case "$var" in 00:05:34.903 22:43:25 -- accel/accel.sh@20 -- # IFS=: 00:05:34.903 22:43:25 -- accel/accel.sh@20 -- # read -r var val 00:05:36.280 22:43:27 -- accel/accel.sh@21 -- # val= 00:05:36.280 22:43:27 -- accel/accel.sh@22 -- # case "$var" in 00:05:36.280 22:43:27 -- accel/accel.sh@20 -- # IFS=: 00:05:36.280 22:43:27 -- accel/accel.sh@20 -- # read -r var val 00:05:36.280 22:43:27 -- accel/accel.sh@21 -- # val= 00:05:36.280 22:43:27 -- accel/accel.sh@22 -- # case "$var" in 00:05:36.280 22:43:27 -- accel/accel.sh@20 -- # IFS=: 00:05:36.280 22:43:27 -- accel/accel.sh@20 -- # read -r var val 00:05:36.280 22:43:27 -- accel/accel.sh@21 -- # val= 00:05:36.280 22:43:27 -- accel/accel.sh@22 -- # case "$var" in 00:05:36.280 22:43:27 -- accel/accel.sh@20 -- # IFS=: 00:05:36.280 22:43:27 -- accel/accel.sh@20 -- # read -r var val 00:05:36.280 22:43:27 -- accel/accel.sh@21 -- # val= 00:05:36.280 22:43:27 -- accel/accel.sh@22 -- # case "$var" in 00:05:36.280 22:43:27 -- accel/accel.sh@20 -- # IFS=: 00:05:36.280 22:43:27 -- accel/accel.sh@20 -- # read -r var val 00:05:36.280 22:43:27 -- accel/accel.sh@21 -- # val= 00:05:36.280 22:43:27 -- accel/accel.sh@22 -- # case "$var" in 00:05:36.280 22:43:27 -- accel/accel.sh@20 -- # IFS=: 00:05:36.280 22:43:27 -- accel/accel.sh@20 -- # read -r var val 00:05:36.280 22:43:27 -- accel/accel.sh@21 -- # val= 00:05:36.280 22:43:27 -- accel/accel.sh@22 -- # case "$var" in 00:05:36.280 22:43:27 -- accel/accel.sh@20 -- # IFS=: 00:05:36.280 22:43:27 -- accel/accel.sh@20 -- # read -r var val 00:05:36.280 22:43:27 -- accel/accel.sh@28 -- # [[ -n software ]] 00:05:36.280 22:43:27 -- accel/accel.sh@28 -- # [[ -n decompress ]] 00:05:36.280 22:43:27 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:05:36.280 00:05:36.280 real 0m2.960s 00:05:36.280 user 0m2.663s 00:05:36.280 sys 0m0.289s 00:05:36.280 22:43:27 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:05:36.280 22:43:27 -- common/autotest_common.sh@10 -- # set +x 00:05:36.280 ************************************ 00:05:36.280 END TEST accel_decomp 00:05:36.280 ************************************ 00:05:36.280 22:43:27 -- accel/accel.sh@110 -- # run_test accel_decmop_full accel_test -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 00:05:36.280 22:43:27 -- common/autotest_common.sh@1077 -- # '[' 11 -le 1 ']' 00:05:36.280 22:43:27 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:05:36.280 22:43:27 -- common/autotest_common.sh@10 -- # set +x 00:05:36.280 ************************************ 00:05:36.280 START TEST accel_decmop_full 00:05:36.280 ************************************ 00:05:36.280 22:43:27 -- common/autotest_common.sh@1104 -- # accel_test -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 00:05:36.280 22:43:27 -- accel/accel.sh@16 -- # local accel_opc 00:05:36.280 22:43:27 -- accel/accel.sh@17 -- # local accel_module 00:05:36.280 22:43:27 -- accel/accel.sh@18 -- # accel_perf -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 00:05:36.280 22:43:27 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 00:05:36.280 22:43:27 -- accel/accel.sh@12 -- # build_accel_config 00:05:36.280 22:43:27 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:05:36.280 22:43:27 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:36.280 22:43:27 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:36.280 22:43:27 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:05:36.280 22:43:27 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:05:36.280 22:43:27 -- accel/accel.sh@41 -- # local IFS=, 00:05:36.280 22:43:27 -- accel/accel.sh@42 -- # jq -r . 00:05:36.280 [2024-04-16 22:43:27.088530] Starting SPDK v24.01.1-pre git sha1 4b134b4ab / DPDK 23.11.0 initialization... 00:05:36.280 [2024-04-16 22:43:27.088616] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid168044 ] 00:05:36.280 EAL: No free 2048 kB hugepages reported on node 1 00:05:36.280 [2024-04-16 22:43:27.151126] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:36.280 [2024-04-16 22:43:27.272050] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:37.660 22:43:28 -- accel/accel.sh@18 -- # out='Preparing input file... 00:05:37.660 00:05:37.660 SPDK Configuration: 00:05:37.660 Core mask: 0x1 00:05:37.660 00:05:37.660 Accel Perf Configuration: 00:05:37.660 Workload Type: decompress 00:05:37.660 Transfer size: 111250 bytes 00:05:37.660 Vector count 1 00:05:37.660 Module: software 00:05:37.660 File Name: /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:05:37.660 Queue depth: 32 00:05:37.660 Allocate depth: 32 00:05:37.660 # threads/core: 1 00:05:37.660 Run time: 1 seconds 00:05:37.660 Verify: Yes 00:05:37.660 00:05:37.660 Running for 1 seconds... 00:05:37.660 00:05:37.660 Core,Thread Transfers Bandwidth Failed Miscompares 00:05:37.660 ------------------------------------------------------------------------------------ 00:05:37.660 0,0 3808/s 157 MiB/s 0 0 00:05:37.660 ==================================================================================== 00:05:37.660 Total 3808/s 404 MiB/s 0 0' 00:05:37.660 22:43:28 -- accel/accel.sh@20 -- # IFS=: 00:05:37.660 22:43:28 -- accel/accel.sh@15 -- # accel_perf -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 00:05:37.660 22:43:28 -- accel/accel.sh@20 -- # read -r var val 00:05:37.660 22:43:28 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 00:05:37.660 22:43:28 -- accel/accel.sh@12 -- # build_accel_config 00:05:37.660 22:43:28 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:05:37.660 22:43:28 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:37.660 22:43:28 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:37.660 22:43:28 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:05:37.660 22:43:28 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:05:37.660 22:43:28 -- accel/accel.sh@41 -- # local IFS=, 00:05:37.660 22:43:28 -- accel/accel.sh@42 -- # jq -r . 00:05:37.660 [2024-04-16 22:43:28.587748] Starting SPDK v24.01.1-pre git sha1 4b134b4ab / DPDK 23.11.0 initialization... 00:05:37.660 [2024-04-16 22:43:28.587831] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid168278 ] 00:05:37.660 EAL: No free 2048 kB hugepages reported on node 1 00:05:37.660 [2024-04-16 22:43:28.653637] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:37.660 [2024-04-16 22:43:28.773649] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:37.920 22:43:28 -- accel/accel.sh@21 -- # val= 00:05:37.920 22:43:28 -- accel/accel.sh@22 -- # case "$var" in 00:05:37.920 22:43:28 -- accel/accel.sh@20 -- # IFS=: 00:05:37.920 22:43:28 -- accel/accel.sh@20 -- # read -r var val 00:05:37.920 22:43:28 -- accel/accel.sh@21 -- # val= 00:05:37.920 22:43:28 -- accel/accel.sh@22 -- # case "$var" in 00:05:37.920 22:43:28 -- accel/accel.sh@20 -- # IFS=: 00:05:37.920 22:43:28 -- accel/accel.sh@20 -- # read -r var val 00:05:37.920 22:43:28 -- accel/accel.sh@21 -- # val= 00:05:37.921 22:43:28 -- accel/accel.sh@22 -- # case "$var" in 00:05:37.921 22:43:28 -- accel/accel.sh@20 -- # IFS=: 00:05:37.921 22:43:28 -- accel/accel.sh@20 -- # read -r var val 00:05:37.921 22:43:28 -- accel/accel.sh@21 -- # val=0x1 00:05:37.921 22:43:28 -- accel/accel.sh@22 -- # case "$var" in 00:05:37.921 22:43:28 -- accel/accel.sh@20 -- # IFS=: 00:05:37.921 22:43:28 -- accel/accel.sh@20 -- # read -r var val 00:05:37.921 22:43:28 -- accel/accel.sh@21 -- # val= 00:05:37.921 22:43:28 -- accel/accel.sh@22 -- # case "$var" in 00:05:37.921 22:43:28 -- accel/accel.sh@20 -- # IFS=: 00:05:37.921 22:43:28 -- accel/accel.sh@20 -- # read -r var val 00:05:37.921 22:43:28 -- accel/accel.sh@21 -- # val= 00:05:37.921 22:43:28 -- accel/accel.sh@22 -- # case "$var" in 00:05:37.921 22:43:28 -- accel/accel.sh@20 -- # IFS=: 00:05:37.921 22:43:28 -- accel/accel.sh@20 -- # read -r var val 00:05:37.921 22:43:28 -- accel/accel.sh@21 -- # val=decompress 00:05:37.921 22:43:28 -- accel/accel.sh@22 -- # case "$var" in 00:05:37.921 22:43:28 -- accel/accel.sh@24 -- # accel_opc=decompress 00:05:37.921 22:43:28 -- accel/accel.sh@20 -- # IFS=: 00:05:37.921 22:43:28 -- accel/accel.sh@20 -- # read -r var val 00:05:37.921 22:43:28 -- accel/accel.sh@21 -- # val='111250 bytes' 00:05:37.921 22:43:28 -- accel/accel.sh@22 -- # case "$var" in 00:05:37.921 22:43:28 -- accel/accel.sh@20 -- # IFS=: 00:05:37.921 22:43:28 -- accel/accel.sh@20 -- # read -r var val 00:05:37.921 22:43:28 -- accel/accel.sh@21 -- # val= 00:05:37.921 22:43:28 -- accel/accel.sh@22 -- # case "$var" in 00:05:37.921 22:43:28 -- accel/accel.sh@20 -- # IFS=: 00:05:37.921 22:43:28 -- accel/accel.sh@20 -- # read -r var val 00:05:37.921 22:43:28 -- accel/accel.sh@21 -- # val=software 00:05:37.921 22:43:28 -- accel/accel.sh@22 -- # case "$var" in 00:05:37.921 22:43:28 -- accel/accel.sh@23 -- # accel_module=software 00:05:37.921 22:43:28 -- accel/accel.sh@20 -- # IFS=: 00:05:37.921 22:43:28 -- accel/accel.sh@20 -- # read -r var val 00:05:37.921 22:43:28 -- accel/accel.sh@21 -- # val=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:05:37.921 22:43:28 -- accel/accel.sh@22 -- # case "$var" in 00:05:37.921 22:43:28 -- accel/accel.sh@20 -- # IFS=: 00:05:37.921 22:43:28 -- accel/accel.sh@20 -- # read -r var val 00:05:37.921 22:43:28 -- accel/accel.sh@21 -- # val=32 00:05:37.921 22:43:28 -- accel/accel.sh@22 -- # case "$var" in 00:05:37.921 22:43:28 -- accel/accel.sh@20 -- # IFS=: 00:05:37.921 22:43:28 -- accel/accel.sh@20 -- # read -r var val 00:05:37.921 22:43:28 -- accel/accel.sh@21 -- # val=32 00:05:37.921 22:43:28 -- accel/accel.sh@22 -- # case "$var" in 00:05:37.921 22:43:28 -- accel/accel.sh@20 -- # IFS=: 00:05:37.921 22:43:28 -- accel/accel.sh@20 -- # read -r var val 00:05:37.921 22:43:28 -- accel/accel.sh@21 -- # val=1 00:05:37.921 22:43:28 -- accel/accel.sh@22 -- # case "$var" in 00:05:37.921 22:43:28 -- accel/accel.sh@20 -- # IFS=: 00:05:37.921 22:43:28 -- accel/accel.sh@20 -- # read -r var val 00:05:37.921 22:43:28 -- accel/accel.sh@21 -- # val='1 seconds' 00:05:37.921 22:43:28 -- accel/accel.sh@22 -- # case "$var" in 00:05:37.921 22:43:28 -- accel/accel.sh@20 -- # IFS=: 00:05:37.921 22:43:28 -- accel/accel.sh@20 -- # read -r var val 00:05:37.921 22:43:28 -- accel/accel.sh@21 -- # val=Yes 00:05:37.921 22:43:28 -- accel/accel.sh@22 -- # case "$var" in 00:05:37.921 22:43:28 -- accel/accel.sh@20 -- # IFS=: 00:05:37.921 22:43:28 -- accel/accel.sh@20 -- # read -r var val 00:05:37.921 22:43:28 -- accel/accel.sh@21 -- # val= 00:05:37.921 22:43:28 -- accel/accel.sh@22 -- # case "$var" in 00:05:37.921 22:43:28 -- accel/accel.sh@20 -- # IFS=: 00:05:37.921 22:43:28 -- accel/accel.sh@20 -- # read -r var val 00:05:37.921 22:43:28 -- accel/accel.sh@21 -- # val= 00:05:37.921 22:43:28 -- accel/accel.sh@22 -- # case "$var" in 00:05:37.921 22:43:28 -- accel/accel.sh@20 -- # IFS=: 00:05:37.921 22:43:28 -- accel/accel.sh@20 -- # read -r var val 00:05:39.329 22:43:30 -- accel/accel.sh@21 -- # val= 00:05:39.329 22:43:30 -- accel/accel.sh@22 -- # case "$var" in 00:05:39.329 22:43:30 -- accel/accel.sh@20 -- # IFS=: 00:05:39.329 22:43:30 -- accel/accel.sh@20 -- # read -r var val 00:05:39.329 22:43:30 -- accel/accel.sh@21 -- # val= 00:05:39.329 22:43:30 -- accel/accel.sh@22 -- # case "$var" in 00:05:39.329 22:43:30 -- accel/accel.sh@20 -- # IFS=: 00:05:39.329 22:43:30 -- accel/accel.sh@20 -- # read -r var val 00:05:39.329 22:43:30 -- accel/accel.sh@21 -- # val= 00:05:39.329 22:43:30 -- accel/accel.sh@22 -- # case "$var" in 00:05:39.329 22:43:30 -- accel/accel.sh@20 -- # IFS=: 00:05:39.329 22:43:30 -- accel/accel.sh@20 -- # read -r var val 00:05:39.329 22:43:30 -- accel/accel.sh@21 -- # val= 00:05:39.329 22:43:30 -- accel/accel.sh@22 -- # case "$var" in 00:05:39.329 22:43:30 -- accel/accel.sh@20 -- # IFS=: 00:05:39.329 22:43:30 -- accel/accel.sh@20 -- # read -r var val 00:05:39.329 22:43:30 -- accel/accel.sh@21 -- # val= 00:05:39.329 22:43:30 -- accel/accel.sh@22 -- # case "$var" in 00:05:39.329 22:43:30 -- accel/accel.sh@20 -- # IFS=: 00:05:39.329 22:43:30 -- accel/accel.sh@20 -- # read -r var val 00:05:39.329 22:43:30 -- accel/accel.sh@21 -- # val= 00:05:39.329 22:43:30 -- accel/accel.sh@22 -- # case "$var" in 00:05:39.329 22:43:30 -- accel/accel.sh@20 -- # IFS=: 00:05:39.329 22:43:30 -- accel/accel.sh@20 -- # read -r var val 00:05:39.329 22:43:30 -- accel/accel.sh@28 -- # [[ -n software ]] 00:05:39.329 22:43:30 -- accel/accel.sh@28 -- # [[ -n decompress ]] 00:05:39.329 22:43:30 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:05:39.329 00:05:39.329 real 0m3.013s 00:05:39.329 user 0m2.718s 00:05:39.329 sys 0m0.287s 00:05:39.329 22:43:30 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:05:39.329 22:43:30 -- common/autotest_common.sh@10 -- # set +x 00:05:39.329 ************************************ 00:05:39.329 END TEST accel_decmop_full 00:05:39.329 ************************************ 00:05:39.329 22:43:30 -- accel/accel.sh@111 -- # run_test accel_decomp_mcore accel_test -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -m 0xf 00:05:39.329 22:43:30 -- common/autotest_common.sh@1077 -- # '[' 11 -le 1 ']' 00:05:39.329 22:43:30 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:05:39.329 22:43:30 -- common/autotest_common.sh@10 -- # set +x 00:05:39.329 ************************************ 00:05:39.329 START TEST accel_decomp_mcore 00:05:39.329 ************************************ 00:05:39.329 22:43:30 -- common/autotest_common.sh@1104 -- # accel_test -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -m 0xf 00:05:39.329 22:43:30 -- accel/accel.sh@16 -- # local accel_opc 00:05:39.329 22:43:30 -- accel/accel.sh@17 -- # local accel_module 00:05:39.329 22:43:30 -- accel/accel.sh@18 -- # accel_perf -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -m 0xf 00:05:39.329 22:43:30 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -m 0xf 00:05:39.329 22:43:30 -- accel/accel.sh@12 -- # build_accel_config 00:05:39.329 22:43:30 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:05:39.329 22:43:30 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:39.329 22:43:30 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:39.329 22:43:30 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:05:39.329 22:43:30 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:05:39.329 22:43:30 -- accel/accel.sh@41 -- # local IFS=, 00:05:39.329 22:43:30 -- accel/accel.sh@42 -- # jq -r . 00:05:39.329 [2024-04-16 22:43:30.125803] Starting SPDK v24.01.1-pre git sha1 4b134b4ab / DPDK 23.11.0 initialization... 00:05:39.329 [2024-04-16 22:43:30.125887] [ DPDK EAL parameters: accel_perf --no-shconf -c 0xf --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid168464 ] 00:05:39.329 EAL: No free 2048 kB hugepages reported on node 1 00:05:39.329 [2024-04-16 22:43:30.190950] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:05:39.329 [2024-04-16 22:43:30.313346] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:05:39.329 [2024-04-16 22:43:30.313398] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:05:39.329 [2024-04-16 22:43:30.313454] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:05:39.329 [2024-04-16 22:43:30.313457] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:40.709 22:43:31 -- accel/accel.sh@18 -- # out='Preparing input file... 00:05:40.709 00:05:40.710 SPDK Configuration: 00:05:40.710 Core mask: 0xf 00:05:40.710 00:05:40.710 Accel Perf Configuration: 00:05:40.710 Workload Type: decompress 00:05:40.710 Transfer size: 4096 bytes 00:05:40.710 Vector count 1 00:05:40.710 Module: software 00:05:40.710 File Name: /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:05:40.710 Queue depth: 32 00:05:40.710 Allocate depth: 32 00:05:40.710 # threads/core: 1 00:05:40.710 Run time: 1 seconds 00:05:40.710 Verify: Yes 00:05:40.710 00:05:40.710 Running for 1 seconds... 00:05:40.710 00:05:40.710 Core,Thread Transfers Bandwidth Failed Miscompares 00:05:40.710 ------------------------------------------------------------------------------------ 00:05:40.710 0,0 55648/s 102 MiB/s 0 0 00:05:40.710 3,0 56448/s 104 MiB/s 0 0 00:05:40.710 2,0 56416/s 103 MiB/s 0 0 00:05:40.710 1,0 55968/s 103 MiB/s 0 0 00:05:40.710 ==================================================================================== 00:05:40.710 Total 224480/s 876 MiB/s 0 0' 00:05:40.710 22:43:31 -- accel/accel.sh@20 -- # IFS=: 00:05:40.710 22:43:31 -- accel/accel.sh@15 -- # accel_perf -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -m 0xf 00:05:40.710 22:43:31 -- accel/accel.sh@20 -- # read -r var val 00:05:40.710 22:43:31 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -m 0xf 00:05:40.710 22:43:31 -- accel/accel.sh@12 -- # build_accel_config 00:05:40.710 22:43:31 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:05:40.710 22:43:31 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:40.710 22:43:31 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:40.710 22:43:31 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:05:40.710 22:43:31 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:05:40.710 22:43:31 -- accel/accel.sh@41 -- # local IFS=, 00:05:40.710 22:43:31 -- accel/accel.sh@42 -- # jq -r . 00:05:40.710 [2024-04-16 22:43:31.610492] Starting SPDK v24.01.1-pre git sha1 4b134b4ab / DPDK 23.11.0 initialization... 00:05:40.710 [2024-04-16 22:43:31.610578] [ DPDK EAL parameters: accel_perf --no-shconf -c 0xf --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid168620 ] 00:05:40.710 EAL: No free 2048 kB hugepages reported on node 1 00:05:40.710 [2024-04-16 22:43:31.673340] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:05:40.710 [2024-04-16 22:43:31.795660] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:05:40.710 [2024-04-16 22:43:31.795716] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:05:40.710 [2024-04-16 22:43:31.795777] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:05:40.710 [2024-04-16 22:43:31.795780] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:40.970 22:43:31 -- accel/accel.sh@21 -- # val= 00:05:40.970 22:43:31 -- accel/accel.sh@22 -- # case "$var" in 00:05:40.970 22:43:31 -- accel/accel.sh@20 -- # IFS=: 00:05:40.970 22:43:31 -- accel/accel.sh@20 -- # read -r var val 00:05:40.970 22:43:31 -- accel/accel.sh@21 -- # val= 00:05:40.970 22:43:31 -- accel/accel.sh@22 -- # case "$var" in 00:05:40.970 22:43:31 -- accel/accel.sh@20 -- # IFS=: 00:05:40.970 22:43:31 -- accel/accel.sh@20 -- # read -r var val 00:05:40.970 22:43:31 -- accel/accel.sh@21 -- # val= 00:05:40.970 22:43:31 -- accel/accel.sh@22 -- # case "$var" in 00:05:40.970 22:43:31 -- accel/accel.sh@20 -- # IFS=: 00:05:40.970 22:43:31 -- accel/accel.sh@20 -- # read -r var val 00:05:40.970 22:43:31 -- accel/accel.sh@21 -- # val=0xf 00:05:40.970 22:43:31 -- accel/accel.sh@22 -- # case "$var" in 00:05:40.970 22:43:31 -- accel/accel.sh@20 -- # IFS=: 00:05:40.970 22:43:31 -- accel/accel.sh@20 -- # read -r var val 00:05:40.970 22:43:31 -- accel/accel.sh@21 -- # val= 00:05:40.970 22:43:31 -- accel/accel.sh@22 -- # case "$var" in 00:05:40.970 22:43:31 -- accel/accel.sh@20 -- # IFS=: 00:05:40.970 22:43:31 -- accel/accel.sh@20 -- # read -r var val 00:05:40.970 22:43:31 -- accel/accel.sh@21 -- # val= 00:05:40.970 22:43:31 -- accel/accel.sh@22 -- # case "$var" in 00:05:40.970 22:43:31 -- accel/accel.sh@20 -- # IFS=: 00:05:40.970 22:43:31 -- accel/accel.sh@20 -- # read -r var val 00:05:40.970 22:43:31 -- accel/accel.sh@21 -- # val=decompress 00:05:40.970 22:43:31 -- accel/accel.sh@22 -- # case "$var" in 00:05:40.970 22:43:31 -- accel/accel.sh@24 -- # accel_opc=decompress 00:05:40.970 22:43:31 -- accel/accel.sh@20 -- # IFS=: 00:05:40.970 22:43:31 -- accel/accel.sh@20 -- # read -r var val 00:05:40.970 22:43:31 -- accel/accel.sh@21 -- # val='4096 bytes' 00:05:40.970 22:43:31 -- accel/accel.sh@22 -- # case "$var" in 00:05:40.970 22:43:31 -- accel/accel.sh@20 -- # IFS=: 00:05:40.970 22:43:31 -- accel/accel.sh@20 -- # read -r var val 00:05:40.970 22:43:31 -- accel/accel.sh@21 -- # val= 00:05:40.970 22:43:31 -- accel/accel.sh@22 -- # case "$var" in 00:05:40.970 22:43:31 -- accel/accel.sh@20 -- # IFS=: 00:05:40.970 22:43:31 -- accel/accel.sh@20 -- # read -r var val 00:05:40.970 22:43:31 -- accel/accel.sh@21 -- # val=software 00:05:40.970 22:43:31 -- accel/accel.sh@22 -- # case "$var" in 00:05:40.970 22:43:31 -- accel/accel.sh@23 -- # accel_module=software 00:05:40.970 22:43:31 -- accel/accel.sh@20 -- # IFS=: 00:05:40.970 22:43:31 -- accel/accel.sh@20 -- # read -r var val 00:05:40.970 22:43:31 -- accel/accel.sh@21 -- # val=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:05:40.970 22:43:31 -- accel/accel.sh@22 -- # case "$var" in 00:05:40.970 22:43:31 -- accel/accel.sh@20 -- # IFS=: 00:05:40.970 22:43:31 -- accel/accel.sh@20 -- # read -r var val 00:05:40.970 22:43:31 -- accel/accel.sh@21 -- # val=32 00:05:40.970 22:43:31 -- accel/accel.sh@22 -- # case "$var" in 00:05:40.970 22:43:31 -- accel/accel.sh@20 -- # IFS=: 00:05:40.970 22:43:31 -- accel/accel.sh@20 -- # read -r var val 00:05:40.970 22:43:31 -- accel/accel.sh@21 -- # val=32 00:05:40.970 22:43:31 -- accel/accel.sh@22 -- # case "$var" in 00:05:40.970 22:43:31 -- accel/accel.sh@20 -- # IFS=: 00:05:40.970 22:43:31 -- accel/accel.sh@20 -- # read -r var val 00:05:40.970 22:43:31 -- accel/accel.sh@21 -- # val=1 00:05:40.970 22:43:31 -- accel/accel.sh@22 -- # case "$var" in 00:05:40.970 22:43:31 -- accel/accel.sh@20 -- # IFS=: 00:05:40.970 22:43:31 -- accel/accel.sh@20 -- # read -r var val 00:05:40.970 22:43:31 -- accel/accel.sh@21 -- # val='1 seconds' 00:05:40.970 22:43:31 -- accel/accel.sh@22 -- # case "$var" in 00:05:40.970 22:43:31 -- accel/accel.sh@20 -- # IFS=: 00:05:40.970 22:43:31 -- accel/accel.sh@20 -- # read -r var val 00:05:40.970 22:43:31 -- accel/accel.sh@21 -- # val=Yes 00:05:40.970 22:43:31 -- accel/accel.sh@22 -- # case "$var" in 00:05:40.970 22:43:31 -- accel/accel.sh@20 -- # IFS=: 00:05:40.970 22:43:31 -- accel/accel.sh@20 -- # read -r var val 00:05:40.970 22:43:31 -- accel/accel.sh@21 -- # val= 00:05:40.970 22:43:31 -- accel/accel.sh@22 -- # case "$var" in 00:05:40.971 22:43:31 -- accel/accel.sh@20 -- # IFS=: 00:05:40.971 22:43:31 -- accel/accel.sh@20 -- # read -r var val 00:05:40.971 22:43:31 -- accel/accel.sh@21 -- # val= 00:05:40.971 22:43:31 -- accel/accel.sh@22 -- # case "$var" in 00:05:40.971 22:43:31 -- accel/accel.sh@20 -- # IFS=: 00:05:40.971 22:43:31 -- accel/accel.sh@20 -- # read -r var val 00:05:42.346 22:43:33 -- accel/accel.sh@21 -- # val= 00:05:42.346 22:43:33 -- accel/accel.sh@22 -- # case "$var" in 00:05:42.346 22:43:33 -- accel/accel.sh@20 -- # IFS=: 00:05:42.346 22:43:33 -- accel/accel.sh@20 -- # read -r var val 00:05:42.346 22:43:33 -- accel/accel.sh@21 -- # val= 00:05:42.346 22:43:33 -- accel/accel.sh@22 -- # case "$var" in 00:05:42.346 22:43:33 -- accel/accel.sh@20 -- # IFS=: 00:05:42.346 22:43:33 -- accel/accel.sh@20 -- # read -r var val 00:05:42.346 22:43:33 -- accel/accel.sh@21 -- # val= 00:05:42.346 22:43:33 -- accel/accel.sh@22 -- # case "$var" in 00:05:42.346 22:43:33 -- accel/accel.sh@20 -- # IFS=: 00:05:42.346 22:43:33 -- accel/accel.sh@20 -- # read -r var val 00:05:42.346 22:43:33 -- accel/accel.sh@21 -- # val= 00:05:42.346 22:43:33 -- accel/accel.sh@22 -- # case "$var" in 00:05:42.346 22:43:33 -- accel/accel.sh@20 -- # IFS=: 00:05:42.346 22:43:33 -- accel/accel.sh@20 -- # read -r var val 00:05:42.346 22:43:33 -- accel/accel.sh@21 -- # val= 00:05:42.346 22:43:33 -- accel/accel.sh@22 -- # case "$var" in 00:05:42.346 22:43:33 -- accel/accel.sh@20 -- # IFS=: 00:05:42.346 22:43:33 -- accel/accel.sh@20 -- # read -r var val 00:05:42.346 22:43:33 -- accel/accel.sh@21 -- # val= 00:05:42.346 22:43:33 -- accel/accel.sh@22 -- # case "$var" in 00:05:42.346 22:43:33 -- accel/accel.sh@20 -- # IFS=: 00:05:42.346 22:43:33 -- accel/accel.sh@20 -- # read -r var val 00:05:42.346 22:43:33 -- accel/accel.sh@21 -- # val= 00:05:42.346 22:43:33 -- accel/accel.sh@22 -- # case "$var" in 00:05:42.346 22:43:33 -- accel/accel.sh@20 -- # IFS=: 00:05:42.346 22:43:33 -- accel/accel.sh@20 -- # read -r var val 00:05:42.346 22:43:33 -- accel/accel.sh@21 -- # val= 00:05:42.346 22:43:33 -- accel/accel.sh@22 -- # case "$var" in 00:05:42.346 22:43:33 -- accel/accel.sh@20 -- # IFS=: 00:05:42.346 22:43:33 -- accel/accel.sh@20 -- # read -r var val 00:05:42.346 22:43:33 -- accel/accel.sh@21 -- # val= 00:05:42.346 22:43:33 -- accel/accel.sh@22 -- # case "$var" in 00:05:42.346 22:43:33 -- accel/accel.sh@20 -- # IFS=: 00:05:42.346 22:43:33 -- accel/accel.sh@20 -- # read -r var val 00:05:42.346 22:43:33 -- accel/accel.sh@28 -- # [[ -n software ]] 00:05:42.346 22:43:33 -- accel/accel.sh@28 -- # [[ -n decompress ]] 00:05:42.346 22:43:33 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:05:42.346 00:05:42.346 real 0m2.981s 00:05:42.346 user 0m9.591s 00:05:42.346 sys 0m0.298s 00:05:42.346 22:43:33 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:05:42.346 22:43:33 -- common/autotest_common.sh@10 -- # set +x 00:05:42.346 ************************************ 00:05:42.346 END TEST accel_decomp_mcore 00:05:42.346 ************************************ 00:05:42.346 22:43:33 -- accel/accel.sh@112 -- # run_test accel_decomp_full_mcore accel_test -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 -m 0xf 00:05:42.346 22:43:33 -- common/autotest_common.sh@1077 -- # '[' 13 -le 1 ']' 00:05:42.346 22:43:33 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:05:42.346 22:43:33 -- common/autotest_common.sh@10 -- # set +x 00:05:42.347 ************************************ 00:05:42.347 START TEST accel_decomp_full_mcore 00:05:42.347 ************************************ 00:05:42.347 22:43:33 -- common/autotest_common.sh@1104 -- # accel_test -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 -m 0xf 00:05:42.347 22:43:33 -- accel/accel.sh@16 -- # local accel_opc 00:05:42.347 22:43:33 -- accel/accel.sh@17 -- # local accel_module 00:05:42.347 22:43:33 -- accel/accel.sh@18 -- # accel_perf -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 -m 0xf 00:05:42.347 22:43:33 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 -m 0xf 00:05:42.347 22:43:33 -- accel/accel.sh@12 -- # build_accel_config 00:05:42.347 22:43:33 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:05:42.347 22:43:33 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:42.347 22:43:33 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:42.347 22:43:33 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:05:42.347 22:43:33 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:05:42.347 22:43:33 -- accel/accel.sh@41 -- # local IFS=, 00:05:42.347 22:43:33 -- accel/accel.sh@42 -- # jq -r . 00:05:42.347 [2024-04-16 22:43:33.133836] Starting SPDK v24.01.1-pre git sha1 4b134b4ab / DPDK 23.11.0 initialization... 00:05:42.347 [2024-04-16 22:43:33.133916] [ DPDK EAL parameters: accel_perf --no-shconf -c 0xf --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid168883 ] 00:05:42.347 EAL: No free 2048 kB hugepages reported on node 1 00:05:42.347 [2024-04-16 22:43:33.200281] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:05:42.347 [2024-04-16 22:43:33.324490] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:05:42.347 [2024-04-16 22:43:33.324546] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:05:42.347 [2024-04-16 22:43:33.324600] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:05:42.347 [2024-04-16 22:43:33.324603] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:43.731 22:43:34 -- accel/accel.sh@18 -- # out='Preparing input file... 00:05:43.731 00:05:43.731 SPDK Configuration: 00:05:43.731 Core mask: 0xf 00:05:43.731 00:05:43.731 Accel Perf Configuration: 00:05:43.731 Workload Type: decompress 00:05:43.731 Transfer size: 111250 bytes 00:05:43.731 Vector count 1 00:05:43.731 Module: software 00:05:43.731 File Name: /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:05:43.731 Queue depth: 32 00:05:43.731 Allocate depth: 32 00:05:43.731 # threads/core: 1 00:05:43.731 Run time: 1 seconds 00:05:43.731 Verify: Yes 00:05:43.731 00:05:43.731 Running for 1 seconds... 00:05:43.731 00:05:43.731 Core,Thread Transfers Bandwidth Failed Miscompares 00:05:43.731 ------------------------------------------------------------------------------------ 00:05:43.731 0,0 3776/s 155 MiB/s 0 0 00:05:43.731 3,0 3776/s 155 MiB/s 0 0 00:05:43.731 2,0 3776/s 155 MiB/s 0 0 00:05:43.731 1,0 3776/s 155 MiB/s 0 0 00:05:43.731 ==================================================================================== 00:05:43.731 Total 15104/s 1602 MiB/s 0 0' 00:05:43.731 22:43:34 -- accel/accel.sh@20 -- # IFS=: 00:05:43.731 22:43:34 -- accel/accel.sh@15 -- # accel_perf -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 -m 0xf 00:05:43.731 22:43:34 -- accel/accel.sh@20 -- # read -r var val 00:05:43.731 22:43:34 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 -m 0xf 00:05:43.731 22:43:34 -- accel/accel.sh@12 -- # build_accel_config 00:05:43.731 22:43:34 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:05:43.731 22:43:34 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:43.731 22:43:34 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:43.731 22:43:34 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:05:43.731 22:43:34 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:05:43.731 22:43:34 -- accel/accel.sh@41 -- # local IFS=, 00:05:43.731 22:43:34 -- accel/accel.sh@42 -- # jq -r . 00:05:43.731 [2024-04-16 22:43:34.645703] Starting SPDK v24.01.1-pre git sha1 4b134b4ab / DPDK 23.11.0 initialization... 00:05:43.731 [2024-04-16 22:43:34.645787] [ DPDK EAL parameters: accel_perf --no-shconf -c 0xf --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid169045 ] 00:05:43.731 EAL: No free 2048 kB hugepages reported on node 1 00:05:43.731 [2024-04-16 22:43:34.707963] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:05:43.731 [2024-04-16 22:43:34.831934] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:05:43.731 [2024-04-16 22:43:34.831989] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:05:43.732 [2024-04-16 22:43:34.832044] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:05:43.732 [2024-04-16 22:43:34.832048] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:43.990 22:43:34 -- accel/accel.sh@21 -- # val= 00:05:43.990 22:43:34 -- accel/accel.sh@22 -- # case "$var" in 00:05:43.990 22:43:34 -- accel/accel.sh@20 -- # IFS=: 00:05:43.990 22:43:34 -- accel/accel.sh@20 -- # read -r var val 00:05:43.990 22:43:34 -- accel/accel.sh@21 -- # val= 00:05:43.990 22:43:34 -- accel/accel.sh@22 -- # case "$var" in 00:05:43.990 22:43:34 -- accel/accel.sh@20 -- # IFS=: 00:05:43.990 22:43:34 -- accel/accel.sh@20 -- # read -r var val 00:05:43.990 22:43:34 -- accel/accel.sh@21 -- # val= 00:05:43.990 22:43:34 -- accel/accel.sh@22 -- # case "$var" in 00:05:43.990 22:43:34 -- accel/accel.sh@20 -- # IFS=: 00:05:43.990 22:43:34 -- accel/accel.sh@20 -- # read -r var val 00:05:43.990 22:43:34 -- accel/accel.sh@21 -- # val=0xf 00:05:43.990 22:43:34 -- accel/accel.sh@22 -- # case "$var" in 00:05:43.990 22:43:34 -- accel/accel.sh@20 -- # IFS=: 00:05:43.990 22:43:34 -- accel/accel.sh@20 -- # read -r var val 00:05:43.990 22:43:34 -- accel/accel.sh@21 -- # val= 00:05:43.990 22:43:34 -- accel/accel.sh@22 -- # case "$var" in 00:05:43.990 22:43:34 -- accel/accel.sh@20 -- # IFS=: 00:05:43.990 22:43:34 -- accel/accel.sh@20 -- # read -r var val 00:05:43.990 22:43:34 -- accel/accel.sh@21 -- # val= 00:05:43.990 22:43:34 -- accel/accel.sh@22 -- # case "$var" in 00:05:43.990 22:43:34 -- accel/accel.sh@20 -- # IFS=: 00:05:43.990 22:43:34 -- accel/accel.sh@20 -- # read -r var val 00:05:43.990 22:43:34 -- accel/accel.sh@21 -- # val=decompress 00:05:43.990 22:43:34 -- accel/accel.sh@22 -- # case "$var" in 00:05:43.990 22:43:34 -- accel/accel.sh@24 -- # accel_opc=decompress 00:05:43.990 22:43:34 -- accel/accel.sh@20 -- # IFS=: 00:05:43.990 22:43:34 -- accel/accel.sh@20 -- # read -r var val 00:05:43.990 22:43:34 -- accel/accel.sh@21 -- # val='111250 bytes' 00:05:43.990 22:43:34 -- accel/accel.sh@22 -- # case "$var" in 00:05:43.990 22:43:34 -- accel/accel.sh@20 -- # IFS=: 00:05:43.990 22:43:34 -- accel/accel.sh@20 -- # read -r var val 00:05:43.990 22:43:34 -- accel/accel.sh@21 -- # val= 00:05:43.990 22:43:34 -- accel/accel.sh@22 -- # case "$var" in 00:05:43.990 22:43:34 -- accel/accel.sh@20 -- # IFS=: 00:05:43.990 22:43:34 -- accel/accel.sh@20 -- # read -r var val 00:05:43.990 22:43:34 -- accel/accel.sh@21 -- # val=software 00:05:43.990 22:43:34 -- accel/accel.sh@22 -- # case "$var" in 00:05:43.990 22:43:34 -- accel/accel.sh@23 -- # accel_module=software 00:05:43.990 22:43:34 -- accel/accel.sh@20 -- # IFS=: 00:05:43.990 22:43:34 -- accel/accel.sh@20 -- # read -r var val 00:05:43.990 22:43:34 -- accel/accel.sh@21 -- # val=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:05:43.990 22:43:34 -- accel/accel.sh@22 -- # case "$var" in 00:05:43.990 22:43:34 -- accel/accel.sh@20 -- # IFS=: 00:05:43.990 22:43:34 -- accel/accel.sh@20 -- # read -r var val 00:05:43.990 22:43:34 -- accel/accel.sh@21 -- # val=32 00:05:43.990 22:43:34 -- accel/accel.sh@22 -- # case "$var" in 00:05:43.991 22:43:34 -- accel/accel.sh@20 -- # IFS=: 00:05:43.991 22:43:34 -- accel/accel.sh@20 -- # read -r var val 00:05:43.991 22:43:34 -- accel/accel.sh@21 -- # val=32 00:05:43.991 22:43:34 -- accel/accel.sh@22 -- # case "$var" in 00:05:43.991 22:43:34 -- accel/accel.sh@20 -- # IFS=: 00:05:43.991 22:43:34 -- accel/accel.sh@20 -- # read -r var val 00:05:43.991 22:43:34 -- accel/accel.sh@21 -- # val=1 00:05:43.991 22:43:34 -- accel/accel.sh@22 -- # case "$var" in 00:05:43.991 22:43:34 -- accel/accel.sh@20 -- # IFS=: 00:05:43.991 22:43:34 -- accel/accel.sh@20 -- # read -r var val 00:05:43.991 22:43:34 -- accel/accel.sh@21 -- # val='1 seconds' 00:05:43.991 22:43:34 -- accel/accel.sh@22 -- # case "$var" in 00:05:43.991 22:43:34 -- accel/accel.sh@20 -- # IFS=: 00:05:43.991 22:43:34 -- accel/accel.sh@20 -- # read -r var val 00:05:43.991 22:43:34 -- accel/accel.sh@21 -- # val=Yes 00:05:43.991 22:43:34 -- accel/accel.sh@22 -- # case "$var" in 00:05:43.991 22:43:34 -- accel/accel.sh@20 -- # IFS=: 00:05:43.991 22:43:34 -- accel/accel.sh@20 -- # read -r var val 00:05:43.991 22:43:34 -- accel/accel.sh@21 -- # val= 00:05:43.991 22:43:34 -- accel/accel.sh@22 -- # case "$var" in 00:05:43.991 22:43:34 -- accel/accel.sh@20 -- # IFS=: 00:05:43.991 22:43:34 -- accel/accel.sh@20 -- # read -r var val 00:05:43.991 22:43:34 -- accel/accel.sh@21 -- # val= 00:05:43.991 22:43:34 -- accel/accel.sh@22 -- # case "$var" in 00:05:43.991 22:43:34 -- accel/accel.sh@20 -- # IFS=: 00:05:43.991 22:43:34 -- accel/accel.sh@20 -- # read -r var val 00:05:45.367 22:43:36 -- accel/accel.sh@21 -- # val= 00:05:45.367 22:43:36 -- accel/accel.sh@22 -- # case "$var" in 00:05:45.367 22:43:36 -- accel/accel.sh@20 -- # IFS=: 00:05:45.367 22:43:36 -- accel/accel.sh@20 -- # read -r var val 00:05:45.367 22:43:36 -- accel/accel.sh@21 -- # val= 00:05:45.367 22:43:36 -- accel/accel.sh@22 -- # case "$var" in 00:05:45.367 22:43:36 -- accel/accel.sh@20 -- # IFS=: 00:05:45.367 22:43:36 -- accel/accel.sh@20 -- # read -r var val 00:05:45.367 22:43:36 -- accel/accel.sh@21 -- # val= 00:05:45.367 22:43:36 -- accel/accel.sh@22 -- # case "$var" in 00:05:45.367 22:43:36 -- accel/accel.sh@20 -- # IFS=: 00:05:45.367 22:43:36 -- accel/accel.sh@20 -- # read -r var val 00:05:45.367 22:43:36 -- accel/accel.sh@21 -- # val= 00:05:45.367 22:43:36 -- accel/accel.sh@22 -- # case "$var" in 00:05:45.367 22:43:36 -- accel/accel.sh@20 -- # IFS=: 00:05:45.367 22:43:36 -- accel/accel.sh@20 -- # read -r var val 00:05:45.367 22:43:36 -- accel/accel.sh@21 -- # val= 00:05:45.367 22:43:36 -- accel/accel.sh@22 -- # case "$var" in 00:05:45.367 22:43:36 -- accel/accel.sh@20 -- # IFS=: 00:05:45.367 22:43:36 -- accel/accel.sh@20 -- # read -r var val 00:05:45.367 22:43:36 -- accel/accel.sh@21 -- # val= 00:05:45.367 22:43:36 -- accel/accel.sh@22 -- # case "$var" in 00:05:45.367 22:43:36 -- accel/accel.sh@20 -- # IFS=: 00:05:45.367 22:43:36 -- accel/accel.sh@20 -- # read -r var val 00:05:45.367 22:43:36 -- accel/accel.sh@21 -- # val= 00:05:45.367 22:43:36 -- accel/accel.sh@22 -- # case "$var" in 00:05:45.367 22:43:36 -- accel/accel.sh@20 -- # IFS=: 00:05:45.367 22:43:36 -- accel/accel.sh@20 -- # read -r var val 00:05:45.367 22:43:36 -- accel/accel.sh@21 -- # val= 00:05:45.367 22:43:36 -- accel/accel.sh@22 -- # case "$var" in 00:05:45.367 22:43:36 -- accel/accel.sh@20 -- # IFS=: 00:05:45.367 22:43:36 -- accel/accel.sh@20 -- # read -r var val 00:05:45.367 22:43:36 -- accel/accel.sh@21 -- # val= 00:05:45.367 22:43:36 -- accel/accel.sh@22 -- # case "$var" in 00:05:45.367 22:43:36 -- accel/accel.sh@20 -- # IFS=: 00:05:45.367 22:43:36 -- accel/accel.sh@20 -- # read -r var val 00:05:45.367 22:43:36 -- accel/accel.sh@28 -- # [[ -n software ]] 00:05:45.367 22:43:36 -- accel/accel.sh@28 -- # [[ -n decompress ]] 00:05:45.367 22:43:36 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:05:45.367 00:05:45.367 real 0m3.016s 00:05:45.367 user 0m9.699s 00:05:45.367 sys 0m0.311s 00:05:45.367 22:43:36 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:05:45.367 22:43:36 -- common/autotest_common.sh@10 -- # set +x 00:05:45.367 ************************************ 00:05:45.367 END TEST accel_decomp_full_mcore 00:05:45.367 ************************************ 00:05:45.367 22:43:36 -- accel/accel.sh@113 -- # run_test accel_decomp_mthread accel_test -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -T 2 00:05:45.367 22:43:36 -- common/autotest_common.sh@1077 -- # '[' 11 -le 1 ']' 00:05:45.367 22:43:36 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:05:45.367 22:43:36 -- common/autotest_common.sh@10 -- # set +x 00:05:45.367 ************************************ 00:05:45.367 START TEST accel_decomp_mthread 00:05:45.367 ************************************ 00:05:45.367 22:43:36 -- common/autotest_common.sh@1104 -- # accel_test -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -T 2 00:05:45.367 22:43:36 -- accel/accel.sh@16 -- # local accel_opc 00:05:45.367 22:43:36 -- accel/accel.sh@17 -- # local accel_module 00:05:45.367 22:43:36 -- accel/accel.sh@18 -- # accel_perf -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -T 2 00:05:45.368 22:43:36 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -T 2 00:05:45.368 22:43:36 -- accel/accel.sh@12 -- # build_accel_config 00:05:45.368 22:43:36 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:05:45.368 22:43:36 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:45.368 22:43:36 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:45.368 22:43:36 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:05:45.368 22:43:36 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:05:45.368 22:43:36 -- accel/accel.sh@41 -- # local IFS=, 00:05:45.368 22:43:36 -- accel/accel.sh@42 -- # jq -r . 00:05:45.368 [2024-04-16 22:43:36.180052] Starting SPDK v24.01.1-pre git sha1 4b134b4ab / DPDK 23.11.0 initialization... 00:05:45.368 [2024-04-16 22:43:36.180147] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid169207 ] 00:05:45.368 EAL: No free 2048 kB hugepages reported on node 1 00:05:45.368 [2024-04-16 22:43:36.244537] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:45.368 [2024-04-16 22:43:36.359442] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:46.748 22:43:37 -- accel/accel.sh@18 -- # out='Preparing input file... 00:05:46.748 00:05:46.748 SPDK Configuration: 00:05:46.748 Core mask: 0x1 00:05:46.748 00:05:46.748 Accel Perf Configuration: 00:05:46.748 Workload Type: decompress 00:05:46.748 Transfer size: 4096 bytes 00:05:46.748 Vector count 1 00:05:46.748 Module: software 00:05:46.748 File Name: /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:05:46.748 Queue depth: 32 00:05:46.748 Allocate depth: 32 00:05:46.748 # threads/core: 2 00:05:46.748 Run time: 1 seconds 00:05:46.748 Verify: Yes 00:05:46.748 00:05:46.748 Running for 1 seconds... 00:05:46.748 00:05:46.748 Core,Thread Transfers Bandwidth Failed Miscompares 00:05:46.748 ------------------------------------------------------------------------------------ 00:05:46.748 0,1 28096/s 51 MiB/s 0 0 00:05:46.748 0,0 28000/s 51 MiB/s 0 0 00:05:46.748 ==================================================================================== 00:05:46.748 Total 56096/s 219 MiB/s 0 0' 00:05:46.748 22:43:37 -- accel/accel.sh@20 -- # IFS=: 00:05:46.748 22:43:37 -- accel/accel.sh@15 -- # accel_perf -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -T 2 00:05:46.748 22:43:37 -- accel/accel.sh@20 -- # read -r var val 00:05:46.748 22:43:37 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -T 2 00:05:46.748 22:43:37 -- accel/accel.sh@12 -- # build_accel_config 00:05:46.748 22:43:37 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:05:46.748 22:43:37 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:46.748 22:43:37 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:46.748 22:43:37 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:05:46.748 22:43:37 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:05:46.748 22:43:37 -- accel/accel.sh@41 -- # local IFS=, 00:05:46.748 22:43:37 -- accel/accel.sh@42 -- # jq -r . 00:05:46.749 [2024-04-16 22:43:37.654010] Starting SPDK v24.01.1-pre git sha1 4b134b4ab / DPDK 23.11.0 initialization... 00:05:46.749 [2024-04-16 22:43:37.654105] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid169426 ] 00:05:46.749 EAL: No free 2048 kB hugepages reported on node 1 00:05:46.749 [2024-04-16 22:43:37.717970] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:46.749 [2024-04-16 22:43:37.839002] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:47.009 22:43:37 -- accel/accel.sh@21 -- # val= 00:05:47.009 22:43:37 -- accel/accel.sh@22 -- # case "$var" in 00:05:47.009 22:43:37 -- accel/accel.sh@20 -- # IFS=: 00:05:47.009 22:43:37 -- accel/accel.sh@20 -- # read -r var val 00:05:47.009 22:43:37 -- accel/accel.sh@21 -- # val= 00:05:47.009 22:43:37 -- accel/accel.sh@22 -- # case "$var" in 00:05:47.009 22:43:37 -- accel/accel.sh@20 -- # IFS=: 00:05:47.009 22:43:37 -- accel/accel.sh@20 -- # read -r var val 00:05:47.009 22:43:37 -- accel/accel.sh@21 -- # val= 00:05:47.009 22:43:37 -- accel/accel.sh@22 -- # case "$var" in 00:05:47.009 22:43:37 -- accel/accel.sh@20 -- # IFS=: 00:05:47.009 22:43:37 -- accel/accel.sh@20 -- # read -r var val 00:05:47.009 22:43:37 -- accel/accel.sh@21 -- # val=0x1 00:05:47.009 22:43:37 -- accel/accel.sh@22 -- # case "$var" in 00:05:47.009 22:43:37 -- accel/accel.sh@20 -- # IFS=: 00:05:47.009 22:43:37 -- accel/accel.sh@20 -- # read -r var val 00:05:47.009 22:43:37 -- accel/accel.sh@21 -- # val= 00:05:47.009 22:43:37 -- accel/accel.sh@22 -- # case "$var" in 00:05:47.009 22:43:37 -- accel/accel.sh@20 -- # IFS=: 00:05:47.009 22:43:37 -- accel/accel.sh@20 -- # read -r var val 00:05:47.009 22:43:37 -- accel/accel.sh@21 -- # val= 00:05:47.009 22:43:37 -- accel/accel.sh@22 -- # case "$var" in 00:05:47.009 22:43:37 -- accel/accel.sh@20 -- # IFS=: 00:05:47.009 22:43:37 -- accel/accel.sh@20 -- # read -r var val 00:05:47.009 22:43:37 -- accel/accel.sh@21 -- # val=decompress 00:05:47.009 22:43:37 -- accel/accel.sh@22 -- # case "$var" in 00:05:47.009 22:43:37 -- accel/accel.sh@24 -- # accel_opc=decompress 00:05:47.009 22:43:37 -- accel/accel.sh@20 -- # IFS=: 00:05:47.009 22:43:37 -- accel/accel.sh@20 -- # read -r var val 00:05:47.009 22:43:37 -- accel/accel.sh@21 -- # val='4096 bytes' 00:05:47.009 22:43:37 -- accel/accel.sh@22 -- # case "$var" in 00:05:47.009 22:43:37 -- accel/accel.sh@20 -- # IFS=: 00:05:47.009 22:43:37 -- accel/accel.sh@20 -- # read -r var val 00:05:47.009 22:43:37 -- accel/accel.sh@21 -- # val= 00:05:47.009 22:43:37 -- accel/accel.sh@22 -- # case "$var" in 00:05:47.009 22:43:37 -- accel/accel.sh@20 -- # IFS=: 00:05:47.009 22:43:37 -- accel/accel.sh@20 -- # read -r var val 00:05:47.009 22:43:37 -- accel/accel.sh@21 -- # val=software 00:05:47.009 22:43:37 -- accel/accel.sh@22 -- # case "$var" in 00:05:47.009 22:43:37 -- accel/accel.sh@23 -- # accel_module=software 00:05:47.009 22:43:37 -- accel/accel.sh@20 -- # IFS=: 00:05:47.009 22:43:37 -- accel/accel.sh@20 -- # read -r var val 00:05:47.009 22:43:37 -- accel/accel.sh@21 -- # val=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:05:47.009 22:43:37 -- accel/accel.sh@22 -- # case "$var" in 00:05:47.009 22:43:37 -- accel/accel.sh@20 -- # IFS=: 00:05:47.009 22:43:37 -- accel/accel.sh@20 -- # read -r var val 00:05:47.009 22:43:37 -- accel/accel.sh@21 -- # val=32 00:05:47.009 22:43:37 -- accel/accel.sh@22 -- # case "$var" in 00:05:47.009 22:43:37 -- accel/accel.sh@20 -- # IFS=: 00:05:47.009 22:43:37 -- accel/accel.sh@20 -- # read -r var val 00:05:47.009 22:43:37 -- accel/accel.sh@21 -- # val=32 00:05:47.009 22:43:37 -- accel/accel.sh@22 -- # case "$var" in 00:05:47.009 22:43:37 -- accel/accel.sh@20 -- # IFS=: 00:05:47.009 22:43:37 -- accel/accel.sh@20 -- # read -r var val 00:05:47.009 22:43:37 -- accel/accel.sh@21 -- # val=2 00:05:47.009 22:43:37 -- accel/accel.sh@22 -- # case "$var" in 00:05:47.009 22:43:37 -- accel/accel.sh@20 -- # IFS=: 00:05:47.009 22:43:37 -- accel/accel.sh@20 -- # read -r var val 00:05:47.009 22:43:37 -- accel/accel.sh@21 -- # val='1 seconds' 00:05:47.009 22:43:37 -- accel/accel.sh@22 -- # case "$var" in 00:05:47.009 22:43:37 -- accel/accel.sh@20 -- # IFS=: 00:05:47.009 22:43:37 -- accel/accel.sh@20 -- # read -r var val 00:05:47.009 22:43:37 -- accel/accel.sh@21 -- # val=Yes 00:05:47.009 22:43:37 -- accel/accel.sh@22 -- # case "$var" in 00:05:47.009 22:43:37 -- accel/accel.sh@20 -- # IFS=: 00:05:47.009 22:43:37 -- accel/accel.sh@20 -- # read -r var val 00:05:47.009 22:43:37 -- accel/accel.sh@21 -- # val= 00:05:47.009 22:43:37 -- accel/accel.sh@22 -- # case "$var" in 00:05:47.009 22:43:37 -- accel/accel.sh@20 -- # IFS=: 00:05:47.009 22:43:37 -- accel/accel.sh@20 -- # read -r var val 00:05:47.009 22:43:37 -- accel/accel.sh@21 -- # val= 00:05:47.009 22:43:37 -- accel/accel.sh@22 -- # case "$var" in 00:05:47.009 22:43:37 -- accel/accel.sh@20 -- # IFS=: 00:05:47.009 22:43:37 -- accel/accel.sh@20 -- # read -r var val 00:05:48.387 22:43:39 -- accel/accel.sh@21 -- # val= 00:05:48.387 22:43:39 -- accel/accel.sh@22 -- # case "$var" in 00:05:48.387 22:43:39 -- accel/accel.sh@20 -- # IFS=: 00:05:48.387 22:43:39 -- accel/accel.sh@20 -- # read -r var val 00:05:48.387 22:43:39 -- accel/accel.sh@21 -- # val= 00:05:48.387 22:43:39 -- accel/accel.sh@22 -- # case "$var" in 00:05:48.387 22:43:39 -- accel/accel.sh@20 -- # IFS=: 00:05:48.387 22:43:39 -- accel/accel.sh@20 -- # read -r var val 00:05:48.387 22:43:39 -- accel/accel.sh@21 -- # val= 00:05:48.387 22:43:39 -- accel/accel.sh@22 -- # case "$var" in 00:05:48.387 22:43:39 -- accel/accel.sh@20 -- # IFS=: 00:05:48.387 22:43:39 -- accel/accel.sh@20 -- # read -r var val 00:05:48.387 22:43:39 -- accel/accel.sh@21 -- # val= 00:05:48.387 22:43:39 -- accel/accel.sh@22 -- # case "$var" in 00:05:48.387 22:43:39 -- accel/accel.sh@20 -- # IFS=: 00:05:48.387 22:43:39 -- accel/accel.sh@20 -- # read -r var val 00:05:48.387 22:43:39 -- accel/accel.sh@21 -- # val= 00:05:48.387 22:43:39 -- accel/accel.sh@22 -- # case "$var" in 00:05:48.387 22:43:39 -- accel/accel.sh@20 -- # IFS=: 00:05:48.387 22:43:39 -- accel/accel.sh@20 -- # read -r var val 00:05:48.387 22:43:39 -- accel/accel.sh@21 -- # val= 00:05:48.387 22:43:39 -- accel/accel.sh@22 -- # case "$var" in 00:05:48.387 22:43:39 -- accel/accel.sh@20 -- # IFS=: 00:05:48.387 22:43:39 -- accel/accel.sh@20 -- # read -r var val 00:05:48.387 22:43:39 -- accel/accel.sh@21 -- # val= 00:05:48.387 22:43:39 -- accel/accel.sh@22 -- # case "$var" in 00:05:48.387 22:43:39 -- accel/accel.sh@20 -- # IFS=: 00:05:48.387 22:43:39 -- accel/accel.sh@20 -- # read -r var val 00:05:48.387 22:43:39 -- accel/accel.sh@28 -- # [[ -n software ]] 00:05:48.387 22:43:39 -- accel/accel.sh@28 -- # [[ -n decompress ]] 00:05:48.387 22:43:39 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:05:48.387 00:05:48.387 real 0m2.973s 00:05:48.387 user 0m2.662s 00:05:48.387 sys 0m0.302s 00:05:48.387 22:43:39 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:05:48.387 22:43:39 -- common/autotest_common.sh@10 -- # set +x 00:05:48.387 ************************************ 00:05:48.387 END TEST accel_decomp_mthread 00:05:48.387 ************************************ 00:05:48.387 22:43:39 -- accel/accel.sh@114 -- # run_test accel_deomp_full_mthread accel_test -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 -T 2 00:05:48.387 22:43:39 -- common/autotest_common.sh@1077 -- # '[' 13 -le 1 ']' 00:05:48.387 22:43:39 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:05:48.387 22:43:39 -- common/autotest_common.sh@10 -- # set +x 00:05:48.387 ************************************ 00:05:48.387 START TEST accel_deomp_full_mthread 00:05:48.387 ************************************ 00:05:48.387 22:43:39 -- common/autotest_common.sh@1104 -- # accel_test -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 -T 2 00:05:48.387 22:43:39 -- accel/accel.sh@16 -- # local accel_opc 00:05:48.387 22:43:39 -- accel/accel.sh@17 -- # local accel_module 00:05:48.387 22:43:39 -- accel/accel.sh@18 -- # accel_perf -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 -T 2 00:05:48.387 22:43:39 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 -T 2 00:05:48.387 22:43:39 -- accel/accel.sh@12 -- # build_accel_config 00:05:48.387 22:43:39 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:05:48.387 22:43:39 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:48.387 22:43:39 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:48.387 22:43:39 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:05:48.387 22:43:39 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:05:48.387 22:43:39 -- accel/accel.sh@41 -- # local IFS=, 00:05:48.387 22:43:39 -- accel/accel.sh@42 -- # jq -r . 00:05:48.387 [2024-04-16 22:43:39.177834] Starting SPDK v24.01.1-pre git sha1 4b134b4ab / DPDK 23.11.0 initialization... 00:05:48.387 [2024-04-16 22:43:39.177917] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid169631 ] 00:05:48.387 EAL: No free 2048 kB hugepages reported on node 1 00:05:48.387 [2024-04-16 22:43:39.244554] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:48.387 [2024-04-16 22:43:39.365431] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:49.770 22:43:40 -- accel/accel.sh@18 -- # out='Preparing input file... 00:05:49.770 00:05:49.771 SPDK Configuration: 00:05:49.771 Core mask: 0x1 00:05:49.771 00:05:49.771 Accel Perf Configuration: 00:05:49.771 Workload Type: decompress 00:05:49.771 Transfer size: 111250 bytes 00:05:49.771 Vector count 1 00:05:49.771 Module: software 00:05:49.771 File Name: /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:05:49.771 Queue depth: 32 00:05:49.771 Allocate depth: 32 00:05:49.771 # threads/core: 2 00:05:49.771 Run time: 1 seconds 00:05:49.771 Verify: Yes 00:05:49.771 00:05:49.771 Running for 1 seconds... 00:05:49.771 00:05:49.771 Core,Thread Transfers Bandwidth Failed Miscompares 00:05:49.771 ------------------------------------------------------------------------------------ 00:05:49.771 0,1 1920/s 79 MiB/s 0 0 00:05:49.771 0,0 1920/s 79 MiB/s 0 0 00:05:49.771 ==================================================================================== 00:05:49.771 Total 3840/s 407 MiB/s 0 0' 00:05:49.771 22:43:40 -- accel/accel.sh@20 -- # IFS=: 00:05:49.771 22:43:40 -- accel/accel.sh@15 -- # accel_perf -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 -T 2 00:05:49.771 22:43:40 -- accel/accel.sh@20 -- # read -r var val 00:05:49.771 22:43:40 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 -T 2 00:05:49.771 22:43:40 -- accel/accel.sh@12 -- # build_accel_config 00:05:49.771 22:43:40 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:05:49.771 22:43:40 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:49.771 22:43:40 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:49.771 22:43:40 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:05:49.771 22:43:40 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:05:49.771 22:43:40 -- accel/accel.sh@41 -- # local IFS=, 00:05:49.771 22:43:40 -- accel/accel.sh@42 -- # jq -r . 00:05:49.771 [2024-04-16 22:43:40.698668] Starting SPDK v24.01.1-pre git sha1 4b134b4ab / DPDK 23.11.0 initialization... 00:05:49.771 [2024-04-16 22:43:40.698756] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid169777 ] 00:05:49.771 EAL: No free 2048 kB hugepages reported on node 1 00:05:49.771 [2024-04-16 22:43:40.760611] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:49.771 [2024-04-16 22:43:40.881633] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:50.031 22:43:40 -- accel/accel.sh@21 -- # val= 00:05:50.031 22:43:40 -- accel/accel.sh@22 -- # case "$var" in 00:05:50.031 22:43:40 -- accel/accel.sh@20 -- # IFS=: 00:05:50.031 22:43:40 -- accel/accel.sh@20 -- # read -r var val 00:05:50.031 22:43:40 -- accel/accel.sh@21 -- # val= 00:05:50.031 22:43:40 -- accel/accel.sh@22 -- # case "$var" in 00:05:50.031 22:43:40 -- accel/accel.sh@20 -- # IFS=: 00:05:50.031 22:43:40 -- accel/accel.sh@20 -- # read -r var val 00:05:50.031 22:43:40 -- accel/accel.sh@21 -- # val= 00:05:50.031 22:43:40 -- accel/accel.sh@22 -- # case "$var" in 00:05:50.031 22:43:40 -- accel/accel.sh@20 -- # IFS=: 00:05:50.031 22:43:40 -- accel/accel.sh@20 -- # read -r var val 00:05:50.031 22:43:40 -- accel/accel.sh@21 -- # val=0x1 00:05:50.031 22:43:40 -- accel/accel.sh@22 -- # case "$var" in 00:05:50.031 22:43:40 -- accel/accel.sh@20 -- # IFS=: 00:05:50.031 22:43:40 -- accel/accel.sh@20 -- # read -r var val 00:05:50.031 22:43:40 -- accel/accel.sh@21 -- # val= 00:05:50.031 22:43:40 -- accel/accel.sh@22 -- # case "$var" in 00:05:50.031 22:43:40 -- accel/accel.sh@20 -- # IFS=: 00:05:50.031 22:43:40 -- accel/accel.sh@20 -- # read -r var val 00:05:50.031 22:43:40 -- accel/accel.sh@21 -- # val= 00:05:50.031 22:43:40 -- accel/accel.sh@22 -- # case "$var" in 00:05:50.031 22:43:40 -- accel/accel.sh@20 -- # IFS=: 00:05:50.031 22:43:40 -- accel/accel.sh@20 -- # read -r var val 00:05:50.031 22:43:40 -- accel/accel.sh@21 -- # val=decompress 00:05:50.031 22:43:40 -- accel/accel.sh@22 -- # case "$var" in 00:05:50.031 22:43:40 -- accel/accel.sh@24 -- # accel_opc=decompress 00:05:50.031 22:43:40 -- accel/accel.sh@20 -- # IFS=: 00:05:50.031 22:43:40 -- accel/accel.sh@20 -- # read -r var val 00:05:50.031 22:43:40 -- accel/accel.sh@21 -- # val='111250 bytes' 00:05:50.031 22:43:40 -- accel/accel.sh@22 -- # case "$var" in 00:05:50.031 22:43:40 -- accel/accel.sh@20 -- # IFS=: 00:05:50.031 22:43:40 -- accel/accel.sh@20 -- # read -r var val 00:05:50.031 22:43:40 -- accel/accel.sh@21 -- # val= 00:05:50.031 22:43:40 -- accel/accel.sh@22 -- # case "$var" in 00:05:50.031 22:43:40 -- accel/accel.sh@20 -- # IFS=: 00:05:50.031 22:43:40 -- accel/accel.sh@20 -- # read -r var val 00:05:50.031 22:43:40 -- accel/accel.sh@21 -- # val=software 00:05:50.031 22:43:40 -- accel/accel.sh@22 -- # case "$var" in 00:05:50.031 22:43:40 -- accel/accel.sh@23 -- # accel_module=software 00:05:50.031 22:43:40 -- accel/accel.sh@20 -- # IFS=: 00:05:50.031 22:43:40 -- accel/accel.sh@20 -- # read -r var val 00:05:50.032 22:43:40 -- accel/accel.sh@21 -- # val=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:05:50.032 22:43:40 -- accel/accel.sh@22 -- # case "$var" in 00:05:50.032 22:43:40 -- accel/accel.sh@20 -- # IFS=: 00:05:50.032 22:43:40 -- accel/accel.sh@20 -- # read -r var val 00:05:50.032 22:43:40 -- accel/accel.sh@21 -- # val=32 00:05:50.032 22:43:40 -- accel/accel.sh@22 -- # case "$var" in 00:05:50.032 22:43:40 -- accel/accel.sh@20 -- # IFS=: 00:05:50.032 22:43:40 -- accel/accel.sh@20 -- # read -r var val 00:05:50.032 22:43:40 -- accel/accel.sh@21 -- # val=32 00:05:50.032 22:43:40 -- accel/accel.sh@22 -- # case "$var" in 00:05:50.032 22:43:40 -- accel/accel.sh@20 -- # IFS=: 00:05:50.032 22:43:40 -- accel/accel.sh@20 -- # read -r var val 00:05:50.032 22:43:40 -- accel/accel.sh@21 -- # val=2 00:05:50.032 22:43:40 -- accel/accel.sh@22 -- # case "$var" in 00:05:50.032 22:43:40 -- accel/accel.sh@20 -- # IFS=: 00:05:50.032 22:43:40 -- accel/accel.sh@20 -- # read -r var val 00:05:50.032 22:43:40 -- accel/accel.sh@21 -- # val='1 seconds' 00:05:50.032 22:43:40 -- accel/accel.sh@22 -- # case "$var" in 00:05:50.032 22:43:40 -- accel/accel.sh@20 -- # IFS=: 00:05:50.032 22:43:40 -- accel/accel.sh@20 -- # read -r var val 00:05:50.032 22:43:40 -- accel/accel.sh@21 -- # val=Yes 00:05:50.032 22:43:40 -- accel/accel.sh@22 -- # case "$var" in 00:05:50.032 22:43:40 -- accel/accel.sh@20 -- # IFS=: 00:05:50.032 22:43:40 -- accel/accel.sh@20 -- # read -r var val 00:05:50.032 22:43:40 -- accel/accel.sh@21 -- # val= 00:05:50.032 22:43:40 -- accel/accel.sh@22 -- # case "$var" in 00:05:50.032 22:43:40 -- accel/accel.sh@20 -- # IFS=: 00:05:50.032 22:43:40 -- accel/accel.sh@20 -- # read -r var val 00:05:50.032 22:43:40 -- accel/accel.sh@21 -- # val= 00:05:50.032 22:43:40 -- accel/accel.sh@22 -- # case "$var" in 00:05:50.032 22:43:40 -- accel/accel.sh@20 -- # IFS=: 00:05:50.032 22:43:40 -- accel/accel.sh@20 -- # read -r var val 00:05:51.416 22:43:42 -- accel/accel.sh@21 -- # val= 00:05:51.416 22:43:42 -- accel/accel.sh@22 -- # case "$var" in 00:05:51.416 22:43:42 -- accel/accel.sh@20 -- # IFS=: 00:05:51.416 22:43:42 -- accel/accel.sh@20 -- # read -r var val 00:05:51.416 22:43:42 -- accel/accel.sh@21 -- # val= 00:05:51.416 22:43:42 -- accel/accel.sh@22 -- # case "$var" in 00:05:51.416 22:43:42 -- accel/accel.sh@20 -- # IFS=: 00:05:51.416 22:43:42 -- accel/accel.sh@20 -- # read -r var val 00:05:51.416 22:43:42 -- accel/accel.sh@21 -- # val= 00:05:51.416 22:43:42 -- accel/accel.sh@22 -- # case "$var" in 00:05:51.416 22:43:42 -- accel/accel.sh@20 -- # IFS=: 00:05:51.416 22:43:42 -- accel/accel.sh@20 -- # read -r var val 00:05:51.416 22:43:42 -- accel/accel.sh@21 -- # val= 00:05:51.416 22:43:42 -- accel/accel.sh@22 -- # case "$var" in 00:05:51.416 22:43:42 -- accel/accel.sh@20 -- # IFS=: 00:05:51.416 22:43:42 -- accel/accel.sh@20 -- # read -r var val 00:05:51.416 22:43:42 -- accel/accel.sh@21 -- # val= 00:05:51.416 22:43:42 -- accel/accel.sh@22 -- # case "$var" in 00:05:51.416 22:43:42 -- accel/accel.sh@20 -- # IFS=: 00:05:51.416 22:43:42 -- accel/accel.sh@20 -- # read -r var val 00:05:51.416 22:43:42 -- accel/accel.sh@21 -- # val= 00:05:51.416 22:43:42 -- accel/accel.sh@22 -- # case "$var" in 00:05:51.416 22:43:42 -- accel/accel.sh@20 -- # IFS=: 00:05:51.416 22:43:42 -- accel/accel.sh@20 -- # read -r var val 00:05:51.416 22:43:42 -- accel/accel.sh@21 -- # val= 00:05:51.416 22:43:42 -- accel/accel.sh@22 -- # case "$var" in 00:05:51.416 22:43:42 -- accel/accel.sh@20 -- # IFS=: 00:05:51.416 22:43:42 -- accel/accel.sh@20 -- # read -r var val 00:05:51.416 22:43:42 -- accel/accel.sh@28 -- # [[ -n software ]] 00:05:51.416 22:43:42 -- accel/accel.sh@28 -- # [[ -n decompress ]] 00:05:51.416 22:43:42 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:05:51.416 00:05:51.416 real 0m3.043s 00:05:51.416 user 0m2.732s 00:05:51.416 sys 0m0.304s 00:05:51.416 22:43:42 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:05:51.416 22:43:42 -- common/autotest_common.sh@10 -- # set +x 00:05:51.416 ************************************ 00:05:51.416 END TEST accel_deomp_full_mthread 00:05:51.416 ************************************ 00:05:51.416 22:43:42 -- accel/accel.sh@116 -- # [[ n == y ]] 00:05:51.416 22:43:42 -- accel/accel.sh@129 -- # run_test accel_dif_functional_tests /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/dif/dif -c /dev/fd/62 00:05:51.416 22:43:42 -- accel/accel.sh@129 -- # build_accel_config 00:05:51.416 22:43:42 -- common/autotest_common.sh@1077 -- # '[' 4 -le 1 ']' 00:05:51.416 22:43:42 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:05:51.416 22:43:42 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:05:51.416 22:43:42 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:51.416 22:43:42 -- common/autotest_common.sh@10 -- # set +x 00:05:51.416 22:43:42 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:51.416 22:43:42 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:05:51.416 22:43:42 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:05:51.416 22:43:42 -- accel/accel.sh@41 -- # local IFS=, 00:05:51.416 22:43:42 -- accel/accel.sh@42 -- # jq -r . 00:05:51.416 ************************************ 00:05:51.416 START TEST accel_dif_functional_tests 00:05:51.416 ************************************ 00:05:51.416 22:43:42 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/dif/dif -c /dev/fd/62 00:05:51.416 [2024-04-16 22:43:42.262912] Starting SPDK v24.01.1-pre git sha1 4b134b4ab / DPDK 23.11.0 initialization... 00:05:51.416 [2024-04-16 22:43:42.262998] [ DPDK EAL parameters: DIF --no-shconf -c 0x7 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid170059 ] 00:05:51.416 EAL: No free 2048 kB hugepages reported on node 1 00:05:51.416 [2024-04-16 22:43:42.325123] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 3 00:05:51.416 [2024-04-16 22:43:42.446880] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:05:51.416 [2024-04-16 22:43:42.446935] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:05:51.416 [2024-04-16 22:43:42.446939] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:51.676 00:05:51.676 00:05:51.676 CUnit - A unit testing framework for C - Version 2.1-3 00:05:51.676 http://cunit.sourceforge.net/ 00:05:51.676 00:05:51.676 00:05:51.676 Suite: accel_dif 00:05:51.676 Test: verify: DIF generated, GUARD check ...passed 00:05:51.676 Test: verify: DIF generated, APPTAG check ...passed 00:05:51.676 Test: verify: DIF generated, REFTAG check ...passed 00:05:51.676 Test: verify: DIF not generated, GUARD check ...[2024-04-16 22:43:42.549837] dif.c: 777:_dif_verify: *ERROR*: Failed to compare Guard: LBA=10, Expected=5a5a, Actual=7867 00:05:51.676 [2024-04-16 22:43:42.549904] dif.c: 777:_dif_verify: *ERROR*: Failed to compare Guard: LBA=10, Expected=5a5a, Actual=7867 00:05:51.676 passed 00:05:51.676 Test: verify: DIF not generated, APPTAG check ...[2024-04-16 22:43:42.549951] dif.c: 792:_dif_verify: *ERROR*: Failed to compare App Tag: LBA=10, Expected=14, Actual=5a5a 00:05:51.676 [2024-04-16 22:43:42.549981] dif.c: 792:_dif_verify: *ERROR*: Failed to compare App Tag: LBA=10, Expected=14, Actual=5a5a 00:05:51.676 passed 00:05:51.676 Test: verify: DIF not generated, REFTAG check ...[2024-04-16 22:43:42.550018] dif.c: 813:_dif_verify: *ERROR*: Failed to compare Ref Tag: LBA=10, Expected=a, Actual=5a5a5a5a 00:05:51.676 [2024-04-16 22:43:42.550047] dif.c: 813:_dif_verify: *ERROR*: Failed to compare Ref Tag: LBA=10, Expected=a, Actual=5a5a5a5a 00:05:51.676 passed 00:05:51.677 Test: verify: APPTAG correct, APPTAG check ...passed 00:05:51.677 Test: verify: APPTAG incorrect, APPTAG check ...[2024-04-16 22:43:42.550117] dif.c: 792:_dif_verify: *ERROR*: Failed to compare App Tag: LBA=30, Expected=28, Actual=14 00:05:51.677 passed 00:05:51.677 Test: verify: APPTAG incorrect, no APPTAG check ...passed 00:05:51.677 Test: verify: REFTAG incorrect, REFTAG ignore ...passed 00:05:51.677 Test: verify: REFTAG_INIT correct, REFTAG check ...passed 00:05:51.677 Test: verify: REFTAG_INIT incorrect, REFTAG check ...[2024-04-16 22:43:42.550283] dif.c: 813:_dif_verify: *ERROR*: Failed to compare Ref Tag: LBA=10, Expected=a, Actual=10 00:05:51.677 passed 00:05:51.677 Test: generate copy: DIF generated, GUARD check ...passed 00:05:51.677 Test: generate copy: DIF generated, APTTAG check ...passed 00:05:51.677 Test: generate copy: DIF generated, REFTAG check ...passed 00:05:51.677 Test: generate copy: DIF generated, no GUARD check flag set ...passed 00:05:51.677 Test: generate copy: DIF generated, no APPTAG check flag set ...passed 00:05:51.677 Test: generate copy: DIF generated, no REFTAG check flag set ...passed 00:05:51.677 Test: generate copy: iovecs-len validate ...[2024-04-16 22:43:42.550554] dif.c:1167:spdk_dif_generate_copy: *ERROR*: Size of bounce_iovs arrays are not valid or misaligned with block_size. 00:05:51.677 passed 00:05:51.677 Test: generate copy: buffer alignment validate ...passed 00:05:51.677 00:05:51.677 Run Summary: Type Total Ran Passed Failed Inactive 00:05:51.677 suites 1 1 n/a 0 0 00:05:51.677 tests 20 20 20 0 0 00:05:51.677 asserts 204 204 204 0 n/a 00:05:51.677 00:05:51.677 Elapsed time = 0.003 seconds 00:05:51.936 00:05:51.936 real 0m0.595s 00:05:51.936 user 0m0.906s 00:05:51.936 sys 0m0.189s 00:05:51.936 22:43:42 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:05:51.936 22:43:42 -- common/autotest_common.sh@10 -- # set +x 00:05:51.936 ************************************ 00:05:51.936 END TEST accel_dif_functional_tests 00:05:51.936 ************************************ 00:05:51.936 00:05:51.936 real 1m3.182s 00:05:51.936 user 1m11.006s 00:05:51.936 sys 0m7.264s 00:05:51.936 22:43:42 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:05:51.936 22:43:42 -- common/autotest_common.sh@10 -- # set +x 00:05:51.936 ************************************ 00:05:51.936 END TEST accel 00:05:51.936 ************************************ 00:05:51.936 22:43:42 -- spdk/autotest.sh@190 -- # run_test accel_rpc /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/accel_rpc.sh 00:05:51.936 22:43:42 -- common/autotest_common.sh@1077 -- # '[' 2 -le 1 ']' 00:05:51.936 22:43:42 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:05:51.936 22:43:42 -- common/autotest_common.sh@10 -- # set +x 00:05:51.936 ************************************ 00:05:51.936 START TEST accel_rpc 00:05:51.936 ************************************ 00:05:51.936 22:43:42 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/accel_rpc.sh 00:05:51.936 * Looking for test storage... 00:05:51.936 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel 00:05:51.936 22:43:42 -- accel/accel_rpc.sh@11 -- # trap 'killprocess $spdk_tgt_pid; exit 1' ERR 00:05:51.936 22:43:42 -- accel/accel_rpc.sh@14 -- # spdk_tgt_pid=170124 00:05:51.936 22:43:42 -- accel/accel_rpc.sh@13 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt --wait-for-rpc 00:05:51.936 22:43:42 -- accel/accel_rpc.sh@15 -- # waitforlisten 170124 00:05:51.936 22:43:42 -- common/autotest_common.sh@819 -- # '[' -z 170124 ']' 00:05:51.936 22:43:42 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk.sock 00:05:51.936 22:43:42 -- common/autotest_common.sh@824 -- # local max_retries=100 00:05:51.936 22:43:42 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:05:51.936 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:05:51.936 22:43:42 -- common/autotest_common.sh@828 -- # xtrace_disable 00:05:51.936 22:43:42 -- common/autotest_common.sh@10 -- # set +x 00:05:51.936 [2024-04-16 22:43:42.974094] Starting SPDK v24.01.1-pre git sha1 4b134b4ab / DPDK 23.11.0 initialization... 00:05:51.936 [2024-04-16 22:43:42.974205] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid170124 ] 00:05:51.936 EAL: No free 2048 kB hugepages reported on node 1 00:05:51.936 [2024-04-16 22:43:43.032256] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:52.194 [2024-04-16 22:43:43.137582] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:05:52.194 [2024-04-16 22:43:43.137758] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:52.194 22:43:43 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:05:52.194 22:43:43 -- common/autotest_common.sh@852 -- # return 0 00:05:52.194 22:43:43 -- accel/accel_rpc.sh@45 -- # [[ y == y ]] 00:05:52.194 22:43:43 -- accel/accel_rpc.sh@45 -- # [[ 0 -gt 0 ]] 00:05:52.194 22:43:43 -- accel/accel_rpc.sh@49 -- # [[ y == y ]] 00:05:52.194 22:43:43 -- accel/accel_rpc.sh@49 -- # [[ 0 -gt 0 ]] 00:05:52.194 22:43:43 -- accel/accel_rpc.sh@53 -- # run_test accel_assign_opcode accel_assign_opcode_test_suite 00:05:52.194 22:43:43 -- common/autotest_common.sh@1077 -- # '[' 2 -le 1 ']' 00:05:52.194 22:43:43 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:05:52.194 22:43:43 -- common/autotest_common.sh@10 -- # set +x 00:05:52.194 ************************************ 00:05:52.194 START TEST accel_assign_opcode 00:05:52.194 ************************************ 00:05:52.194 22:43:43 -- common/autotest_common.sh@1104 -- # accel_assign_opcode_test_suite 00:05:52.194 22:43:43 -- accel/accel_rpc.sh@38 -- # rpc_cmd accel_assign_opc -o copy -m incorrect 00:05:52.194 22:43:43 -- common/autotest_common.sh@551 -- # xtrace_disable 00:05:52.194 22:43:43 -- common/autotest_common.sh@10 -- # set +x 00:05:52.195 [2024-04-16 22:43:43.174262] accel_rpc.c: 168:rpc_accel_assign_opc: *NOTICE*: Operation copy will be assigned to module incorrect 00:05:52.195 22:43:43 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:05:52.195 22:43:43 -- accel/accel_rpc.sh@40 -- # rpc_cmd accel_assign_opc -o copy -m software 00:05:52.195 22:43:43 -- common/autotest_common.sh@551 -- # xtrace_disable 00:05:52.195 22:43:43 -- common/autotest_common.sh@10 -- # set +x 00:05:52.195 [2024-04-16 22:43:43.182270] accel_rpc.c: 168:rpc_accel_assign_opc: *NOTICE*: Operation copy will be assigned to module software 00:05:52.195 22:43:43 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:05:52.195 22:43:43 -- accel/accel_rpc.sh@41 -- # rpc_cmd framework_start_init 00:05:52.195 22:43:43 -- common/autotest_common.sh@551 -- # xtrace_disable 00:05:52.195 22:43:43 -- common/autotest_common.sh@10 -- # set +x 00:05:52.455 22:43:43 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:05:52.455 22:43:43 -- accel/accel_rpc.sh@42 -- # rpc_cmd accel_get_opc_assignments 00:05:52.455 22:43:43 -- common/autotest_common.sh@551 -- # xtrace_disable 00:05:52.455 22:43:43 -- accel/accel_rpc.sh@42 -- # jq -r .copy 00:05:52.455 22:43:43 -- common/autotest_common.sh@10 -- # set +x 00:05:52.455 22:43:43 -- accel/accel_rpc.sh@42 -- # grep software 00:05:52.455 22:43:43 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:05:52.455 software 00:05:52.455 00:05:52.455 real 0m0.295s 00:05:52.455 user 0m0.037s 00:05:52.455 sys 0m0.007s 00:05:52.455 22:43:43 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:05:52.455 22:43:43 -- common/autotest_common.sh@10 -- # set +x 00:05:52.455 ************************************ 00:05:52.455 END TEST accel_assign_opcode 00:05:52.455 ************************************ 00:05:52.455 22:43:43 -- accel/accel_rpc.sh@55 -- # killprocess 170124 00:05:52.455 22:43:43 -- common/autotest_common.sh@926 -- # '[' -z 170124 ']' 00:05:52.455 22:43:43 -- common/autotest_common.sh@930 -- # kill -0 170124 00:05:52.455 22:43:43 -- common/autotest_common.sh@931 -- # uname 00:05:52.455 22:43:43 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:05:52.455 22:43:43 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 170124 00:05:52.455 22:43:43 -- common/autotest_common.sh@932 -- # process_name=reactor_0 00:05:52.455 22:43:43 -- common/autotest_common.sh@936 -- # '[' reactor_0 = sudo ']' 00:05:52.455 22:43:43 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 170124' 00:05:52.455 killing process with pid 170124 00:05:52.455 22:43:43 -- common/autotest_common.sh@945 -- # kill 170124 00:05:52.455 22:43:43 -- common/autotest_common.sh@950 -- # wait 170124 00:05:53.024 00:05:53.024 real 0m1.120s 00:05:53.024 user 0m1.047s 00:05:53.024 sys 0m0.389s 00:05:53.024 22:43:43 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:05:53.024 22:43:43 -- common/autotest_common.sh@10 -- # set +x 00:05:53.024 ************************************ 00:05:53.024 END TEST accel_rpc 00:05:53.024 ************************************ 00:05:53.024 22:43:44 -- spdk/autotest.sh@191 -- # run_test app_cmdline /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/app/cmdline.sh 00:05:53.024 22:43:44 -- common/autotest_common.sh@1077 -- # '[' 2 -le 1 ']' 00:05:53.024 22:43:44 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:05:53.024 22:43:44 -- common/autotest_common.sh@10 -- # set +x 00:05:53.024 ************************************ 00:05:53.024 START TEST app_cmdline 00:05:53.024 ************************************ 00:05:53.024 22:43:44 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/app/cmdline.sh 00:05:53.024 * Looking for test storage... 00:05:53.024 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/app 00:05:53.024 22:43:44 -- app/cmdline.sh@14 -- # trap 'killprocess $spdk_tgt_pid' EXIT 00:05:53.024 22:43:44 -- app/cmdline.sh@17 -- # spdk_tgt_pid=170327 00:05:53.024 22:43:44 -- app/cmdline.sh@16 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt --rpcs-allowed spdk_get_version,rpc_get_methods 00:05:53.024 22:43:44 -- app/cmdline.sh@18 -- # waitforlisten 170327 00:05:53.024 22:43:44 -- common/autotest_common.sh@819 -- # '[' -z 170327 ']' 00:05:53.024 22:43:44 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk.sock 00:05:53.024 22:43:44 -- common/autotest_common.sh@824 -- # local max_retries=100 00:05:53.024 22:43:44 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:05:53.024 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:05:53.024 22:43:44 -- common/autotest_common.sh@828 -- # xtrace_disable 00:05:53.024 22:43:44 -- common/autotest_common.sh@10 -- # set +x 00:05:53.024 [2024-04-16 22:43:44.125867] Starting SPDK v24.01.1-pre git sha1 4b134b4ab / DPDK 23.11.0 initialization... 00:05:53.024 [2024-04-16 22:43:44.125956] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid170327 ] 00:05:53.285 EAL: No free 2048 kB hugepages reported on node 1 00:05:53.286 [2024-04-16 22:43:44.192453] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:53.286 [2024-04-16 22:43:44.311580] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:05:53.286 [2024-04-16 22:43:44.311759] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:54.226 22:43:45 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:05:54.226 22:43:45 -- common/autotest_common.sh@852 -- # return 0 00:05:54.226 22:43:45 -- app/cmdline.sh@20 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py spdk_get_version 00:05:54.484 { 00:05:54.484 "version": "SPDK v24.01.1-pre git sha1 4b134b4ab", 00:05:54.484 "fields": { 00:05:54.484 "major": 24, 00:05:54.484 "minor": 1, 00:05:54.484 "patch": 1, 00:05:54.484 "suffix": "-pre", 00:05:54.484 "commit": "4b134b4ab" 00:05:54.484 } 00:05:54.484 } 00:05:54.484 22:43:45 -- app/cmdline.sh@22 -- # expected_methods=() 00:05:54.484 22:43:45 -- app/cmdline.sh@23 -- # expected_methods+=("rpc_get_methods") 00:05:54.484 22:43:45 -- app/cmdline.sh@24 -- # expected_methods+=("spdk_get_version") 00:05:54.484 22:43:45 -- app/cmdline.sh@26 -- # methods=($(rpc_cmd rpc_get_methods | jq -r ".[]" | sort)) 00:05:54.484 22:43:45 -- app/cmdline.sh@26 -- # rpc_cmd rpc_get_methods 00:05:54.484 22:43:45 -- common/autotest_common.sh@551 -- # xtrace_disable 00:05:54.484 22:43:45 -- common/autotest_common.sh@10 -- # set +x 00:05:54.484 22:43:45 -- app/cmdline.sh@26 -- # jq -r '.[]' 00:05:54.484 22:43:45 -- app/cmdline.sh@26 -- # sort 00:05:54.484 22:43:45 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:05:54.484 22:43:45 -- app/cmdline.sh@27 -- # (( 2 == 2 )) 00:05:54.484 22:43:45 -- app/cmdline.sh@28 -- # [[ rpc_get_methods spdk_get_version == \r\p\c\_\g\e\t\_\m\e\t\h\o\d\s\ \s\p\d\k\_\g\e\t\_\v\e\r\s\i\o\n ]] 00:05:54.484 22:43:45 -- app/cmdline.sh@30 -- # NOT /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py env_dpdk_get_mem_stats 00:05:54.484 22:43:45 -- common/autotest_common.sh@640 -- # local es=0 00:05:54.484 22:43:45 -- common/autotest_common.sh@642 -- # valid_exec_arg /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py env_dpdk_get_mem_stats 00:05:54.484 22:43:45 -- common/autotest_common.sh@628 -- # local arg=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:05:54.484 22:43:45 -- common/autotest_common.sh@632 -- # case "$(type -t "$arg")" in 00:05:54.484 22:43:45 -- common/autotest_common.sh@632 -- # type -t /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:05:54.484 22:43:45 -- common/autotest_common.sh@632 -- # case "$(type -t "$arg")" in 00:05:54.484 22:43:45 -- common/autotest_common.sh@634 -- # type -P /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:05:54.484 22:43:45 -- common/autotest_common.sh@632 -- # case "$(type -t "$arg")" in 00:05:54.484 22:43:45 -- common/autotest_common.sh@634 -- # arg=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:05:54.484 22:43:45 -- common/autotest_common.sh@634 -- # [[ -x /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py ]] 00:05:54.484 22:43:45 -- common/autotest_common.sh@643 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py env_dpdk_get_mem_stats 00:05:54.744 request: 00:05:54.744 { 00:05:54.744 "method": "env_dpdk_get_mem_stats", 00:05:54.744 "req_id": 1 00:05:54.744 } 00:05:54.744 Got JSON-RPC error response 00:05:54.744 response: 00:05:54.744 { 00:05:54.744 "code": -32601, 00:05:54.744 "message": "Method not found" 00:05:54.744 } 00:05:54.744 22:43:45 -- common/autotest_common.sh@643 -- # es=1 00:05:54.744 22:43:45 -- common/autotest_common.sh@651 -- # (( es > 128 )) 00:05:54.744 22:43:45 -- common/autotest_common.sh@662 -- # [[ -n '' ]] 00:05:54.744 22:43:45 -- common/autotest_common.sh@667 -- # (( !es == 0 )) 00:05:54.744 22:43:45 -- app/cmdline.sh@1 -- # killprocess 170327 00:05:54.744 22:43:45 -- common/autotest_common.sh@926 -- # '[' -z 170327 ']' 00:05:54.744 22:43:45 -- common/autotest_common.sh@930 -- # kill -0 170327 00:05:54.744 22:43:45 -- common/autotest_common.sh@931 -- # uname 00:05:54.744 22:43:45 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:05:54.744 22:43:45 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 170327 00:05:54.744 22:43:45 -- common/autotest_common.sh@932 -- # process_name=reactor_0 00:05:54.744 22:43:45 -- common/autotest_common.sh@936 -- # '[' reactor_0 = sudo ']' 00:05:54.744 22:43:45 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 170327' 00:05:54.744 killing process with pid 170327 00:05:54.744 22:43:45 -- common/autotest_common.sh@945 -- # kill 170327 00:05:54.744 22:43:45 -- common/autotest_common.sh@950 -- # wait 170327 00:05:55.313 00:05:55.313 real 0m2.185s 00:05:55.313 user 0m2.812s 00:05:55.313 sys 0m0.484s 00:05:55.313 22:43:46 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:05:55.313 22:43:46 -- common/autotest_common.sh@10 -- # set +x 00:05:55.313 ************************************ 00:05:55.313 END TEST app_cmdline 00:05:55.313 ************************************ 00:05:55.313 22:43:46 -- spdk/autotest.sh@192 -- # run_test version /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/app/version.sh 00:05:55.313 22:43:46 -- common/autotest_common.sh@1077 -- # '[' 2 -le 1 ']' 00:05:55.313 22:43:46 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:05:55.313 22:43:46 -- common/autotest_common.sh@10 -- # set +x 00:05:55.313 ************************************ 00:05:55.313 START TEST version 00:05:55.313 ************************************ 00:05:55.313 22:43:46 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/app/version.sh 00:05:55.313 * Looking for test storage... 00:05:55.313 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/app 00:05:55.313 22:43:46 -- app/version.sh@17 -- # get_header_version major 00:05:55.313 22:43:46 -- app/version.sh@13 -- # grep -E '^#define SPDK_VERSION_MAJOR[[:space:]]+' /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/include/spdk/version.h 00:05:55.313 22:43:46 -- app/version.sh@14 -- # cut -f2 00:05:55.313 22:43:46 -- app/version.sh@14 -- # tr -d '"' 00:05:55.313 22:43:46 -- app/version.sh@17 -- # major=24 00:05:55.314 22:43:46 -- app/version.sh@18 -- # get_header_version minor 00:05:55.314 22:43:46 -- app/version.sh@13 -- # grep -E '^#define SPDK_VERSION_MINOR[[:space:]]+' /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/include/spdk/version.h 00:05:55.314 22:43:46 -- app/version.sh@14 -- # cut -f2 00:05:55.314 22:43:46 -- app/version.sh@14 -- # tr -d '"' 00:05:55.314 22:43:46 -- app/version.sh@18 -- # minor=1 00:05:55.314 22:43:46 -- app/version.sh@19 -- # get_header_version patch 00:05:55.314 22:43:46 -- app/version.sh@13 -- # grep -E '^#define SPDK_VERSION_PATCH[[:space:]]+' /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/include/spdk/version.h 00:05:55.314 22:43:46 -- app/version.sh@14 -- # cut -f2 00:05:55.314 22:43:46 -- app/version.sh@14 -- # tr -d '"' 00:05:55.314 22:43:46 -- app/version.sh@19 -- # patch=1 00:05:55.314 22:43:46 -- app/version.sh@20 -- # get_header_version suffix 00:05:55.314 22:43:46 -- app/version.sh@13 -- # grep -E '^#define SPDK_VERSION_SUFFIX[[:space:]]+' /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/include/spdk/version.h 00:05:55.314 22:43:46 -- app/version.sh@14 -- # cut -f2 00:05:55.314 22:43:46 -- app/version.sh@14 -- # tr -d '"' 00:05:55.314 22:43:46 -- app/version.sh@20 -- # suffix=-pre 00:05:55.314 22:43:46 -- app/version.sh@22 -- # version=24.1 00:05:55.314 22:43:46 -- app/version.sh@25 -- # (( patch != 0 )) 00:05:55.314 22:43:46 -- app/version.sh@25 -- # version=24.1.1 00:05:55.314 22:43:46 -- app/version.sh@28 -- # version=24.1.1rc0 00:05:55.314 22:43:46 -- app/version.sh@30 -- # PYTHONPATH=:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/python:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc_plugins:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/python:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc_plugins:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/python 00:05:55.314 22:43:46 -- app/version.sh@30 -- # python3 -c 'import spdk; print(spdk.__version__)' 00:05:55.314 22:43:46 -- app/version.sh@30 -- # py_version=24.1.1rc0 00:05:55.314 22:43:46 -- app/version.sh@31 -- # [[ 24.1.1rc0 == \2\4\.\1\.\1\r\c\0 ]] 00:05:55.314 00:05:55.314 real 0m0.102s 00:05:55.314 user 0m0.056s 00:05:55.314 sys 0m0.069s 00:05:55.314 22:43:46 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:05:55.314 22:43:46 -- common/autotest_common.sh@10 -- # set +x 00:05:55.314 ************************************ 00:05:55.314 END TEST version 00:05:55.314 ************************************ 00:05:55.314 22:43:46 -- spdk/autotest.sh@194 -- # '[' 0 -eq 1 ']' 00:05:55.314 22:43:46 -- spdk/autotest.sh@204 -- # uname -s 00:05:55.314 22:43:46 -- spdk/autotest.sh@204 -- # [[ Linux == Linux ]] 00:05:55.314 22:43:46 -- spdk/autotest.sh@205 -- # [[ 0 -eq 1 ]] 00:05:55.314 22:43:46 -- spdk/autotest.sh@205 -- # [[ 0 -eq 1 ]] 00:05:55.314 22:43:46 -- spdk/autotest.sh@217 -- # '[' 0 -eq 1 ']' 00:05:55.314 22:43:46 -- spdk/autotest.sh@264 -- # '[' 0 -eq 1 ']' 00:05:55.314 22:43:46 -- spdk/autotest.sh@268 -- # timing_exit lib 00:05:55.314 22:43:46 -- common/autotest_common.sh@718 -- # xtrace_disable 00:05:55.314 22:43:46 -- common/autotest_common.sh@10 -- # set +x 00:05:55.314 22:43:46 -- spdk/autotest.sh@270 -- # '[' 0 -eq 1 ']' 00:05:55.314 22:43:46 -- spdk/autotest.sh@278 -- # '[' 0 -eq 1 ']' 00:05:55.314 22:43:46 -- spdk/autotest.sh@287 -- # '[' 1 -eq 1 ']' 00:05:55.314 22:43:46 -- spdk/autotest.sh@288 -- # export NET_TYPE 00:05:55.314 22:43:46 -- spdk/autotest.sh@291 -- # '[' tcp = rdma ']' 00:05:55.314 22:43:46 -- spdk/autotest.sh@294 -- # '[' tcp = tcp ']' 00:05:55.314 22:43:46 -- spdk/autotest.sh@295 -- # run_test nvmf_tcp /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/nvmf.sh --transport=tcp 00:05:55.314 22:43:46 -- common/autotest_common.sh@1077 -- # '[' 3 -le 1 ']' 00:05:55.314 22:43:46 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:05:55.314 22:43:46 -- common/autotest_common.sh@10 -- # set +x 00:05:55.314 ************************************ 00:05:55.314 START TEST nvmf_tcp 00:05:55.314 ************************************ 00:05:55.314 22:43:46 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/nvmf.sh --transport=tcp 00:05:55.314 * Looking for test storage... 00:05:55.314 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf 00:05:55.314 22:43:46 -- nvmf/nvmf.sh@10 -- # uname -s 00:05:55.314 22:43:46 -- nvmf/nvmf.sh@10 -- # '[' '!' Linux = Linux ']' 00:05:55.314 22:43:46 -- nvmf/nvmf.sh@14 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:05:55.314 22:43:46 -- nvmf/common.sh@7 -- # uname -s 00:05:55.314 22:43:46 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:05:55.314 22:43:46 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:05:55.314 22:43:46 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:05:55.314 22:43:46 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:05:55.314 22:43:46 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:05:55.314 22:43:46 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:05:55.314 22:43:46 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:05:55.314 22:43:46 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:05:55.314 22:43:46 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:05:55.314 22:43:46 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:05:55.574 22:43:46 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:05:55.574 22:43:46 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:05:55.574 22:43:46 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:05:55.574 22:43:46 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:05:55.574 22:43:46 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:05:55.574 22:43:46 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:05:55.574 22:43:46 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:05:55.574 22:43:46 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:05:55.574 22:43:46 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:05:55.574 22:43:46 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:05:55.574 22:43:46 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:05:55.574 22:43:46 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:05:55.574 22:43:46 -- paths/export.sh@5 -- # export PATH 00:05:55.574 22:43:46 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:05:55.574 22:43:46 -- nvmf/common.sh@46 -- # : 0 00:05:55.574 22:43:46 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:05:55.574 22:43:46 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:05:55.574 22:43:46 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:05:55.574 22:43:46 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:05:55.574 22:43:46 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:05:55.574 22:43:46 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:05:55.574 22:43:46 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:05:55.574 22:43:46 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:05:55.574 22:43:46 -- nvmf/nvmf.sh@16 -- # trap 'exit 1' SIGINT SIGTERM EXIT 00:05:55.574 22:43:46 -- nvmf/nvmf.sh@18 -- # TEST_ARGS=("$@") 00:05:55.574 22:43:46 -- nvmf/nvmf.sh@20 -- # timing_enter target 00:05:55.574 22:43:46 -- common/autotest_common.sh@712 -- # xtrace_disable 00:05:55.574 22:43:46 -- common/autotest_common.sh@10 -- # set +x 00:05:55.574 22:43:46 -- nvmf/nvmf.sh@22 -- # [[ 0 -eq 0 ]] 00:05:55.574 22:43:46 -- nvmf/nvmf.sh@23 -- # run_test nvmf_example /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/nvmf_example.sh --transport=tcp 00:05:55.574 22:43:46 -- common/autotest_common.sh@1077 -- # '[' 3 -le 1 ']' 00:05:55.574 22:43:46 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:05:55.574 22:43:46 -- common/autotest_common.sh@10 -- # set +x 00:05:55.574 ************************************ 00:05:55.574 START TEST nvmf_example 00:05:55.574 ************************************ 00:05:55.574 22:43:46 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/nvmf_example.sh --transport=tcp 00:05:55.574 * Looking for test storage... 00:05:55.574 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:05:55.574 22:43:46 -- target/nvmf_example.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:05:55.574 22:43:46 -- nvmf/common.sh@7 -- # uname -s 00:05:55.574 22:43:46 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:05:55.574 22:43:46 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:05:55.574 22:43:46 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:05:55.574 22:43:46 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:05:55.574 22:43:46 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:05:55.574 22:43:46 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:05:55.574 22:43:46 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:05:55.574 22:43:46 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:05:55.574 22:43:46 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:05:55.574 22:43:46 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:05:55.574 22:43:46 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:05:55.574 22:43:46 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:05:55.574 22:43:46 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:05:55.574 22:43:46 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:05:55.574 22:43:46 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:05:55.574 22:43:46 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:05:55.574 22:43:46 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:05:55.574 22:43:46 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:05:55.574 22:43:46 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:05:55.574 22:43:46 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:05:55.574 22:43:46 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:05:55.574 22:43:46 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:05:55.574 22:43:46 -- paths/export.sh@5 -- # export PATH 00:05:55.574 22:43:46 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:05:55.574 22:43:46 -- nvmf/common.sh@46 -- # : 0 00:05:55.574 22:43:46 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:05:55.574 22:43:46 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:05:55.575 22:43:46 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:05:55.575 22:43:46 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:05:55.575 22:43:46 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:05:55.575 22:43:46 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:05:55.575 22:43:46 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:05:55.575 22:43:46 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:05:55.575 22:43:46 -- target/nvmf_example.sh@11 -- # NVMF_EXAMPLE=("$SPDK_EXAMPLE_DIR/nvmf") 00:05:55.575 22:43:46 -- target/nvmf_example.sh@13 -- # MALLOC_BDEV_SIZE=64 00:05:55.575 22:43:46 -- target/nvmf_example.sh@14 -- # MALLOC_BLOCK_SIZE=512 00:05:55.575 22:43:46 -- target/nvmf_example.sh@24 -- # build_nvmf_example_args 00:05:55.575 22:43:46 -- target/nvmf_example.sh@17 -- # '[' 0 -eq 1 ']' 00:05:55.575 22:43:46 -- target/nvmf_example.sh@20 -- # NVMF_EXAMPLE+=(-i "$NVMF_APP_SHM_ID" -g 10000) 00:05:55.575 22:43:46 -- target/nvmf_example.sh@21 -- # NVMF_EXAMPLE+=("${NO_HUGE[@]}") 00:05:55.575 22:43:46 -- target/nvmf_example.sh@40 -- # timing_enter nvmf_example_test 00:05:55.575 22:43:46 -- common/autotest_common.sh@712 -- # xtrace_disable 00:05:55.575 22:43:46 -- common/autotest_common.sh@10 -- # set +x 00:05:55.575 22:43:46 -- target/nvmf_example.sh@41 -- # nvmftestinit 00:05:55.575 22:43:46 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:05:55.575 22:43:46 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:05:55.575 22:43:46 -- nvmf/common.sh@436 -- # prepare_net_devs 00:05:55.575 22:43:46 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:05:55.575 22:43:46 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:05:55.575 22:43:46 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:05:55.575 22:43:46 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:05:55.575 22:43:46 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:05:55.575 22:43:46 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:05:55.575 22:43:46 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:05:55.575 22:43:46 -- nvmf/common.sh@284 -- # xtrace_disable 00:05:55.575 22:43:46 -- common/autotest_common.sh@10 -- # set +x 00:05:57.517 22:43:48 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:05:57.517 22:43:48 -- nvmf/common.sh@290 -- # pci_devs=() 00:05:57.517 22:43:48 -- nvmf/common.sh@290 -- # local -a pci_devs 00:05:57.517 22:43:48 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:05:57.517 22:43:48 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:05:57.517 22:43:48 -- nvmf/common.sh@292 -- # pci_drivers=() 00:05:57.517 22:43:48 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:05:57.517 22:43:48 -- nvmf/common.sh@294 -- # net_devs=() 00:05:57.517 22:43:48 -- nvmf/common.sh@294 -- # local -ga net_devs 00:05:57.517 22:43:48 -- nvmf/common.sh@295 -- # e810=() 00:05:57.517 22:43:48 -- nvmf/common.sh@295 -- # local -ga e810 00:05:57.517 22:43:48 -- nvmf/common.sh@296 -- # x722=() 00:05:57.517 22:43:48 -- nvmf/common.sh@296 -- # local -ga x722 00:05:57.517 22:43:48 -- nvmf/common.sh@297 -- # mlx=() 00:05:57.517 22:43:48 -- nvmf/common.sh@297 -- # local -ga mlx 00:05:57.517 22:43:48 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:05:57.517 22:43:48 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:05:57.517 22:43:48 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:05:57.517 22:43:48 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:05:57.517 22:43:48 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:05:57.517 22:43:48 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:05:57.517 22:43:48 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:05:57.517 22:43:48 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:05:57.517 22:43:48 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:05:57.517 22:43:48 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:05:57.517 22:43:48 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:05:57.517 22:43:48 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:05:57.517 22:43:48 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:05:57.518 22:43:48 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:05:57.518 22:43:48 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:05:57.518 22:43:48 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:05:57.518 22:43:48 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:05:57.518 22:43:48 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:05:57.518 22:43:48 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:05:57.518 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:05:57.518 22:43:48 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:05:57.518 22:43:48 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:05:57.518 22:43:48 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:05:57.518 22:43:48 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:05:57.518 22:43:48 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:05:57.518 22:43:48 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:05:57.518 22:43:48 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:05:57.518 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:05:57.518 22:43:48 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:05:57.518 22:43:48 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:05:57.518 22:43:48 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:05:57.518 22:43:48 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:05:57.518 22:43:48 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:05:57.518 22:43:48 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:05:57.518 22:43:48 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:05:57.518 22:43:48 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:05:57.518 22:43:48 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:05:57.518 22:43:48 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:05:57.518 22:43:48 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:05:57.518 22:43:48 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:05:57.518 22:43:48 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:05:57.518 Found net devices under 0000:0a:00.0: cvl_0_0 00:05:57.518 22:43:48 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:05:57.518 22:43:48 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:05:57.518 22:43:48 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:05:57.518 22:43:48 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:05:57.518 22:43:48 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:05:57.518 22:43:48 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:05:57.518 Found net devices under 0000:0a:00.1: cvl_0_1 00:05:57.518 22:43:48 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:05:57.518 22:43:48 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:05:57.518 22:43:48 -- nvmf/common.sh@402 -- # is_hw=yes 00:05:57.518 22:43:48 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:05:57.518 22:43:48 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:05:57.518 22:43:48 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:05:57.518 22:43:48 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:05:57.518 22:43:48 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:05:57.518 22:43:48 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:05:57.518 22:43:48 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:05:57.518 22:43:48 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:05:57.518 22:43:48 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:05:57.518 22:43:48 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:05:57.518 22:43:48 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:05:57.518 22:43:48 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:05:57.518 22:43:48 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:05:57.518 22:43:48 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:05:57.518 22:43:48 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:05:57.518 22:43:48 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:05:57.518 22:43:48 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:05:57.518 22:43:48 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:05:57.518 22:43:48 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:05:57.518 22:43:48 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:05:57.518 22:43:48 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:05:57.518 22:43:48 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:05:57.518 22:43:48 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:05:57.518 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:05:57.518 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.209 ms 00:05:57.518 00:05:57.518 --- 10.0.0.2 ping statistics --- 00:05:57.518 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:05:57.518 rtt min/avg/max/mdev = 0.209/0.209/0.209/0.000 ms 00:05:57.518 22:43:48 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:05:57.518 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:05:57.518 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.097 ms 00:05:57.518 00:05:57.518 --- 10.0.0.1 ping statistics --- 00:05:57.518 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:05:57.518 rtt min/avg/max/mdev = 0.097/0.097/0.097/0.000 ms 00:05:57.518 22:43:48 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:05:57.518 22:43:48 -- nvmf/common.sh@410 -- # return 0 00:05:57.518 22:43:48 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:05:57.518 22:43:48 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:05:57.518 22:43:48 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:05:57.518 22:43:48 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:05:57.518 22:43:48 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:05:57.518 22:43:48 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:05:57.518 22:43:48 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:05:57.518 22:43:48 -- target/nvmf_example.sh@42 -- # nvmfexamplestart '-m 0xF' 00:05:57.518 22:43:48 -- target/nvmf_example.sh@27 -- # timing_enter start_nvmf_example 00:05:57.518 22:43:48 -- common/autotest_common.sh@712 -- # xtrace_disable 00:05:57.518 22:43:48 -- common/autotest_common.sh@10 -- # set +x 00:05:57.518 22:43:48 -- target/nvmf_example.sh@29 -- # '[' tcp == tcp ']' 00:05:57.518 22:43:48 -- target/nvmf_example.sh@30 -- # NVMF_EXAMPLE=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_EXAMPLE[@]}") 00:05:57.518 22:43:48 -- target/nvmf_example.sh@34 -- # nvmfpid=172363 00:05:57.518 22:43:48 -- target/nvmf_example.sh@33 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/nvmf -i 0 -g 10000 -m 0xF 00:05:57.518 22:43:48 -- target/nvmf_example.sh@35 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:05:57.518 22:43:48 -- target/nvmf_example.sh@36 -- # waitforlisten 172363 00:05:57.518 22:43:48 -- common/autotest_common.sh@819 -- # '[' -z 172363 ']' 00:05:57.518 22:43:48 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk.sock 00:05:57.518 22:43:48 -- common/autotest_common.sh@824 -- # local max_retries=100 00:05:57.518 22:43:48 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:05:57.518 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:05:57.518 22:43:48 -- common/autotest_common.sh@828 -- # xtrace_disable 00:05:57.518 22:43:48 -- common/autotest_common.sh@10 -- # set +x 00:05:57.518 EAL: No free 2048 kB hugepages reported on node 1 00:05:58.453 22:43:49 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:05:58.453 22:43:49 -- common/autotest_common.sh@852 -- # return 0 00:05:58.453 22:43:49 -- target/nvmf_example.sh@37 -- # timing_exit start_nvmf_example 00:05:58.453 22:43:49 -- common/autotest_common.sh@718 -- # xtrace_disable 00:05:58.453 22:43:49 -- common/autotest_common.sh@10 -- # set +x 00:05:58.453 22:43:49 -- target/nvmf_example.sh@45 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:05:58.453 22:43:49 -- common/autotest_common.sh@551 -- # xtrace_disable 00:05:58.453 22:43:49 -- common/autotest_common.sh@10 -- # set +x 00:05:58.453 22:43:49 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:05:58.453 22:43:49 -- target/nvmf_example.sh@47 -- # rpc_cmd bdev_malloc_create 64 512 00:05:58.454 22:43:49 -- common/autotest_common.sh@551 -- # xtrace_disable 00:05:58.454 22:43:49 -- common/autotest_common.sh@10 -- # set +x 00:05:58.454 22:43:49 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:05:58.454 22:43:49 -- target/nvmf_example.sh@47 -- # malloc_bdevs='Malloc0 ' 00:05:58.454 22:43:49 -- target/nvmf_example.sh@49 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:05:58.454 22:43:49 -- common/autotest_common.sh@551 -- # xtrace_disable 00:05:58.454 22:43:49 -- common/autotest_common.sh@10 -- # set +x 00:05:58.454 22:43:49 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:05:58.454 22:43:49 -- target/nvmf_example.sh@52 -- # for malloc_bdev in $malloc_bdevs 00:05:58.454 22:43:49 -- target/nvmf_example.sh@53 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:05:58.454 22:43:49 -- common/autotest_common.sh@551 -- # xtrace_disable 00:05:58.454 22:43:49 -- common/autotest_common.sh@10 -- # set +x 00:05:58.454 22:43:49 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:05:58.454 22:43:49 -- target/nvmf_example.sh@57 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:05:58.454 22:43:49 -- common/autotest_common.sh@551 -- # xtrace_disable 00:05:58.454 22:43:49 -- common/autotest_common.sh@10 -- # set +x 00:05:58.454 22:43:49 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:05:58.454 22:43:49 -- target/nvmf_example.sh@59 -- # perf=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf 00:05:58.454 22:43:49 -- target/nvmf_example.sh@61 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -q 64 -o 4096 -w randrw -M 30 -t 10 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1' 00:05:58.454 EAL: No free 2048 kB hugepages reported on node 1 00:06:10.675 Initializing NVMe Controllers 00:06:10.675 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:06:10.675 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 0 00:06:10.675 Initialization complete. Launching workers. 00:06:10.675 ======================================================== 00:06:10.675 Latency(us) 00:06:10.675 Device Information : IOPS MiB/s Average min max 00:06:10.675 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 0: 15722.52 61.42 4071.37 885.04 16458.63 00:06:10.675 ======================================================== 00:06:10.675 Total : 15722.52 61.42 4071.37 885.04 16458.63 00:06:10.675 00:06:10.675 22:43:59 -- target/nvmf_example.sh@65 -- # trap - SIGINT SIGTERM EXIT 00:06:10.675 22:43:59 -- target/nvmf_example.sh@66 -- # nvmftestfini 00:06:10.675 22:43:59 -- nvmf/common.sh@476 -- # nvmfcleanup 00:06:10.675 22:43:59 -- nvmf/common.sh@116 -- # sync 00:06:10.675 22:43:59 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:06:10.675 22:43:59 -- nvmf/common.sh@119 -- # set +e 00:06:10.675 22:43:59 -- nvmf/common.sh@120 -- # for i in {1..20} 00:06:10.675 22:43:59 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:06:10.675 rmmod nvme_tcp 00:06:10.675 rmmod nvme_fabrics 00:06:10.675 rmmod nvme_keyring 00:06:10.675 22:43:59 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:06:10.675 22:43:59 -- nvmf/common.sh@123 -- # set -e 00:06:10.675 22:43:59 -- nvmf/common.sh@124 -- # return 0 00:06:10.675 22:43:59 -- nvmf/common.sh@477 -- # '[' -n 172363 ']' 00:06:10.675 22:43:59 -- nvmf/common.sh@478 -- # killprocess 172363 00:06:10.675 22:43:59 -- common/autotest_common.sh@926 -- # '[' -z 172363 ']' 00:06:10.675 22:43:59 -- common/autotest_common.sh@930 -- # kill -0 172363 00:06:10.675 22:43:59 -- common/autotest_common.sh@931 -- # uname 00:06:10.675 22:43:59 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:06:10.675 22:43:59 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 172363 00:06:10.675 22:43:59 -- common/autotest_common.sh@932 -- # process_name=nvmf 00:06:10.675 22:43:59 -- common/autotest_common.sh@936 -- # '[' nvmf = sudo ']' 00:06:10.675 22:43:59 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 172363' 00:06:10.675 killing process with pid 172363 00:06:10.675 22:43:59 -- common/autotest_common.sh@945 -- # kill 172363 00:06:10.675 22:43:59 -- common/autotest_common.sh@950 -- # wait 172363 00:06:10.675 nvmf threads initialize successfully 00:06:10.675 bdev subsystem init successfully 00:06:10.675 created a nvmf target service 00:06:10.675 create targets's poll groups done 00:06:10.675 all subsystems of target started 00:06:10.675 nvmf target is running 00:06:10.675 all subsystems of target stopped 00:06:10.675 destroy targets's poll groups done 00:06:10.675 destroyed the nvmf target service 00:06:10.675 bdev subsystem finish successfully 00:06:10.675 nvmf threads destroy successfully 00:06:10.675 22:44:00 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:06:10.675 22:44:00 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:06:10.675 22:44:00 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:06:10.675 22:44:00 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:06:10.675 22:44:00 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:06:10.675 22:44:00 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:06:10.675 22:44:00 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:06:10.675 22:44:00 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:06:11.246 22:44:02 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:06:11.246 22:44:02 -- target/nvmf_example.sh@67 -- # timing_exit nvmf_example_test 00:06:11.246 22:44:02 -- common/autotest_common.sh@718 -- # xtrace_disable 00:06:11.246 22:44:02 -- common/autotest_common.sh@10 -- # set +x 00:06:11.246 00:06:11.246 real 0m15.722s 00:06:11.246 user 0m45.129s 00:06:11.246 sys 0m3.117s 00:06:11.246 22:44:02 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:06:11.246 22:44:02 -- common/autotest_common.sh@10 -- # set +x 00:06:11.246 ************************************ 00:06:11.246 END TEST nvmf_example 00:06:11.246 ************************************ 00:06:11.246 22:44:02 -- nvmf/nvmf.sh@24 -- # run_test nvmf_filesystem /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/filesystem.sh --transport=tcp 00:06:11.246 22:44:02 -- common/autotest_common.sh@1077 -- # '[' 3 -le 1 ']' 00:06:11.246 22:44:02 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:06:11.246 22:44:02 -- common/autotest_common.sh@10 -- # set +x 00:06:11.246 ************************************ 00:06:11.246 START TEST nvmf_filesystem 00:06:11.246 ************************************ 00:06:11.246 22:44:02 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/filesystem.sh --transport=tcp 00:06:11.246 * Looking for test storage... 00:06:11.246 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:06:11.246 22:44:02 -- target/filesystem.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/autotest_common.sh 00:06:11.246 22:44:02 -- common/autotest_common.sh@7 -- # rpc_py=rpc_cmd 00:06:11.246 22:44:02 -- common/autotest_common.sh@34 -- # set -e 00:06:11.246 22:44:02 -- common/autotest_common.sh@35 -- # shopt -s nullglob 00:06:11.246 22:44:02 -- common/autotest_common.sh@36 -- # shopt -s extglob 00:06:11.246 22:44:02 -- common/autotest_common.sh@38 -- # [[ -e /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/build_config.sh ]] 00:06:11.246 22:44:02 -- common/autotest_common.sh@39 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/build_config.sh 00:06:11.246 22:44:02 -- common/build_config.sh@1 -- # CONFIG_WPDK_DIR= 00:06:11.246 22:44:02 -- common/build_config.sh@2 -- # CONFIG_ASAN=n 00:06:11.246 22:44:02 -- common/build_config.sh@3 -- # CONFIG_VBDEV_COMPRESS=n 00:06:11.246 22:44:02 -- common/build_config.sh@4 -- # CONFIG_HAVE_EXECINFO_H=y 00:06:11.246 22:44:02 -- common/build_config.sh@5 -- # CONFIG_USDT=n 00:06:11.246 22:44:02 -- common/build_config.sh@6 -- # CONFIG_CUSTOMOCF=n 00:06:11.246 22:44:02 -- common/build_config.sh@7 -- # CONFIG_PREFIX=/usr/local 00:06:11.246 22:44:02 -- common/build_config.sh@8 -- # CONFIG_RBD=n 00:06:11.246 22:44:02 -- common/build_config.sh@9 -- # CONFIG_LIBDIR= 00:06:11.246 22:44:02 -- common/build_config.sh@10 -- # CONFIG_IDXD=y 00:06:11.246 22:44:02 -- common/build_config.sh@11 -- # CONFIG_NVME_CUSE=y 00:06:11.246 22:44:02 -- common/build_config.sh@12 -- # CONFIG_SMA=n 00:06:11.246 22:44:02 -- common/build_config.sh@13 -- # CONFIG_VTUNE=n 00:06:11.246 22:44:02 -- common/build_config.sh@14 -- # CONFIG_TSAN=n 00:06:11.246 22:44:02 -- common/build_config.sh@15 -- # CONFIG_RDMA_SEND_WITH_INVAL=y 00:06:11.246 22:44:02 -- common/build_config.sh@16 -- # CONFIG_VFIO_USER_DIR= 00:06:11.246 22:44:02 -- common/build_config.sh@17 -- # CONFIG_PGO_CAPTURE=n 00:06:11.246 22:44:02 -- common/build_config.sh@18 -- # CONFIG_HAVE_UUID_GENERATE_SHA1=y 00:06:11.246 22:44:02 -- common/build_config.sh@19 -- # CONFIG_ENV=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/env_dpdk 00:06:11.246 22:44:02 -- common/build_config.sh@20 -- # CONFIG_LTO=n 00:06:11.246 22:44:02 -- common/build_config.sh@21 -- # CONFIG_ISCSI_INITIATOR=y 00:06:11.246 22:44:02 -- common/build_config.sh@22 -- # CONFIG_CET=n 00:06:11.246 22:44:02 -- common/build_config.sh@23 -- # CONFIG_VBDEV_COMPRESS_MLX5=n 00:06:11.246 22:44:02 -- common/build_config.sh@24 -- # CONFIG_OCF_PATH= 00:06:11.246 22:44:02 -- common/build_config.sh@25 -- # CONFIG_RDMA_SET_TOS=y 00:06:11.246 22:44:02 -- common/build_config.sh@26 -- # CONFIG_HAVE_ARC4RANDOM=y 00:06:11.246 22:44:02 -- common/build_config.sh@27 -- # CONFIG_HAVE_LIBARCHIVE=n 00:06:11.246 22:44:02 -- common/build_config.sh@28 -- # CONFIG_UBLK=y 00:06:11.246 22:44:02 -- common/build_config.sh@29 -- # CONFIG_ISAL_CRYPTO=y 00:06:11.246 22:44:02 -- common/build_config.sh@30 -- # CONFIG_OPENSSL_PATH= 00:06:11.246 22:44:02 -- common/build_config.sh@31 -- # CONFIG_OCF=n 00:06:11.246 22:44:02 -- common/build_config.sh@32 -- # CONFIG_FUSE=n 00:06:11.246 22:44:02 -- common/build_config.sh@33 -- # CONFIG_VTUNE_DIR= 00:06:11.246 22:44:02 -- common/build_config.sh@34 -- # CONFIG_FUZZER_LIB= 00:06:11.246 22:44:02 -- common/build_config.sh@35 -- # CONFIG_FUZZER=n 00:06:11.246 22:44:02 -- common/build_config.sh@36 -- # CONFIG_DPDK_DIR=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/dpdk/build 00:06:11.246 22:44:02 -- common/build_config.sh@37 -- # CONFIG_CRYPTO=n 00:06:11.246 22:44:02 -- common/build_config.sh@38 -- # CONFIG_PGO_USE=n 00:06:11.246 22:44:02 -- common/build_config.sh@39 -- # CONFIG_VHOST=y 00:06:11.246 22:44:02 -- common/build_config.sh@40 -- # CONFIG_DAOS=n 00:06:11.246 22:44:02 -- common/build_config.sh@41 -- # CONFIG_DPDK_INC_DIR= 00:06:11.246 22:44:02 -- common/build_config.sh@42 -- # CONFIG_DAOS_DIR= 00:06:11.246 22:44:02 -- common/build_config.sh@43 -- # CONFIG_UNIT_TESTS=n 00:06:11.246 22:44:02 -- common/build_config.sh@44 -- # CONFIG_RDMA_SET_ACK_TIMEOUT=y 00:06:11.246 22:44:02 -- common/build_config.sh@45 -- # CONFIG_VIRTIO=y 00:06:11.246 22:44:02 -- common/build_config.sh@46 -- # CONFIG_COVERAGE=y 00:06:11.246 22:44:02 -- common/build_config.sh@47 -- # CONFIG_RDMA=y 00:06:11.246 22:44:02 -- common/build_config.sh@48 -- # CONFIG_FIO_SOURCE_DIR=/usr/src/fio 00:06:11.246 22:44:02 -- common/build_config.sh@49 -- # CONFIG_URING_PATH= 00:06:11.246 22:44:02 -- common/build_config.sh@50 -- # CONFIG_XNVME=n 00:06:11.246 22:44:02 -- common/build_config.sh@51 -- # CONFIG_VFIO_USER=n 00:06:11.246 22:44:02 -- common/build_config.sh@52 -- # CONFIG_ARCH=native 00:06:11.247 22:44:02 -- common/build_config.sh@53 -- # CONFIG_URING_ZNS=n 00:06:11.247 22:44:02 -- common/build_config.sh@54 -- # CONFIG_WERROR=y 00:06:11.247 22:44:02 -- common/build_config.sh@55 -- # CONFIG_HAVE_LIBBSD=n 00:06:11.247 22:44:02 -- common/build_config.sh@56 -- # CONFIG_UBSAN=y 00:06:11.247 22:44:02 -- common/build_config.sh@57 -- # CONFIG_IPSEC_MB_DIR= 00:06:11.247 22:44:02 -- common/build_config.sh@58 -- # CONFIG_GOLANG=n 00:06:11.247 22:44:02 -- common/build_config.sh@59 -- # CONFIG_ISAL=y 00:06:11.247 22:44:02 -- common/build_config.sh@60 -- # CONFIG_IDXD_KERNEL=n 00:06:11.247 22:44:02 -- common/build_config.sh@61 -- # CONFIG_DPDK_LIB_DIR= 00:06:11.247 22:44:02 -- common/build_config.sh@62 -- # CONFIG_RDMA_PROV=verbs 00:06:11.247 22:44:02 -- common/build_config.sh@63 -- # CONFIG_APPS=y 00:06:11.247 22:44:02 -- common/build_config.sh@64 -- # CONFIG_SHARED=y 00:06:11.247 22:44:02 -- common/build_config.sh@65 -- # CONFIG_FC_PATH= 00:06:11.247 22:44:02 -- common/build_config.sh@66 -- # CONFIG_DPDK_PKG_CONFIG=n 00:06:11.247 22:44:02 -- common/build_config.sh@67 -- # CONFIG_FC=n 00:06:11.247 22:44:02 -- common/build_config.sh@68 -- # CONFIG_AVAHI=n 00:06:11.247 22:44:02 -- common/build_config.sh@69 -- # CONFIG_FIO_PLUGIN=y 00:06:11.247 22:44:02 -- common/build_config.sh@70 -- # CONFIG_RAID5F=n 00:06:11.247 22:44:02 -- common/build_config.sh@71 -- # CONFIG_EXAMPLES=y 00:06:11.247 22:44:02 -- common/build_config.sh@72 -- # CONFIG_TESTS=y 00:06:11.247 22:44:02 -- common/build_config.sh@73 -- # CONFIG_CRYPTO_MLX5=n 00:06:11.247 22:44:02 -- common/build_config.sh@74 -- # CONFIG_MAX_LCORES= 00:06:11.247 22:44:02 -- common/build_config.sh@75 -- # CONFIG_IPSEC_MB=n 00:06:11.247 22:44:02 -- common/build_config.sh@76 -- # CONFIG_DEBUG=y 00:06:11.247 22:44:02 -- common/build_config.sh@77 -- # CONFIG_DPDK_COMPRESSDEV=n 00:06:11.247 22:44:02 -- common/build_config.sh@78 -- # CONFIG_CROSS_PREFIX= 00:06:11.247 22:44:02 -- common/build_config.sh@79 -- # CONFIG_URING=n 00:06:11.247 22:44:02 -- common/autotest_common.sh@48 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/applications.sh 00:06:11.247 22:44:02 -- common/applications.sh@8 -- # dirname /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/applications.sh 00:06:11.247 22:44:02 -- common/applications.sh@8 -- # readlink -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common 00:06:11.247 22:44:02 -- common/applications.sh@8 -- # _root=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common 00:06:11.247 22:44:02 -- common/applications.sh@9 -- # _root=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:06:11.247 22:44:02 -- common/applications.sh@10 -- # _app_dir=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin 00:06:11.247 22:44:02 -- common/applications.sh@11 -- # _test_app_dir=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/app 00:06:11.247 22:44:02 -- common/applications.sh@12 -- # _examples_dir=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples 00:06:11.247 22:44:02 -- common/applications.sh@14 -- # VHOST_FUZZ_APP=("$_test_app_dir/fuzz/vhost_fuzz/vhost_fuzz") 00:06:11.247 22:44:02 -- common/applications.sh@15 -- # ISCSI_APP=("$_app_dir/iscsi_tgt") 00:06:11.247 22:44:02 -- common/applications.sh@16 -- # NVMF_APP=("$_app_dir/nvmf_tgt") 00:06:11.247 22:44:02 -- common/applications.sh@17 -- # VHOST_APP=("$_app_dir/vhost") 00:06:11.247 22:44:02 -- common/applications.sh@18 -- # DD_APP=("$_app_dir/spdk_dd") 00:06:11.247 22:44:02 -- common/applications.sh@19 -- # SPDK_APP=("$_app_dir/spdk_tgt") 00:06:11.247 22:44:02 -- common/applications.sh@22 -- # [[ -e /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/include/spdk/config.h ]] 00:06:11.247 22:44:02 -- common/applications.sh@23 -- # [[ #ifndef SPDK_CONFIG_H 00:06:11.247 #define SPDK_CONFIG_H 00:06:11.247 #define SPDK_CONFIG_APPS 1 00:06:11.247 #define SPDK_CONFIG_ARCH native 00:06:11.247 #undef SPDK_CONFIG_ASAN 00:06:11.247 #undef SPDK_CONFIG_AVAHI 00:06:11.247 #undef SPDK_CONFIG_CET 00:06:11.247 #define SPDK_CONFIG_COVERAGE 1 00:06:11.247 #define SPDK_CONFIG_CROSS_PREFIX 00:06:11.247 #undef SPDK_CONFIG_CRYPTO 00:06:11.247 #undef SPDK_CONFIG_CRYPTO_MLX5 00:06:11.247 #undef SPDK_CONFIG_CUSTOMOCF 00:06:11.247 #undef SPDK_CONFIG_DAOS 00:06:11.247 #define SPDK_CONFIG_DAOS_DIR 00:06:11.247 #define SPDK_CONFIG_DEBUG 1 00:06:11.247 #undef SPDK_CONFIG_DPDK_COMPRESSDEV 00:06:11.247 #define SPDK_CONFIG_DPDK_DIR /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/dpdk/build 00:06:11.247 #define SPDK_CONFIG_DPDK_INC_DIR 00:06:11.247 #define SPDK_CONFIG_DPDK_LIB_DIR 00:06:11.247 #undef SPDK_CONFIG_DPDK_PKG_CONFIG 00:06:11.247 #define SPDK_CONFIG_ENV /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/env_dpdk 00:06:11.247 #define SPDK_CONFIG_EXAMPLES 1 00:06:11.247 #undef SPDK_CONFIG_FC 00:06:11.247 #define SPDK_CONFIG_FC_PATH 00:06:11.247 #define SPDK_CONFIG_FIO_PLUGIN 1 00:06:11.247 #define SPDK_CONFIG_FIO_SOURCE_DIR /usr/src/fio 00:06:11.247 #undef SPDK_CONFIG_FUSE 00:06:11.247 #undef SPDK_CONFIG_FUZZER 00:06:11.247 #define SPDK_CONFIG_FUZZER_LIB 00:06:11.247 #undef SPDK_CONFIG_GOLANG 00:06:11.247 #define SPDK_CONFIG_HAVE_ARC4RANDOM 1 00:06:11.247 #define SPDK_CONFIG_HAVE_EXECINFO_H 1 00:06:11.247 #undef SPDK_CONFIG_HAVE_LIBARCHIVE 00:06:11.247 #undef SPDK_CONFIG_HAVE_LIBBSD 00:06:11.247 #define SPDK_CONFIG_HAVE_UUID_GENERATE_SHA1 1 00:06:11.247 #define SPDK_CONFIG_IDXD 1 00:06:11.247 #undef SPDK_CONFIG_IDXD_KERNEL 00:06:11.247 #undef SPDK_CONFIG_IPSEC_MB 00:06:11.247 #define SPDK_CONFIG_IPSEC_MB_DIR 00:06:11.247 #define SPDK_CONFIG_ISAL 1 00:06:11.247 #define SPDK_CONFIG_ISAL_CRYPTO 1 00:06:11.247 #define SPDK_CONFIG_ISCSI_INITIATOR 1 00:06:11.247 #define SPDK_CONFIG_LIBDIR 00:06:11.247 #undef SPDK_CONFIG_LTO 00:06:11.247 #define SPDK_CONFIG_MAX_LCORES 00:06:11.247 #define SPDK_CONFIG_NVME_CUSE 1 00:06:11.247 #undef SPDK_CONFIG_OCF 00:06:11.247 #define SPDK_CONFIG_OCF_PATH 00:06:11.247 #define SPDK_CONFIG_OPENSSL_PATH 00:06:11.247 #undef SPDK_CONFIG_PGO_CAPTURE 00:06:11.247 #undef SPDK_CONFIG_PGO_USE 00:06:11.247 #define SPDK_CONFIG_PREFIX /usr/local 00:06:11.247 #undef SPDK_CONFIG_RAID5F 00:06:11.247 #undef SPDK_CONFIG_RBD 00:06:11.247 #define SPDK_CONFIG_RDMA 1 00:06:11.247 #define SPDK_CONFIG_RDMA_PROV verbs 00:06:11.247 #define SPDK_CONFIG_RDMA_SEND_WITH_INVAL 1 00:06:11.247 #define SPDK_CONFIG_RDMA_SET_ACK_TIMEOUT 1 00:06:11.247 #define SPDK_CONFIG_RDMA_SET_TOS 1 00:06:11.247 #define SPDK_CONFIG_SHARED 1 00:06:11.247 #undef SPDK_CONFIG_SMA 00:06:11.247 #define SPDK_CONFIG_TESTS 1 00:06:11.247 #undef SPDK_CONFIG_TSAN 00:06:11.247 #define SPDK_CONFIG_UBLK 1 00:06:11.247 #define SPDK_CONFIG_UBSAN 1 00:06:11.247 #undef SPDK_CONFIG_UNIT_TESTS 00:06:11.247 #undef SPDK_CONFIG_URING 00:06:11.247 #define SPDK_CONFIG_URING_PATH 00:06:11.247 #undef SPDK_CONFIG_URING_ZNS 00:06:11.247 #undef SPDK_CONFIG_USDT 00:06:11.247 #undef SPDK_CONFIG_VBDEV_COMPRESS 00:06:11.247 #undef SPDK_CONFIG_VBDEV_COMPRESS_MLX5 00:06:11.247 #undef SPDK_CONFIG_VFIO_USER 00:06:11.247 #define SPDK_CONFIG_VFIO_USER_DIR 00:06:11.247 #define SPDK_CONFIG_VHOST 1 00:06:11.247 #define SPDK_CONFIG_VIRTIO 1 00:06:11.247 #undef SPDK_CONFIG_VTUNE 00:06:11.247 #define SPDK_CONFIG_VTUNE_DIR 00:06:11.247 #define SPDK_CONFIG_WERROR 1 00:06:11.247 #define SPDK_CONFIG_WPDK_DIR 00:06:11.247 #undef SPDK_CONFIG_XNVME 00:06:11.247 #endif /* SPDK_CONFIG_H */ == *\#\d\e\f\i\n\e\ \S\P\D\K\_\C\O\N\F\I\G\_\D\E\B\U\G* ]] 00:06:11.247 22:44:02 -- common/applications.sh@24 -- # (( SPDK_AUTOTEST_DEBUG_APPS )) 00:06:11.247 22:44:02 -- common/autotest_common.sh@49 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:06:11.247 22:44:02 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:06:11.247 22:44:02 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:06:11.247 22:44:02 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:06:11.247 22:44:02 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:06:11.247 22:44:02 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:06:11.247 22:44:02 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:06:11.247 22:44:02 -- paths/export.sh@5 -- # export PATH 00:06:11.247 22:44:02 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:06:11.247 22:44:02 -- common/autotest_common.sh@50 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/perf/pm/common 00:06:11.247 22:44:02 -- pm/common@6 -- # dirname /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/perf/pm/common 00:06:11.247 22:44:02 -- pm/common@6 -- # readlink -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/perf/pm 00:06:11.247 22:44:02 -- pm/common@6 -- # _pmdir=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/perf/pm 00:06:11.247 22:44:02 -- pm/common@7 -- # readlink -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/perf/pm/../../../ 00:06:11.247 22:44:02 -- pm/common@7 -- # _pmrootdir=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:06:11.247 22:44:02 -- pm/common@16 -- # TEST_TAG=N/A 00:06:11.247 22:44:02 -- pm/common@17 -- # TEST_TAG_FILE=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/.run_test_name 00:06:11.247 22:44:02 -- common/autotest_common.sh@52 -- # : 1 00:06:11.247 22:44:02 -- common/autotest_common.sh@53 -- # export RUN_NIGHTLY 00:06:11.247 22:44:02 -- common/autotest_common.sh@56 -- # : 0 00:06:11.248 22:44:02 -- common/autotest_common.sh@57 -- # export SPDK_AUTOTEST_DEBUG_APPS 00:06:11.248 22:44:02 -- common/autotest_common.sh@58 -- # : 0 00:06:11.248 22:44:02 -- common/autotest_common.sh@59 -- # export SPDK_RUN_VALGRIND 00:06:11.248 22:44:02 -- common/autotest_common.sh@60 -- # : 1 00:06:11.248 22:44:02 -- common/autotest_common.sh@61 -- # export SPDK_RUN_FUNCTIONAL_TEST 00:06:11.248 22:44:02 -- common/autotest_common.sh@62 -- # : 0 00:06:11.248 22:44:02 -- common/autotest_common.sh@63 -- # export SPDK_TEST_UNITTEST 00:06:11.248 22:44:02 -- common/autotest_common.sh@64 -- # : 00:06:11.248 22:44:02 -- common/autotest_common.sh@65 -- # export SPDK_TEST_AUTOBUILD 00:06:11.248 22:44:02 -- common/autotest_common.sh@66 -- # : 0 00:06:11.248 22:44:02 -- common/autotest_common.sh@67 -- # export SPDK_TEST_RELEASE_BUILD 00:06:11.248 22:44:02 -- common/autotest_common.sh@68 -- # : 0 00:06:11.248 22:44:02 -- common/autotest_common.sh@69 -- # export SPDK_TEST_ISAL 00:06:11.248 22:44:02 -- common/autotest_common.sh@70 -- # : 0 00:06:11.248 22:44:02 -- common/autotest_common.sh@71 -- # export SPDK_TEST_ISCSI 00:06:11.248 22:44:02 -- common/autotest_common.sh@72 -- # : 0 00:06:11.248 22:44:02 -- common/autotest_common.sh@73 -- # export SPDK_TEST_ISCSI_INITIATOR 00:06:11.248 22:44:02 -- common/autotest_common.sh@74 -- # : 0 00:06:11.248 22:44:02 -- common/autotest_common.sh@75 -- # export SPDK_TEST_NVME 00:06:11.248 22:44:02 -- common/autotest_common.sh@76 -- # : 0 00:06:11.248 22:44:02 -- common/autotest_common.sh@77 -- # export SPDK_TEST_NVME_PMR 00:06:11.248 22:44:02 -- common/autotest_common.sh@78 -- # : 0 00:06:11.248 22:44:02 -- common/autotest_common.sh@79 -- # export SPDK_TEST_NVME_BP 00:06:11.248 22:44:02 -- common/autotest_common.sh@80 -- # : 1 00:06:11.248 22:44:02 -- common/autotest_common.sh@81 -- # export SPDK_TEST_NVME_CLI 00:06:11.248 22:44:02 -- common/autotest_common.sh@82 -- # : 0 00:06:11.248 22:44:02 -- common/autotest_common.sh@83 -- # export SPDK_TEST_NVME_CUSE 00:06:11.248 22:44:02 -- common/autotest_common.sh@84 -- # : 0 00:06:11.248 22:44:02 -- common/autotest_common.sh@85 -- # export SPDK_TEST_NVME_FDP 00:06:11.248 22:44:02 -- common/autotest_common.sh@86 -- # : 1 00:06:11.248 22:44:02 -- common/autotest_common.sh@87 -- # export SPDK_TEST_NVMF 00:06:11.248 22:44:02 -- common/autotest_common.sh@88 -- # : 0 00:06:11.248 22:44:02 -- common/autotest_common.sh@89 -- # export SPDK_TEST_VFIOUSER 00:06:11.248 22:44:02 -- common/autotest_common.sh@90 -- # : 0 00:06:11.248 22:44:02 -- common/autotest_common.sh@91 -- # export SPDK_TEST_VFIOUSER_QEMU 00:06:11.248 22:44:02 -- common/autotest_common.sh@92 -- # : 0 00:06:11.248 22:44:02 -- common/autotest_common.sh@93 -- # export SPDK_TEST_FUZZER 00:06:11.248 22:44:02 -- common/autotest_common.sh@94 -- # : 0 00:06:11.248 22:44:02 -- common/autotest_common.sh@95 -- # export SPDK_TEST_FUZZER_SHORT 00:06:11.248 22:44:02 -- common/autotest_common.sh@96 -- # : tcp 00:06:11.248 22:44:02 -- common/autotest_common.sh@97 -- # export SPDK_TEST_NVMF_TRANSPORT 00:06:11.248 22:44:02 -- common/autotest_common.sh@98 -- # : 0 00:06:11.248 22:44:02 -- common/autotest_common.sh@99 -- # export SPDK_TEST_RBD 00:06:11.248 22:44:02 -- common/autotest_common.sh@100 -- # : 0 00:06:11.248 22:44:02 -- common/autotest_common.sh@101 -- # export SPDK_TEST_VHOST 00:06:11.248 22:44:02 -- common/autotest_common.sh@102 -- # : 0 00:06:11.248 22:44:02 -- common/autotest_common.sh@103 -- # export SPDK_TEST_BLOCKDEV 00:06:11.248 22:44:02 -- common/autotest_common.sh@104 -- # : 0 00:06:11.248 22:44:02 -- common/autotest_common.sh@105 -- # export SPDK_TEST_IOAT 00:06:11.248 22:44:02 -- common/autotest_common.sh@106 -- # : 0 00:06:11.248 22:44:02 -- common/autotest_common.sh@107 -- # export SPDK_TEST_BLOBFS 00:06:11.248 22:44:02 -- common/autotest_common.sh@108 -- # : 0 00:06:11.248 22:44:02 -- common/autotest_common.sh@109 -- # export SPDK_TEST_VHOST_INIT 00:06:11.248 22:44:02 -- common/autotest_common.sh@110 -- # : 0 00:06:11.248 22:44:02 -- common/autotest_common.sh@111 -- # export SPDK_TEST_LVOL 00:06:11.248 22:44:02 -- common/autotest_common.sh@112 -- # : 0 00:06:11.248 22:44:02 -- common/autotest_common.sh@113 -- # export SPDK_TEST_VBDEV_COMPRESS 00:06:11.248 22:44:02 -- common/autotest_common.sh@114 -- # : 0 00:06:11.248 22:44:02 -- common/autotest_common.sh@115 -- # export SPDK_RUN_ASAN 00:06:11.248 22:44:02 -- common/autotest_common.sh@116 -- # : 1 00:06:11.248 22:44:02 -- common/autotest_common.sh@117 -- # export SPDK_RUN_UBSAN 00:06:11.248 22:44:02 -- common/autotest_common.sh@118 -- # : 00:06:11.248 22:44:02 -- common/autotest_common.sh@119 -- # export SPDK_RUN_EXTERNAL_DPDK 00:06:11.248 22:44:02 -- common/autotest_common.sh@120 -- # : 0 00:06:11.248 22:44:02 -- common/autotest_common.sh@121 -- # export SPDK_RUN_NON_ROOT 00:06:11.248 22:44:02 -- common/autotest_common.sh@122 -- # : 0 00:06:11.248 22:44:02 -- common/autotest_common.sh@123 -- # export SPDK_TEST_CRYPTO 00:06:11.248 22:44:02 -- common/autotest_common.sh@124 -- # : 0 00:06:11.248 22:44:02 -- common/autotest_common.sh@125 -- # export SPDK_TEST_FTL 00:06:11.248 22:44:02 -- common/autotest_common.sh@126 -- # : 0 00:06:11.248 22:44:02 -- common/autotest_common.sh@127 -- # export SPDK_TEST_OCF 00:06:11.248 22:44:02 -- common/autotest_common.sh@128 -- # : 0 00:06:11.248 22:44:02 -- common/autotest_common.sh@129 -- # export SPDK_TEST_VMD 00:06:11.248 22:44:02 -- common/autotest_common.sh@130 -- # : 0 00:06:11.248 22:44:02 -- common/autotest_common.sh@131 -- # export SPDK_TEST_OPAL 00:06:11.248 22:44:02 -- common/autotest_common.sh@132 -- # : 00:06:11.248 22:44:02 -- common/autotest_common.sh@133 -- # export SPDK_TEST_NATIVE_DPDK 00:06:11.248 22:44:02 -- common/autotest_common.sh@134 -- # : true 00:06:11.248 22:44:02 -- common/autotest_common.sh@135 -- # export SPDK_AUTOTEST_X 00:06:11.248 22:44:02 -- common/autotest_common.sh@136 -- # : 0 00:06:11.248 22:44:02 -- common/autotest_common.sh@137 -- # export SPDK_TEST_RAID5 00:06:11.248 22:44:02 -- common/autotest_common.sh@138 -- # : 0 00:06:11.248 22:44:02 -- common/autotest_common.sh@139 -- # export SPDK_TEST_URING 00:06:11.248 22:44:02 -- common/autotest_common.sh@140 -- # : 0 00:06:11.248 22:44:02 -- common/autotest_common.sh@141 -- # export SPDK_TEST_USDT 00:06:11.248 22:44:02 -- common/autotest_common.sh@142 -- # : 0 00:06:11.248 22:44:02 -- common/autotest_common.sh@143 -- # export SPDK_TEST_USE_IGB_UIO 00:06:11.248 22:44:02 -- common/autotest_common.sh@144 -- # : 0 00:06:11.248 22:44:02 -- common/autotest_common.sh@145 -- # export SPDK_TEST_SCHEDULER 00:06:11.248 22:44:02 -- common/autotest_common.sh@146 -- # : 0 00:06:11.248 22:44:02 -- common/autotest_common.sh@147 -- # export SPDK_TEST_SCANBUILD 00:06:11.248 22:44:02 -- common/autotest_common.sh@148 -- # : e810 00:06:11.248 22:44:02 -- common/autotest_common.sh@149 -- # export SPDK_TEST_NVMF_NICS 00:06:11.248 22:44:02 -- common/autotest_common.sh@150 -- # : 0 00:06:11.248 22:44:02 -- common/autotest_common.sh@151 -- # export SPDK_TEST_SMA 00:06:11.248 22:44:02 -- common/autotest_common.sh@152 -- # : 0 00:06:11.248 22:44:02 -- common/autotest_common.sh@153 -- # export SPDK_TEST_DAOS 00:06:11.248 22:44:02 -- common/autotest_common.sh@154 -- # : 0 00:06:11.248 22:44:02 -- common/autotest_common.sh@155 -- # export SPDK_TEST_XNVME 00:06:11.248 22:44:02 -- common/autotest_common.sh@156 -- # : 0 00:06:11.248 22:44:02 -- common/autotest_common.sh@157 -- # export SPDK_TEST_ACCEL_DSA 00:06:11.248 22:44:02 -- common/autotest_common.sh@158 -- # : 0 00:06:11.248 22:44:02 -- common/autotest_common.sh@159 -- # export SPDK_TEST_ACCEL_IAA 00:06:11.248 22:44:02 -- common/autotest_common.sh@160 -- # : 0 00:06:11.248 22:44:02 -- common/autotest_common.sh@161 -- # export SPDK_TEST_ACCEL_IOAT 00:06:11.248 22:44:02 -- common/autotest_common.sh@163 -- # : 00:06:11.248 22:44:02 -- common/autotest_common.sh@164 -- # export SPDK_TEST_FUZZER_TARGET 00:06:11.248 22:44:02 -- common/autotest_common.sh@165 -- # : 0 00:06:11.248 22:44:02 -- common/autotest_common.sh@166 -- # export SPDK_TEST_NVMF_MDNS 00:06:11.248 22:44:02 -- common/autotest_common.sh@167 -- # : 0 00:06:11.248 22:44:02 -- common/autotest_common.sh@168 -- # export SPDK_JSONRPC_GO_CLIENT 00:06:11.248 22:44:02 -- common/autotest_common.sh@171 -- # export SPDK_LIB_DIR=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/lib 00:06:11.248 22:44:02 -- common/autotest_common.sh@171 -- # SPDK_LIB_DIR=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/lib 00:06:11.248 22:44:02 -- common/autotest_common.sh@172 -- # export DPDK_LIB_DIR=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/dpdk/build/lib 00:06:11.248 22:44:02 -- common/autotest_common.sh@172 -- # DPDK_LIB_DIR=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/dpdk/build/lib 00:06:11.248 22:44:02 -- common/autotest_common.sh@173 -- # export VFIO_LIB_DIR=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/libvfio-user/usr/local/lib 00:06:11.248 22:44:02 -- common/autotest_common.sh@173 -- # VFIO_LIB_DIR=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/libvfio-user/usr/local/lib 00:06:11.248 22:44:02 -- common/autotest_common.sh@174 -- # export LD_LIBRARY_PATH=:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/dpdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/libvfio-user/usr/local/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/dpdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/libvfio-user/usr/local/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/dpdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/libvfio-user/usr/local/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/dpdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/libvfio-user/usr/local/lib 00:06:11.248 22:44:02 -- common/autotest_common.sh@174 -- # LD_LIBRARY_PATH=:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/dpdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/libvfio-user/usr/local/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/dpdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/libvfio-user/usr/local/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/dpdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/libvfio-user/usr/local/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/dpdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/libvfio-user/usr/local/lib 00:06:11.248 22:44:02 -- common/autotest_common.sh@177 -- # export PCI_BLOCK_SYNC_ON_RESET=yes 00:06:11.248 22:44:02 -- common/autotest_common.sh@177 -- # PCI_BLOCK_SYNC_ON_RESET=yes 00:06:11.248 22:44:02 -- common/autotest_common.sh@181 -- # export PYTHONPATH=:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/python:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc_plugins:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/python:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc_plugins:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/python:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc_plugins:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/python 00:06:11.249 22:44:02 -- common/autotest_common.sh@181 -- # PYTHONPATH=:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/python:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc_plugins:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/python:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc_plugins:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/python:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc_plugins:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/python 00:06:11.249 22:44:02 -- common/autotest_common.sh@185 -- # export PYTHONDONTWRITEBYTECODE=1 00:06:11.249 22:44:02 -- common/autotest_common.sh@185 -- # PYTHONDONTWRITEBYTECODE=1 00:06:11.249 22:44:02 -- common/autotest_common.sh@189 -- # export ASAN_OPTIONS=new_delete_type_mismatch=0:disable_coredump=0:abort_on_error=1:use_sigaltstack=0 00:06:11.249 22:44:02 -- common/autotest_common.sh@189 -- # ASAN_OPTIONS=new_delete_type_mismatch=0:disable_coredump=0:abort_on_error=1:use_sigaltstack=0 00:06:11.249 22:44:02 -- common/autotest_common.sh@190 -- # export UBSAN_OPTIONS=halt_on_error=1:print_stacktrace=1:abort_on_error=1:disable_coredump=0:exitcode=134 00:06:11.249 22:44:02 -- common/autotest_common.sh@190 -- # UBSAN_OPTIONS=halt_on_error=1:print_stacktrace=1:abort_on_error=1:disable_coredump=0:exitcode=134 00:06:11.249 22:44:02 -- common/autotest_common.sh@194 -- # asan_suppression_file=/var/tmp/asan_suppression_file 00:06:11.249 22:44:02 -- common/autotest_common.sh@195 -- # rm -rf /var/tmp/asan_suppression_file 00:06:11.249 22:44:02 -- common/autotest_common.sh@196 -- # cat 00:06:11.249 22:44:02 -- common/autotest_common.sh@222 -- # echo leak:libfuse3.so 00:06:11.249 22:44:02 -- common/autotest_common.sh@224 -- # export LSAN_OPTIONS=suppressions=/var/tmp/asan_suppression_file 00:06:11.249 22:44:02 -- common/autotest_common.sh@224 -- # LSAN_OPTIONS=suppressions=/var/tmp/asan_suppression_file 00:06:11.249 22:44:02 -- common/autotest_common.sh@226 -- # export DEFAULT_RPC_ADDR=/var/tmp/spdk.sock 00:06:11.249 22:44:02 -- common/autotest_common.sh@226 -- # DEFAULT_RPC_ADDR=/var/tmp/spdk.sock 00:06:11.249 22:44:02 -- common/autotest_common.sh@228 -- # '[' -z /var/spdk/dependencies ']' 00:06:11.249 22:44:02 -- common/autotest_common.sh@231 -- # export DEPENDENCY_DIR 00:06:11.249 22:44:02 -- common/autotest_common.sh@235 -- # export SPDK_BIN_DIR=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin 00:06:11.249 22:44:02 -- common/autotest_common.sh@235 -- # SPDK_BIN_DIR=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin 00:06:11.249 22:44:02 -- common/autotest_common.sh@236 -- # export SPDK_EXAMPLE_DIR=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples 00:06:11.249 22:44:02 -- common/autotest_common.sh@236 -- # SPDK_EXAMPLE_DIR=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples 00:06:11.249 22:44:02 -- common/autotest_common.sh@239 -- # export QEMU_BIN=/usr/local/qemu/vanilla-latest/bin/qemu-system-x86_64 00:06:11.249 22:44:02 -- common/autotest_common.sh@239 -- # QEMU_BIN=/usr/local/qemu/vanilla-latest/bin/qemu-system-x86_64 00:06:11.249 22:44:02 -- common/autotest_common.sh@240 -- # export VFIO_QEMU_BIN=/usr/local/qemu/vfio-user-latest/bin/qemu-system-x86_64 00:06:11.249 22:44:02 -- common/autotest_common.sh@240 -- # VFIO_QEMU_BIN=/usr/local/qemu/vfio-user-latest/bin/qemu-system-x86_64 00:06:11.249 22:44:02 -- common/autotest_common.sh@242 -- # export AR_TOOL=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/ar-xnvme-fixer 00:06:11.249 22:44:02 -- common/autotest_common.sh@242 -- # AR_TOOL=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/ar-xnvme-fixer 00:06:11.249 22:44:02 -- common/autotest_common.sh@245 -- # export UNBIND_ENTIRE_IOMMU_GROUP=yes 00:06:11.249 22:44:02 -- common/autotest_common.sh@245 -- # UNBIND_ENTIRE_IOMMU_GROUP=yes 00:06:11.249 22:44:02 -- common/autotest_common.sh@248 -- # '[' 0 -eq 0 ']' 00:06:11.249 22:44:02 -- common/autotest_common.sh@249 -- # export valgrind= 00:06:11.249 22:44:02 -- common/autotest_common.sh@249 -- # valgrind= 00:06:11.249 22:44:02 -- common/autotest_common.sh@255 -- # uname -s 00:06:11.249 22:44:02 -- common/autotest_common.sh@255 -- # '[' Linux = Linux ']' 00:06:11.249 22:44:02 -- common/autotest_common.sh@256 -- # HUGEMEM=4096 00:06:11.249 22:44:02 -- common/autotest_common.sh@257 -- # export CLEAR_HUGE=yes 00:06:11.249 22:44:02 -- common/autotest_common.sh@257 -- # CLEAR_HUGE=yes 00:06:11.249 22:44:02 -- common/autotest_common.sh@258 -- # [[ 0 -eq 1 ]] 00:06:11.249 22:44:02 -- common/autotest_common.sh@258 -- # [[ 0 -eq 1 ]] 00:06:11.249 22:44:02 -- common/autotest_common.sh@265 -- # MAKE=make 00:06:11.249 22:44:02 -- common/autotest_common.sh@266 -- # MAKEFLAGS=-j48 00:06:11.249 22:44:02 -- common/autotest_common.sh@282 -- # export HUGEMEM=4096 00:06:11.249 22:44:02 -- common/autotest_common.sh@282 -- # HUGEMEM=4096 00:06:11.249 22:44:02 -- common/autotest_common.sh@284 -- # '[' -z /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output ']' 00:06:11.249 22:44:02 -- common/autotest_common.sh@289 -- # NO_HUGE=() 00:06:11.249 22:44:02 -- common/autotest_common.sh@290 -- # TEST_MODE= 00:06:11.249 22:44:02 -- common/autotest_common.sh@291 -- # for i in "$@" 00:06:11.249 22:44:02 -- common/autotest_common.sh@292 -- # case "$i" in 00:06:11.249 22:44:02 -- common/autotest_common.sh@297 -- # TEST_TRANSPORT=tcp 00:06:11.249 22:44:02 -- common/autotest_common.sh@309 -- # [[ -z 174120 ]] 00:06:11.249 22:44:02 -- common/autotest_common.sh@309 -- # kill -0 174120 00:06:11.249 22:44:02 -- common/autotest_common.sh@1665 -- # set_test_storage 2147483648 00:06:11.249 22:44:02 -- common/autotest_common.sh@319 -- # [[ -v testdir ]] 00:06:11.249 22:44:02 -- common/autotest_common.sh@321 -- # local requested_size=2147483648 00:06:11.249 22:44:02 -- common/autotest_common.sh@322 -- # local mount target_dir 00:06:11.249 22:44:02 -- common/autotest_common.sh@324 -- # local -A mounts fss sizes avails uses 00:06:11.249 22:44:02 -- common/autotest_common.sh@325 -- # local source fs size avail mount use 00:06:11.249 22:44:02 -- common/autotest_common.sh@327 -- # local storage_fallback storage_candidates 00:06:11.249 22:44:02 -- common/autotest_common.sh@329 -- # mktemp -udt spdk.XXXXXX 00:06:11.249 22:44:02 -- common/autotest_common.sh@329 -- # storage_fallback=/tmp/spdk.M3rWm2 00:06:11.249 22:44:02 -- common/autotest_common.sh@334 -- # storage_candidates=("$testdir" "$storage_fallback/tests/${testdir##*/}" "$storage_fallback") 00:06:11.249 22:44:02 -- common/autotest_common.sh@336 -- # [[ -n '' ]] 00:06:11.249 22:44:02 -- common/autotest_common.sh@341 -- # [[ -n '' ]] 00:06:11.249 22:44:02 -- common/autotest_common.sh@346 -- # mkdir -p /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target /tmp/spdk.M3rWm2/tests/target /tmp/spdk.M3rWm2 00:06:11.249 22:44:02 -- common/autotest_common.sh@349 -- # requested_size=2214592512 00:06:11.249 22:44:02 -- common/autotest_common.sh@351 -- # read -r source fs size use avail _ mount 00:06:11.249 22:44:02 -- common/autotest_common.sh@318 -- # df -T 00:06:11.249 22:44:02 -- common/autotest_common.sh@318 -- # grep -v Filesystem 00:06:11.249 22:44:02 -- common/autotest_common.sh@352 -- # mounts["$mount"]=spdk_devtmpfs 00:06:11.249 22:44:02 -- common/autotest_common.sh@352 -- # fss["$mount"]=devtmpfs 00:06:11.249 22:44:02 -- common/autotest_common.sh@353 -- # avails["$mount"]=67108864 00:06:11.249 22:44:02 -- common/autotest_common.sh@353 -- # sizes["$mount"]=67108864 00:06:11.249 22:44:02 -- common/autotest_common.sh@354 -- # uses["$mount"]=0 00:06:11.249 22:44:02 -- common/autotest_common.sh@351 -- # read -r source fs size use avail _ mount 00:06:11.249 22:44:02 -- common/autotest_common.sh@352 -- # mounts["$mount"]=/dev/pmem0 00:06:11.249 22:44:02 -- common/autotest_common.sh@352 -- # fss["$mount"]=ext2 00:06:11.249 22:44:02 -- common/autotest_common.sh@353 -- # avails["$mount"]=996749312 00:06:11.249 22:44:02 -- common/autotest_common.sh@353 -- # sizes["$mount"]=5284429824 00:06:11.249 22:44:02 -- common/autotest_common.sh@354 -- # uses["$mount"]=4287680512 00:06:11.249 22:44:02 -- common/autotest_common.sh@351 -- # read -r source fs size use avail _ mount 00:06:11.249 22:44:02 -- common/autotest_common.sh@352 -- # mounts["$mount"]=spdk_root 00:06:11.249 22:44:02 -- common/autotest_common.sh@352 -- # fss["$mount"]=overlay 00:06:11.249 22:44:02 -- common/autotest_common.sh@353 -- # avails["$mount"]=53498695680 00:06:11.249 22:44:02 -- common/autotest_common.sh@353 -- # sizes["$mount"]=61994737664 00:06:11.249 22:44:02 -- common/autotest_common.sh@354 -- # uses["$mount"]=8496041984 00:06:11.249 22:44:02 -- common/autotest_common.sh@351 -- # read -r source fs size use avail _ mount 00:06:11.249 22:44:02 -- common/autotest_common.sh@352 -- # mounts["$mount"]=tmpfs 00:06:11.249 22:44:02 -- common/autotest_common.sh@352 -- # fss["$mount"]=tmpfs 00:06:11.249 22:44:02 -- common/autotest_common.sh@353 -- # avails["$mount"]=30996111360 00:06:11.249 22:44:02 -- common/autotest_common.sh@353 -- # sizes["$mount"]=30997368832 00:06:11.249 22:44:02 -- common/autotest_common.sh@354 -- # uses["$mount"]=1257472 00:06:11.249 22:44:02 -- common/autotest_common.sh@351 -- # read -r source fs size use avail _ mount 00:06:11.249 22:44:02 -- common/autotest_common.sh@352 -- # mounts["$mount"]=tmpfs 00:06:11.249 22:44:02 -- common/autotest_common.sh@352 -- # fss["$mount"]=tmpfs 00:06:11.249 22:44:02 -- common/autotest_common.sh@353 -- # avails["$mount"]=12390187008 00:06:11.249 22:44:02 -- common/autotest_common.sh@353 -- # sizes["$mount"]=12398948352 00:06:11.249 22:44:02 -- common/autotest_common.sh@354 -- # uses["$mount"]=8761344 00:06:11.249 22:44:02 -- common/autotest_common.sh@351 -- # read -r source fs size use avail _ mount 00:06:11.249 22:44:02 -- common/autotest_common.sh@352 -- # mounts["$mount"]=tmpfs 00:06:11.249 22:44:02 -- common/autotest_common.sh@352 -- # fss["$mount"]=tmpfs 00:06:11.249 22:44:02 -- common/autotest_common.sh@353 -- # avails["$mount"]=30997090304 00:06:11.249 22:44:02 -- common/autotest_common.sh@353 -- # sizes["$mount"]=30997368832 00:06:11.249 22:44:02 -- common/autotest_common.sh@354 -- # uses["$mount"]=278528 00:06:11.249 22:44:02 -- common/autotest_common.sh@351 -- # read -r source fs size use avail _ mount 00:06:11.249 22:44:02 -- common/autotest_common.sh@352 -- # mounts["$mount"]=tmpfs 00:06:11.249 22:44:02 -- common/autotest_common.sh@352 -- # fss["$mount"]=tmpfs 00:06:11.249 22:44:02 -- common/autotest_common.sh@353 -- # avails["$mount"]=6199468032 00:06:11.249 22:44:02 -- common/autotest_common.sh@353 -- # sizes["$mount"]=6199472128 00:06:11.249 22:44:02 -- common/autotest_common.sh@354 -- # uses["$mount"]=4096 00:06:11.249 22:44:02 -- common/autotest_common.sh@351 -- # read -r source fs size use avail _ mount 00:06:11.249 22:44:02 -- common/autotest_common.sh@357 -- # printf '* Looking for test storage...\n' 00:06:11.249 * Looking for test storage... 00:06:11.249 22:44:02 -- common/autotest_common.sh@359 -- # local target_space new_size 00:06:11.249 22:44:02 -- common/autotest_common.sh@360 -- # for target_dir in "${storage_candidates[@]}" 00:06:11.249 22:44:02 -- common/autotest_common.sh@363 -- # df /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:06:11.249 22:44:02 -- common/autotest_common.sh@363 -- # awk '$1 !~ /Filesystem/{print $6}' 00:06:11.249 22:44:02 -- common/autotest_common.sh@363 -- # mount=/ 00:06:11.249 22:44:02 -- common/autotest_common.sh@365 -- # target_space=53498695680 00:06:11.249 22:44:02 -- common/autotest_common.sh@366 -- # (( target_space == 0 || target_space < requested_size )) 00:06:11.249 22:44:02 -- common/autotest_common.sh@369 -- # (( target_space >= requested_size )) 00:06:11.249 22:44:02 -- common/autotest_common.sh@371 -- # [[ overlay == tmpfs ]] 00:06:11.249 22:44:02 -- common/autotest_common.sh@371 -- # [[ overlay == ramfs ]] 00:06:11.249 22:44:02 -- common/autotest_common.sh@371 -- # [[ / == / ]] 00:06:11.249 22:44:02 -- common/autotest_common.sh@372 -- # new_size=10710634496 00:06:11.249 22:44:02 -- common/autotest_common.sh@373 -- # (( new_size * 100 / sizes[/] > 95 )) 00:06:11.249 22:44:02 -- common/autotest_common.sh@378 -- # export SPDK_TEST_STORAGE=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:06:11.249 22:44:02 -- common/autotest_common.sh@378 -- # SPDK_TEST_STORAGE=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:06:11.249 22:44:02 -- common/autotest_common.sh@379 -- # printf '* Found test storage at %s\n' /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:06:11.249 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:06:11.250 22:44:02 -- common/autotest_common.sh@380 -- # return 0 00:06:11.250 22:44:02 -- common/autotest_common.sh@1667 -- # set -o errtrace 00:06:11.250 22:44:02 -- common/autotest_common.sh@1668 -- # shopt -s extdebug 00:06:11.250 22:44:02 -- common/autotest_common.sh@1669 -- # trap 'trap - ERR; print_backtrace >&2' ERR 00:06:11.250 22:44:02 -- common/autotest_common.sh@1671 -- # PS4=' \t -- ${BASH_SOURCE#${BASH_SOURCE%/*/*}/}@${LINENO} -- \$ ' 00:06:11.250 22:44:02 -- common/autotest_common.sh@1672 -- # true 00:06:11.250 22:44:02 -- common/autotest_common.sh@1674 -- # xtrace_fd 00:06:11.250 22:44:02 -- common/autotest_common.sh@25 -- # [[ -n 14 ]] 00:06:11.250 22:44:02 -- common/autotest_common.sh@25 -- # [[ -e /proc/self/fd/14 ]] 00:06:11.250 22:44:02 -- common/autotest_common.sh@27 -- # exec 00:06:11.250 22:44:02 -- common/autotest_common.sh@29 -- # exec 00:06:11.250 22:44:02 -- common/autotest_common.sh@31 -- # xtrace_restore 00:06:11.250 22:44:02 -- common/autotest_common.sh@16 -- # unset -v 'X_STACK[0 - 1 < 0 ? 0 : 0 - 1]' 00:06:11.250 22:44:02 -- common/autotest_common.sh@17 -- # (( 0 == 0 )) 00:06:11.250 22:44:02 -- common/autotest_common.sh@18 -- # set -x 00:06:11.250 22:44:02 -- target/filesystem.sh@10 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:06:11.250 22:44:02 -- nvmf/common.sh@7 -- # uname -s 00:06:11.250 22:44:02 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:06:11.250 22:44:02 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:06:11.250 22:44:02 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:06:11.250 22:44:02 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:06:11.250 22:44:02 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:06:11.250 22:44:02 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:06:11.250 22:44:02 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:06:11.250 22:44:02 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:06:11.250 22:44:02 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:06:11.250 22:44:02 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:06:11.250 22:44:02 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:06:11.250 22:44:02 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:06:11.250 22:44:02 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:06:11.250 22:44:02 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:06:11.250 22:44:02 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:06:11.250 22:44:02 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:06:11.250 22:44:02 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:06:11.250 22:44:02 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:06:11.250 22:44:02 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:06:11.250 22:44:02 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:06:11.250 22:44:02 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:06:11.250 22:44:02 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:06:11.250 22:44:02 -- paths/export.sh@5 -- # export PATH 00:06:11.250 22:44:02 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:06:11.250 22:44:02 -- nvmf/common.sh@46 -- # : 0 00:06:11.250 22:44:02 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:06:11.250 22:44:02 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:06:11.250 22:44:02 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:06:11.250 22:44:02 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:06:11.250 22:44:02 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:06:11.250 22:44:02 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:06:11.250 22:44:02 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:06:11.250 22:44:02 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:06:11.250 22:44:02 -- target/filesystem.sh@12 -- # MALLOC_BDEV_SIZE=512 00:06:11.250 22:44:02 -- target/filesystem.sh@13 -- # MALLOC_BLOCK_SIZE=512 00:06:11.250 22:44:02 -- target/filesystem.sh@15 -- # nvmftestinit 00:06:11.250 22:44:02 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:06:11.250 22:44:02 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:06:11.250 22:44:02 -- nvmf/common.sh@436 -- # prepare_net_devs 00:06:11.250 22:44:02 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:06:11.250 22:44:02 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:06:11.250 22:44:02 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:06:11.250 22:44:02 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:06:11.250 22:44:02 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:06:11.250 22:44:02 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:06:11.250 22:44:02 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:06:11.250 22:44:02 -- nvmf/common.sh@284 -- # xtrace_disable 00:06:11.250 22:44:02 -- common/autotest_common.sh@10 -- # set +x 00:06:13.157 22:44:04 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:06:13.157 22:44:04 -- nvmf/common.sh@290 -- # pci_devs=() 00:06:13.157 22:44:04 -- nvmf/common.sh@290 -- # local -a pci_devs 00:06:13.157 22:44:04 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:06:13.157 22:44:04 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:06:13.157 22:44:04 -- nvmf/common.sh@292 -- # pci_drivers=() 00:06:13.158 22:44:04 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:06:13.158 22:44:04 -- nvmf/common.sh@294 -- # net_devs=() 00:06:13.158 22:44:04 -- nvmf/common.sh@294 -- # local -ga net_devs 00:06:13.158 22:44:04 -- nvmf/common.sh@295 -- # e810=() 00:06:13.158 22:44:04 -- nvmf/common.sh@295 -- # local -ga e810 00:06:13.158 22:44:04 -- nvmf/common.sh@296 -- # x722=() 00:06:13.158 22:44:04 -- nvmf/common.sh@296 -- # local -ga x722 00:06:13.158 22:44:04 -- nvmf/common.sh@297 -- # mlx=() 00:06:13.158 22:44:04 -- nvmf/common.sh@297 -- # local -ga mlx 00:06:13.158 22:44:04 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:06:13.158 22:44:04 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:06:13.158 22:44:04 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:06:13.158 22:44:04 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:06:13.158 22:44:04 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:06:13.158 22:44:04 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:06:13.158 22:44:04 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:06:13.158 22:44:04 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:06:13.158 22:44:04 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:06:13.158 22:44:04 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:06:13.158 22:44:04 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:06:13.158 22:44:04 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:06:13.158 22:44:04 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:06:13.158 22:44:04 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:06:13.158 22:44:04 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:06:13.158 22:44:04 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:06:13.158 22:44:04 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:06:13.158 22:44:04 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:06:13.158 22:44:04 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:06:13.158 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:06:13.158 22:44:04 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:06:13.158 22:44:04 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:06:13.158 22:44:04 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:06:13.158 22:44:04 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:06:13.158 22:44:04 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:06:13.158 22:44:04 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:06:13.158 22:44:04 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:06:13.158 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:06:13.158 22:44:04 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:06:13.158 22:44:04 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:06:13.158 22:44:04 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:06:13.158 22:44:04 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:06:13.158 22:44:04 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:06:13.158 22:44:04 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:06:13.158 22:44:04 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:06:13.158 22:44:04 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:06:13.158 22:44:04 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:06:13.158 22:44:04 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:06:13.158 22:44:04 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:06:13.158 22:44:04 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:06:13.158 22:44:04 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:06:13.158 Found net devices under 0000:0a:00.0: cvl_0_0 00:06:13.158 22:44:04 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:06:13.158 22:44:04 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:06:13.158 22:44:04 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:06:13.158 22:44:04 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:06:13.158 22:44:04 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:06:13.158 22:44:04 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:06:13.158 Found net devices under 0000:0a:00.1: cvl_0_1 00:06:13.158 22:44:04 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:06:13.158 22:44:04 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:06:13.158 22:44:04 -- nvmf/common.sh@402 -- # is_hw=yes 00:06:13.158 22:44:04 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:06:13.158 22:44:04 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:06:13.158 22:44:04 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:06:13.158 22:44:04 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:06:13.158 22:44:04 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:06:13.158 22:44:04 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:06:13.158 22:44:04 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:06:13.158 22:44:04 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:06:13.158 22:44:04 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:06:13.158 22:44:04 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:06:13.158 22:44:04 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:06:13.158 22:44:04 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:06:13.158 22:44:04 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:06:13.158 22:44:04 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:06:13.158 22:44:04 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:06:13.158 22:44:04 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:06:13.158 22:44:04 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:06:13.158 22:44:04 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:06:13.158 22:44:04 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:06:13.158 22:44:04 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:06:13.418 22:44:04 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:06:13.418 22:44:04 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:06:13.418 22:44:04 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:06:13.418 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:06:13.418 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.180 ms 00:06:13.418 00:06:13.418 --- 10.0.0.2 ping statistics --- 00:06:13.418 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:06:13.418 rtt min/avg/max/mdev = 0.180/0.180/0.180/0.000 ms 00:06:13.418 22:44:04 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:06:13.418 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:06:13.418 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.109 ms 00:06:13.418 00:06:13.418 --- 10.0.0.1 ping statistics --- 00:06:13.418 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:06:13.418 rtt min/avg/max/mdev = 0.109/0.109/0.109/0.000 ms 00:06:13.418 22:44:04 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:06:13.418 22:44:04 -- nvmf/common.sh@410 -- # return 0 00:06:13.418 22:44:04 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:06:13.418 22:44:04 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:06:13.418 22:44:04 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:06:13.418 22:44:04 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:06:13.418 22:44:04 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:06:13.418 22:44:04 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:06:13.418 22:44:04 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:06:13.418 22:44:04 -- target/filesystem.sh@105 -- # run_test nvmf_filesystem_no_in_capsule nvmf_filesystem_part 0 00:06:13.418 22:44:04 -- common/autotest_common.sh@1077 -- # '[' 3 -le 1 ']' 00:06:13.418 22:44:04 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:06:13.418 22:44:04 -- common/autotest_common.sh@10 -- # set +x 00:06:13.418 ************************************ 00:06:13.418 START TEST nvmf_filesystem_no_in_capsule 00:06:13.418 ************************************ 00:06:13.418 22:44:04 -- common/autotest_common.sh@1104 -- # nvmf_filesystem_part 0 00:06:13.418 22:44:04 -- target/filesystem.sh@47 -- # in_capsule=0 00:06:13.418 22:44:04 -- target/filesystem.sh@49 -- # nvmfappstart -m 0xF 00:06:13.418 22:44:04 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:06:13.418 22:44:04 -- common/autotest_common.sh@712 -- # xtrace_disable 00:06:13.418 22:44:04 -- common/autotest_common.sh@10 -- # set +x 00:06:13.418 22:44:04 -- nvmf/common.sh@469 -- # nvmfpid=175746 00:06:13.418 22:44:04 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:06:13.418 22:44:04 -- nvmf/common.sh@470 -- # waitforlisten 175746 00:06:13.418 22:44:04 -- common/autotest_common.sh@819 -- # '[' -z 175746 ']' 00:06:13.418 22:44:04 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk.sock 00:06:13.418 22:44:04 -- common/autotest_common.sh@824 -- # local max_retries=100 00:06:13.418 22:44:04 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:06:13.418 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:06:13.419 22:44:04 -- common/autotest_common.sh@828 -- # xtrace_disable 00:06:13.419 22:44:04 -- common/autotest_common.sh@10 -- # set +x 00:06:13.419 [2024-04-16 22:44:04.387775] Starting SPDK v24.01.1-pre git sha1 4b134b4ab / DPDK 23.11.0 initialization... 00:06:13.419 [2024-04-16 22:44:04.387862] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:06:13.419 EAL: No free 2048 kB hugepages reported on node 1 00:06:13.419 [2024-04-16 22:44:04.458501] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:06:13.679 [2024-04-16 22:44:04.570403] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:06:13.679 [2024-04-16 22:44:04.570555] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:06:13.679 [2024-04-16 22:44:04.570571] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:06:13.679 [2024-04-16 22:44:04.570583] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:06:13.679 [2024-04-16 22:44:04.570641] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:06:13.679 [2024-04-16 22:44:04.570701] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:06:13.679 [2024-04-16 22:44:04.570767] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:06:13.679 [2024-04-16 22:44:04.570769] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:14.247 22:44:05 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:06:14.247 22:44:05 -- common/autotest_common.sh@852 -- # return 0 00:06:14.247 22:44:05 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:06:14.247 22:44:05 -- common/autotest_common.sh@718 -- # xtrace_disable 00:06:14.247 22:44:05 -- common/autotest_common.sh@10 -- # set +x 00:06:14.505 22:44:05 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:06:14.505 22:44:05 -- target/filesystem.sh@50 -- # malloc_name=Malloc1 00:06:14.505 22:44:05 -- target/filesystem.sh@52 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 -c 0 00:06:14.505 22:44:05 -- common/autotest_common.sh@551 -- # xtrace_disable 00:06:14.505 22:44:05 -- common/autotest_common.sh@10 -- # set +x 00:06:14.505 [2024-04-16 22:44:05.392864] tcp.c: 659:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:06:14.505 22:44:05 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:06:14.505 22:44:05 -- target/filesystem.sh@53 -- # rpc_cmd bdev_malloc_create 512 512 -b Malloc1 00:06:14.505 22:44:05 -- common/autotest_common.sh@551 -- # xtrace_disable 00:06:14.505 22:44:05 -- common/autotest_common.sh@10 -- # set +x 00:06:14.505 Malloc1 00:06:14.505 22:44:05 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:06:14.505 22:44:05 -- target/filesystem.sh@54 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDKISFASTANDAWESOME 00:06:14.505 22:44:05 -- common/autotest_common.sh@551 -- # xtrace_disable 00:06:14.505 22:44:05 -- common/autotest_common.sh@10 -- # set +x 00:06:14.505 22:44:05 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:06:14.505 22:44:05 -- target/filesystem.sh@55 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:06:14.505 22:44:05 -- common/autotest_common.sh@551 -- # xtrace_disable 00:06:14.505 22:44:05 -- common/autotest_common.sh@10 -- # set +x 00:06:14.505 22:44:05 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:06:14.505 22:44:05 -- target/filesystem.sh@56 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:06:14.505 22:44:05 -- common/autotest_common.sh@551 -- # xtrace_disable 00:06:14.505 22:44:05 -- common/autotest_common.sh@10 -- # set +x 00:06:14.505 [2024-04-16 22:44:05.579589] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:06:14.505 22:44:05 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:06:14.505 22:44:05 -- target/filesystem.sh@58 -- # get_bdev_size Malloc1 00:06:14.505 22:44:05 -- common/autotest_common.sh@1357 -- # local bdev_name=Malloc1 00:06:14.505 22:44:05 -- common/autotest_common.sh@1358 -- # local bdev_info 00:06:14.505 22:44:05 -- common/autotest_common.sh@1359 -- # local bs 00:06:14.505 22:44:05 -- common/autotest_common.sh@1360 -- # local nb 00:06:14.505 22:44:05 -- common/autotest_common.sh@1361 -- # rpc_cmd bdev_get_bdevs -b Malloc1 00:06:14.505 22:44:05 -- common/autotest_common.sh@551 -- # xtrace_disable 00:06:14.505 22:44:05 -- common/autotest_common.sh@10 -- # set +x 00:06:14.505 22:44:05 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:06:14.505 22:44:05 -- common/autotest_common.sh@1361 -- # bdev_info='[ 00:06:14.505 { 00:06:14.505 "name": "Malloc1", 00:06:14.505 "aliases": [ 00:06:14.505 "aee8f747-71c6-4622-9388-e270b2d94fdb" 00:06:14.505 ], 00:06:14.505 "product_name": "Malloc disk", 00:06:14.505 "block_size": 512, 00:06:14.505 "num_blocks": 1048576, 00:06:14.505 "uuid": "aee8f747-71c6-4622-9388-e270b2d94fdb", 00:06:14.505 "assigned_rate_limits": { 00:06:14.505 "rw_ios_per_sec": 0, 00:06:14.505 "rw_mbytes_per_sec": 0, 00:06:14.505 "r_mbytes_per_sec": 0, 00:06:14.505 "w_mbytes_per_sec": 0 00:06:14.505 }, 00:06:14.505 "claimed": true, 00:06:14.505 "claim_type": "exclusive_write", 00:06:14.505 "zoned": false, 00:06:14.505 "supported_io_types": { 00:06:14.505 "read": true, 00:06:14.505 "write": true, 00:06:14.505 "unmap": true, 00:06:14.505 "write_zeroes": true, 00:06:14.505 "flush": true, 00:06:14.505 "reset": true, 00:06:14.505 "compare": false, 00:06:14.505 "compare_and_write": false, 00:06:14.505 "abort": true, 00:06:14.505 "nvme_admin": false, 00:06:14.505 "nvme_io": false 00:06:14.505 }, 00:06:14.505 "memory_domains": [ 00:06:14.505 { 00:06:14.505 "dma_device_id": "SPDK_ACCEL_DMA_DEVICE", 00:06:14.505 "dma_device_type": 2 00:06:14.505 } 00:06:14.505 ], 00:06:14.505 "driver_specific": {} 00:06:14.505 } 00:06:14.505 ]' 00:06:14.505 22:44:05 -- common/autotest_common.sh@1362 -- # jq '.[] .block_size' 00:06:14.763 22:44:05 -- common/autotest_common.sh@1362 -- # bs=512 00:06:14.763 22:44:05 -- common/autotest_common.sh@1363 -- # jq '.[] .num_blocks' 00:06:14.763 22:44:05 -- common/autotest_common.sh@1363 -- # nb=1048576 00:06:14.763 22:44:05 -- common/autotest_common.sh@1366 -- # bdev_size=512 00:06:14.763 22:44:05 -- common/autotest_common.sh@1367 -- # echo 512 00:06:14.763 22:44:05 -- target/filesystem.sh@58 -- # malloc_size=536870912 00:06:14.763 22:44:05 -- target/filesystem.sh@60 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:06:15.331 22:44:06 -- target/filesystem.sh@62 -- # waitforserial SPDKISFASTANDAWESOME 00:06:15.331 22:44:06 -- common/autotest_common.sh@1177 -- # local i=0 00:06:15.331 22:44:06 -- common/autotest_common.sh@1178 -- # local nvme_device_counter=1 nvme_devices=0 00:06:15.331 22:44:06 -- common/autotest_common.sh@1179 -- # [[ -n '' ]] 00:06:15.331 22:44:06 -- common/autotest_common.sh@1184 -- # sleep 2 00:06:17.236 22:44:08 -- common/autotest_common.sh@1185 -- # (( i++ <= 15 )) 00:06:17.236 22:44:08 -- common/autotest_common.sh@1186 -- # lsblk -l -o NAME,SERIAL 00:06:17.236 22:44:08 -- common/autotest_common.sh@1186 -- # grep -c SPDKISFASTANDAWESOME 00:06:17.236 22:44:08 -- common/autotest_common.sh@1186 -- # nvme_devices=1 00:06:17.236 22:44:08 -- common/autotest_common.sh@1187 -- # (( nvme_devices == nvme_device_counter )) 00:06:17.236 22:44:08 -- common/autotest_common.sh@1187 -- # return 0 00:06:17.236 22:44:08 -- target/filesystem.sh@63 -- # lsblk -l -o NAME,SERIAL 00:06:17.236 22:44:08 -- target/filesystem.sh@63 -- # grep -oP '([\w]*)(?=\s+SPDKISFASTANDAWESOME)' 00:06:17.236 22:44:08 -- target/filesystem.sh@63 -- # nvme_name=nvme0n1 00:06:17.236 22:44:08 -- target/filesystem.sh@64 -- # sec_size_to_bytes nvme0n1 00:06:17.236 22:44:08 -- setup/common.sh@76 -- # local dev=nvme0n1 00:06:17.236 22:44:08 -- setup/common.sh@78 -- # [[ -e /sys/block/nvme0n1 ]] 00:06:17.236 22:44:08 -- setup/common.sh@80 -- # echo 536870912 00:06:17.236 22:44:08 -- target/filesystem.sh@64 -- # nvme_size=536870912 00:06:17.236 22:44:08 -- target/filesystem.sh@66 -- # mkdir -p /mnt/device 00:06:17.236 22:44:08 -- target/filesystem.sh@67 -- # (( nvme_size == malloc_size )) 00:06:17.236 22:44:08 -- target/filesystem.sh@68 -- # parted -s /dev/nvme0n1 mklabel gpt mkpart SPDK_TEST 0% 100% 00:06:17.494 22:44:08 -- target/filesystem.sh@69 -- # partprobe 00:06:18.432 22:44:09 -- target/filesystem.sh@70 -- # sleep 1 00:06:19.370 22:44:10 -- target/filesystem.sh@76 -- # '[' 0 -eq 0 ']' 00:06:19.370 22:44:10 -- target/filesystem.sh@77 -- # run_test filesystem_ext4 nvmf_filesystem_create ext4 nvme0n1 00:06:19.370 22:44:10 -- common/autotest_common.sh@1077 -- # '[' 4 -le 1 ']' 00:06:19.370 22:44:10 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:06:19.370 22:44:10 -- common/autotest_common.sh@10 -- # set +x 00:06:19.370 ************************************ 00:06:19.370 START TEST filesystem_ext4 00:06:19.370 ************************************ 00:06:19.370 22:44:10 -- common/autotest_common.sh@1104 -- # nvmf_filesystem_create ext4 nvme0n1 00:06:19.370 22:44:10 -- target/filesystem.sh@18 -- # fstype=ext4 00:06:19.370 22:44:10 -- target/filesystem.sh@19 -- # nvme_name=nvme0n1 00:06:19.370 22:44:10 -- target/filesystem.sh@21 -- # make_filesystem ext4 /dev/nvme0n1p1 00:06:19.370 22:44:10 -- common/autotest_common.sh@902 -- # local fstype=ext4 00:06:19.370 22:44:10 -- common/autotest_common.sh@903 -- # local dev_name=/dev/nvme0n1p1 00:06:19.370 22:44:10 -- common/autotest_common.sh@904 -- # local i=0 00:06:19.370 22:44:10 -- common/autotest_common.sh@905 -- # local force 00:06:19.370 22:44:10 -- common/autotest_common.sh@907 -- # '[' ext4 = ext4 ']' 00:06:19.370 22:44:10 -- common/autotest_common.sh@908 -- # force=-F 00:06:19.370 22:44:10 -- common/autotest_common.sh@913 -- # mkfs.ext4 -F /dev/nvme0n1p1 00:06:19.370 mke2fs 1.46.5 (30-Dec-2021) 00:06:19.370 Discarding device blocks: 0/522240 done 00:06:19.370 Creating filesystem with 522240 1k blocks and 130560 inodes 00:06:19.370 Filesystem UUID: a817b3a4-9534-4720-99b3-16b4da1b7a61 00:06:19.370 Superblock backups stored on blocks: 00:06:19.370 8193, 24577, 40961, 57345, 73729, 204801, 221185, 401409 00:06:19.370 00:06:19.370 Allocating group tables: 0/64 done 00:06:19.370 Writing inode tables: 0/64 done 00:06:21.274 Creating journal (8192 blocks): done 00:06:21.274 Writing superblocks and filesystem accounting information: 0/64 done 00:06:21.274 00:06:21.274 22:44:12 -- common/autotest_common.sh@921 -- # return 0 00:06:21.275 22:44:12 -- target/filesystem.sh@23 -- # mount /dev/nvme0n1p1 /mnt/device 00:06:21.533 22:44:12 -- target/filesystem.sh@24 -- # touch /mnt/device/aaa 00:06:21.533 22:44:12 -- target/filesystem.sh@25 -- # sync 00:06:21.533 22:44:12 -- target/filesystem.sh@26 -- # rm /mnt/device/aaa 00:06:21.533 22:44:12 -- target/filesystem.sh@27 -- # sync 00:06:21.533 22:44:12 -- target/filesystem.sh@29 -- # i=0 00:06:21.533 22:44:12 -- target/filesystem.sh@30 -- # umount /mnt/device 00:06:21.533 22:44:12 -- target/filesystem.sh@37 -- # kill -0 175746 00:06:21.533 22:44:12 -- target/filesystem.sh@40 -- # lsblk -l -o NAME 00:06:21.533 22:44:12 -- target/filesystem.sh@40 -- # grep -q -w nvme0n1 00:06:21.792 22:44:12 -- target/filesystem.sh@43 -- # lsblk -l -o NAME 00:06:21.792 22:44:12 -- target/filesystem.sh@43 -- # grep -q -w nvme0n1p1 00:06:21.792 00:06:21.792 real 0m2.365s 00:06:21.792 user 0m0.017s 00:06:21.792 sys 0m0.034s 00:06:21.792 22:44:12 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:06:21.792 22:44:12 -- common/autotest_common.sh@10 -- # set +x 00:06:21.792 ************************************ 00:06:21.792 END TEST filesystem_ext4 00:06:21.792 ************************************ 00:06:21.792 22:44:12 -- target/filesystem.sh@78 -- # run_test filesystem_btrfs nvmf_filesystem_create btrfs nvme0n1 00:06:21.792 22:44:12 -- common/autotest_common.sh@1077 -- # '[' 4 -le 1 ']' 00:06:21.792 22:44:12 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:06:21.792 22:44:12 -- common/autotest_common.sh@10 -- # set +x 00:06:21.792 ************************************ 00:06:21.792 START TEST filesystem_btrfs 00:06:21.792 ************************************ 00:06:21.792 22:44:12 -- common/autotest_common.sh@1104 -- # nvmf_filesystem_create btrfs nvme0n1 00:06:21.792 22:44:12 -- target/filesystem.sh@18 -- # fstype=btrfs 00:06:21.792 22:44:12 -- target/filesystem.sh@19 -- # nvme_name=nvme0n1 00:06:21.792 22:44:12 -- target/filesystem.sh@21 -- # make_filesystem btrfs /dev/nvme0n1p1 00:06:21.792 22:44:12 -- common/autotest_common.sh@902 -- # local fstype=btrfs 00:06:21.792 22:44:12 -- common/autotest_common.sh@903 -- # local dev_name=/dev/nvme0n1p1 00:06:21.792 22:44:12 -- common/autotest_common.sh@904 -- # local i=0 00:06:21.792 22:44:12 -- common/autotest_common.sh@905 -- # local force 00:06:21.792 22:44:12 -- common/autotest_common.sh@907 -- # '[' btrfs = ext4 ']' 00:06:21.792 22:44:12 -- common/autotest_common.sh@910 -- # force=-f 00:06:21.792 22:44:12 -- common/autotest_common.sh@913 -- # mkfs.btrfs -f /dev/nvme0n1p1 00:06:22.052 btrfs-progs v6.6.2 00:06:22.052 See https://btrfs.readthedocs.io for more information. 00:06:22.052 00:06:22.052 Performing full device TRIM /dev/nvme0n1p1 (510.00MiB) ... 00:06:22.052 NOTE: several default settings have changed in version 5.15, please make sure 00:06:22.052 this does not affect your deployments: 00:06:22.052 - DUP for metadata (-m dup) 00:06:22.052 - enabled no-holes (-O no-holes) 00:06:22.052 - enabled free-space-tree (-R free-space-tree) 00:06:22.052 00:06:22.052 Label: (null) 00:06:22.052 UUID: 60a427eb-1674-497e-a67a-0998b29b9e34 00:06:22.052 Node size: 16384 00:06:22.052 Sector size: 4096 00:06:22.052 Filesystem size: 510.00MiB 00:06:22.052 Block group profiles: 00:06:22.052 Data: single 8.00MiB 00:06:22.052 Metadata: DUP 32.00MiB 00:06:22.052 System: DUP 8.00MiB 00:06:22.052 SSD detected: yes 00:06:22.052 Zoned device: no 00:06:22.052 Incompat features: extref, skinny-metadata, no-holes, free-space-tree 00:06:22.052 Runtime features: free-space-tree 00:06:22.052 Checksum: crc32c 00:06:22.052 Number of devices: 1 00:06:22.052 Devices: 00:06:22.052 ID SIZE PATH 00:06:22.052 1 510.00MiB /dev/nvme0n1p1 00:06:22.052 00:06:22.052 22:44:13 -- common/autotest_common.sh@921 -- # return 0 00:06:22.052 22:44:13 -- target/filesystem.sh@23 -- # mount /dev/nvme0n1p1 /mnt/device 00:06:22.621 22:44:13 -- target/filesystem.sh@24 -- # touch /mnt/device/aaa 00:06:22.621 22:44:13 -- target/filesystem.sh@25 -- # sync 00:06:22.621 22:44:13 -- target/filesystem.sh@26 -- # rm /mnt/device/aaa 00:06:22.621 22:44:13 -- target/filesystem.sh@27 -- # sync 00:06:22.621 22:44:13 -- target/filesystem.sh@29 -- # i=0 00:06:22.621 22:44:13 -- target/filesystem.sh@30 -- # umount /mnt/device 00:06:22.621 22:44:13 -- target/filesystem.sh@37 -- # kill -0 175746 00:06:22.621 22:44:13 -- target/filesystem.sh@40 -- # lsblk -l -o NAME 00:06:22.621 22:44:13 -- target/filesystem.sh@40 -- # grep -q -w nvme0n1 00:06:22.621 22:44:13 -- target/filesystem.sh@43 -- # lsblk -l -o NAME 00:06:22.621 22:44:13 -- target/filesystem.sh@43 -- # grep -q -w nvme0n1p1 00:06:22.621 00:06:22.621 real 0m0.844s 00:06:22.621 user 0m0.014s 00:06:22.621 sys 0m0.045s 00:06:22.621 22:44:13 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:06:22.621 22:44:13 -- common/autotest_common.sh@10 -- # set +x 00:06:22.621 ************************************ 00:06:22.621 END TEST filesystem_btrfs 00:06:22.621 ************************************ 00:06:22.621 22:44:13 -- target/filesystem.sh@79 -- # run_test filesystem_xfs nvmf_filesystem_create xfs nvme0n1 00:06:22.621 22:44:13 -- common/autotest_common.sh@1077 -- # '[' 4 -le 1 ']' 00:06:22.621 22:44:13 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:06:22.621 22:44:13 -- common/autotest_common.sh@10 -- # set +x 00:06:22.621 ************************************ 00:06:22.621 START TEST filesystem_xfs 00:06:22.621 ************************************ 00:06:22.621 22:44:13 -- common/autotest_common.sh@1104 -- # nvmf_filesystem_create xfs nvme0n1 00:06:22.621 22:44:13 -- target/filesystem.sh@18 -- # fstype=xfs 00:06:22.621 22:44:13 -- target/filesystem.sh@19 -- # nvme_name=nvme0n1 00:06:22.621 22:44:13 -- target/filesystem.sh@21 -- # make_filesystem xfs /dev/nvme0n1p1 00:06:22.621 22:44:13 -- common/autotest_common.sh@902 -- # local fstype=xfs 00:06:22.621 22:44:13 -- common/autotest_common.sh@903 -- # local dev_name=/dev/nvme0n1p1 00:06:22.621 22:44:13 -- common/autotest_common.sh@904 -- # local i=0 00:06:22.621 22:44:13 -- common/autotest_common.sh@905 -- # local force 00:06:22.621 22:44:13 -- common/autotest_common.sh@907 -- # '[' xfs = ext4 ']' 00:06:22.621 22:44:13 -- common/autotest_common.sh@910 -- # force=-f 00:06:22.621 22:44:13 -- common/autotest_common.sh@913 -- # mkfs.xfs -f /dev/nvme0n1p1 00:06:22.621 meta-data=/dev/nvme0n1p1 isize=512 agcount=4, agsize=32640 blks 00:06:22.621 = sectsz=512 attr=2, projid32bit=1 00:06:22.621 = crc=1 finobt=1, sparse=1, rmapbt=0 00:06:22.621 = reflink=1 bigtime=1 inobtcount=1 nrext64=0 00:06:22.621 data = bsize=4096 blocks=130560, imaxpct=25 00:06:22.621 = sunit=0 swidth=0 blks 00:06:22.621 naming =version 2 bsize=4096 ascii-ci=0, ftype=1 00:06:22.621 log =internal log bsize=4096 blocks=16384, version=2 00:06:22.621 = sectsz=512 sunit=0 blks, lazy-count=1 00:06:22.621 realtime =none extsz=4096 blocks=0, rtextents=0 00:06:23.558 Discarding blocks...Done. 00:06:23.558 22:44:14 -- common/autotest_common.sh@921 -- # return 0 00:06:23.558 22:44:14 -- target/filesystem.sh@23 -- # mount /dev/nvme0n1p1 /mnt/device 00:06:26.126 22:44:16 -- target/filesystem.sh@24 -- # touch /mnt/device/aaa 00:06:26.126 22:44:17 -- target/filesystem.sh@25 -- # sync 00:06:26.126 22:44:17 -- target/filesystem.sh@26 -- # rm /mnt/device/aaa 00:06:26.126 22:44:17 -- target/filesystem.sh@27 -- # sync 00:06:26.126 22:44:17 -- target/filesystem.sh@29 -- # i=0 00:06:26.126 22:44:17 -- target/filesystem.sh@30 -- # umount /mnt/device 00:06:26.126 22:44:17 -- target/filesystem.sh@37 -- # kill -0 175746 00:06:26.126 22:44:17 -- target/filesystem.sh@40 -- # lsblk -l -o NAME 00:06:26.126 22:44:17 -- target/filesystem.sh@40 -- # grep -q -w nvme0n1 00:06:26.126 22:44:17 -- target/filesystem.sh@43 -- # lsblk -l -o NAME 00:06:26.126 22:44:17 -- target/filesystem.sh@43 -- # grep -q -w nvme0n1p1 00:06:26.126 00:06:26.126 real 0m3.493s 00:06:26.126 user 0m0.017s 00:06:26.126 sys 0m0.042s 00:06:26.126 22:44:17 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:06:26.126 22:44:17 -- common/autotest_common.sh@10 -- # set +x 00:06:26.126 ************************************ 00:06:26.126 END TEST filesystem_xfs 00:06:26.126 ************************************ 00:06:26.126 22:44:17 -- target/filesystem.sh@91 -- # flock /dev/nvme0n1 parted -s /dev/nvme0n1 rm 1 00:06:26.126 22:44:17 -- target/filesystem.sh@93 -- # sync 00:06:26.126 22:44:17 -- target/filesystem.sh@94 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:06:26.126 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:06:26.126 22:44:17 -- target/filesystem.sh@95 -- # waitforserial_disconnect SPDKISFASTANDAWESOME 00:06:26.126 22:44:17 -- common/autotest_common.sh@1198 -- # local i=0 00:06:26.126 22:44:17 -- common/autotest_common.sh@1199 -- # lsblk -o NAME,SERIAL 00:06:26.126 22:44:17 -- common/autotest_common.sh@1199 -- # grep -q -w SPDKISFASTANDAWESOME 00:06:26.126 22:44:17 -- common/autotest_common.sh@1206 -- # lsblk -l -o NAME,SERIAL 00:06:26.126 22:44:17 -- common/autotest_common.sh@1206 -- # grep -q -w SPDKISFASTANDAWESOME 00:06:26.126 22:44:17 -- common/autotest_common.sh@1210 -- # return 0 00:06:26.126 22:44:17 -- target/filesystem.sh@97 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:06:26.126 22:44:17 -- common/autotest_common.sh@551 -- # xtrace_disable 00:06:26.126 22:44:17 -- common/autotest_common.sh@10 -- # set +x 00:06:26.126 22:44:17 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:06:26.126 22:44:17 -- target/filesystem.sh@99 -- # trap - SIGINT SIGTERM EXIT 00:06:26.126 22:44:17 -- target/filesystem.sh@101 -- # killprocess 175746 00:06:26.126 22:44:17 -- common/autotest_common.sh@926 -- # '[' -z 175746 ']' 00:06:26.126 22:44:17 -- common/autotest_common.sh@930 -- # kill -0 175746 00:06:26.126 22:44:17 -- common/autotest_common.sh@931 -- # uname 00:06:26.126 22:44:17 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:06:26.126 22:44:17 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 175746 00:06:26.126 22:44:17 -- common/autotest_common.sh@932 -- # process_name=reactor_0 00:06:26.126 22:44:17 -- common/autotest_common.sh@936 -- # '[' reactor_0 = sudo ']' 00:06:26.126 22:44:17 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 175746' 00:06:26.126 killing process with pid 175746 00:06:26.126 22:44:17 -- common/autotest_common.sh@945 -- # kill 175746 00:06:26.126 22:44:17 -- common/autotest_common.sh@950 -- # wait 175746 00:06:26.694 22:44:17 -- target/filesystem.sh@102 -- # nvmfpid= 00:06:26.694 00:06:26.694 real 0m13.376s 00:06:26.694 user 0m51.592s 00:06:26.694 sys 0m1.665s 00:06:26.694 22:44:17 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:06:26.695 22:44:17 -- common/autotest_common.sh@10 -- # set +x 00:06:26.695 ************************************ 00:06:26.695 END TEST nvmf_filesystem_no_in_capsule 00:06:26.695 ************************************ 00:06:26.695 22:44:17 -- target/filesystem.sh@106 -- # run_test nvmf_filesystem_in_capsule nvmf_filesystem_part 4096 00:06:26.695 22:44:17 -- common/autotest_common.sh@1077 -- # '[' 3 -le 1 ']' 00:06:26.695 22:44:17 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:06:26.695 22:44:17 -- common/autotest_common.sh@10 -- # set +x 00:06:26.695 ************************************ 00:06:26.695 START TEST nvmf_filesystem_in_capsule 00:06:26.695 ************************************ 00:06:26.695 22:44:17 -- common/autotest_common.sh@1104 -- # nvmf_filesystem_part 4096 00:06:26.695 22:44:17 -- target/filesystem.sh@47 -- # in_capsule=4096 00:06:26.695 22:44:17 -- target/filesystem.sh@49 -- # nvmfappstart -m 0xF 00:06:26.695 22:44:17 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:06:26.695 22:44:17 -- common/autotest_common.sh@712 -- # xtrace_disable 00:06:26.695 22:44:17 -- common/autotest_common.sh@10 -- # set +x 00:06:26.695 22:44:17 -- nvmf/common.sh@469 -- # nvmfpid=177615 00:06:26.695 22:44:17 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:06:26.695 22:44:17 -- nvmf/common.sh@470 -- # waitforlisten 177615 00:06:26.695 22:44:17 -- common/autotest_common.sh@819 -- # '[' -z 177615 ']' 00:06:26.695 22:44:17 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk.sock 00:06:26.695 22:44:17 -- common/autotest_common.sh@824 -- # local max_retries=100 00:06:26.695 22:44:17 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:06:26.695 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:06:26.695 22:44:17 -- common/autotest_common.sh@828 -- # xtrace_disable 00:06:26.695 22:44:17 -- common/autotest_common.sh@10 -- # set +x 00:06:26.695 [2024-04-16 22:44:17.795460] Starting SPDK v24.01.1-pre git sha1 4b134b4ab / DPDK 23.11.0 initialization... 00:06:26.695 [2024-04-16 22:44:17.795566] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:06:26.954 EAL: No free 2048 kB hugepages reported on node 1 00:06:26.954 [2024-04-16 22:44:17.865280] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:06:26.954 [2024-04-16 22:44:17.983471] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:06:26.954 [2024-04-16 22:44:17.983653] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:06:26.954 [2024-04-16 22:44:17.983672] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:06:26.954 [2024-04-16 22:44:17.983687] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:06:26.954 [2024-04-16 22:44:17.983795] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:06:26.954 [2024-04-16 22:44:17.983863] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:06:26.954 [2024-04-16 22:44:17.983921] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:06:26.954 [2024-04-16 22:44:17.983925] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:27.889 22:44:18 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:06:27.889 22:44:18 -- common/autotest_common.sh@852 -- # return 0 00:06:27.889 22:44:18 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:06:27.889 22:44:18 -- common/autotest_common.sh@718 -- # xtrace_disable 00:06:27.889 22:44:18 -- common/autotest_common.sh@10 -- # set +x 00:06:27.889 22:44:18 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:06:27.889 22:44:18 -- target/filesystem.sh@50 -- # malloc_name=Malloc1 00:06:27.889 22:44:18 -- target/filesystem.sh@52 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 -c 4096 00:06:27.889 22:44:18 -- common/autotest_common.sh@551 -- # xtrace_disable 00:06:27.889 22:44:18 -- common/autotest_common.sh@10 -- # set +x 00:06:27.889 [2024-04-16 22:44:18.770698] tcp.c: 659:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:06:27.889 22:44:18 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:06:27.889 22:44:18 -- target/filesystem.sh@53 -- # rpc_cmd bdev_malloc_create 512 512 -b Malloc1 00:06:27.889 22:44:18 -- common/autotest_common.sh@551 -- # xtrace_disable 00:06:27.889 22:44:18 -- common/autotest_common.sh@10 -- # set +x 00:06:27.889 Malloc1 00:06:27.889 22:44:18 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:06:27.889 22:44:18 -- target/filesystem.sh@54 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDKISFASTANDAWESOME 00:06:27.889 22:44:18 -- common/autotest_common.sh@551 -- # xtrace_disable 00:06:27.889 22:44:18 -- common/autotest_common.sh@10 -- # set +x 00:06:27.889 22:44:18 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:06:27.889 22:44:18 -- target/filesystem.sh@55 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:06:27.889 22:44:18 -- common/autotest_common.sh@551 -- # xtrace_disable 00:06:27.889 22:44:18 -- common/autotest_common.sh@10 -- # set +x 00:06:27.889 22:44:18 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:06:27.889 22:44:18 -- target/filesystem.sh@56 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:06:27.889 22:44:18 -- common/autotest_common.sh@551 -- # xtrace_disable 00:06:27.889 22:44:18 -- common/autotest_common.sh@10 -- # set +x 00:06:27.889 [2024-04-16 22:44:18.957663] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:06:27.889 22:44:18 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:06:27.889 22:44:18 -- target/filesystem.sh@58 -- # get_bdev_size Malloc1 00:06:27.889 22:44:18 -- common/autotest_common.sh@1357 -- # local bdev_name=Malloc1 00:06:27.889 22:44:18 -- common/autotest_common.sh@1358 -- # local bdev_info 00:06:27.889 22:44:18 -- common/autotest_common.sh@1359 -- # local bs 00:06:27.889 22:44:18 -- common/autotest_common.sh@1360 -- # local nb 00:06:27.889 22:44:18 -- common/autotest_common.sh@1361 -- # rpc_cmd bdev_get_bdevs -b Malloc1 00:06:27.889 22:44:18 -- common/autotest_common.sh@551 -- # xtrace_disable 00:06:27.889 22:44:18 -- common/autotest_common.sh@10 -- # set +x 00:06:27.889 22:44:18 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:06:27.889 22:44:18 -- common/autotest_common.sh@1361 -- # bdev_info='[ 00:06:27.889 { 00:06:27.889 "name": "Malloc1", 00:06:27.889 "aliases": [ 00:06:27.889 "03482e9b-e127-41d9-b696-5b03dac711f0" 00:06:27.889 ], 00:06:27.889 "product_name": "Malloc disk", 00:06:27.889 "block_size": 512, 00:06:27.889 "num_blocks": 1048576, 00:06:27.889 "uuid": "03482e9b-e127-41d9-b696-5b03dac711f0", 00:06:27.889 "assigned_rate_limits": { 00:06:27.889 "rw_ios_per_sec": 0, 00:06:27.889 "rw_mbytes_per_sec": 0, 00:06:27.889 "r_mbytes_per_sec": 0, 00:06:27.889 "w_mbytes_per_sec": 0 00:06:27.889 }, 00:06:27.889 "claimed": true, 00:06:27.889 "claim_type": "exclusive_write", 00:06:27.889 "zoned": false, 00:06:27.889 "supported_io_types": { 00:06:27.889 "read": true, 00:06:27.889 "write": true, 00:06:27.889 "unmap": true, 00:06:27.889 "write_zeroes": true, 00:06:27.889 "flush": true, 00:06:27.889 "reset": true, 00:06:27.889 "compare": false, 00:06:27.889 "compare_and_write": false, 00:06:27.889 "abort": true, 00:06:27.889 "nvme_admin": false, 00:06:27.889 "nvme_io": false 00:06:27.889 }, 00:06:27.889 "memory_domains": [ 00:06:27.889 { 00:06:27.889 "dma_device_id": "SPDK_ACCEL_DMA_DEVICE", 00:06:27.889 "dma_device_type": 2 00:06:27.889 } 00:06:27.889 ], 00:06:27.889 "driver_specific": {} 00:06:27.889 } 00:06:27.889 ]' 00:06:27.889 22:44:18 -- common/autotest_common.sh@1362 -- # jq '.[] .block_size' 00:06:28.148 22:44:19 -- common/autotest_common.sh@1362 -- # bs=512 00:06:28.149 22:44:19 -- common/autotest_common.sh@1363 -- # jq '.[] .num_blocks' 00:06:28.149 22:44:19 -- common/autotest_common.sh@1363 -- # nb=1048576 00:06:28.149 22:44:19 -- common/autotest_common.sh@1366 -- # bdev_size=512 00:06:28.149 22:44:19 -- common/autotest_common.sh@1367 -- # echo 512 00:06:28.149 22:44:19 -- target/filesystem.sh@58 -- # malloc_size=536870912 00:06:28.149 22:44:19 -- target/filesystem.sh@60 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:06:28.716 22:44:19 -- target/filesystem.sh@62 -- # waitforserial SPDKISFASTANDAWESOME 00:06:28.716 22:44:19 -- common/autotest_common.sh@1177 -- # local i=0 00:06:28.716 22:44:19 -- common/autotest_common.sh@1178 -- # local nvme_device_counter=1 nvme_devices=0 00:06:28.716 22:44:19 -- common/autotest_common.sh@1179 -- # [[ -n '' ]] 00:06:28.716 22:44:19 -- common/autotest_common.sh@1184 -- # sleep 2 00:06:30.620 22:44:21 -- common/autotest_common.sh@1185 -- # (( i++ <= 15 )) 00:06:30.620 22:44:21 -- common/autotest_common.sh@1186 -- # lsblk -l -o NAME,SERIAL 00:06:30.620 22:44:21 -- common/autotest_common.sh@1186 -- # grep -c SPDKISFASTANDAWESOME 00:06:30.620 22:44:21 -- common/autotest_common.sh@1186 -- # nvme_devices=1 00:06:30.620 22:44:21 -- common/autotest_common.sh@1187 -- # (( nvme_devices == nvme_device_counter )) 00:06:30.620 22:44:21 -- common/autotest_common.sh@1187 -- # return 0 00:06:30.620 22:44:21 -- target/filesystem.sh@63 -- # lsblk -l -o NAME,SERIAL 00:06:30.620 22:44:21 -- target/filesystem.sh@63 -- # grep -oP '([\w]*)(?=\s+SPDKISFASTANDAWESOME)' 00:06:30.620 22:44:21 -- target/filesystem.sh@63 -- # nvme_name=nvme0n1 00:06:30.620 22:44:21 -- target/filesystem.sh@64 -- # sec_size_to_bytes nvme0n1 00:06:30.620 22:44:21 -- setup/common.sh@76 -- # local dev=nvme0n1 00:06:30.620 22:44:21 -- setup/common.sh@78 -- # [[ -e /sys/block/nvme0n1 ]] 00:06:30.620 22:44:21 -- setup/common.sh@80 -- # echo 536870912 00:06:30.620 22:44:21 -- target/filesystem.sh@64 -- # nvme_size=536870912 00:06:30.620 22:44:21 -- target/filesystem.sh@66 -- # mkdir -p /mnt/device 00:06:30.620 22:44:21 -- target/filesystem.sh@67 -- # (( nvme_size == malloc_size )) 00:06:30.620 22:44:21 -- target/filesystem.sh@68 -- # parted -s /dev/nvme0n1 mklabel gpt mkpart SPDK_TEST 0% 100% 00:06:30.879 22:44:21 -- target/filesystem.sh@69 -- # partprobe 00:06:31.449 22:44:22 -- target/filesystem.sh@70 -- # sleep 1 00:06:32.388 22:44:23 -- target/filesystem.sh@76 -- # '[' 4096 -eq 0 ']' 00:06:32.388 22:44:23 -- target/filesystem.sh@81 -- # run_test filesystem_in_capsule_ext4 nvmf_filesystem_create ext4 nvme0n1 00:06:32.388 22:44:23 -- common/autotest_common.sh@1077 -- # '[' 4 -le 1 ']' 00:06:32.388 22:44:23 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:06:32.388 22:44:23 -- common/autotest_common.sh@10 -- # set +x 00:06:32.388 ************************************ 00:06:32.388 START TEST filesystem_in_capsule_ext4 00:06:32.388 ************************************ 00:06:32.388 22:44:23 -- common/autotest_common.sh@1104 -- # nvmf_filesystem_create ext4 nvme0n1 00:06:32.388 22:44:23 -- target/filesystem.sh@18 -- # fstype=ext4 00:06:32.388 22:44:23 -- target/filesystem.sh@19 -- # nvme_name=nvme0n1 00:06:32.388 22:44:23 -- target/filesystem.sh@21 -- # make_filesystem ext4 /dev/nvme0n1p1 00:06:32.388 22:44:23 -- common/autotest_common.sh@902 -- # local fstype=ext4 00:06:32.388 22:44:23 -- common/autotest_common.sh@903 -- # local dev_name=/dev/nvme0n1p1 00:06:32.388 22:44:23 -- common/autotest_common.sh@904 -- # local i=0 00:06:32.388 22:44:23 -- common/autotest_common.sh@905 -- # local force 00:06:32.388 22:44:23 -- common/autotest_common.sh@907 -- # '[' ext4 = ext4 ']' 00:06:32.388 22:44:23 -- common/autotest_common.sh@908 -- # force=-F 00:06:32.388 22:44:23 -- common/autotest_common.sh@913 -- # mkfs.ext4 -F /dev/nvme0n1p1 00:06:32.388 mke2fs 1.46.5 (30-Dec-2021) 00:06:32.388 Discarding device blocks: 0/522240 done 00:06:32.388 Creating filesystem with 522240 1k blocks and 130560 inodes 00:06:32.388 Filesystem UUID: 12a83587-09bf-41da-8871-d5200460170a 00:06:32.388 Superblock backups stored on blocks: 00:06:32.388 8193, 24577, 40961, 57345, 73729, 204801, 221185, 401409 00:06:32.388 00:06:32.388 Allocating group tables: 0/64 done 00:06:32.388 Writing inode tables: 0/64 done 00:06:32.648 Creating journal (8192 blocks): done 00:06:33.732 Writing superblocks and filesystem accounting information: 0/64 4/64 done 00:06:33.732 00:06:33.732 22:44:24 -- common/autotest_common.sh@921 -- # return 0 00:06:33.732 22:44:24 -- target/filesystem.sh@23 -- # mount /dev/nvme0n1p1 /mnt/device 00:06:33.732 22:44:24 -- target/filesystem.sh@24 -- # touch /mnt/device/aaa 00:06:33.732 22:44:24 -- target/filesystem.sh@25 -- # sync 00:06:33.732 22:44:24 -- target/filesystem.sh@26 -- # rm /mnt/device/aaa 00:06:33.732 22:44:24 -- target/filesystem.sh@27 -- # sync 00:06:33.732 22:44:24 -- target/filesystem.sh@29 -- # i=0 00:06:33.732 22:44:24 -- target/filesystem.sh@30 -- # umount /mnt/device 00:06:33.732 22:44:24 -- target/filesystem.sh@37 -- # kill -0 177615 00:06:33.732 22:44:24 -- target/filesystem.sh@40 -- # lsblk -l -o NAME 00:06:33.732 22:44:24 -- target/filesystem.sh@40 -- # grep -q -w nvme0n1 00:06:33.732 22:44:24 -- target/filesystem.sh@43 -- # lsblk -l -o NAME 00:06:33.732 22:44:24 -- target/filesystem.sh@43 -- # grep -q -w nvme0n1p1 00:06:33.732 00:06:33.733 real 0m1.369s 00:06:33.733 user 0m0.012s 00:06:33.733 sys 0m0.028s 00:06:33.733 22:44:24 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:06:33.733 22:44:24 -- common/autotest_common.sh@10 -- # set +x 00:06:33.733 ************************************ 00:06:33.733 END TEST filesystem_in_capsule_ext4 00:06:33.733 ************************************ 00:06:33.733 22:44:24 -- target/filesystem.sh@82 -- # run_test filesystem_in_capsule_btrfs nvmf_filesystem_create btrfs nvme0n1 00:06:33.733 22:44:24 -- common/autotest_common.sh@1077 -- # '[' 4 -le 1 ']' 00:06:33.733 22:44:24 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:06:33.733 22:44:24 -- common/autotest_common.sh@10 -- # set +x 00:06:33.733 ************************************ 00:06:33.733 START TEST filesystem_in_capsule_btrfs 00:06:33.733 ************************************ 00:06:33.733 22:44:24 -- common/autotest_common.sh@1104 -- # nvmf_filesystem_create btrfs nvme0n1 00:06:33.733 22:44:24 -- target/filesystem.sh@18 -- # fstype=btrfs 00:06:33.733 22:44:24 -- target/filesystem.sh@19 -- # nvme_name=nvme0n1 00:06:33.733 22:44:24 -- target/filesystem.sh@21 -- # make_filesystem btrfs /dev/nvme0n1p1 00:06:33.733 22:44:24 -- common/autotest_common.sh@902 -- # local fstype=btrfs 00:06:33.733 22:44:24 -- common/autotest_common.sh@903 -- # local dev_name=/dev/nvme0n1p1 00:06:33.733 22:44:24 -- common/autotest_common.sh@904 -- # local i=0 00:06:33.733 22:44:24 -- common/autotest_common.sh@905 -- # local force 00:06:33.733 22:44:24 -- common/autotest_common.sh@907 -- # '[' btrfs = ext4 ']' 00:06:33.733 22:44:24 -- common/autotest_common.sh@910 -- # force=-f 00:06:33.733 22:44:24 -- common/autotest_common.sh@913 -- # mkfs.btrfs -f /dev/nvme0n1p1 00:06:33.992 btrfs-progs v6.6.2 00:06:33.992 See https://btrfs.readthedocs.io for more information. 00:06:33.992 00:06:33.992 Performing full device TRIM /dev/nvme0n1p1 (510.00MiB) ... 00:06:33.992 NOTE: several default settings have changed in version 5.15, please make sure 00:06:33.992 this does not affect your deployments: 00:06:33.992 - DUP for metadata (-m dup) 00:06:33.992 - enabled no-holes (-O no-holes) 00:06:33.992 - enabled free-space-tree (-R free-space-tree) 00:06:33.992 00:06:33.992 Label: (null) 00:06:33.992 UUID: 217ffca2-3950-4960-9dd0-332c1fef8162 00:06:33.992 Node size: 16384 00:06:33.992 Sector size: 4096 00:06:33.992 Filesystem size: 510.00MiB 00:06:33.992 Block group profiles: 00:06:33.992 Data: single 8.00MiB 00:06:33.992 Metadata: DUP 32.00MiB 00:06:33.992 System: DUP 8.00MiB 00:06:33.992 SSD detected: yes 00:06:33.992 Zoned device: no 00:06:33.992 Incompat features: extref, skinny-metadata, no-holes, free-space-tree 00:06:33.992 Runtime features: free-space-tree 00:06:33.992 Checksum: crc32c 00:06:33.992 Number of devices: 1 00:06:33.992 Devices: 00:06:33.992 ID SIZE PATH 00:06:33.992 1 510.00MiB /dev/nvme0n1p1 00:06:33.992 00:06:33.992 22:44:25 -- common/autotest_common.sh@921 -- # return 0 00:06:33.992 22:44:25 -- target/filesystem.sh@23 -- # mount /dev/nvme0n1p1 /mnt/device 00:06:34.561 22:44:25 -- target/filesystem.sh@24 -- # touch /mnt/device/aaa 00:06:34.561 22:44:25 -- target/filesystem.sh@25 -- # sync 00:06:34.561 22:44:25 -- target/filesystem.sh@26 -- # rm /mnt/device/aaa 00:06:34.561 22:44:25 -- target/filesystem.sh@27 -- # sync 00:06:34.561 22:44:25 -- target/filesystem.sh@29 -- # i=0 00:06:34.561 22:44:25 -- target/filesystem.sh@30 -- # umount /mnt/device 00:06:34.561 22:44:25 -- target/filesystem.sh@37 -- # kill -0 177615 00:06:34.561 22:44:25 -- target/filesystem.sh@40 -- # lsblk -l -o NAME 00:06:34.562 22:44:25 -- target/filesystem.sh@40 -- # grep -q -w nvme0n1 00:06:34.562 22:44:25 -- target/filesystem.sh@43 -- # lsblk -l -o NAME 00:06:34.562 22:44:25 -- target/filesystem.sh@43 -- # grep -q -w nvme0n1p1 00:06:34.562 00:06:34.562 real 0m0.877s 00:06:34.562 user 0m0.018s 00:06:34.562 sys 0m0.038s 00:06:34.562 22:44:25 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:06:34.562 22:44:25 -- common/autotest_common.sh@10 -- # set +x 00:06:34.562 ************************************ 00:06:34.562 END TEST filesystem_in_capsule_btrfs 00:06:34.562 ************************************ 00:06:34.562 22:44:25 -- target/filesystem.sh@83 -- # run_test filesystem_in_capsule_xfs nvmf_filesystem_create xfs nvme0n1 00:06:34.562 22:44:25 -- common/autotest_common.sh@1077 -- # '[' 4 -le 1 ']' 00:06:34.562 22:44:25 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:06:34.562 22:44:25 -- common/autotest_common.sh@10 -- # set +x 00:06:34.820 ************************************ 00:06:34.820 START TEST filesystem_in_capsule_xfs 00:06:34.820 ************************************ 00:06:34.820 22:44:25 -- common/autotest_common.sh@1104 -- # nvmf_filesystem_create xfs nvme0n1 00:06:34.820 22:44:25 -- target/filesystem.sh@18 -- # fstype=xfs 00:06:34.820 22:44:25 -- target/filesystem.sh@19 -- # nvme_name=nvme0n1 00:06:34.820 22:44:25 -- target/filesystem.sh@21 -- # make_filesystem xfs /dev/nvme0n1p1 00:06:34.820 22:44:25 -- common/autotest_common.sh@902 -- # local fstype=xfs 00:06:34.820 22:44:25 -- common/autotest_common.sh@903 -- # local dev_name=/dev/nvme0n1p1 00:06:34.820 22:44:25 -- common/autotest_common.sh@904 -- # local i=0 00:06:34.820 22:44:25 -- common/autotest_common.sh@905 -- # local force 00:06:34.820 22:44:25 -- common/autotest_common.sh@907 -- # '[' xfs = ext4 ']' 00:06:34.820 22:44:25 -- common/autotest_common.sh@910 -- # force=-f 00:06:34.820 22:44:25 -- common/autotest_common.sh@913 -- # mkfs.xfs -f /dev/nvme0n1p1 00:06:34.820 meta-data=/dev/nvme0n1p1 isize=512 agcount=4, agsize=32640 blks 00:06:34.820 = sectsz=512 attr=2, projid32bit=1 00:06:34.820 = crc=1 finobt=1, sparse=1, rmapbt=0 00:06:34.820 = reflink=1 bigtime=1 inobtcount=1 nrext64=0 00:06:34.820 data = bsize=4096 blocks=130560, imaxpct=25 00:06:34.820 = sunit=0 swidth=0 blks 00:06:34.820 naming =version 2 bsize=4096 ascii-ci=0, ftype=1 00:06:34.820 log =internal log bsize=4096 blocks=16384, version=2 00:06:34.820 = sectsz=512 sunit=0 blks, lazy-count=1 00:06:34.820 realtime =none extsz=4096 blocks=0, rtextents=0 00:06:35.759 Discarding blocks...Done. 00:06:35.759 22:44:26 -- common/autotest_common.sh@921 -- # return 0 00:06:35.759 22:44:26 -- target/filesystem.sh@23 -- # mount /dev/nvme0n1p1 /mnt/device 00:06:38.292 22:44:28 -- target/filesystem.sh@24 -- # touch /mnt/device/aaa 00:06:38.292 22:44:28 -- target/filesystem.sh@25 -- # sync 00:06:38.292 22:44:28 -- target/filesystem.sh@26 -- # rm /mnt/device/aaa 00:06:38.292 22:44:28 -- target/filesystem.sh@27 -- # sync 00:06:38.292 22:44:28 -- target/filesystem.sh@29 -- # i=0 00:06:38.292 22:44:28 -- target/filesystem.sh@30 -- # umount /mnt/device 00:06:38.292 22:44:28 -- target/filesystem.sh@37 -- # kill -0 177615 00:06:38.292 22:44:28 -- target/filesystem.sh@40 -- # lsblk -l -o NAME 00:06:38.292 22:44:28 -- target/filesystem.sh@40 -- # grep -q -w nvme0n1 00:06:38.292 22:44:28 -- target/filesystem.sh@43 -- # lsblk -l -o NAME 00:06:38.292 22:44:28 -- target/filesystem.sh@43 -- # grep -q -w nvme0n1p1 00:06:38.292 00:06:38.292 real 0m3.217s 00:06:38.292 user 0m0.017s 00:06:38.292 sys 0m0.039s 00:06:38.292 22:44:28 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:06:38.292 22:44:28 -- common/autotest_common.sh@10 -- # set +x 00:06:38.292 ************************************ 00:06:38.292 END TEST filesystem_in_capsule_xfs 00:06:38.292 ************************************ 00:06:38.292 22:44:28 -- target/filesystem.sh@91 -- # flock /dev/nvme0n1 parted -s /dev/nvme0n1 rm 1 00:06:38.292 22:44:29 -- target/filesystem.sh@93 -- # sync 00:06:38.292 22:44:29 -- target/filesystem.sh@94 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:06:38.292 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:06:38.292 22:44:29 -- target/filesystem.sh@95 -- # waitforserial_disconnect SPDKISFASTANDAWESOME 00:06:38.292 22:44:29 -- common/autotest_common.sh@1198 -- # local i=0 00:06:38.292 22:44:29 -- common/autotest_common.sh@1199 -- # lsblk -o NAME,SERIAL 00:06:38.292 22:44:29 -- common/autotest_common.sh@1199 -- # grep -q -w SPDKISFASTANDAWESOME 00:06:38.292 22:44:29 -- common/autotest_common.sh@1206 -- # lsblk -l -o NAME,SERIAL 00:06:38.293 22:44:29 -- common/autotest_common.sh@1206 -- # grep -q -w SPDKISFASTANDAWESOME 00:06:38.293 22:44:29 -- common/autotest_common.sh@1210 -- # return 0 00:06:38.293 22:44:29 -- target/filesystem.sh@97 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:06:38.293 22:44:29 -- common/autotest_common.sh@551 -- # xtrace_disable 00:06:38.293 22:44:29 -- common/autotest_common.sh@10 -- # set +x 00:06:38.293 22:44:29 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:06:38.293 22:44:29 -- target/filesystem.sh@99 -- # trap - SIGINT SIGTERM EXIT 00:06:38.293 22:44:29 -- target/filesystem.sh@101 -- # killprocess 177615 00:06:38.293 22:44:29 -- common/autotest_common.sh@926 -- # '[' -z 177615 ']' 00:06:38.293 22:44:29 -- common/autotest_common.sh@930 -- # kill -0 177615 00:06:38.293 22:44:29 -- common/autotest_common.sh@931 -- # uname 00:06:38.293 22:44:29 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:06:38.293 22:44:29 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 177615 00:06:38.293 22:44:29 -- common/autotest_common.sh@932 -- # process_name=reactor_0 00:06:38.293 22:44:29 -- common/autotest_common.sh@936 -- # '[' reactor_0 = sudo ']' 00:06:38.293 22:44:29 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 177615' 00:06:38.293 killing process with pid 177615 00:06:38.293 22:44:29 -- common/autotest_common.sh@945 -- # kill 177615 00:06:38.293 22:44:29 -- common/autotest_common.sh@950 -- # wait 177615 00:06:38.552 22:44:29 -- target/filesystem.sh@102 -- # nvmfpid= 00:06:38.552 00:06:38.552 real 0m11.884s 00:06:38.552 user 0m45.596s 00:06:38.552 sys 0m1.589s 00:06:38.552 22:44:29 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:06:38.552 22:44:29 -- common/autotest_common.sh@10 -- # set +x 00:06:38.552 ************************************ 00:06:38.552 END TEST nvmf_filesystem_in_capsule 00:06:38.552 ************************************ 00:06:38.552 22:44:29 -- target/filesystem.sh@108 -- # nvmftestfini 00:06:38.552 22:44:29 -- nvmf/common.sh@476 -- # nvmfcleanup 00:06:38.552 22:44:29 -- nvmf/common.sh@116 -- # sync 00:06:38.552 22:44:29 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:06:38.552 22:44:29 -- nvmf/common.sh@119 -- # set +e 00:06:38.552 22:44:29 -- nvmf/common.sh@120 -- # for i in {1..20} 00:06:38.552 22:44:29 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:06:38.552 rmmod nvme_tcp 00:06:38.552 rmmod nvme_fabrics 00:06:38.812 rmmod nvme_keyring 00:06:38.812 22:44:29 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:06:38.812 22:44:29 -- nvmf/common.sh@123 -- # set -e 00:06:38.812 22:44:29 -- nvmf/common.sh@124 -- # return 0 00:06:38.812 22:44:29 -- nvmf/common.sh@477 -- # '[' -n '' ']' 00:06:38.812 22:44:29 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:06:38.813 22:44:29 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:06:38.813 22:44:29 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:06:38.813 22:44:29 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:06:38.813 22:44:29 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:06:38.813 22:44:29 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:06:38.813 22:44:29 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:06:38.813 22:44:29 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:06:40.720 22:44:31 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:06:40.720 00:06:40.720 real 0m29.543s 00:06:40.720 user 1m37.985s 00:06:40.720 sys 0m4.755s 00:06:40.720 22:44:31 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:06:40.720 22:44:31 -- common/autotest_common.sh@10 -- # set +x 00:06:40.720 ************************************ 00:06:40.720 END TEST nvmf_filesystem 00:06:40.720 ************************************ 00:06:40.720 22:44:31 -- nvmf/nvmf.sh@25 -- # run_test nvmf_discovery /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/discovery.sh --transport=tcp 00:06:40.720 22:44:31 -- common/autotest_common.sh@1077 -- # '[' 3 -le 1 ']' 00:06:40.720 22:44:31 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:06:40.720 22:44:31 -- common/autotest_common.sh@10 -- # set +x 00:06:40.720 ************************************ 00:06:40.720 START TEST nvmf_discovery 00:06:40.720 ************************************ 00:06:40.720 22:44:31 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/discovery.sh --transport=tcp 00:06:40.720 * Looking for test storage... 00:06:40.720 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:06:40.720 22:44:31 -- target/discovery.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:06:40.720 22:44:31 -- nvmf/common.sh@7 -- # uname -s 00:06:40.720 22:44:31 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:06:40.720 22:44:31 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:06:40.720 22:44:31 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:06:40.720 22:44:31 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:06:40.720 22:44:31 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:06:40.720 22:44:31 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:06:40.720 22:44:31 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:06:40.720 22:44:31 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:06:40.720 22:44:31 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:06:40.720 22:44:31 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:06:40.720 22:44:31 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:06:40.720 22:44:31 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:06:40.720 22:44:31 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:06:40.720 22:44:31 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:06:40.720 22:44:31 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:06:40.720 22:44:31 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:06:40.720 22:44:31 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:06:40.720 22:44:31 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:06:40.720 22:44:31 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:06:40.720 22:44:31 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:06:40.720 22:44:31 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:06:40.720 22:44:31 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:06:40.720 22:44:31 -- paths/export.sh@5 -- # export PATH 00:06:40.720 22:44:31 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:06:40.720 22:44:31 -- nvmf/common.sh@46 -- # : 0 00:06:40.720 22:44:31 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:06:40.720 22:44:31 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:06:40.720 22:44:31 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:06:40.720 22:44:31 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:06:40.720 22:44:31 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:06:40.720 22:44:31 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:06:40.720 22:44:31 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:06:40.720 22:44:31 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:06:40.720 22:44:31 -- target/discovery.sh@11 -- # NULL_BDEV_SIZE=102400 00:06:40.720 22:44:31 -- target/discovery.sh@12 -- # NULL_BLOCK_SIZE=512 00:06:40.720 22:44:31 -- target/discovery.sh@13 -- # NVMF_PORT_REFERRAL=4430 00:06:40.720 22:44:31 -- target/discovery.sh@15 -- # hash nvme 00:06:40.720 22:44:31 -- target/discovery.sh@20 -- # nvmftestinit 00:06:40.720 22:44:31 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:06:40.720 22:44:31 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:06:40.720 22:44:31 -- nvmf/common.sh@436 -- # prepare_net_devs 00:06:40.720 22:44:31 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:06:40.720 22:44:31 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:06:40.720 22:44:31 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:06:40.720 22:44:31 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:06:40.720 22:44:31 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:06:40.979 22:44:31 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:06:40.979 22:44:31 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:06:40.979 22:44:31 -- nvmf/common.sh@284 -- # xtrace_disable 00:06:40.979 22:44:31 -- common/autotest_common.sh@10 -- # set +x 00:06:42.882 22:44:33 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:06:42.882 22:44:33 -- nvmf/common.sh@290 -- # pci_devs=() 00:06:42.882 22:44:33 -- nvmf/common.sh@290 -- # local -a pci_devs 00:06:42.882 22:44:33 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:06:42.882 22:44:33 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:06:42.882 22:44:33 -- nvmf/common.sh@292 -- # pci_drivers=() 00:06:42.882 22:44:33 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:06:42.882 22:44:33 -- nvmf/common.sh@294 -- # net_devs=() 00:06:42.882 22:44:33 -- nvmf/common.sh@294 -- # local -ga net_devs 00:06:42.882 22:44:33 -- nvmf/common.sh@295 -- # e810=() 00:06:42.882 22:44:33 -- nvmf/common.sh@295 -- # local -ga e810 00:06:42.882 22:44:33 -- nvmf/common.sh@296 -- # x722=() 00:06:42.882 22:44:33 -- nvmf/common.sh@296 -- # local -ga x722 00:06:42.882 22:44:33 -- nvmf/common.sh@297 -- # mlx=() 00:06:42.882 22:44:33 -- nvmf/common.sh@297 -- # local -ga mlx 00:06:42.882 22:44:33 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:06:42.882 22:44:33 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:06:42.882 22:44:33 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:06:42.882 22:44:33 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:06:42.882 22:44:33 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:06:42.882 22:44:33 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:06:42.882 22:44:33 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:06:42.882 22:44:33 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:06:42.882 22:44:33 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:06:42.882 22:44:33 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:06:42.882 22:44:33 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:06:42.882 22:44:33 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:06:42.882 22:44:33 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:06:42.882 22:44:33 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:06:42.882 22:44:33 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:06:42.882 22:44:33 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:06:42.882 22:44:33 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:06:42.882 22:44:33 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:06:42.882 22:44:33 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:06:42.882 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:06:42.882 22:44:33 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:06:42.882 22:44:33 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:06:42.882 22:44:33 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:06:42.882 22:44:33 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:06:42.883 22:44:33 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:06:42.883 22:44:33 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:06:42.883 22:44:33 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:06:42.883 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:06:42.883 22:44:33 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:06:42.883 22:44:33 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:06:42.883 22:44:33 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:06:42.883 22:44:33 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:06:42.883 22:44:33 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:06:42.883 22:44:33 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:06:42.883 22:44:33 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:06:42.883 22:44:33 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:06:42.883 22:44:33 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:06:42.883 22:44:33 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:06:42.883 22:44:33 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:06:42.883 22:44:33 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:06:42.883 22:44:33 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:06:42.883 Found net devices under 0000:0a:00.0: cvl_0_0 00:06:42.883 22:44:33 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:06:42.883 22:44:33 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:06:42.883 22:44:33 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:06:42.883 22:44:33 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:06:42.883 22:44:33 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:06:42.883 22:44:33 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:06:42.883 Found net devices under 0000:0a:00.1: cvl_0_1 00:06:42.883 22:44:33 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:06:42.883 22:44:33 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:06:42.883 22:44:33 -- nvmf/common.sh@402 -- # is_hw=yes 00:06:42.883 22:44:33 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:06:42.883 22:44:33 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:06:42.883 22:44:33 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:06:42.883 22:44:33 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:06:42.883 22:44:33 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:06:42.883 22:44:33 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:06:42.883 22:44:33 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:06:42.883 22:44:33 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:06:42.883 22:44:33 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:06:42.883 22:44:33 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:06:42.883 22:44:33 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:06:42.883 22:44:33 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:06:42.883 22:44:33 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:06:42.883 22:44:33 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:06:42.883 22:44:33 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:06:42.883 22:44:33 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:06:42.883 22:44:33 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:06:42.883 22:44:33 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:06:42.883 22:44:34 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:06:42.883 22:44:34 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:06:43.142 22:44:34 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:06:43.142 22:44:34 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:06:43.142 22:44:34 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:06:43.142 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:06:43.142 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.238 ms 00:06:43.142 00:06:43.142 --- 10.0.0.2 ping statistics --- 00:06:43.142 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:06:43.142 rtt min/avg/max/mdev = 0.238/0.238/0.238/0.000 ms 00:06:43.142 22:44:34 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:06:43.142 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:06:43.142 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.114 ms 00:06:43.142 00:06:43.142 --- 10.0.0.1 ping statistics --- 00:06:43.142 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:06:43.142 rtt min/avg/max/mdev = 0.114/0.114/0.114/0.000 ms 00:06:43.142 22:44:34 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:06:43.142 22:44:34 -- nvmf/common.sh@410 -- # return 0 00:06:43.142 22:44:34 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:06:43.142 22:44:34 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:06:43.142 22:44:34 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:06:43.142 22:44:34 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:06:43.142 22:44:34 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:06:43.142 22:44:34 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:06:43.142 22:44:34 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:06:43.142 22:44:34 -- target/discovery.sh@21 -- # nvmfappstart -m 0xF 00:06:43.142 22:44:34 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:06:43.142 22:44:34 -- common/autotest_common.sh@712 -- # xtrace_disable 00:06:43.142 22:44:34 -- common/autotest_common.sh@10 -- # set +x 00:06:43.142 22:44:34 -- nvmf/common.sh@469 -- # nvmfpid=181142 00:06:43.142 22:44:34 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:06:43.142 22:44:34 -- nvmf/common.sh@470 -- # waitforlisten 181142 00:06:43.142 22:44:34 -- common/autotest_common.sh@819 -- # '[' -z 181142 ']' 00:06:43.142 22:44:34 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk.sock 00:06:43.142 22:44:34 -- common/autotest_common.sh@824 -- # local max_retries=100 00:06:43.142 22:44:34 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:06:43.142 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:06:43.142 22:44:34 -- common/autotest_common.sh@828 -- # xtrace_disable 00:06:43.142 22:44:34 -- common/autotest_common.sh@10 -- # set +x 00:06:43.142 [2024-04-16 22:44:34.129000] Starting SPDK v24.01.1-pre git sha1 4b134b4ab / DPDK 23.11.0 initialization... 00:06:43.142 [2024-04-16 22:44:34.129086] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:06:43.142 EAL: No free 2048 kB hugepages reported on node 1 00:06:43.142 [2024-04-16 22:44:34.193688] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:06:43.422 [2024-04-16 22:44:34.303602] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:06:43.422 [2024-04-16 22:44:34.303752] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:06:43.422 [2024-04-16 22:44:34.303770] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:06:43.422 [2024-04-16 22:44:34.303783] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:06:43.422 [2024-04-16 22:44:34.303835] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:06:43.422 [2024-04-16 22:44:34.303861] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:06:43.422 [2024-04-16 22:44:34.303910] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:06:43.422 [2024-04-16 22:44:34.303913] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:44.018 22:44:35 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:06:44.018 22:44:35 -- common/autotest_common.sh@852 -- # return 0 00:06:44.018 22:44:35 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:06:44.018 22:44:35 -- common/autotest_common.sh@718 -- # xtrace_disable 00:06:44.018 22:44:35 -- common/autotest_common.sh@10 -- # set +x 00:06:44.018 22:44:35 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:06:44.018 22:44:35 -- target/discovery.sh@23 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:06:44.018 22:44:35 -- common/autotest_common.sh@551 -- # xtrace_disable 00:06:44.018 22:44:35 -- common/autotest_common.sh@10 -- # set +x 00:06:44.018 [2024-04-16 22:44:35.097708] tcp.c: 659:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:06:44.018 22:44:35 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:06:44.018 22:44:35 -- target/discovery.sh@26 -- # seq 1 4 00:06:44.018 22:44:35 -- target/discovery.sh@26 -- # for i in $(seq 1 4) 00:06:44.018 22:44:35 -- target/discovery.sh@27 -- # rpc_cmd bdev_null_create Null1 102400 512 00:06:44.018 22:44:35 -- common/autotest_common.sh@551 -- # xtrace_disable 00:06:44.018 22:44:35 -- common/autotest_common.sh@10 -- # set +x 00:06:44.018 Null1 00:06:44.018 22:44:35 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:06:44.018 22:44:35 -- target/discovery.sh@28 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:06:44.018 22:44:35 -- common/autotest_common.sh@551 -- # xtrace_disable 00:06:44.018 22:44:35 -- common/autotest_common.sh@10 -- # set +x 00:06:44.018 22:44:35 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:06:44.018 22:44:35 -- target/discovery.sh@29 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Null1 00:06:44.018 22:44:35 -- common/autotest_common.sh@551 -- # xtrace_disable 00:06:44.018 22:44:35 -- common/autotest_common.sh@10 -- # set +x 00:06:44.018 22:44:35 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:06:44.018 22:44:35 -- target/discovery.sh@30 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:06:44.018 22:44:35 -- common/autotest_common.sh@551 -- # xtrace_disable 00:06:44.018 22:44:35 -- common/autotest_common.sh@10 -- # set +x 00:06:44.018 [2024-04-16 22:44:35.137960] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:06:44.018 22:44:35 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:06:44.018 22:44:35 -- target/discovery.sh@26 -- # for i in $(seq 1 4) 00:06:44.018 22:44:35 -- target/discovery.sh@27 -- # rpc_cmd bdev_null_create Null2 102400 512 00:06:44.018 22:44:35 -- common/autotest_common.sh@551 -- # xtrace_disable 00:06:44.018 22:44:35 -- common/autotest_common.sh@10 -- # set +x 00:06:44.277 Null2 00:06:44.277 22:44:35 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:06:44.277 22:44:35 -- target/discovery.sh@28 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode2 -a -s SPDK00000000000002 00:06:44.277 22:44:35 -- common/autotest_common.sh@551 -- # xtrace_disable 00:06:44.277 22:44:35 -- common/autotest_common.sh@10 -- # set +x 00:06:44.277 22:44:35 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:06:44.277 22:44:35 -- target/discovery.sh@29 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode2 Null2 00:06:44.277 22:44:35 -- common/autotest_common.sh@551 -- # xtrace_disable 00:06:44.277 22:44:35 -- common/autotest_common.sh@10 -- # set +x 00:06:44.277 22:44:35 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:06:44.277 22:44:35 -- target/discovery.sh@30 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode2 -t tcp -a 10.0.0.2 -s 4420 00:06:44.277 22:44:35 -- common/autotest_common.sh@551 -- # xtrace_disable 00:06:44.277 22:44:35 -- common/autotest_common.sh@10 -- # set +x 00:06:44.277 22:44:35 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:06:44.277 22:44:35 -- target/discovery.sh@26 -- # for i in $(seq 1 4) 00:06:44.277 22:44:35 -- target/discovery.sh@27 -- # rpc_cmd bdev_null_create Null3 102400 512 00:06:44.277 22:44:35 -- common/autotest_common.sh@551 -- # xtrace_disable 00:06:44.277 22:44:35 -- common/autotest_common.sh@10 -- # set +x 00:06:44.277 Null3 00:06:44.277 22:44:35 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:06:44.277 22:44:35 -- target/discovery.sh@28 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode3 -a -s SPDK00000000000003 00:06:44.277 22:44:35 -- common/autotest_common.sh@551 -- # xtrace_disable 00:06:44.277 22:44:35 -- common/autotest_common.sh@10 -- # set +x 00:06:44.277 22:44:35 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:06:44.277 22:44:35 -- target/discovery.sh@29 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode3 Null3 00:06:44.277 22:44:35 -- common/autotest_common.sh@551 -- # xtrace_disable 00:06:44.277 22:44:35 -- common/autotest_common.sh@10 -- # set +x 00:06:44.277 22:44:35 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:06:44.277 22:44:35 -- target/discovery.sh@30 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode3 -t tcp -a 10.0.0.2 -s 4420 00:06:44.277 22:44:35 -- common/autotest_common.sh@551 -- # xtrace_disable 00:06:44.277 22:44:35 -- common/autotest_common.sh@10 -- # set +x 00:06:44.277 22:44:35 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:06:44.277 22:44:35 -- target/discovery.sh@26 -- # for i in $(seq 1 4) 00:06:44.277 22:44:35 -- target/discovery.sh@27 -- # rpc_cmd bdev_null_create Null4 102400 512 00:06:44.277 22:44:35 -- common/autotest_common.sh@551 -- # xtrace_disable 00:06:44.277 22:44:35 -- common/autotest_common.sh@10 -- # set +x 00:06:44.277 Null4 00:06:44.277 22:44:35 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:06:44.277 22:44:35 -- target/discovery.sh@28 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode4 -a -s SPDK00000000000004 00:06:44.277 22:44:35 -- common/autotest_common.sh@551 -- # xtrace_disable 00:06:44.277 22:44:35 -- common/autotest_common.sh@10 -- # set +x 00:06:44.277 22:44:35 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:06:44.277 22:44:35 -- target/discovery.sh@29 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode4 Null4 00:06:44.277 22:44:35 -- common/autotest_common.sh@551 -- # xtrace_disable 00:06:44.277 22:44:35 -- common/autotest_common.sh@10 -- # set +x 00:06:44.277 22:44:35 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:06:44.277 22:44:35 -- target/discovery.sh@30 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode4 -t tcp -a 10.0.0.2 -s 4420 00:06:44.277 22:44:35 -- common/autotest_common.sh@551 -- # xtrace_disable 00:06:44.277 22:44:35 -- common/autotest_common.sh@10 -- # set +x 00:06:44.277 22:44:35 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:06:44.277 22:44:35 -- target/discovery.sh@32 -- # rpc_cmd nvmf_subsystem_add_listener discovery -t tcp -a 10.0.0.2 -s 4420 00:06:44.277 22:44:35 -- common/autotest_common.sh@551 -- # xtrace_disable 00:06:44.277 22:44:35 -- common/autotest_common.sh@10 -- # set +x 00:06:44.277 22:44:35 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:06:44.277 22:44:35 -- target/discovery.sh@35 -- # rpc_cmd nvmf_discovery_add_referral -t tcp -a 10.0.0.2 -s 4430 00:06:44.277 22:44:35 -- common/autotest_common.sh@551 -- # xtrace_disable 00:06:44.277 22:44:35 -- common/autotest_common.sh@10 -- # set +x 00:06:44.277 22:44:35 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:06:44.277 22:44:35 -- target/discovery.sh@37 -- # nvme discover --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -a 10.0.0.2 -s 4420 00:06:44.537 00:06:44.537 Discovery Log Number of Records 6, Generation counter 6 00:06:44.537 =====Discovery Log Entry 0====== 00:06:44.537 trtype: tcp 00:06:44.537 adrfam: ipv4 00:06:44.537 subtype: current discovery subsystem 00:06:44.537 treq: not required 00:06:44.537 portid: 0 00:06:44.537 trsvcid: 4420 00:06:44.537 subnqn: nqn.2014-08.org.nvmexpress.discovery 00:06:44.537 traddr: 10.0.0.2 00:06:44.537 eflags: explicit discovery connections, duplicate discovery information 00:06:44.537 sectype: none 00:06:44.537 =====Discovery Log Entry 1====== 00:06:44.537 trtype: tcp 00:06:44.537 adrfam: ipv4 00:06:44.537 subtype: nvme subsystem 00:06:44.537 treq: not required 00:06:44.537 portid: 0 00:06:44.537 trsvcid: 4420 00:06:44.537 subnqn: nqn.2016-06.io.spdk:cnode1 00:06:44.537 traddr: 10.0.0.2 00:06:44.537 eflags: none 00:06:44.537 sectype: none 00:06:44.537 =====Discovery Log Entry 2====== 00:06:44.537 trtype: tcp 00:06:44.537 adrfam: ipv4 00:06:44.537 subtype: nvme subsystem 00:06:44.537 treq: not required 00:06:44.537 portid: 0 00:06:44.537 trsvcid: 4420 00:06:44.537 subnqn: nqn.2016-06.io.spdk:cnode2 00:06:44.537 traddr: 10.0.0.2 00:06:44.537 eflags: none 00:06:44.537 sectype: none 00:06:44.537 =====Discovery Log Entry 3====== 00:06:44.537 trtype: tcp 00:06:44.537 adrfam: ipv4 00:06:44.537 subtype: nvme subsystem 00:06:44.537 treq: not required 00:06:44.537 portid: 0 00:06:44.537 trsvcid: 4420 00:06:44.537 subnqn: nqn.2016-06.io.spdk:cnode3 00:06:44.537 traddr: 10.0.0.2 00:06:44.537 eflags: none 00:06:44.537 sectype: none 00:06:44.537 =====Discovery Log Entry 4====== 00:06:44.537 trtype: tcp 00:06:44.537 adrfam: ipv4 00:06:44.537 subtype: nvme subsystem 00:06:44.537 treq: not required 00:06:44.537 portid: 0 00:06:44.537 trsvcid: 4420 00:06:44.537 subnqn: nqn.2016-06.io.spdk:cnode4 00:06:44.537 traddr: 10.0.0.2 00:06:44.538 eflags: none 00:06:44.538 sectype: none 00:06:44.538 =====Discovery Log Entry 5====== 00:06:44.538 trtype: tcp 00:06:44.538 adrfam: ipv4 00:06:44.538 subtype: discovery subsystem referral 00:06:44.538 treq: not required 00:06:44.538 portid: 0 00:06:44.538 trsvcid: 4430 00:06:44.538 subnqn: nqn.2014-08.org.nvmexpress.discovery 00:06:44.538 traddr: 10.0.0.2 00:06:44.538 eflags: none 00:06:44.538 sectype: none 00:06:44.538 22:44:35 -- target/discovery.sh@39 -- # echo 'Perform nvmf subsystem discovery via RPC' 00:06:44.538 Perform nvmf subsystem discovery via RPC 00:06:44.538 22:44:35 -- target/discovery.sh@40 -- # rpc_cmd nvmf_get_subsystems 00:06:44.538 22:44:35 -- common/autotest_common.sh@551 -- # xtrace_disable 00:06:44.538 22:44:35 -- common/autotest_common.sh@10 -- # set +x 00:06:44.538 [2024-04-16 22:44:35.442827] nvmf_rpc.c: 275:rpc_nvmf_get_subsystems: *WARNING*: rpc_nvmf_get_subsystems: deprecated feature listener.transport is deprecated in favor of trtype to be removed in v24.05 00:06:44.538 [ 00:06:44.538 { 00:06:44.538 "nqn": "nqn.2014-08.org.nvmexpress.discovery", 00:06:44.538 "subtype": "Discovery", 00:06:44.538 "listen_addresses": [ 00:06:44.538 { 00:06:44.538 "transport": "TCP", 00:06:44.538 "trtype": "TCP", 00:06:44.538 "adrfam": "IPv4", 00:06:44.538 "traddr": "10.0.0.2", 00:06:44.538 "trsvcid": "4420" 00:06:44.538 } 00:06:44.538 ], 00:06:44.538 "allow_any_host": true, 00:06:44.538 "hosts": [] 00:06:44.538 }, 00:06:44.538 { 00:06:44.538 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:06:44.538 "subtype": "NVMe", 00:06:44.538 "listen_addresses": [ 00:06:44.538 { 00:06:44.538 "transport": "TCP", 00:06:44.538 "trtype": "TCP", 00:06:44.538 "adrfam": "IPv4", 00:06:44.538 "traddr": "10.0.0.2", 00:06:44.538 "trsvcid": "4420" 00:06:44.538 } 00:06:44.538 ], 00:06:44.538 "allow_any_host": true, 00:06:44.538 "hosts": [], 00:06:44.538 "serial_number": "SPDK00000000000001", 00:06:44.538 "model_number": "SPDK bdev Controller", 00:06:44.538 "max_namespaces": 32, 00:06:44.538 "min_cntlid": 1, 00:06:44.538 "max_cntlid": 65519, 00:06:44.538 "namespaces": [ 00:06:44.538 { 00:06:44.538 "nsid": 1, 00:06:44.538 "bdev_name": "Null1", 00:06:44.538 "name": "Null1", 00:06:44.538 "nguid": "9F5CDC503CF645CEA9146641D8543603", 00:06:44.538 "uuid": "9f5cdc50-3cf6-45ce-a914-6641d8543603" 00:06:44.538 } 00:06:44.538 ] 00:06:44.538 }, 00:06:44.538 { 00:06:44.538 "nqn": "nqn.2016-06.io.spdk:cnode2", 00:06:44.538 "subtype": "NVMe", 00:06:44.538 "listen_addresses": [ 00:06:44.538 { 00:06:44.538 "transport": "TCP", 00:06:44.538 "trtype": "TCP", 00:06:44.538 "adrfam": "IPv4", 00:06:44.538 "traddr": "10.0.0.2", 00:06:44.538 "trsvcid": "4420" 00:06:44.538 } 00:06:44.538 ], 00:06:44.538 "allow_any_host": true, 00:06:44.538 "hosts": [], 00:06:44.538 "serial_number": "SPDK00000000000002", 00:06:44.538 "model_number": "SPDK bdev Controller", 00:06:44.538 "max_namespaces": 32, 00:06:44.538 "min_cntlid": 1, 00:06:44.538 "max_cntlid": 65519, 00:06:44.538 "namespaces": [ 00:06:44.538 { 00:06:44.538 "nsid": 1, 00:06:44.538 "bdev_name": "Null2", 00:06:44.538 "name": "Null2", 00:06:44.538 "nguid": "5A660CA15A294907AAB2A8FC0D3F4243", 00:06:44.538 "uuid": "5a660ca1-5a29-4907-aab2-a8fc0d3f4243" 00:06:44.538 } 00:06:44.538 ] 00:06:44.538 }, 00:06:44.538 { 00:06:44.538 "nqn": "nqn.2016-06.io.spdk:cnode3", 00:06:44.538 "subtype": "NVMe", 00:06:44.538 "listen_addresses": [ 00:06:44.538 { 00:06:44.538 "transport": "TCP", 00:06:44.538 "trtype": "TCP", 00:06:44.538 "adrfam": "IPv4", 00:06:44.538 "traddr": "10.0.0.2", 00:06:44.538 "trsvcid": "4420" 00:06:44.538 } 00:06:44.538 ], 00:06:44.538 "allow_any_host": true, 00:06:44.538 "hosts": [], 00:06:44.538 "serial_number": "SPDK00000000000003", 00:06:44.538 "model_number": "SPDK bdev Controller", 00:06:44.538 "max_namespaces": 32, 00:06:44.538 "min_cntlid": 1, 00:06:44.538 "max_cntlid": 65519, 00:06:44.538 "namespaces": [ 00:06:44.538 { 00:06:44.538 "nsid": 1, 00:06:44.538 "bdev_name": "Null3", 00:06:44.538 "name": "Null3", 00:06:44.538 "nguid": "B0EB8685285445F9846B38E0F38D93BE", 00:06:44.538 "uuid": "b0eb8685-2854-45f9-846b-38e0f38d93be" 00:06:44.538 } 00:06:44.538 ] 00:06:44.538 }, 00:06:44.538 { 00:06:44.538 "nqn": "nqn.2016-06.io.spdk:cnode4", 00:06:44.538 "subtype": "NVMe", 00:06:44.538 "listen_addresses": [ 00:06:44.538 { 00:06:44.538 "transport": "TCP", 00:06:44.538 "trtype": "TCP", 00:06:44.538 "adrfam": "IPv4", 00:06:44.538 "traddr": "10.0.0.2", 00:06:44.538 "trsvcid": "4420" 00:06:44.538 } 00:06:44.538 ], 00:06:44.538 "allow_any_host": true, 00:06:44.538 "hosts": [], 00:06:44.538 "serial_number": "SPDK00000000000004", 00:06:44.538 "model_number": "SPDK bdev Controller", 00:06:44.538 "max_namespaces": 32, 00:06:44.538 "min_cntlid": 1, 00:06:44.538 "max_cntlid": 65519, 00:06:44.538 "namespaces": [ 00:06:44.538 { 00:06:44.538 "nsid": 1, 00:06:44.538 "bdev_name": "Null4", 00:06:44.538 "name": "Null4", 00:06:44.538 "nguid": "CF8508B936634D7188ECA072FAB34472", 00:06:44.538 "uuid": "cf8508b9-3663-4d71-88ec-a072fab34472" 00:06:44.538 } 00:06:44.538 ] 00:06:44.538 } 00:06:44.538 ] 00:06:44.538 22:44:35 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:06:44.538 22:44:35 -- target/discovery.sh@42 -- # seq 1 4 00:06:44.538 22:44:35 -- target/discovery.sh@42 -- # for i in $(seq 1 4) 00:06:44.538 22:44:35 -- target/discovery.sh@43 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:06:44.538 22:44:35 -- common/autotest_common.sh@551 -- # xtrace_disable 00:06:44.538 22:44:35 -- common/autotest_common.sh@10 -- # set +x 00:06:44.538 22:44:35 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:06:44.538 22:44:35 -- target/discovery.sh@44 -- # rpc_cmd bdev_null_delete Null1 00:06:44.538 22:44:35 -- common/autotest_common.sh@551 -- # xtrace_disable 00:06:44.538 22:44:35 -- common/autotest_common.sh@10 -- # set +x 00:06:44.538 22:44:35 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:06:44.538 22:44:35 -- target/discovery.sh@42 -- # for i in $(seq 1 4) 00:06:44.538 22:44:35 -- target/discovery.sh@43 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode2 00:06:44.538 22:44:35 -- common/autotest_common.sh@551 -- # xtrace_disable 00:06:44.538 22:44:35 -- common/autotest_common.sh@10 -- # set +x 00:06:44.538 22:44:35 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:06:44.538 22:44:35 -- target/discovery.sh@44 -- # rpc_cmd bdev_null_delete Null2 00:06:44.538 22:44:35 -- common/autotest_common.sh@551 -- # xtrace_disable 00:06:44.538 22:44:35 -- common/autotest_common.sh@10 -- # set +x 00:06:44.538 22:44:35 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:06:44.538 22:44:35 -- target/discovery.sh@42 -- # for i in $(seq 1 4) 00:06:44.538 22:44:35 -- target/discovery.sh@43 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode3 00:06:44.538 22:44:35 -- common/autotest_common.sh@551 -- # xtrace_disable 00:06:44.538 22:44:35 -- common/autotest_common.sh@10 -- # set +x 00:06:44.538 22:44:35 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:06:44.538 22:44:35 -- target/discovery.sh@44 -- # rpc_cmd bdev_null_delete Null3 00:06:44.538 22:44:35 -- common/autotest_common.sh@551 -- # xtrace_disable 00:06:44.538 22:44:35 -- common/autotest_common.sh@10 -- # set +x 00:06:44.538 22:44:35 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:06:44.538 22:44:35 -- target/discovery.sh@42 -- # for i in $(seq 1 4) 00:06:44.538 22:44:35 -- target/discovery.sh@43 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode4 00:06:44.538 22:44:35 -- common/autotest_common.sh@551 -- # xtrace_disable 00:06:44.538 22:44:35 -- common/autotest_common.sh@10 -- # set +x 00:06:44.538 22:44:35 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:06:44.538 22:44:35 -- target/discovery.sh@44 -- # rpc_cmd bdev_null_delete Null4 00:06:44.538 22:44:35 -- common/autotest_common.sh@551 -- # xtrace_disable 00:06:44.538 22:44:35 -- common/autotest_common.sh@10 -- # set +x 00:06:44.538 22:44:35 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:06:44.538 22:44:35 -- target/discovery.sh@47 -- # rpc_cmd nvmf_discovery_remove_referral -t tcp -a 10.0.0.2 -s 4430 00:06:44.538 22:44:35 -- common/autotest_common.sh@551 -- # xtrace_disable 00:06:44.538 22:44:35 -- common/autotest_common.sh@10 -- # set +x 00:06:44.538 22:44:35 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:06:44.538 22:44:35 -- target/discovery.sh@49 -- # rpc_cmd bdev_get_bdevs 00:06:44.538 22:44:35 -- target/discovery.sh@49 -- # jq -r '.[].name' 00:06:44.538 22:44:35 -- common/autotest_common.sh@551 -- # xtrace_disable 00:06:44.538 22:44:35 -- common/autotest_common.sh@10 -- # set +x 00:06:44.538 22:44:35 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:06:44.538 22:44:35 -- target/discovery.sh@49 -- # check_bdevs= 00:06:44.538 22:44:35 -- target/discovery.sh@50 -- # '[' -n '' ']' 00:06:44.538 22:44:35 -- target/discovery.sh@55 -- # trap - SIGINT SIGTERM EXIT 00:06:44.538 22:44:35 -- target/discovery.sh@57 -- # nvmftestfini 00:06:44.538 22:44:35 -- nvmf/common.sh@476 -- # nvmfcleanup 00:06:44.538 22:44:35 -- nvmf/common.sh@116 -- # sync 00:06:44.538 22:44:35 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:06:44.538 22:44:35 -- nvmf/common.sh@119 -- # set +e 00:06:44.538 22:44:35 -- nvmf/common.sh@120 -- # for i in {1..20} 00:06:44.538 22:44:35 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:06:44.538 rmmod nvme_tcp 00:06:44.538 rmmod nvme_fabrics 00:06:44.538 rmmod nvme_keyring 00:06:44.538 22:44:35 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:06:44.538 22:44:35 -- nvmf/common.sh@123 -- # set -e 00:06:44.538 22:44:35 -- nvmf/common.sh@124 -- # return 0 00:06:44.538 22:44:35 -- nvmf/common.sh@477 -- # '[' -n 181142 ']' 00:06:44.538 22:44:35 -- nvmf/common.sh@478 -- # killprocess 181142 00:06:44.538 22:44:35 -- common/autotest_common.sh@926 -- # '[' -z 181142 ']' 00:06:44.538 22:44:35 -- common/autotest_common.sh@930 -- # kill -0 181142 00:06:44.538 22:44:35 -- common/autotest_common.sh@931 -- # uname 00:06:44.538 22:44:35 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:06:44.538 22:44:35 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 181142 00:06:44.539 22:44:35 -- common/autotest_common.sh@932 -- # process_name=reactor_0 00:06:44.539 22:44:35 -- common/autotest_common.sh@936 -- # '[' reactor_0 = sudo ']' 00:06:44.539 22:44:35 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 181142' 00:06:44.539 killing process with pid 181142 00:06:44.539 22:44:35 -- common/autotest_common.sh@945 -- # kill 181142 00:06:44.539 [2024-04-16 22:44:35.630657] app.c: 883:log_deprecation_hits: *WARNING*: rpc_nvmf_get_subsystems: deprecation 'listener.transport is deprecated in favor of trtype' scheduled for removal in v24.05 hit 1 times 00:06:44.539 22:44:35 -- common/autotest_common.sh@950 -- # wait 181142 00:06:44.797 22:44:35 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:06:44.797 22:44:35 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:06:44.797 22:44:35 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:06:44.797 22:44:35 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:06:44.797 22:44:35 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:06:44.797 22:44:35 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:06:44.797 22:44:35 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:06:44.797 22:44:35 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:06:47.337 22:44:37 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:06:47.337 00:06:47.337 real 0m6.176s 00:06:47.337 user 0m7.249s 00:06:47.337 sys 0m1.877s 00:06:47.337 22:44:37 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:06:47.337 22:44:37 -- common/autotest_common.sh@10 -- # set +x 00:06:47.337 ************************************ 00:06:47.337 END TEST nvmf_discovery 00:06:47.337 ************************************ 00:06:47.337 22:44:37 -- nvmf/nvmf.sh@26 -- # run_test nvmf_referrals /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/referrals.sh --transport=tcp 00:06:47.337 22:44:37 -- common/autotest_common.sh@1077 -- # '[' 3 -le 1 ']' 00:06:47.337 22:44:37 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:06:47.337 22:44:37 -- common/autotest_common.sh@10 -- # set +x 00:06:47.337 ************************************ 00:06:47.337 START TEST nvmf_referrals 00:06:47.337 ************************************ 00:06:47.337 22:44:37 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/referrals.sh --transport=tcp 00:06:47.337 * Looking for test storage... 00:06:47.337 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:06:47.337 22:44:38 -- target/referrals.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:06:47.337 22:44:38 -- nvmf/common.sh@7 -- # uname -s 00:06:47.337 22:44:38 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:06:47.337 22:44:38 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:06:47.337 22:44:38 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:06:47.337 22:44:38 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:06:47.337 22:44:38 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:06:47.337 22:44:38 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:06:47.337 22:44:38 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:06:47.337 22:44:38 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:06:47.337 22:44:38 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:06:47.337 22:44:38 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:06:47.337 22:44:38 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:06:47.338 22:44:38 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:06:47.338 22:44:38 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:06:47.338 22:44:38 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:06:47.338 22:44:38 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:06:47.338 22:44:38 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:06:47.338 22:44:38 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:06:47.338 22:44:38 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:06:47.338 22:44:38 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:06:47.338 22:44:38 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:06:47.338 22:44:38 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:06:47.338 22:44:38 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:06:47.338 22:44:38 -- paths/export.sh@5 -- # export PATH 00:06:47.338 22:44:38 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:06:47.338 22:44:38 -- nvmf/common.sh@46 -- # : 0 00:06:47.338 22:44:38 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:06:47.338 22:44:38 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:06:47.338 22:44:38 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:06:47.338 22:44:38 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:06:47.338 22:44:38 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:06:47.338 22:44:38 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:06:47.338 22:44:38 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:06:47.338 22:44:38 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:06:47.338 22:44:38 -- target/referrals.sh@11 -- # NVMF_REFERRAL_IP_1=127.0.0.2 00:06:47.338 22:44:38 -- target/referrals.sh@12 -- # NVMF_REFERRAL_IP_2=127.0.0.3 00:06:47.338 22:44:38 -- target/referrals.sh@13 -- # NVMF_REFERRAL_IP_3=127.0.0.4 00:06:47.338 22:44:38 -- target/referrals.sh@14 -- # NVMF_PORT_REFERRAL=4430 00:06:47.338 22:44:38 -- target/referrals.sh@15 -- # DISCOVERY_NQN=nqn.2014-08.org.nvmexpress.discovery 00:06:47.338 22:44:38 -- target/referrals.sh@16 -- # NQN=nqn.2016-06.io.spdk:cnode1 00:06:47.338 22:44:38 -- target/referrals.sh@37 -- # nvmftestinit 00:06:47.338 22:44:38 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:06:47.338 22:44:38 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:06:47.338 22:44:38 -- nvmf/common.sh@436 -- # prepare_net_devs 00:06:47.338 22:44:38 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:06:47.338 22:44:38 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:06:47.338 22:44:38 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:06:47.338 22:44:38 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:06:47.338 22:44:38 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:06:47.338 22:44:38 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:06:47.338 22:44:38 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:06:47.338 22:44:38 -- nvmf/common.sh@284 -- # xtrace_disable 00:06:47.338 22:44:38 -- common/autotest_common.sh@10 -- # set +x 00:06:49.243 22:44:39 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:06:49.243 22:44:39 -- nvmf/common.sh@290 -- # pci_devs=() 00:06:49.243 22:44:39 -- nvmf/common.sh@290 -- # local -a pci_devs 00:06:49.243 22:44:39 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:06:49.243 22:44:39 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:06:49.243 22:44:39 -- nvmf/common.sh@292 -- # pci_drivers=() 00:06:49.243 22:44:39 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:06:49.243 22:44:39 -- nvmf/common.sh@294 -- # net_devs=() 00:06:49.243 22:44:39 -- nvmf/common.sh@294 -- # local -ga net_devs 00:06:49.243 22:44:39 -- nvmf/common.sh@295 -- # e810=() 00:06:49.243 22:44:39 -- nvmf/common.sh@295 -- # local -ga e810 00:06:49.243 22:44:39 -- nvmf/common.sh@296 -- # x722=() 00:06:49.243 22:44:39 -- nvmf/common.sh@296 -- # local -ga x722 00:06:49.243 22:44:39 -- nvmf/common.sh@297 -- # mlx=() 00:06:49.243 22:44:39 -- nvmf/common.sh@297 -- # local -ga mlx 00:06:49.243 22:44:39 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:06:49.243 22:44:39 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:06:49.243 22:44:39 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:06:49.243 22:44:39 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:06:49.243 22:44:39 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:06:49.243 22:44:39 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:06:49.243 22:44:39 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:06:49.243 22:44:39 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:06:49.243 22:44:39 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:06:49.243 22:44:39 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:06:49.243 22:44:39 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:06:49.243 22:44:39 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:06:49.243 22:44:39 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:06:49.243 22:44:39 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:06:49.243 22:44:39 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:06:49.243 22:44:39 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:06:49.243 22:44:39 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:06:49.243 22:44:39 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:06:49.243 22:44:39 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:06:49.243 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:06:49.243 22:44:39 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:06:49.243 22:44:39 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:06:49.243 22:44:39 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:06:49.243 22:44:39 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:06:49.243 22:44:39 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:06:49.243 22:44:39 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:06:49.243 22:44:39 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:06:49.243 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:06:49.243 22:44:39 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:06:49.243 22:44:39 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:06:49.243 22:44:39 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:06:49.243 22:44:39 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:06:49.243 22:44:39 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:06:49.243 22:44:39 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:06:49.243 22:44:39 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:06:49.243 22:44:39 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:06:49.243 22:44:39 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:06:49.243 22:44:39 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:06:49.243 22:44:39 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:06:49.243 22:44:39 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:06:49.244 22:44:39 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:06:49.244 Found net devices under 0000:0a:00.0: cvl_0_0 00:06:49.244 22:44:39 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:06:49.244 22:44:39 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:06:49.244 22:44:39 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:06:49.244 22:44:39 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:06:49.244 22:44:39 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:06:49.244 22:44:39 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:06:49.244 Found net devices under 0000:0a:00.1: cvl_0_1 00:06:49.244 22:44:39 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:06:49.244 22:44:39 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:06:49.244 22:44:39 -- nvmf/common.sh@402 -- # is_hw=yes 00:06:49.244 22:44:39 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:06:49.244 22:44:39 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:06:49.244 22:44:39 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:06:49.244 22:44:39 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:06:49.244 22:44:39 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:06:49.244 22:44:39 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:06:49.244 22:44:39 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:06:49.244 22:44:39 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:06:49.244 22:44:39 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:06:49.244 22:44:39 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:06:49.244 22:44:39 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:06:49.244 22:44:39 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:06:49.244 22:44:39 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:06:49.244 22:44:39 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:06:49.244 22:44:39 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:06:49.244 22:44:39 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:06:49.244 22:44:40 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:06:49.244 22:44:40 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:06:49.244 22:44:40 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:06:49.244 22:44:40 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:06:49.244 22:44:40 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:06:49.244 22:44:40 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:06:49.244 22:44:40 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:06:49.244 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:06:49.244 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.207 ms 00:06:49.244 00:06:49.244 --- 10.0.0.2 ping statistics --- 00:06:49.244 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:06:49.244 rtt min/avg/max/mdev = 0.207/0.207/0.207/0.000 ms 00:06:49.244 22:44:40 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:06:49.244 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:06:49.244 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.112 ms 00:06:49.244 00:06:49.244 --- 10.0.0.1 ping statistics --- 00:06:49.244 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:06:49.244 rtt min/avg/max/mdev = 0.112/0.112/0.112/0.000 ms 00:06:49.244 22:44:40 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:06:49.244 22:44:40 -- nvmf/common.sh@410 -- # return 0 00:06:49.244 22:44:40 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:06:49.244 22:44:40 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:06:49.244 22:44:40 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:06:49.244 22:44:40 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:06:49.244 22:44:40 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:06:49.244 22:44:40 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:06:49.244 22:44:40 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:06:49.244 22:44:40 -- target/referrals.sh@38 -- # nvmfappstart -m 0xF 00:06:49.244 22:44:40 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:06:49.244 22:44:40 -- common/autotest_common.sh@712 -- # xtrace_disable 00:06:49.244 22:44:40 -- common/autotest_common.sh@10 -- # set +x 00:06:49.244 22:44:40 -- nvmf/common.sh@469 -- # nvmfpid=183379 00:06:49.244 22:44:40 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:06:49.244 22:44:40 -- nvmf/common.sh@470 -- # waitforlisten 183379 00:06:49.244 22:44:40 -- common/autotest_common.sh@819 -- # '[' -z 183379 ']' 00:06:49.244 22:44:40 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk.sock 00:06:49.244 22:44:40 -- common/autotest_common.sh@824 -- # local max_retries=100 00:06:49.244 22:44:40 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:06:49.244 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:06:49.244 22:44:40 -- common/autotest_common.sh@828 -- # xtrace_disable 00:06:49.244 22:44:40 -- common/autotest_common.sh@10 -- # set +x 00:06:49.244 [2024-04-16 22:44:40.177687] Starting SPDK v24.01.1-pre git sha1 4b134b4ab / DPDK 23.11.0 initialization... 00:06:49.244 [2024-04-16 22:44:40.177761] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:06:49.244 EAL: No free 2048 kB hugepages reported on node 1 00:06:49.244 [2024-04-16 22:44:40.244398] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:06:49.244 [2024-04-16 22:44:40.352725] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:06:49.244 [2024-04-16 22:44:40.352858] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:06:49.244 [2024-04-16 22:44:40.352875] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:06:49.244 [2024-04-16 22:44:40.352887] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:06:49.244 [2024-04-16 22:44:40.352936] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:06:49.244 [2024-04-16 22:44:40.352959] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:06:49.244 [2024-04-16 22:44:40.353018] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:06:49.244 [2024-04-16 22:44:40.353021] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:50.177 22:44:41 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:06:50.177 22:44:41 -- common/autotest_common.sh@852 -- # return 0 00:06:50.177 22:44:41 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:06:50.177 22:44:41 -- common/autotest_common.sh@718 -- # xtrace_disable 00:06:50.177 22:44:41 -- common/autotest_common.sh@10 -- # set +x 00:06:50.177 22:44:41 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:06:50.177 22:44:41 -- target/referrals.sh@40 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:06:50.177 22:44:41 -- common/autotest_common.sh@551 -- # xtrace_disable 00:06:50.177 22:44:41 -- common/autotest_common.sh@10 -- # set +x 00:06:50.177 [2024-04-16 22:44:41.190871] tcp.c: 659:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:06:50.177 22:44:41 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:06:50.177 22:44:41 -- target/referrals.sh@41 -- # rpc_cmd nvmf_subsystem_add_listener -t tcp -a 10.0.0.2 -s 8009 discovery 00:06:50.177 22:44:41 -- common/autotest_common.sh@551 -- # xtrace_disable 00:06:50.177 22:44:41 -- common/autotest_common.sh@10 -- # set +x 00:06:50.177 [2024-04-16 22:44:41.203034] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 8009 *** 00:06:50.177 22:44:41 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:06:50.177 22:44:41 -- target/referrals.sh@44 -- # rpc_cmd nvmf_discovery_add_referral -t tcp -a 127.0.0.2 -s 4430 00:06:50.177 22:44:41 -- common/autotest_common.sh@551 -- # xtrace_disable 00:06:50.177 22:44:41 -- common/autotest_common.sh@10 -- # set +x 00:06:50.177 22:44:41 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:06:50.177 22:44:41 -- target/referrals.sh@45 -- # rpc_cmd nvmf_discovery_add_referral -t tcp -a 127.0.0.3 -s 4430 00:06:50.177 22:44:41 -- common/autotest_common.sh@551 -- # xtrace_disable 00:06:50.177 22:44:41 -- common/autotest_common.sh@10 -- # set +x 00:06:50.177 22:44:41 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:06:50.177 22:44:41 -- target/referrals.sh@46 -- # rpc_cmd nvmf_discovery_add_referral -t tcp -a 127.0.0.4 -s 4430 00:06:50.177 22:44:41 -- common/autotest_common.sh@551 -- # xtrace_disable 00:06:50.177 22:44:41 -- common/autotest_common.sh@10 -- # set +x 00:06:50.177 22:44:41 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:06:50.177 22:44:41 -- target/referrals.sh@48 -- # rpc_cmd nvmf_discovery_get_referrals 00:06:50.177 22:44:41 -- common/autotest_common.sh@551 -- # xtrace_disable 00:06:50.177 22:44:41 -- target/referrals.sh@48 -- # jq length 00:06:50.177 22:44:41 -- common/autotest_common.sh@10 -- # set +x 00:06:50.177 22:44:41 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:06:50.177 22:44:41 -- target/referrals.sh@48 -- # (( 3 == 3 )) 00:06:50.177 22:44:41 -- target/referrals.sh@49 -- # get_referral_ips rpc 00:06:50.177 22:44:41 -- target/referrals.sh@19 -- # [[ rpc == \r\p\c ]] 00:06:50.177 22:44:41 -- target/referrals.sh@21 -- # rpc_cmd nvmf_discovery_get_referrals 00:06:50.177 22:44:41 -- target/referrals.sh@21 -- # jq -r '.[].address.traddr' 00:06:50.177 22:44:41 -- common/autotest_common.sh@551 -- # xtrace_disable 00:06:50.177 22:44:41 -- common/autotest_common.sh@10 -- # set +x 00:06:50.177 22:44:41 -- target/referrals.sh@21 -- # sort 00:06:50.177 22:44:41 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:06:50.435 22:44:41 -- target/referrals.sh@21 -- # echo 127.0.0.2 127.0.0.3 127.0.0.4 00:06:50.435 22:44:41 -- target/referrals.sh@49 -- # [[ 127.0.0.2 127.0.0.3 127.0.0.4 == \1\2\7\.\0\.\0\.\2\ \1\2\7\.\0\.\0\.\3\ \1\2\7\.\0\.\0\.\4 ]] 00:06:50.435 22:44:41 -- target/referrals.sh@50 -- # get_referral_ips nvme 00:06:50.435 22:44:41 -- target/referrals.sh@19 -- # [[ nvme == \r\p\c ]] 00:06:50.435 22:44:41 -- target/referrals.sh@22 -- # [[ nvme == \n\v\m\e ]] 00:06:50.435 22:44:41 -- target/referrals.sh@26 -- # nvme discover --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -a 10.0.0.2 -s 8009 -o json 00:06:50.435 22:44:41 -- target/referrals.sh@26 -- # jq -r '.records[] | select(.subtype != "current discovery subsystem").traddr' 00:06:50.435 22:44:41 -- target/referrals.sh@26 -- # sort 00:06:50.435 22:44:41 -- target/referrals.sh@26 -- # echo 127.0.0.2 127.0.0.3 127.0.0.4 00:06:50.435 22:44:41 -- target/referrals.sh@50 -- # [[ 127.0.0.2 127.0.0.3 127.0.0.4 == \1\2\7\.\0\.\0\.\2\ \1\2\7\.\0\.\0\.\3\ \1\2\7\.\0\.\0\.\4 ]] 00:06:50.435 22:44:41 -- target/referrals.sh@52 -- # rpc_cmd nvmf_discovery_remove_referral -t tcp -a 127.0.0.2 -s 4430 00:06:50.435 22:44:41 -- common/autotest_common.sh@551 -- # xtrace_disable 00:06:50.435 22:44:41 -- common/autotest_common.sh@10 -- # set +x 00:06:50.435 22:44:41 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:06:50.435 22:44:41 -- target/referrals.sh@53 -- # rpc_cmd nvmf_discovery_remove_referral -t tcp -a 127.0.0.3 -s 4430 00:06:50.435 22:44:41 -- common/autotest_common.sh@551 -- # xtrace_disable 00:06:50.435 22:44:41 -- common/autotest_common.sh@10 -- # set +x 00:06:50.435 22:44:41 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:06:50.435 22:44:41 -- target/referrals.sh@54 -- # rpc_cmd nvmf_discovery_remove_referral -t tcp -a 127.0.0.4 -s 4430 00:06:50.435 22:44:41 -- common/autotest_common.sh@551 -- # xtrace_disable 00:06:50.435 22:44:41 -- common/autotest_common.sh@10 -- # set +x 00:06:50.435 22:44:41 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:06:50.435 22:44:41 -- target/referrals.sh@56 -- # rpc_cmd nvmf_discovery_get_referrals 00:06:50.435 22:44:41 -- target/referrals.sh@56 -- # jq length 00:06:50.435 22:44:41 -- common/autotest_common.sh@551 -- # xtrace_disable 00:06:50.435 22:44:41 -- common/autotest_common.sh@10 -- # set +x 00:06:50.435 22:44:41 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:06:50.435 22:44:41 -- target/referrals.sh@56 -- # (( 0 == 0 )) 00:06:50.435 22:44:41 -- target/referrals.sh@57 -- # get_referral_ips nvme 00:06:50.435 22:44:41 -- target/referrals.sh@19 -- # [[ nvme == \r\p\c ]] 00:06:50.435 22:44:41 -- target/referrals.sh@22 -- # [[ nvme == \n\v\m\e ]] 00:06:50.435 22:44:41 -- target/referrals.sh@26 -- # nvme discover --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -a 10.0.0.2 -s 8009 -o json 00:06:50.435 22:44:41 -- target/referrals.sh@26 -- # jq -r '.records[] | select(.subtype != "current discovery subsystem").traddr' 00:06:50.435 22:44:41 -- target/referrals.sh@26 -- # sort 00:06:50.694 22:44:41 -- target/referrals.sh@26 -- # echo 00:06:50.694 22:44:41 -- target/referrals.sh@57 -- # [[ '' == '' ]] 00:06:50.694 22:44:41 -- target/referrals.sh@60 -- # rpc_cmd nvmf_discovery_add_referral -t tcp -a 127.0.0.2 -s 4430 -n discovery 00:06:50.694 22:44:41 -- common/autotest_common.sh@551 -- # xtrace_disable 00:06:50.694 22:44:41 -- common/autotest_common.sh@10 -- # set +x 00:06:50.694 22:44:41 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:06:50.694 22:44:41 -- target/referrals.sh@62 -- # rpc_cmd nvmf_discovery_add_referral -t tcp -a 127.0.0.2 -s 4430 -n nqn.2016-06.io.spdk:cnode1 00:06:50.694 22:44:41 -- common/autotest_common.sh@551 -- # xtrace_disable 00:06:50.694 22:44:41 -- common/autotest_common.sh@10 -- # set +x 00:06:50.694 22:44:41 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:06:50.694 22:44:41 -- target/referrals.sh@65 -- # get_referral_ips rpc 00:06:50.694 22:44:41 -- target/referrals.sh@19 -- # [[ rpc == \r\p\c ]] 00:06:50.694 22:44:41 -- target/referrals.sh@21 -- # rpc_cmd nvmf_discovery_get_referrals 00:06:50.694 22:44:41 -- target/referrals.sh@21 -- # jq -r '.[].address.traddr' 00:06:50.694 22:44:41 -- common/autotest_common.sh@551 -- # xtrace_disable 00:06:50.694 22:44:41 -- common/autotest_common.sh@10 -- # set +x 00:06:50.694 22:44:41 -- target/referrals.sh@21 -- # sort 00:06:50.694 22:44:41 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:06:50.694 22:44:41 -- target/referrals.sh@21 -- # echo 127.0.0.2 127.0.0.2 00:06:50.694 22:44:41 -- target/referrals.sh@65 -- # [[ 127.0.0.2 127.0.0.2 == \1\2\7\.\0\.\0\.\2\ \1\2\7\.\0\.\0\.\2 ]] 00:06:50.694 22:44:41 -- target/referrals.sh@66 -- # get_referral_ips nvme 00:06:50.694 22:44:41 -- target/referrals.sh@19 -- # [[ nvme == \r\p\c ]] 00:06:50.694 22:44:41 -- target/referrals.sh@22 -- # [[ nvme == \n\v\m\e ]] 00:06:50.694 22:44:41 -- target/referrals.sh@26 -- # nvme discover --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -a 10.0.0.2 -s 8009 -o json 00:06:50.694 22:44:41 -- target/referrals.sh@26 -- # jq -r '.records[] | select(.subtype != "current discovery subsystem").traddr' 00:06:50.694 22:44:41 -- target/referrals.sh@26 -- # sort 00:06:50.694 22:44:41 -- target/referrals.sh@26 -- # echo 127.0.0.2 127.0.0.2 00:06:50.694 22:44:41 -- target/referrals.sh@66 -- # [[ 127.0.0.2 127.0.0.2 == \1\2\7\.\0\.\0\.\2\ \1\2\7\.\0\.\0\.\2 ]] 00:06:50.694 22:44:41 -- target/referrals.sh@67 -- # get_discovery_entries 'nvme subsystem' 00:06:50.694 22:44:41 -- target/referrals.sh@31 -- # local 'subtype=nvme subsystem' 00:06:50.694 22:44:41 -- target/referrals.sh@67 -- # jq -r .subnqn 00:06:50.694 22:44:41 -- target/referrals.sh@33 -- # nvme discover --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -a 10.0.0.2 -s 8009 -o json 00:06:50.694 22:44:41 -- target/referrals.sh@34 -- # jq '.records[] | select(.subtype == "nvme subsystem")' 00:06:50.954 22:44:41 -- target/referrals.sh@67 -- # [[ nqn.2016-06.io.spdk:cnode1 == \n\q\n\.\2\0\1\6\-\0\6\.\i\o\.\s\p\d\k\:\c\n\o\d\e\1 ]] 00:06:50.954 22:44:41 -- target/referrals.sh@68 -- # get_discovery_entries 'discovery subsystem referral' 00:06:50.954 22:44:41 -- target/referrals.sh@68 -- # jq -r .subnqn 00:06:50.954 22:44:41 -- target/referrals.sh@31 -- # local 'subtype=discovery subsystem referral' 00:06:50.954 22:44:41 -- target/referrals.sh@33 -- # nvme discover --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -a 10.0.0.2 -s 8009 -o json 00:06:50.954 22:44:41 -- target/referrals.sh@34 -- # jq '.records[] | select(.subtype == "discovery subsystem referral")' 00:06:50.954 22:44:41 -- target/referrals.sh@68 -- # [[ nqn.2014-08.org.nvmexpress.discovery == \n\q\n\.\2\0\1\4\-\0\8\.\o\r\g\.\n\v\m\e\x\p\r\e\s\s\.\d\i\s\c\o\v\e\r\y ]] 00:06:50.954 22:44:41 -- target/referrals.sh@71 -- # rpc_cmd nvmf_discovery_remove_referral -t tcp -a 127.0.0.2 -s 4430 -n nqn.2016-06.io.spdk:cnode1 00:06:50.954 22:44:41 -- common/autotest_common.sh@551 -- # xtrace_disable 00:06:50.954 22:44:41 -- common/autotest_common.sh@10 -- # set +x 00:06:50.954 22:44:41 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:06:50.954 22:44:41 -- target/referrals.sh@73 -- # get_referral_ips rpc 00:06:50.954 22:44:41 -- target/referrals.sh@19 -- # [[ rpc == \r\p\c ]] 00:06:50.954 22:44:41 -- target/referrals.sh@21 -- # rpc_cmd nvmf_discovery_get_referrals 00:06:50.954 22:44:41 -- target/referrals.sh@21 -- # jq -r '.[].address.traddr' 00:06:50.954 22:44:41 -- common/autotest_common.sh@551 -- # xtrace_disable 00:06:50.954 22:44:41 -- common/autotest_common.sh@10 -- # set +x 00:06:50.954 22:44:41 -- target/referrals.sh@21 -- # sort 00:06:50.954 22:44:41 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:06:50.954 22:44:42 -- target/referrals.sh@21 -- # echo 127.0.0.2 00:06:50.954 22:44:42 -- target/referrals.sh@73 -- # [[ 127.0.0.2 == \1\2\7\.\0\.\0\.\2 ]] 00:06:50.954 22:44:42 -- target/referrals.sh@74 -- # get_referral_ips nvme 00:06:50.954 22:44:42 -- target/referrals.sh@19 -- # [[ nvme == \r\p\c ]] 00:06:50.954 22:44:42 -- target/referrals.sh@22 -- # [[ nvme == \n\v\m\e ]] 00:06:50.954 22:44:42 -- target/referrals.sh@26 -- # nvme discover --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -a 10.0.0.2 -s 8009 -o json 00:06:50.954 22:44:42 -- target/referrals.sh@26 -- # jq -r '.records[] | select(.subtype != "current discovery subsystem").traddr' 00:06:50.954 22:44:42 -- target/referrals.sh@26 -- # sort 00:06:51.214 22:44:42 -- target/referrals.sh@26 -- # echo 127.0.0.2 00:06:51.214 22:44:42 -- target/referrals.sh@74 -- # [[ 127.0.0.2 == \1\2\7\.\0\.\0\.\2 ]] 00:06:51.214 22:44:42 -- target/referrals.sh@75 -- # get_discovery_entries 'nvme subsystem' 00:06:51.214 22:44:42 -- target/referrals.sh@75 -- # jq -r .subnqn 00:06:51.214 22:44:42 -- target/referrals.sh@31 -- # local 'subtype=nvme subsystem' 00:06:51.214 22:44:42 -- target/referrals.sh@33 -- # nvme discover --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -a 10.0.0.2 -s 8009 -o json 00:06:51.214 22:44:42 -- target/referrals.sh@34 -- # jq '.records[] | select(.subtype == "nvme subsystem")' 00:06:51.214 22:44:42 -- target/referrals.sh@75 -- # [[ '' == '' ]] 00:06:51.214 22:44:42 -- target/referrals.sh@76 -- # get_discovery_entries 'discovery subsystem referral' 00:06:51.214 22:44:42 -- target/referrals.sh@31 -- # local 'subtype=discovery subsystem referral' 00:06:51.214 22:44:42 -- target/referrals.sh@76 -- # jq -r .subnqn 00:06:51.215 22:44:42 -- target/referrals.sh@33 -- # nvme discover --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -a 10.0.0.2 -s 8009 -o json 00:06:51.215 22:44:42 -- target/referrals.sh@34 -- # jq '.records[] | select(.subtype == "discovery subsystem referral")' 00:06:51.215 22:44:42 -- target/referrals.sh@76 -- # [[ nqn.2014-08.org.nvmexpress.discovery == \n\q\n\.\2\0\1\4\-\0\8\.\o\r\g\.\n\v\m\e\x\p\r\e\s\s\.\d\i\s\c\o\v\e\r\y ]] 00:06:51.215 22:44:42 -- target/referrals.sh@79 -- # rpc_cmd nvmf_discovery_remove_referral -t tcp -a 127.0.0.2 -s 4430 -n nqn.2014-08.org.nvmexpress.discovery 00:06:51.215 22:44:42 -- common/autotest_common.sh@551 -- # xtrace_disable 00:06:51.215 22:44:42 -- common/autotest_common.sh@10 -- # set +x 00:06:51.215 22:44:42 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:06:51.215 22:44:42 -- target/referrals.sh@82 -- # rpc_cmd nvmf_discovery_get_referrals 00:06:51.215 22:44:42 -- common/autotest_common.sh@551 -- # xtrace_disable 00:06:51.215 22:44:42 -- target/referrals.sh@82 -- # jq length 00:06:51.215 22:44:42 -- common/autotest_common.sh@10 -- # set +x 00:06:51.215 22:44:42 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:06:51.215 22:44:42 -- target/referrals.sh@82 -- # (( 0 == 0 )) 00:06:51.215 22:44:42 -- target/referrals.sh@83 -- # get_referral_ips nvme 00:06:51.215 22:44:42 -- target/referrals.sh@19 -- # [[ nvme == \r\p\c ]] 00:06:51.215 22:44:42 -- target/referrals.sh@22 -- # [[ nvme == \n\v\m\e ]] 00:06:51.215 22:44:42 -- target/referrals.sh@26 -- # nvme discover --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -a 10.0.0.2 -s 8009 -o json 00:06:51.215 22:44:42 -- target/referrals.sh@26 -- # jq -r '.records[] | select(.subtype != "current discovery subsystem").traddr' 00:06:51.215 22:44:42 -- target/referrals.sh@26 -- # sort 00:06:51.475 22:44:42 -- target/referrals.sh@26 -- # echo 00:06:51.475 22:44:42 -- target/referrals.sh@83 -- # [[ '' == '' ]] 00:06:51.475 22:44:42 -- target/referrals.sh@85 -- # trap - SIGINT SIGTERM EXIT 00:06:51.475 22:44:42 -- target/referrals.sh@86 -- # nvmftestfini 00:06:51.475 22:44:42 -- nvmf/common.sh@476 -- # nvmfcleanup 00:06:51.475 22:44:42 -- nvmf/common.sh@116 -- # sync 00:06:51.475 22:44:42 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:06:51.475 22:44:42 -- nvmf/common.sh@119 -- # set +e 00:06:51.475 22:44:42 -- nvmf/common.sh@120 -- # for i in {1..20} 00:06:51.475 22:44:42 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:06:51.475 rmmod nvme_tcp 00:06:51.475 rmmod nvme_fabrics 00:06:51.475 rmmod nvme_keyring 00:06:51.475 22:44:42 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:06:51.475 22:44:42 -- nvmf/common.sh@123 -- # set -e 00:06:51.475 22:44:42 -- nvmf/common.sh@124 -- # return 0 00:06:51.475 22:44:42 -- nvmf/common.sh@477 -- # '[' -n 183379 ']' 00:06:51.475 22:44:42 -- nvmf/common.sh@478 -- # killprocess 183379 00:06:51.475 22:44:42 -- common/autotest_common.sh@926 -- # '[' -z 183379 ']' 00:06:51.475 22:44:42 -- common/autotest_common.sh@930 -- # kill -0 183379 00:06:51.475 22:44:42 -- common/autotest_common.sh@931 -- # uname 00:06:51.475 22:44:42 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:06:51.475 22:44:42 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 183379 00:06:51.475 22:44:42 -- common/autotest_common.sh@932 -- # process_name=reactor_0 00:06:51.475 22:44:42 -- common/autotest_common.sh@936 -- # '[' reactor_0 = sudo ']' 00:06:51.475 22:44:42 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 183379' 00:06:51.475 killing process with pid 183379 00:06:51.475 22:44:42 -- common/autotest_common.sh@945 -- # kill 183379 00:06:51.475 22:44:42 -- common/autotest_common.sh@950 -- # wait 183379 00:06:51.734 22:44:42 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:06:51.734 22:44:42 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:06:51.734 22:44:42 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:06:51.734 22:44:42 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:06:51.734 22:44:42 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:06:51.734 22:44:42 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:06:51.734 22:44:42 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:06:51.734 22:44:42 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:06:53.642 22:44:44 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:06:53.642 00:06:53.642 real 0m6.782s 00:06:53.642 user 0m10.812s 00:06:53.642 sys 0m1.912s 00:06:53.642 22:44:44 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:06:53.642 22:44:44 -- common/autotest_common.sh@10 -- # set +x 00:06:53.642 ************************************ 00:06:53.642 END TEST nvmf_referrals 00:06:53.642 ************************************ 00:06:53.901 22:44:44 -- nvmf/nvmf.sh@27 -- # run_test nvmf_connect_disconnect /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/connect_disconnect.sh --transport=tcp 00:06:53.901 22:44:44 -- common/autotest_common.sh@1077 -- # '[' 3 -le 1 ']' 00:06:53.901 22:44:44 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:06:53.901 22:44:44 -- common/autotest_common.sh@10 -- # set +x 00:06:53.901 ************************************ 00:06:53.901 START TEST nvmf_connect_disconnect 00:06:53.901 ************************************ 00:06:53.901 22:44:44 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/connect_disconnect.sh --transport=tcp 00:06:53.901 * Looking for test storage... 00:06:53.901 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:06:53.901 22:44:44 -- target/connect_disconnect.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:06:53.901 22:44:44 -- nvmf/common.sh@7 -- # uname -s 00:06:53.901 22:44:44 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:06:53.901 22:44:44 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:06:53.901 22:44:44 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:06:53.901 22:44:44 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:06:53.901 22:44:44 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:06:53.901 22:44:44 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:06:53.901 22:44:44 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:06:53.901 22:44:44 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:06:53.901 22:44:44 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:06:53.901 22:44:44 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:06:53.901 22:44:44 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:06:53.901 22:44:44 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:06:53.901 22:44:44 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:06:53.901 22:44:44 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:06:53.901 22:44:44 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:06:53.901 22:44:44 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:06:53.901 22:44:44 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:06:53.901 22:44:44 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:06:53.901 22:44:44 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:06:53.901 22:44:44 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:06:53.901 22:44:44 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:06:53.901 22:44:44 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:06:53.901 22:44:44 -- paths/export.sh@5 -- # export PATH 00:06:53.901 22:44:44 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:06:53.901 22:44:44 -- nvmf/common.sh@46 -- # : 0 00:06:53.901 22:44:44 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:06:53.901 22:44:44 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:06:53.901 22:44:44 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:06:53.901 22:44:44 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:06:53.901 22:44:44 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:06:53.901 22:44:44 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:06:53.901 22:44:44 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:06:53.901 22:44:44 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:06:53.901 22:44:44 -- target/connect_disconnect.sh@11 -- # MALLOC_BDEV_SIZE=64 00:06:53.901 22:44:44 -- target/connect_disconnect.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:06:53.901 22:44:44 -- target/connect_disconnect.sh@15 -- # nvmftestinit 00:06:53.901 22:44:44 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:06:53.901 22:44:44 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:06:53.901 22:44:44 -- nvmf/common.sh@436 -- # prepare_net_devs 00:06:53.901 22:44:44 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:06:53.901 22:44:44 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:06:53.901 22:44:44 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:06:53.901 22:44:44 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:06:53.901 22:44:44 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:06:53.901 22:44:44 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:06:53.901 22:44:44 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:06:53.901 22:44:44 -- nvmf/common.sh@284 -- # xtrace_disable 00:06:53.901 22:44:44 -- common/autotest_common.sh@10 -- # set +x 00:06:55.809 22:44:46 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:06:55.809 22:44:46 -- nvmf/common.sh@290 -- # pci_devs=() 00:06:55.809 22:44:46 -- nvmf/common.sh@290 -- # local -a pci_devs 00:06:55.809 22:44:46 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:06:55.809 22:44:46 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:06:55.809 22:44:46 -- nvmf/common.sh@292 -- # pci_drivers=() 00:06:55.809 22:44:46 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:06:55.809 22:44:46 -- nvmf/common.sh@294 -- # net_devs=() 00:06:55.809 22:44:46 -- nvmf/common.sh@294 -- # local -ga net_devs 00:06:55.809 22:44:46 -- nvmf/common.sh@295 -- # e810=() 00:06:55.809 22:44:46 -- nvmf/common.sh@295 -- # local -ga e810 00:06:55.809 22:44:46 -- nvmf/common.sh@296 -- # x722=() 00:06:55.809 22:44:46 -- nvmf/common.sh@296 -- # local -ga x722 00:06:55.809 22:44:46 -- nvmf/common.sh@297 -- # mlx=() 00:06:55.809 22:44:46 -- nvmf/common.sh@297 -- # local -ga mlx 00:06:55.809 22:44:46 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:06:55.809 22:44:46 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:06:55.809 22:44:46 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:06:55.809 22:44:46 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:06:55.809 22:44:46 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:06:55.809 22:44:46 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:06:55.809 22:44:46 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:06:55.809 22:44:46 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:06:55.809 22:44:46 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:06:55.809 22:44:46 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:06:55.809 22:44:46 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:06:55.809 22:44:46 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:06:55.809 22:44:46 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:06:55.809 22:44:46 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:06:55.809 22:44:46 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:06:55.809 22:44:46 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:06:55.809 22:44:46 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:06:55.809 22:44:46 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:06:55.809 22:44:46 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:06:55.809 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:06:55.809 22:44:46 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:06:55.809 22:44:46 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:06:55.809 22:44:46 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:06:55.809 22:44:46 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:06:55.809 22:44:46 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:06:55.809 22:44:46 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:06:55.809 22:44:46 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:06:55.809 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:06:55.809 22:44:46 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:06:55.809 22:44:46 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:06:55.809 22:44:46 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:06:55.809 22:44:46 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:06:55.809 22:44:46 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:06:55.809 22:44:46 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:06:55.809 22:44:46 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:06:55.809 22:44:46 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:06:55.809 22:44:46 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:06:55.809 22:44:46 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:06:55.809 22:44:46 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:06:55.809 22:44:46 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:06:55.809 22:44:46 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:06:55.809 Found net devices under 0000:0a:00.0: cvl_0_0 00:06:55.809 22:44:46 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:06:55.809 22:44:46 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:06:55.809 22:44:46 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:06:55.809 22:44:46 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:06:55.809 22:44:46 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:06:55.809 22:44:46 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:06:55.809 Found net devices under 0000:0a:00.1: cvl_0_1 00:06:55.809 22:44:46 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:06:55.809 22:44:46 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:06:55.809 22:44:46 -- nvmf/common.sh@402 -- # is_hw=yes 00:06:55.809 22:44:46 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:06:55.809 22:44:46 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:06:55.809 22:44:46 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:06:55.809 22:44:46 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:06:55.809 22:44:46 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:06:55.809 22:44:46 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:06:55.809 22:44:46 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:06:55.809 22:44:46 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:06:55.809 22:44:46 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:06:55.809 22:44:46 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:06:55.809 22:44:46 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:06:55.809 22:44:46 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:06:55.809 22:44:46 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:06:55.809 22:44:46 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:06:55.809 22:44:46 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:06:55.809 22:44:46 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:06:55.809 22:44:46 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:06:55.809 22:44:46 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:06:55.809 22:44:46 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:06:55.809 22:44:46 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:06:55.809 22:44:46 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:06:55.809 22:44:46 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:06:55.809 22:44:46 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:06:55.809 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:06:55.809 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.150 ms 00:06:55.809 00:06:55.809 --- 10.0.0.2 ping statistics --- 00:06:55.809 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:06:55.809 rtt min/avg/max/mdev = 0.150/0.150/0.150/0.000 ms 00:06:55.809 22:44:46 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:06:55.809 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:06:55.809 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.120 ms 00:06:55.809 00:06:55.809 --- 10.0.0.1 ping statistics --- 00:06:55.809 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:06:55.809 rtt min/avg/max/mdev = 0.120/0.120/0.120/0.000 ms 00:06:55.809 22:44:46 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:06:55.809 22:44:46 -- nvmf/common.sh@410 -- # return 0 00:06:55.809 22:44:46 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:06:55.809 22:44:46 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:06:55.809 22:44:46 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:06:55.809 22:44:46 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:06:55.809 22:44:46 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:06:55.809 22:44:46 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:06:55.809 22:44:46 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:06:55.809 22:44:46 -- target/connect_disconnect.sh@16 -- # nvmfappstart -m 0xF 00:06:55.809 22:44:46 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:06:55.809 22:44:46 -- common/autotest_common.sh@712 -- # xtrace_disable 00:06:55.809 22:44:46 -- common/autotest_common.sh@10 -- # set +x 00:06:55.809 22:44:46 -- nvmf/common.sh@469 -- # nvmfpid=185696 00:06:55.809 22:44:46 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:06:55.809 22:44:46 -- nvmf/common.sh@470 -- # waitforlisten 185696 00:06:55.809 22:44:46 -- common/autotest_common.sh@819 -- # '[' -z 185696 ']' 00:06:55.809 22:44:46 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk.sock 00:06:55.809 22:44:46 -- common/autotest_common.sh@824 -- # local max_retries=100 00:06:55.809 22:44:46 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:06:55.809 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:06:55.809 22:44:46 -- common/autotest_common.sh@828 -- # xtrace_disable 00:06:55.809 22:44:46 -- common/autotest_common.sh@10 -- # set +x 00:06:56.069 [2024-04-16 22:44:46.969419] Starting SPDK v24.01.1-pre git sha1 4b134b4ab / DPDK 23.11.0 initialization... 00:06:56.069 [2024-04-16 22:44:46.969514] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:06:56.069 EAL: No free 2048 kB hugepages reported on node 1 00:06:56.069 [2024-04-16 22:44:47.039486] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:06:56.069 [2024-04-16 22:44:47.160001] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:06:56.069 [2024-04-16 22:44:47.160169] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:06:56.069 [2024-04-16 22:44:47.160198] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:06:56.069 [2024-04-16 22:44:47.160213] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:06:56.069 [2024-04-16 22:44:47.160282] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:06:56.069 [2024-04-16 22:44:47.160337] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:06:56.069 [2024-04-16 22:44:47.160389] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:06:56.070 [2024-04-16 22:44:47.160392] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:57.008 22:44:47 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:06:57.008 22:44:47 -- common/autotest_common.sh@852 -- # return 0 00:06:57.008 22:44:47 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:06:57.008 22:44:47 -- common/autotest_common.sh@718 -- # xtrace_disable 00:06:57.008 22:44:47 -- common/autotest_common.sh@10 -- # set +x 00:06:57.008 22:44:47 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:06:57.008 22:44:47 -- target/connect_disconnect.sh@18 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 -c 0 00:06:57.008 22:44:47 -- common/autotest_common.sh@551 -- # xtrace_disable 00:06:57.008 22:44:47 -- common/autotest_common.sh@10 -- # set +x 00:06:57.008 [2024-04-16 22:44:47.918600] tcp.c: 659:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:06:57.008 22:44:47 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:06:57.008 22:44:47 -- target/connect_disconnect.sh@20 -- # rpc_cmd bdev_malloc_create 64 512 00:06:57.008 22:44:47 -- common/autotest_common.sh@551 -- # xtrace_disable 00:06:57.008 22:44:47 -- common/autotest_common.sh@10 -- # set +x 00:06:57.008 22:44:47 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:06:57.008 22:44:47 -- target/connect_disconnect.sh@20 -- # bdev=Malloc0 00:06:57.008 22:44:47 -- target/connect_disconnect.sh@22 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDKISFASTANDAWESOME 00:06:57.008 22:44:47 -- common/autotest_common.sh@551 -- # xtrace_disable 00:06:57.008 22:44:47 -- common/autotest_common.sh@10 -- # set +x 00:06:57.008 22:44:47 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:06:57.008 22:44:47 -- target/connect_disconnect.sh@23 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:06:57.008 22:44:47 -- common/autotest_common.sh@551 -- # xtrace_disable 00:06:57.008 22:44:47 -- common/autotest_common.sh@10 -- # set +x 00:06:57.008 22:44:47 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:06:57.008 22:44:47 -- target/connect_disconnect.sh@24 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:06:57.008 22:44:47 -- common/autotest_common.sh@551 -- # xtrace_disable 00:06:57.008 22:44:47 -- common/autotest_common.sh@10 -- # set +x 00:06:57.008 [2024-04-16 22:44:47.970664] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:06:57.008 22:44:47 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:06:57.008 22:44:47 -- target/connect_disconnect.sh@26 -- # '[' 1 -eq 1 ']' 00:06:57.008 22:44:47 -- target/connect_disconnect.sh@27 -- # num_iterations=100 00:06:57.008 22:44:47 -- target/connect_disconnect.sh@29 -- # NVME_CONNECT='nvme connect -i 8' 00:06:57.008 22:44:47 -- target/connect_disconnect.sh@34 -- # set +x 00:06:59.548 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:07:01.447 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:07:03.982 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:07:06.540 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:07:08.435 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:07:10.961 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:07:12.857 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:07:15.382 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:07:17.280 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:07:19.806 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:07:21.706 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:07:24.241 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:07:26.779 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:07:28.721 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:07:30.648 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:07:33.185 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:07:35.091 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:07:37.628 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:07:40.164 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:07:42.072 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:07:44.612 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:07:46.516 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:07:49.058 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:07:50.962 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:07:53.523 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:07:55.428 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:07:57.963 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:07:59.869 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:08:02.406 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:08:04.319 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:08:06.853 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:08:09.390 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:08:11.294 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:08:13.827 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:08:15.733 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:08:18.294 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:08:20.200 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:08:22.726 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:08:25.253 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:08:27.150 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:08:29.676 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:08:31.573 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:08:34.098 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:08:35.996 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:08:37.893 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:08:40.468 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:08:42.996 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:08:44.897 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:08:47.422 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:08:49.319 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:08:51.856 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:08:54.388 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:08:56.296 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:08:58.833 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:00.737 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:03.274 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:05.205 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:07.738 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:09.647 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:12.184 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:14.720 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:16.627 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:19.163 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:21.069 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:23.603 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:25.508 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:28.072 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:30.611 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:32.517 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:35.053 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:36.959 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:38.867 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:41.433 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:43.967 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:45.874 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:48.410 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:50.316 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:52.853 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:54.756 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:57.292 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:59.197 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:01.730 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:03.644 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:06.176 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:08.715 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:10.618 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:13.157 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:15.131 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:17.662 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:19.565 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:22.099 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:24.007 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:26.543 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:28.446 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:30.982 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:32.884 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:35.417 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:37.384 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:39.922 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:41.828 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:41.828 22:48:32 -- target/connect_disconnect.sh@43 -- # trap - SIGINT SIGTERM EXIT 00:10:41.828 22:48:32 -- target/connect_disconnect.sh@45 -- # nvmftestfini 00:10:41.828 22:48:32 -- nvmf/common.sh@476 -- # nvmfcleanup 00:10:41.828 22:48:32 -- nvmf/common.sh@116 -- # sync 00:10:41.828 22:48:32 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:10:41.828 22:48:32 -- nvmf/common.sh@119 -- # set +e 00:10:41.828 22:48:32 -- nvmf/common.sh@120 -- # for i in {1..20} 00:10:41.828 22:48:32 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:10:41.828 rmmod nvme_tcp 00:10:41.828 rmmod nvme_fabrics 00:10:41.828 rmmod nvme_keyring 00:10:41.828 22:48:32 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:10:42.088 22:48:32 -- nvmf/common.sh@123 -- # set -e 00:10:42.088 22:48:32 -- nvmf/common.sh@124 -- # return 0 00:10:42.088 22:48:32 -- nvmf/common.sh@477 -- # '[' -n 185696 ']' 00:10:42.088 22:48:32 -- nvmf/common.sh@478 -- # killprocess 185696 00:10:42.088 22:48:32 -- common/autotest_common.sh@926 -- # '[' -z 185696 ']' 00:10:42.088 22:48:32 -- common/autotest_common.sh@930 -- # kill -0 185696 00:10:42.088 22:48:32 -- common/autotest_common.sh@931 -- # uname 00:10:42.088 22:48:32 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:10:42.088 22:48:32 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 185696 00:10:42.088 22:48:32 -- common/autotest_common.sh@932 -- # process_name=reactor_0 00:10:42.088 22:48:32 -- common/autotest_common.sh@936 -- # '[' reactor_0 = sudo ']' 00:10:42.088 22:48:32 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 185696' 00:10:42.088 killing process with pid 185696 00:10:42.088 22:48:32 -- common/autotest_common.sh@945 -- # kill 185696 00:10:42.088 22:48:32 -- common/autotest_common.sh@950 -- # wait 185696 00:10:42.346 22:48:33 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:10:42.346 22:48:33 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:10:42.346 22:48:33 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:10:42.346 22:48:33 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:10:42.346 22:48:33 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:10:42.346 22:48:33 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:10:42.346 22:48:33 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:10:42.346 22:48:33 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:10:44.256 22:48:35 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:10:44.256 00:10:44.256 real 3m50.555s 00:10:44.256 user 14m38.179s 00:10:44.256 sys 0m30.776s 00:10:44.256 22:48:35 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:10:44.256 22:48:35 -- common/autotest_common.sh@10 -- # set +x 00:10:44.256 ************************************ 00:10:44.256 END TEST nvmf_connect_disconnect 00:10:44.256 ************************************ 00:10:44.256 22:48:35 -- nvmf/nvmf.sh@28 -- # run_test nvmf_multitarget /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/multitarget.sh --transport=tcp 00:10:44.256 22:48:35 -- common/autotest_common.sh@1077 -- # '[' 3 -le 1 ']' 00:10:44.256 22:48:35 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:10:44.256 22:48:35 -- common/autotest_common.sh@10 -- # set +x 00:10:44.256 ************************************ 00:10:44.256 START TEST nvmf_multitarget 00:10:44.256 ************************************ 00:10:44.256 22:48:35 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/multitarget.sh --transport=tcp 00:10:44.514 * Looking for test storage... 00:10:44.514 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:10:44.514 22:48:35 -- target/multitarget.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:10:44.514 22:48:35 -- nvmf/common.sh@7 -- # uname -s 00:10:44.514 22:48:35 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:10:44.514 22:48:35 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:10:44.514 22:48:35 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:10:44.514 22:48:35 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:10:44.514 22:48:35 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:10:44.514 22:48:35 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:10:44.514 22:48:35 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:10:44.514 22:48:35 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:10:44.514 22:48:35 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:10:44.514 22:48:35 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:10:44.514 22:48:35 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:10:44.514 22:48:35 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:10:44.514 22:48:35 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:10:44.514 22:48:35 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:10:44.514 22:48:35 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:10:44.514 22:48:35 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:10:44.514 22:48:35 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:10:44.514 22:48:35 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:10:44.514 22:48:35 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:10:44.514 22:48:35 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:10:44.514 22:48:35 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:10:44.514 22:48:35 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:10:44.514 22:48:35 -- paths/export.sh@5 -- # export PATH 00:10:44.515 22:48:35 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:10:44.515 22:48:35 -- nvmf/common.sh@46 -- # : 0 00:10:44.515 22:48:35 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:10:44.515 22:48:35 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:10:44.515 22:48:35 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:10:44.515 22:48:35 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:10:44.515 22:48:35 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:10:44.515 22:48:35 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:10:44.515 22:48:35 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:10:44.515 22:48:35 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:10:44.515 22:48:35 -- target/multitarget.sh@13 -- # rpc_py=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/multitarget_rpc.py 00:10:44.515 22:48:35 -- target/multitarget.sh@15 -- # nvmftestinit 00:10:44.515 22:48:35 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:10:44.515 22:48:35 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:10:44.515 22:48:35 -- nvmf/common.sh@436 -- # prepare_net_devs 00:10:44.515 22:48:35 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:10:44.515 22:48:35 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:10:44.515 22:48:35 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:10:44.515 22:48:35 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:10:44.515 22:48:35 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:10:44.515 22:48:35 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:10:44.515 22:48:35 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:10:44.515 22:48:35 -- nvmf/common.sh@284 -- # xtrace_disable 00:10:44.515 22:48:35 -- common/autotest_common.sh@10 -- # set +x 00:10:46.416 22:48:37 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:10:46.416 22:48:37 -- nvmf/common.sh@290 -- # pci_devs=() 00:10:46.416 22:48:37 -- nvmf/common.sh@290 -- # local -a pci_devs 00:10:46.416 22:48:37 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:10:46.416 22:48:37 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:10:46.416 22:48:37 -- nvmf/common.sh@292 -- # pci_drivers=() 00:10:46.416 22:48:37 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:10:46.416 22:48:37 -- nvmf/common.sh@294 -- # net_devs=() 00:10:46.416 22:48:37 -- nvmf/common.sh@294 -- # local -ga net_devs 00:10:46.416 22:48:37 -- nvmf/common.sh@295 -- # e810=() 00:10:46.416 22:48:37 -- nvmf/common.sh@295 -- # local -ga e810 00:10:46.416 22:48:37 -- nvmf/common.sh@296 -- # x722=() 00:10:46.416 22:48:37 -- nvmf/common.sh@296 -- # local -ga x722 00:10:46.416 22:48:37 -- nvmf/common.sh@297 -- # mlx=() 00:10:46.416 22:48:37 -- nvmf/common.sh@297 -- # local -ga mlx 00:10:46.416 22:48:37 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:10:46.416 22:48:37 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:10:46.416 22:48:37 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:10:46.416 22:48:37 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:10:46.416 22:48:37 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:10:46.416 22:48:37 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:10:46.416 22:48:37 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:10:46.416 22:48:37 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:10:46.416 22:48:37 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:10:46.416 22:48:37 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:10:46.416 22:48:37 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:10:46.416 22:48:37 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:10:46.416 22:48:37 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:10:46.416 22:48:37 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:10:46.416 22:48:37 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:10:46.416 22:48:37 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:10:46.416 22:48:37 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:10:46.416 22:48:37 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:10:46.416 22:48:37 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:10:46.416 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:10:46.416 22:48:37 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:10:46.416 22:48:37 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:10:46.416 22:48:37 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:10:46.416 22:48:37 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:10:46.416 22:48:37 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:10:46.416 22:48:37 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:10:46.416 22:48:37 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:10:46.416 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:10:46.416 22:48:37 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:10:46.416 22:48:37 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:10:46.416 22:48:37 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:10:46.416 22:48:37 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:10:46.416 22:48:37 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:10:46.416 22:48:37 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:10:46.416 22:48:37 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:10:46.416 22:48:37 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:10:46.416 22:48:37 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:10:46.416 22:48:37 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:10:46.416 22:48:37 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:10:46.416 22:48:37 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:10:46.416 22:48:37 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:10:46.417 Found net devices under 0000:0a:00.0: cvl_0_0 00:10:46.417 22:48:37 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:10:46.417 22:48:37 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:10:46.417 22:48:37 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:10:46.417 22:48:37 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:10:46.417 22:48:37 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:10:46.417 22:48:37 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:10:46.417 Found net devices under 0000:0a:00.1: cvl_0_1 00:10:46.417 22:48:37 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:10:46.417 22:48:37 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:10:46.417 22:48:37 -- nvmf/common.sh@402 -- # is_hw=yes 00:10:46.417 22:48:37 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:10:46.417 22:48:37 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:10:46.417 22:48:37 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:10:46.417 22:48:37 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:10:46.417 22:48:37 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:10:46.417 22:48:37 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:10:46.417 22:48:37 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:10:46.417 22:48:37 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:10:46.417 22:48:37 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:10:46.417 22:48:37 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:10:46.417 22:48:37 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:10:46.417 22:48:37 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:10:46.417 22:48:37 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:10:46.417 22:48:37 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:10:46.417 22:48:37 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:10:46.417 22:48:37 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:10:46.675 22:48:37 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:10:46.675 22:48:37 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:10:46.675 22:48:37 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:10:46.675 22:48:37 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:10:46.675 22:48:37 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:10:46.675 22:48:37 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:10:46.675 22:48:37 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:10:46.675 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:10:46.675 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.218 ms 00:10:46.675 00:10:46.675 --- 10.0.0.2 ping statistics --- 00:10:46.675 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:10:46.675 rtt min/avg/max/mdev = 0.218/0.218/0.218/0.000 ms 00:10:46.675 22:48:37 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:10:46.675 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:10:46.675 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.146 ms 00:10:46.675 00:10:46.675 --- 10.0.0.1 ping statistics --- 00:10:46.675 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:10:46.675 rtt min/avg/max/mdev = 0.146/0.146/0.146/0.000 ms 00:10:46.675 22:48:37 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:10:46.675 22:48:37 -- nvmf/common.sh@410 -- # return 0 00:10:46.675 22:48:37 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:10:46.675 22:48:37 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:10:46.675 22:48:37 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:10:46.675 22:48:37 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:10:46.675 22:48:37 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:10:46.675 22:48:37 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:10:46.675 22:48:37 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:10:46.675 22:48:37 -- target/multitarget.sh@16 -- # nvmfappstart -m 0xF 00:10:46.675 22:48:37 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:10:46.675 22:48:37 -- common/autotest_common.sh@712 -- # xtrace_disable 00:10:46.675 22:48:37 -- common/autotest_common.sh@10 -- # set +x 00:10:46.675 22:48:37 -- nvmf/common.sh@469 -- # nvmfpid=217617 00:10:46.675 22:48:37 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:10:46.675 22:48:37 -- nvmf/common.sh@470 -- # waitforlisten 217617 00:10:46.675 22:48:37 -- common/autotest_common.sh@819 -- # '[' -z 217617 ']' 00:10:46.675 22:48:37 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk.sock 00:10:46.675 22:48:37 -- common/autotest_common.sh@824 -- # local max_retries=100 00:10:46.675 22:48:37 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:10:46.675 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:10:46.675 22:48:37 -- common/autotest_common.sh@828 -- # xtrace_disable 00:10:46.675 22:48:37 -- common/autotest_common.sh@10 -- # set +x 00:10:46.675 [2024-04-16 22:48:37.729975] Starting SPDK v24.01.1-pre git sha1 4b134b4ab / DPDK 23.11.0 initialization... 00:10:46.675 [2024-04-16 22:48:37.730057] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:10:46.675 EAL: No free 2048 kB hugepages reported on node 1 00:10:46.675 [2024-04-16 22:48:37.799187] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:10:46.933 [2024-04-16 22:48:37.919109] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:10:46.933 [2024-04-16 22:48:37.919295] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:10:46.933 [2024-04-16 22:48:37.919315] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:10:46.933 [2024-04-16 22:48:37.919330] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:10:46.933 [2024-04-16 22:48:37.919411] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:10:46.933 [2024-04-16 22:48:37.919470] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:10:46.933 [2024-04-16 22:48:37.919524] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:10:46.933 [2024-04-16 22:48:37.919527] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:10:47.866 22:48:38 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:10:47.866 22:48:38 -- common/autotest_common.sh@852 -- # return 0 00:10:47.866 22:48:38 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:10:47.866 22:48:38 -- common/autotest_common.sh@718 -- # xtrace_disable 00:10:47.866 22:48:38 -- common/autotest_common.sh@10 -- # set +x 00:10:47.866 22:48:38 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:10:47.866 22:48:38 -- target/multitarget.sh@18 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; nvmftestfini $1; exit 1' SIGINT SIGTERM EXIT 00:10:47.866 22:48:38 -- target/multitarget.sh@21 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/multitarget_rpc.py nvmf_get_targets 00:10:47.866 22:48:38 -- target/multitarget.sh@21 -- # jq length 00:10:47.866 22:48:38 -- target/multitarget.sh@21 -- # '[' 1 '!=' 1 ']' 00:10:47.866 22:48:38 -- target/multitarget.sh@25 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/multitarget_rpc.py nvmf_create_target -n nvmf_tgt_1 -s 32 00:10:47.866 "nvmf_tgt_1" 00:10:47.866 22:48:38 -- target/multitarget.sh@26 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/multitarget_rpc.py nvmf_create_target -n nvmf_tgt_2 -s 32 00:10:48.124 "nvmf_tgt_2" 00:10:48.124 22:48:39 -- target/multitarget.sh@28 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/multitarget_rpc.py nvmf_get_targets 00:10:48.124 22:48:39 -- target/multitarget.sh@28 -- # jq length 00:10:48.124 22:48:39 -- target/multitarget.sh@28 -- # '[' 3 '!=' 3 ']' 00:10:48.124 22:48:39 -- target/multitarget.sh@32 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/multitarget_rpc.py nvmf_delete_target -n nvmf_tgt_1 00:10:48.124 true 00:10:48.124 22:48:39 -- target/multitarget.sh@33 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/multitarget_rpc.py nvmf_delete_target -n nvmf_tgt_2 00:10:48.381 true 00:10:48.381 22:48:39 -- target/multitarget.sh@35 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/multitarget_rpc.py nvmf_get_targets 00:10:48.381 22:48:39 -- target/multitarget.sh@35 -- # jq length 00:10:48.381 22:48:39 -- target/multitarget.sh@35 -- # '[' 1 '!=' 1 ']' 00:10:48.381 22:48:39 -- target/multitarget.sh@39 -- # trap - SIGINT SIGTERM EXIT 00:10:48.381 22:48:39 -- target/multitarget.sh@41 -- # nvmftestfini 00:10:48.381 22:48:39 -- nvmf/common.sh@476 -- # nvmfcleanup 00:10:48.381 22:48:39 -- nvmf/common.sh@116 -- # sync 00:10:48.381 22:48:39 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:10:48.381 22:48:39 -- nvmf/common.sh@119 -- # set +e 00:10:48.381 22:48:39 -- nvmf/common.sh@120 -- # for i in {1..20} 00:10:48.381 22:48:39 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:10:48.381 rmmod nvme_tcp 00:10:48.381 rmmod nvme_fabrics 00:10:48.381 rmmod nvme_keyring 00:10:48.382 22:48:39 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:10:48.382 22:48:39 -- nvmf/common.sh@123 -- # set -e 00:10:48.382 22:48:39 -- nvmf/common.sh@124 -- # return 0 00:10:48.382 22:48:39 -- nvmf/common.sh@477 -- # '[' -n 217617 ']' 00:10:48.382 22:48:39 -- nvmf/common.sh@478 -- # killprocess 217617 00:10:48.382 22:48:39 -- common/autotest_common.sh@926 -- # '[' -z 217617 ']' 00:10:48.382 22:48:39 -- common/autotest_common.sh@930 -- # kill -0 217617 00:10:48.382 22:48:39 -- common/autotest_common.sh@931 -- # uname 00:10:48.382 22:48:39 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:10:48.382 22:48:39 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 217617 00:10:48.639 22:48:39 -- common/autotest_common.sh@932 -- # process_name=reactor_0 00:10:48.639 22:48:39 -- common/autotest_common.sh@936 -- # '[' reactor_0 = sudo ']' 00:10:48.639 22:48:39 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 217617' 00:10:48.639 killing process with pid 217617 00:10:48.639 22:48:39 -- common/autotest_common.sh@945 -- # kill 217617 00:10:48.639 22:48:39 -- common/autotest_common.sh@950 -- # wait 217617 00:10:48.898 22:48:39 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:10:48.898 22:48:39 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:10:48.898 22:48:39 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:10:48.898 22:48:39 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:10:48.898 22:48:39 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:10:48.898 22:48:39 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:10:48.898 22:48:39 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:10:48.898 22:48:39 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:10:50.797 22:48:41 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:10:50.797 00:10:50.797 real 0m6.478s 00:10:50.797 user 0m9.043s 00:10:50.797 sys 0m1.984s 00:10:50.797 22:48:41 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:10:50.797 22:48:41 -- common/autotest_common.sh@10 -- # set +x 00:10:50.797 ************************************ 00:10:50.797 END TEST nvmf_multitarget 00:10:50.797 ************************************ 00:10:50.797 22:48:41 -- nvmf/nvmf.sh@29 -- # run_test nvmf_rpc /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/rpc.sh --transport=tcp 00:10:50.797 22:48:41 -- common/autotest_common.sh@1077 -- # '[' 3 -le 1 ']' 00:10:50.797 22:48:41 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:10:50.797 22:48:41 -- common/autotest_common.sh@10 -- # set +x 00:10:50.797 ************************************ 00:10:50.797 START TEST nvmf_rpc 00:10:50.797 ************************************ 00:10:50.797 22:48:41 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/rpc.sh --transport=tcp 00:10:50.797 * Looking for test storage... 00:10:51.057 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:10:51.057 22:48:41 -- target/rpc.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:10:51.057 22:48:41 -- nvmf/common.sh@7 -- # uname -s 00:10:51.057 22:48:41 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:10:51.057 22:48:41 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:10:51.057 22:48:41 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:10:51.057 22:48:41 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:10:51.057 22:48:41 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:10:51.057 22:48:41 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:10:51.057 22:48:41 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:10:51.057 22:48:41 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:10:51.057 22:48:41 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:10:51.057 22:48:41 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:10:51.057 22:48:41 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:10:51.057 22:48:41 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:10:51.057 22:48:41 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:10:51.057 22:48:41 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:10:51.057 22:48:41 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:10:51.057 22:48:41 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:10:51.057 22:48:41 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:10:51.057 22:48:41 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:10:51.057 22:48:41 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:10:51.057 22:48:41 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:10:51.057 22:48:41 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:10:51.057 22:48:41 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:10:51.057 22:48:41 -- paths/export.sh@5 -- # export PATH 00:10:51.058 22:48:41 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:10:51.058 22:48:41 -- nvmf/common.sh@46 -- # : 0 00:10:51.058 22:48:41 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:10:51.058 22:48:41 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:10:51.058 22:48:41 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:10:51.058 22:48:41 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:10:51.058 22:48:41 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:10:51.058 22:48:41 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:10:51.058 22:48:41 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:10:51.058 22:48:41 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:10:51.058 22:48:41 -- target/rpc.sh@11 -- # loops=5 00:10:51.058 22:48:41 -- target/rpc.sh@23 -- # nvmftestinit 00:10:51.058 22:48:41 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:10:51.058 22:48:41 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:10:51.058 22:48:41 -- nvmf/common.sh@436 -- # prepare_net_devs 00:10:51.058 22:48:41 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:10:51.058 22:48:41 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:10:51.058 22:48:41 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:10:51.058 22:48:41 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:10:51.058 22:48:41 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:10:51.058 22:48:41 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:10:51.058 22:48:41 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:10:51.058 22:48:41 -- nvmf/common.sh@284 -- # xtrace_disable 00:10:51.058 22:48:41 -- common/autotest_common.sh@10 -- # set +x 00:10:52.962 22:48:43 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:10:52.962 22:48:43 -- nvmf/common.sh@290 -- # pci_devs=() 00:10:52.962 22:48:43 -- nvmf/common.sh@290 -- # local -a pci_devs 00:10:52.962 22:48:43 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:10:52.962 22:48:43 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:10:52.962 22:48:43 -- nvmf/common.sh@292 -- # pci_drivers=() 00:10:52.962 22:48:43 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:10:52.962 22:48:43 -- nvmf/common.sh@294 -- # net_devs=() 00:10:52.962 22:48:43 -- nvmf/common.sh@294 -- # local -ga net_devs 00:10:52.962 22:48:43 -- nvmf/common.sh@295 -- # e810=() 00:10:52.962 22:48:43 -- nvmf/common.sh@295 -- # local -ga e810 00:10:52.962 22:48:43 -- nvmf/common.sh@296 -- # x722=() 00:10:52.962 22:48:43 -- nvmf/common.sh@296 -- # local -ga x722 00:10:52.962 22:48:43 -- nvmf/common.sh@297 -- # mlx=() 00:10:52.962 22:48:43 -- nvmf/common.sh@297 -- # local -ga mlx 00:10:52.962 22:48:43 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:10:52.962 22:48:43 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:10:52.962 22:48:43 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:10:52.962 22:48:43 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:10:52.962 22:48:43 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:10:52.962 22:48:43 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:10:52.962 22:48:43 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:10:52.962 22:48:43 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:10:52.962 22:48:43 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:10:52.962 22:48:43 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:10:52.962 22:48:43 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:10:52.962 22:48:43 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:10:52.962 22:48:43 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:10:52.962 22:48:43 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:10:52.962 22:48:43 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:10:52.962 22:48:43 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:10:52.962 22:48:43 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:10:52.962 22:48:43 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:10:52.962 22:48:43 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:10:52.962 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:10:52.962 22:48:43 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:10:52.962 22:48:43 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:10:52.962 22:48:43 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:10:52.962 22:48:43 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:10:52.962 22:48:43 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:10:52.962 22:48:43 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:10:52.962 22:48:43 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:10:52.962 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:10:52.962 22:48:43 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:10:52.962 22:48:43 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:10:52.962 22:48:43 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:10:52.962 22:48:43 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:10:52.962 22:48:43 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:10:52.962 22:48:43 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:10:52.962 22:48:43 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:10:52.962 22:48:43 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:10:52.962 22:48:43 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:10:52.962 22:48:43 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:10:52.962 22:48:43 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:10:52.962 22:48:43 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:10:52.962 22:48:43 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:10:52.962 Found net devices under 0000:0a:00.0: cvl_0_0 00:10:52.962 22:48:43 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:10:52.962 22:48:43 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:10:52.962 22:48:43 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:10:52.962 22:48:43 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:10:52.962 22:48:43 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:10:52.962 22:48:43 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:10:52.962 Found net devices under 0000:0a:00.1: cvl_0_1 00:10:52.962 22:48:43 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:10:52.962 22:48:43 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:10:52.962 22:48:43 -- nvmf/common.sh@402 -- # is_hw=yes 00:10:52.962 22:48:43 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:10:52.962 22:48:43 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:10:52.962 22:48:43 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:10:52.962 22:48:43 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:10:52.962 22:48:43 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:10:52.962 22:48:43 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:10:52.962 22:48:43 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:10:52.962 22:48:43 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:10:52.962 22:48:43 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:10:52.962 22:48:43 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:10:52.962 22:48:43 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:10:52.962 22:48:43 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:10:52.962 22:48:43 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:10:52.962 22:48:43 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:10:52.962 22:48:43 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:10:52.962 22:48:43 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:10:52.962 22:48:44 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:10:52.962 22:48:44 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:10:52.962 22:48:44 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:10:52.962 22:48:44 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:10:52.962 22:48:44 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:10:52.962 22:48:44 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:10:53.220 22:48:44 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:10:53.220 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:10:53.220 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.208 ms 00:10:53.220 00:10:53.220 --- 10.0.0.2 ping statistics --- 00:10:53.220 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:10:53.220 rtt min/avg/max/mdev = 0.208/0.208/0.208/0.000 ms 00:10:53.220 22:48:44 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:10:53.220 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:10:53.220 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.148 ms 00:10:53.220 00:10:53.220 --- 10.0.0.1 ping statistics --- 00:10:53.220 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:10:53.220 rtt min/avg/max/mdev = 0.148/0.148/0.148/0.000 ms 00:10:53.220 22:48:44 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:10:53.220 22:48:44 -- nvmf/common.sh@410 -- # return 0 00:10:53.220 22:48:44 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:10:53.220 22:48:44 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:10:53.220 22:48:44 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:10:53.220 22:48:44 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:10:53.220 22:48:44 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:10:53.220 22:48:44 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:10:53.220 22:48:44 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:10:53.220 22:48:44 -- target/rpc.sh@24 -- # nvmfappstart -m 0xF 00:10:53.220 22:48:44 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:10:53.220 22:48:44 -- common/autotest_common.sh@712 -- # xtrace_disable 00:10:53.220 22:48:44 -- common/autotest_common.sh@10 -- # set +x 00:10:53.220 22:48:44 -- nvmf/common.sh@469 -- # nvmfpid=219868 00:10:53.221 22:48:44 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:10:53.221 22:48:44 -- nvmf/common.sh@470 -- # waitforlisten 219868 00:10:53.221 22:48:44 -- common/autotest_common.sh@819 -- # '[' -z 219868 ']' 00:10:53.221 22:48:44 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk.sock 00:10:53.221 22:48:44 -- common/autotest_common.sh@824 -- # local max_retries=100 00:10:53.221 22:48:44 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:10:53.221 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:10:53.221 22:48:44 -- common/autotest_common.sh@828 -- # xtrace_disable 00:10:53.221 22:48:44 -- common/autotest_common.sh@10 -- # set +x 00:10:53.221 [2024-04-16 22:48:44.168886] Starting SPDK v24.01.1-pre git sha1 4b134b4ab / DPDK 23.11.0 initialization... 00:10:53.221 [2024-04-16 22:48:44.168956] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:10:53.221 EAL: No free 2048 kB hugepages reported on node 1 00:10:53.221 [2024-04-16 22:48:44.231730] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:10:53.221 [2024-04-16 22:48:44.343060] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:10:53.221 [2024-04-16 22:48:44.343226] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:10:53.221 [2024-04-16 22:48:44.343247] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:10:53.221 [2024-04-16 22:48:44.343262] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:10:53.221 [2024-04-16 22:48:44.343328] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:10:53.221 [2024-04-16 22:48:44.343385] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:10:53.221 [2024-04-16 22:48:44.343437] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:10:53.221 [2024-04-16 22:48:44.343440] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:10:54.153 22:48:45 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:10:54.153 22:48:45 -- common/autotest_common.sh@852 -- # return 0 00:10:54.153 22:48:45 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:10:54.153 22:48:45 -- common/autotest_common.sh@718 -- # xtrace_disable 00:10:54.153 22:48:45 -- common/autotest_common.sh@10 -- # set +x 00:10:54.153 22:48:45 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:10:54.153 22:48:45 -- target/rpc.sh@26 -- # rpc_cmd nvmf_get_stats 00:10:54.153 22:48:45 -- common/autotest_common.sh@551 -- # xtrace_disable 00:10:54.153 22:48:45 -- common/autotest_common.sh@10 -- # set +x 00:10:54.153 22:48:45 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:10:54.153 22:48:45 -- target/rpc.sh@26 -- # stats='{ 00:10:54.153 "tick_rate": 2700000000, 00:10:54.153 "poll_groups": [ 00:10:54.153 { 00:10:54.153 "name": "nvmf_tgt_poll_group_0", 00:10:54.153 "admin_qpairs": 0, 00:10:54.153 "io_qpairs": 0, 00:10:54.153 "current_admin_qpairs": 0, 00:10:54.153 "current_io_qpairs": 0, 00:10:54.153 "pending_bdev_io": 0, 00:10:54.153 "completed_nvme_io": 0, 00:10:54.153 "transports": [] 00:10:54.153 }, 00:10:54.153 { 00:10:54.153 "name": "nvmf_tgt_poll_group_1", 00:10:54.153 "admin_qpairs": 0, 00:10:54.153 "io_qpairs": 0, 00:10:54.153 "current_admin_qpairs": 0, 00:10:54.153 "current_io_qpairs": 0, 00:10:54.153 "pending_bdev_io": 0, 00:10:54.153 "completed_nvme_io": 0, 00:10:54.153 "transports": [] 00:10:54.153 }, 00:10:54.153 { 00:10:54.153 "name": "nvmf_tgt_poll_group_2", 00:10:54.153 "admin_qpairs": 0, 00:10:54.153 "io_qpairs": 0, 00:10:54.153 "current_admin_qpairs": 0, 00:10:54.153 "current_io_qpairs": 0, 00:10:54.153 "pending_bdev_io": 0, 00:10:54.153 "completed_nvme_io": 0, 00:10:54.153 "transports": [] 00:10:54.153 }, 00:10:54.153 { 00:10:54.153 "name": "nvmf_tgt_poll_group_3", 00:10:54.153 "admin_qpairs": 0, 00:10:54.153 "io_qpairs": 0, 00:10:54.153 "current_admin_qpairs": 0, 00:10:54.153 "current_io_qpairs": 0, 00:10:54.153 "pending_bdev_io": 0, 00:10:54.153 "completed_nvme_io": 0, 00:10:54.153 "transports": [] 00:10:54.153 } 00:10:54.153 ] 00:10:54.153 }' 00:10:54.153 22:48:45 -- target/rpc.sh@28 -- # jcount '.poll_groups[].name' 00:10:54.153 22:48:45 -- target/rpc.sh@14 -- # local 'filter=.poll_groups[].name' 00:10:54.153 22:48:45 -- target/rpc.sh@15 -- # jq '.poll_groups[].name' 00:10:54.153 22:48:45 -- target/rpc.sh@15 -- # wc -l 00:10:54.153 22:48:45 -- target/rpc.sh@28 -- # (( 4 == 4 )) 00:10:54.153 22:48:45 -- target/rpc.sh@29 -- # jq '.poll_groups[0].transports[0]' 00:10:54.153 22:48:45 -- target/rpc.sh@29 -- # [[ null == null ]] 00:10:54.153 22:48:45 -- target/rpc.sh@31 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:10:54.153 22:48:45 -- common/autotest_common.sh@551 -- # xtrace_disable 00:10:54.153 22:48:45 -- common/autotest_common.sh@10 -- # set +x 00:10:54.153 [2024-04-16 22:48:45.236037] tcp.c: 659:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:10:54.153 22:48:45 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:10:54.153 22:48:45 -- target/rpc.sh@33 -- # rpc_cmd nvmf_get_stats 00:10:54.153 22:48:45 -- common/autotest_common.sh@551 -- # xtrace_disable 00:10:54.153 22:48:45 -- common/autotest_common.sh@10 -- # set +x 00:10:54.153 22:48:45 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:10:54.153 22:48:45 -- target/rpc.sh@33 -- # stats='{ 00:10:54.153 "tick_rate": 2700000000, 00:10:54.153 "poll_groups": [ 00:10:54.153 { 00:10:54.153 "name": "nvmf_tgt_poll_group_0", 00:10:54.153 "admin_qpairs": 0, 00:10:54.153 "io_qpairs": 0, 00:10:54.153 "current_admin_qpairs": 0, 00:10:54.153 "current_io_qpairs": 0, 00:10:54.153 "pending_bdev_io": 0, 00:10:54.153 "completed_nvme_io": 0, 00:10:54.153 "transports": [ 00:10:54.153 { 00:10:54.153 "trtype": "TCP" 00:10:54.153 } 00:10:54.153 ] 00:10:54.153 }, 00:10:54.153 { 00:10:54.153 "name": "nvmf_tgt_poll_group_1", 00:10:54.153 "admin_qpairs": 0, 00:10:54.153 "io_qpairs": 0, 00:10:54.153 "current_admin_qpairs": 0, 00:10:54.153 "current_io_qpairs": 0, 00:10:54.153 "pending_bdev_io": 0, 00:10:54.153 "completed_nvme_io": 0, 00:10:54.153 "transports": [ 00:10:54.153 { 00:10:54.153 "trtype": "TCP" 00:10:54.153 } 00:10:54.153 ] 00:10:54.153 }, 00:10:54.153 { 00:10:54.153 "name": "nvmf_tgt_poll_group_2", 00:10:54.153 "admin_qpairs": 0, 00:10:54.153 "io_qpairs": 0, 00:10:54.153 "current_admin_qpairs": 0, 00:10:54.153 "current_io_qpairs": 0, 00:10:54.153 "pending_bdev_io": 0, 00:10:54.153 "completed_nvme_io": 0, 00:10:54.153 "transports": [ 00:10:54.153 { 00:10:54.153 "trtype": "TCP" 00:10:54.153 } 00:10:54.153 ] 00:10:54.153 }, 00:10:54.153 { 00:10:54.153 "name": "nvmf_tgt_poll_group_3", 00:10:54.153 "admin_qpairs": 0, 00:10:54.153 "io_qpairs": 0, 00:10:54.153 "current_admin_qpairs": 0, 00:10:54.153 "current_io_qpairs": 0, 00:10:54.153 "pending_bdev_io": 0, 00:10:54.153 "completed_nvme_io": 0, 00:10:54.153 "transports": [ 00:10:54.153 { 00:10:54.153 "trtype": "TCP" 00:10:54.153 } 00:10:54.153 ] 00:10:54.153 } 00:10:54.153 ] 00:10:54.153 }' 00:10:54.153 22:48:45 -- target/rpc.sh@35 -- # jsum '.poll_groups[].admin_qpairs' 00:10:54.153 22:48:45 -- target/rpc.sh@19 -- # local 'filter=.poll_groups[].admin_qpairs' 00:10:54.153 22:48:45 -- target/rpc.sh@20 -- # jq '.poll_groups[].admin_qpairs' 00:10:54.153 22:48:45 -- target/rpc.sh@20 -- # awk '{s+=$1}END{print s}' 00:10:54.412 22:48:45 -- target/rpc.sh@35 -- # (( 0 == 0 )) 00:10:54.412 22:48:45 -- target/rpc.sh@36 -- # jsum '.poll_groups[].io_qpairs' 00:10:54.412 22:48:45 -- target/rpc.sh@19 -- # local 'filter=.poll_groups[].io_qpairs' 00:10:54.412 22:48:45 -- target/rpc.sh@20 -- # jq '.poll_groups[].io_qpairs' 00:10:54.412 22:48:45 -- target/rpc.sh@20 -- # awk '{s+=$1}END{print s}' 00:10:54.412 22:48:45 -- target/rpc.sh@36 -- # (( 0 == 0 )) 00:10:54.412 22:48:45 -- target/rpc.sh@38 -- # '[' rdma == tcp ']' 00:10:54.412 22:48:45 -- target/rpc.sh@46 -- # MALLOC_BDEV_SIZE=64 00:10:54.412 22:48:45 -- target/rpc.sh@47 -- # MALLOC_BLOCK_SIZE=512 00:10:54.412 22:48:45 -- target/rpc.sh@49 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc1 00:10:54.412 22:48:45 -- common/autotest_common.sh@551 -- # xtrace_disable 00:10:54.412 22:48:45 -- common/autotest_common.sh@10 -- # set +x 00:10:54.412 Malloc1 00:10:54.412 22:48:45 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:10:54.412 22:48:45 -- target/rpc.sh@52 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDKISFASTANDAWESOME 00:10:54.412 22:48:45 -- common/autotest_common.sh@551 -- # xtrace_disable 00:10:54.412 22:48:45 -- common/autotest_common.sh@10 -- # set +x 00:10:54.412 22:48:45 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:10:54.412 22:48:45 -- target/rpc.sh@53 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:10:54.412 22:48:45 -- common/autotest_common.sh@551 -- # xtrace_disable 00:10:54.412 22:48:45 -- common/autotest_common.sh@10 -- # set +x 00:10:54.412 22:48:45 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:10:54.412 22:48:45 -- target/rpc.sh@54 -- # rpc_cmd nvmf_subsystem_allow_any_host -d nqn.2016-06.io.spdk:cnode1 00:10:54.412 22:48:45 -- common/autotest_common.sh@551 -- # xtrace_disable 00:10:54.412 22:48:45 -- common/autotest_common.sh@10 -- # set +x 00:10:54.412 22:48:45 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:10:54.412 22:48:45 -- target/rpc.sh@55 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:10:54.412 22:48:45 -- common/autotest_common.sh@551 -- # xtrace_disable 00:10:54.412 22:48:45 -- common/autotest_common.sh@10 -- # set +x 00:10:54.412 [2024-04-16 22:48:45.380329] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:10:54.412 22:48:45 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:10:54.412 22:48:45 -- target/rpc.sh@58 -- # NOT nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -q nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 -a 10.0.0.2 -s 4420 00:10:54.412 22:48:45 -- common/autotest_common.sh@640 -- # local es=0 00:10:54.412 22:48:45 -- common/autotest_common.sh@642 -- # valid_exec_arg nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -q nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 -a 10.0.0.2 -s 4420 00:10:54.412 22:48:45 -- common/autotest_common.sh@628 -- # local arg=nvme 00:10:54.412 22:48:45 -- common/autotest_common.sh@632 -- # case "$(type -t "$arg")" in 00:10:54.412 22:48:45 -- common/autotest_common.sh@632 -- # type -t nvme 00:10:54.412 22:48:45 -- common/autotest_common.sh@632 -- # case "$(type -t "$arg")" in 00:10:54.412 22:48:45 -- common/autotest_common.sh@634 -- # type -P nvme 00:10:54.412 22:48:45 -- common/autotest_common.sh@632 -- # case "$(type -t "$arg")" in 00:10:54.412 22:48:45 -- common/autotest_common.sh@634 -- # arg=/usr/sbin/nvme 00:10:54.412 22:48:45 -- common/autotest_common.sh@634 -- # [[ -x /usr/sbin/nvme ]] 00:10:54.412 22:48:45 -- common/autotest_common.sh@643 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -q nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 -a 10.0.0.2 -s 4420 00:10:54.412 [2024-04-16 22:48:45.402805] ctrlr.c: 715:nvmf_qpair_access_allowed: *ERROR*: Subsystem 'nqn.2016-06.io.spdk:cnode1' does not allow host 'nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55' 00:10:54.412 Failed to write to /dev/nvme-fabrics: Input/output error 00:10:54.412 could not add new controller: failed to write to nvme-fabrics device 00:10:54.412 22:48:45 -- common/autotest_common.sh@643 -- # es=1 00:10:54.412 22:48:45 -- common/autotest_common.sh@651 -- # (( es > 128 )) 00:10:54.412 22:48:45 -- common/autotest_common.sh@662 -- # [[ -n '' ]] 00:10:54.412 22:48:45 -- common/autotest_common.sh@667 -- # (( !es == 0 )) 00:10:54.412 22:48:45 -- target/rpc.sh@61 -- # rpc_cmd nvmf_subsystem_add_host nqn.2016-06.io.spdk:cnode1 nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:10:54.412 22:48:45 -- common/autotest_common.sh@551 -- # xtrace_disable 00:10:54.412 22:48:45 -- common/autotest_common.sh@10 -- # set +x 00:10:54.412 22:48:45 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:10:54.412 22:48:45 -- target/rpc.sh@62 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:10:54.977 22:48:46 -- target/rpc.sh@63 -- # waitforserial SPDKISFASTANDAWESOME 00:10:54.977 22:48:46 -- common/autotest_common.sh@1177 -- # local i=0 00:10:54.977 22:48:46 -- common/autotest_common.sh@1178 -- # local nvme_device_counter=1 nvme_devices=0 00:10:54.977 22:48:46 -- common/autotest_common.sh@1179 -- # [[ -n '' ]] 00:10:54.977 22:48:46 -- common/autotest_common.sh@1184 -- # sleep 2 00:10:57.503 22:48:48 -- common/autotest_common.sh@1185 -- # (( i++ <= 15 )) 00:10:57.503 22:48:48 -- common/autotest_common.sh@1186 -- # lsblk -l -o NAME,SERIAL 00:10:57.503 22:48:48 -- common/autotest_common.sh@1186 -- # grep -c SPDKISFASTANDAWESOME 00:10:57.503 22:48:48 -- common/autotest_common.sh@1186 -- # nvme_devices=1 00:10:57.503 22:48:48 -- common/autotest_common.sh@1187 -- # (( nvme_devices == nvme_device_counter )) 00:10:57.503 22:48:48 -- common/autotest_common.sh@1187 -- # return 0 00:10:57.503 22:48:48 -- target/rpc.sh@64 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:10:57.503 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:57.503 22:48:48 -- target/rpc.sh@65 -- # waitforserial_disconnect SPDKISFASTANDAWESOME 00:10:57.503 22:48:48 -- common/autotest_common.sh@1198 -- # local i=0 00:10:57.503 22:48:48 -- common/autotest_common.sh@1199 -- # lsblk -o NAME,SERIAL 00:10:57.503 22:48:48 -- common/autotest_common.sh@1199 -- # grep -q -w SPDKISFASTANDAWESOME 00:10:57.503 22:48:48 -- common/autotest_common.sh@1206 -- # lsblk -l -o NAME,SERIAL 00:10:57.503 22:48:48 -- common/autotest_common.sh@1206 -- # grep -q -w SPDKISFASTANDAWESOME 00:10:57.503 22:48:48 -- common/autotest_common.sh@1210 -- # return 0 00:10:57.503 22:48:48 -- target/rpc.sh@68 -- # rpc_cmd nvmf_subsystem_remove_host nqn.2016-06.io.spdk:cnode1 nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:10:57.503 22:48:48 -- common/autotest_common.sh@551 -- # xtrace_disable 00:10:57.503 22:48:48 -- common/autotest_common.sh@10 -- # set +x 00:10:57.503 22:48:48 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:10:57.503 22:48:48 -- target/rpc.sh@69 -- # NOT nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:10:57.503 22:48:48 -- common/autotest_common.sh@640 -- # local es=0 00:10:57.503 22:48:48 -- common/autotest_common.sh@642 -- # valid_exec_arg nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:10:57.503 22:48:48 -- common/autotest_common.sh@628 -- # local arg=nvme 00:10:57.503 22:48:48 -- common/autotest_common.sh@632 -- # case "$(type -t "$arg")" in 00:10:57.503 22:48:48 -- common/autotest_common.sh@632 -- # type -t nvme 00:10:57.503 22:48:48 -- common/autotest_common.sh@632 -- # case "$(type -t "$arg")" in 00:10:57.503 22:48:48 -- common/autotest_common.sh@634 -- # type -P nvme 00:10:57.503 22:48:48 -- common/autotest_common.sh@632 -- # case "$(type -t "$arg")" in 00:10:57.503 22:48:48 -- common/autotest_common.sh@634 -- # arg=/usr/sbin/nvme 00:10:57.503 22:48:48 -- common/autotest_common.sh@634 -- # [[ -x /usr/sbin/nvme ]] 00:10:57.503 22:48:48 -- common/autotest_common.sh@643 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:10:57.503 [2024-04-16 22:48:48.181739] ctrlr.c: 715:nvmf_qpair_access_allowed: *ERROR*: Subsystem 'nqn.2016-06.io.spdk:cnode1' does not allow host 'nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55' 00:10:57.503 Failed to write to /dev/nvme-fabrics: Input/output error 00:10:57.503 could not add new controller: failed to write to nvme-fabrics device 00:10:57.503 22:48:48 -- common/autotest_common.sh@643 -- # es=1 00:10:57.503 22:48:48 -- common/autotest_common.sh@651 -- # (( es > 128 )) 00:10:57.503 22:48:48 -- common/autotest_common.sh@662 -- # [[ -n '' ]] 00:10:57.503 22:48:48 -- common/autotest_common.sh@667 -- # (( !es == 0 )) 00:10:57.503 22:48:48 -- target/rpc.sh@72 -- # rpc_cmd nvmf_subsystem_allow_any_host -e nqn.2016-06.io.spdk:cnode1 00:10:57.503 22:48:48 -- common/autotest_common.sh@551 -- # xtrace_disable 00:10:57.503 22:48:48 -- common/autotest_common.sh@10 -- # set +x 00:10:57.503 22:48:48 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:10:57.503 22:48:48 -- target/rpc.sh@73 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:10:57.760 22:48:48 -- target/rpc.sh@74 -- # waitforserial SPDKISFASTANDAWESOME 00:10:57.760 22:48:48 -- common/autotest_common.sh@1177 -- # local i=0 00:10:57.760 22:48:48 -- common/autotest_common.sh@1178 -- # local nvme_device_counter=1 nvme_devices=0 00:10:57.761 22:48:48 -- common/autotest_common.sh@1179 -- # [[ -n '' ]] 00:10:57.761 22:48:48 -- common/autotest_common.sh@1184 -- # sleep 2 00:10:59.690 22:48:50 -- common/autotest_common.sh@1185 -- # (( i++ <= 15 )) 00:10:59.690 22:48:50 -- common/autotest_common.sh@1186 -- # lsblk -l -o NAME,SERIAL 00:10:59.690 22:48:50 -- common/autotest_common.sh@1186 -- # grep -c SPDKISFASTANDAWESOME 00:10:59.690 22:48:50 -- common/autotest_common.sh@1186 -- # nvme_devices=1 00:10:59.690 22:48:50 -- common/autotest_common.sh@1187 -- # (( nvme_devices == nvme_device_counter )) 00:10:59.690 22:48:50 -- common/autotest_common.sh@1187 -- # return 0 00:10:59.690 22:48:50 -- target/rpc.sh@75 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:10:59.948 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:59.948 22:48:50 -- target/rpc.sh@76 -- # waitforserial_disconnect SPDKISFASTANDAWESOME 00:10:59.948 22:48:50 -- common/autotest_common.sh@1198 -- # local i=0 00:10:59.948 22:48:50 -- common/autotest_common.sh@1199 -- # lsblk -o NAME,SERIAL 00:10:59.948 22:48:50 -- common/autotest_common.sh@1199 -- # grep -q -w SPDKISFASTANDAWESOME 00:10:59.948 22:48:50 -- common/autotest_common.sh@1206 -- # lsblk -l -o NAME,SERIAL 00:10:59.948 22:48:50 -- common/autotest_common.sh@1206 -- # grep -q -w SPDKISFASTANDAWESOME 00:10:59.948 22:48:50 -- common/autotest_common.sh@1210 -- # return 0 00:10:59.948 22:48:50 -- target/rpc.sh@78 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:10:59.948 22:48:50 -- common/autotest_common.sh@551 -- # xtrace_disable 00:10:59.948 22:48:50 -- common/autotest_common.sh@10 -- # set +x 00:10:59.948 22:48:50 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:10:59.948 22:48:50 -- target/rpc.sh@81 -- # seq 1 5 00:10:59.948 22:48:50 -- target/rpc.sh@81 -- # for i in $(seq 1 $loops) 00:10:59.948 22:48:50 -- target/rpc.sh@82 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDKISFASTANDAWESOME 00:10:59.948 22:48:50 -- common/autotest_common.sh@551 -- # xtrace_disable 00:10:59.948 22:48:50 -- common/autotest_common.sh@10 -- # set +x 00:10:59.948 22:48:50 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:10:59.948 22:48:50 -- target/rpc.sh@83 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:10:59.948 22:48:50 -- common/autotest_common.sh@551 -- # xtrace_disable 00:10:59.948 22:48:50 -- common/autotest_common.sh@10 -- # set +x 00:10:59.948 [2024-04-16 22:48:50.895826] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:10:59.948 22:48:50 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:10:59.948 22:48:50 -- target/rpc.sh@84 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 -n 5 00:10:59.948 22:48:50 -- common/autotest_common.sh@551 -- # xtrace_disable 00:10:59.948 22:48:50 -- common/autotest_common.sh@10 -- # set +x 00:10:59.948 22:48:50 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:10:59.948 22:48:50 -- target/rpc.sh@85 -- # rpc_cmd nvmf_subsystem_allow_any_host nqn.2016-06.io.spdk:cnode1 00:10:59.948 22:48:50 -- common/autotest_common.sh@551 -- # xtrace_disable 00:10:59.948 22:48:50 -- common/autotest_common.sh@10 -- # set +x 00:10:59.948 22:48:50 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:10:59.948 22:48:50 -- target/rpc.sh@86 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:11:00.514 22:48:51 -- target/rpc.sh@88 -- # waitforserial SPDKISFASTANDAWESOME 00:11:00.514 22:48:51 -- common/autotest_common.sh@1177 -- # local i=0 00:11:00.514 22:48:51 -- common/autotest_common.sh@1178 -- # local nvme_device_counter=1 nvme_devices=0 00:11:00.514 22:48:51 -- common/autotest_common.sh@1179 -- # [[ -n '' ]] 00:11:00.514 22:48:51 -- common/autotest_common.sh@1184 -- # sleep 2 00:11:02.413 22:48:53 -- common/autotest_common.sh@1185 -- # (( i++ <= 15 )) 00:11:02.413 22:48:53 -- common/autotest_common.sh@1186 -- # lsblk -l -o NAME,SERIAL 00:11:02.413 22:48:53 -- common/autotest_common.sh@1186 -- # grep -c SPDKISFASTANDAWESOME 00:11:02.413 22:48:53 -- common/autotest_common.sh@1186 -- # nvme_devices=1 00:11:02.413 22:48:53 -- common/autotest_common.sh@1187 -- # (( nvme_devices == nvme_device_counter )) 00:11:02.413 22:48:53 -- common/autotest_common.sh@1187 -- # return 0 00:11:02.413 22:48:53 -- target/rpc.sh@90 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:11:02.671 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:02.671 22:48:53 -- target/rpc.sh@91 -- # waitforserial_disconnect SPDKISFASTANDAWESOME 00:11:02.671 22:48:53 -- common/autotest_common.sh@1198 -- # local i=0 00:11:02.671 22:48:53 -- common/autotest_common.sh@1199 -- # lsblk -o NAME,SERIAL 00:11:02.671 22:48:53 -- common/autotest_common.sh@1199 -- # grep -q -w SPDKISFASTANDAWESOME 00:11:02.671 22:48:53 -- common/autotest_common.sh@1206 -- # lsblk -l -o NAME,SERIAL 00:11:02.671 22:48:53 -- common/autotest_common.sh@1206 -- # grep -q -w SPDKISFASTANDAWESOME 00:11:02.671 22:48:53 -- common/autotest_common.sh@1210 -- # return 0 00:11:02.671 22:48:53 -- target/rpc.sh@93 -- # rpc_cmd nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 5 00:11:02.671 22:48:53 -- common/autotest_common.sh@551 -- # xtrace_disable 00:11:02.671 22:48:53 -- common/autotest_common.sh@10 -- # set +x 00:11:02.671 22:48:53 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:11:02.671 22:48:53 -- target/rpc.sh@94 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:11:02.671 22:48:53 -- common/autotest_common.sh@551 -- # xtrace_disable 00:11:02.671 22:48:53 -- common/autotest_common.sh@10 -- # set +x 00:11:02.671 22:48:53 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:11:02.671 22:48:53 -- target/rpc.sh@81 -- # for i in $(seq 1 $loops) 00:11:02.671 22:48:53 -- target/rpc.sh@82 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDKISFASTANDAWESOME 00:11:02.671 22:48:53 -- common/autotest_common.sh@551 -- # xtrace_disable 00:11:02.671 22:48:53 -- common/autotest_common.sh@10 -- # set +x 00:11:02.671 22:48:53 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:11:02.671 22:48:53 -- target/rpc.sh@83 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:11:02.671 22:48:53 -- common/autotest_common.sh@551 -- # xtrace_disable 00:11:02.671 22:48:53 -- common/autotest_common.sh@10 -- # set +x 00:11:02.671 [2024-04-16 22:48:53.646212] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:11:02.671 22:48:53 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:11:02.671 22:48:53 -- target/rpc.sh@84 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 -n 5 00:11:02.671 22:48:53 -- common/autotest_common.sh@551 -- # xtrace_disable 00:11:02.671 22:48:53 -- common/autotest_common.sh@10 -- # set +x 00:11:02.671 22:48:53 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:11:02.671 22:48:53 -- target/rpc.sh@85 -- # rpc_cmd nvmf_subsystem_allow_any_host nqn.2016-06.io.spdk:cnode1 00:11:02.671 22:48:53 -- common/autotest_common.sh@551 -- # xtrace_disable 00:11:02.671 22:48:53 -- common/autotest_common.sh@10 -- # set +x 00:11:02.671 22:48:53 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:11:02.671 22:48:53 -- target/rpc.sh@86 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:11:03.237 22:48:54 -- target/rpc.sh@88 -- # waitforserial SPDKISFASTANDAWESOME 00:11:03.237 22:48:54 -- common/autotest_common.sh@1177 -- # local i=0 00:11:03.237 22:48:54 -- common/autotest_common.sh@1178 -- # local nvme_device_counter=1 nvme_devices=0 00:11:03.237 22:48:54 -- common/autotest_common.sh@1179 -- # [[ -n '' ]] 00:11:03.237 22:48:54 -- common/autotest_common.sh@1184 -- # sleep 2 00:11:05.764 22:48:56 -- common/autotest_common.sh@1185 -- # (( i++ <= 15 )) 00:11:05.764 22:48:56 -- common/autotest_common.sh@1186 -- # lsblk -l -o NAME,SERIAL 00:11:05.764 22:48:56 -- common/autotest_common.sh@1186 -- # grep -c SPDKISFASTANDAWESOME 00:11:05.764 22:48:56 -- common/autotest_common.sh@1186 -- # nvme_devices=1 00:11:05.764 22:48:56 -- common/autotest_common.sh@1187 -- # (( nvme_devices == nvme_device_counter )) 00:11:05.764 22:48:56 -- common/autotest_common.sh@1187 -- # return 0 00:11:05.764 22:48:56 -- target/rpc.sh@90 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:11:05.764 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:05.764 22:48:56 -- target/rpc.sh@91 -- # waitforserial_disconnect SPDKISFASTANDAWESOME 00:11:05.764 22:48:56 -- common/autotest_common.sh@1198 -- # local i=0 00:11:05.764 22:48:56 -- common/autotest_common.sh@1199 -- # lsblk -o NAME,SERIAL 00:11:05.764 22:48:56 -- common/autotest_common.sh@1199 -- # grep -q -w SPDKISFASTANDAWESOME 00:11:05.764 22:48:56 -- common/autotest_common.sh@1206 -- # lsblk -l -o NAME,SERIAL 00:11:05.764 22:48:56 -- common/autotest_common.sh@1206 -- # grep -q -w SPDKISFASTANDAWESOME 00:11:05.764 22:48:56 -- common/autotest_common.sh@1210 -- # return 0 00:11:05.764 22:48:56 -- target/rpc.sh@93 -- # rpc_cmd nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 5 00:11:05.764 22:48:56 -- common/autotest_common.sh@551 -- # xtrace_disable 00:11:05.764 22:48:56 -- common/autotest_common.sh@10 -- # set +x 00:11:05.764 22:48:56 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:11:05.764 22:48:56 -- target/rpc.sh@94 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:11:05.764 22:48:56 -- common/autotest_common.sh@551 -- # xtrace_disable 00:11:05.764 22:48:56 -- common/autotest_common.sh@10 -- # set +x 00:11:05.764 22:48:56 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:11:05.764 22:48:56 -- target/rpc.sh@81 -- # for i in $(seq 1 $loops) 00:11:05.764 22:48:56 -- target/rpc.sh@82 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDKISFASTANDAWESOME 00:11:05.764 22:48:56 -- common/autotest_common.sh@551 -- # xtrace_disable 00:11:05.765 22:48:56 -- common/autotest_common.sh@10 -- # set +x 00:11:05.765 22:48:56 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:11:05.765 22:48:56 -- target/rpc.sh@83 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:11:05.765 22:48:56 -- common/autotest_common.sh@551 -- # xtrace_disable 00:11:05.765 22:48:56 -- common/autotest_common.sh@10 -- # set +x 00:11:05.765 [2024-04-16 22:48:56.444700] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:11:05.765 22:48:56 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:11:05.765 22:48:56 -- target/rpc.sh@84 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 -n 5 00:11:05.765 22:48:56 -- common/autotest_common.sh@551 -- # xtrace_disable 00:11:05.765 22:48:56 -- common/autotest_common.sh@10 -- # set +x 00:11:05.765 22:48:56 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:11:05.765 22:48:56 -- target/rpc.sh@85 -- # rpc_cmd nvmf_subsystem_allow_any_host nqn.2016-06.io.spdk:cnode1 00:11:05.765 22:48:56 -- common/autotest_common.sh@551 -- # xtrace_disable 00:11:05.765 22:48:56 -- common/autotest_common.sh@10 -- # set +x 00:11:05.765 22:48:56 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:11:05.765 22:48:56 -- target/rpc.sh@86 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:11:06.024 22:48:57 -- target/rpc.sh@88 -- # waitforserial SPDKISFASTANDAWESOME 00:11:06.024 22:48:57 -- common/autotest_common.sh@1177 -- # local i=0 00:11:06.024 22:48:57 -- common/autotest_common.sh@1178 -- # local nvme_device_counter=1 nvme_devices=0 00:11:06.024 22:48:57 -- common/autotest_common.sh@1179 -- # [[ -n '' ]] 00:11:06.024 22:48:57 -- common/autotest_common.sh@1184 -- # sleep 2 00:11:07.931 22:48:59 -- common/autotest_common.sh@1185 -- # (( i++ <= 15 )) 00:11:07.931 22:48:59 -- common/autotest_common.sh@1186 -- # lsblk -l -o NAME,SERIAL 00:11:07.931 22:48:59 -- common/autotest_common.sh@1186 -- # grep -c SPDKISFASTANDAWESOME 00:11:07.931 22:48:59 -- common/autotest_common.sh@1186 -- # nvme_devices=1 00:11:07.931 22:48:59 -- common/autotest_common.sh@1187 -- # (( nvme_devices == nvme_device_counter )) 00:11:07.931 22:48:59 -- common/autotest_common.sh@1187 -- # return 0 00:11:07.931 22:48:59 -- target/rpc.sh@90 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:11:08.190 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:08.190 22:48:59 -- target/rpc.sh@91 -- # waitforserial_disconnect SPDKISFASTANDAWESOME 00:11:08.190 22:48:59 -- common/autotest_common.sh@1198 -- # local i=0 00:11:08.190 22:48:59 -- common/autotest_common.sh@1199 -- # lsblk -o NAME,SERIAL 00:11:08.190 22:48:59 -- common/autotest_common.sh@1199 -- # grep -q -w SPDKISFASTANDAWESOME 00:11:08.190 22:48:59 -- common/autotest_common.sh@1206 -- # lsblk -l -o NAME,SERIAL 00:11:08.190 22:48:59 -- common/autotest_common.sh@1206 -- # grep -q -w SPDKISFASTANDAWESOME 00:11:08.190 22:48:59 -- common/autotest_common.sh@1210 -- # return 0 00:11:08.190 22:48:59 -- target/rpc.sh@93 -- # rpc_cmd nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 5 00:11:08.190 22:48:59 -- common/autotest_common.sh@551 -- # xtrace_disable 00:11:08.190 22:48:59 -- common/autotest_common.sh@10 -- # set +x 00:11:08.190 22:48:59 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:11:08.190 22:48:59 -- target/rpc.sh@94 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:11:08.190 22:48:59 -- common/autotest_common.sh@551 -- # xtrace_disable 00:11:08.190 22:48:59 -- common/autotest_common.sh@10 -- # set +x 00:11:08.190 22:48:59 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:11:08.190 22:48:59 -- target/rpc.sh@81 -- # for i in $(seq 1 $loops) 00:11:08.190 22:48:59 -- target/rpc.sh@82 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDKISFASTANDAWESOME 00:11:08.190 22:48:59 -- common/autotest_common.sh@551 -- # xtrace_disable 00:11:08.190 22:48:59 -- common/autotest_common.sh@10 -- # set +x 00:11:08.190 22:48:59 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:11:08.190 22:48:59 -- target/rpc.sh@83 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:11:08.190 22:48:59 -- common/autotest_common.sh@551 -- # xtrace_disable 00:11:08.190 22:48:59 -- common/autotest_common.sh@10 -- # set +x 00:11:08.190 [2024-04-16 22:48:59.218440] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:11:08.190 22:48:59 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:11:08.190 22:48:59 -- target/rpc.sh@84 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 -n 5 00:11:08.190 22:48:59 -- common/autotest_common.sh@551 -- # xtrace_disable 00:11:08.190 22:48:59 -- common/autotest_common.sh@10 -- # set +x 00:11:08.190 22:48:59 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:11:08.190 22:48:59 -- target/rpc.sh@85 -- # rpc_cmd nvmf_subsystem_allow_any_host nqn.2016-06.io.spdk:cnode1 00:11:08.190 22:48:59 -- common/autotest_common.sh@551 -- # xtrace_disable 00:11:08.190 22:48:59 -- common/autotest_common.sh@10 -- # set +x 00:11:08.190 22:48:59 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:11:08.190 22:48:59 -- target/rpc.sh@86 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:11:08.757 22:48:59 -- target/rpc.sh@88 -- # waitforserial SPDKISFASTANDAWESOME 00:11:08.757 22:48:59 -- common/autotest_common.sh@1177 -- # local i=0 00:11:08.757 22:48:59 -- common/autotest_common.sh@1178 -- # local nvme_device_counter=1 nvme_devices=0 00:11:08.757 22:48:59 -- common/autotest_common.sh@1179 -- # [[ -n '' ]] 00:11:08.757 22:48:59 -- common/autotest_common.sh@1184 -- # sleep 2 00:11:11.285 22:49:01 -- common/autotest_common.sh@1185 -- # (( i++ <= 15 )) 00:11:11.285 22:49:01 -- common/autotest_common.sh@1186 -- # lsblk -l -o NAME,SERIAL 00:11:11.285 22:49:01 -- common/autotest_common.sh@1186 -- # grep -c SPDKISFASTANDAWESOME 00:11:11.285 22:49:01 -- common/autotest_common.sh@1186 -- # nvme_devices=1 00:11:11.285 22:49:01 -- common/autotest_common.sh@1187 -- # (( nvme_devices == nvme_device_counter )) 00:11:11.285 22:49:01 -- common/autotest_common.sh@1187 -- # return 0 00:11:11.285 22:49:01 -- target/rpc.sh@90 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:11:11.285 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:11.285 22:49:01 -- target/rpc.sh@91 -- # waitforserial_disconnect SPDKISFASTANDAWESOME 00:11:11.285 22:49:01 -- common/autotest_common.sh@1198 -- # local i=0 00:11:11.285 22:49:01 -- common/autotest_common.sh@1199 -- # lsblk -o NAME,SERIAL 00:11:11.285 22:49:01 -- common/autotest_common.sh@1199 -- # grep -q -w SPDKISFASTANDAWESOME 00:11:11.285 22:49:01 -- common/autotest_common.sh@1206 -- # lsblk -l -o NAME,SERIAL 00:11:11.285 22:49:01 -- common/autotest_common.sh@1206 -- # grep -q -w SPDKISFASTANDAWESOME 00:11:11.285 22:49:01 -- common/autotest_common.sh@1210 -- # return 0 00:11:11.285 22:49:01 -- target/rpc.sh@93 -- # rpc_cmd nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 5 00:11:11.285 22:49:01 -- common/autotest_common.sh@551 -- # xtrace_disable 00:11:11.285 22:49:01 -- common/autotest_common.sh@10 -- # set +x 00:11:11.285 22:49:01 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:11:11.285 22:49:01 -- target/rpc.sh@94 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:11:11.285 22:49:01 -- common/autotest_common.sh@551 -- # xtrace_disable 00:11:11.285 22:49:01 -- common/autotest_common.sh@10 -- # set +x 00:11:11.285 22:49:01 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:11:11.285 22:49:01 -- target/rpc.sh@81 -- # for i in $(seq 1 $loops) 00:11:11.285 22:49:01 -- target/rpc.sh@82 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDKISFASTANDAWESOME 00:11:11.285 22:49:01 -- common/autotest_common.sh@551 -- # xtrace_disable 00:11:11.285 22:49:01 -- common/autotest_common.sh@10 -- # set +x 00:11:11.285 22:49:01 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:11:11.285 22:49:01 -- target/rpc.sh@83 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:11:11.285 22:49:01 -- common/autotest_common.sh@551 -- # xtrace_disable 00:11:11.285 22:49:01 -- common/autotest_common.sh@10 -- # set +x 00:11:11.285 [2024-04-16 22:49:01.995999] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:11:11.285 22:49:01 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:11:11.285 22:49:01 -- target/rpc.sh@84 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 -n 5 00:11:11.285 22:49:01 -- common/autotest_common.sh@551 -- # xtrace_disable 00:11:11.285 22:49:01 -- common/autotest_common.sh@10 -- # set +x 00:11:11.285 22:49:02 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:11:11.285 22:49:02 -- target/rpc.sh@85 -- # rpc_cmd nvmf_subsystem_allow_any_host nqn.2016-06.io.spdk:cnode1 00:11:11.285 22:49:02 -- common/autotest_common.sh@551 -- # xtrace_disable 00:11:11.285 22:49:02 -- common/autotest_common.sh@10 -- # set +x 00:11:11.285 22:49:02 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:11:11.285 22:49:02 -- target/rpc.sh@86 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:11:11.543 22:49:02 -- target/rpc.sh@88 -- # waitforserial SPDKISFASTANDAWESOME 00:11:11.543 22:49:02 -- common/autotest_common.sh@1177 -- # local i=0 00:11:11.543 22:49:02 -- common/autotest_common.sh@1178 -- # local nvme_device_counter=1 nvme_devices=0 00:11:11.543 22:49:02 -- common/autotest_common.sh@1179 -- # [[ -n '' ]] 00:11:11.543 22:49:02 -- common/autotest_common.sh@1184 -- # sleep 2 00:11:14.067 22:49:04 -- common/autotest_common.sh@1185 -- # (( i++ <= 15 )) 00:11:14.067 22:49:04 -- common/autotest_common.sh@1186 -- # lsblk -l -o NAME,SERIAL 00:11:14.067 22:49:04 -- common/autotest_common.sh@1186 -- # grep -c SPDKISFASTANDAWESOME 00:11:14.067 22:49:04 -- common/autotest_common.sh@1186 -- # nvme_devices=1 00:11:14.067 22:49:04 -- common/autotest_common.sh@1187 -- # (( nvme_devices == nvme_device_counter )) 00:11:14.067 22:49:04 -- common/autotest_common.sh@1187 -- # return 0 00:11:14.067 22:49:04 -- target/rpc.sh@90 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:11:14.067 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:14.067 22:49:04 -- target/rpc.sh@91 -- # waitforserial_disconnect SPDKISFASTANDAWESOME 00:11:14.067 22:49:04 -- common/autotest_common.sh@1198 -- # local i=0 00:11:14.067 22:49:04 -- common/autotest_common.sh@1199 -- # lsblk -o NAME,SERIAL 00:11:14.067 22:49:04 -- common/autotest_common.sh@1199 -- # grep -q -w SPDKISFASTANDAWESOME 00:11:14.067 22:49:04 -- common/autotest_common.sh@1206 -- # lsblk -l -o NAME,SERIAL 00:11:14.067 22:49:04 -- common/autotest_common.sh@1206 -- # grep -q -w SPDKISFASTANDAWESOME 00:11:14.067 22:49:04 -- common/autotest_common.sh@1210 -- # return 0 00:11:14.067 22:49:04 -- target/rpc.sh@93 -- # rpc_cmd nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 5 00:11:14.067 22:49:04 -- common/autotest_common.sh@551 -- # xtrace_disable 00:11:14.067 22:49:04 -- common/autotest_common.sh@10 -- # set +x 00:11:14.067 22:49:04 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:11:14.067 22:49:04 -- target/rpc.sh@94 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:11:14.067 22:49:04 -- common/autotest_common.sh@551 -- # xtrace_disable 00:11:14.067 22:49:04 -- common/autotest_common.sh@10 -- # set +x 00:11:14.067 22:49:04 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:11:14.067 22:49:04 -- target/rpc.sh@99 -- # seq 1 5 00:11:14.067 22:49:04 -- target/rpc.sh@99 -- # for i in $(seq 1 $loops) 00:11:14.067 22:49:04 -- target/rpc.sh@100 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDKISFASTANDAWESOME 00:11:14.067 22:49:04 -- common/autotest_common.sh@551 -- # xtrace_disable 00:11:14.067 22:49:04 -- common/autotest_common.sh@10 -- # set +x 00:11:14.067 22:49:04 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:11:14.067 22:49:04 -- target/rpc.sh@101 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:11:14.067 22:49:04 -- common/autotest_common.sh@551 -- # xtrace_disable 00:11:14.067 22:49:04 -- common/autotest_common.sh@10 -- # set +x 00:11:14.067 [2024-04-16 22:49:04.688393] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:11:14.067 22:49:04 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:11:14.067 22:49:04 -- target/rpc.sh@102 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:11:14.067 22:49:04 -- common/autotest_common.sh@551 -- # xtrace_disable 00:11:14.067 22:49:04 -- common/autotest_common.sh@10 -- # set +x 00:11:14.067 22:49:04 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:11:14.067 22:49:04 -- target/rpc.sh@103 -- # rpc_cmd nvmf_subsystem_allow_any_host nqn.2016-06.io.spdk:cnode1 00:11:14.067 22:49:04 -- common/autotest_common.sh@551 -- # xtrace_disable 00:11:14.067 22:49:04 -- common/autotest_common.sh@10 -- # set +x 00:11:14.067 22:49:04 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:11:14.067 22:49:04 -- target/rpc.sh@105 -- # rpc_cmd nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:11:14.067 22:49:04 -- common/autotest_common.sh@551 -- # xtrace_disable 00:11:14.067 22:49:04 -- common/autotest_common.sh@10 -- # set +x 00:11:14.067 22:49:04 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:11:14.067 22:49:04 -- target/rpc.sh@107 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:11:14.067 22:49:04 -- common/autotest_common.sh@551 -- # xtrace_disable 00:11:14.067 22:49:04 -- common/autotest_common.sh@10 -- # set +x 00:11:14.067 22:49:04 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:11:14.067 22:49:04 -- target/rpc.sh@99 -- # for i in $(seq 1 $loops) 00:11:14.067 22:49:04 -- target/rpc.sh@100 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDKISFASTANDAWESOME 00:11:14.067 22:49:04 -- common/autotest_common.sh@551 -- # xtrace_disable 00:11:14.067 22:49:04 -- common/autotest_common.sh@10 -- # set +x 00:11:14.067 22:49:04 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:11:14.067 22:49:04 -- target/rpc.sh@101 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:11:14.067 22:49:04 -- common/autotest_common.sh@551 -- # xtrace_disable 00:11:14.067 22:49:04 -- common/autotest_common.sh@10 -- # set +x 00:11:14.067 [2024-04-16 22:49:04.736478] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:11:14.067 22:49:04 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:11:14.067 22:49:04 -- target/rpc.sh@102 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:11:14.067 22:49:04 -- common/autotest_common.sh@551 -- # xtrace_disable 00:11:14.067 22:49:04 -- common/autotest_common.sh@10 -- # set +x 00:11:14.067 22:49:04 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:11:14.067 22:49:04 -- target/rpc.sh@103 -- # rpc_cmd nvmf_subsystem_allow_any_host nqn.2016-06.io.spdk:cnode1 00:11:14.067 22:49:04 -- common/autotest_common.sh@551 -- # xtrace_disable 00:11:14.067 22:49:04 -- common/autotest_common.sh@10 -- # set +x 00:11:14.067 22:49:04 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:11:14.067 22:49:04 -- target/rpc.sh@105 -- # rpc_cmd nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:11:14.067 22:49:04 -- common/autotest_common.sh@551 -- # xtrace_disable 00:11:14.067 22:49:04 -- common/autotest_common.sh@10 -- # set +x 00:11:14.067 22:49:04 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:11:14.067 22:49:04 -- target/rpc.sh@107 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:11:14.067 22:49:04 -- common/autotest_common.sh@551 -- # xtrace_disable 00:11:14.067 22:49:04 -- common/autotest_common.sh@10 -- # set +x 00:11:14.067 22:49:04 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:11:14.067 22:49:04 -- target/rpc.sh@99 -- # for i in $(seq 1 $loops) 00:11:14.068 22:49:04 -- target/rpc.sh@100 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDKISFASTANDAWESOME 00:11:14.068 22:49:04 -- common/autotest_common.sh@551 -- # xtrace_disable 00:11:14.068 22:49:04 -- common/autotest_common.sh@10 -- # set +x 00:11:14.068 22:49:04 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:11:14.068 22:49:04 -- target/rpc.sh@101 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:11:14.068 22:49:04 -- common/autotest_common.sh@551 -- # xtrace_disable 00:11:14.068 22:49:04 -- common/autotest_common.sh@10 -- # set +x 00:11:14.068 [2024-04-16 22:49:04.784662] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:11:14.068 22:49:04 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:11:14.068 22:49:04 -- target/rpc.sh@102 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:11:14.068 22:49:04 -- common/autotest_common.sh@551 -- # xtrace_disable 00:11:14.068 22:49:04 -- common/autotest_common.sh@10 -- # set +x 00:11:14.068 22:49:04 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:11:14.068 22:49:04 -- target/rpc.sh@103 -- # rpc_cmd nvmf_subsystem_allow_any_host nqn.2016-06.io.spdk:cnode1 00:11:14.068 22:49:04 -- common/autotest_common.sh@551 -- # xtrace_disable 00:11:14.068 22:49:04 -- common/autotest_common.sh@10 -- # set +x 00:11:14.068 22:49:04 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:11:14.068 22:49:04 -- target/rpc.sh@105 -- # rpc_cmd nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:11:14.068 22:49:04 -- common/autotest_common.sh@551 -- # xtrace_disable 00:11:14.068 22:49:04 -- common/autotest_common.sh@10 -- # set +x 00:11:14.068 22:49:04 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:11:14.068 22:49:04 -- target/rpc.sh@107 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:11:14.068 22:49:04 -- common/autotest_common.sh@551 -- # xtrace_disable 00:11:14.068 22:49:04 -- common/autotest_common.sh@10 -- # set +x 00:11:14.068 22:49:04 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:11:14.068 22:49:04 -- target/rpc.sh@99 -- # for i in $(seq 1 $loops) 00:11:14.068 22:49:04 -- target/rpc.sh@100 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDKISFASTANDAWESOME 00:11:14.068 22:49:04 -- common/autotest_common.sh@551 -- # xtrace_disable 00:11:14.068 22:49:04 -- common/autotest_common.sh@10 -- # set +x 00:11:14.068 22:49:04 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:11:14.068 22:49:04 -- target/rpc.sh@101 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:11:14.068 22:49:04 -- common/autotest_common.sh@551 -- # xtrace_disable 00:11:14.068 22:49:04 -- common/autotest_common.sh@10 -- # set +x 00:11:14.068 [2024-04-16 22:49:04.832801] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:11:14.068 22:49:04 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:11:14.068 22:49:04 -- target/rpc.sh@102 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:11:14.068 22:49:04 -- common/autotest_common.sh@551 -- # xtrace_disable 00:11:14.068 22:49:04 -- common/autotest_common.sh@10 -- # set +x 00:11:14.068 22:49:04 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:11:14.068 22:49:04 -- target/rpc.sh@103 -- # rpc_cmd nvmf_subsystem_allow_any_host nqn.2016-06.io.spdk:cnode1 00:11:14.068 22:49:04 -- common/autotest_common.sh@551 -- # xtrace_disable 00:11:14.068 22:49:04 -- common/autotest_common.sh@10 -- # set +x 00:11:14.068 22:49:04 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:11:14.068 22:49:04 -- target/rpc.sh@105 -- # rpc_cmd nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:11:14.068 22:49:04 -- common/autotest_common.sh@551 -- # xtrace_disable 00:11:14.068 22:49:04 -- common/autotest_common.sh@10 -- # set +x 00:11:14.068 22:49:04 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:11:14.068 22:49:04 -- target/rpc.sh@107 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:11:14.068 22:49:04 -- common/autotest_common.sh@551 -- # xtrace_disable 00:11:14.068 22:49:04 -- common/autotest_common.sh@10 -- # set +x 00:11:14.068 22:49:04 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:11:14.068 22:49:04 -- target/rpc.sh@99 -- # for i in $(seq 1 $loops) 00:11:14.068 22:49:04 -- target/rpc.sh@100 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDKISFASTANDAWESOME 00:11:14.068 22:49:04 -- common/autotest_common.sh@551 -- # xtrace_disable 00:11:14.068 22:49:04 -- common/autotest_common.sh@10 -- # set +x 00:11:14.068 22:49:04 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:11:14.068 22:49:04 -- target/rpc.sh@101 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:11:14.068 22:49:04 -- common/autotest_common.sh@551 -- # xtrace_disable 00:11:14.068 22:49:04 -- common/autotest_common.sh@10 -- # set +x 00:11:14.068 [2024-04-16 22:49:04.880955] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:11:14.068 22:49:04 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:11:14.068 22:49:04 -- target/rpc.sh@102 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:11:14.068 22:49:04 -- common/autotest_common.sh@551 -- # xtrace_disable 00:11:14.068 22:49:04 -- common/autotest_common.sh@10 -- # set +x 00:11:14.068 22:49:04 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:11:14.068 22:49:04 -- target/rpc.sh@103 -- # rpc_cmd nvmf_subsystem_allow_any_host nqn.2016-06.io.spdk:cnode1 00:11:14.068 22:49:04 -- common/autotest_common.sh@551 -- # xtrace_disable 00:11:14.068 22:49:04 -- common/autotest_common.sh@10 -- # set +x 00:11:14.068 22:49:04 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:11:14.068 22:49:04 -- target/rpc.sh@105 -- # rpc_cmd nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:11:14.068 22:49:04 -- common/autotest_common.sh@551 -- # xtrace_disable 00:11:14.068 22:49:04 -- common/autotest_common.sh@10 -- # set +x 00:11:14.068 22:49:04 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:11:14.068 22:49:04 -- target/rpc.sh@107 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:11:14.068 22:49:04 -- common/autotest_common.sh@551 -- # xtrace_disable 00:11:14.068 22:49:04 -- common/autotest_common.sh@10 -- # set +x 00:11:14.068 22:49:04 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:11:14.068 22:49:04 -- target/rpc.sh@110 -- # rpc_cmd nvmf_get_stats 00:11:14.068 22:49:04 -- common/autotest_common.sh@551 -- # xtrace_disable 00:11:14.068 22:49:04 -- common/autotest_common.sh@10 -- # set +x 00:11:14.068 22:49:04 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:11:14.068 22:49:04 -- target/rpc.sh@110 -- # stats='{ 00:11:14.068 "tick_rate": 2700000000, 00:11:14.068 "poll_groups": [ 00:11:14.068 { 00:11:14.068 "name": "nvmf_tgt_poll_group_0", 00:11:14.068 "admin_qpairs": 2, 00:11:14.068 "io_qpairs": 84, 00:11:14.068 "current_admin_qpairs": 0, 00:11:14.068 "current_io_qpairs": 0, 00:11:14.068 "pending_bdev_io": 0, 00:11:14.068 "completed_nvme_io": 233, 00:11:14.068 "transports": [ 00:11:14.068 { 00:11:14.068 "trtype": "TCP" 00:11:14.068 } 00:11:14.068 ] 00:11:14.068 }, 00:11:14.068 { 00:11:14.068 "name": "nvmf_tgt_poll_group_1", 00:11:14.068 "admin_qpairs": 2, 00:11:14.068 "io_qpairs": 84, 00:11:14.068 "current_admin_qpairs": 0, 00:11:14.068 "current_io_qpairs": 0, 00:11:14.068 "pending_bdev_io": 0, 00:11:14.068 "completed_nvme_io": 178, 00:11:14.068 "transports": [ 00:11:14.068 { 00:11:14.068 "trtype": "TCP" 00:11:14.068 } 00:11:14.068 ] 00:11:14.068 }, 00:11:14.068 { 00:11:14.068 "name": "nvmf_tgt_poll_group_2", 00:11:14.068 "admin_qpairs": 1, 00:11:14.068 "io_qpairs": 84, 00:11:14.068 "current_admin_qpairs": 0, 00:11:14.068 "current_io_qpairs": 0, 00:11:14.068 "pending_bdev_io": 0, 00:11:14.068 "completed_nvme_io": 184, 00:11:14.068 "transports": [ 00:11:14.068 { 00:11:14.068 "trtype": "TCP" 00:11:14.068 } 00:11:14.068 ] 00:11:14.068 }, 00:11:14.068 { 00:11:14.068 "name": "nvmf_tgt_poll_group_3", 00:11:14.068 "admin_qpairs": 2, 00:11:14.068 "io_qpairs": 84, 00:11:14.068 "current_admin_qpairs": 0, 00:11:14.068 "current_io_qpairs": 0, 00:11:14.068 "pending_bdev_io": 0, 00:11:14.068 "completed_nvme_io": 91, 00:11:14.068 "transports": [ 00:11:14.068 { 00:11:14.068 "trtype": "TCP" 00:11:14.068 } 00:11:14.068 ] 00:11:14.068 } 00:11:14.068 ] 00:11:14.068 }' 00:11:14.068 22:49:04 -- target/rpc.sh@112 -- # jsum '.poll_groups[].admin_qpairs' 00:11:14.068 22:49:04 -- target/rpc.sh@19 -- # local 'filter=.poll_groups[].admin_qpairs' 00:11:14.068 22:49:04 -- target/rpc.sh@20 -- # jq '.poll_groups[].admin_qpairs' 00:11:14.068 22:49:04 -- target/rpc.sh@20 -- # awk '{s+=$1}END{print s}' 00:11:14.068 22:49:04 -- target/rpc.sh@112 -- # (( 7 > 0 )) 00:11:14.068 22:49:04 -- target/rpc.sh@113 -- # jsum '.poll_groups[].io_qpairs' 00:11:14.068 22:49:04 -- target/rpc.sh@19 -- # local 'filter=.poll_groups[].io_qpairs' 00:11:14.068 22:49:04 -- target/rpc.sh@20 -- # jq '.poll_groups[].io_qpairs' 00:11:14.068 22:49:04 -- target/rpc.sh@20 -- # awk '{s+=$1}END{print s}' 00:11:14.068 22:49:05 -- target/rpc.sh@113 -- # (( 336 > 0 )) 00:11:14.068 22:49:05 -- target/rpc.sh@115 -- # '[' rdma == tcp ']' 00:11:14.068 22:49:05 -- target/rpc.sh@121 -- # trap - SIGINT SIGTERM EXIT 00:11:14.068 22:49:05 -- target/rpc.sh@123 -- # nvmftestfini 00:11:14.068 22:49:05 -- nvmf/common.sh@476 -- # nvmfcleanup 00:11:14.068 22:49:05 -- nvmf/common.sh@116 -- # sync 00:11:14.068 22:49:05 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:11:14.068 22:49:05 -- nvmf/common.sh@119 -- # set +e 00:11:14.068 22:49:05 -- nvmf/common.sh@120 -- # for i in {1..20} 00:11:14.068 22:49:05 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:11:14.068 rmmod nvme_tcp 00:11:14.068 rmmod nvme_fabrics 00:11:14.068 rmmod nvme_keyring 00:11:14.068 22:49:05 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:11:14.068 22:49:05 -- nvmf/common.sh@123 -- # set -e 00:11:14.068 22:49:05 -- nvmf/common.sh@124 -- # return 0 00:11:14.068 22:49:05 -- nvmf/common.sh@477 -- # '[' -n 219868 ']' 00:11:14.068 22:49:05 -- nvmf/common.sh@478 -- # killprocess 219868 00:11:14.068 22:49:05 -- common/autotest_common.sh@926 -- # '[' -z 219868 ']' 00:11:14.068 22:49:05 -- common/autotest_common.sh@930 -- # kill -0 219868 00:11:14.068 22:49:05 -- common/autotest_common.sh@931 -- # uname 00:11:14.068 22:49:05 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:11:14.068 22:49:05 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 219868 00:11:14.068 22:49:05 -- common/autotest_common.sh@932 -- # process_name=reactor_0 00:11:14.068 22:49:05 -- common/autotest_common.sh@936 -- # '[' reactor_0 = sudo ']' 00:11:14.068 22:49:05 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 219868' 00:11:14.068 killing process with pid 219868 00:11:14.069 22:49:05 -- common/autotest_common.sh@945 -- # kill 219868 00:11:14.069 22:49:05 -- common/autotest_common.sh@950 -- # wait 219868 00:11:14.327 22:49:05 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:11:14.327 22:49:05 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:11:14.327 22:49:05 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:11:14.327 22:49:05 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:11:14.327 22:49:05 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:11:14.327 22:49:05 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:11:14.327 22:49:05 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:11:14.327 22:49:05 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:11:16.862 22:49:07 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:11:16.862 00:11:16.862 real 0m25.582s 00:11:16.862 user 1m23.481s 00:11:16.862 sys 0m3.783s 00:11:16.862 22:49:07 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:11:16.862 22:49:07 -- common/autotest_common.sh@10 -- # set +x 00:11:16.862 ************************************ 00:11:16.862 END TEST nvmf_rpc 00:11:16.862 ************************************ 00:11:16.862 22:49:07 -- nvmf/nvmf.sh@30 -- # run_test nvmf_invalid /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/invalid.sh --transport=tcp 00:11:16.862 22:49:07 -- common/autotest_common.sh@1077 -- # '[' 3 -le 1 ']' 00:11:16.862 22:49:07 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:11:16.862 22:49:07 -- common/autotest_common.sh@10 -- # set +x 00:11:16.862 ************************************ 00:11:16.862 START TEST nvmf_invalid 00:11:16.862 ************************************ 00:11:16.862 22:49:07 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/invalid.sh --transport=tcp 00:11:16.862 * Looking for test storage... 00:11:16.862 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:11:16.862 22:49:07 -- target/invalid.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:11:16.862 22:49:07 -- nvmf/common.sh@7 -- # uname -s 00:11:16.862 22:49:07 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:11:16.862 22:49:07 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:11:16.862 22:49:07 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:11:16.862 22:49:07 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:11:16.862 22:49:07 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:11:16.862 22:49:07 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:11:16.862 22:49:07 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:11:16.862 22:49:07 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:11:16.862 22:49:07 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:11:16.862 22:49:07 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:11:16.862 22:49:07 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:11:16.862 22:49:07 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:11:16.862 22:49:07 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:11:16.862 22:49:07 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:11:16.862 22:49:07 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:11:16.862 22:49:07 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:11:16.862 22:49:07 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:11:16.863 22:49:07 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:11:16.863 22:49:07 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:11:16.863 22:49:07 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:11:16.863 22:49:07 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:11:16.863 22:49:07 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:11:16.863 22:49:07 -- paths/export.sh@5 -- # export PATH 00:11:16.863 22:49:07 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:11:16.863 22:49:07 -- nvmf/common.sh@46 -- # : 0 00:11:16.863 22:49:07 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:11:16.863 22:49:07 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:11:16.863 22:49:07 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:11:16.863 22:49:07 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:11:16.863 22:49:07 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:11:16.863 22:49:07 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:11:16.863 22:49:07 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:11:16.863 22:49:07 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:11:16.863 22:49:07 -- target/invalid.sh@11 -- # multi_target_rpc=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/multitarget_rpc.py 00:11:16.863 22:49:07 -- target/invalid.sh@12 -- # rpc=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:11:16.863 22:49:07 -- target/invalid.sh@13 -- # nqn=nqn.2016-06.io.spdk:cnode 00:11:16.863 22:49:07 -- target/invalid.sh@14 -- # target=foobar 00:11:16.863 22:49:07 -- target/invalid.sh@16 -- # RANDOM=0 00:11:16.863 22:49:07 -- target/invalid.sh@34 -- # nvmftestinit 00:11:16.863 22:49:07 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:11:16.863 22:49:07 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:11:16.863 22:49:07 -- nvmf/common.sh@436 -- # prepare_net_devs 00:11:16.863 22:49:07 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:11:16.863 22:49:07 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:11:16.863 22:49:07 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:11:16.863 22:49:07 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:11:16.863 22:49:07 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:11:16.863 22:49:07 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:11:16.863 22:49:07 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:11:16.863 22:49:07 -- nvmf/common.sh@284 -- # xtrace_disable 00:11:16.863 22:49:07 -- common/autotest_common.sh@10 -- # set +x 00:11:18.763 22:49:09 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:11:18.763 22:49:09 -- nvmf/common.sh@290 -- # pci_devs=() 00:11:18.763 22:49:09 -- nvmf/common.sh@290 -- # local -a pci_devs 00:11:18.763 22:49:09 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:11:18.763 22:49:09 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:11:18.763 22:49:09 -- nvmf/common.sh@292 -- # pci_drivers=() 00:11:18.763 22:49:09 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:11:18.763 22:49:09 -- nvmf/common.sh@294 -- # net_devs=() 00:11:18.763 22:49:09 -- nvmf/common.sh@294 -- # local -ga net_devs 00:11:18.763 22:49:09 -- nvmf/common.sh@295 -- # e810=() 00:11:18.763 22:49:09 -- nvmf/common.sh@295 -- # local -ga e810 00:11:18.763 22:49:09 -- nvmf/common.sh@296 -- # x722=() 00:11:18.763 22:49:09 -- nvmf/common.sh@296 -- # local -ga x722 00:11:18.763 22:49:09 -- nvmf/common.sh@297 -- # mlx=() 00:11:18.763 22:49:09 -- nvmf/common.sh@297 -- # local -ga mlx 00:11:18.763 22:49:09 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:11:18.763 22:49:09 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:11:18.763 22:49:09 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:11:18.763 22:49:09 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:11:18.763 22:49:09 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:11:18.763 22:49:09 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:11:18.763 22:49:09 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:11:18.763 22:49:09 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:11:18.763 22:49:09 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:11:18.763 22:49:09 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:11:18.763 22:49:09 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:11:18.763 22:49:09 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:11:18.763 22:49:09 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:11:18.763 22:49:09 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:11:18.763 22:49:09 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:11:18.763 22:49:09 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:11:18.763 22:49:09 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:11:18.763 22:49:09 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:11:18.763 22:49:09 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:11:18.763 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:11:18.763 22:49:09 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:11:18.763 22:49:09 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:11:18.763 22:49:09 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:11:18.763 22:49:09 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:11:18.763 22:49:09 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:11:18.763 22:49:09 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:11:18.763 22:49:09 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:11:18.763 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:11:18.763 22:49:09 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:11:18.763 22:49:09 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:11:18.763 22:49:09 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:11:18.763 22:49:09 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:11:18.763 22:49:09 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:11:18.763 22:49:09 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:11:18.763 22:49:09 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:11:18.763 22:49:09 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:11:18.763 22:49:09 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:11:18.763 22:49:09 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:11:18.763 22:49:09 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:11:18.763 22:49:09 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:11:18.763 22:49:09 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:11:18.763 Found net devices under 0000:0a:00.0: cvl_0_0 00:11:18.763 22:49:09 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:11:18.763 22:49:09 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:11:18.763 22:49:09 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:11:18.763 22:49:09 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:11:18.763 22:49:09 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:11:18.763 22:49:09 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:11:18.763 Found net devices under 0000:0a:00.1: cvl_0_1 00:11:18.763 22:49:09 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:11:18.763 22:49:09 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:11:18.763 22:49:09 -- nvmf/common.sh@402 -- # is_hw=yes 00:11:18.763 22:49:09 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:11:18.763 22:49:09 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:11:18.763 22:49:09 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:11:18.763 22:49:09 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:11:18.763 22:49:09 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:11:18.763 22:49:09 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:11:18.763 22:49:09 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:11:18.763 22:49:09 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:11:18.763 22:49:09 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:11:18.763 22:49:09 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:11:18.763 22:49:09 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:11:18.763 22:49:09 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:11:18.763 22:49:09 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:11:18.763 22:49:09 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:11:18.763 22:49:09 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:11:18.763 22:49:09 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:11:18.763 22:49:09 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:11:18.763 22:49:09 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:11:18.763 22:49:09 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:11:18.763 22:49:09 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:11:18.763 22:49:09 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:11:18.763 22:49:09 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:11:18.763 22:49:09 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:11:18.763 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:11:18.763 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.203 ms 00:11:18.763 00:11:18.763 --- 10.0.0.2 ping statistics --- 00:11:18.763 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:11:18.763 rtt min/avg/max/mdev = 0.203/0.203/0.203/0.000 ms 00:11:18.763 22:49:09 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:11:18.763 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:11:18.764 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.058 ms 00:11:18.764 00:11:18.764 --- 10.0.0.1 ping statistics --- 00:11:18.764 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:11:18.764 rtt min/avg/max/mdev = 0.058/0.058/0.058/0.000 ms 00:11:18.764 22:49:09 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:11:18.764 22:49:09 -- nvmf/common.sh@410 -- # return 0 00:11:18.764 22:49:09 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:11:18.764 22:49:09 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:11:18.764 22:49:09 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:11:18.764 22:49:09 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:11:18.764 22:49:09 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:11:18.764 22:49:09 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:11:18.764 22:49:09 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:11:18.764 22:49:09 -- target/invalid.sh@35 -- # nvmfappstart -m 0xF 00:11:18.764 22:49:09 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:11:18.764 22:49:09 -- common/autotest_common.sh@712 -- # xtrace_disable 00:11:18.764 22:49:09 -- common/autotest_common.sh@10 -- # set +x 00:11:18.764 22:49:09 -- nvmf/common.sh@469 -- # nvmfpid=224451 00:11:18.764 22:49:09 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:11:18.764 22:49:09 -- nvmf/common.sh@470 -- # waitforlisten 224451 00:11:18.764 22:49:09 -- common/autotest_common.sh@819 -- # '[' -z 224451 ']' 00:11:18.764 22:49:09 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk.sock 00:11:18.764 22:49:09 -- common/autotest_common.sh@824 -- # local max_retries=100 00:11:18.764 22:49:09 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:11:18.764 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:11:18.764 22:49:09 -- common/autotest_common.sh@828 -- # xtrace_disable 00:11:18.764 22:49:09 -- common/autotest_common.sh@10 -- # set +x 00:11:18.764 [2024-04-16 22:49:09.813422] Starting SPDK v24.01.1-pre git sha1 4b134b4ab / DPDK 23.11.0 initialization... 00:11:18.764 [2024-04-16 22:49:09.813510] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:11:18.764 EAL: No free 2048 kB hugepages reported on node 1 00:11:18.764 [2024-04-16 22:49:09.876595] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:11:19.022 [2024-04-16 22:49:09.985100] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:11:19.022 [2024-04-16 22:49:09.985273] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:11:19.022 [2024-04-16 22:49:09.985292] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:11:19.022 [2024-04-16 22:49:09.985305] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:11:19.022 [2024-04-16 22:49:09.985362] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:11:19.022 [2024-04-16 22:49:09.985424] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:11:19.022 [2024-04-16 22:49:09.985473] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:11:19.022 [2024-04-16 22:49:09.985475] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:11:19.955 22:49:10 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:11:19.955 22:49:10 -- common/autotest_common.sh@852 -- # return 0 00:11:19.955 22:49:10 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:11:19.956 22:49:10 -- common/autotest_common.sh@718 -- # xtrace_disable 00:11:19.956 22:49:10 -- common/autotest_common.sh@10 -- # set +x 00:11:19.956 22:49:10 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:11:19.956 22:49:10 -- target/invalid.sh@37 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; nvmftestfini $1; exit 1' SIGINT SIGTERM EXIT 00:11:19.956 22:49:10 -- target/invalid.sh@40 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem -t foobar nqn.2016-06.io.spdk:cnode9118 00:11:19.956 [2024-04-16 22:49:11.059519] nvmf_rpc.c: 401:rpc_nvmf_create_subsystem: *ERROR*: Unable to find target foobar 00:11:19.956 22:49:11 -- target/invalid.sh@40 -- # out='request: 00:11:19.956 { 00:11:19.956 "nqn": "nqn.2016-06.io.spdk:cnode9118", 00:11:19.956 "tgt_name": "foobar", 00:11:19.956 "method": "nvmf_create_subsystem", 00:11:19.956 "req_id": 1 00:11:19.956 } 00:11:19.956 Got JSON-RPC error response 00:11:19.956 response: 00:11:19.956 { 00:11:19.956 "code": -32603, 00:11:19.956 "message": "Unable to find target foobar" 00:11:19.956 }' 00:11:19.956 22:49:11 -- target/invalid.sh@41 -- # [[ request: 00:11:19.956 { 00:11:19.956 "nqn": "nqn.2016-06.io.spdk:cnode9118", 00:11:19.956 "tgt_name": "foobar", 00:11:19.956 "method": "nvmf_create_subsystem", 00:11:19.956 "req_id": 1 00:11:19.956 } 00:11:19.956 Got JSON-RPC error response 00:11:19.956 response: 00:11:19.956 { 00:11:19.956 "code": -32603, 00:11:19.956 "message": "Unable to find target foobar" 00:11:19.956 } == *\U\n\a\b\l\e\ \t\o\ \f\i\n\d\ \t\a\r\g\e\t* ]] 00:11:19.956 22:49:11 -- target/invalid.sh@45 -- # echo -e '\x1f' 00:11:19.956 22:49:11 -- target/invalid.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem -s $'SPDKISFASTANDAWESOME\037' nqn.2016-06.io.spdk:cnode17580 00:11:20.213 [2024-04-16 22:49:11.308368] nvmf_rpc.c: 418:rpc_nvmf_create_subsystem: *ERROR*: Subsystem nqn.2016-06.io.spdk:cnode17580: invalid serial number 'SPDKISFASTANDAWESOME' 00:11:20.213 22:49:11 -- target/invalid.sh@45 -- # out='request: 00:11:20.214 { 00:11:20.214 "nqn": "nqn.2016-06.io.spdk:cnode17580", 00:11:20.214 "serial_number": "SPDKISFASTANDAWESOME\u001f", 00:11:20.214 "method": "nvmf_create_subsystem", 00:11:20.214 "req_id": 1 00:11:20.214 } 00:11:20.214 Got JSON-RPC error response 00:11:20.214 response: 00:11:20.214 { 00:11:20.214 "code": -32602, 00:11:20.214 "message": "Invalid SN SPDKISFASTANDAWESOME\u001f" 00:11:20.214 }' 00:11:20.214 22:49:11 -- target/invalid.sh@46 -- # [[ request: 00:11:20.214 { 00:11:20.214 "nqn": "nqn.2016-06.io.spdk:cnode17580", 00:11:20.214 "serial_number": "SPDKISFASTANDAWESOME\u001f", 00:11:20.214 "method": "nvmf_create_subsystem", 00:11:20.214 "req_id": 1 00:11:20.214 } 00:11:20.214 Got JSON-RPC error response 00:11:20.214 response: 00:11:20.214 { 00:11:20.214 "code": -32602, 00:11:20.214 "message": "Invalid SN SPDKISFASTANDAWESOME\u001f" 00:11:20.214 } == *\I\n\v\a\l\i\d\ \S\N* ]] 00:11:20.214 22:49:11 -- target/invalid.sh@50 -- # echo -e '\x1f' 00:11:20.214 22:49:11 -- target/invalid.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem -d $'SPDK_Controller\037' nqn.2016-06.io.spdk:cnode30654 00:11:20.472 [2024-04-16 22:49:11.549133] nvmf_rpc.c: 427:rpc_nvmf_create_subsystem: *ERROR*: Subsystem nqn.2016-06.io.spdk:cnode30654: invalid model number 'SPDK_Controller' 00:11:20.472 22:49:11 -- target/invalid.sh@50 -- # out='request: 00:11:20.472 { 00:11:20.472 "nqn": "nqn.2016-06.io.spdk:cnode30654", 00:11:20.472 "model_number": "SPDK_Controller\u001f", 00:11:20.472 "method": "nvmf_create_subsystem", 00:11:20.472 "req_id": 1 00:11:20.472 } 00:11:20.472 Got JSON-RPC error response 00:11:20.472 response: 00:11:20.472 { 00:11:20.472 "code": -32602, 00:11:20.472 "message": "Invalid MN SPDK_Controller\u001f" 00:11:20.472 }' 00:11:20.472 22:49:11 -- target/invalid.sh@51 -- # [[ request: 00:11:20.472 { 00:11:20.472 "nqn": "nqn.2016-06.io.spdk:cnode30654", 00:11:20.472 "model_number": "SPDK_Controller\u001f", 00:11:20.472 "method": "nvmf_create_subsystem", 00:11:20.472 "req_id": 1 00:11:20.472 } 00:11:20.472 Got JSON-RPC error response 00:11:20.472 response: 00:11:20.472 { 00:11:20.472 "code": -32602, 00:11:20.472 "message": "Invalid MN SPDK_Controller\u001f" 00:11:20.472 } == *\I\n\v\a\l\i\d\ \M\N* ]] 00:11:20.472 22:49:11 -- target/invalid.sh@54 -- # gen_random_s 21 00:11:20.472 22:49:11 -- target/invalid.sh@19 -- # local length=21 ll 00:11:20.472 22:49:11 -- target/invalid.sh@21 -- # chars=('32' '33' '34' '35' '36' '37' '38' '39' '40' '41' '42' '43' '44' '45' '46' '47' '48' '49' '50' '51' '52' '53' '54' '55' '56' '57' '58' '59' '60' '61' '62' '63' '64' '65' '66' '67' '68' '69' '70' '71' '72' '73' '74' '75' '76' '77' '78' '79' '80' '81' '82' '83' '84' '85' '86' '87' '88' '89' '90' '91' '92' '93' '94' '95' '96' '97' '98' '99' '100' '101' '102' '103' '104' '105' '106' '107' '108' '109' '110' '111' '112' '113' '114' '115' '116' '117' '118' '119' '120' '121' '122' '123' '124' '125' '126' '127') 00:11:20.472 22:49:11 -- target/invalid.sh@21 -- # local chars 00:11:20.472 22:49:11 -- target/invalid.sh@22 -- # local string 00:11:20.472 22:49:11 -- target/invalid.sh@24 -- # (( ll = 0 )) 00:11:20.472 22:49:11 -- target/invalid.sh@24 -- # (( ll < length )) 00:11:20.472 22:49:11 -- target/invalid.sh@25 -- # printf %x 100 00:11:20.472 22:49:11 -- target/invalid.sh@25 -- # echo -e '\x64' 00:11:20.472 22:49:11 -- target/invalid.sh@25 -- # string+=d 00:11:20.472 22:49:11 -- target/invalid.sh@24 -- # (( ll++ )) 00:11:20.472 22:49:11 -- target/invalid.sh@24 -- # (( ll < length )) 00:11:20.472 22:49:11 -- target/invalid.sh@25 -- # printf %x 84 00:11:20.472 22:49:11 -- target/invalid.sh@25 -- # echo -e '\x54' 00:11:20.472 22:49:11 -- target/invalid.sh@25 -- # string+=T 00:11:20.472 22:49:11 -- target/invalid.sh@24 -- # (( ll++ )) 00:11:20.472 22:49:11 -- target/invalid.sh@24 -- # (( ll < length )) 00:11:20.472 22:49:11 -- target/invalid.sh@25 -- # printf %x 98 00:11:20.472 22:49:11 -- target/invalid.sh@25 -- # echo -e '\x62' 00:11:20.472 22:49:11 -- target/invalid.sh@25 -- # string+=b 00:11:20.472 22:49:11 -- target/invalid.sh@24 -- # (( ll++ )) 00:11:20.472 22:49:11 -- target/invalid.sh@24 -- # (( ll < length )) 00:11:20.472 22:49:11 -- target/invalid.sh@25 -- # printf %x 74 00:11:20.472 22:49:11 -- target/invalid.sh@25 -- # echo -e '\x4a' 00:11:20.472 22:49:11 -- target/invalid.sh@25 -- # string+=J 00:11:20.472 22:49:11 -- target/invalid.sh@24 -- # (( ll++ )) 00:11:20.472 22:49:11 -- target/invalid.sh@24 -- # (( ll < length )) 00:11:20.472 22:49:11 -- target/invalid.sh@25 -- # printf %x 43 00:11:20.472 22:49:11 -- target/invalid.sh@25 -- # echo -e '\x2b' 00:11:20.472 22:49:11 -- target/invalid.sh@25 -- # string+=+ 00:11:20.472 22:49:11 -- target/invalid.sh@24 -- # (( ll++ )) 00:11:20.472 22:49:11 -- target/invalid.sh@24 -- # (( ll < length )) 00:11:20.472 22:49:11 -- target/invalid.sh@25 -- # printf %x 104 00:11:20.472 22:49:11 -- target/invalid.sh@25 -- # echo -e '\x68' 00:11:20.472 22:49:11 -- target/invalid.sh@25 -- # string+=h 00:11:20.472 22:49:11 -- target/invalid.sh@24 -- # (( ll++ )) 00:11:20.472 22:49:11 -- target/invalid.sh@24 -- # (( ll < length )) 00:11:20.472 22:49:11 -- target/invalid.sh@25 -- # printf %x 99 00:11:20.473 22:49:11 -- target/invalid.sh@25 -- # echo -e '\x63' 00:11:20.473 22:49:11 -- target/invalid.sh@25 -- # string+=c 00:11:20.473 22:49:11 -- target/invalid.sh@24 -- # (( ll++ )) 00:11:20.473 22:49:11 -- target/invalid.sh@24 -- # (( ll < length )) 00:11:20.473 22:49:11 -- target/invalid.sh@25 -- # printf %x 43 00:11:20.473 22:49:11 -- target/invalid.sh@25 -- # echo -e '\x2b' 00:11:20.473 22:49:11 -- target/invalid.sh@25 -- # string+=+ 00:11:20.473 22:49:11 -- target/invalid.sh@24 -- # (( ll++ )) 00:11:20.473 22:49:11 -- target/invalid.sh@24 -- # (( ll < length )) 00:11:20.731 22:49:11 -- target/invalid.sh@25 -- # printf %x 58 00:11:20.731 22:49:11 -- target/invalid.sh@25 -- # echo -e '\x3a' 00:11:20.731 22:49:11 -- target/invalid.sh@25 -- # string+=: 00:11:20.731 22:49:11 -- target/invalid.sh@24 -- # (( ll++ )) 00:11:20.731 22:49:11 -- target/invalid.sh@24 -- # (( ll < length )) 00:11:20.731 22:49:11 -- target/invalid.sh@25 -- # printf %x 120 00:11:20.731 22:49:11 -- target/invalid.sh@25 -- # echo -e '\x78' 00:11:20.731 22:49:11 -- target/invalid.sh@25 -- # string+=x 00:11:20.731 22:49:11 -- target/invalid.sh@24 -- # (( ll++ )) 00:11:20.731 22:49:11 -- target/invalid.sh@24 -- # (( ll < length )) 00:11:20.731 22:49:11 -- target/invalid.sh@25 -- # printf %x 120 00:11:20.731 22:49:11 -- target/invalid.sh@25 -- # echo -e '\x78' 00:11:20.731 22:49:11 -- target/invalid.sh@25 -- # string+=x 00:11:20.731 22:49:11 -- target/invalid.sh@24 -- # (( ll++ )) 00:11:20.731 22:49:11 -- target/invalid.sh@24 -- # (( ll < length )) 00:11:20.731 22:49:11 -- target/invalid.sh@25 -- # printf %x 93 00:11:20.731 22:49:11 -- target/invalid.sh@25 -- # echo -e '\x5d' 00:11:20.731 22:49:11 -- target/invalid.sh@25 -- # string+=']' 00:11:20.731 22:49:11 -- target/invalid.sh@24 -- # (( ll++ )) 00:11:20.731 22:49:11 -- target/invalid.sh@24 -- # (( ll < length )) 00:11:20.731 22:49:11 -- target/invalid.sh@25 -- # printf %x 81 00:11:20.731 22:49:11 -- target/invalid.sh@25 -- # echo -e '\x51' 00:11:20.731 22:49:11 -- target/invalid.sh@25 -- # string+=Q 00:11:20.731 22:49:11 -- target/invalid.sh@24 -- # (( ll++ )) 00:11:20.731 22:49:11 -- target/invalid.sh@24 -- # (( ll < length )) 00:11:20.731 22:49:11 -- target/invalid.sh@25 -- # printf %x 93 00:11:20.731 22:49:11 -- target/invalid.sh@25 -- # echo -e '\x5d' 00:11:20.731 22:49:11 -- target/invalid.sh@25 -- # string+=']' 00:11:20.731 22:49:11 -- target/invalid.sh@24 -- # (( ll++ )) 00:11:20.731 22:49:11 -- target/invalid.sh@24 -- # (( ll < length )) 00:11:20.731 22:49:11 -- target/invalid.sh@25 -- # printf %x 58 00:11:20.731 22:49:11 -- target/invalid.sh@25 -- # echo -e '\x3a' 00:11:20.731 22:49:11 -- target/invalid.sh@25 -- # string+=: 00:11:20.731 22:49:11 -- target/invalid.sh@24 -- # (( ll++ )) 00:11:20.731 22:49:11 -- target/invalid.sh@24 -- # (( ll < length )) 00:11:20.731 22:49:11 -- target/invalid.sh@25 -- # printf %x 39 00:11:20.731 22:49:11 -- target/invalid.sh@25 -- # echo -e '\x27' 00:11:20.731 22:49:11 -- target/invalid.sh@25 -- # string+=\' 00:11:20.731 22:49:11 -- target/invalid.sh@24 -- # (( ll++ )) 00:11:20.731 22:49:11 -- target/invalid.sh@24 -- # (( ll < length )) 00:11:20.731 22:49:11 -- target/invalid.sh@25 -- # printf %x 111 00:11:20.731 22:49:11 -- target/invalid.sh@25 -- # echo -e '\x6f' 00:11:20.731 22:49:11 -- target/invalid.sh@25 -- # string+=o 00:11:20.731 22:49:11 -- target/invalid.sh@24 -- # (( ll++ )) 00:11:20.731 22:49:11 -- target/invalid.sh@24 -- # (( ll < length )) 00:11:20.731 22:49:11 -- target/invalid.sh@25 -- # printf %x 110 00:11:20.731 22:49:11 -- target/invalid.sh@25 -- # echo -e '\x6e' 00:11:20.731 22:49:11 -- target/invalid.sh@25 -- # string+=n 00:11:20.731 22:49:11 -- target/invalid.sh@24 -- # (( ll++ )) 00:11:20.731 22:49:11 -- target/invalid.sh@24 -- # (( ll < length )) 00:11:20.731 22:49:11 -- target/invalid.sh@25 -- # printf %x 111 00:11:20.731 22:49:11 -- target/invalid.sh@25 -- # echo -e '\x6f' 00:11:20.731 22:49:11 -- target/invalid.sh@25 -- # string+=o 00:11:20.731 22:49:11 -- target/invalid.sh@24 -- # (( ll++ )) 00:11:20.731 22:49:11 -- target/invalid.sh@24 -- # (( ll < length )) 00:11:20.731 22:49:11 -- target/invalid.sh@25 -- # printf %x 58 00:11:20.731 22:49:11 -- target/invalid.sh@25 -- # echo -e '\x3a' 00:11:20.731 22:49:11 -- target/invalid.sh@25 -- # string+=: 00:11:20.731 22:49:11 -- target/invalid.sh@24 -- # (( ll++ )) 00:11:20.731 22:49:11 -- target/invalid.sh@24 -- # (( ll < length )) 00:11:20.731 22:49:11 -- target/invalid.sh@25 -- # printf %x 111 00:11:20.731 22:49:11 -- target/invalid.sh@25 -- # echo -e '\x6f' 00:11:20.731 22:49:11 -- target/invalid.sh@25 -- # string+=o 00:11:20.731 22:49:11 -- target/invalid.sh@24 -- # (( ll++ )) 00:11:20.731 22:49:11 -- target/invalid.sh@24 -- # (( ll < length )) 00:11:20.731 22:49:11 -- target/invalid.sh@28 -- # [[ d == \- ]] 00:11:20.731 22:49:11 -- target/invalid.sh@31 -- # echo 'dTbJ+hc+:xx]Q]:'\''ono:o' 00:11:20.731 22:49:11 -- target/invalid.sh@54 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem -s 'dTbJ+hc+:xx]Q]:'\''ono:o' nqn.2016-06.io.spdk:cnode14545 00:11:20.731 [2024-04-16 22:49:11.858122] nvmf_rpc.c: 418:rpc_nvmf_create_subsystem: *ERROR*: Subsystem nqn.2016-06.io.spdk:cnode14545: invalid serial number 'dTbJ+hc+:xx]Q]:'ono:o' 00:11:21.017 22:49:11 -- target/invalid.sh@54 -- # out='request: 00:11:21.017 { 00:11:21.017 "nqn": "nqn.2016-06.io.spdk:cnode14545", 00:11:21.017 "serial_number": "dTbJ+hc+:xx]Q]:'\''ono:o", 00:11:21.017 "method": "nvmf_create_subsystem", 00:11:21.017 "req_id": 1 00:11:21.017 } 00:11:21.017 Got JSON-RPC error response 00:11:21.017 response: 00:11:21.017 { 00:11:21.017 "code": -32602, 00:11:21.017 "message": "Invalid SN dTbJ+hc+:xx]Q]:'\''ono:o" 00:11:21.017 }' 00:11:21.017 22:49:11 -- target/invalid.sh@55 -- # [[ request: 00:11:21.017 { 00:11:21.017 "nqn": "nqn.2016-06.io.spdk:cnode14545", 00:11:21.017 "serial_number": "dTbJ+hc+:xx]Q]:'ono:o", 00:11:21.017 "method": "nvmf_create_subsystem", 00:11:21.017 "req_id": 1 00:11:21.017 } 00:11:21.017 Got JSON-RPC error response 00:11:21.017 response: 00:11:21.017 { 00:11:21.017 "code": -32602, 00:11:21.017 "message": "Invalid SN dTbJ+hc+:xx]Q]:'ono:o" 00:11:21.017 } == *\I\n\v\a\l\i\d\ \S\N* ]] 00:11:21.017 22:49:11 -- target/invalid.sh@58 -- # gen_random_s 41 00:11:21.017 22:49:11 -- target/invalid.sh@19 -- # local length=41 ll 00:11:21.017 22:49:11 -- target/invalid.sh@21 -- # chars=('32' '33' '34' '35' '36' '37' '38' '39' '40' '41' '42' '43' '44' '45' '46' '47' '48' '49' '50' '51' '52' '53' '54' '55' '56' '57' '58' '59' '60' '61' '62' '63' '64' '65' '66' '67' '68' '69' '70' '71' '72' '73' '74' '75' '76' '77' '78' '79' '80' '81' '82' '83' '84' '85' '86' '87' '88' '89' '90' '91' '92' '93' '94' '95' '96' '97' '98' '99' '100' '101' '102' '103' '104' '105' '106' '107' '108' '109' '110' '111' '112' '113' '114' '115' '116' '117' '118' '119' '120' '121' '122' '123' '124' '125' '126' '127') 00:11:21.017 22:49:11 -- target/invalid.sh@21 -- # local chars 00:11:21.018 22:49:11 -- target/invalid.sh@22 -- # local string 00:11:21.018 22:49:11 -- target/invalid.sh@24 -- # (( ll = 0 )) 00:11:21.018 22:49:11 -- target/invalid.sh@24 -- # (( ll < length )) 00:11:21.018 22:49:11 -- target/invalid.sh@25 -- # printf %x 63 00:11:21.018 22:49:11 -- target/invalid.sh@25 -- # echo -e '\x3f' 00:11:21.018 22:49:11 -- target/invalid.sh@25 -- # string+='?' 00:11:21.018 22:49:11 -- target/invalid.sh@24 -- # (( ll++ )) 00:11:21.018 22:49:11 -- target/invalid.sh@24 -- # (( ll < length )) 00:11:21.018 22:49:11 -- target/invalid.sh@25 -- # printf %x 83 00:11:21.018 22:49:11 -- target/invalid.sh@25 -- # echo -e '\x53' 00:11:21.018 22:49:11 -- target/invalid.sh@25 -- # string+=S 00:11:21.018 22:49:11 -- target/invalid.sh@24 -- # (( ll++ )) 00:11:21.018 22:49:11 -- target/invalid.sh@24 -- # (( ll < length )) 00:11:21.018 22:49:11 -- target/invalid.sh@25 -- # printf %x 76 00:11:21.018 22:49:11 -- target/invalid.sh@25 -- # echo -e '\x4c' 00:11:21.018 22:49:11 -- target/invalid.sh@25 -- # string+=L 00:11:21.018 22:49:11 -- target/invalid.sh@24 -- # (( ll++ )) 00:11:21.018 22:49:11 -- target/invalid.sh@24 -- # (( ll < length )) 00:11:21.018 22:49:11 -- target/invalid.sh@25 -- # printf %x 93 00:11:21.018 22:49:11 -- target/invalid.sh@25 -- # echo -e '\x5d' 00:11:21.018 22:49:11 -- target/invalid.sh@25 -- # string+=']' 00:11:21.018 22:49:11 -- target/invalid.sh@24 -- # (( ll++ )) 00:11:21.018 22:49:11 -- target/invalid.sh@24 -- # (( ll < length )) 00:11:21.018 22:49:11 -- target/invalid.sh@25 -- # printf %x 121 00:11:21.018 22:49:11 -- target/invalid.sh@25 -- # echo -e '\x79' 00:11:21.018 22:49:11 -- target/invalid.sh@25 -- # string+=y 00:11:21.018 22:49:11 -- target/invalid.sh@24 -- # (( ll++ )) 00:11:21.018 22:49:11 -- target/invalid.sh@24 -- # (( ll < length )) 00:11:21.018 22:49:11 -- target/invalid.sh@25 -- # printf %x 101 00:11:21.018 22:49:11 -- target/invalid.sh@25 -- # echo -e '\x65' 00:11:21.018 22:49:11 -- target/invalid.sh@25 -- # string+=e 00:11:21.018 22:49:11 -- target/invalid.sh@24 -- # (( ll++ )) 00:11:21.018 22:49:11 -- target/invalid.sh@24 -- # (( ll < length )) 00:11:21.018 22:49:11 -- target/invalid.sh@25 -- # printf %x 123 00:11:21.018 22:49:11 -- target/invalid.sh@25 -- # echo -e '\x7b' 00:11:21.018 22:49:11 -- target/invalid.sh@25 -- # string+='{' 00:11:21.018 22:49:11 -- target/invalid.sh@24 -- # (( ll++ )) 00:11:21.018 22:49:11 -- target/invalid.sh@24 -- # (( ll < length )) 00:11:21.018 22:49:11 -- target/invalid.sh@25 -- # printf %x 80 00:11:21.018 22:49:11 -- target/invalid.sh@25 -- # echo -e '\x50' 00:11:21.018 22:49:11 -- target/invalid.sh@25 -- # string+=P 00:11:21.018 22:49:11 -- target/invalid.sh@24 -- # (( ll++ )) 00:11:21.018 22:49:11 -- target/invalid.sh@24 -- # (( ll < length )) 00:11:21.018 22:49:11 -- target/invalid.sh@25 -- # printf %x 122 00:11:21.018 22:49:11 -- target/invalid.sh@25 -- # echo -e '\x7a' 00:11:21.018 22:49:11 -- target/invalid.sh@25 -- # string+=z 00:11:21.018 22:49:11 -- target/invalid.sh@24 -- # (( ll++ )) 00:11:21.018 22:49:11 -- target/invalid.sh@24 -- # (( ll < length )) 00:11:21.018 22:49:11 -- target/invalid.sh@25 -- # printf %x 95 00:11:21.018 22:49:11 -- target/invalid.sh@25 -- # echo -e '\x5f' 00:11:21.018 22:49:11 -- target/invalid.sh@25 -- # string+=_ 00:11:21.018 22:49:11 -- target/invalid.sh@24 -- # (( ll++ )) 00:11:21.018 22:49:11 -- target/invalid.sh@24 -- # (( ll < length )) 00:11:21.018 22:49:11 -- target/invalid.sh@25 -- # printf %x 81 00:11:21.018 22:49:11 -- target/invalid.sh@25 -- # echo -e '\x51' 00:11:21.018 22:49:11 -- target/invalid.sh@25 -- # string+=Q 00:11:21.018 22:49:11 -- target/invalid.sh@24 -- # (( ll++ )) 00:11:21.018 22:49:11 -- target/invalid.sh@24 -- # (( ll < length )) 00:11:21.018 22:49:11 -- target/invalid.sh@25 -- # printf %x 42 00:11:21.018 22:49:11 -- target/invalid.sh@25 -- # echo -e '\x2a' 00:11:21.018 22:49:11 -- target/invalid.sh@25 -- # string+='*' 00:11:21.018 22:49:11 -- target/invalid.sh@24 -- # (( ll++ )) 00:11:21.018 22:49:11 -- target/invalid.sh@24 -- # (( ll < length )) 00:11:21.018 22:49:11 -- target/invalid.sh@25 -- # printf %x 42 00:11:21.018 22:49:11 -- target/invalid.sh@25 -- # echo -e '\x2a' 00:11:21.018 22:49:11 -- target/invalid.sh@25 -- # string+='*' 00:11:21.018 22:49:11 -- target/invalid.sh@24 -- # (( ll++ )) 00:11:21.018 22:49:11 -- target/invalid.sh@24 -- # (( ll < length )) 00:11:21.018 22:49:11 -- target/invalid.sh@25 -- # printf %x 44 00:11:21.018 22:49:11 -- target/invalid.sh@25 -- # echo -e '\x2c' 00:11:21.018 22:49:11 -- target/invalid.sh@25 -- # string+=, 00:11:21.018 22:49:11 -- target/invalid.sh@24 -- # (( ll++ )) 00:11:21.018 22:49:11 -- target/invalid.sh@24 -- # (( ll < length )) 00:11:21.018 22:49:11 -- target/invalid.sh@25 -- # printf %x 124 00:11:21.018 22:49:11 -- target/invalid.sh@25 -- # echo -e '\x7c' 00:11:21.018 22:49:11 -- target/invalid.sh@25 -- # string+='|' 00:11:21.018 22:49:11 -- target/invalid.sh@24 -- # (( ll++ )) 00:11:21.018 22:49:11 -- target/invalid.sh@24 -- # (( ll < length )) 00:11:21.018 22:49:11 -- target/invalid.sh@25 -- # printf %x 34 00:11:21.018 22:49:11 -- target/invalid.sh@25 -- # echo -e '\x22' 00:11:21.018 22:49:11 -- target/invalid.sh@25 -- # string+='"' 00:11:21.018 22:49:11 -- target/invalid.sh@24 -- # (( ll++ )) 00:11:21.018 22:49:11 -- target/invalid.sh@24 -- # (( ll < length )) 00:11:21.018 22:49:11 -- target/invalid.sh@25 -- # printf %x 121 00:11:21.018 22:49:11 -- target/invalid.sh@25 -- # echo -e '\x79' 00:11:21.018 22:49:11 -- target/invalid.sh@25 -- # string+=y 00:11:21.018 22:49:11 -- target/invalid.sh@24 -- # (( ll++ )) 00:11:21.018 22:49:11 -- target/invalid.sh@24 -- # (( ll < length )) 00:11:21.018 22:49:11 -- target/invalid.sh@25 -- # printf %x 93 00:11:21.018 22:49:11 -- target/invalid.sh@25 -- # echo -e '\x5d' 00:11:21.018 22:49:11 -- target/invalid.sh@25 -- # string+=']' 00:11:21.018 22:49:11 -- target/invalid.sh@24 -- # (( ll++ )) 00:11:21.018 22:49:11 -- target/invalid.sh@24 -- # (( ll < length )) 00:11:21.018 22:49:11 -- target/invalid.sh@25 -- # printf %x 107 00:11:21.018 22:49:11 -- target/invalid.sh@25 -- # echo -e '\x6b' 00:11:21.018 22:49:11 -- target/invalid.sh@25 -- # string+=k 00:11:21.018 22:49:11 -- target/invalid.sh@24 -- # (( ll++ )) 00:11:21.018 22:49:11 -- target/invalid.sh@24 -- # (( ll < length )) 00:11:21.018 22:49:11 -- target/invalid.sh@25 -- # printf %x 53 00:11:21.018 22:49:11 -- target/invalid.sh@25 -- # echo -e '\x35' 00:11:21.018 22:49:11 -- target/invalid.sh@25 -- # string+=5 00:11:21.018 22:49:11 -- target/invalid.sh@24 -- # (( ll++ )) 00:11:21.018 22:49:11 -- target/invalid.sh@24 -- # (( ll < length )) 00:11:21.018 22:49:11 -- target/invalid.sh@25 -- # printf %x 49 00:11:21.018 22:49:11 -- target/invalid.sh@25 -- # echo -e '\x31' 00:11:21.018 22:49:11 -- target/invalid.sh@25 -- # string+=1 00:11:21.018 22:49:11 -- target/invalid.sh@24 -- # (( ll++ )) 00:11:21.018 22:49:11 -- target/invalid.sh@24 -- # (( ll < length )) 00:11:21.018 22:49:11 -- target/invalid.sh@25 -- # printf %x 108 00:11:21.018 22:49:11 -- target/invalid.sh@25 -- # echo -e '\x6c' 00:11:21.018 22:49:11 -- target/invalid.sh@25 -- # string+=l 00:11:21.018 22:49:11 -- target/invalid.sh@24 -- # (( ll++ )) 00:11:21.018 22:49:11 -- target/invalid.sh@24 -- # (( ll < length )) 00:11:21.018 22:49:11 -- target/invalid.sh@25 -- # printf %x 58 00:11:21.018 22:49:11 -- target/invalid.sh@25 -- # echo -e '\x3a' 00:11:21.018 22:49:11 -- target/invalid.sh@25 -- # string+=: 00:11:21.018 22:49:11 -- target/invalid.sh@24 -- # (( ll++ )) 00:11:21.018 22:49:11 -- target/invalid.sh@24 -- # (( ll < length )) 00:11:21.018 22:49:11 -- target/invalid.sh@25 -- # printf %x 104 00:11:21.018 22:49:11 -- target/invalid.sh@25 -- # echo -e '\x68' 00:11:21.018 22:49:11 -- target/invalid.sh@25 -- # string+=h 00:11:21.018 22:49:11 -- target/invalid.sh@24 -- # (( ll++ )) 00:11:21.018 22:49:11 -- target/invalid.sh@24 -- # (( ll < length )) 00:11:21.018 22:49:11 -- target/invalid.sh@25 -- # printf %x 74 00:11:21.018 22:49:11 -- target/invalid.sh@25 -- # echo -e '\x4a' 00:11:21.018 22:49:11 -- target/invalid.sh@25 -- # string+=J 00:11:21.018 22:49:11 -- target/invalid.sh@24 -- # (( ll++ )) 00:11:21.018 22:49:11 -- target/invalid.sh@24 -- # (( ll < length )) 00:11:21.018 22:49:11 -- target/invalid.sh@25 -- # printf %x 104 00:11:21.018 22:49:11 -- target/invalid.sh@25 -- # echo -e '\x68' 00:11:21.018 22:49:11 -- target/invalid.sh@25 -- # string+=h 00:11:21.018 22:49:11 -- target/invalid.sh@24 -- # (( ll++ )) 00:11:21.018 22:49:11 -- target/invalid.sh@24 -- # (( ll < length )) 00:11:21.018 22:49:11 -- target/invalid.sh@25 -- # printf %x 49 00:11:21.018 22:49:11 -- target/invalid.sh@25 -- # echo -e '\x31' 00:11:21.018 22:49:11 -- target/invalid.sh@25 -- # string+=1 00:11:21.018 22:49:11 -- target/invalid.sh@24 -- # (( ll++ )) 00:11:21.018 22:49:11 -- target/invalid.sh@24 -- # (( ll < length )) 00:11:21.018 22:49:11 -- target/invalid.sh@25 -- # printf %x 44 00:11:21.018 22:49:11 -- target/invalid.sh@25 -- # echo -e '\x2c' 00:11:21.018 22:49:11 -- target/invalid.sh@25 -- # string+=, 00:11:21.019 22:49:11 -- target/invalid.sh@24 -- # (( ll++ )) 00:11:21.019 22:49:11 -- target/invalid.sh@24 -- # (( ll < length )) 00:11:21.019 22:49:11 -- target/invalid.sh@25 -- # printf %x 39 00:11:21.019 22:49:11 -- target/invalid.sh@25 -- # echo -e '\x27' 00:11:21.019 22:49:11 -- target/invalid.sh@25 -- # string+=\' 00:11:21.019 22:49:11 -- target/invalid.sh@24 -- # (( ll++ )) 00:11:21.019 22:49:11 -- target/invalid.sh@24 -- # (( ll < length )) 00:11:21.019 22:49:11 -- target/invalid.sh@25 -- # printf %x 89 00:11:21.019 22:49:11 -- target/invalid.sh@25 -- # echo -e '\x59' 00:11:21.019 22:49:11 -- target/invalid.sh@25 -- # string+=Y 00:11:21.019 22:49:11 -- target/invalid.sh@24 -- # (( ll++ )) 00:11:21.019 22:49:11 -- target/invalid.sh@24 -- # (( ll < length )) 00:11:21.019 22:49:11 -- target/invalid.sh@25 -- # printf %x 80 00:11:21.019 22:49:11 -- target/invalid.sh@25 -- # echo -e '\x50' 00:11:21.019 22:49:11 -- target/invalid.sh@25 -- # string+=P 00:11:21.019 22:49:11 -- target/invalid.sh@24 -- # (( ll++ )) 00:11:21.019 22:49:11 -- target/invalid.sh@24 -- # (( ll < length )) 00:11:21.019 22:49:11 -- target/invalid.sh@25 -- # printf %x 124 00:11:21.019 22:49:11 -- target/invalid.sh@25 -- # echo -e '\x7c' 00:11:21.019 22:49:11 -- target/invalid.sh@25 -- # string+='|' 00:11:21.019 22:49:11 -- target/invalid.sh@24 -- # (( ll++ )) 00:11:21.019 22:49:11 -- target/invalid.sh@24 -- # (( ll < length )) 00:11:21.019 22:49:11 -- target/invalid.sh@25 -- # printf %x 121 00:11:21.019 22:49:11 -- target/invalid.sh@25 -- # echo -e '\x79' 00:11:21.019 22:49:11 -- target/invalid.sh@25 -- # string+=y 00:11:21.019 22:49:11 -- target/invalid.sh@24 -- # (( ll++ )) 00:11:21.019 22:49:11 -- target/invalid.sh@24 -- # (( ll < length )) 00:11:21.019 22:49:11 -- target/invalid.sh@25 -- # printf %x 46 00:11:21.019 22:49:11 -- target/invalid.sh@25 -- # echo -e '\x2e' 00:11:21.019 22:49:11 -- target/invalid.sh@25 -- # string+=. 00:11:21.019 22:49:11 -- target/invalid.sh@24 -- # (( ll++ )) 00:11:21.019 22:49:11 -- target/invalid.sh@24 -- # (( ll < length )) 00:11:21.019 22:49:11 -- target/invalid.sh@25 -- # printf %x 55 00:11:21.019 22:49:12 -- target/invalid.sh@25 -- # echo -e '\x37' 00:11:21.019 22:49:12 -- target/invalid.sh@25 -- # string+=7 00:11:21.019 22:49:12 -- target/invalid.sh@24 -- # (( ll++ )) 00:11:21.019 22:49:12 -- target/invalid.sh@24 -- # (( ll < length )) 00:11:21.019 22:49:12 -- target/invalid.sh@25 -- # printf %x 53 00:11:21.019 22:49:12 -- target/invalid.sh@25 -- # echo -e '\x35' 00:11:21.019 22:49:12 -- target/invalid.sh@25 -- # string+=5 00:11:21.019 22:49:12 -- target/invalid.sh@24 -- # (( ll++ )) 00:11:21.019 22:49:12 -- target/invalid.sh@24 -- # (( ll < length )) 00:11:21.019 22:49:12 -- target/invalid.sh@25 -- # printf %x 79 00:11:21.019 22:49:12 -- target/invalid.sh@25 -- # echo -e '\x4f' 00:11:21.019 22:49:12 -- target/invalid.sh@25 -- # string+=O 00:11:21.019 22:49:12 -- target/invalid.sh@24 -- # (( ll++ )) 00:11:21.019 22:49:12 -- target/invalid.sh@24 -- # (( ll < length )) 00:11:21.019 22:49:12 -- target/invalid.sh@25 -- # printf %x 50 00:11:21.019 22:49:12 -- target/invalid.sh@25 -- # echo -e '\x32' 00:11:21.019 22:49:12 -- target/invalid.sh@25 -- # string+=2 00:11:21.019 22:49:12 -- target/invalid.sh@24 -- # (( ll++ )) 00:11:21.019 22:49:12 -- target/invalid.sh@24 -- # (( ll < length )) 00:11:21.019 22:49:12 -- target/invalid.sh@25 -- # printf %x 95 00:11:21.019 22:49:12 -- target/invalid.sh@25 -- # echo -e '\x5f' 00:11:21.019 22:49:12 -- target/invalid.sh@25 -- # string+=_ 00:11:21.019 22:49:12 -- target/invalid.sh@24 -- # (( ll++ )) 00:11:21.019 22:49:12 -- target/invalid.sh@24 -- # (( ll < length )) 00:11:21.019 22:49:12 -- target/invalid.sh@25 -- # printf %x 48 00:11:21.019 22:49:12 -- target/invalid.sh@25 -- # echo -e '\x30' 00:11:21.019 22:49:12 -- target/invalid.sh@25 -- # string+=0 00:11:21.019 22:49:12 -- target/invalid.sh@24 -- # (( ll++ )) 00:11:21.019 22:49:12 -- target/invalid.sh@24 -- # (( ll < length )) 00:11:21.019 22:49:12 -- target/invalid.sh@25 -- # printf %x 32 00:11:21.019 22:49:12 -- target/invalid.sh@25 -- # echo -e '\x20' 00:11:21.019 22:49:12 -- target/invalid.sh@25 -- # string+=' ' 00:11:21.019 22:49:12 -- target/invalid.sh@24 -- # (( ll++ )) 00:11:21.019 22:49:12 -- target/invalid.sh@24 -- # (( ll < length )) 00:11:21.019 22:49:12 -- target/invalid.sh@28 -- # [[ ? == \- ]] 00:11:21.019 22:49:12 -- target/invalid.sh@31 -- # echo '?SL]ye{Pz_Q**,|"y]k51l:hJh1,'\''YP|y.75O2_0 ' 00:11:21.019 22:49:12 -- target/invalid.sh@58 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem -d '?SL]ye{Pz_Q**,|"y]k51l:hJh1,'\''YP|y.75O2_0 ' nqn.2016-06.io.spdk:cnode20063 00:11:21.277 [2024-04-16 22:49:12.239375] nvmf_rpc.c: 427:rpc_nvmf_create_subsystem: *ERROR*: Subsystem nqn.2016-06.io.spdk:cnode20063: invalid model number '?SL]ye{Pz_Q**,|"y]k51l:hJh1,'YP|y.75O2_0 ' 00:11:21.277 22:49:12 -- target/invalid.sh@58 -- # out='request: 00:11:21.277 { 00:11:21.277 "nqn": "nqn.2016-06.io.spdk:cnode20063", 00:11:21.277 "model_number": "?SL]ye{Pz_Q**,|\"y]k51l:hJh1,'\''YP|y.75O2_0 ", 00:11:21.277 "method": "nvmf_create_subsystem", 00:11:21.277 "req_id": 1 00:11:21.277 } 00:11:21.277 Got JSON-RPC error response 00:11:21.277 response: 00:11:21.277 { 00:11:21.277 "code": -32602, 00:11:21.277 "message": "Invalid MN ?SL]ye{Pz_Q**,|\"y]k51l:hJh1,'\''YP|y.75O2_0 " 00:11:21.277 }' 00:11:21.277 22:49:12 -- target/invalid.sh@59 -- # [[ request: 00:11:21.277 { 00:11:21.277 "nqn": "nqn.2016-06.io.spdk:cnode20063", 00:11:21.277 "model_number": "?SL]ye{Pz_Q**,|\"y]k51l:hJh1,'YP|y.75O2_0 ", 00:11:21.277 "method": "nvmf_create_subsystem", 00:11:21.277 "req_id": 1 00:11:21.277 } 00:11:21.277 Got JSON-RPC error response 00:11:21.277 response: 00:11:21.277 { 00:11:21.277 "code": -32602, 00:11:21.277 "message": "Invalid MN ?SL]ye{Pz_Q**,|\"y]k51l:hJh1,'YP|y.75O2_0 " 00:11:21.277 } == *\I\n\v\a\l\i\d\ \M\N* ]] 00:11:21.277 22:49:12 -- target/invalid.sh@62 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_transport --trtype tcp 00:11:21.535 [2024-04-16 22:49:12.488260] tcp.c: 659:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:11:21.535 22:49:12 -- target/invalid.sh@63 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode -s SPDK001 -a 00:11:21.793 22:49:12 -- target/invalid.sh@64 -- # [[ tcp == \T\C\P ]] 00:11:21.793 22:49:12 -- target/invalid.sh@67 -- # echo '' 00:11:21.793 22:49:12 -- target/invalid.sh@67 -- # head -n 1 00:11:21.793 22:49:12 -- target/invalid.sh@67 -- # IP= 00:11:21.793 22:49:12 -- target/invalid.sh@69 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_listener nqn.2016-06.io.spdk:cnode -t tcp -a '' -s 4421 00:11:22.050 [2024-04-16 22:49:12.961811] nvmf_rpc.c: 783:nvmf_rpc_listen_paused: *ERROR*: Unable to remove listener, rc -2 00:11:22.051 22:49:12 -- target/invalid.sh@69 -- # out='request: 00:11:22.051 { 00:11:22.051 "nqn": "nqn.2016-06.io.spdk:cnode", 00:11:22.051 "listen_address": { 00:11:22.051 "trtype": "tcp", 00:11:22.051 "traddr": "", 00:11:22.051 "trsvcid": "4421" 00:11:22.051 }, 00:11:22.051 "method": "nvmf_subsystem_remove_listener", 00:11:22.051 "req_id": 1 00:11:22.051 } 00:11:22.051 Got JSON-RPC error response 00:11:22.051 response: 00:11:22.051 { 00:11:22.051 "code": -32602, 00:11:22.051 "message": "Invalid parameters" 00:11:22.051 }' 00:11:22.051 22:49:12 -- target/invalid.sh@70 -- # [[ request: 00:11:22.051 { 00:11:22.051 "nqn": "nqn.2016-06.io.spdk:cnode", 00:11:22.051 "listen_address": { 00:11:22.051 "trtype": "tcp", 00:11:22.051 "traddr": "", 00:11:22.051 "trsvcid": "4421" 00:11:22.051 }, 00:11:22.051 "method": "nvmf_subsystem_remove_listener", 00:11:22.051 "req_id": 1 00:11:22.051 } 00:11:22.051 Got JSON-RPC error response 00:11:22.051 response: 00:11:22.051 { 00:11:22.051 "code": -32602, 00:11:22.051 "message": "Invalid parameters" 00:11:22.051 } != *\U\n\a\b\l\e\ \t\o\ \s\t\o\p\ \l\i\s\t\e\n\e\r\.* ]] 00:11:22.051 22:49:12 -- target/invalid.sh@73 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode6295 -i 0 00:11:22.309 [2024-04-16 22:49:13.194627] nvmf_rpc.c: 439:rpc_nvmf_create_subsystem: *ERROR*: Subsystem nqn.2016-06.io.spdk:cnode6295: invalid cntlid range [0-65519] 00:11:22.309 22:49:13 -- target/invalid.sh@73 -- # out='request: 00:11:22.309 { 00:11:22.309 "nqn": "nqn.2016-06.io.spdk:cnode6295", 00:11:22.309 "min_cntlid": 0, 00:11:22.309 "method": "nvmf_create_subsystem", 00:11:22.309 "req_id": 1 00:11:22.309 } 00:11:22.309 Got JSON-RPC error response 00:11:22.309 response: 00:11:22.309 { 00:11:22.309 "code": -32602, 00:11:22.309 "message": "Invalid cntlid range [0-65519]" 00:11:22.309 }' 00:11:22.309 22:49:13 -- target/invalid.sh@74 -- # [[ request: 00:11:22.309 { 00:11:22.309 "nqn": "nqn.2016-06.io.spdk:cnode6295", 00:11:22.309 "min_cntlid": 0, 00:11:22.309 "method": "nvmf_create_subsystem", 00:11:22.309 "req_id": 1 00:11:22.309 } 00:11:22.309 Got JSON-RPC error response 00:11:22.309 response: 00:11:22.309 { 00:11:22.309 "code": -32602, 00:11:22.309 "message": "Invalid cntlid range [0-65519]" 00:11:22.309 } == *\I\n\v\a\l\i\d\ \c\n\t\l\i\d\ \r\a\n\g\e* ]] 00:11:22.309 22:49:13 -- target/invalid.sh@75 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode25360 -i 65520 00:11:22.309 [2024-04-16 22:49:13.435441] nvmf_rpc.c: 439:rpc_nvmf_create_subsystem: *ERROR*: Subsystem nqn.2016-06.io.spdk:cnode25360: invalid cntlid range [65520-65519] 00:11:22.567 22:49:13 -- target/invalid.sh@75 -- # out='request: 00:11:22.567 { 00:11:22.567 "nqn": "nqn.2016-06.io.spdk:cnode25360", 00:11:22.567 "min_cntlid": 65520, 00:11:22.567 "method": "nvmf_create_subsystem", 00:11:22.567 "req_id": 1 00:11:22.567 } 00:11:22.567 Got JSON-RPC error response 00:11:22.567 response: 00:11:22.567 { 00:11:22.567 "code": -32602, 00:11:22.567 "message": "Invalid cntlid range [65520-65519]" 00:11:22.567 }' 00:11:22.567 22:49:13 -- target/invalid.sh@76 -- # [[ request: 00:11:22.567 { 00:11:22.567 "nqn": "nqn.2016-06.io.spdk:cnode25360", 00:11:22.567 "min_cntlid": 65520, 00:11:22.567 "method": "nvmf_create_subsystem", 00:11:22.567 "req_id": 1 00:11:22.567 } 00:11:22.567 Got JSON-RPC error response 00:11:22.567 response: 00:11:22.567 { 00:11:22.567 "code": -32602, 00:11:22.567 "message": "Invalid cntlid range [65520-65519]" 00:11:22.567 } == *\I\n\v\a\l\i\d\ \c\n\t\l\i\d\ \r\a\n\g\e* ]] 00:11:22.567 22:49:13 -- target/invalid.sh@77 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode9814 -I 0 00:11:22.567 [2024-04-16 22:49:13.684317] nvmf_rpc.c: 439:rpc_nvmf_create_subsystem: *ERROR*: Subsystem nqn.2016-06.io.spdk:cnode9814: invalid cntlid range [1-0] 00:11:22.825 22:49:13 -- target/invalid.sh@77 -- # out='request: 00:11:22.825 { 00:11:22.825 "nqn": "nqn.2016-06.io.spdk:cnode9814", 00:11:22.825 "max_cntlid": 0, 00:11:22.825 "method": "nvmf_create_subsystem", 00:11:22.825 "req_id": 1 00:11:22.825 } 00:11:22.825 Got JSON-RPC error response 00:11:22.825 response: 00:11:22.825 { 00:11:22.825 "code": -32602, 00:11:22.825 "message": "Invalid cntlid range [1-0]" 00:11:22.825 }' 00:11:22.825 22:49:13 -- target/invalid.sh@78 -- # [[ request: 00:11:22.825 { 00:11:22.825 "nqn": "nqn.2016-06.io.spdk:cnode9814", 00:11:22.825 "max_cntlid": 0, 00:11:22.825 "method": "nvmf_create_subsystem", 00:11:22.825 "req_id": 1 00:11:22.825 } 00:11:22.825 Got JSON-RPC error response 00:11:22.825 response: 00:11:22.825 { 00:11:22.825 "code": -32602, 00:11:22.825 "message": "Invalid cntlid range [1-0]" 00:11:22.825 } == *\I\n\v\a\l\i\d\ \c\n\t\l\i\d\ \r\a\n\g\e* ]] 00:11:22.825 22:49:13 -- target/invalid.sh@79 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode8926 -I 65520 00:11:22.825 [2024-04-16 22:49:13.929206] nvmf_rpc.c: 439:rpc_nvmf_create_subsystem: *ERROR*: Subsystem nqn.2016-06.io.spdk:cnode8926: invalid cntlid range [1-65520] 00:11:22.825 22:49:13 -- target/invalid.sh@79 -- # out='request: 00:11:22.825 { 00:11:22.825 "nqn": "nqn.2016-06.io.spdk:cnode8926", 00:11:22.825 "max_cntlid": 65520, 00:11:22.825 "method": "nvmf_create_subsystem", 00:11:22.825 "req_id": 1 00:11:22.825 } 00:11:22.825 Got JSON-RPC error response 00:11:22.825 response: 00:11:22.825 { 00:11:22.825 "code": -32602, 00:11:22.825 "message": "Invalid cntlid range [1-65520]" 00:11:22.825 }' 00:11:22.825 22:49:13 -- target/invalid.sh@80 -- # [[ request: 00:11:22.825 { 00:11:22.825 "nqn": "nqn.2016-06.io.spdk:cnode8926", 00:11:22.825 "max_cntlid": 65520, 00:11:22.825 "method": "nvmf_create_subsystem", 00:11:22.825 "req_id": 1 00:11:22.825 } 00:11:22.825 Got JSON-RPC error response 00:11:22.825 response: 00:11:22.825 { 00:11:22.825 "code": -32602, 00:11:22.825 "message": "Invalid cntlid range [1-65520]" 00:11:22.825 } == *\I\n\v\a\l\i\d\ \c\n\t\l\i\d\ \r\a\n\g\e* ]] 00:11:22.825 22:49:13 -- target/invalid.sh@83 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode9162 -i 6 -I 5 00:11:23.083 [2024-04-16 22:49:14.166022] nvmf_rpc.c: 439:rpc_nvmf_create_subsystem: *ERROR*: Subsystem nqn.2016-06.io.spdk:cnode9162: invalid cntlid range [6-5] 00:11:23.083 22:49:14 -- target/invalid.sh@83 -- # out='request: 00:11:23.083 { 00:11:23.083 "nqn": "nqn.2016-06.io.spdk:cnode9162", 00:11:23.083 "min_cntlid": 6, 00:11:23.083 "max_cntlid": 5, 00:11:23.083 "method": "nvmf_create_subsystem", 00:11:23.083 "req_id": 1 00:11:23.083 } 00:11:23.083 Got JSON-RPC error response 00:11:23.083 response: 00:11:23.083 { 00:11:23.083 "code": -32602, 00:11:23.083 "message": "Invalid cntlid range [6-5]" 00:11:23.083 }' 00:11:23.083 22:49:14 -- target/invalid.sh@84 -- # [[ request: 00:11:23.083 { 00:11:23.083 "nqn": "nqn.2016-06.io.spdk:cnode9162", 00:11:23.083 "min_cntlid": 6, 00:11:23.083 "max_cntlid": 5, 00:11:23.083 "method": "nvmf_create_subsystem", 00:11:23.083 "req_id": 1 00:11:23.083 } 00:11:23.083 Got JSON-RPC error response 00:11:23.083 response: 00:11:23.083 { 00:11:23.083 "code": -32602, 00:11:23.083 "message": "Invalid cntlid range [6-5]" 00:11:23.083 } == *\I\n\v\a\l\i\d\ \c\n\t\l\i\d\ \r\a\n\g\e* ]] 00:11:23.083 22:49:14 -- target/invalid.sh@87 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/multitarget_rpc.py nvmf_delete_target --name foobar 00:11:23.340 22:49:14 -- target/invalid.sh@87 -- # out='request: 00:11:23.340 { 00:11:23.340 "name": "foobar", 00:11:23.340 "method": "nvmf_delete_target", 00:11:23.340 "req_id": 1 00:11:23.340 } 00:11:23.340 Got JSON-RPC error response 00:11:23.340 response: 00:11:23.340 { 00:11:23.340 "code": -32602, 00:11:23.340 "message": "The specified target doesn'\''t exist, cannot delete it." 00:11:23.340 }' 00:11:23.340 22:49:14 -- target/invalid.sh@88 -- # [[ request: 00:11:23.340 { 00:11:23.340 "name": "foobar", 00:11:23.340 "method": "nvmf_delete_target", 00:11:23.340 "req_id": 1 00:11:23.340 } 00:11:23.340 Got JSON-RPC error response 00:11:23.340 response: 00:11:23.340 { 00:11:23.340 "code": -32602, 00:11:23.340 "message": "The specified target doesn't exist, cannot delete it." 00:11:23.340 } == *\T\h\e\ \s\p\e\c\i\f\i\e\d\ \t\a\r\g\e\t\ \d\o\e\s\n\'\t\ \e\x\i\s\t\,\ \c\a\n\n\o\t\ \d\e\l\e\t\e\ \i\t\.* ]] 00:11:23.340 22:49:14 -- target/invalid.sh@90 -- # trap - SIGINT SIGTERM EXIT 00:11:23.340 22:49:14 -- target/invalid.sh@91 -- # nvmftestfini 00:11:23.340 22:49:14 -- nvmf/common.sh@476 -- # nvmfcleanup 00:11:23.340 22:49:14 -- nvmf/common.sh@116 -- # sync 00:11:23.340 22:49:14 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:11:23.340 22:49:14 -- nvmf/common.sh@119 -- # set +e 00:11:23.340 22:49:14 -- nvmf/common.sh@120 -- # for i in {1..20} 00:11:23.340 22:49:14 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:11:23.340 rmmod nvme_tcp 00:11:23.340 rmmod nvme_fabrics 00:11:23.340 rmmod nvme_keyring 00:11:23.340 22:49:14 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:11:23.340 22:49:14 -- nvmf/common.sh@123 -- # set -e 00:11:23.340 22:49:14 -- nvmf/common.sh@124 -- # return 0 00:11:23.340 22:49:14 -- nvmf/common.sh@477 -- # '[' -n 224451 ']' 00:11:23.340 22:49:14 -- nvmf/common.sh@478 -- # killprocess 224451 00:11:23.340 22:49:14 -- common/autotest_common.sh@926 -- # '[' -z 224451 ']' 00:11:23.340 22:49:14 -- common/autotest_common.sh@930 -- # kill -0 224451 00:11:23.340 22:49:14 -- common/autotest_common.sh@931 -- # uname 00:11:23.340 22:49:14 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:11:23.340 22:49:14 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 224451 00:11:23.340 22:49:14 -- common/autotest_common.sh@932 -- # process_name=reactor_0 00:11:23.340 22:49:14 -- common/autotest_common.sh@936 -- # '[' reactor_0 = sudo ']' 00:11:23.340 22:49:14 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 224451' 00:11:23.340 killing process with pid 224451 00:11:23.340 22:49:14 -- common/autotest_common.sh@945 -- # kill 224451 00:11:23.340 22:49:14 -- common/autotest_common.sh@950 -- # wait 224451 00:11:23.599 22:49:14 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:11:23.599 22:49:14 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:11:23.599 22:49:14 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:11:23.599 22:49:14 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:11:23.599 22:49:14 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:11:23.599 22:49:14 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:11:23.599 22:49:14 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:11:23.599 22:49:14 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:11:26.128 22:49:16 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:11:26.128 00:11:26.128 real 0m9.234s 00:11:26.128 user 0m22.365s 00:11:26.128 sys 0m2.435s 00:11:26.128 22:49:16 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:11:26.129 22:49:16 -- common/autotest_common.sh@10 -- # set +x 00:11:26.129 ************************************ 00:11:26.129 END TEST nvmf_invalid 00:11:26.129 ************************************ 00:11:26.129 22:49:16 -- nvmf/nvmf.sh@31 -- # run_test nvmf_abort /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/abort.sh --transport=tcp 00:11:26.129 22:49:16 -- common/autotest_common.sh@1077 -- # '[' 3 -le 1 ']' 00:11:26.129 22:49:16 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:11:26.129 22:49:16 -- common/autotest_common.sh@10 -- # set +x 00:11:26.129 ************************************ 00:11:26.129 START TEST nvmf_abort 00:11:26.129 ************************************ 00:11:26.129 22:49:16 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/abort.sh --transport=tcp 00:11:26.129 * Looking for test storage... 00:11:26.129 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:11:26.129 22:49:16 -- target/abort.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:11:26.129 22:49:16 -- nvmf/common.sh@7 -- # uname -s 00:11:26.129 22:49:16 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:11:26.129 22:49:16 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:11:26.129 22:49:16 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:11:26.129 22:49:16 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:11:26.129 22:49:16 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:11:26.129 22:49:16 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:11:26.129 22:49:16 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:11:26.129 22:49:16 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:11:26.129 22:49:16 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:11:26.129 22:49:16 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:11:26.129 22:49:16 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:11:26.129 22:49:16 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:11:26.129 22:49:16 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:11:26.129 22:49:16 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:11:26.129 22:49:16 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:11:26.129 22:49:16 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:11:26.129 22:49:16 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:11:26.129 22:49:16 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:11:26.129 22:49:16 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:11:26.129 22:49:16 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:11:26.129 22:49:16 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:11:26.129 22:49:16 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:11:26.129 22:49:16 -- paths/export.sh@5 -- # export PATH 00:11:26.129 22:49:16 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:11:26.129 22:49:16 -- nvmf/common.sh@46 -- # : 0 00:11:26.129 22:49:16 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:11:26.129 22:49:16 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:11:26.129 22:49:16 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:11:26.129 22:49:16 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:11:26.129 22:49:16 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:11:26.129 22:49:16 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:11:26.129 22:49:16 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:11:26.129 22:49:16 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:11:26.129 22:49:16 -- target/abort.sh@11 -- # MALLOC_BDEV_SIZE=64 00:11:26.129 22:49:16 -- target/abort.sh@12 -- # MALLOC_BLOCK_SIZE=4096 00:11:26.129 22:49:16 -- target/abort.sh@14 -- # nvmftestinit 00:11:26.129 22:49:16 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:11:26.129 22:49:16 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:11:26.129 22:49:16 -- nvmf/common.sh@436 -- # prepare_net_devs 00:11:26.129 22:49:16 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:11:26.129 22:49:16 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:11:26.129 22:49:16 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:11:26.129 22:49:16 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:11:26.129 22:49:16 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:11:26.129 22:49:16 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:11:26.129 22:49:16 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:11:26.129 22:49:16 -- nvmf/common.sh@284 -- # xtrace_disable 00:11:26.129 22:49:16 -- common/autotest_common.sh@10 -- # set +x 00:11:28.031 22:49:18 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:11:28.031 22:49:18 -- nvmf/common.sh@290 -- # pci_devs=() 00:11:28.031 22:49:18 -- nvmf/common.sh@290 -- # local -a pci_devs 00:11:28.031 22:49:18 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:11:28.031 22:49:18 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:11:28.031 22:49:18 -- nvmf/common.sh@292 -- # pci_drivers=() 00:11:28.031 22:49:18 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:11:28.031 22:49:18 -- nvmf/common.sh@294 -- # net_devs=() 00:11:28.031 22:49:18 -- nvmf/common.sh@294 -- # local -ga net_devs 00:11:28.031 22:49:18 -- nvmf/common.sh@295 -- # e810=() 00:11:28.031 22:49:18 -- nvmf/common.sh@295 -- # local -ga e810 00:11:28.031 22:49:18 -- nvmf/common.sh@296 -- # x722=() 00:11:28.031 22:49:18 -- nvmf/common.sh@296 -- # local -ga x722 00:11:28.031 22:49:18 -- nvmf/common.sh@297 -- # mlx=() 00:11:28.031 22:49:18 -- nvmf/common.sh@297 -- # local -ga mlx 00:11:28.031 22:49:18 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:11:28.031 22:49:18 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:11:28.031 22:49:18 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:11:28.031 22:49:18 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:11:28.031 22:49:18 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:11:28.031 22:49:18 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:11:28.031 22:49:18 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:11:28.031 22:49:18 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:11:28.031 22:49:18 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:11:28.031 22:49:18 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:11:28.031 22:49:18 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:11:28.031 22:49:18 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:11:28.031 22:49:18 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:11:28.031 22:49:18 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:11:28.031 22:49:18 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:11:28.031 22:49:18 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:11:28.031 22:49:18 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:11:28.031 22:49:18 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:11:28.031 22:49:18 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:11:28.031 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:11:28.031 22:49:18 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:11:28.031 22:49:18 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:11:28.031 22:49:18 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:11:28.031 22:49:18 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:11:28.031 22:49:18 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:11:28.031 22:49:18 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:11:28.031 22:49:18 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:11:28.031 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:11:28.031 22:49:18 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:11:28.031 22:49:18 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:11:28.031 22:49:18 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:11:28.031 22:49:18 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:11:28.031 22:49:18 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:11:28.031 22:49:18 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:11:28.031 22:49:18 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:11:28.031 22:49:18 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:11:28.031 22:49:18 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:11:28.031 22:49:18 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:11:28.031 22:49:18 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:11:28.031 22:49:18 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:11:28.031 22:49:18 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:11:28.032 Found net devices under 0000:0a:00.0: cvl_0_0 00:11:28.032 22:49:18 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:11:28.032 22:49:18 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:11:28.032 22:49:18 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:11:28.032 22:49:18 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:11:28.032 22:49:18 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:11:28.032 22:49:18 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:11:28.032 Found net devices under 0000:0a:00.1: cvl_0_1 00:11:28.032 22:49:18 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:11:28.032 22:49:18 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:11:28.032 22:49:18 -- nvmf/common.sh@402 -- # is_hw=yes 00:11:28.032 22:49:18 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:11:28.032 22:49:18 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:11:28.032 22:49:18 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:11:28.032 22:49:18 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:11:28.032 22:49:18 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:11:28.032 22:49:18 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:11:28.032 22:49:18 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:11:28.032 22:49:18 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:11:28.032 22:49:18 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:11:28.032 22:49:18 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:11:28.032 22:49:18 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:11:28.032 22:49:18 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:11:28.032 22:49:18 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:11:28.032 22:49:18 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:11:28.032 22:49:18 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:11:28.032 22:49:18 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:11:28.032 22:49:18 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:11:28.032 22:49:18 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:11:28.032 22:49:18 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:11:28.032 22:49:18 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:11:28.032 22:49:18 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:11:28.032 22:49:18 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:11:28.032 22:49:18 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:11:28.032 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:11:28.032 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.148 ms 00:11:28.032 00:11:28.032 --- 10.0.0.2 ping statistics --- 00:11:28.032 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:11:28.032 rtt min/avg/max/mdev = 0.148/0.148/0.148/0.000 ms 00:11:28.032 22:49:18 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:11:28.032 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:11:28.032 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.085 ms 00:11:28.032 00:11:28.032 --- 10.0.0.1 ping statistics --- 00:11:28.032 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:11:28.032 rtt min/avg/max/mdev = 0.085/0.085/0.085/0.000 ms 00:11:28.032 22:49:18 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:11:28.032 22:49:18 -- nvmf/common.sh@410 -- # return 0 00:11:28.032 22:49:18 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:11:28.032 22:49:18 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:11:28.032 22:49:18 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:11:28.032 22:49:18 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:11:28.032 22:49:18 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:11:28.032 22:49:18 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:11:28.032 22:49:18 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:11:28.032 22:49:18 -- target/abort.sh@15 -- # nvmfappstart -m 0xE 00:11:28.032 22:49:18 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:11:28.032 22:49:18 -- common/autotest_common.sh@712 -- # xtrace_disable 00:11:28.032 22:49:18 -- common/autotest_common.sh@10 -- # set +x 00:11:28.032 22:49:18 -- nvmf/common.sh@469 -- # nvmfpid=227121 00:11:28.032 22:49:18 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xE 00:11:28.032 22:49:18 -- nvmf/common.sh@470 -- # waitforlisten 227121 00:11:28.032 22:49:18 -- common/autotest_common.sh@819 -- # '[' -z 227121 ']' 00:11:28.032 22:49:18 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk.sock 00:11:28.032 22:49:18 -- common/autotest_common.sh@824 -- # local max_retries=100 00:11:28.032 22:49:18 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:11:28.032 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:11:28.032 22:49:18 -- common/autotest_common.sh@828 -- # xtrace_disable 00:11:28.032 22:49:18 -- common/autotest_common.sh@10 -- # set +x 00:11:28.032 [2024-04-16 22:49:18.964107] Starting SPDK v24.01.1-pre git sha1 4b134b4ab / DPDK 23.11.0 initialization... 00:11:28.032 [2024-04-16 22:49:18.964202] [ DPDK EAL parameters: nvmf -c 0xE --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:11:28.032 EAL: No free 2048 kB hugepages reported on node 1 00:11:28.032 [2024-04-16 22:49:19.038531] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 3 00:11:28.291 [2024-04-16 22:49:19.162131] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:11:28.291 [2024-04-16 22:49:19.162291] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:11:28.291 [2024-04-16 22:49:19.162313] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:11:28.291 [2024-04-16 22:49:19.162328] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:11:28.291 [2024-04-16 22:49:19.162398] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:11:28.291 [2024-04-16 22:49:19.162445] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:11:28.291 [2024-04-16 22:49:19.162449] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:11:28.857 22:49:19 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:11:28.857 22:49:19 -- common/autotest_common.sh@852 -- # return 0 00:11:28.857 22:49:19 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:11:28.857 22:49:19 -- common/autotest_common.sh@718 -- # xtrace_disable 00:11:28.857 22:49:19 -- common/autotest_common.sh@10 -- # set +x 00:11:28.858 22:49:19 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:11:28.858 22:49:19 -- target/abort.sh@17 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 -a 256 00:11:28.858 22:49:19 -- common/autotest_common.sh@551 -- # xtrace_disable 00:11:28.858 22:49:19 -- common/autotest_common.sh@10 -- # set +x 00:11:28.858 [2024-04-16 22:49:19.980742] tcp.c: 659:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:11:29.116 22:49:19 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:11:29.116 22:49:19 -- target/abort.sh@20 -- # rpc_cmd bdev_malloc_create 64 4096 -b Malloc0 00:11:29.116 22:49:19 -- common/autotest_common.sh@551 -- # xtrace_disable 00:11:29.116 22:49:19 -- common/autotest_common.sh@10 -- # set +x 00:11:29.116 Malloc0 00:11:29.116 22:49:20 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:11:29.116 22:49:20 -- target/abort.sh@21 -- # rpc_cmd bdev_delay_create -b Malloc0 -d Delay0 -r 1000000 -t 1000000 -w 1000000 -n 1000000 00:11:29.116 22:49:20 -- common/autotest_common.sh@551 -- # xtrace_disable 00:11:29.116 22:49:20 -- common/autotest_common.sh@10 -- # set +x 00:11:29.116 Delay0 00:11:29.116 22:49:20 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:11:29.116 22:49:20 -- target/abort.sh@24 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode0 -a -s SPDK0 00:11:29.116 22:49:20 -- common/autotest_common.sh@551 -- # xtrace_disable 00:11:29.116 22:49:20 -- common/autotest_common.sh@10 -- # set +x 00:11:29.116 22:49:20 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:11:29.116 22:49:20 -- target/abort.sh@25 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode0 Delay0 00:11:29.116 22:49:20 -- common/autotest_common.sh@551 -- # xtrace_disable 00:11:29.116 22:49:20 -- common/autotest_common.sh@10 -- # set +x 00:11:29.116 22:49:20 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:11:29.116 22:49:20 -- target/abort.sh@26 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode0 -t tcp -a 10.0.0.2 -s 4420 00:11:29.116 22:49:20 -- common/autotest_common.sh@551 -- # xtrace_disable 00:11:29.116 22:49:20 -- common/autotest_common.sh@10 -- # set +x 00:11:29.116 [2024-04-16 22:49:20.048904] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:11:29.116 22:49:20 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:11:29.116 22:49:20 -- target/abort.sh@27 -- # rpc_cmd nvmf_subsystem_add_listener discovery -t tcp -a 10.0.0.2 -s 4420 00:11:29.116 22:49:20 -- common/autotest_common.sh@551 -- # xtrace_disable 00:11:29.116 22:49:20 -- common/autotest_common.sh@10 -- # set +x 00:11:29.116 22:49:20 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:11:29.116 22:49:20 -- target/abort.sh@30 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/abort -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' -c 0x1 -t 1 -l warning -q 128 00:11:29.116 EAL: No free 2048 kB hugepages reported on node 1 00:11:29.116 [2024-04-16 22:49:20.154146] nvme_fabric.c: 295:nvme_fabric_discover_probe: *WARNING*: Skipping unsupported current discovery service or discovery service referral 00:11:31.648 Initializing NVMe Controllers 00:11:31.648 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode0 00:11:31.648 controller IO queue size 128 less than required 00:11:31.648 Consider using lower queue depth or small IO size because IO requests may be queued at the NVMe driver. 00:11:31.648 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode0) NSID 1 with lcore 0 00:11:31.648 Initialization complete. Launching workers. 00:11:31.648 NS: TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode0) NSID 1 I/O completed: 123, failed: 30694 00:11:31.648 CTRLR: TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode0) abort submitted 30755, failed to submit 62 00:11:31.648 success 30694, unsuccess 61, failed 0 00:11:31.648 22:49:22 -- target/abort.sh@34 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode0 00:11:31.648 22:49:22 -- common/autotest_common.sh@551 -- # xtrace_disable 00:11:31.648 22:49:22 -- common/autotest_common.sh@10 -- # set +x 00:11:31.648 22:49:22 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:11:31.648 22:49:22 -- target/abort.sh@36 -- # trap - SIGINT SIGTERM EXIT 00:11:31.648 22:49:22 -- target/abort.sh@38 -- # nvmftestfini 00:11:31.648 22:49:22 -- nvmf/common.sh@476 -- # nvmfcleanup 00:11:31.648 22:49:22 -- nvmf/common.sh@116 -- # sync 00:11:31.648 22:49:22 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:11:31.648 22:49:22 -- nvmf/common.sh@119 -- # set +e 00:11:31.648 22:49:22 -- nvmf/common.sh@120 -- # for i in {1..20} 00:11:31.648 22:49:22 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:11:31.648 rmmod nvme_tcp 00:11:31.648 rmmod nvme_fabrics 00:11:31.648 rmmod nvme_keyring 00:11:31.648 22:49:22 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:11:31.648 22:49:22 -- nvmf/common.sh@123 -- # set -e 00:11:31.648 22:49:22 -- nvmf/common.sh@124 -- # return 0 00:11:31.648 22:49:22 -- nvmf/common.sh@477 -- # '[' -n 227121 ']' 00:11:31.648 22:49:22 -- nvmf/common.sh@478 -- # killprocess 227121 00:11:31.648 22:49:22 -- common/autotest_common.sh@926 -- # '[' -z 227121 ']' 00:11:31.648 22:49:22 -- common/autotest_common.sh@930 -- # kill -0 227121 00:11:31.648 22:49:22 -- common/autotest_common.sh@931 -- # uname 00:11:31.648 22:49:22 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:11:31.648 22:49:22 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 227121 00:11:31.648 22:49:22 -- common/autotest_common.sh@932 -- # process_name=reactor_1 00:11:31.648 22:49:22 -- common/autotest_common.sh@936 -- # '[' reactor_1 = sudo ']' 00:11:31.648 22:49:22 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 227121' 00:11:31.648 killing process with pid 227121 00:11:31.648 22:49:22 -- common/autotest_common.sh@945 -- # kill 227121 00:11:31.648 22:49:22 -- common/autotest_common.sh@950 -- # wait 227121 00:11:31.648 22:49:22 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:11:31.648 22:49:22 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:11:31.648 22:49:22 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:11:31.648 22:49:22 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:11:31.648 22:49:22 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:11:31.648 22:49:22 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:11:31.648 22:49:22 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:11:31.648 22:49:22 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:11:34.180 22:49:24 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:11:34.180 00:11:34.180 real 0m7.982s 00:11:34.180 user 0m12.852s 00:11:34.180 sys 0m2.585s 00:11:34.180 22:49:24 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:11:34.180 22:49:24 -- common/autotest_common.sh@10 -- # set +x 00:11:34.180 ************************************ 00:11:34.180 END TEST nvmf_abort 00:11:34.180 ************************************ 00:11:34.180 22:49:24 -- nvmf/nvmf.sh@32 -- # run_test nvmf_ns_hotplug_stress /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/ns_hotplug_stress.sh --transport=tcp 00:11:34.180 22:49:24 -- common/autotest_common.sh@1077 -- # '[' 3 -le 1 ']' 00:11:34.180 22:49:24 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:11:34.180 22:49:24 -- common/autotest_common.sh@10 -- # set +x 00:11:34.180 ************************************ 00:11:34.180 START TEST nvmf_ns_hotplug_stress 00:11:34.180 ************************************ 00:11:34.180 22:49:24 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/ns_hotplug_stress.sh --transport=tcp 00:11:34.180 * Looking for test storage... 00:11:34.180 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:11:34.180 22:49:24 -- target/ns_hotplug_stress.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:11:34.180 22:49:24 -- nvmf/common.sh@7 -- # uname -s 00:11:34.180 22:49:24 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:11:34.180 22:49:24 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:11:34.180 22:49:24 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:11:34.180 22:49:24 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:11:34.180 22:49:24 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:11:34.180 22:49:24 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:11:34.180 22:49:24 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:11:34.180 22:49:24 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:11:34.180 22:49:24 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:11:34.180 22:49:24 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:11:34.180 22:49:24 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:11:34.180 22:49:24 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:11:34.180 22:49:24 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:11:34.180 22:49:24 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:11:34.180 22:49:24 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:11:34.180 22:49:24 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:11:34.180 22:49:24 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:11:34.180 22:49:24 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:11:34.180 22:49:24 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:11:34.180 22:49:24 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:11:34.180 22:49:24 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:11:34.180 22:49:24 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:11:34.181 22:49:24 -- paths/export.sh@5 -- # export PATH 00:11:34.181 22:49:24 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:11:34.181 22:49:24 -- nvmf/common.sh@46 -- # : 0 00:11:34.181 22:49:24 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:11:34.181 22:49:24 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:11:34.181 22:49:24 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:11:34.181 22:49:24 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:11:34.181 22:49:24 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:11:34.181 22:49:24 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:11:34.181 22:49:24 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:11:34.181 22:49:24 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:11:34.181 22:49:24 -- target/ns_hotplug_stress.sh@11 -- # rpc_py=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:11:34.181 22:49:24 -- target/ns_hotplug_stress.sh@13 -- # nvmftestinit 00:11:34.181 22:49:24 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:11:34.181 22:49:24 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:11:34.181 22:49:24 -- nvmf/common.sh@436 -- # prepare_net_devs 00:11:34.181 22:49:24 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:11:34.181 22:49:24 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:11:34.181 22:49:24 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:11:34.181 22:49:24 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:11:34.181 22:49:24 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:11:34.181 22:49:24 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:11:34.181 22:49:24 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:11:34.181 22:49:24 -- nvmf/common.sh@284 -- # xtrace_disable 00:11:34.181 22:49:24 -- common/autotest_common.sh@10 -- # set +x 00:11:36.081 22:49:26 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:11:36.081 22:49:26 -- nvmf/common.sh@290 -- # pci_devs=() 00:11:36.081 22:49:26 -- nvmf/common.sh@290 -- # local -a pci_devs 00:11:36.081 22:49:26 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:11:36.081 22:49:26 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:11:36.081 22:49:26 -- nvmf/common.sh@292 -- # pci_drivers=() 00:11:36.081 22:49:26 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:11:36.081 22:49:26 -- nvmf/common.sh@294 -- # net_devs=() 00:11:36.081 22:49:26 -- nvmf/common.sh@294 -- # local -ga net_devs 00:11:36.081 22:49:26 -- nvmf/common.sh@295 -- # e810=() 00:11:36.081 22:49:26 -- nvmf/common.sh@295 -- # local -ga e810 00:11:36.081 22:49:26 -- nvmf/common.sh@296 -- # x722=() 00:11:36.081 22:49:26 -- nvmf/common.sh@296 -- # local -ga x722 00:11:36.081 22:49:26 -- nvmf/common.sh@297 -- # mlx=() 00:11:36.081 22:49:26 -- nvmf/common.sh@297 -- # local -ga mlx 00:11:36.081 22:49:26 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:11:36.081 22:49:26 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:11:36.081 22:49:26 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:11:36.081 22:49:26 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:11:36.081 22:49:26 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:11:36.081 22:49:26 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:11:36.081 22:49:26 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:11:36.081 22:49:26 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:11:36.081 22:49:26 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:11:36.081 22:49:26 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:11:36.081 22:49:26 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:11:36.081 22:49:26 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:11:36.081 22:49:26 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:11:36.081 22:49:26 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:11:36.081 22:49:26 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:11:36.081 22:49:26 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:11:36.081 22:49:26 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:11:36.081 22:49:26 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:11:36.081 22:49:26 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:11:36.081 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:11:36.081 22:49:26 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:11:36.081 22:49:26 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:11:36.081 22:49:26 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:11:36.081 22:49:26 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:11:36.081 22:49:26 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:11:36.081 22:49:26 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:11:36.081 22:49:26 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:11:36.081 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:11:36.081 22:49:26 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:11:36.081 22:49:26 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:11:36.081 22:49:26 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:11:36.081 22:49:26 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:11:36.081 22:49:26 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:11:36.081 22:49:26 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:11:36.081 22:49:26 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:11:36.081 22:49:26 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:11:36.081 22:49:26 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:11:36.081 22:49:26 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:11:36.081 22:49:26 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:11:36.081 22:49:26 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:11:36.081 22:49:26 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:11:36.081 Found net devices under 0000:0a:00.0: cvl_0_0 00:11:36.081 22:49:26 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:11:36.081 22:49:26 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:11:36.081 22:49:26 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:11:36.081 22:49:26 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:11:36.081 22:49:26 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:11:36.081 22:49:26 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:11:36.081 Found net devices under 0000:0a:00.1: cvl_0_1 00:11:36.081 22:49:26 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:11:36.081 22:49:26 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:11:36.081 22:49:26 -- nvmf/common.sh@402 -- # is_hw=yes 00:11:36.081 22:49:26 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:11:36.081 22:49:26 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:11:36.081 22:49:26 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:11:36.081 22:49:26 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:11:36.081 22:49:26 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:11:36.081 22:49:26 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:11:36.081 22:49:26 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:11:36.081 22:49:26 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:11:36.081 22:49:26 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:11:36.081 22:49:26 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:11:36.081 22:49:26 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:11:36.081 22:49:26 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:11:36.081 22:49:26 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:11:36.081 22:49:26 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:11:36.081 22:49:26 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:11:36.081 22:49:26 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:11:36.081 22:49:26 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:11:36.081 22:49:26 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:11:36.081 22:49:26 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:11:36.081 22:49:26 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:11:36.081 22:49:26 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:11:36.081 22:49:26 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:11:36.081 22:49:26 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:11:36.081 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:11:36.081 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.208 ms 00:11:36.081 00:11:36.081 --- 10.0.0.2 ping statistics --- 00:11:36.081 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:11:36.081 rtt min/avg/max/mdev = 0.208/0.208/0.208/0.000 ms 00:11:36.081 22:49:26 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:11:36.081 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:11:36.081 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.083 ms 00:11:36.081 00:11:36.081 --- 10.0.0.1 ping statistics --- 00:11:36.081 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:11:36.081 rtt min/avg/max/mdev = 0.083/0.083/0.083/0.000 ms 00:11:36.081 22:49:26 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:11:36.081 22:49:26 -- nvmf/common.sh@410 -- # return 0 00:11:36.081 22:49:26 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:11:36.081 22:49:26 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:11:36.081 22:49:26 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:11:36.081 22:49:26 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:11:36.081 22:49:26 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:11:36.081 22:49:26 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:11:36.081 22:49:26 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:11:36.081 22:49:26 -- target/ns_hotplug_stress.sh@14 -- # nvmfappstart -m 0xE 00:11:36.081 22:49:26 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:11:36.081 22:49:26 -- common/autotest_common.sh@712 -- # xtrace_disable 00:11:36.081 22:49:26 -- common/autotest_common.sh@10 -- # set +x 00:11:36.081 22:49:26 -- nvmf/common.sh@469 -- # nvmfpid=229501 00:11:36.081 22:49:26 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xE 00:11:36.081 22:49:26 -- nvmf/common.sh@470 -- # waitforlisten 229501 00:11:36.081 22:49:26 -- common/autotest_common.sh@819 -- # '[' -z 229501 ']' 00:11:36.081 22:49:26 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk.sock 00:11:36.081 22:49:26 -- common/autotest_common.sh@824 -- # local max_retries=100 00:11:36.081 22:49:26 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:11:36.081 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:11:36.081 22:49:26 -- common/autotest_common.sh@828 -- # xtrace_disable 00:11:36.081 22:49:26 -- common/autotest_common.sh@10 -- # set +x 00:11:36.082 [2024-04-16 22:49:26.919218] Starting SPDK v24.01.1-pre git sha1 4b134b4ab / DPDK 23.11.0 initialization... 00:11:36.082 [2024-04-16 22:49:26.919303] [ DPDK EAL parameters: nvmf -c 0xE --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:11:36.082 EAL: No free 2048 kB hugepages reported on node 1 00:11:36.082 [2024-04-16 22:49:26.983818] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 3 00:11:36.082 [2024-04-16 22:49:27.092843] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:11:36.082 [2024-04-16 22:49:27.092993] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:11:36.082 [2024-04-16 22:49:27.093016] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:11:36.082 [2024-04-16 22:49:27.093029] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:11:36.082 [2024-04-16 22:49:27.093119] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:11:36.082 [2024-04-16 22:49:27.093192] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:11:36.082 [2024-04-16 22:49:27.093196] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:11:37.014 22:49:27 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:11:37.014 22:49:27 -- common/autotest_common.sh@852 -- # return 0 00:11:37.014 22:49:27 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:11:37.014 22:49:27 -- common/autotest_common.sh@718 -- # xtrace_disable 00:11:37.014 22:49:27 -- common/autotest_common.sh@10 -- # set +x 00:11:37.014 22:49:27 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:11:37.014 22:49:27 -- target/ns_hotplug_stress.sh@16 -- # null_size=1000 00:11:37.014 22:49:27 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_transport -t tcp -o -u 8192 00:11:37.014 [2024-04-16 22:49:28.105042] tcp.c: 659:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:11:37.014 22:49:28 -- target/ns_hotplug_stress.sh@20 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 -m 10 00:11:37.271 22:49:28 -- target/ns_hotplug_stress.sh@21 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:11:37.528 [2024-04-16 22:49:28.599776] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:11:37.528 22:49:28 -- target/ns_hotplug_stress.sh@22 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener discovery -t tcp -a 10.0.0.2 -s 4420 00:11:37.786 22:49:28 -- target/ns_hotplug_stress.sh@23 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 32 512 -b Malloc0 00:11:38.043 Malloc0 00:11:38.043 22:49:29 -- target/ns_hotplug_stress.sh@24 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_delay_create -b Malloc0 -d Delay0 -r 1000000 -t 1000000 -w 1000000 -n 1000000 00:11:38.300 Delay0 00:11:38.300 22:49:29 -- target/ns_hotplug_stress.sh@25 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:11:38.557 22:49:29 -- target/ns_hotplug_stress.sh@26 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_create NULL1 1000 512 00:11:38.814 NULL1 00:11:38.814 22:49:29 -- target/ns_hotplug_stress.sh@27 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 NULL1 00:11:39.071 22:49:30 -- target/ns_hotplug_stress.sh@33 -- # PERF_PID=229936 00:11:39.071 22:49:30 -- target/ns_hotplug_stress.sh@31 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -c 0x1 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' -t 30 -q 128 -w randread -o 512 -Q 1000 00:11:39.071 22:49:30 -- target/ns_hotplug_stress.sh@35 -- # kill -0 229936 00:11:39.071 22:49:30 -- target/ns_hotplug_stress.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:11:39.071 EAL: No free 2048 kB hugepages reported on node 1 00:11:40.441 Read completed with error (sct=0, sc=11) 00:11:40.441 22:49:31 -- target/ns_hotplug_stress.sh@37 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:11:40.441 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:11:40.441 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:11:40.441 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:11:40.441 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:11:40.441 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:11:40.441 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:11:40.441 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:11:40.441 22:49:31 -- target/ns_hotplug_stress.sh@40 -- # null_size=1001 00:11:40.441 22:49:31 -- target/ns_hotplug_stress.sh@41 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1001 00:11:40.699 true 00:11:40.699 22:49:31 -- target/ns_hotplug_stress.sh@35 -- # kill -0 229936 00:11:40.699 22:49:31 -- target/ns_hotplug_stress.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:11:41.630 22:49:32 -- target/ns_hotplug_stress.sh@37 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:11:41.892 22:49:32 -- target/ns_hotplug_stress.sh@40 -- # null_size=1002 00:11:41.892 22:49:32 -- target/ns_hotplug_stress.sh@41 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1002 00:11:42.195 true 00:11:42.195 22:49:33 -- target/ns_hotplug_stress.sh@35 -- # kill -0 229936 00:11:42.195 22:49:33 -- target/ns_hotplug_stress.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:11:42.452 22:49:33 -- target/ns_hotplug_stress.sh@37 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:11:42.452 22:49:33 -- target/ns_hotplug_stress.sh@40 -- # null_size=1003 00:11:42.452 22:49:33 -- target/ns_hotplug_stress.sh@41 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1003 00:11:42.711 true 00:11:42.711 22:49:33 -- target/ns_hotplug_stress.sh@35 -- # kill -0 229936 00:11:42.711 22:49:33 -- target/ns_hotplug_stress.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:11:43.643 22:49:34 -- target/ns_hotplug_stress.sh@37 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:11:43.643 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:11:43.643 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:11:43.643 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:11:43.900 22:49:34 -- target/ns_hotplug_stress.sh@40 -- # null_size=1004 00:11:43.900 22:49:34 -- target/ns_hotplug_stress.sh@41 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1004 00:11:44.158 true 00:11:44.158 22:49:35 -- target/ns_hotplug_stress.sh@35 -- # kill -0 229936 00:11:44.158 22:49:35 -- target/ns_hotplug_stress.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:11:44.416 22:49:35 -- target/ns_hotplug_stress.sh@37 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:11:44.673 22:49:35 -- target/ns_hotplug_stress.sh@40 -- # null_size=1005 00:11:44.673 22:49:35 -- target/ns_hotplug_stress.sh@41 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1005 00:11:44.931 true 00:11:44.931 22:49:35 -- target/ns_hotplug_stress.sh@35 -- # kill -0 229936 00:11:44.931 22:49:35 -- target/ns_hotplug_stress.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:11:45.864 22:49:36 -- target/ns_hotplug_stress.sh@37 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:11:45.864 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:11:46.121 22:49:37 -- target/ns_hotplug_stress.sh@40 -- # null_size=1006 00:11:46.122 22:49:37 -- target/ns_hotplug_stress.sh@41 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1006 00:11:46.379 true 00:11:46.379 22:49:37 -- target/ns_hotplug_stress.sh@35 -- # kill -0 229936 00:11:46.379 22:49:37 -- target/ns_hotplug_stress.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:11:46.637 22:49:37 -- target/ns_hotplug_stress.sh@37 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:11:46.637 22:49:37 -- target/ns_hotplug_stress.sh@40 -- # null_size=1007 00:11:46.637 22:49:37 -- target/ns_hotplug_stress.sh@41 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1007 00:11:46.895 true 00:11:46.895 22:49:38 -- target/ns_hotplug_stress.sh@35 -- # kill -0 229936 00:11:46.895 22:49:38 -- target/ns_hotplug_stress.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:11:48.267 22:49:39 -- target/ns_hotplug_stress.sh@37 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:11:48.267 22:49:39 -- target/ns_hotplug_stress.sh@40 -- # null_size=1008 00:11:48.267 22:49:39 -- target/ns_hotplug_stress.sh@41 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1008 00:11:48.525 true 00:11:48.525 22:49:39 -- target/ns_hotplug_stress.sh@35 -- # kill -0 229936 00:11:48.525 22:49:39 -- target/ns_hotplug_stress.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:11:48.782 22:49:39 -- target/ns_hotplug_stress.sh@37 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:11:49.040 22:49:39 -- target/ns_hotplug_stress.sh@40 -- # null_size=1009 00:11:49.040 22:49:39 -- target/ns_hotplug_stress.sh@41 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1009 00:11:49.298 true 00:11:49.298 22:49:40 -- target/ns_hotplug_stress.sh@35 -- # kill -0 229936 00:11:49.298 22:49:40 -- target/ns_hotplug_stress.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:11:50.231 22:49:41 -- target/ns_hotplug_stress.sh@37 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:11:50.231 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:11:50.231 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:11:50.231 22:49:41 -- target/ns_hotplug_stress.sh@40 -- # null_size=1010 00:11:50.231 22:49:41 -- target/ns_hotplug_stress.sh@41 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1010 00:11:50.489 true 00:11:50.489 22:49:41 -- target/ns_hotplug_stress.sh@35 -- # kill -0 229936 00:11:50.489 22:49:41 -- target/ns_hotplug_stress.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:11:50.746 22:49:41 -- target/ns_hotplug_stress.sh@37 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:11:51.004 22:49:42 -- target/ns_hotplug_stress.sh@40 -- # null_size=1011 00:11:51.004 22:49:42 -- target/ns_hotplug_stress.sh@41 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1011 00:11:51.262 true 00:11:51.262 22:49:42 -- target/ns_hotplug_stress.sh@35 -- # kill -0 229936 00:11:51.262 22:49:42 -- target/ns_hotplug_stress.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:11:52.195 22:49:43 -- target/ns_hotplug_stress.sh@37 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:11:52.195 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:11:52.453 22:49:43 -- target/ns_hotplug_stress.sh@40 -- # null_size=1012 00:11:52.453 22:49:43 -- target/ns_hotplug_stress.sh@41 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1012 00:11:52.711 true 00:11:52.711 22:49:43 -- target/ns_hotplug_stress.sh@35 -- # kill -0 229936 00:11:52.711 22:49:43 -- target/ns_hotplug_stress.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:11:52.969 22:49:43 -- target/ns_hotplug_stress.sh@37 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:11:53.227 22:49:44 -- target/ns_hotplug_stress.sh@40 -- # null_size=1013 00:11:53.227 22:49:44 -- target/ns_hotplug_stress.sh@41 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1013 00:11:53.484 true 00:11:53.484 22:49:44 -- target/ns_hotplug_stress.sh@35 -- # kill -0 229936 00:11:53.484 22:49:44 -- target/ns_hotplug_stress.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:11:54.416 22:49:45 -- target/ns_hotplug_stress.sh@37 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:11:54.674 22:49:45 -- target/ns_hotplug_stress.sh@40 -- # null_size=1014 00:11:54.674 22:49:45 -- target/ns_hotplug_stress.sh@41 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1014 00:11:54.931 true 00:11:54.932 22:49:45 -- target/ns_hotplug_stress.sh@35 -- # kill -0 229936 00:11:54.932 22:49:45 -- target/ns_hotplug_stress.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:11:55.189 22:49:46 -- target/ns_hotplug_stress.sh@37 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:11:55.446 22:49:46 -- target/ns_hotplug_stress.sh@40 -- # null_size=1015 00:11:55.446 22:49:46 -- target/ns_hotplug_stress.sh@41 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1015 00:11:55.703 true 00:11:55.703 22:49:46 -- target/ns_hotplug_stress.sh@35 -- # kill -0 229936 00:11:55.703 22:49:46 -- target/ns_hotplug_stress.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:11:55.960 22:49:46 -- target/ns_hotplug_stress.sh@37 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:11:55.960 22:49:47 -- target/ns_hotplug_stress.sh@40 -- # null_size=1016 00:11:55.960 22:49:47 -- target/ns_hotplug_stress.sh@41 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1016 00:11:56.218 true 00:11:56.218 22:49:47 -- target/ns_hotplug_stress.sh@35 -- # kill -0 229936 00:11:56.218 22:49:47 -- target/ns_hotplug_stress.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:11:57.591 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:11:57.591 22:49:48 -- target/ns_hotplug_stress.sh@37 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:11:57.591 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:11:57.591 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:11:57.591 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:11:57.591 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:11:57.591 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:11:57.591 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:11:57.591 22:49:48 -- target/ns_hotplug_stress.sh@40 -- # null_size=1017 00:11:57.591 22:49:48 -- target/ns_hotplug_stress.sh@41 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1017 00:11:57.849 true 00:11:57.849 22:49:48 -- target/ns_hotplug_stress.sh@35 -- # kill -0 229936 00:11:57.849 22:49:48 -- target/ns_hotplug_stress.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:11:58.782 22:49:49 -- target/ns_hotplug_stress.sh@37 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:11:58.782 22:49:49 -- target/ns_hotplug_stress.sh@40 -- # null_size=1018 00:11:58.782 22:49:49 -- target/ns_hotplug_stress.sh@41 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1018 00:11:59.348 true 00:11:59.348 22:49:50 -- target/ns_hotplug_stress.sh@35 -- # kill -0 229936 00:11:59.348 22:49:50 -- target/ns_hotplug_stress.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:11:59.348 22:49:50 -- target/ns_hotplug_stress.sh@37 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:11:59.607 22:49:50 -- target/ns_hotplug_stress.sh@40 -- # null_size=1019 00:11:59.607 22:49:50 -- target/ns_hotplug_stress.sh@41 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1019 00:11:59.906 true 00:11:59.906 22:49:50 -- target/ns_hotplug_stress.sh@35 -- # kill -0 229936 00:11:59.906 22:49:50 -- target/ns_hotplug_stress.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:12:00.164 22:49:51 -- target/ns_hotplug_stress.sh@37 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:12:00.422 22:49:51 -- target/ns_hotplug_stress.sh@40 -- # null_size=1020 00:12:00.422 22:49:51 -- target/ns_hotplug_stress.sh@41 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1020 00:12:00.679 true 00:12:00.679 22:49:51 -- target/ns_hotplug_stress.sh@35 -- # kill -0 229936 00:12:00.679 22:49:51 -- target/ns_hotplug_stress.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:12:02.052 22:49:52 -- target/ns_hotplug_stress.sh@37 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:12:02.052 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:12:02.052 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:12:02.052 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:12:02.052 22:49:52 -- target/ns_hotplug_stress.sh@40 -- # null_size=1021 00:12:02.052 22:49:52 -- target/ns_hotplug_stress.sh@41 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1021 00:12:02.309 true 00:12:02.309 22:49:53 -- target/ns_hotplug_stress.sh@35 -- # kill -0 229936 00:12:02.309 22:49:53 -- target/ns_hotplug_stress.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:12:02.567 22:49:53 -- target/ns_hotplug_stress.sh@37 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:12:02.825 22:49:53 -- target/ns_hotplug_stress.sh@40 -- # null_size=1022 00:12:02.825 22:49:53 -- target/ns_hotplug_stress.sh@41 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1022 00:12:03.082 true 00:12:03.082 22:49:53 -- target/ns_hotplug_stress.sh@35 -- # kill -0 229936 00:12:03.082 22:49:53 -- target/ns_hotplug_stress.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:12:04.012 22:49:54 -- target/ns_hotplug_stress.sh@37 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:12:04.012 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:12:04.012 22:49:55 -- target/ns_hotplug_stress.sh@40 -- # null_size=1023 00:12:04.012 22:49:55 -- target/ns_hotplug_stress.sh@41 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1023 00:12:04.269 true 00:12:04.269 22:49:55 -- target/ns_hotplug_stress.sh@35 -- # kill -0 229936 00:12:04.269 22:49:55 -- target/ns_hotplug_stress.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:12:04.526 22:49:55 -- target/ns_hotplug_stress.sh@37 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:12:04.783 22:49:55 -- target/ns_hotplug_stress.sh@40 -- # null_size=1024 00:12:04.783 22:49:55 -- target/ns_hotplug_stress.sh@41 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1024 00:12:05.040 true 00:12:05.040 22:49:56 -- target/ns_hotplug_stress.sh@35 -- # kill -0 229936 00:12:05.040 22:49:56 -- target/ns_hotplug_stress.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:12:05.970 22:49:57 -- target/ns_hotplug_stress.sh@37 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:12:05.971 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:12:06.227 22:49:57 -- target/ns_hotplug_stress.sh@40 -- # null_size=1025 00:12:06.227 22:49:57 -- target/ns_hotplug_stress.sh@41 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1025 00:12:06.485 true 00:12:06.485 22:49:57 -- target/ns_hotplug_stress.sh@35 -- # kill -0 229936 00:12:06.485 22:49:57 -- target/ns_hotplug_stress.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:12:06.742 22:49:57 -- target/ns_hotplug_stress.sh@37 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:12:07.000 22:49:58 -- target/ns_hotplug_stress.sh@40 -- # null_size=1026 00:12:07.000 22:49:58 -- target/ns_hotplug_stress.sh@41 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1026 00:12:07.257 true 00:12:07.257 22:49:58 -- target/ns_hotplug_stress.sh@35 -- # kill -0 229936 00:12:07.257 22:49:58 -- target/ns_hotplug_stress.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:12:08.189 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:12:08.189 22:49:59 -- target/ns_hotplug_stress.sh@37 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:12:08.447 22:49:59 -- target/ns_hotplug_stress.sh@40 -- # null_size=1027 00:12:08.447 22:49:59 -- target/ns_hotplug_stress.sh@41 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1027 00:12:08.705 true 00:12:08.705 22:49:59 -- target/ns_hotplug_stress.sh@35 -- # kill -0 229936 00:12:08.705 22:49:59 -- target/ns_hotplug_stress.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:12:08.963 22:49:59 -- target/ns_hotplug_stress.sh@37 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:12:09.221 22:50:00 -- target/ns_hotplug_stress.sh@40 -- # null_size=1028 00:12:09.221 22:50:00 -- target/ns_hotplug_stress.sh@41 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1028 00:12:09.479 true 00:12:09.479 22:50:00 -- target/ns_hotplug_stress.sh@35 -- # kill -0 229936 00:12:09.479 22:50:00 -- target/ns_hotplug_stress.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:12:10.412 Initializing NVMe Controllers 00:12:10.412 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:12:10.412 Controller IO queue size 128, less than required. 00:12:10.412 Consider using lower queue depth or smaller IO size, because IO requests may be queued at the NVMe driver. 00:12:10.412 Controller IO queue size 128, less than required. 00:12:10.412 Consider using lower queue depth or smaller IO size, because IO requests may be queued at the NVMe driver. 00:12:10.412 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 0 00:12:10.412 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 2 with lcore 0 00:12:10.412 Initialization complete. Launching workers. 00:12:10.412 ======================================================== 00:12:10.412 Latency(us) 00:12:10.412 Device Information : IOPS MiB/s Average min max 00:12:10.412 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 0: 977.94 0.48 73410.15 2323.77 1108951.37 00:12:10.412 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 2 from core 0: 12225.55 5.97 10470.61 2334.86 437678.37 00:12:10.412 ======================================================== 00:12:10.412 Total : 13203.49 6.45 15132.34 2323.77 1108951.37 00:12:10.412 00:12:10.412 22:50:01 -- target/ns_hotplug_stress.sh@37 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:12:10.668 22:50:01 -- target/ns_hotplug_stress.sh@40 -- # null_size=1029 00:12:10.668 22:50:01 -- target/ns_hotplug_stress.sh@41 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1029 00:12:10.926 true 00:12:10.926 22:50:01 -- target/ns_hotplug_stress.sh@35 -- # kill -0 229936 00:12:10.926 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/ns_hotplug_stress.sh: line 35: kill: (229936) - No such process 00:12:10.926 22:50:01 -- target/ns_hotplug_stress.sh@44 -- # wait 229936 00:12:10.926 22:50:01 -- target/ns_hotplug_stress.sh@46 -- # trap - SIGINT SIGTERM EXIT 00:12:10.926 22:50:01 -- target/ns_hotplug_stress.sh@48 -- # nvmftestfini 00:12:10.926 22:50:01 -- nvmf/common.sh@476 -- # nvmfcleanup 00:12:10.926 22:50:01 -- nvmf/common.sh@116 -- # sync 00:12:10.926 22:50:01 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:12:10.926 22:50:01 -- nvmf/common.sh@119 -- # set +e 00:12:10.926 22:50:01 -- nvmf/common.sh@120 -- # for i in {1..20} 00:12:10.926 22:50:01 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:12:10.926 rmmod nvme_tcp 00:12:10.926 rmmod nvme_fabrics 00:12:10.926 rmmod nvme_keyring 00:12:10.926 22:50:01 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:12:10.926 22:50:01 -- nvmf/common.sh@123 -- # set -e 00:12:10.926 22:50:01 -- nvmf/common.sh@124 -- # return 0 00:12:10.926 22:50:01 -- nvmf/common.sh@477 -- # '[' -n 229501 ']' 00:12:10.926 22:50:01 -- nvmf/common.sh@478 -- # killprocess 229501 00:12:10.926 22:50:01 -- common/autotest_common.sh@926 -- # '[' -z 229501 ']' 00:12:10.926 22:50:01 -- common/autotest_common.sh@930 -- # kill -0 229501 00:12:10.926 22:50:01 -- common/autotest_common.sh@931 -- # uname 00:12:10.926 22:50:01 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:12:10.926 22:50:01 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 229501 00:12:10.926 22:50:01 -- common/autotest_common.sh@932 -- # process_name=reactor_1 00:12:10.926 22:50:01 -- common/autotest_common.sh@936 -- # '[' reactor_1 = sudo ']' 00:12:10.926 22:50:01 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 229501' 00:12:10.926 killing process with pid 229501 00:12:10.926 22:50:01 -- common/autotest_common.sh@945 -- # kill 229501 00:12:10.926 22:50:01 -- common/autotest_common.sh@950 -- # wait 229501 00:12:11.185 22:50:02 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:12:11.185 22:50:02 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:12:11.185 22:50:02 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:12:11.186 22:50:02 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:12:11.186 22:50:02 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:12:11.186 22:50:02 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:12:11.186 22:50:02 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:12:11.186 22:50:02 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:12:13.719 22:50:04 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:12:13.719 00:12:13.719 real 0m39.510s 00:12:13.719 user 2m33.476s 00:12:13.719 sys 0m9.988s 00:12:13.719 22:50:04 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:12:13.719 22:50:04 -- common/autotest_common.sh@10 -- # set +x 00:12:13.719 ************************************ 00:12:13.719 END TEST nvmf_ns_hotplug_stress 00:12:13.719 ************************************ 00:12:13.719 22:50:04 -- nvmf/nvmf.sh@33 -- # run_test nvmf_connect_stress /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/connect_stress.sh --transport=tcp 00:12:13.719 22:50:04 -- common/autotest_common.sh@1077 -- # '[' 3 -le 1 ']' 00:12:13.719 22:50:04 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:12:13.719 22:50:04 -- common/autotest_common.sh@10 -- # set +x 00:12:13.719 ************************************ 00:12:13.719 START TEST nvmf_connect_stress 00:12:13.719 ************************************ 00:12:13.719 22:50:04 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/connect_stress.sh --transport=tcp 00:12:13.719 * Looking for test storage... 00:12:13.719 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:12:13.719 22:50:04 -- target/connect_stress.sh@10 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:12:13.719 22:50:04 -- nvmf/common.sh@7 -- # uname -s 00:12:13.719 22:50:04 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:12:13.719 22:50:04 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:12:13.719 22:50:04 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:12:13.719 22:50:04 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:12:13.719 22:50:04 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:12:13.719 22:50:04 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:12:13.719 22:50:04 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:12:13.719 22:50:04 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:12:13.719 22:50:04 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:12:13.719 22:50:04 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:12:13.719 22:50:04 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:12:13.719 22:50:04 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:12:13.719 22:50:04 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:12:13.719 22:50:04 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:12:13.719 22:50:04 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:12:13.719 22:50:04 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:12:13.719 22:50:04 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:12:13.719 22:50:04 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:12:13.719 22:50:04 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:12:13.719 22:50:04 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:12:13.719 22:50:04 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:12:13.720 22:50:04 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:12:13.720 22:50:04 -- paths/export.sh@5 -- # export PATH 00:12:13.720 22:50:04 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:12:13.720 22:50:04 -- nvmf/common.sh@46 -- # : 0 00:12:13.720 22:50:04 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:12:13.720 22:50:04 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:12:13.720 22:50:04 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:12:13.720 22:50:04 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:12:13.720 22:50:04 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:12:13.720 22:50:04 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:12:13.720 22:50:04 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:12:13.720 22:50:04 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:12:13.720 22:50:04 -- target/connect_stress.sh@12 -- # nvmftestinit 00:12:13.720 22:50:04 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:12:13.720 22:50:04 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:12:13.720 22:50:04 -- nvmf/common.sh@436 -- # prepare_net_devs 00:12:13.720 22:50:04 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:12:13.720 22:50:04 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:12:13.720 22:50:04 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:12:13.720 22:50:04 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:12:13.720 22:50:04 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:12:13.720 22:50:04 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:12:13.720 22:50:04 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:12:13.720 22:50:04 -- nvmf/common.sh@284 -- # xtrace_disable 00:12:13.720 22:50:04 -- common/autotest_common.sh@10 -- # set +x 00:12:15.618 22:50:06 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:12:15.618 22:50:06 -- nvmf/common.sh@290 -- # pci_devs=() 00:12:15.618 22:50:06 -- nvmf/common.sh@290 -- # local -a pci_devs 00:12:15.618 22:50:06 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:12:15.618 22:50:06 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:12:15.618 22:50:06 -- nvmf/common.sh@292 -- # pci_drivers=() 00:12:15.618 22:50:06 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:12:15.618 22:50:06 -- nvmf/common.sh@294 -- # net_devs=() 00:12:15.618 22:50:06 -- nvmf/common.sh@294 -- # local -ga net_devs 00:12:15.618 22:50:06 -- nvmf/common.sh@295 -- # e810=() 00:12:15.618 22:50:06 -- nvmf/common.sh@295 -- # local -ga e810 00:12:15.618 22:50:06 -- nvmf/common.sh@296 -- # x722=() 00:12:15.618 22:50:06 -- nvmf/common.sh@296 -- # local -ga x722 00:12:15.618 22:50:06 -- nvmf/common.sh@297 -- # mlx=() 00:12:15.618 22:50:06 -- nvmf/common.sh@297 -- # local -ga mlx 00:12:15.618 22:50:06 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:12:15.618 22:50:06 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:12:15.618 22:50:06 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:12:15.618 22:50:06 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:12:15.618 22:50:06 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:12:15.618 22:50:06 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:12:15.618 22:50:06 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:12:15.618 22:50:06 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:12:15.618 22:50:06 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:12:15.618 22:50:06 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:12:15.618 22:50:06 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:12:15.618 22:50:06 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:12:15.618 22:50:06 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:12:15.618 22:50:06 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:12:15.618 22:50:06 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:12:15.618 22:50:06 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:12:15.618 22:50:06 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:12:15.618 22:50:06 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:12:15.618 22:50:06 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:12:15.618 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:12:15.618 22:50:06 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:12:15.618 22:50:06 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:12:15.618 22:50:06 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:12:15.618 22:50:06 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:12:15.618 22:50:06 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:12:15.618 22:50:06 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:12:15.618 22:50:06 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:12:15.618 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:12:15.618 22:50:06 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:12:15.618 22:50:06 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:12:15.618 22:50:06 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:12:15.618 22:50:06 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:12:15.618 22:50:06 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:12:15.618 22:50:06 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:12:15.618 22:50:06 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:12:15.618 22:50:06 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:12:15.618 22:50:06 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:12:15.618 22:50:06 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:12:15.618 22:50:06 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:12:15.618 22:50:06 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:12:15.618 22:50:06 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:12:15.618 Found net devices under 0000:0a:00.0: cvl_0_0 00:12:15.618 22:50:06 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:12:15.618 22:50:06 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:12:15.618 22:50:06 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:12:15.618 22:50:06 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:12:15.618 22:50:06 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:12:15.618 22:50:06 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:12:15.618 Found net devices under 0000:0a:00.1: cvl_0_1 00:12:15.618 22:50:06 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:12:15.618 22:50:06 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:12:15.618 22:50:06 -- nvmf/common.sh@402 -- # is_hw=yes 00:12:15.618 22:50:06 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:12:15.618 22:50:06 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:12:15.618 22:50:06 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:12:15.618 22:50:06 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:12:15.619 22:50:06 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:12:15.619 22:50:06 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:12:15.619 22:50:06 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:12:15.619 22:50:06 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:12:15.619 22:50:06 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:12:15.619 22:50:06 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:12:15.619 22:50:06 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:12:15.619 22:50:06 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:12:15.619 22:50:06 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:12:15.619 22:50:06 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:12:15.619 22:50:06 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:12:15.619 22:50:06 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:12:15.619 22:50:06 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:12:15.619 22:50:06 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:12:15.619 22:50:06 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:12:15.619 22:50:06 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:12:15.619 22:50:06 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:12:15.619 22:50:06 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:12:15.619 22:50:06 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:12:15.619 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:12:15.619 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.196 ms 00:12:15.619 00:12:15.619 --- 10.0.0.2 ping statistics --- 00:12:15.619 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:12:15.619 rtt min/avg/max/mdev = 0.196/0.196/0.196/0.000 ms 00:12:15.619 22:50:06 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:12:15.619 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:12:15.619 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.149 ms 00:12:15.619 00:12:15.619 --- 10.0.0.1 ping statistics --- 00:12:15.619 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:12:15.619 rtt min/avg/max/mdev = 0.149/0.149/0.149/0.000 ms 00:12:15.619 22:50:06 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:12:15.619 22:50:06 -- nvmf/common.sh@410 -- # return 0 00:12:15.619 22:50:06 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:12:15.619 22:50:06 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:12:15.619 22:50:06 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:12:15.619 22:50:06 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:12:15.619 22:50:06 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:12:15.619 22:50:06 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:12:15.619 22:50:06 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:12:15.619 22:50:06 -- target/connect_stress.sh@13 -- # nvmfappstart -m 0xE 00:12:15.619 22:50:06 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:12:15.619 22:50:06 -- common/autotest_common.sh@712 -- # xtrace_disable 00:12:15.619 22:50:06 -- common/autotest_common.sh@10 -- # set +x 00:12:15.619 22:50:06 -- nvmf/common.sh@469 -- # nvmfpid=235891 00:12:15.619 22:50:06 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xE 00:12:15.619 22:50:06 -- nvmf/common.sh@470 -- # waitforlisten 235891 00:12:15.619 22:50:06 -- common/autotest_common.sh@819 -- # '[' -z 235891 ']' 00:12:15.619 22:50:06 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk.sock 00:12:15.619 22:50:06 -- common/autotest_common.sh@824 -- # local max_retries=100 00:12:15.619 22:50:06 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:12:15.619 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:12:15.619 22:50:06 -- common/autotest_common.sh@828 -- # xtrace_disable 00:12:15.619 22:50:06 -- common/autotest_common.sh@10 -- # set +x 00:12:15.619 [2024-04-16 22:50:06.429610] Starting SPDK v24.01.1-pre git sha1 4b134b4ab / DPDK 23.11.0 initialization... 00:12:15.619 [2024-04-16 22:50:06.429688] [ DPDK EAL parameters: nvmf -c 0xE --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:12:15.619 EAL: No free 2048 kB hugepages reported on node 1 00:12:15.619 [2024-04-16 22:50:06.493512] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 3 00:12:15.619 [2024-04-16 22:50:06.600783] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:12:15.619 [2024-04-16 22:50:06.600924] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:12:15.619 [2024-04-16 22:50:06.600942] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:12:15.619 [2024-04-16 22:50:06.600954] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:12:15.619 [2024-04-16 22:50:06.601042] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:12:15.619 [2024-04-16 22:50:06.601105] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:12:15.619 [2024-04-16 22:50:06.601108] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:12:16.552 22:50:07 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:12:16.552 22:50:07 -- common/autotest_common.sh@852 -- # return 0 00:12:16.552 22:50:07 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:12:16.552 22:50:07 -- common/autotest_common.sh@718 -- # xtrace_disable 00:12:16.552 22:50:07 -- common/autotest_common.sh@10 -- # set +x 00:12:16.552 22:50:07 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:12:16.552 22:50:07 -- target/connect_stress.sh@15 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:12:16.552 22:50:07 -- common/autotest_common.sh@551 -- # xtrace_disable 00:12:16.552 22:50:07 -- common/autotest_common.sh@10 -- # set +x 00:12:16.552 [2024-04-16 22:50:07.416320] tcp.c: 659:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:12:16.552 22:50:07 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:12:16.552 22:50:07 -- target/connect_stress.sh@16 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 -m 10 00:12:16.552 22:50:07 -- common/autotest_common.sh@551 -- # xtrace_disable 00:12:16.552 22:50:07 -- common/autotest_common.sh@10 -- # set +x 00:12:16.552 22:50:07 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:12:16.552 22:50:07 -- target/connect_stress.sh@17 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:12:16.552 22:50:07 -- common/autotest_common.sh@551 -- # xtrace_disable 00:12:16.552 22:50:07 -- common/autotest_common.sh@10 -- # set +x 00:12:16.552 [2024-04-16 22:50:07.443323] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:12:16.552 22:50:07 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:12:16.552 22:50:07 -- target/connect_stress.sh@18 -- # rpc_cmd bdev_null_create NULL1 1000 512 00:12:16.552 22:50:07 -- common/autotest_common.sh@551 -- # xtrace_disable 00:12:16.552 22:50:07 -- common/autotest_common.sh@10 -- # set +x 00:12:16.552 NULL1 00:12:16.552 22:50:07 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:12:16.552 22:50:07 -- target/connect_stress.sh@21 -- # PERF_PID=236050 00:12:16.552 22:50:07 -- target/connect_stress.sh@23 -- # rpcs=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/rpc.txt 00:12:16.552 22:50:07 -- target/connect_stress.sh@25 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/rpc.txt 00:12:16.552 22:50:07 -- target/connect_stress.sh@20 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvme/connect_stress/connect_stress -c 0x1 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1' -t 10 00:12:16.552 22:50:07 -- target/connect_stress.sh@27 -- # seq 1 20 00:12:16.552 22:50:07 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:12:16.552 22:50:07 -- target/connect_stress.sh@28 -- # cat 00:12:16.552 22:50:07 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:12:16.552 22:50:07 -- target/connect_stress.sh@28 -- # cat 00:12:16.552 22:50:07 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:12:16.552 22:50:07 -- target/connect_stress.sh@28 -- # cat 00:12:16.552 22:50:07 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:12:16.552 22:50:07 -- target/connect_stress.sh@28 -- # cat 00:12:16.552 22:50:07 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:12:16.552 22:50:07 -- target/connect_stress.sh@28 -- # cat 00:12:16.552 22:50:07 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:12:16.552 22:50:07 -- target/connect_stress.sh@28 -- # cat 00:12:16.552 22:50:07 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:12:16.552 22:50:07 -- target/connect_stress.sh@28 -- # cat 00:12:16.552 22:50:07 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:12:16.552 22:50:07 -- target/connect_stress.sh@28 -- # cat 00:12:16.552 22:50:07 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:12:16.552 22:50:07 -- target/connect_stress.sh@28 -- # cat 00:12:16.552 22:50:07 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:12:16.553 22:50:07 -- target/connect_stress.sh@28 -- # cat 00:12:16.553 22:50:07 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:12:16.553 22:50:07 -- target/connect_stress.sh@28 -- # cat 00:12:16.553 22:50:07 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:12:16.553 22:50:07 -- target/connect_stress.sh@28 -- # cat 00:12:16.553 EAL: No free 2048 kB hugepages reported on node 1 00:12:16.553 22:50:07 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:12:16.553 22:50:07 -- target/connect_stress.sh@28 -- # cat 00:12:16.553 22:50:07 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:12:16.553 22:50:07 -- target/connect_stress.sh@28 -- # cat 00:12:16.553 22:50:07 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:12:16.553 22:50:07 -- target/connect_stress.sh@28 -- # cat 00:12:16.553 22:50:07 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:12:16.553 22:50:07 -- target/connect_stress.sh@28 -- # cat 00:12:16.553 22:50:07 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:12:16.553 22:50:07 -- target/connect_stress.sh@28 -- # cat 00:12:16.553 22:50:07 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:12:16.553 22:50:07 -- target/connect_stress.sh@28 -- # cat 00:12:16.553 22:50:07 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:12:16.553 22:50:07 -- target/connect_stress.sh@28 -- # cat 00:12:16.553 22:50:07 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:12:16.553 22:50:07 -- target/connect_stress.sh@28 -- # cat 00:12:16.553 22:50:07 -- target/connect_stress.sh@34 -- # kill -0 236050 00:12:16.553 22:50:07 -- target/connect_stress.sh@35 -- # rpc_cmd 00:12:16.553 22:50:07 -- common/autotest_common.sh@551 -- # xtrace_disable 00:12:16.553 22:50:07 -- common/autotest_common.sh@10 -- # set +x 00:12:16.810 22:50:07 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:12:16.810 22:50:07 -- target/connect_stress.sh@34 -- # kill -0 236050 00:12:16.810 22:50:07 -- target/connect_stress.sh@35 -- # rpc_cmd 00:12:16.810 22:50:07 -- common/autotest_common.sh@551 -- # xtrace_disable 00:12:16.810 22:50:07 -- common/autotest_common.sh@10 -- # set +x 00:12:17.068 22:50:08 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:12:17.068 22:50:08 -- target/connect_stress.sh@34 -- # kill -0 236050 00:12:17.068 22:50:08 -- target/connect_stress.sh@35 -- # rpc_cmd 00:12:17.068 22:50:08 -- common/autotest_common.sh@551 -- # xtrace_disable 00:12:17.068 22:50:08 -- common/autotest_common.sh@10 -- # set +x 00:12:17.632 22:50:08 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:12:17.632 22:50:08 -- target/connect_stress.sh@34 -- # kill -0 236050 00:12:17.632 22:50:08 -- target/connect_stress.sh@35 -- # rpc_cmd 00:12:17.632 22:50:08 -- common/autotest_common.sh@551 -- # xtrace_disable 00:12:17.632 22:50:08 -- common/autotest_common.sh@10 -- # set +x 00:12:17.889 22:50:08 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:12:17.889 22:50:08 -- target/connect_stress.sh@34 -- # kill -0 236050 00:12:17.889 22:50:08 -- target/connect_stress.sh@35 -- # rpc_cmd 00:12:17.889 22:50:08 -- common/autotest_common.sh@551 -- # xtrace_disable 00:12:17.889 22:50:08 -- common/autotest_common.sh@10 -- # set +x 00:12:18.146 22:50:09 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:12:18.146 22:50:09 -- target/connect_stress.sh@34 -- # kill -0 236050 00:12:18.146 22:50:09 -- target/connect_stress.sh@35 -- # rpc_cmd 00:12:18.146 22:50:09 -- common/autotest_common.sh@551 -- # xtrace_disable 00:12:18.146 22:50:09 -- common/autotest_common.sh@10 -- # set +x 00:12:18.403 22:50:09 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:12:18.403 22:50:09 -- target/connect_stress.sh@34 -- # kill -0 236050 00:12:18.403 22:50:09 -- target/connect_stress.sh@35 -- # rpc_cmd 00:12:18.403 22:50:09 -- common/autotest_common.sh@551 -- # xtrace_disable 00:12:18.403 22:50:09 -- common/autotest_common.sh@10 -- # set +x 00:12:18.688 22:50:09 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:12:18.688 22:50:09 -- target/connect_stress.sh@34 -- # kill -0 236050 00:12:18.688 22:50:09 -- target/connect_stress.sh@35 -- # rpc_cmd 00:12:18.688 22:50:09 -- common/autotest_common.sh@551 -- # xtrace_disable 00:12:18.688 22:50:09 -- common/autotest_common.sh@10 -- # set +x 00:12:18.947 22:50:10 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:12:18.947 22:50:10 -- target/connect_stress.sh@34 -- # kill -0 236050 00:12:18.947 22:50:10 -- target/connect_stress.sh@35 -- # rpc_cmd 00:12:18.947 22:50:10 -- common/autotest_common.sh@551 -- # xtrace_disable 00:12:18.947 22:50:10 -- common/autotest_common.sh@10 -- # set +x 00:12:19.513 22:50:10 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:12:19.513 22:50:10 -- target/connect_stress.sh@34 -- # kill -0 236050 00:12:19.513 22:50:10 -- target/connect_stress.sh@35 -- # rpc_cmd 00:12:19.513 22:50:10 -- common/autotest_common.sh@551 -- # xtrace_disable 00:12:19.513 22:50:10 -- common/autotest_common.sh@10 -- # set +x 00:12:19.770 22:50:10 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:12:19.770 22:50:10 -- target/connect_stress.sh@34 -- # kill -0 236050 00:12:19.771 22:50:10 -- target/connect_stress.sh@35 -- # rpc_cmd 00:12:19.771 22:50:10 -- common/autotest_common.sh@551 -- # xtrace_disable 00:12:19.771 22:50:10 -- common/autotest_common.sh@10 -- # set +x 00:12:20.029 22:50:11 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:12:20.029 22:50:11 -- target/connect_stress.sh@34 -- # kill -0 236050 00:12:20.029 22:50:11 -- target/connect_stress.sh@35 -- # rpc_cmd 00:12:20.029 22:50:11 -- common/autotest_common.sh@551 -- # xtrace_disable 00:12:20.029 22:50:11 -- common/autotest_common.sh@10 -- # set +x 00:12:20.287 22:50:11 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:12:20.287 22:50:11 -- target/connect_stress.sh@34 -- # kill -0 236050 00:12:20.287 22:50:11 -- target/connect_stress.sh@35 -- # rpc_cmd 00:12:20.287 22:50:11 -- common/autotest_common.sh@551 -- # xtrace_disable 00:12:20.287 22:50:11 -- common/autotest_common.sh@10 -- # set +x 00:12:20.851 22:50:11 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:12:20.851 22:50:11 -- target/connect_stress.sh@34 -- # kill -0 236050 00:12:20.851 22:50:11 -- target/connect_stress.sh@35 -- # rpc_cmd 00:12:20.851 22:50:11 -- common/autotest_common.sh@551 -- # xtrace_disable 00:12:20.851 22:50:11 -- common/autotest_common.sh@10 -- # set +x 00:12:21.109 22:50:11 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:12:21.109 22:50:11 -- target/connect_stress.sh@34 -- # kill -0 236050 00:12:21.109 22:50:11 -- target/connect_stress.sh@35 -- # rpc_cmd 00:12:21.109 22:50:11 -- common/autotest_common.sh@551 -- # xtrace_disable 00:12:21.109 22:50:11 -- common/autotest_common.sh@10 -- # set +x 00:12:21.366 22:50:12 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:12:21.366 22:50:12 -- target/connect_stress.sh@34 -- # kill -0 236050 00:12:21.366 22:50:12 -- target/connect_stress.sh@35 -- # rpc_cmd 00:12:21.366 22:50:12 -- common/autotest_common.sh@551 -- # xtrace_disable 00:12:21.366 22:50:12 -- common/autotest_common.sh@10 -- # set +x 00:12:21.623 22:50:12 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:12:21.623 22:50:12 -- target/connect_stress.sh@34 -- # kill -0 236050 00:12:21.623 22:50:12 -- target/connect_stress.sh@35 -- # rpc_cmd 00:12:21.623 22:50:12 -- common/autotest_common.sh@551 -- # xtrace_disable 00:12:21.623 22:50:12 -- common/autotest_common.sh@10 -- # set +x 00:12:21.880 22:50:12 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:12:21.880 22:50:12 -- target/connect_stress.sh@34 -- # kill -0 236050 00:12:21.880 22:50:12 -- target/connect_stress.sh@35 -- # rpc_cmd 00:12:21.880 22:50:12 -- common/autotest_common.sh@551 -- # xtrace_disable 00:12:21.881 22:50:12 -- common/autotest_common.sh@10 -- # set +x 00:12:22.445 22:50:13 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:12:22.445 22:50:13 -- target/connect_stress.sh@34 -- # kill -0 236050 00:12:22.445 22:50:13 -- target/connect_stress.sh@35 -- # rpc_cmd 00:12:22.445 22:50:13 -- common/autotest_common.sh@551 -- # xtrace_disable 00:12:22.445 22:50:13 -- common/autotest_common.sh@10 -- # set +x 00:12:22.702 22:50:13 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:12:22.702 22:50:13 -- target/connect_stress.sh@34 -- # kill -0 236050 00:12:22.702 22:50:13 -- target/connect_stress.sh@35 -- # rpc_cmd 00:12:22.702 22:50:13 -- common/autotest_common.sh@551 -- # xtrace_disable 00:12:22.702 22:50:13 -- common/autotest_common.sh@10 -- # set +x 00:12:22.960 22:50:13 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:12:22.960 22:50:13 -- target/connect_stress.sh@34 -- # kill -0 236050 00:12:22.960 22:50:13 -- target/connect_stress.sh@35 -- # rpc_cmd 00:12:22.960 22:50:13 -- common/autotest_common.sh@551 -- # xtrace_disable 00:12:22.960 22:50:13 -- common/autotest_common.sh@10 -- # set +x 00:12:23.226 22:50:14 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:12:23.226 22:50:14 -- target/connect_stress.sh@34 -- # kill -0 236050 00:12:23.226 22:50:14 -- target/connect_stress.sh@35 -- # rpc_cmd 00:12:23.226 22:50:14 -- common/autotest_common.sh@551 -- # xtrace_disable 00:12:23.226 22:50:14 -- common/autotest_common.sh@10 -- # set +x 00:12:23.486 22:50:14 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:12:23.486 22:50:14 -- target/connect_stress.sh@34 -- # kill -0 236050 00:12:23.486 22:50:14 -- target/connect_stress.sh@35 -- # rpc_cmd 00:12:23.486 22:50:14 -- common/autotest_common.sh@551 -- # xtrace_disable 00:12:23.486 22:50:14 -- common/autotest_common.sh@10 -- # set +x 00:12:24.049 22:50:14 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:12:24.049 22:50:14 -- target/connect_stress.sh@34 -- # kill -0 236050 00:12:24.049 22:50:14 -- target/connect_stress.sh@35 -- # rpc_cmd 00:12:24.049 22:50:14 -- common/autotest_common.sh@551 -- # xtrace_disable 00:12:24.049 22:50:14 -- common/autotest_common.sh@10 -- # set +x 00:12:24.306 22:50:15 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:12:24.307 22:50:15 -- target/connect_stress.sh@34 -- # kill -0 236050 00:12:24.307 22:50:15 -- target/connect_stress.sh@35 -- # rpc_cmd 00:12:24.307 22:50:15 -- common/autotest_common.sh@551 -- # xtrace_disable 00:12:24.307 22:50:15 -- common/autotest_common.sh@10 -- # set +x 00:12:24.564 22:50:15 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:12:24.564 22:50:15 -- target/connect_stress.sh@34 -- # kill -0 236050 00:12:24.564 22:50:15 -- target/connect_stress.sh@35 -- # rpc_cmd 00:12:24.564 22:50:15 -- common/autotest_common.sh@551 -- # xtrace_disable 00:12:24.564 22:50:15 -- common/autotest_common.sh@10 -- # set +x 00:12:24.822 22:50:15 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:12:24.822 22:50:15 -- target/connect_stress.sh@34 -- # kill -0 236050 00:12:24.822 22:50:15 -- target/connect_stress.sh@35 -- # rpc_cmd 00:12:24.822 22:50:15 -- common/autotest_common.sh@551 -- # xtrace_disable 00:12:24.822 22:50:15 -- common/autotest_common.sh@10 -- # set +x 00:12:25.079 22:50:16 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:12:25.079 22:50:16 -- target/connect_stress.sh@34 -- # kill -0 236050 00:12:25.079 22:50:16 -- target/connect_stress.sh@35 -- # rpc_cmd 00:12:25.079 22:50:16 -- common/autotest_common.sh@551 -- # xtrace_disable 00:12:25.079 22:50:16 -- common/autotest_common.sh@10 -- # set +x 00:12:25.645 22:50:16 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:12:25.645 22:50:16 -- target/connect_stress.sh@34 -- # kill -0 236050 00:12:25.645 22:50:16 -- target/connect_stress.sh@35 -- # rpc_cmd 00:12:25.645 22:50:16 -- common/autotest_common.sh@551 -- # xtrace_disable 00:12:25.645 22:50:16 -- common/autotest_common.sh@10 -- # set +x 00:12:25.903 22:50:16 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:12:25.903 22:50:16 -- target/connect_stress.sh@34 -- # kill -0 236050 00:12:25.903 22:50:16 -- target/connect_stress.sh@35 -- # rpc_cmd 00:12:25.903 22:50:16 -- common/autotest_common.sh@551 -- # xtrace_disable 00:12:25.903 22:50:16 -- common/autotest_common.sh@10 -- # set +x 00:12:26.161 22:50:17 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:12:26.161 22:50:17 -- target/connect_stress.sh@34 -- # kill -0 236050 00:12:26.161 22:50:17 -- target/connect_stress.sh@35 -- # rpc_cmd 00:12:26.161 22:50:17 -- common/autotest_common.sh@551 -- # xtrace_disable 00:12:26.161 22:50:17 -- common/autotest_common.sh@10 -- # set +x 00:12:26.419 22:50:17 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:12:26.419 22:50:17 -- target/connect_stress.sh@34 -- # kill -0 236050 00:12:26.419 22:50:17 -- target/connect_stress.sh@35 -- # rpc_cmd 00:12:26.419 22:50:17 -- common/autotest_common.sh@551 -- # xtrace_disable 00:12:26.419 22:50:17 -- common/autotest_common.sh@10 -- # set +x 00:12:26.677 Testing NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:12:26.678 22:50:17 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:12:26.678 22:50:17 -- target/connect_stress.sh@34 -- # kill -0 236050 00:12:26.678 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/connect_stress.sh: line 34: kill: (236050) - No such process 00:12:26.678 22:50:17 -- target/connect_stress.sh@38 -- # wait 236050 00:12:26.678 22:50:17 -- target/connect_stress.sh@39 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/rpc.txt 00:12:26.678 22:50:17 -- target/connect_stress.sh@41 -- # trap - SIGINT SIGTERM EXIT 00:12:26.678 22:50:17 -- target/connect_stress.sh@43 -- # nvmftestfini 00:12:26.678 22:50:17 -- nvmf/common.sh@476 -- # nvmfcleanup 00:12:26.678 22:50:17 -- nvmf/common.sh@116 -- # sync 00:12:26.678 22:50:17 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:12:26.678 22:50:17 -- nvmf/common.sh@119 -- # set +e 00:12:26.678 22:50:17 -- nvmf/common.sh@120 -- # for i in {1..20} 00:12:26.678 22:50:17 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:12:26.678 rmmod nvme_tcp 00:12:26.936 rmmod nvme_fabrics 00:12:26.936 rmmod nvme_keyring 00:12:26.936 22:50:17 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:12:26.936 22:50:17 -- nvmf/common.sh@123 -- # set -e 00:12:26.936 22:50:17 -- nvmf/common.sh@124 -- # return 0 00:12:26.936 22:50:17 -- nvmf/common.sh@477 -- # '[' -n 235891 ']' 00:12:26.936 22:50:17 -- nvmf/common.sh@478 -- # killprocess 235891 00:12:26.936 22:50:17 -- common/autotest_common.sh@926 -- # '[' -z 235891 ']' 00:12:26.936 22:50:17 -- common/autotest_common.sh@930 -- # kill -0 235891 00:12:26.936 22:50:17 -- common/autotest_common.sh@931 -- # uname 00:12:26.936 22:50:17 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:12:26.936 22:50:17 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 235891 00:12:26.936 22:50:17 -- common/autotest_common.sh@932 -- # process_name=reactor_1 00:12:26.936 22:50:17 -- common/autotest_common.sh@936 -- # '[' reactor_1 = sudo ']' 00:12:26.936 22:50:17 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 235891' 00:12:26.936 killing process with pid 235891 00:12:26.936 22:50:17 -- common/autotest_common.sh@945 -- # kill 235891 00:12:26.936 22:50:17 -- common/autotest_common.sh@950 -- # wait 235891 00:12:27.195 22:50:18 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:12:27.195 22:50:18 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:12:27.195 22:50:18 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:12:27.195 22:50:18 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:12:27.195 22:50:18 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:12:27.195 22:50:18 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:12:27.195 22:50:18 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:12:27.195 22:50:18 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:12:29.099 22:50:20 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:12:29.099 00:12:29.099 real 0m15.877s 00:12:29.099 user 0m40.192s 00:12:29.099 sys 0m6.026s 00:12:29.099 22:50:20 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:12:29.099 22:50:20 -- common/autotest_common.sh@10 -- # set +x 00:12:29.099 ************************************ 00:12:29.099 END TEST nvmf_connect_stress 00:12:29.099 ************************************ 00:12:29.099 22:50:20 -- nvmf/nvmf.sh@34 -- # run_test nvmf_fused_ordering /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/fused_ordering.sh --transport=tcp 00:12:29.099 22:50:20 -- common/autotest_common.sh@1077 -- # '[' 3 -le 1 ']' 00:12:29.099 22:50:20 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:12:29.099 22:50:20 -- common/autotest_common.sh@10 -- # set +x 00:12:29.099 ************************************ 00:12:29.099 START TEST nvmf_fused_ordering 00:12:29.099 ************************************ 00:12:29.099 22:50:20 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/fused_ordering.sh --transport=tcp 00:12:29.358 * Looking for test storage... 00:12:29.358 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:12:29.358 22:50:20 -- target/fused_ordering.sh@10 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:12:29.358 22:50:20 -- nvmf/common.sh@7 -- # uname -s 00:12:29.358 22:50:20 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:12:29.358 22:50:20 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:12:29.358 22:50:20 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:12:29.358 22:50:20 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:12:29.358 22:50:20 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:12:29.358 22:50:20 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:12:29.358 22:50:20 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:12:29.358 22:50:20 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:12:29.358 22:50:20 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:12:29.358 22:50:20 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:12:29.358 22:50:20 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:12:29.358 22:50:20 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:12:29.358 22:50:20 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:12:29.358 22:50:20 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:12:29.358 22:50:20 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:12:29.358 22:50:20 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:12:29.358 22:50:20 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:12:29.358 22:50:20 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:12:29.358 22:50:20 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:12:29.358 22:50:20 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:12:29.358 22:50:20 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:12:29.358 22:50:20 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:12:29.358 22:50:20 -- paths/export.sh@5 -- # export PATH 00:12:29.358 22:50:20 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:12:29.358 22:50:20 -- nvmf/common.sh@46 -- # : 0 00:12:29.358 22:50:20 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:12:29.358 22:50:20 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:12:29.358 22:50:20 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:12:29.358 22:50:20 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:12:29.358 22:50:20 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:12:29.358 22:50:20 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:12:29.358 22:50:20 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:12:29.358 22:50:20 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:12:29.358 22:50:20 -- target/fused_ordering.sh@12 -- # nvmftestinit 00:12:29.358 22:50:20 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:12:29.358 22:50:20 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:12:29.358 22:50:20 -- nvmf/common.sh@436 -- # prepare_net_devs 00:12:29.358 22:50:20 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:12:29.358 22:50:20 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:12:29.358 22:50:20 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:12:29.358 22:50:20 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:12:29.358 22:50:20 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:12:29.358 22:50:20 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:12:29.358 22:50:20 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:12:29.358 22:50:20 -- nvmf/common.sh@284 -- # xtrace_disable 00:12:29.358 22:50:20 -- common/autotest_common.sh@10 -- # set +x 00:12:31.260 22:50:22 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:12:31.260 22:50:22 -- nvmf/common.sh@290 -- # pci_devs=() 00:12:31.260 22:50:22 -- nvmf/common.sh@290 -- # local -a pci_devs 00:12:31.260 22:50:22 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:12:31.260 22:50:22 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:12:31.260 22:50:22 -- nvmf/common.sh@292 -- # pci_drivers=() 00:12:31.260 22:50:22 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:12:31.260 22:50:22 -- nvmf/common.sh@294 -- # net_devs=() 00:12:31.260 22:50:22 -- nvmf/common.sh@294 -- # local -ga net_devs 00:12:31.260 22:50:22 -- nvmf/common.sh@295 -- # e810=() 00:12:31.260 22:50:22 -- nvmf/common.sh@295 -- # local -ga e810 00:12:31.260 22:50:22 -- nvmf/common.sh@296 -- # x722=() 00:12:31.260 22:50:22 -- nvmf/common.sh@296 -- # local -ga x722 00:12:31.260 22:50:22 -- nvmf/common.sh@297 -- # mlx=() 00:12:31.260 22:50:22 -- nvmf/common.sh@297 -- # local -ga mlx 00:12:31.260 22:50:22 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:12:31.260 22:50:22 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:12:31.260 22:50:22 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:12:31.260 22:50:22 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:12:31.260 22:50:22 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:12:31.260 22:50:22 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:12:31.260 22:50:22 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:12:31.260 22:50:22 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:12:31.260 22:50:22 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:12:31.260 22:50:22 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:12:31.260 22:50:22 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:12:31.260 22:50:22 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:12:31.260 22:50:22 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:12:31.260 22:50:22 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:12:31.260 22:50:22 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:12:31.260 22:50:22 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:12:31.260 22:50:22 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:12:31.260 22:50:22 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:12:31.260 22:50:22 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:12:31.260 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:12:31.260 22:50:22 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:12:31.260 22:50:22 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:12:31.260 22:50:22 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:12:31.260 22:50:22 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:12:31.260 22:50:22 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:12:31.260 22:50:22 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:12:31.260 22:50:22 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:12:31.260 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:12:31.260 22:50:22 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:12:31.260 22:50:22 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:12:31.260 22:50:22 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:12:31.260 22:50:22 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:12:31.260 22:50:22 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:12:31.260 22:50:22 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:12:31.260 22:50:22 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:12:31.260 22:50:22 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:12:31.260 22:50:22 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:12:31.260 22:50:22 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:12:31.260 22:50:22 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:12:31.260 22:50:22 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:12:31.260 22:50:22 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:12:31.260 Found net devices under 0000:0a:00.0: cvl_0_0 00:12:31.260 22:50:22 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:12:31.260 22:50:22 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:12:31.260 22:50:22 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:12:31.260 22:50:22 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:12:31.260 22:50:22 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:12:31.260 22:50:22 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:12:31.260 Found net devices under 0000:0a:00.1: cvl_0_1 00:12:31.260 22:50:22 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:12:31.260 22:50:22 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:12:31.260 22:50:22 -- nvmf/common.sh@402 -- # is_hw=yes 00:12:31.260 22:50:22 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:12:31.260 22:50:22 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:12:31.260 22:50:22 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:12:31.260 22:50:22 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:12:31.260 22:50:22 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:12:31.260 22:50:22 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:12:31.260 22:50:22 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:12:31.260 22:50:22 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:12:31.260 22:50:22 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:12:31.260 22:50:22 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:12:31.260 22:50:22 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:12:31.260 22:50:22 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:12:31.260 22:50:22 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:12:31.260 22:50:22 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:12:31.260 22:50:22 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:12:31.260 22:50:22 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:12:31.260 22:50:22 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:12:31.260 22:50:22 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:12:31.260 22:50:22 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:12:31.260 22:50:22 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:12:31.260 22:50:22 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:12:31.260 22:50:22 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:12:31.519 22:50:22 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:12:31.519 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:12:31.519 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.159 ms 00:12:31.519 00:12:31.519 --- 10.0.0.2 ping statistics --- 00:12:31.519 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:12:31.519 rtt min/avg/max/mdev = 0.159/0.159/0.159/0.000 ms 00:12:31.519 22:50:22 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:12:31.519 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:12:31.519 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.104 ms 00:12:31.519 00:12:31.519 --- 10.0.0.1 ping statistics --- 00:12:31.519 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:12:31.519 rtt min/avg/max/mdev = 0.104/0.104/0.104/0.000 ms 00:12:31.519 22:50:22 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:12:31.519 22:50:22 -- nvmf/common.sh@410 -- # return 0 00:12:31.519 22:50:22 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:12:31.519 22:50:22 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:12:31.519 22:50:22 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:12:31.519 22:50:22 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:12:31.519 22:50:22 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:12:31.519 22:50:22 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:12:31.519 22:50:22 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:12:31.519 22:50:22 -- target/fused_ordering.sh@13 -- # nvmfappstart -m 0x2 00:12:31.519 22:50:22 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:12:31.519 22:50:22 -- common/autotest_common.sh@712 -- # xtrace_disable 00:12:31.519 22:50:22 -- common/autotest_common.sh@10 -- # set +x 00:12:31.519 22:50:22 -- nvmf/common.sh@469 -- # nvmfpid=239246 00:12:31.519 22:50:22 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x2 00:12:31.519 22:50:22 -- nvmf/common.sh@470 -- # waitforlisten 239246 00:12:31.519 22:50:22 -- common/autotest_common.sh@819 -- # '[' -z 239246 ']' 00:12:31.519 22:50:22 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk.sock 00:12:31.519 22:50:22 -- common/autotest_common.sh@824 -- # local max_retries=100 00:12:31.519 22:50:22 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:12:31.519 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:12:31.519 22:50:22 -- common/autotest_common.sh@828 -- # xtrace_disable 00:12:31.519 22:50:22 -- common/autotest_common.sh@10 -- # set +x 00:12:31.519 [2024-04-16 22:50:22.466067] Starting SPDK v24.01.1-pre git sha1 4b134b4ab / DPDK 23.11.0 initialization... 00:12:31.519 [2024-04-16 22:50:22.466149] [ DPDK EAL parameters: nvmf -c 0x2 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:12:31.519 EAL: No free 2048 kB hugepages reported on node 1 00:12:31.519 [2024-04-16 22:50:22.539972] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:12:31.778 [2024-04-16 22:50:22.661901] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:12:31.778 [2024-04-16 22:50:22.662060] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:12:31.778 [2024-04-16 22:50:22.662087] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:12:31.778 [2024-04-16 22:50:22.662102] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:12:31.778 [2024-04-16 22:50:22.662131] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:12:32.711 22:50:23 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:12:32.711 22:50:23 -- common/autotest_common.sh@852 -- # return 0 00:12:32.711 22:50:23 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:12:32.711 22:50:23 -- common/autotest_common.sh@718 -- # xtrace_disable 00:12:32.711 22:50:23 -- common/autotest_common.sh@10 -- # set +x 00:12:32.711 22:50:23 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:12:32.711 22:50:23 -- target/fused_ordering.sh@15 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:12:32.711 22:50:23 -- common/autotest_common.sh@551 -- # xtrace_disable 00:12:32.711 22:50:23 -- common/autotest_common.sh@10 -- # set +x 00:12:32.711 [2024-04-16 22:50:23.516147] tcp.c: 659:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:12:32.711 22:50:23 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:12:32.711 22:50:23 -- target/fused_ordering.sh@16 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 -m 10 00:12:32.711 22:50:23 -- common/autotest_common.sh@551 -- # xtrace_disable 00:12:32.711 22:50:23 -- common/autotest_common.sh@10 -- # set +x 00:12:32.711 22:50:23 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:12:32.711 22:50:23 -- target/fused_ordering.sh@17 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:12:32.711 22:50:23 -- common/autotest_common.sh@551 -- # xtrace_disable 00:12:32.711 22:50:23 -- common/autotest_common.sh@10 -- # set +x 00:12:32.711 [2024-04-16 22:50:23.532337] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:12:32.711 22:50:23 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:12:32.712 22:50:23 -- target/fused_ordering.sh@18 -- # rpc_cmd bdev_null_create NULL1 1000 512 00:12:32.712 22:50:23 -- common/autotest_common.sh@551 -- # xtrace_disable 00:12:32.712 22:50:23 -- common/autotest_common.sh@10 -- # set +x 00:12:32.712 NULL1 00:12:32.712 22:50:23 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:12:32.712 22:50:23 -- target/fused_ordering.sh@19 -- # rpc_cmd bdev_wait_for_examine 00:12:32.712 22:50:23 -- common/autotest_common.sh@551 -- # xtrace_disable 00:12:32.712 22:50:23 -- common/autotest_common.sh@10 -- # set +x 00:12:32.712 22:50:23 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:12:32.712 22:50:23 -- target/fused_ordering.sh@20 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 NULL1 00:12:32.712 22:50:23 -- common/autotest_common.sh@551 -- # xtrace_disable 00:12:32.712 22:50:23 -- common/autotest_common.sh@10 -- # set +x 00:12:32.712 22:50:23 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:12:32.712 22:50:23 -- target/fused_ordering.sh@22 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvme/fused_ordering/fused_ordering -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1' 00:12:32.712 [2024-04-16 22:50:23.576435] Starting SPDK v24.01.1-pre git sha1 4b134b4ab / DPDK 23.11.0 initialization... 00:12:32.712 [2024-04-16 22:50:23.576476] [ DPDK EAL parameters: fused_ordering --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid239403 ] 00:12:32.712 EAL: No free 2048 kB hugepages reported on node 1 00:12:32.970 Attached to nqn.2016-06.io.spdk:cnode1 00:12:32.970 Namespace ID: 1 size: 1GB 00:12:32.970 fused_ordering(0) 00:12:32.970 fused_ordering(1) 00:12:32.970 fused_ordering(2) 00:12:32.970 fused_ordering(3) 00:12:32.970 fused_ordering(4) 00:12:32.970 fused_ordering(5) 00:12:32.970 fused_ordering(6) 00:12:32.970 fused_ordering(7) 00:12:32.970 fused_ordering(8) 00:12:32.970 fused_ordering(9) 00:12:32.970 fused_ordering(10) 00:12:32.970 fused_ordering(11) 00:12:32.970 fused_ordering(12) 00:12:32.970 fused_ordering(13) 00:12:32.970 fused_ordering(14) 00:12:32.970 fused_ordering(15) 00:12:32.970 fused_ordering(16) 00:12:32.970 fused_ordering(17) 00:12:32.970 fused_ordering(18) 00:12:32.970 fused_ordering(19) 00:12:32.970 fused_ordering(20) 00:12:32.970 fused_ordering(21) 00:12:32.970 fused_ordering(22) 00:12:32.970 fused_ordering(23) 00:12:32.970 fused_ordering(24) 00:12:32.970 fused_ordering(25) 00:12:32.970 fused_ordering(26) 00:12:32.970 fused_ordering(27) 00:12:32.970 fused_ordering(28) 00:12:32.970 fused_ordering(29) 00:12:32.970 fused_ordering(30) 00:12:32.970 fused_ordering(31) 00:12:32.970 fused_ordering(32) 00:12:32.970 fused_ordering(33) 00:12:32.970 fused_ordering(34) 00:12:32.970 fused_ordering(35) 00:12:32.970 fused_ordering(36) 00:12:32.970 fused_ordering(37) 00:12:32.970 fused_ordering(38) 00:12:32.970 fused_ordering(39) 00:12:32.970 fused_ordering(40) 00:12:32.970 fused_ordering(41) 00:12:32.970 fused_ordering(42) 00:12:32.970 fused_ordering(43) 00:12:32.970 fused_ordering(44) 00:12:32.970 fused_ordering(45) 00:12:32.970 fused_ordering(46) 00:12:32.970 fused_ordering(47) 00:12:32.970 fused_ordering(48) 00:12:32.970 fused_ordering(49) 00:12:32.970 fused_ordering(50) 00:12:32.970 fused_ordering(51) 00:12:32.970 fused_ordering(52) 00:12:32.970 fused_ordering(53) 00:12:32.970 fused_ordering(54) 00:12:32.970 fused_ordering(55) 00:12:32.970 fused_ordering(56) 00:12:32.970 fused_ordering(57) 00:12:32.970 fused_ordering(58) 00:12:32.970 fused_ordering(59) 00:12:32.970 fused_ordering(60) 00:12:32.970 fused_ordering(61) 00:12:32.970 fused_ordering(62) 00:12:32.970 fused_ordering(63) 00:12:32.970 fused_ordering(64) 00:12:32.970 fused_ordering(65) 00:12:32.970 fused_ordering(66) 00:12:32.970 fused_ordering(67) 00:12:32.970 fused_ordering(68) 00:12:32.970 fused_ordering(69) 00:12:32.970 fused_ordering(70) 00:12:32.970 fused_ordering(71) 00:12:32.970 fused_ordering(72) 00:12:32.970 fused_ordering(73) 00:12:32.970 fused_ordering(74) 00:12:32.970 fused_ordering(75) 00:12:32.970 fused_ordering(76) 00:12:32.970 fused_ordering(77) 00:12:32.970 fused_ordering(78) 00:12:32.970 fused_ordering(79) 00:12:32.970 fused_ordering(80) 00:12:32.970 fused_ordering(81) 00:12:32.970 fused_ordering(82) 00:12:32.970 fused_ordering(83) 00:12:32.970 fused_ordering(84) 00:12:32.970 fused_ordering(85) 00:12:32.970 fused_ordering(86) 00:12:32.970 fused_ordering(87) 00:12:32.970 fused_ordering(88) 00:12:32.970 fused_ordering(89) 00:12:32.970 fused_ordering(90) 00:12:32.970 fused_ordering(91) 00:12:32.970 fused_ordering(92) 00:12:32.970 fused_ordering(93) 00:12:32.970 fused_ordering(94) 00:12:32.970 fused_ordering(95) 00:12:32.970 fused_ordering(96) 00:12:32.970 fused_ordering(97) 00:12:32.970 fused_ordering(98) 00:12:32.970 fused_ordering(99) 00:12:32.971 fused_ordering(100) 00:12:32.971 fused_ordering(101) 00:12:32.971 fused_ordering(102) 00:12:32.971 fused_ordering(103) 00:12:32.971 fused_ordering(104) 00:12:32.971 fused_ordering(105) 00:12:32.971 fused_ordering(106) 00:12:32.971 fused_ordering(107) 00:12:32.971 fused_ordering(108) 00:12:32.971 fused_ordering(109) 00:12:32.971 fused_ordering(110) 00:12:32.971 fused_ordering(111) 00:12:32.971 fused_ordering(112) 00:12:32.971 fused_ordering(113) 00:12:32.971 fused_ordering(114) 00:12:32.971 fused_ordering(115) 00:12:32.971 fused_ordering(116) 00:12:32.971 fused_ordering(117) 00:12:32.971 fused_ordering(118) 00:12:32.971 fused_ordering(119) 00:12:32.971 fused_ordering(120) 00:12:32.971 fused_ordering(121) 00:12:32.971 fused_ordering(122) 00:12:32.971 fused_ordering(123) 00:12:32.971 fused_ordering(124) 00:12:32.971 fused_ordering(125) 00:12:32.971 fused_ordering(126) 00:12:32.971 fused_ordering(127) 00:12:32.971 fused_ordering(128) 00:12:32.971 fused_ordering(129) 00:12:32.971 fused_ordering(130) 00:12:32.971 fused_ordering(131) 00:12:32.971 fused_ordering(132) 00:12:32.971 fused_ordering(133) 00:12:32.971 fused_ordering(134) 00:12:32.971 fused_ordering(135) 00:12:32.971 fused_ordering(136) 00:12:32.971 fused_ordering(137) 00:12:32.971 fused_ordering(138) 00:12:32.971 fused_ordering(139) 00:12:32.971 fused_ordering(140) 00:12:32.971 fused_ordering(141) 00:12:32.971 fused_ordering(142) 00:12:32.971 fused_ordering(143) 00:12:32.971 fused_ordering(144) 00:12:32.971 fused_ordering(145) 00:12:32.971 fused_ordering(146) 00:12:32.971 fused_ordering(147) 00:12:32.971 fused_ordering(148) 00:12:32.971 fused_ordering(149) 00:12:32.971 fused_ordering(150) 00:12:32.971 fused_ordering(151) 00:12:32.971 fused_ordering(152) 00:12:32.971 fused_ordering(153) 00:12:32.971 fused_ordering(154) 00:12:32.971 fused_ordering(155) 00:12:32.971 fused_ordering(156) 00:12:32.971 fused_ordering(157) 00:12:32.971 fused_ordering(158) 00:12:32.971 fused_ordering(159) 00:12:32.971 fused_ordering(160) 00:12:32.971 fused_ordering(161) 00:12:32.971 fused_ordering(162) 00:12:32.971 fused_ordering(163) 00:12:32.971 fused_ordering(164) 00:12:32.971 fused_ordering(165) 00:12:32.971 fused_ordering(166) 00:12:32.971 fused_ordering(167) 00:12:32.971 fused_ordering(168) 00:12:32.971 fused_ordering(169) 00:12:32.971 fused_ordering(170) 00:12:32.971 fused_ordering(171) 00:12:32.971 fused_ordering(172) 00:12:32.971 fused_ordering(173) 00:12:32.971 fused_ordering(174) 00:12:32.971 fused_ordering(175) 00:12:32.971 fused_ordering(176) 00:12:32.971 fused_ordering(177) 00:12:32.971 fused_ordering(178) 00:12:32.971 fused_ordering(179) 00:12:32.971 fused_ordering(180) 00:12:32.971 fused_ordering(181) 00:12:32.971 fused_ordering(182) 00:12:32.971 fused_ordering(183) 00:12:32.971 fused_ordering(184) 00:12:32.971 fused_ordering(185) 00:12:32.971 fused_ordering(186) 00:12:32.971 fused_ordering(187) 00:12:32.971 fused_ordering(188) 00:12:32.971 fused_ordering(189) 00:12:32.971 fused_ordering(190) 00:12:32.971 fused_ordering(191) 00:12:32.971 fused_ordering(192) 00:12:32.971 fused_ordering(193) 00:12:32.971 fused_ordering(194) 00:12:32.971 fused_ordering(195) 00:12:32.971 fused_ordering(196) 00:12:32.971 fused_ordering(197) 00:12:32.971 fused_ordering(198) 00:12:32.971 fused_ordering(199) 00:12:32.971 fused_ordering(200) 00:12:32.971 fused_ordering(201) 00:12:32.971 fused_ordering(202) 00:12:32.971 fused_ordering(203) 00:12:32.971 fused_ordering(204) 00:12:32.971 fused_ordering(205) 00:12:33.537 fused_ordering(206) 00:12:33.537 fused_ordering(207) 00:12:33.537 fused_ordering(208) 00:12:33.537 fused_ordering(209) 00:12:33.537 fused_ordering(210) 00:12:33.537 fused_ordering(211) 00:12:33.537 fused_ordering(212) 00:12:33.537 fused_ordering(213) 00:12:33.537 fused_ordering(214) 00:12:33.537 fused_ordering(215) 00:12:33.537 fused_ordering(216) 00:12:33.537 fused_ordering(217) 00:12:33.537 fused_ordering(218) 00:12:33.537 fused_ordering(219) 00:12:33.537 fused_ordering(220) 00:12:33.537 fused_ordering(221) 00:12:33.537 fused_ordering(222) 00:12:33.537 fused_ordering(223) 00:12:33.537 fused_ordering(224) 00:12:33.537 fused_ordering(225) 00:12:33.537 fused_ordering(226) 00:12:33.538 fused_ordering(227) 00:12:33.538 fused_ordering(228) 00:12:33.538 fused_ordering(229) 00:12:33.538 fused_ordering(230) 00:12:33.538 fused_ordering(231) 00:12:33.538 fused_ordering(232) 00:12:33.538 fused_ordering(233) 00:12:33.538 fused_ordering(234) 00:12:33.538 fused_ordering(235) 00:12:33.538 fused_ordering(236) 00:12:33.538 fused_ordering(237) 00:12:33.538 fused_ordering(238) 00:12:33.538 fused_ordering(239) 00:12:33.538 fused_ordering(240) 00:12:33.538 fused_ordering(241) 00:12:33.538 fused_ordering(242) 00:12:33.538 fused_ordering(243) 00:12:33.538 fused_ordering(244) 00:12:33.538 fused_ordering(245) 00:12:33.538 fused_ordering(246) 00:12:33.538 fused_ordering(247) 00:12:33.538 fused_ordering(248) 00:12:33.538 fused_ordering(249) 00:12:33.538 fused_ordering(250) 00:12:33.538 fused_ordering(251) 00:12:33.538 fused_ordering(252) 00:12:33.538 fused_ordering(253) 00:12:33.538 fused_ordering(254) 00:12:33.538 fused_ordering(255) 00:12:33.538 fused_ordering(256) 00:12:33.538 fused_ordering(257) 00:12:33.538 fused_ordering(258) 00:12:33.538 fused_ordering(259) 00:12:33.538 fused_ordering(260) 00:12:33.538 fused_ordering(261) 00:12:33.538 fused_ordering(262) 00:12:33.538 fused_ordering(263) 00:12:33.538 fused_ordering(264) 00:12:33.538 fused_ordering(265) 00:12:33.538 fused_ordering(266) 00:12:33.538 fused_ordering(267) 00:12:33.538 fused_ordering(268) 00:12:33.538 fused_ordering(269) 00:12:33.538 fused_ordering(270) 00:12:33.538 fused_ordering(271) 00:12:33.538 fused_ordering(272) 00:12:33.538 fused_ordering(273) 00:12:33.538 fused_ordering(274) 00:12:33.538 fused_ordering(275) 00:12:33.538 fused_ordering(276) 00:12:33.538 fused_ordering(277) 00:12:33.538 fused_ordering(278) 00:12:33.538 fused_ordering(279) 00:12:33.538 fused_ordering(280) 00:12:33.538 fused_ordering(281) 00:12:33.538 fused_ordering(282) 00:12:33.538 fused_ordering(283) 00:12:33.538 fused_ordering(284) 00:12:33.538 fused_ordering(285) 00:12:33.538 fused_ordering(286) 00:12:33.538 fused_ordering(287) 00:12:33.538 fused_ordering(288) 00:12:33.538 fused_ordering(289) 00:12:33.538 fused_ordering(290) 00:12:33.538 fused_ordering(291) 00:12:33.538 fused_ordering(292) 00:12:33.538 fused_ordering(293) 00:12:33.538 fused_ordering(294) 00:12:33.538 fused_ordering(295) 00:12:33.538 fused_ordering(296) 00:12:33.538 fused_ordering(297) 00:12:33.538 fused_ordering(298) 00:12:33.538 fused_ordering(299) 00:12:33.538 fused_ordering(300) 00:12:33.538 fused_ordering(301) 00:12:33.538 fused_ordering(302) 00:12:33.538 fused_ordering(303) 00:12:33.538 fused_ordering(304) 00:12:33.538 fused_ordering(305) 00:12:33.538 fused_ordering(306) 00:12:33.538 fused_ordering(307) 00:12:33.538 fused_ordering(308) 00:12:33.538 fused_ordering(309) 00:12:33.538 fused_ordering(310) 00:12:33.538 fused_ordering(311) 00:12:33.538 fused_ordering(312) 00:12:33.538 fused_ordering(313) 00:12:33.538 fused_ordering(314) 00:12:33.538 fused_ordering(315) 00:12:33.538 fused_ordering(316) 00:12:33.538 fused_ordering(317) 00:12:33.538 fused_ordering(318) 00:12:33.538 fused_ordering(319) 00:12:33.538 fused_ordering(320) 00:12:33.538 fused_ordering(321) 00:12:33.538 fused_ordering(322) 00:12:33.538 fused_ordering(323) 00:12:33.538 fused_ordering(324) 00:12:33.538 fused_ordering(325) 00:12:33.538 fused_ordering(326) 00:12:33.538 fused_ordering(327) 00:12:33.538 fused_ordering(328) 00:12:33.538 fused_ordering(329) 00:12:33.538 fused_ordering(330) 00:12:33.538 fused_ordering(331) 00:12:33.538 fused_ordering(332) 00:12:33.538 fused_ordering(333) 00:12:33.538 fused_ordering(334) 00:12:33.538 fused_ordering(335) 00:12:33.538 fused_ordering(336) 00:12:33.538 fused_ordering(337) 00:12:33.538 fused_ordering(338) 00:12:33.538 fused_ordering(339) 00:12:33.538 fused_ordering(340) 00:12:33.538 fused_ordering(341) 00:12:33.538 fused_ordering(342) 00:12:33.538 fused_ordering(343) 00:12:33.538 fused_ordering(344) 00:12:33.538 fused_ordering(345) 00:12:33.538 fused_ordering(346) 00:12:33.538 fused_ordering(347) 00:12:33.538 fused_ordering(348) 00:12:33.538 fused_ordering(349) 00:12:33.538 fused_ordering(350) 00:12:33.538 fused_ordering(351) 00:12:33.538 fused_ordering(352) 00:12:33.538 fused_ordering(353) 00:12:33.538 fused_ordering(354) 00:12:33.538 fused_ordering(355) 00:12:33.538 fused_ordering(356) 00:12:33.538 fused_ordering(357) 00:12:33.538 fused_ordering(358) 00:12:33.538 fused_ordering(359) 00:12:33.538 fused_ordering(360) 00:12:33.538 fused_ordering(361) 00:12:33.538 fused_ordering(362) 00:12:33.538 fused_ordering(363) 00:12:33.538 fused_ordering(364) 00:12:33.538 fused_ordering(365) 00:12:33.538 fused_ordering(366) 00:12:33.538 fused_ordering(367) 00:12:33.538 fused_ordering(368) 00:12:33.538 fused_ordering(369) 00:12:33.538 fused_ordering(370) 00:12:33.538 fused_ordering(371) 00:12:33.538 fused_ordering(372) 00:12:33.538 fused_ordering(373) 00:12:33.538 fused_ordering(374) 00:12:33.538 fused_ordering(375) 00:12:33.538 fused_ordering(376) 00:12:33.538 fused_ordering(377) 00:12:33.538 fused_ordering(378) 00:12:33.538 fused_ordering(379) 00:12:33.538 fused_ordering(380) 00:12:33.538 fused_ordering(381) 00:12:33.538 fused_ordering(382) 00:12:33.538 fused_ordering(383) 00:12:33.538 fused_ordering(384) 00:12:33.538 fused_ordering(385) 00:12:33.538 fused_ordering(386) 00:12:33.538 fused_ordering(387) 00:12:33.538 fused_ordering(388) 00:12:33.538 fused_ordering(389) 00:12:33.538 fused_ordering(390) 00:12:33.538 fused_ordering(391) 00:12:33.538 fused_ordering(392) 00:12:33.538 fused_ordering(393) 00:12:33.538 fused_ordering(394) 00:12:33.538 fused_ordering(395) 00:12:33.538 fused_ordering(396) 00:12:33.538 fused_ordering(397) 00:12:33.538 fused_ordering(398) 00:12:33.538 fused_ordering(399) 00:12:33.538 fused_ordering(400) 00:12:33.538 fused_ordering(401) 00:12:33.538 fused_ordering(402) 00:12:33.538 fused_ordering(403) 00:12:33.538 fused_ordering(404) 00:12:33.538 fused_ordering(405) 00:12:33.538 fused_ordering(406) 00:12:33.538 fused_ordering(407) 00:12:33.538 fused_ordering(408) 00:12:33.538 fused_ordering(409) 00:12:33.538 fused_ordering(410) 00:12:34.105 fused_ordering(411) 00:12:34.105 fused_ordering(412) 00:12:34.105 fused_ordering(413) 00:12:34.105 fused_ordering(414) 00:12:34.105 fused_ordering(415) 00:12:34.105 fused_ordering(416) 00:12:34.105 fused_ordering(417) 00:12:34.105 fused_ordering(418) 00:12:34.105 fused_ordering(419) 00:12:34.105 fused_ordering(420) 00:12:34.105 fused_ordering(421) 00:12:34.105 fused_ordering(422) 00:12:34.105 fused_ordering(423) 00:12:34.105 fused_ordering(424) 00:12:34.105 fused_ordering(425) 00:12:34.105 fused_ordering(426) 00:12:34.105 fused_ordering(427) 00:12:34.105 fused_ordering(428) 00:12:34.105 fused_ordering(429) 00:12:34.105 fused_ordering(430) 00:12:34.105 fused_ordering(431) 00:12:34.105 fused_ordering(432) 00:12:34.105 fused_ordering(433) 00:12:34.105 fused_ordering(434) 00:12:34.105 fused_ordering(435) 00:12:34.105 fused_ordering(436) 00:12:34.105 fused_ordering(437) 00:12:34.105 fused_ordering(438) 00:12:34.105 fused_ordering(439) 00:12:34.105 fused_ordering(440) 00:12:34.105 fused_ordering(441) 00:12:34.105 fused_ordering(442) 00:12:34.105 fused_ordering(443) 00:12:34.105 fused_ordering(444) 00:12:34.105 fused_ordering(445) 00:12:34.105 fused_ordering(446) 00:12:34.105 fused_ordering(447) 00:12:34.105 fused_ordering(448) 00:12:34.105 fused_ordering(449) 00:12:34.105 fused_ordering(450) 00:12:34.105 fused_ordering(451) 00:12:34.105 fused_ordering(452) 00:12:34.105 fused_ordering(453) 00:12:34.105 fused_ordering(454) 00:12:34.105 fused_ordering(455) 00:12:34.105 fused_ordering(456) 00:12:34.105 fused_ordering(457) 00:12:34.105 fused_ordering(458) 00:12:34.105 fused_ordering(459) 00:12:34.105 fused_ordering(460) 00:12:34.105 fused_ordering(461) 00:12:34.105 fused_ordering(462) 00:12:34.105 fused_ordering(463) 00:12:34.105 fused_ordering(464) 00:12:34.105 fused_ordering(465) 00:12:34.105 fused_ordering(466) 00:12:34.105 fused_ordering(467) 00:12:34.105 fused_ordering(468) 00:12:34.105 fused_ordering(469) 00:12:34.105 fused_ordering(470) 00:12:34.105 fused_ordering(471) 00:12:34.105 fused_ordering(472) 00:12:34.105 fused_ordering(473) 00:12:34.105 fused_ordering(474) 00:12:34.105 fused_ordering(475) 00:12:34.105 fused_ordering(476) 00:12:34.105 fused_ordering(477) 00:12:34.105 fused_ordering(478) 00:12:34.105 fused_ordering(479) 00:12:34.105 fused_ordering(480) 00:12:34.105 fused_ordering(481) 00:12:34.105 fused_ordering(482) 00:12:34.105 fused_ordering(483) 00:12:34.105 fused_ordering(484) 00:12:34.105 fused_ordering(485) 00:12:34.105 fused_ordering(486) 00:12:34.105 fused_ordering(487) 00:12:34.105 fused_ordering(488) 00:12:34.105 fused_ordering(489) 00:12:34.105 fused_ordering(490) 00:12:34.105 fused_ordering(491) 00:12:34.105 fused_ordering(492) 00:12:34.105 fused_ordering(493) 00:12:34.105 fused_ordering(494) 00:12:34.105 fused_ordering(495) 00:12:34.105 fused_ordering(496) 00:12:34.105 fused_ordering(497) 00:12:34.105 fused_ordering(498) 00:12:34.106 fused_ordering(499) 00:12:34.106 fused_ordering(500) 00:12:34.106 fused_ordering(501) 00:12:34.106 fused_ordering(502) 00:12:34.106 fused_ordering(503) 00:12:34.106 fused_ordering(504) 00:12:34.106 fused_ordering(505) 00:12:34.106 fused_ordering(506) 00:12:34.106 fused_ordering(507) 00:12:34.106 fused_ordering(508) 00:12:34.106 fused_ordering(509) 00:12:34.106 fused_ordering(510) 00:12:34.106 fused_ordering(511) 00:12:34.106 fused_ordering(512) 00:12:34.106 fused_ordering(513) 00:12:34.106 fused_ordering(514) 00:12:34.106 fused_ordering(515) 00:12:34.106 fused_ordering(516) 00:12:34.106 fused_ordering(517) 00:12:34.106 fused_ordering(518) 00:12:34.106 fused_ordering(519) 00:12:34.106 fused_ordering(520) 00:12:34.106 fused_ordering(521) 00:12:34.106 fused_ordering(522) 00:12:34.106 fused_ordering(523) 00:12:34.106 fused_ordering(524) 00:12:34.106 fused_ordering(525) 00:12:34.106 fused_ordering(526) 00:12:34.106 fused_ordering(527) 00:12:34.106 fused_ordering(528) 00:12:34.106 fused_ordering(529) 00:12:34.106 fused_ordering(530) 00:12:34.106 fused_ordering(531) 00:12:34.106 fused_ordering(532) 00:12:34.106 fused_ordering(533) 00:12:34.106 fused_ordering(534) 00:12:34.106 fused_ordering(535) 00:12:34.106 fused_ordering(536) 00:12:34.106 fused_ordering(537) 00:12:34.106 fused_ordering(538) 00:12:34.106 fused_ordering(539) 00:12:34.106 fused_ordering(540) 00:12:34.106 fused_ordering(541) 00:12:34.106 fused_ordering(542) 00:12:34.106 fused_ordering(543) 00:12:34.106 fused_ordering(544) 00:12:34.106 fused_ordering(545) 00:12:34.106 fused_ordering(546) 00:12:34.106 fused_ordering(547) 00:12:34.106 fused_ordering(548) 00:12:34.106 fused_ordering(549) 00:12:34.106 fused_ordering(550) 00:12:34.106 fused_ordering(551) 00:12:34.106 fused_ordering(552) 00:12:34.106 fused_ordering(553) 00:12:34.106 fused_ordering(554) 00:12:34.106 fused_ordering(555) 00:12:34.106 fused_ordering(556) 00:12:34.106 fused_ordering(557) 00:12:34.106 fused_ordering(558) 00:12:34.106 fused_ordering(559) 00:12:34.106 fused_ordering(560) 00:12:34.106 fused_ordering(561) 00:12:34.106 fused_ordering(562) 00:12:34.106 fused_ordering(563) 00:12:34.106 fused_ordering(564) 00:12:34.106 fused_ordering(565) 00:12:34.106 fused_ordering(566) 00:12:34.106 fused_ordering(567) 00:12:34.106 fused_ordering(568) 00:12:34.106 fused_ordering(569) 00:12:34.106 fused_ordering(570) 00:12:34.106 fused_ordering(571) 00:12:34.106 fused_ordering(572) 00:12:34.106 fused_ordering(573) 00:12:34.106 fused_ordering(574) 00:12:34.106 fused_ordering(575) 00:12:34.106 fused_ordering(576) 00:12:34.106 fused_ordering(577) 00:12:34.106 fused_ordering(578) 00:12:34.106 fused_ordering(579) 00:12:34.106 fused_ordering(580) 00:12:34.106 fused_ordering(581) 00:12:34.106 fused_ordering(582) 00:12:34.106 fused_ordering(583) 00:12:34.106 fused_ordering(584) 00:12:34.106 fused_ordering(585) 00:12:34.106 fused_ordering(586) 00:12:34.106 fused_ordering(587) 00:12:34.106 fused_ordering(588) 00:12:34.106 fused_ordering(589) 00:12:34.106 fused_ordering(590) 00:12:34.106 fused_ordering(591) 00:12:34.106 fused_ordering(592) 00:12:34.106 fused_ordering(593) 00:12:34.106 fused_ordering(594) 00:12:34.106 fused_ordering(595) 00:12:34.106 fused_ordering(596) 00:12:34.106 fused_ordering(597) 00:12:34.106 fused_ordering(598) 00:12:34.106 fused_ordering(599) 00:12:34.106 fused_ordering(600) 00:12:34.106 fused_ordering(601) 00:12:34.106 fused_ordering(602) 00:12:34.106 fused_ordering(603) 00:12:34.106 fused_ordering(604) 00:12:34.106 fused_ordering(605) 00:12:34.106 fused_ordering(606) 00:12:34.106 fused_ordering(607) 00:12:34.106 fused_ordering(608) 00:12:34.106 fused_ordering(609) 00:12:34.106 fused_ordering(610) 00:12:34.106 fused_ordering(611) 00:12:34.106 fused_ordering(612) 00:12:34.106 fused_ordering(613) 00:12:34.106 fused_ordering(614) 00:12:34.106 fused_ordering(615) 00:12:34.672 fused_ordering(616) 00:12:34.672 fused_ordering(617) 00:12:34.672 fused_ordering(618) 00:12:34.672 fused_ordering(619) 00:12:34.672 fused_ordering(620) 00:12:34.672 fused_ordering(621) 00:12:34.672 fused_ordering(622) 00:12:34.672 fused_ordering(623) 00:12:34.672 fused_ordering(624) 00:12:34.672 fused_ordering(625) 00:12:34.672 fused_ordering(626) 00:12:34.672 fused_ordering(627) 00:12:34.672 fused_ordering(628) 00:12:34.672 fused_ordering(629) 00:12:34.672 fused_ordering(630) 00:12:34.672 fused_ordering(631) 00:12:34.672 fused_ordering(632) 00:12:34.672 fused_ordering(633) 00:12:34.672 fused_ordering(634) 00:12:34.672 fused_ordering(635) 00:12:34.672 fused_ordering(636) 00:12:34.672 fused_ordering(637) 00:12:34.672 fused_ordering(638) 00:12:34.672 fused_ordering(639) 00:12:34.672 fused_ordering(640) 00:12:34.672 fused_ordering(641) 00:12:34.672 fused_ordering(642) 00:12:34.672 fused_ordering(643) 00:12:34.672 fused_ordering(644) 00:12:34.672 fused_ordering(645) 00:12:34.672 fused_ordering(646) 00:12:34.672 fused_ordering(647) 00:12:34.672 fused_ordering(648) 00:12:34.672 fused_ordering(649) 00:12:34.672 fused_ordering(650) 00:12:34.672 fused_ordering(651) 00:12:34.672 fused_ordering(652) 00:12:34.672 fused_ordering(653) 00:12:34.672 fused_ordering(654) 00:12:34.672 fused_ordering(655) 00:12:34.672 fused_ordering(656) 00:12:34.672 fused_ordering(657) 00:12:34.672 fused_ordering(658) 00:12:34.672 fused_ordering(659) 00:12:34.672 fused_ordering(660) 00:12:34.672 fused_ordering(661) 00:12:34.672 fused_ordering(662) 00:12:34.672 fused_ordering(663) 00:12:34.672 fused_ordering(664) 00:12:34.672 fused_ordering(665) 00:12:34.672 fused_ordering(666) 00:12:34.672 fused_ordering(667) 00:12:34.672 fused_ordering(668) 00:12:34.672 fused_ordering(669) 00:12:34.672 fused_ordering(670) 00:12:34.672 fused_ordering(671) 00:12:34.672 fused_ordering(672) 00:12:34.672 fused_ordering(673) 00:12:34.672 fused_ordering(674) 00:12:34.672 fused_ordering(675) 00:12:34.672 fused_ordering(676) 00:12:34.672 fused_ordering(677) 00:12:34.672 fused_ordering(678) 00:12:34.672 fused_ordering(679) 00:12:34.672 fused_ordering(680) 00:12:34.672 fused_ordering(681) 00:12:34.672 fused_ordering(682) 00:12:34.672 fused_ordering(683) 00:12:34.672 fused_ordering(684) 00:12:34.672 fused_ordering(685) 00:12:34.672 fused_ordering(686) 00:12:34.672 fused_ordering(687) 00:12:34.672 fused_ordering(688) 00:12:34.672 fused_ordering(689) 00:12:34.672 fused_ordering(690) 00:12:34.672 fused_ordering(691) 00:12:34.672 fused_ordering(692) 00:12:34.672 fused_ordering(693) 00:12:34.672 fused_ordering(694) 00:12:34.672 fused_ordering(695) 00:12:34.672 fused_ordering(696) 00:12:34.672 fused_ordering(697) 00:12:34.672 fused_ordering(698) 00:12:34.672 fused_ordering(699) 00:12:34.672 fused_ordering(700) 00:12:34.672 fused_ordering(701) 00:12:34.672 fused_ordering(702) 00:12:34.672 fused_ordering(703) 00:12:34.672 fused_ordering(704) 00:12:34.672 fused_ordering(705) 00:12:34.672 fused_ordering(706) 00:12:34.672 fused_ordering(707) 00:12:34.672 fused_ordering(708) 00:12:34.672 fused_ordering(709) 00:12:34.672 fused_ordering(710) 00:12:34.672 fused_ordering(711) 00:12:34.672 fused_ordering(712) 00:12:34.672 fused_ordering(713) 00:12:34.672 fused_ordering(714) 00:12:34.672 fused_ordering(715) 00:12:34.672 fused_ordering(716) 00:12:34.672 fused_ordering(717) 00:12:34.672 fused_ordering(718) 00:12:34.672 fused_ordering(719) 00:12:34.672 fused_ordering(720) 00:12:34.672 fused_ordering(721) 00:12:34.672 fused_ordering(722) 00:12:34.672 fused_ordering(723) 00:12:34.672 fused_ordering(724) 00:12:34.672 fused_ordering(725) 00:12:34.672 fused_ordering(726) 00:12:34.672 fused_ordering(727) 00:12:34.672 fused_ordering(728) 00:12:34.672 fused_ordering(729) 00:12:34.672 fused_ordering(730) 00:12:34.672 fused_ordering(731) 00:12:34.672 fused_ordering(732) 00:12:34.672 fused_ordering(733) 00:12:34.672 fused_ordering(734) 00:12:34.672 fused_ordering(735) 00:12:34.672 fused_ordering(736) 00:12:34.672 fused_ordering(737) 00:12:34.672 fused_ordering(738) 00:12:34.672 fused_ordering(739) 00:12:34.672 fused_ordering(740) 00:12:34.672 fused_ordering(741) 00:12:34.672 fused_ordering(742) 00:12:34.672 fused_ordering(743) 00:12:34.672 fused_ordering(744) 00:12:34.672 fused_ordering(745) 00:12:34.672 fused_ordering(746) 00:12:34.672 fused_ordering(747) 00:12:34.672 fused_ordering(748) 00:12:34.672 fused_ordering(749) 00:12:34.672 fused_ordering(750) 00:12:34.672 fused_ordering(751) 00:12:34.672 fused_ordering(752) 00:12:34.672 fused_ordering(753) 00:12:34.672 fused_ordering(754) 00:12:34.672 fused_ordering(755) 00:12:34.672 fused_ordering(756) 00:12:34.672 fused_ordering(757) 00:12:34.672 fused_ordering(758) 00:12:34.672 fused_ordering(759) 00:12:34.672 fused_ordering(760) 00:12:34.672 fused_ordering(761) 00:12:34.672 fused_ordering(762) 00:12:34.672 fused_ordering(763) 00:12:34.672 fused_ordering(764) 00:12:34.672 fused_ordering(765) 00:12:34.672 fused_ordering(766) 00:12:34.672 fused_ordering(767) 00:12:34.672 fused_ordering(768) 00:12:34.672 fused_ordering(769) 00:12:34.672 fused_ordering(770) 00:12:34.672 fused_ordering(771) 00:12:34.672 fused_ordering(772) 00:12:34.672 fused_ordering(773) 00:12:34.672 fused_ordering(774) 00:12:34.672 fused_ordering(775) 00:12:34.672 fused_ordering(776) 00:12:34.672 fused_ordering(777) 00:12:34.672 fused_ordering(778) 00:12:34.672 fused_ordering(779) 00:12:34.672 fused_ordering(780) 00:12:34.672 fused_ordering(781) 00:12:34.672 fused_ordering(782) 00:12:34.672 fused_ordering(783) 00:12:34.672 fused_ordering(784) 00:12:34.672 fused_ordering(785) 00:12:34.672 fused_ordering(786) 00:12:34.672 fused_ordering(787) 00:12:34.672 fused_ordering(788) 00:12:34.672 fused_ordering(789) 00:12:34.672 fused_ordering(790) 00:12:34.672 fused_ordering(791) 00:12:34.672 fused_ordering(792) 00:12:34.672 fused_ordering(793) 00:12:34.672 fused_ordering(794) 00:12:34.672 fused_ordering(795) 00:12:34.672 fused_ordering(796) 00:12:34.672 fused_ordering(797) 00:12:34.672 fused_ordering(798) 00:12:34.672 fused_ordering(799) 00:12:34.672 fused_ordering(800) 00:12:34.672 fused_ordering(801) 00:12:34.672 fused_ordering(802) 00:12:34.672 fused_ordering(803) 00:12:34.672 fused_ordering(804) 00:12:34.672 fused_ordering(805) 00:12:34.672 fused_ordering(806) 00:12:34.672 fused_ordering(807) 00:12:34.672 fused_ordering(808) 00:12:34.672 fused_ordering(809) 00:12:34.672 fused_ordering(810) 00:12:34.672 fused_ordering(811) 00:12:34.672 fused_ordering(812) 00:12:34.672 fused_ordering(813) 00:12:34.672 fused_ordering(814) 00:12:34.672 fused_ordering(815) 00:12:34.672 fused_ordering(816) 00:12:34.672 fused_ordering(817) 00:12:34.672 fused_ordering(818) 00:12:34.672 fused_ordering(819) 00:12:34.672 fused_ordering(820) 00:12:35.604 fused_ordering(821) 00:12:35.604 fused_ordering(822) 00:12:35.604 fused_ordering(823) 00:12:35.604 fused_ordering(824) 00:12:35.604 fused_ordering(825) 00:12:35.604 fused_ordering(826) 00:12:35.604 fused_ordering(827) 00:12:35.604 fused_ordering(828) 00:12:35.604 fused_ordering(829) 00:12:35.604 fused_ordering(830) 00:12:35.604 fused_ordering(831) 00:12:35.604 fused_ordering(832) 00:12:35.604 fused_ordering(833) 00:12:35.604 fused_ordering(834) 00:12:35.604 fused_ordering(835) 00:12:35.604 fused_ordering(836) 00:12:35.604 fused_ordering(837) 00:12:35.604 fused_ordering(838) 00:12:35.604 fused_ordering(839) 00:12:35.604 fused_ordering(840) 00:12:35.604 fused_ordering(841) 00:12:35.604 fused_ordering(842) 00:12:35.604 fused_ordering(843) 00:12:35.604 fused_ordering(844) 00:12:35.604 fused_ordering(845) 00:12:35.604 fused_ordering(846) 00:12:35.604 fused_ordering(847) 00:12:35.604 fused_ordering(848) 00:12:35.604 fused_ordering(849) 00:12:35.604 fused_ordering(850) 00:12:35.604 fused_ordering(851) 00:12:35.604 fused_ordering(852) 00:12:35.604 fused_ordering(853) 00:12:35.604 fused_ordering(854) 00:12:35.604 fused_ordering(855) 00:12:35.604 fused_ordering(856) 00:12:35.604 fused_ordering(857) 00:12:35.604 fused_ordering(858) 00:12:35.604 fused_ordering(859) 00:12:35.604 fused_ordering(860) 00:12:35.604 fused_ordering(861) 00:12:35.604 fused_ordering(862) 00:12:35.604 fused_ordering(863) 00:12:35.604 fused_ordering(864) 00:12:35.604 fused_ordering(865) 00:12:35.604 fused_ordering(866) 00:12:35.604 fused_ordering(867) 00:12:35.604 fused_ordering(868) 00:12:35.604 fused_ordering(869) 00:12:35.604 fused_ordering(870) 00:12:35.604 fused_ordering(871) 00:12:35.604 fused_ordering(872) 00:12:35.604 fused_ordering(873) 00:12:35.604 fused_ordering(874) 00:12:35.604 fused_ordering(875) 00:12:35.604 fused_ordering(876) 00:12:35.604 fused_ordering(877) 00:12:35.604 fused_ordering(878) 00:12:35.604 fused_ordering(879) 00:12:35.604 fused_ordering(880) 00:12:35.604 fused_ordering(881) 00:12:35.604 fused_ordering(882) 00:12:35.604 fused_ordering(883) 00:12:35.604 fused_ordering(884) 00:12:35.604 fused_ordering(885) 00:12:35.604 fused_ordering(886) 00:12:35.604 fused_ordering(887) 00:12:35.604 fused_ordering(888) 00:12:35.604 fused_ordering(889) 00:12:35.604 fused_ordering(890) 00:12:35.604 fused_ordering(891) 00:12:35.604 fused_ordering(892) 00:12:35.604 fused_ordering(893) 00:12:35.604 fused_ordering(894) 00:12:35.604 fused_ordering(895) 00:12:35.604 fused_ordering(896) 00:12:35.604 fused_ordering(897) 00:12:35.604 fused_ordering(898) 00:12:35.604 fused_ordering(899) 00:12:35.604 fused_ordering(900) 00:12:35.604 fused_ordering(901) 00:12:35.604 fused_ordering(902) 00:12:35.604 fused_ordering(903) 00:12:35.604 fused_ordering(904) 00:12:35.604 fused_ordering(905) 00:12:35.604 fused_ordering(906) 00:12:35.604 fused_ordering(907) 00:12:35.604 fused_ordering(908) 00:12:35.604 fused_ordering(909) 00:12:35.604 fused_ordering(910) 00:12:35.604 fused_ordering(911) 00:12:35.604 fused_ordering(912) 00:12:35.604 fused_ordering(913) 00:12:35.604 fused_ordering(914) 00:12:35.604 fused_ordering(915) 00:12:35.604 fused_ordering(916) 00:12:35.604 fused_ordering(917) 00:12:35.604 fused_ordering(918) 00:12:35.604 fused_ordering(919) 00:12:35.604 fused_ordering(920) 00:12:35.604 fused_ordering(921) 00:12:35.604 fused_ordering(922) 00:12:35.604 fused_ordering(923) 00:12:35.604 fused_ordering(924) 00:12:35.604 fused_ordering(925) 00:12:35.604 fused_ordering(926) 00:12:35.604 fused_ordering(927) 00:12:35.604 fused_ordering(928) 00:12:35.604 fused_ordering(929) 00:12:35.604 fused_ordering(930) 00:12:35.604 fused_ordering(931) 00:12:35.604 fused_ordering(932) 00:12:35.604 fused_ordering(933) 00:12:35.604 fused_ordering(934) 00:12:35.604 fused_ordering(935) 00:12:35.604 fused_ordering(936) 00:12:35.604 fused_ordering(937) 00:12:35.604 fused_ordering(938) 00:12:35.604 fused_ordering(939) 00:12:35.604 fused_ordering(940) 00:12:35.604 fused_ordering(941) 00:12:35.604 fused_ordering(942) 00:12:35.604 fused_ordering(943) 00:12:35.604 fused_ordering(944) 00:12:35.604 fused_ordering(945) 00:12:35.604 fused_ordering(946) 00:12:35.604 fused_ordering(947) 00:12:35.604 fused_ordering(948) 00:12:35.604 fused_ordering(949) 00:12:35.604 fused_ordering(950) 00:12:35.604 fused_ordering(951) 00:12:35.604 fused_ordering(952) 00:12:35.604 fused_ordering(953) 00:12:35.604 fused_ordering(954) 00:12:35.604 fused_ordering(955) 00:12:35.604 fused_ordering(956) 00:12:35.604 fused_ordering(957) 00:12:35.604 fused_ordering(958) 00:12:35.604 fused_ordering(959) 00:12:35.604 fused_ordering(960) 00:12:35.604 fused_ordering(961) 00:12:35.604 fused_ordering(962) 00:12:35.604 fused_ordering(963) 00:12:35.604 fused_ordering(964) 00:12:35.604 fused_ordering(965) 00:12:35.604 fused_ordering(966) 00:12:35.604 fused_ordering(967) 00:12:35.604 fused_ordering(968) 00:12:35.604 fused_ordering(969) 00:12:35.604 fused_ordering(970) 00:12:35.604 fused_ordering(971) 00:12:35.604 fused_ordering(972) 00:12:35.604 fused_ordering(973) 00:12:35.604 fused_ordering(974) 00:12:35.604 fused_ordering(975) 00:12:35.604 fused_ordering(976) 00:12:35.604 fused_ordering(977) 00:12:35.604 fused_ordering(978) 00:12:35.604 fused_ordering(979) 00:12:35.604 fused_ordering(980) 00:12:35.604 fused_ordering(981) 00:12:35.604 fused_ordering(982) 00:12:35.604 fused_ordering(983) 00:12:35.604 fused_ordering(984) 00:12:35.604 fused_ordering(985) 00:12:35.604 fused_ordering(986) 00:12:35.604 fused_ordering(987) 00:12:35.604 fused_ordering(988) 00:12:35.604 fused_ordering(989) 00:12:35.604 fused_ordering(990) 00:12:35.604 fused_ordering(991) 00:12:35.604 fused_ordering(992) 00:12:35.604 fused_ordering(993) 00:12:35.604 fused_ordering(994) 00:12:35.604 fused_ordering(995) 00:12:35.604 fused_ordering(996) 00:12:35.604 fused_ordering(997) 00:12:35.604 fused_ordering(998) 00:12:35.604 fused_ordering(999) 00:12:35.604 fused_ordering(1000) 00:12:35.604 fused_ordering(1001) 00:12:35.604 fused_ordering(1002) 00:12:35.605 fused_ordering(1003) 00:12:35.605 fused_ordering(1004) 00:12:35.605 fused_ordering(1005) 00:12:35.605 fused_ordering(1006) 00:12:35.605 fused_ordering(1007) 00:12:35.605 fused_ordering(1008) 00:12:35.605 fused_ordering(1009) 00:12:35.605 fused_ordering(1010) 00:12:35.605 fused_ordering(1011) 00:12:35.605 fused_ordering(1012) 00:12:35.605 fused_ordering(1013) 00:12:35.605 fused_ordering(1014) 00:12:35.605 fused_ordering(1015) 00:12:35.605 fused_ordering(1016) 00:12:35.605 fused_ordering(1017) 00:12:35.605 fused_ordering(1018) 00:12:35.605 fused_ordering(1019) 00:12:35.605 fused_ordering(1020) 00:12:35.605 fused_ordering(1021) 00:12:35.605 fused_ordering(1022) 00:12:35.605 fused_ordering(1023) 00:12:35.605 22:50:26 -- target/fused_ordering.sh@23 -- # trap - SIGINT SIGTERM EXIT 00:12:35.605 22:50:26 -- target/fused_ordering.sh@25 -- # nvmftestfini 00:12:35.605 22:50:26 -- nvmf/common.sh@476 -- # nvmfcleanup 00:12:35.605 22:50:26 -- nvmf/common.sh@116 -- # sync 00:12:35.605 22:50:26 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:12:35.605 22:50:26 -- nvmf/common.sh@119 -- # set +e 00:12:35.605 22:50:26 -- nvmf/common.sh@120 -- # for i in {1..20} 00:12:35.605 22:50:26 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:12:35.605 rmmod nvme_tcp 00:12:35.605 rmmod nvme_fabrics 00:12:35.605 rmmod nvme_keyring 00:12:35.605 22:50:26 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:12:35.605 22:50:26 -- nvmf/common.sh@123 -- # set -e 00:12:35.605 22:50:26 -- nvmf/common.sh@124 -- # return 0 00:12:35.605 22:50:26 -- nvmf/common.sh@477 -- # '[' -n 239246 ']' 00:12:35.605 22:50:26 -- nvmf/common.sh@478 -- # killprocess 239246 00:12:35.605 22:50:26 -- common/autotest_common.sh@926 -- # '[' -z 239246 ']' 00:12:35.605 22:50:26 -- common/autotest_common.sh@930 -- # kill -0 239246 00:12:35.605 22:50:26 -- common/autotest_common.sh@931 -- # uname 00:12:35.605 22:50:26 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:12:35.605 22:50:26 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 239246 00:12:35.605 22:50:26 -- common/autotest_common.sh@932 -- # process_name=reactor_1 00:12:35.605 22:50:26 -- common/autotest_common.sh@936 -- # '[' reactor_1 = sudo ']' 00:12:35.605 22:50:26 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 239246' 00:12:35.605 killing process with pid 239246 00:12:35.605 22:50:26 -- common/autotest_common.sh@945 -- # kill 239246 00:12:35.605 22:50:26 -- common/autotest_common.sh@950 -- # wait 239246 00:12:35.864 22:50:26 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:12:35.864 22:50:26 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:12:35.864 22:50:26 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:12:35.864 22:50:26 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:12:35.864 22:50:26 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:12:35.864 22:50:26 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:12:35.864 22:50:26 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:12:35.864 22:50:26 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:12:37.805 22:50:28 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:12:37.806 00:12:37.806 real 0m8.623s 00:12:37.806 user 0m5.981s 00:12:37.806 sys 0m3.795s 00:12:37.806 22:50:28 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:12:37.806 22:50:28 -- common/autotest_common.sh@10 -- # set +x 00:12:37.806 ************************************ 00:12:37.806 END TEST nvmf_fused_ordering 00:12:37.806 ************************************ 00:12:37.806 22:50:28 -- nvmf/nvmf.sh@35 -- # run_test nvmf_delete_subsystem /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/delete_subsystem.sh --transport=tcp 00:12:37.806 22:50:28 -- common/autotest_common.sh@1077 -- # '[' 3 -le 1 ']' 00:12:37.806 22:50:28 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:12:37.806 22:50:28 -- common/autotest_common.sh@10 -- # set +x 00:12:37.806 ************************************ 00:12:37.806 START TEST nvmf_delete_subsystem 00:12:37.806 ************************************ 00:12:37.806 22:50:28 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/delete_subsystem.sh --transport=tcp 00:12:37.806 * Looking for test storage... 00:12:37.806 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:12:37.806 22:50:28 -- target/delete_subsystem.sh@10 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:12:37.806 22:50:28 -- nvmf/common.sh@7 -- # uname -s 00:12:37.806 22:50:28 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:12:37.806 22:50:28 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:12:37.806 22:50:28 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:12:37.806 22:50:28 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:12:37.806 22:50:28 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:12:37.806 22:50:28 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:12:37.806 22:50:28 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:12:37.806 22:50:28 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:12:37.806 22:50:28 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:12:37.806 22:50:28 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:12:37.806 22:50:28 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:12:37.806 22:50:28 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:12:37.806 22:50:28 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:12:37.806 22:50:28 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:12:37.806 22:50:28 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:12:37.806 22:50:28 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:12:37.806 22:50:28 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:12:37.806 22:50:28 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:12:37.806 22:50:28 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:12:37.806 22:50:28 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:12:37.806 22:50:28 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:12:37.806 22:50:28 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:12:37.806 22:50:28 -- paths/export.sh@5 -- # export PATH 00:12:37.806 22:50:28 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:12:37.806 22:50:28 -- nvmf/common.sh@46 -- # : 0 00:12:37.806 22:50:28 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:12:37.806 22:50:28 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:12:37.806 22:50:28 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:12:37.806 22:50:28 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:12:37.806 22:50:28 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:12:37.806 22:50:28 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:12:37.806 22:50:28 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:12:37.806 22:50:28 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:12:37.806 22:50:28 -- target/delete_subsystem.sh@12 -- # nvmftestinit 00:12:37.806 22:50:28 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:12:37.806 22:50:28 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:12:37.806 22:50:28 -- nvmf/common.sh@436 -- # prepare_net_devs 00:12:37.806 22:50:28 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:12:37.806 22:50:28 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:12:37.806 22:50:28 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:12:37.806 22:50:28 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:12:37.806 22:50:28 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:12:37.806 22:50:28 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:12:37.806 22:50:28 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:12:37.806 22:50:28 -- nvmf/common.sh@284 -- # xtrace_disable 00:12:37.806 22:50:28 -- common/autotest_common.sh@10 -- # set +x 00:12:40.339 22:50:31 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:12:40.339 22:50:31 -- nvmf/common.sh@290 -- # pci_devs=() 00:12:40.339 22:50:31 -- nvmf/common.sh@290 -- # local -a pci_devs 00:12:40.339 22:50:31 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:12:40.339 22:50:31 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:12:40.339 22:50:31 -- nvmf/common.sh@292 -- # pci_drivers=() 00:12:40.339 22:50:31 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:12:40.339 22:50:31 -- nvmf/common.sh@294 -- # net_devs=() 00:12:40.339 22:50:31 -- nvmf/common.sh@294 -- # local -ga net_devs 00:12:40.339 22:50:31 -- nvmf/common.sh@295 -- # e810=() 00:12:40.339 22:50:31 -- nvmf/common.sh@295 -- # local -ga e810 00:12:40.339 22:50:31 -- nvmf/common.sh@296 -- # x722=() 00:12:40.339 22:50:31 -- nvmf/common.sh@296 -- # local -ga x722 00:12:40.339 22:50:31 -- nvmf/common.sh@297 -- # mlx=() 00:12:40.339 22:50:31 -- nvmf/common.sh@297 -- # local -ga mlx 00:12:40.339 22:50:31 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:12:40.339 22:50:31 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:12:40.339 22:50:31 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:12:40.339 22:50:31 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:12:40.339 22:50:31 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:12:40.339 22:50:31 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:12:40.339 22:50:31 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:12:40.339 22:50:31 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:12:40.339 22:50:31 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:12:40.339 22:50:31 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:12:40.339 22:50:31 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:12:40.339 22:50:31 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:12:40.339 22:50:31 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:12:40.339 22:50:31 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:12:40.339 22:50:31 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:12:40.339 22:50:31 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:12:40.339 22:50:31 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:12:40.339 22:50:31 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:12:40.339 22:50:31 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:12:40.339 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:12:40.339 22:50:31 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:12:40.339 22:50:31 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:12:40.339 22:50:31 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:12:40.339 22:50:31 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:12:40.339 22:50:31 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:12:40.339 22:50:31 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:12:40.339 22:50:31 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:12:40.339 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:12:40.339 22:50:31 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:12:40.339 22:50:31 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:12:40.339 22:50:31 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:12:40.339 22:50:31 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:12:40.339 22:50:31 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:12:40.339 22:50:31 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:12:40.339 22:50:31 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:12:40.339 22:50:31 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:12:40.339 22:50:31 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:12:40.339 22:50:31 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:12:40.339 22:50:31 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:12:40.339 22:50:31 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:12:40.339 22:50:31 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:12:40.339 Found net devices under 0000:0a:00.0: cvl_0_0 00:12:40.339 22:50:31 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:12:40.339 22:50:31 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:12:40.339 22:50:31 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:12:40.339 22:50:31 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:12:40.339 22:50:31 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:12:40.339 22:50:31 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:12:40.339 Found net devices under 0000:0a:00.1: cvl_0_1 00:12:40.339 22:50:31 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:12:40.339 22:50:31 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:12:40.339 22:50:31 -- nvmf/common.sh@402 -- # is_hw=yes 00:12:40.339 22:50:31 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:12:40.339 22:50:31 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:12:40.339 22:50:31 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:12:40.339 22:50:31 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:12:40.339 22:50:31 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:12:40.339 22:50:31 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:12:40.339 22:50:31 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:12:40.339 22:50:31 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:12:40.339 22:50:31 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:12:40.339 22:50:31 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:12:40.339 22:50:31 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:12:40.339 22:50:31 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:12:40.339 22:50:31 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:12:40.339 22:50:31 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:12:40.339 22:50:31 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:12:40.339 22:50:31 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:12:40.339 22:50:31 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:12:40.339 22:50:31 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:12:40.339 22:50:31 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:12:40.339 22:50:31 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:12:40.339 22:50:31 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:12:40.339 22:50:31 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:12:40.339 22:50:31 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:12:40.339 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:12:40.339 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.157 ms 00:12:40.339 00:12:40.339 --- 10.0.0.2 ping statistics --- 00:12:40.339 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:12:40.339 rtt min/avg/max/mdev = 0.157/0.157/0.157/0.000 ms 00:12:40.339 22:50:31 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:12:40.339 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:12:40.339 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.086 ms 00:12:40.339 00:12:40.339 --- 10.0.0.1 ping statistics --- 00:12:40.339 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:12:40.339 rtt min/avg/max/mdev = 0.086/0.086/0.086/0.000 ms 00:12:40.339 22:50:31 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:12:40.339 22:50:31 -- nvmf/common.sh@410 -- # return 0 00:12:40.339 22:50:31 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:12:40.339 22:50:31 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:12:40.339 22:50:31 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:12:40.339 22:50:31 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:12:40.339 22:50:31 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:12:40.339 22:50:31 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:12:40.339 22:50:31 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:12:40.339 22:50:31 -- target/delete_subsystem.sh@13 -- # nvmfappstart -m 0x3 00:12:40.339 22:50:31 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:12:40.339 22:50:31 -- common/autotest_common.sh@712 -- # xtrace_disable 00:12:40.339 22:50:31 -- common/autotest_common.sh@10 -- # set +x 00:12:40.339 22:50:31 -- nvmf/common.sh@469 -- # nvmfpid=241755 00:12:40.339 22:50:31 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x3 00:12:40.339 22:50:31 -- nvmf/common.sh@470 -- # waitforlisten 241755 00:12:40.339 22:50:31 -- common/autotest_common.sh@819 -- # '[' -z 241755 ']' 00:12:40.339 22:50:31 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk.sock 00:12:40.339 22:50:31 -- common/autotest_common.sh@824 -- # local max_retries=100 00:12:40.339 22:50:31 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:12:40.339 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:12:40.339 22:50:31 -- common/autotest_common.sh@828 -- # xtrace_disable 00:12:40.339 22:50:31 -- common/autotest_common.sh@10 -- # set +x 00:12:40.339 [2024-04-16 22:50:31.237137] Starting SPDK v24.01.1-pre git sha1 4b134b4ab / DPDK 23.11.0 initialization... 00:12:40.339 [2024-04-16 22:50:31.237252] [ DPDK EAL parameters: nvmf -c 0x3 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:12:40.339 EAL: No free 2048 kB hugepages reported on node 1 00:12:40.339 [2024-04-16 22:50:31.307533] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 2 00:12:40.339 [2024-04-16 22:50:31.425103] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:12:40.339 [2024-04-16 22:50:31.425288] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:12:40.339 [2024-04-16 22:50:31.425318] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:12:40.339 [2024-04-16 22:50:31.425337] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:12:40.339 [2024-04-16 22:50:31.425418] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:12:40.339 [2024-04-16 22:50:31.425425] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:12:41.272 22:50:32 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:12:41.272 22:50:32 -- common/autotest_common.sh@852 -- # return 0 00:12:41.272 22:50:32 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:12:41.272 22:50:32 -- common/autotest_common.sh@718 -- # xtrace_disable 00:12:41.272 22:50:32 -- common/autotest_common.sh@10 -- # set +x 00:12:41.272 22:50:32 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:12:41.272 22:50:32 -- target/delete_subsystem.sh@15 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:12:41.272 22:50:32 -- common/autotest_common.sh@551 -- # xtrace_disable 00:12:41.272 22:50:32 -- common/autotest_common.sh@10 -- # set +x 00:12:41.272 [2024-04-16 22:50:32.187484] tcp.c: 659:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:12:41.272 22:50:32 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:12:41.272 22:50:32 -- target/delete_subsystem.sh@16 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 -m 10 00:12:41.272 22:50:32 -- common/autotest_common.sh@551 -- # xtrace_disable 00:12:41.272 22:50:32 -- common/autotest_common.sh@10 -- # set +x 00:12:41.272 22:50:32 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:12:41.272 22:50:32 -- target/delete_subsystem.sh@17 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:12:41.272 22:50:32 -- common/autotest_common.sh@551 -- # xtrace_disable 00:12:41.272 22:50:32 -- common/autotest_common.sh@10 -- # set +x 00:12:41.272 [2024-04-16 22:50:32.203710] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:12:41.272 22:50:32 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:12:41.272 22:50:32 -- target/delete_subsystem.sh@18 -- # rpc_cmd bdev_null_create NULL1 1000 512 00:12:41.272 22:50:32 -- common/autotest_common.sh@551 -- # xtrace_disable 00:12:41.272 22:50:32 -- common/autotest_common.sh@10 -- # set +x 00:12:41.272 NULL1 00:12:41.272 22:50:32 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:12:41.272 22:50:32 -- target/delete_subsystem.sh@23 -- # rpc_cmd bdev_delay_create -b NULL1 -d Delay0 -r 1000000 -t 1000000 -w 1000000 -n 1000000 00:12:41.273 22:50:32 -- common/autotest_common.sh@551 -- # xtrace_disable 00:12:41.273 22:50:32 -- common/autotest_common.sh@10 -- # set +x 00:12:41.273 Delay0 00:12:41.273 22:50:32 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:12:41.273 22:50:32 -- target/delete_subsystem.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:12:41.273 22:50:32 -- common/autotest_common.sh@551 -- # xtrace_disable 00:12:41.273 22:50:32 -- common/autotest_common.sh@10 -- # set +x 00:12:41.273 22:50:32 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:12:41.273 22:50:32 -- target/delete_subsystem.sh@28 -- # perf_pid=241813 00:12:41.273 22:50:32 -- target/delete_subsystem.sh@30 -- # sleep 2 00:12:41.273 22:50:32 -- target/delete_subsystem.sh@26 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -c 0xC -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' -t 5 -q 128 -w randrw -M 70 -o 512 -P 4 00:12:41.273 EAL: No free 2048 kB hugepages reported on node 1 00:12:41.273 [2024-04-16 22:50:32.288390] subsystem.c:1304:spdk_nvmf_subsystem_listener_allowed: *WARNING*: Allowing connection to discovery subsystem on TCP/10.0.0.2/4420, even though this listener was not added to the discovery subsystem. This behavior is deprecated and will be removed in a future release. 00:12:43.168 22:50:34 -- target/delete_subsystem.sh@32 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:12:43.168 22:50:34 -- common/autotest_common.sh@551 -- # xtrace_disable 00:12:43.168 22:50:34 -- common/autotest_common.sh@10 -- # set +x 00:12:43.425 Read completed with error (sct=0, sc=8) 00:12:43.425 Write completed with error (sct=0, sc=8) 00:12:43.425 Read completed with error (sct=0, sc=8) 00:12:43.425 Read completed with error (sct=0, sc=8) 00:12:43.425 starting I/O failed: -6 00:12:43.425 Write completed with error (sct=0, sc=8) 00:12:43.425 Read completed with error (sct=0, sc=8) 00:12:43.425 Read completed with error (sct=0, sc=8) 00:12:43.425 Read completed with error (sct=0, sc=8) 00:12:43.425 starting I/O failed: -6 00:12:43.425 Read completed with error (sct=0, sc=8) 00:12:43.425 Read completed with error (sct=0, sc=8) 00:12:43.425 Read completed with error (sct=0, sc=8) 00:12:43.425 Write completed with error (sct=0, sc=8) 00:12:43.425 starting I/O failed: -6 00:12:43.425 Write completed with error (sct=0, sc=8) 00:12:43.425 Read completed with error (sct=0, sc=8) 00:12:43.425 Read completed with error (sct=0, sc=8) 00:12:43.425 Read completed with error (sct=0, sc=8) 00:12:43.426 starting I/O failed: -6 00:12:43.426 Read completed with error (sct=0, sc=8) 00:12:43.426 Write completed with error (sct=0, sc=8) 00:12:43.426 Read completed with error (sct=0, sc=8) 00:12:43.426 Read completed with error (sct=0, sc=8) 00:12:43.426 starting I/O failed: -6 00:12:43.426 Read completed with error (sct=0, sc=8) 00:12:43.426 Read completed with error (sct=0, sc=8) 00:12:43.426 Read completed with error (sct=0, sc=8) 00:12:43.426 Write completed with error (sct=0, sc=8) 00:12:43.426 starting I/O failed: -6 00:12:43.426 Read completed with error (sct=0, sc=8) 00:12:43.426 Read completed with error (sct=0, sc=8) 00:12:43.426 Read completed with error (sct=0, sc=8) 00:12:43.426 Read completed with error (sct=0, sc=8) 00:12:43.426 starting I/O failed: -6 00:12:43.426 Read completed with error (sct=0, sc=8) 00:12:43.426 Read completed with error (sct=0, sc=8) 00:12:43.426 Read completed with error (sct=0, sc=8) 00:12:43.426 Write completed with error (sct=0, sc=8) 00:12:43.426 starting I/O failed: -6 00:12:43.426 Read completed with error (sct=0, sc=8) 00:12:43.426 Write completed with error (sct=0, sc=8) 00:12:43.426 Read completed with error (sct=0, sc=8) 00:12:43.426 Write completed with error (sct=0, sc=8) 00:12:43.426 starting I/O failed: -6 00:12:43.426 Write completed with error (sct=0, sc=8) 00:12:43.426 Read completed with error (sct=0, sc=8) 00:12:43.426 Read completed with error (sct=0, sc=8) 00:12:43.426 Read completed with error (sct=0, sc=8) 00:12:43.426 starting I/O failed: -6 00:12:43.426 Read completed with error (sct=0, sc=8) 00:12:43.426 Write completed with error (sct=0, sc=8) 00:12:43.426 Read completed with error (sct=0, sc=8) 00:12:43.426 [2024-04-16 22:50:34.329599] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7f653800c1d0 is same with the state(5) to be set 00:12:43.426 Write completed with error (sct=0, sc=8) 00:12:43.426 Read completed with error (sct=0, sc=8) 00:12:43.426 Write completed with error (sct=0, sc=8) 00:12:43.426 Read completed with error (sct=0, sc=8) 00:12:43.426 Read completed with error (sct=0, sc=8) 00:12:43.426 Read completed with error (sct=0, sc=8) 00:12:43.426 Write completed with error (sct=0, sc=8) 00:12:43.426 starting I/O failed: -6 00:12:43.426 Read completed with error (sct=0, sc=8) 00:12:43.426 Read completed with error (sct=0, sc=8) 00:12:43.426 Write completed with error (sct=0, sc=8) 00:12:43.426 Read completed with error (sct=0, sc=8) 00:12:43.426 Read completed with error (sct=0, sc=8) 00:12:43.426 Write completed with error (sct=0, sc=8) 00:12:43.426 Write completed with error (sct=0, sc=8) 00:12:43.426 Read completed with error (sct=0, sc=8) 00:12:43.426 Read completed with error (sct=0, sc=8) 00:12:43.426 Write completed with error (sct=0, sc=8) 00:12:43.426 Read completed with error (sct=0, sc=8) 00:12:43.426 Read completed with error (sct=0, sc=8) 00:12:43.426 starting I/O failed: -6 00:12:43.426 Write completed with error (sct=0, sc=8) 00:12:43.426 Read completed with error (sct=0, sc=8) 00:12:43.426 Write completed with error (sct=0, sc=8) 00:12:43.426 Write completed with error (sct=0, sc=8) 00:12:43.426 Read completed with error (sct=0, sc=8) 00:12:43.426 Read completed with error (sct=0, sc=8) 00:12:43.426 Read completed with error (sct=0, sc=8) 00:12:43.426 Write completed with error (sct=0, sc=8) 00:12:43.426 Write completed with error (sct=0, sc=8) 00:12:43.426 Read completed with error (sct=0, sc=8) 00:12:43.426 Write completed with error (sct=0, sc=8) 00:12:43.426 starting I/O failed: -6 00:12:43.426 Write completed with error (sct=0, sc=8) 00:12:43.426 Read completed with error (sct=0, sc=8) 00:12:43.426 Write completed with error (sct=0, sc=8) 00:12:43.426 Write completed with error (sct=0, sc=8) 00:12:43.426 Read completed with error (sct=0, sc=8) 00:12:43.426 Read completed with error (sct=0, sc=8) 00:12:43.426 Read completed with error (sct=0, sc=8) 00:12:43.426 Read completed with error (sct=0, sc=8) 00:12:43.426 starting I/O failed: -6 00:12:43.426 Read completed with error (sct=0, sc=8) 00:12:43.426 Write completed with error (sct=0, sc=8) 00:12:43.426 Write completed with error (sct=0, sc=8) 00:12:43.426 Read completed with error (sct=0, sc=8) 00:12:43.426 starting I/O failed: -6 00:12:43.426 Read completed with error (sct=0, sc=8) 00:12:43.426 Read completed with error (sct=0, sc=8) 00:12:43.426 Write completed with error (sct=0, sc=8) 00:12:43.426 Read completed with error (sct=0, sc=8) 00:12:43.426 Read completed with error (sct=0, sc=8) 00:12:43.426 Read completed with error (sct=0, sc=8) 00:12:43.426 Read completed with error (sct=0, sc=8) 00:12:43.426 Write completed with error (sct=0, sc=8) 00:12:43.426 Read completed with error (sct=0, sc=8) 00:12:43.426 Read completed with error (sct=0, sc=8) 00:12:43.426 Write completed with error (sct=0, sc=8) 00:12:43.426 Read completed with error (sct=0, sc=8) 00:12:43.426 starting I/O failed: -6 00:12:43.426 Read completed with error (sct=0, sc=8) 00:12:43.426 Write completed with error (sct=0, sc=8) 00:12:43.426 Read completed with error (sct=0, sc=8) 00:12:43.426 Read completed with error (sct=0, sc=8) 00:12:43.426 Read completed with error (sct=0, sc=8) 00:12:43.426 Read completed with error (sct=0, sc=8) 00:12:43.426 Write completed with error (sct=0, sc=8) 00:12:43.426 Write completed with error (sct=0, sc=8) 00:12:43.426 Write completed with error (sct=0, sc=8) 00:12:43.426 Read completed with error (sct=0, sc=8) 00:12:43.426 Read completed with error (sct=0, sc=8) 00:12:43.426 Write completed with error (sct=0, sc=8) 00:12:43.426 Read completed with error (sct=0, sc=8) 00:12:43.426 starting I/O failed: -6 00:12:43.426 Write completed with error (sct=0, sc=8) 00:12:43.426 Read completed with error (sct=0, sc=8) 00:12:43.426 Write completed with error (sct=0, sc=8) 00:12:43.426 Read completed with error (sct=0, sc=8) 00:12:43.426 Read completed with error (sct=0, sc=8) 00:12:43.426 Read completed with error (sct=0, sc=8) 00:12:43.426 Read completed with error (sct=0, sc=8) 00:12:43.426 Read completed with error (sct=0, sc=8) 00:12:43.426 Write completed with error (sct=0, sc=8) 00:12:43.426 Write completed with error (sct=0, sc=8) 00:12:43.426 starting I/O failed: -6 00:12:43.426 Read completed with error (sct=0, sc=8) 00:12:43.426 Read completed with error (sct=0, sc=8) 00:12:43.426 Write completed with error (sct=0, sc=8) 00:12:43.426 Read completed with error (sct=0, sc=8) 00:12:43.426 Read completed with error (sct=0, sc=8) 00:12:43.426 Read completed with error (sct=0, sc=8) 00:12:43.426 Write completed with error (sct=0, sc=8) 00:12:43.426 Write completed with error (sct=0, sc=8) 00:12:43.426 Read completed with error (sct=0, sc=8) 00:12:43.426 Read completed with error (sct=0, sc=8) 00:12:43.426 Write completed with error (sct=0, sc=8) 00:12:43.426 Read completed with error (sct=0, sc=8) 00:12:43.426 starting I/O failed: -6 00:12:43.426 Write completed with error (sct=0, sc=8) 00:12:43.426 Read completed with error (sct=0, sc=8) 00:12:43.426 Write completed with error (sct=0, sc=8) 00:12:43.426 Read completed with error (sct=0, sc=8) 00:12:43.426 starting I/O failed: -6 00:12:43.426 Read completed with error (sct=0, sc=8) 00:12:43.426 Write completed with error (sct=0, sc=8) 00:12:43.426 Read completed with error (sct=0, sc=8) 00:12:43.426 Read completed with error (sct=0, sc=8) 00:12:43.426 starting I/O failed: -6 00:12:43.426 Read completed with error (sct=0, sc=8) 00:12:43.426 Read completed with error (sct=0, sc=8) 00:12:43.426 Write completed with error (sct=0, sc=8) 00:12:43.426 Read completed with error (sct=0, sc=8) 00:12:43.426 starting I/O failed: -6 00:12:43.426 [2024-04-16 22:50:34.330422] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cb5e10 is same with the state(5) to be set 00:12:43.426 Read completed with error (sct=0, sc=8) 00:12:43.426 Read completed with error (sct=0, sc=8) 00:12:43.426 Read completed with error (sct=0, sc=8) 00:12:43.426 Read completed with error (sct=0, sc=8) 00:12:43.426 Read completed with error (sct=0, sc=8) 00:12:43.426 Read completed with error (sct=0, sc=8) 00:12:43.426 Read completed with error (sct=0, sc=8) 00:12:43.426 Write completed with error (sct=0, sc=8) 00:12:43.426 Read completed with error (sct=0, sc=8) 00:12:43.426 Read completed with error (sct=0, sc=8) 00:12:43.426 Write completed with error (sct=0, sc=8) 00:12:43.426 Read completed with error (sct=0, sc=8) 00:12:43.426 Read completed with error (sct=0, sc=8) 00:12:43.426 Read completed with error (sct=0, sc=8) 00:12:43.426 Write completed with error (sct=0, sc=8) 00:12:43.426 Read completed with error (sct=0, sc=8) 00:12:43.426 Write completed with error (sct=0, sc=8) 00:12:43.426 Write completed with error (sct=0, sc=8) 00:12:43.426 Write completed with error (sct=0, sc=8) 00:12:43.426 Read completed with error (sct=0, sc=8) 00:12:43.426 Write completed with error (sct=0, sc=8) 00:12:43.426 Read completed with error (sct=0, sc=8) 00:12:43.426 Read completed with error (sct=0, sc=8) 00:12:43.426 Write completed with error (sct=0, sc=8) 00:12:43.426 Read completed with error (sct=0, sc=8) 00:12:43.426 Read completed with error (sct=0, sc=8) 00:12:43.426 Read completed with error (sct=0, sc=8) 00:12:43.426 Write completed with error (sct=0, sc=8) 00:12:43.426 Read completed with error (sct=0, sc=8) 00:12:43.426 Write completed with error (sct=0, sc=8) 00:12:43.426 Read completed with error (sct=0, sc=8) 00:12:43.426 Write completed with error (sct=0, sc=8) 00:12:43.426 Read completed with error (sct=0, sc=8) 00:12:43.426 Read completed with error (sct=0, sc=8) 00:12:43.426 Read completed with error (sct=0, sc=8) 00:12:43.426 Read completed with error (sct=0, sc=8) 00:12:43.426 Write completed with error (sct=0, sc=8) 00:12:43.426 Read completed with error (sct=0, sc=8) 00:12:43.426 Write completed with error (sct=0, sc=8) 00:12:43.426 Write completed with error (sct=0, sc=8) 00:12:43.426 Write completed with error (sct=0, sc=8) 00:12:43.426 Read completed with error (sct=0, sc=8) 00:12:43.426 Read completed with error (sct=0, sc=8) 00:12:43.426 Read completed with error (sct=0, sc=8) 00:12:43.426 Read completed with error (sct=0, sc=8) 00:12:43.426 Read completed with error (sct=0, sc=8) 00:12:43.426 Read completed with error (sct=0, sc=8) 00:12:43.426 Write completed with error (sct=0, sc=8) 00:12:43.426 Write completed with error (sct=0, sc=8) 00:12:43.426 Read completed with error (sct=0, sc=8) 00:12:43.426 Write completed with error (sct=0, sc=8) 00:12:43.427 Read completed with error (sct=0, sc=8) 00:12:43.427 Read completed with error (sct=0, sc=8) 00:12:43.427 Write completed with error (sct=0, sc=8) 00:12:43.427 Write completed with error (sct=0, sc=8) 00:12:43.427 Write completed with error (sct=0, sc=8) 00:12:43.427 Read completed with error (sct=0, sc=8) 00:12:43.427 Read completed with error (sct=0, sc=8) 00:12:44.358 [2024-04-16 22:50:35.305617] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cd55a0 is same with the state(5) to be set 00:12:44.358 Write completed with error (sct=0, sc=8) 00:12:44.358 Write completed with error (sct=0, sc=8) 00:12:44.358 Read completed with error (sct=0, sc=8) 00:12:44.358 Write completed with error (sct=0, sc=8) 00:12:44.358 Write completed with error (sct=0, sc=8) 00:12:44.358 Write completed with error (sct=0, sc=8) 00:12:44.358 Read completed with error (sct=0, sc=8) 00:12:44.358 Read completed with error (sct=0, sc=8) 00:12:44.358 Read completed with error (sct=0, sc=8) 00:12:44.358 Read completed with error (sct=0, sc=8) 00:12:44.358 Read completed with error (sct=0, sc=8) 00:12:44.358 Read completed with error (sct=0, sc=8) 00:12:44.358 Read completed with error (sct=0, sc=8) 00:12:44.358 Read completed with error (sct=0, sc=8) 00:12:44.358 Write completed with error (sct=0, sc=8) 00:12:44.358 Read completed with error (sct=0, sc=8) 00:12:44.358 Read completed with error (sct=0, sc=8) 00:12:44.358 Read completed with error (sct=0, sc=8) 00:12:44.358 Read completed with error (sct=0, sc=8) 00:12:44.358 Write completed with error (sct=0, sc=8) 00:12:44.358 Write completed with error (sct=0, sc=8) 00:12:44.358 [2024-04-16 22:50:35.331731] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7f653800c480 is same with the state(5) to be set 00:12:44.358 Write completed with error (sct=0, sc=8) 00:12:44.358 Write completed with error (sct=0, sc=8) 00:12:44.358 Read completed with error (sct=0, sc=8) 00:12:44.358 Read completed with error (sct=0, sc=8) 00:12:44.358 Read completed with error (sct=0, sc=8) 00:12:44.358 Read completed with error (sct=0, sc=8) 00:12:44.358 Write completed with error (sct=0, sc=8) 00:12:44.358 Write completed with error (sct=0, sc=8) 00:12:44.358 Read completed with error (sct=0, sc=8) 00:12:44.358 Read completed with error (sct=0, sc=8) 00:12:44.358 Write completed with error (sct=0, sc=8) 00:12:44.358 Read completed with error (sct=0, sc=8) 00:12:44.358 Write completed with error (sct=0, sc=8) 00:12:44.358 Write completed with error (sct=0, sc=8) 00:12:44.358 Read completed with error (sct=0, sc=8) 00:12:44.358 Read completed with error (sct=0, sc=8) 00:12:44.358 Read completed with error (sct=0, sc=8) 00:12:44.358 Read completed with error (sct=0, sc=8) 00:12:44.358 Read completed with error (sct=0, sc=8) 00:12:44.358 Read completed with error (sct=0, sc=8) 00:12:44.358 Read completed with error (sct=0, sc=8) 00:12:44.358 Read completed with error (sct=0, sc=8) 00:12:44.358 [2024-04-16 22:50:35.331905] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7f653800bf20 is same with the state(5) to be set 00:12:44.358 Write completed with error (sct=0, sc=8) 00:12:44.358 Write completed with error (sct=0, sc=8) 00:12:44.358 Read completed with error (sct=0, sc=8) 00:12:44.358 Read completed with error (sct=0, sc=8) 00:12:44.358 Read completed with error (sct=0, sc=8) 00:12:44.358 Read completed with error (sct=0, sc=8) 00:12:44.358 Write completed with error (sct=0, sc=8) 00:12:44.358 Read completed with error (sct=0, sc=8) 00:12:44.358 Write completed with error (sct=0, sc=8) 00:12:44.358 Write completed with error (sct=0, sc=8) 00:12:44.358 Write completed with error (sct=0, sc=8) 00:12:44.358 Read completed with error (sct=0, sc=8) 00:12:44.358 Write completed with error (sct=0, sc=8) 00:12:44.358 Read completed with error (sct=0, sc=8) 00:12:44.358 Read completed with error (sct=0, sc=8) 00:12:44.358 Read completed with error (sct=0, sc=8) 00:12:44.358 Read completed with error (sct=0, sc=8) 00:12:44.358 Read completed with error (sct=0, sc=8) 00:12:44.358 Read completed with error (sct=0, sc=8) 00:12:44.358 Write completed with error (sct=0, sc=8) 00:12:44.358 Read completed with error (sct=0, sc=8) 00:12:44.358 Read completed with error (sct=0, sc=8) 00:12:44.358 Write completed with error (sct=0, sc=8) 00:12:44.358 Read completed with error (sct=0, sc=8) 00:12:44.358 Read completed with error (sct=0, sc=8) 00:12:44.358 Read completed with error (sct=0, sc=8) 00:12:44.358 [2024-04-16 22:50:35.332320] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cb5f90 is same with the state(5) to be set 00:12:44.358 Read completed with error (sct=0, sc=8) 00:12:44.358 Write completed with error (sct=0, sc=8) 00:12:44.358 Read completed with error (sct=0, sc=8) 00:12:44.358 Read completed with error (sct=0, sc=8) 00:12:44.358 Write completed with error (sct=0, sc=8) 00:12:44.358 Read completed with error (sct=0, sc=8) 00:12:44.358 Write completed with error (sct=0, sc=8) 00:12:44.358 Write completed with error (sct=0, sc=8) 00:12:44.358 Read completed with error (sct=0, sc=8) 00:12:44.358 Read completed with error (sct=0, sc=8) 00:12:44.358 Write completed with error (sct=0, sc=8) 00:12:44.358 Read completed with error (sct=0, sc=8) 00:12:44.358 Read completed with error (sct=0, sc=8) 00:12:44.358 Write completed with error (sct=0, sc=8) 00:12:44.358 Read completed with error (sct=0, sc=8) 00:12:44.358 Read completed with error (sct=0, sc=8) 00:12:44.359 Write completed with error (sct=0, sc=8) 00:12:44.359 Write completed with error (sct=0, sc=8) 00:12:44.359 Read completed with error (sct=0, sc=8) 00:12:44.359 Read completed with error (sct=0, sc=8) 00:12:44.359 Read completed with error (sct=0, sc=8) 00:12:44.359 Write completed with error (sct=0, sc=8) 00:12:44.359 Write completed with error (sct=0, sc=8) 00:12:44.359 Read completed with error (sct=0, sc=8) 00:12:44.359 Write completed with error (sct=0, sc=8) 00:12:44.359 Write completed with error (sct=0, sc=8) 00:12:44.359 [2024-04-16 22:50:35.332518] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cb6c60 is same with the state(5) to be set 00:12:44.359 [2024-04-16 22:50:35.333376] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1cd55a0 (9): Bad file descriptor 00:12:44.359 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf: errors occurred 00:12:44.359 22:50:35 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:12:44.359 22:50:35 -- target/delete_subsystem.sh@34 -- # delay=0 00:12:44.359 22:50:35 -- target/delete_subsystem.sh@35 -- # kill -0 241813 00:12:44.359 22:50:35 -- target/delete_subsystem.sh@36 -- # sleep 0.5 00:12:44.359 Initializing NVMe Controllers 00:12:44.359 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:12:44.359 Controller IO queue size 128, less than required. 00:12:44.359 Consider using lower queue depth or smaller IO size, because IO requests may be queued at the NVMe driver. 00:12:44.359 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 2 00:12:44.359 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 3 00:12:44.359 Initialization complete. Launching workers. 00:12:44.359 ======================================================== 00:12:44.359 Latency(us) 00:12:44.359 Device Information : IOPS MiB/s Average min max 00:12:44.359 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 2: 173.18 0.08 888058.15 420.96 1011915.77 00:12:44.359 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 3: 164.75 0.08 906215.30 659.09 1011722.25 00:12:44.359 ======================================================== 00:12:44.359 Total : 337.93 0.17 896910.09 420.96 1011915.77 00:12:44.359 00:12:44.924 22:50:35 -- target/delete_subsystem.sh@38 -- # (( delay++ > 30 )) 00:12:44.924 22:50:35 -- target/delete_subsystem.sh@35 -- # kill -0 241813 00:12:44.924 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/delete_subsystem.sh: line 35: kill: (241813) - No such process 00:12:44.924 22:50:35 -- target/delete_subsystem.sh@45 -- # NOT wait 241813 00:12:44.924 22:50:35 -- common/autotest_common.sh@640 -- # local es=0 00:12:44.924 22:50:35 -- common/autotest_common.sh@642 -- # valid_exec_arg wait 241813 00:12:44.924 22:50:35 -- common/autotest_common.sh@628 -- # local arg=wait 00:12:44.924 22:50:35 -- common/autotest_common.sh@632 -- # case "$(type -t "$arg")" in 00:12:44.924 22:50:35 -- common/autotest_common.sh@632 -- # type -t wait 00:12:44.924 22:50:35 -- common/autotest_common.sh@632 -- # case "$(type -t "$arg")" in 00:12:44.924 22:50:35 -- common/autotest_common.sh@643 -- # wait 241813 00:12:44.924 22:50:35 -- common/autotest_common.sh@643 -- # es=1 00:12:44.924 22:50:35 -- common/autotest_common.sh@651 -- # (( es > 128 )) 00:12:44.924 22:50:35 -- common/autotest_common.sh@662 -- # [[ -n '' ]] 00:12:44.924 22:50:35 -- common/autotest_common.sh@667 -- # (( !es == 0 )) 00:12:44.924 22:50:35 -- target/delete_subsystem.sh@48 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 -m 10 00:12:44.924 22:50:35 -- common/autotest_common.sh@551 -- # xtrace_disable 00:12:44.924 22:50:35 -- common/autotest_common.sh@10 -- # set +x 00:12:44.924 22:50:35 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:12:44.924 22:50:35 -- target/delete_subsystem.sh@49 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:12:44.924 22:50:35 -- common/autotest_common.sh@551 -- # xtrace_disable 00:12:44.924 22:50:35 -- common/autotest_common.sh@10 -- # set +x 00:12:44.924 [2024-04-16 22:50:35.857990] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:12:44.924 22:50:35 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:12:44.924 22:50:35 -- target/delete_subsystem.sh@50 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:12:44.924 22:50:35 -- common/autotest_common.sh@551 -- # xtrace_disable 00:12:44.924 22:50:35 -- common/autotest_common.sh@10 -- # set +x 00:12:44.924 22:50:35 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:12:44.924 22:50:35 -- target/delete_subsystem.sh@54 -- # perf_pid=242323 00:12:44.924 22:50:35 -- target/delete_subsystem.sh@56 -- # delay=0 00:12:44.924 22:50:35 -- target/delete_subsystem.sh@52 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -c 0xC -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' -t 3 -q 128 -w randrw -M 70 -o 512 -P 4 00:12:44.924 22:50:35 -- target/delete_subsystem.sh@57 -- # kill -0 242323 00:12:44.924 22:50:35 -- target/delete_subsystem.sh@58 -- # sleep 0.5 00:12:44.924 EAL: No free 2048 kB hugepages reported on node 1 00:12:44.924 [2024-04-16 22:50:35.921013] subsystem.c:1304:spdk_nvmf_subsystem_listener_allowed: *WARNING*: Allowing connection to discovery subsystem on TCP/10.0.0.2/4420, even though this listener was not added to the discovery subsystem. This behavior is deprecated and will be removed in a future release. 00:12:45.489 22:50:36 -- target/delete_subsystem.sh@60 -- # (( delay++ > 20 )) 00:12:45.489 22:50:36 -- target/delete_subsystem.sh@57 -- # kill -0 242323 00:12:45.489 22:50:36 -- target/delete_subsystem.sh@58 -- # sleep 0.5 00:12:46.054 22:50:36 -- target/delete_subsystem.sh@60 -- # (( delay++ > 20 )) 00:12:46.054 22:50:36 -- target/delete_subsystem.sh@57 -- # kill -0 242323 00:12:46.054 22:50:36 -- target/delete_subsystem.sh@58 -- # sleep 0.5 00:12:46.311 22:50:37 -- target/delete_subsystem.sh@60 -- # (( delay++ > 20 )) 00:12:46.311 22:50:37 -- target/delete_subsystem.sh@57 -- # kill -0 242323 00:12:46.311 22:50:37 -- target/delete_subsystem.sh@58 -- # sleep 0.5 00:12:46.876 22:50:37 -- target/delete_subsystem.sh@60 -- # (( delay++ > 20 )) 00:12:46.876 22:50:37 -- target/delete_subsystem.sh@57 -- # kill -0 242323 00:12:46.876 22:50:37 -- target/delete_subsystem.sh@58 -- # sleep 0.5 00:12:47.442 22:50:38 -- target/delete_subsystem.sh@60 -- # (( delay++ > 20 )) 00:12:47.442 22:50:38 -- target/delete_subsystem.sh@57 -- # kill -0 242323 00:12:47.442 22:50:38 -- target/delete_subsystem.sh@58 -- # sleep 0.5 00:12:48.007 22:50:38 -- target/delete_subsystem.sh@60 -- # (( delay++ > 20 )) 00:12:48.007 22:50:38 -- target/delete_subsystem.sh@57 -- # kill -0 242323 00:12:48.007 22:50:38 -- target/delete_subsystem.sh@58 -- # sleep 0.5 00:12:48.007 Initializing NVMe Controllers 00:12:48.007 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:12:48.007 Controller IO queue size 128, less than required. 00:12:48.007 Consider using lower queue depth or smaller IO size, because IO requests may be queued at the NVMe driver. 00:12:48.007 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 2 00:12:48.007 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 3 00:12:48.007 Initialization complete. Launching workers. 00:12:48.007 ======================================================== 00:12:48.007 Latency(us) 00:12:48.007 Device Information : IOPS MiB/s Average min max 00:12:48.007 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 2: 128.00 0.06 1003383.07 1000229.37 1013217.86 00:12:48.007 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 3: 128.00 0.06 1004886.05 1000207.26 1013301.50 00:12:48.007 ======================================================== 00:12:48.007 Total : 256.00 0.12 1004134.56 1000207.26 1013301.50 00:12:48.007 00:12:48.265 22:50:39 -- target/delete_subsystem.sh@60 -- # (( delay++ > 20 )) 00:12:48.265 22:50:39 -- target/delete_subsystem.sh@57 -- # kill -0 242323 00:12:48.265 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/delete_subsystem.sh: line 57: kill: (242323) - No such process 00:12:48.265 22:50:39 -- target/delete_subsystem.sh@67 -- # wait 242323 00:12:48.265 22:50:39 -- target/delete_subsystem.sh@69 -- # trap - SIGINT SIGTERM EXIT 00:12:48.265 22:50:39 -- target/delete_subsystem.sh@71 -- # nvmftestfini 00:12:48.265 22:50:39 -- nvmf/common.sh@476 -- # nvmfcleanup 00:12:48.265 22:50:39 -- nvmf/common.sh@116 -- # sync 00:12:48.265 22:50:39 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:12:48.265 22:50:39 -- nvmf/common.sh@119 -- # set +e 00:12:48.265 22:50:39 -- nvmf/common.sh@120 -- # for i in {1..20} 00:12:48.265 22:50:39 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:12:48.523 rmmod nvme_tcp 00:12:48.523 rmmod nvme_fabrics 00:12:48.523 rmmod nvme_keyring 00:12:48.523 22:50:39 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:12:48.523 22:50:39 -- nvmf/common.sh@123 -- # set -e 00:12:48.523 22:50:39 -- nvmf/common.sh@124 -- # return 0 00:12:48.523 22:50:39 -- nvmf/common.sh@477 -- # '[' -n 241755 ']' 00:12:48.523 22:50:39 -- nvmf/common.sh@478 -- # killprocess 241755 00:12:48.523 22:50:39 -- common/autotest_common.sh@926 -- # '[' -z 241755 ']' 00:12:48.523 22:50:39 -- common/autotest_common.sh@930 -- # kill -0 241755 00:12:48.523 22:50:39 -- common/autotest_common.sh@931 -- # uname 00:12:48.523 22:50:39 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:12:48.523 22:50:39 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 241755 00:12:48.523 22:50:39 -- common/autotest_common.sh@932 -- # process_name=reactor_0 00:12:48.523 22:50:39 -- common/autotest_common.sh@936 -- # '[' reactor_0 = sudo ']' 00:12:48.523 22:50:39 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 241755' 00:12:48.523 killing process with pid 241755 00:12:48.523 22:50:39 -- common/autotest_common.sh@945 -- # kill 241755 00:12:48.523 22:50:39 -- common/autotest_common.sh@950 -- # wait 241755 00:12:48.782 22:50:39 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:12:48.782 22:50:39 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:12:48.782 22:50:39 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:12:48.782 22:50:39 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:12:48.782 22:50:39 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:12:48.782 22:50:39 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:12:48.783 22:50:39 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:12:48.783 22:50:39 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:12:50.688 22:50:41 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:12:50.688 00:12:50.688 real 0m12.963s 00:12:50.688 user 0m28.957s 00:12:50.688 sys 0m3.012s 00:12:50.688 22:50:41 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:12:50.688 22:50:41 -- common/autotest_common.sh@10 -- # set +x 00:12:50.688 ************************************ 00:12:50.688 END TEST nvmf_delete_subsystem 00:12:50.688 ************************************ 00:12:50.946 22:50:41 -- nvmf/nvmf.sh@36 -- # [[ 1 -eq 1 ]] 00:12:50.946 22:50:41 -- nvmf/nvmf.sh@37 -- # run_test nvmf_nvme_cli /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/nvme_cli.sh --transport=tcp 00:12:50.946 22:50:41 -- common/autotest_common.sh@1077 -- # '[' 3 -le 1 ']' 00:12:50.946 22:50:41 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:12:50.946 22:50:41 -- common/autotest_common.sh@10 -- # set +x 00:12:50.946 ************************************ 00:12:50.946 START TEST nvmf_nvme_cli 00:12:50.946 ************************************ 00:12:50.946 22:50:41 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/nvme_cli.sh --transport=tcp 00:12:50.946 * Looking for test storage... 00:12:50.946 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:12:50.946 22:50:41 -- target/nvme_cli.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:12:50.946 22:50:41 -- nvmf/common.sh@7 -- # uname -s 00:12:50.946 22:50:41 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:12:50.946 22:50:41 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:12:50.946 22:50:41 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:12:50.946 22:50:41 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:12:50.946 22:50:41 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:12:50.946 22:50:41 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:12:50.946 22:50:41 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:12:50.946 22:50:41 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:12:50.946 22:50:41 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:12:50.946 22:50:41 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:12:50.946 22:50:41 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:12:50.946 22:50:41 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:12:50.946 22:50:41 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:12:50.946 22:50:41 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:12:50.946 22:50:41 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:12:50.946 22:50:41 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:12:50.946 22:50:41 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:12:50.946 22:50:41 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:12:50.946 22:50:41 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:12:50.946 22:50:41 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:12:50.946 22:50:41 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:12:50.946 22:50:41 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:12:50.946 22:50:41 -- paths/export.sh@5 -- # export PATH 00:12:50.946 22:50:41 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:12:50.947 22:50:41 -- nvmf/common.sh@46 -- # : 0 00:12:50.947 22:50:41 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:12:50.947 22:50:41 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:12:50.947 22:50:41 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:12:50.947 22:50:41 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:12:50.947 22:50:41 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:12:50.947 22:50:41 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:12:50.947 22:50:41 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:12:50.947 22:50:41 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:12:50.947 22:50:41 -- target/nvme_cli.sh@11 -- # MALLOC_BDEV_SIZE=64 00:12:50.947 22:50:41 -- target/nvme_cli.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:12:50.947 22:50:41 -- target/nvme_cli.sh@14 -- # devs=() 00:12:50.947 22:50:41 -- target/nvme_cli.sh@16 -- # nvmftestinit 00:12:50.947 22:50:41 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:12:50.947 22:50:41 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:12:50.947 22:50:41 -- nvmf/common.sh@436 -- # prepare_net_devs 00:12:50.947 22:50:41 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:12:50.947 22:50:41 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:12:50.947 22:50:41 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:12:50.947 22:50:41 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:12:50.947 22:50:41 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:12:50.947 22:50:41 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:12:50.947 22:50:41 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:12:50.947 22:50:41 -- nvmf/common.sh@284 -- # xtrace_disable 00:12:50.947 22:50:41 -- common/autotest_common.sh@10 -- # set +x 00:12:52.847 22:50:43 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:12:52.847 22:50:43 -- nvmf/common.sh@290 -- # pci_devs=() 00:12:52.847 22:50:43 -- nvmf/common.sh@290 -- # local -a pci_devs 00:12:52.847 22:50:43 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:12:52.847 22:50:43 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:12:52.847 22:50:43 -- nvmf/common.sh@292 -- # pci_drivers=() 00:12:52.847 22:50:43 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:12:52.847 22:50:43 -- nvmf/common.sh@294 -- # net_devs=() 00:12:52.847 22:50:43 -- nvmf/common.sh@294 -- # local -ga net_devs 00:12:52.847 22:50:43 -- nvmf/common.sh@295 -- # e810=() 00:12:52.847 22:50:43 -- nvmf/common.sh@295 -- # local -ga e810 00:12:52.847 22:50:43 -- nvmf/common.sh@296 -- # x722=() 00:12:52.847 22:50:43 -- nvmf/common.sh@296 -- # local -ga x722 00:12:52.847 22:50:43 -- nvmf/common.sh@297 -- # mlx=() 00:12:52.847 22:50:43 -- nvmf/common.sh@297 -- # local -ga mlx 00:12:52.847 22:50:43 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:12:52.847 22:50:43 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:12:52.847 22:50:43 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:12:52.847 22:50:43 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:12:52.848 22:50:43 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:12:52.848 22:50:43 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:12:52.848 22:50:43 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:12:52.848 22:50:43 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:12:52.848 22:50:43 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:12:52.848 22:50:43 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:12:52.848 22:50:43 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:12:52.848 22:50:43 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:12:52.848 22:50:43 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:12:52.848 22:50:43 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:12:52.848 22:50:43 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:12:52.848 22:50:43 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:12:52.848 22:50:43 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:12:52.848 22:50:43 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:12:52.848 22:50:43 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:12:52.848 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:12:52.848 22:50:43 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:12:52.848 22:50:43 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:12:52.848 22:50:43 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:12:52.848 22:50:43 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:12:52.848 22:50:43 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:12:52.848 22:50:43 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:12:52.848 22:50:43 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:12:52.848 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:12:52.848 22:50:43 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:12:52.848 22:50:43 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:12:52.848 22:50:43 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:12:52.848 22:50:43 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:12:52.848 22:50:43 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:12:52.848 22:50:43 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:12:52.848 22:50:43 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:12:52.848 22:50:43 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:12:52.848 22:50:43 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:12:52.848 22:50:43 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:12:52.848 22:50:43 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:12:52.848 22:50:43 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:12:52.848 22:50:43 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:12:52.848 Found net devices under 0000:0a:00.0: cvl_0_0 00:12:52.848 22:50:43 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:12:52.848 22:50:43 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:12:52.848 22:50:43 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:12:52.848 22:50:43 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:12:52.848 22:50:43 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:12:52.848 22:50:43 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:12:52.848 Found net devices under 0000:0a:00.1: cvl_0_1 00:12:52.848 22:50:43 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:12:52.848 22:50:43 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:12:52.848 22:50:43 -- nvmf/common.sh@402 -- # is_hw=yes 00:12:52.848 22:50:43 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:12:52.848 22:50:43 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:12:52.848 22:50:43 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:12:52.848 22:50:43 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:12:52.848 22:50:43 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:12:52.848 22:50:43 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:12:52.848 22:50:43 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:12:52.848 22:50:43 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:12:52.848 22:50:43 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:12:52.848 22:50:43 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:12:52.848 22:50:43 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:12:52.848 22:50:43 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:12:52.848 22:50:43 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:12:52.848 22:50:43 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:12:52.848 22:50:43 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:12:52.848 22:50:43 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:12:52.848 22:50:43 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:12:52.848 22:50:43 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:12:52.848 22:50:43 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:12:52.848 22:50:43 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:12:52.848 22:50:43 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:12:52.848 22:50:43 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:12:52.848 22:50:43 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:12:52.848 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:12:52.848 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.260 ms 00:12:52.848 00:12:52.848 --- 10.0.0.2 ping statistics --- 00:12:52.848 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:12:52.848 rtt min/avg/max/mdev = 0.260/0.260/0.260/0.000 ms 00:12:52.848 22:50:43 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:12:52.848 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:12:52.848 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.143 ms 00:12:52.848 00:12:52.848 --- 10.0.0.1 ping statistics --- 00:12:52.848 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:12:52.848 rtt min/avg/max/mdev = 0.143/0.143/0.143/0.000 ms 00:12:52.848 22:50:43 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:12:52.848 22:50:43 -- nvmf/common.sh@410 -- # return 0 00:12:52.848 22:50:43 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:12:52.848 22:50:43 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:12:52.848 22:50:43 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:12:52.848 22:50:43 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:12:52.848 22:50:43 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:12:52.848 22:50:43 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:12:52.848 22:50:43 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:12:52.848 22:50:43 -- target/nvme_cli.sh@17 -- # nvmfappstart -m 0xF 00:12:52.848 22:50:43 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:12:52.848 22:50:43 -- common/autotest_common.sh@712 -- # xtrace_disable 00:12:52.848 22:50:43 -- common/autotest_common.sh@10 -- # set +x 00:12:52.848 22:50:43 -- nvmf/common.sh@469 -- # nvmfpid=244687 00:12:52.848 22:50:43 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:12:52.848 22:50:43 -- nvmf/common.sh@470 -- # waitforlisten 244687 00:12:52.848 22:50:43 -- common/autotest_common.sh@819 -- # '[' -z 244687 ']' 00:12:52.848 22:50:43 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk.sock 00:12:52.848 22:50:43 -- common/autotest_common.sh@824 -- # local max_retries=100 00:12:52.848 22:50:43 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:12:52.848 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:12:52.848 22:50:43 -- common/autotest_common.sh@828 -- # xtrace_disable 00:12:52.848 22:50:43 -- common/autotest_common.sh@10 -- # set +x 00:12:52.848 [2024-04-16 22:50:43.923363] Starting SPDK v24.01.1-pre git sha1 4b134b4ab / DPDK 23.11.0 initialization... 00:12:52.848 [2024-04-16 22:50:43.923442] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:12:52.848 EAL: No free 2048 kB hugepages reported on node 1 00:12:53.107 [2024-04-16 22:50:43.994510] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:12:53.107 [2024-04-16 22:50:44.114095] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:12:53.107 [2024-04-16 22:50:44.114272] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:12:53.107 [2024-04-16 22:50:44.114305] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:12:53.107 [2024-04-16 22:50:44.114319] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:12:53.107 [2024-04-16 22:50:44.114400] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:12:53.107 [2024-04-16 22:50:44.114457] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:12:53.107 [2024-04-16 22:50:44.114522] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:12:53.107 [2024-04-16 22:50:44.114525] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:12:54.039 22:50:44 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:12:54.039 22:50:44 -- common/autotest_common.sh@852 -- # return 0 00:12:54.039 22:50:44 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:12:54.039 22:50:44 -- common/autotest_common.sh@718 -- # xtrace_disable 00:12:54.039 22:50:44 -- common/autotest_common.sh@10 -- # set +x 00:12:54.039 22:50:44 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:12:54.039 22:50:44 -- target/nvme_cli.sh@19 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:12:54.039 22:50:44 -- common/autotest_common.sh@551 -- # xtrace_disable 00:12:54.039 22:50:44 -- common/autotest_common.sh@10 -- # set +x 00:12:54.039 [2024-04-16 22:50:44.884663] tcp.c: 659:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:12:54.039 22:50:44 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:12:54.039 22:50:44 -- target/nvme_cli.sh@21 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc0 00:12:54.039 22:50:44 -- common/autotest_common.sh@551 -- # xtrace_disable 00:12:54.039 22:50:44 -- common/autotest_common.sh@10 -- # set +x 00:12:54.039 Malloc0 00:12:54.039 22:50:44 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:12:54.039 22:50:44 -- target/nvme_cli.sh@22 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc1 00:12:54.039 22:50:44 -- common/autotest_common.sh@551 -- # xtrace_disable 00:12:54.039 22:50:44 -- common/autotest_common.sh@10 -- # set +x 00:12:54.039 Malloc1 00:12:54.039 22:50:44 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:12:54.039 22:50:44 -- target/nvme_cli.sh@24 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDKISFASTANDAWESOME -d SPDK_Controller1 -i 291 00:12:54.039 22:50:44 -- common/autotest_common.sh@551 -- # xtrace_disable 00:12:54.039 22:50:44 -- common/autotest_common.sh@10 -- # set +x 00:12:54.039 22:50:44 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:12:54.039 22:50:44 -- target/nvme_cli.sh@25 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:12:54.039 22:50:44 -- common/autotest_common.sh@551 -- # xtrace_disable 00:12:54.039 22:50:44 -- common/autotest_common.sh@10 -- # set +x 00:12:54.039 22:50:44 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:12:54.039 22:50:44 -- target/nvme_cli.sh@26 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:12:54.039 22:50:44 -- common/autotest_common.sh@551 -- # xtrace_disable 00:12:54.039 22:50:44 -- common/autotest_common.sh@10 -- # set +x 00:12:54.039 22:50:44 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:12:54.039 22:50:44 -- target/nvme_cli.sh@27 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:12:54.039 22:50:44 -- common/autotest_common.sh@551 -- # xtrace_disable 00:12:54.039 22:50:44 -- common/autotest_common.sh@10 -- # set +x 00:12:54.039 [2024-04-16 22:50:44.965802] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:12:54.039 22:50:44 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:12:54.039 22:50:44 -- target/nvme_cli.sh@28 -- # rpc_cmd nvmf_subsystem_add_listener discovery -t tcp -a 10.0.0.2 -s 4420 00:12:54.039 22:50:44 -- common/autotest_common.sh@551 -- # xtrace_disable 00:12:54.039 22:50:44 -- common/autotest_common.sh@10 -- # set +x 00:12:54.039 22:50:44 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:12:54.039 22:50:44 -- target/nvme_cli.sh@30 -- # nvme discover --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -a 10.0.0.2 -s 4420 00:12:54.039 00:12:54.039 Discovery Log Number of Records 2, Generation counter 2 00:12:54.039 =====Discovery Log Entry 0====== 00:12:54.039 trtype: tcp 00:12:54.039 adrfam: ipv4 00:12:54.039 subtype: current discovery subsystem 00:12:54.039 treq: not required 00:12:54.039 portid: 0 00:12:54.039 trsvcid: 4420 00:12:54.039 subnqn: nqn.2014-08.org.nvmexpress.discovery 00:12:54.039 traddr: 10.0.0.2 00:12:54.039 eflags: explicit discovery connections, duplicate discovery information 00:12:54.039 sectype: none 00:12:54.039 =====Discovery Log Entry 1====== 00:12:54.039 trtype: tcp 00:12:54.039 adrfam: ipv4 00:12:54.039 subtype: nvme subsystem 00:12:54.039 treq: not required 00:12:54.039 portid: 0 00:12:54.039 trsvcid: 4420 00:12:54.039 subnqn: nqn.2016-06.io.spdk:cnode1 00:12:54.039 traddr: 10.0.0.2 00:12:54.039 eflags: none 00:12:54.039 sectype: none 00:12:54.039 22:50:45 -- target/nvme_cli.sh@31 -- # devs=($(get_nvme_devs)) 00:12:54.039 22:50:45 -- target/nvme_cli.sh@31 -- # get_nvme_devs 00:12:54.039 22:50:45 -- nvmf/common.sh@510 -- # local dev _ 00:12:54.039 22:50:45 -- nvmf/common.sh@512 -- # read -r dev _ 00:12:54.039 22:50:45 -- nvmf/common.sh@509 -- # nvme list 00:12:54.039 22:50:45 -- nvmf/common.sh@513 -- # [[ Node == /dev/nvme* ]] 00:12:54.039 22:50:45 -- nvmf/common.sh@512 -- # read -r dev _ 00:12:54.039 22:50:45 -- nvmf/common.sh@513 -- # [[ --------------------- == /dev/nvme* ]] 00:12:54.039 22:50:45 -- nvmf/common.sh@512 -- # read -r dev _ 00:12:54.039 22:50:45 -- target/nvme_cli.sh@31 -- # nvme_num_before_connection=0 00:12:54.039 22:50:45 -- target/nvme_cli.sh@32 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:12:54.605 22:50:45 -- target/nvme_cli.sh@34 -- # waitforserial SPDKISFASTANDAWESOME 2 00:12:54.605 22:50:45 -- common/autotest_common.sh@1177 -- # local i=0 00:12:54.605 22:50:45 -- common/autotest_common.sh@1178 -- # local nvme_device_counter=1 nvme_devices=0 00:12:54.605 22:50:45 -- common/autotest_common.sh@1179 -- # [[ -n 2 ]] 00:12:54.605 22:50:45 -- common/autotest_common.sh@1180 -- # nvme_device_counter=2 00:12:54.605 22:50:45 -- common/autotest_common.sh@1184 -- # sleep 2 00:12:57.133 22:50:47 -- common/autotest_common.sh@1185 -- # (( i++ <= 15 )) 00:12:57.133 22:50:47 -- common/autotest_common.sh@1186 -- # lsblk -l -o NAME,SERIAL 00:12:57.133 22:50:47 -- common/autotest_common.sh@1186 -- # grep -c SPDKISFASTANDAWESOME 00:12:57.133 22:50:47 -- common/autotest_common.sh@1186 -- # nvme_devices=2 00:12:57.133 22:50:47 -- common/autotest_common.sh@1187 -- # (( nvme_devices == nvme_device_counter )) 00:12:57.133 22:50:47 -- common/autotest_common.sh@1187 -- # return 0 00:12:57.133 22:50:47 -- target/nvme_cli.sh@35 -- # get_nvme_devs 00:12:57.133 22:50:47 -- nvmf/common.sh@510 -- # local dev _ 00:12:57.133 22:50:47 -- nvmf/common.sh@512 -- # read -r dev _ 00:12:57.133 22:50:47 -- nvmf/common.sh@509 -- # nvme list 00:12:57.133 22:50:47 -- nvmf/common.sh@513 -- # [[ Node == /dev/nvme* ]] 00:12:57.133 22:50:47 -- nvmf/common.sh@512 -- # read -r dev _ 00:12:57.133 22:50:47 -- nvmf/common.sh@513 -- # [[ --------------------- == /dev/nvme* ]] 00:12:57.133 22:50:47 -- nvmf/common.sh@512 -- # read -r dev _ 00:12:57.133 22:50:47 -- nvmf/common.sh@513 -- # [[ /dev/nvme0n2 == /dev/nvme* ]] 00:12:57.133 22:50:47 -- nvmf/common.sh@514 -- # echo /dev/nvme0n2 00:12:57.133 22:50:47 -- nvmf/common.sh@512 -- # read -r dev _ 00:12:57.133 22:50:47 -- nvmf/common.sh@513 -- # [[ /dev/nvme0n1 == /dev/nvme* ]] 00:12:57.133 22:50:47 -- nvmf/common.sh@514 -- # echo /dev/nvme0n1 00:12:57.133 22:50:47 -- nvmf/common.sh@512 -- # read -r dev _ 00:12:57.133 22:50:47 -- target/nvme_cli.sh@35 -- # [[ -z /dev/nvme0n2 00:12:57.133 /dev/nvme0n1 ]] 00:12:57.133 22:50:47 -- target/nvme_cli.sh@59 -- # devs=($(get_nvme_devs)) 00:12:57.133 22:50:47 -- target/nvme_cli.sh@59 -- # get_nvme_devs 00:12:57.133 22:50:47 -- nvmf/common.sh@510 -- # local dev _ 00:12:57.133 22:50:47 -- nvmf/common.sh@512 -- # read -r dev _ 00:12:57.133 22:50:47 -- nvmf/common.sh@509 -- # nvme list 00:12:57.133 22:50:48 -- nvmf/common.sh@513 -- # [[ Node == /dev/nvme* ]] 00:12:57.133 22:50:48 -- nvmf/common.sh@512 -- # read -r dev _ 00:12:57.133 22:50:48 -- nvmf/common.sh@513 -- # [[ --------------------- == /dev/nvme* ]] 00:12:57.133 22:50:48 -- nvmf/common.sh@512 -- # read -r dev _ 00:12:57.133 22:50:48 -- nvmf/common.sh@513 -- # [[ /dev/nvme0n2 == /dev/nvme* ]] 00:12:57.133 22:50:48 -- nvmf/common.sh@514 -- # echo /dev/nvme0n2 00:12:57.133 22:50:48 -- nvmf/common.sh@512 -- # read -r dev _ 00:12:57.133 22:50:48 -- nvmf/common.sh@513 -- # [[ /dev/nvme0n1 == /dev/nvme* ]] 00:12:57.133 22:50:48 -- nvmf/common.sh@514 -- # echo /dev/nvme0n1 00:12:57.133 22:50:48 -- nvmf/common.sh@512 -- # read -r dev _ 00:12:57.133 22:50:48 -- target/nvme_cli.sh@59 -- # nvme_num=2 00:12:57.133 22:50:48 -- target/nvme_cli.sh@60 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:12:57.133 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:12:57.133 22:50:48 -- target/nvme_cli.sh@61 -- # waitforserial_disconnect SPDKISFASTANDAWESOME 00:12:57.133 22:50:48 -- common/autotest_common.sh@1198 -- # local i=0 00:12:57.133 22:50:48 -- common/autotest_common.sh@1199 -- # lsblk -o NAME,SERIAL 00:12:57.392 22:50:48 -- common/autotest_common.sh@1199 -- # grep -q -w SPDKISFASTANDAWESOME 00:12:57.392 22:50:48 -- common/autotest_common.sh@1206 -- # lsblk -l -o NAME,SERIAL 00:12:57.392 22:50:48 -- common/autotest_common.sh@1206 -- # grep -q -w SPDKISFASTANDAWESOME 00:12:57.392 22:50:48 -- common/autotest_common.sh@1210 -- # return 0 00:12:57.392 22:50:48 -- target/nvme_cli.sh@62 -- # (( nvme_num <= nvme_num_before_connection )) 00:12:57.392 22:50:48 -- target/nvme_cli.sh@67 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:12:57.392 22:50:48 -- common/autotest_common.sh@551 -- # xtrace_disable 00:12:57.392 22:50:48 -- common/autotest_common.sh@10 -- # set +x 00:12:57.392 22:50:48 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:12:57.392 22:50:48 -- target/nvme_cli.sh@68 -- # trap - SIGINT SIGTERM EXIT 00:12:57.392 22:50:48 -- target/nvme_cli.sh@70 -- # nvmftestfini 00:12:57.392 22:50:48 -- nvmf/common.sh@476 -- # nvmfcleanup 00:12:57.392 22:50:48 -- nvmf/common.sh@116 -- # sync 00:12:57.392 22:50:48 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:12:57.392 22:50:48 -- nvmf/common.sh@119 -- # set +e 00:12:57.392 22:50:48 -- nvmf/common.sh@120 -- # for i in {1..20} 00:12:57.392 22:50:48 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:12:57.392 rmmod nvme_tcp 00:12:57.392 rmmod nvme_fabrics 00:12:57.392 rmmod nvme_keyring 00:12:57.392 22:50:48 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:12:57.392 22:50:48 -- nvmf/common.sh@123 -- # set -e 00:12:57.392 22:50:48 -- nvmf/common.sh@124 -- # return 0 00:12:57.392 22:50:48 -- nvmf/common.sh@477 -- # '[' -n 244687 ']' 00:12:57.392 22:50:48 -- nvmf/common.sh@478 -- # killprocess 244687 00:12:57.392 22:50:48 -- common/autotest_common.sh@926 -- # '[' -z 244687 ']' 00:12:57.392 22:50:48 -- common/autotest_common.sh@930 -- # kill -0 244687 00:12:57.392 22:50:48 -- common/autotest_common.sh@931 -- # uname 00:12:57.392 22:50:48 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:12:57.392 22:50:48 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 244687 00:12:57.392 22:50:48 -- common/autotest_common.sh@932 -- # process_name=reactor_0 00:12:57.392 22:50:48 -- common/autotest_common.sh@936 -- # '[' reactor_0 = sudo ']' 00:12:57.392 22:50:48 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 244687' 00:12:57.392 killing process with pid 244687 00:12:57.392 22:50:48 -- common/autotest_common.sh@945 -- # kill 244687 00:12:57.392 22:50:48 -- common/autotest_common.sh@950 -- # wait 244687 00:12:57.652 22:50:48 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:12:57.652 22:50:48 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:12:57.652 22:50:48 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:12:57.652 22:50:48 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:12:57.652 22:50:48 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:12:57.652 22:50:48 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:12:57.652 22:50:48 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:12:57.652 22:50:48 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:13:00.232 22:50:50 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:13:00.232 00:13:00.232 real 0m8.919s 00:13:00.232 user 0m18.735s 00:13:00.232 sys 0m2.062s 00:13:00.232 22:50:50 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:13:00.232 22:50:50 -- common/autotest_common.sh@10 -- # set +x 00:13:00.232 ************************************ 00:13:00.232 END TEST nvmf_nvme_cli 00:13:00.232 ************************************ 00:13:00.232 22:50:50 -- nvmf/nvmf.sh@39 -- # [[ 0 -eq 1 ]] 00:13:00.232 22:50:50 -- nvmf/nvmf.sh@46 -- # run_test nvmf_host_management /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/host_management.sh --transport=tcp 00:13:00.232 22:50:50 -- common/autotest_common.sh@1077 -- # '[' 3 -le 1 ']' 00:13:00.232 22:50:50 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:13:00.232 22:50:50 -- common/autotest_common.sh@10 -- # set +x 00:13:00.232 ************************************ 00:13:00.232 START TEST nvmf_host_management 00:13:00.232 ************************************ 00:13:00.232 22:50:50 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/host_management.sh --transport=tcp 00:13:00.232 * Looking for test storage... 00:13:00.232 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:13:00.232 22:50:50 -- target/host_management.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:13:00.232 22:50:50 -- nvmf/common.sh@7 -- # uname -s 00:13:00.232 22:50:50 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:13:00.232 22:50:50 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:13:00.232 22:50:50 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:13:00.232 22:50:50 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:13:00.232 22:50:50 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:13:00.232 22:50:50 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:13:00.232 22:50:50 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:13:00.232 22:50:50 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:13:00.232 22:50:50 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:13:00.232 22:50:50 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:13:00.232 22:50:50 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:13:00.232 22:50:50 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:13:00.232 22:50:50 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:13:00.232 22:50:50 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:13:00.232 22:50:50 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:13:00.232 22:50:50 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:13:00.232 22:50:50 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:13:00.232 22:50:50 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:13:00.232 22:50:50 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:13:00.232 22:50:50 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:00.232 22:50:50 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:00.232 22:50:50 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:00.232 22:50:50 -- paths/export.sh@5 -- # export PATH 00:13:00.232 22:50:50 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:00.232 22:50:50 -- nvmf/common.sh@46 -- # : 0 00:13:00.232 22:50:50 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:13:00.232 22:50:50 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:13:00.232 22:50:50 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:13:00.232 22:50:50 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:13:00.232 22:50:50 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:13:00.232 22:50:50 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:13:00.232 22:50:50 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:13:00.232 22:50:50 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:13:00.232 22:50:50 -- target/host_management.sh@11 -- # MALLOC_BDEV_SIZE=64 00:13:00.232 22:50:50 -- target/host_management.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:13:00.232 22:50:50 -- target/host_management.sh@104 -- # nvmftestinit 00:13:00.232 22:50:50 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:13:00.232 22:50:50 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:13:00.232 22:50:50 -- nvmf/common.sh@436 -- # prepare_net_devs 00:13:00.232 22:50:50 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:13:00.232 22:50:50 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:13:00.232 22:50:50 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:13:00.232 22:50:50 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:13:00.232 22:50:50 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:13:00.232 22:50:50 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:13:00.232 22:50:50 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:13:00.232 22:50:50 -- nvmf/common.sh@284 -- # xtrace_disable 00:13:00.232 22:50:50 -- common/autotest_common.sh@10 -- # set +x 00:13:02.134 22:50:52 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:13:02.134 22:50:52 -- nvmf/common.sh@290 -- # pci_devs=() 00:13:02.134 22:50:52 -- nvmf/common.sh@290 -- # local -a pci_devs 00:13:02.134 22:50:52 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:13:02.134 22:50:52 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:13:02.134 22:50:52 -- nvmf/common.sh@292 -- # pci_drivers=() 00:13:02.134 22:50:52 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:13:02.134 22:50:52 -- nvmf/common.sh@294 -- # net_devs=() 00:13:02.134 22:50:52 -- nvmf/common.sh@294 -- # local -ga net_devs 00:13:02.134 22:50:52 -- nvmf/common.sh@295 -- # e810=() 00:13:02.134 22:50:52 -- nvmf/common.sh@295 -- # local -ga e810 00:13:02.134 22:50:52 -- nvmf/common.sh@296 -- # x722=() 00:13:02.134 22:50:52 -- nvmf/common.sh@296 -- # local -ga x722 00:13:02.134 22:50:52 -- nvmf/common.sh@297 -- # mlx=() 00:13:02.134 22:50:52 -- nvmf/common.sh@297 -- # local -ga mlx 00:13:02.134 22:50:52 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:13:02.134 22:50:52 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:13:02.134 22:50:52 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:13:02.134 22:50:52 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:13:02.134 22:50:52 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:13:02.134 22:50:52 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:13:02.134 22:50:52 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:13:02.134 22:50:52 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:13:02.134 22:50:52 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:13:02.134 22:50:52 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:13:02.134 22:50:52 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:13:02.134 22:50:52 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:13:02.134 22:50:52 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:13:02.134 22:50:52 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:13:02.134 22:50:52 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:13:02.134 22:50:52 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:13:02.134 22:50:52 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:13:02.134 22:50:52 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:13:02.134 22:50:52 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:13:02.134 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:13:02.134 22:50:52 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:13:02.134 22:50:52 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:13:02.134 22:50:52 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:13:02.134 22:50:52 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:13:02.134 22:50:52 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:13:02.134 22:50:52 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:13:02.134 22:50:52 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:13:02.134 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:13:02.134 22:50:52 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:13:02.134 22:50:52 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:13:02.134 22:50:52 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:13:02.134 22:50:52 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:13:02.134 22:50:52 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:13:02.134 22:50:52 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:13:02.134 22:50:52 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:13:02.134 22:50:52 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:13:02.134 22:50:52 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:13:02.134 22:50:52 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:13:02.134 22:50:52 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:13:02.134 22:50:52 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:13:02.134 22:50:52 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:13:02.134 Found net devices under 0000:0a:00.0: cvl_0_0 00:13:02.134 22:50:52 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:13:02.134 22:50:52 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:13:02.134 22:50:52 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:13:02.134 22:50:52 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:13:02.134 22:50:52 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:13:02.134 22:50:52 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:13:02.134 Found net devices under 0000:0a:00.1: cvl_0_1 00:13:02.134 22:50:52 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:13:02.134 22:50:52 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:13:02.134 22:50:52 -- nvmf/common.sh@402 -- # is_hw=yes 00:13:02.134 22:50:52 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:13:02.134 22:50:52 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:13:02.134 22:50:52 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:13:02.134 22:50:52 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:13:02.134 22:50:52 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:13:02.134 22:50:52 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:13:02.134 22:50:52 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:13:02.134 22:50:52 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:13:02.134 22:50:52 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:13:02.134 22:50:52 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:13:02.134 22:50:52 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:13:02.134 22:50:52 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:13:02.134 22:50:52 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:13:02.134 22:50:52 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:13:02.134 22:50:52 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:13:02.134 22:50:52 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:13:02.134 22:50:52 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:13:02.134 22:50:52 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:13:02.134 22:50:52 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:13:02.134 22:50:52 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:13:02.134 22:50:52 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:13:02.134 22:50:53 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:13:02.135 22:50:53 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:13:02.135 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:13:02.135 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.231 ms 00:13:02.135 00:13:02.135 --- 10.0.0.2 ping statistics --- 00:13:02.135 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:13:02.135 rtt min/avg/max/mdev = 0.231/0.231/0.231/0.000 ms 00:13:02.135 22:50:53 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:13:02.135 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:13:02.135 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.083 ms 00:13:02.135 00:13:02.135 --- 10.0.0.1 ping statistics --- 00:13:02.135 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:13:02.135 rtt min/avg/max/mdev = 0.083/0.083/0.083/0.000 ms 00:13:02.135 22:50:53 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:13:02.135 22:50:53 -- nvmf/common.sh@410 -- # return 0 00:13:02.135 22:50:53 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:13:02.135 22:50:53 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:13:02.135 22:50:53 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:13:02.135 22:50:53 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:13:02.135 22:50:53 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:13:02.135 22:50:53 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:13:02.135 22:50:53 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:13:02.135 22:50:53 -- target/host_management.sh@106 -- # run_test nvmf_host_management nvmf_host_management 00:13:02.135 22:50:53 -- common/autotest_common.sh@1077 -- # '[' 2 -le 1 ']' 00:13:02.135 22:50:53 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:13:02.135 22:50:53 -- common/autotest_common.sh@10 -- # set +x 00:13:02.135 ************************************ 00:13:02.135 START TEST nvmf_host_management 00:13:02.135 ************************************ 00:13:02.135 22:50:53 -- common/autotest_common.sh@1104 -- # nvmf_host_management 00:13:02.135 22:50:53 -- target/host_management.sh@69 -- # starttarget 00:13:02.135 22:50:53 -- target/host_management.sh@16 -- # nvmfappstart -m 0x1E 00:13:02.135 22:50:53 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:13:02.135 22:50:53 -- common/autotest_common.sh@712 -- # xtrace_disable 00:13:02.135 22:50:53 -- common/autotest_common.sh@10 -- # set +x 00:13:02.135 22:50:53 -- nvmf/common.sh@469 -- # nvmfpid=247230 00:13:02.135 22:50:53 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x1E 00:13:02.135 22:50:53 -- nvmf/common.sh@470 -- # waitforlisten 247230 00:13:02.135 22:50:53 -- common/autotest_common.sh@819 -- # '[' -z 247230 ']' 00:13:02.135 22:50:53 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk.sock 00:13:02.135 22:50:53 -- common/autotest_common.sh@824 -- # local max_retries=100 00:13:02.135 22:50:53 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:13:02.135 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:13:02.135 22:50:53 -- common/autotest_common.sh@828 -- # xtrace_disable 00:13:02.135 22:50:53 -- common/autotest_common.sh@10 -- # set +x 00:13:02.135 [2024-04-16 22:50:53.090118] Starting SPDK v24.01.1-pre git sha1 4b134b4ab / DPDK 23.11.0 initialization... 00:13:02.135 [2024-04-16 22:50:53.090215] [ DPDK EAL parameters: nvmf -c 0x1E --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:13:02.135 EAL: No free 2048 kB hugepages reported on node 1 00:13:02.135 [2024-04-16 22:50:53.153793] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:13:02.135 [2024-04-16 22:50:53.262022] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:13:02.135 [2024-04-16 22:50:53.262156] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:13:02.135 [2024-04-16 22:50:53.262182] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:13:02.135 [2024-04-16 22:50:53.262197] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:13:02.135 [2024-04-16 22:50:53.262259] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:13:02.135 [2024-04-16 22:50:53.262311] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:13:02.135 [2024-04-16 22:50:53.262333] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 4 00:13:02.135 [2024-04-16 22:50:53.262336] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:13:03.068 22:50:54 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:13:03.068 22:50:54 -- common/autotest_common.sh@852 -- # return 0 00:13:03.068 22:50:54 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:13:03.068 22:50:54 -- common/autotest_common.sh@718 -- # xtrace_disable 00:13:03.068 22:50:54 -- common/autotest_common.sh@10 -- # set +x 00:13:03.068 22:50:54 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:13:03.068 22:50:54 -- target/host_management.sh@18 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:13:03.068 22:50:54 -- common/autotest_common.sh@551 -- # xtrace_disable 00:13:03.068 22:50:54 -- common/autotest_common.sh@10 -- # set +x 00:13:03.068 [2024-04-16 22:50:54.108890] tcp.c: 659:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:13:03.068 22:50:54 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:13:03.068 22:50:54 -- target/host_management.sh@20 -- # timing_enter create_subsystem 00:13:03.068 22:50:54 -- common/autotest_common.sh@712 -- # xtrace_disable 00:13:03.068 22:50:54 -- common/autotest_common.sh@10 -- # set +x 00:13:03.068 22:50:54 -- target/host_management.sh@22 -- # rm -rf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/rpcs.txt 00:13:03.068 22:50:54 -- target/host_management.sh@23 -- # cat 00:13:03.068 22:50:54 -- target/host_management.sh@30 -- # rpc_cmd 00:13:03.068 22:50:54 -- common/autotest_common.sh@551 -- # xtrace_disable 00:13:03.068 22:50:54 -- common/autotest_common.sh@10 -- # set +x 00:13:03.068 Malloc0 00:13:03.068 [2024-04-16 22:50:54.170407] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:13:03.068 22:50:54 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:13:03.068 22:50:54 -- target/host_management.sh@31 -- # timing_exit create_subsystems 00:13:03.068 22:50:54 -- common/autotest_common.sh@718 -- # xtrace_disable 00:13:03.068 22:50:54 -- common/autotest_common.sh@10 -- # set +x 00:13:03.324 22:50:54 -- target/host_management.sh@73 -- # perfpid=247411 00:13:03.324 22:50:54 -- target/host_management.sh@74 -- # waitforlisten 247411 /var/tmp/bdevperf.sock 00:13:03.325 22:50:54 -- common/autotest_common.sh@819 -- # '[' -z 247411 ']' 00:13:03.325 22:50:54 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:13:03.325 22:50:54 -- target/host_management.sh@72 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -r /var/tmp/bdevperf.sock --json /dev/fd/63 -q 64 -o 65536 -w verify -t 10 00:13:03.325 22:50:54 -- target/host_management.sh@72 -- # gen_nvmf_target_json 0 00:13:03.325 22:50:54 -- common/autotest_common.sh@824 -- # local max_retries=100 00:13:03.325 22:50:54 -- nvmf/common.sh@520 -- # config=() 00:13:03.325 22:50:54 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:13:03.325 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:13:03.325 22:50:54 -- nvmf/common.sh@520 -- # local subsystem config 00:13:03.325 22:50:54 -- common/autotest_common.sh@828 -- # xtrace_disable 00:13:03.325 22:50:54 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:13:03.325 22:50:54 -- common/autotest_common.sh@10 -- # set +x 00:13:03.325 22:50:54 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:13:03.325 { 00:13:03.325 "params": { 00:13:03.325 "name": "Nvme$subsystem", 00:13:03.325 "trtype": "$TEST_TRANSPORT", 00:13:03.325 "traddr": "$NVMF_FIRST_TARGET_IP", 00:13:03.325 "adrfam": "ipv4", 00:13:03.325 "trsvcid": "$NVMF_PORT", 00:13:03.325 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:13:03.325 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:13:03.325 "hdgst": ${hdgst:-false}, 00:13:03.325 "ddgst": ${ddgst:-false} 00:13:03.325 }, 00:13:03.325 "method": "bdev_nvme_attach_controller" 00:13:03.325 } 00:13:03.325 EOF 00:13:03.325 )") 00:13:03.325 22:50:54 -- nvmf/common.sh@542 -- # cat 00:13:03.325 22:50:54 -- nvmf/common.sh@544 -- # jq . 00:13:03.325 22:50:54 -- nvmf/common.sh@545 -- # IFS=, 00:13:03.325 22:50:54 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:13:03.325 "params": { 00:13:03.325 "name": "Nvme0", 00:13:03.325 "trtype": "tcp", 00:13:03.325 "traddr": "10.0.0.2", 00:13:03.325 "adrfam": "ipv4", 00:13:03.325 "trsvcid": "4420", 00:13:03.325 "subnqn": "nqn.2016-06.io.spdk:cnode0", 00:13:03.325 "hostnqn": "nqn.2016-06.io.spdk:host0", 00:13:03.325 "hdgst": false, 00:13:03.325 "ddgst": false 00:13:03.325 }, 00:13:03.325 "method": "bdev_nvme_attach_controller" 00:13:03.325 }' 00:13:03.325 [2024-04-16 22:50:54.246245] Starting SPDK v24.01.1-pre git sha1 4b134b4ab / DPDK 23.11.0 initialization... 00:13:03.325 [2024-04-16 22:50:54.246335] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid247411 ] 00:13:03.325 EAL: No free 2048 kB hugepages reported on node 1 00:13:03.325 [2024-04-16 22:50:54.306640] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:13:03.325 [2024-04-16 22:50:54.414130] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:13:03.581 Running I/O for 10 seconds... 00:13:04.149 22:50:55 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:13:04.149 22:50:55 -- common/autotest_common.sh@852 -- # return 0 00:13:04.149 22:50:55 -- target/host_management.sh@75 -- # rpc_cmd -s /var/tmp/bdevperf.sock framework_wait_init 00:13:04.149 22:50:55 -- common/autotest_common.sh@551 -- # xtrace_disable 00:13:04.149 22:50:55 -- common/autotest_common.sh@10 -- # set +x 00:13:04.149 22:50:55 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:13:04.149 22:50:55 -- target/host_management.sh@78 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; kill -9 $perfpid || true; nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:13:04.149 22:50:55 -- target/host_management.sh@80 -- # waitforio /var/tmp/bdevperf.sock Nvme0n1 00:13:04.149 22:50:55 -- target/host_management.sh@45 -- # '[' -z /var/tmp/bdevperf.sock ']' 00:13:04.149 22:50:55 -- target/host_management.sh@49 -- # '[' -z Nvme0n1 ']' 00:13:04.149 22:50:55 -- target/host_management.sh@52 -- # local ret=1 00:13:04.149 22:50:55 -- target/host_management.sh@53 -- # local i 00:13:04.149 22:50:55 -- target/host_management.sh@54 -- # (( i = 10 )) 00:13:04.149 22:50:55 -- target/host_management.sh@54 -- # (( i != 0 )) 00:13:04.149 22:50:55 -- target/host_management.sh@55 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_get_iostat -b Nvme0n1 00:13:04.149 22:50:55 -- target/host_management.sh@55 -- # jq -r '.bdevs[0].num_read_ops' 00:13:04.149 22:50:55 -- common/autotest_common.sh@551 -- # xtrace_disable 00:13:04.149 22:50:55 -- common/autotest_common.sh@10 -- # set +x 00:13:04.149 22:50:55 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:13:04.149 22:50:55 -- target/host_management.sh@55 -- # read_io_count=1759 00:13:04.149 22:50:55 -- target/host_management.sh@58 -- # '[' 1759 -ge 100 ']' 00:13:04.149 22:50:55 -- target/host_management.sh@59 -- # ret=0 00:13:04.149 22:50:55 -- target/host_management.sh@60 -- # break 00:13:04.149 22:50:55 -- target/host_management.sh@64 -- # return 0 00:13:04.149 22:50:55 -- target/host_management.sh@84 -- # rpc_cmd nvmf_subsystem_remove_host nqn.2016-06.io.spdk:cnode0 nqn.2016-06.io.spdk:host0 00:13:04.149 22:50:55 -- common/autotest_common.sh@551 -- # xtrace_disable 00:13:04.149 22:50:55 -- common/autotest_common.sh@10 -- # set +x 00:13:04.149 [2024-04-16 22:50:55.238159] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x803480 is same with the state(5) to be set 00:13:04.149 [2024-04-16 22:50:55.238254] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x803480 is same with the state(5) to be set 00:13:04.149 [2024-04-16 22:50:55.238270] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x803480 is same with the state(5) to be set 00:13:04.149 [2024-04-16 22:50:55.238282] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x803480 is same with the state(5) to be set 00:13:04.149 [2024-04-16 22:50:55.238304] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x803480 is same with the state(5) to be set 00:13:04.149 [2024-04-16 22:50:55.238316] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x803480 is same with the state(5) to be set 00:13:04.149 [2024-04-16 22:50:55.238329] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x803480 is same with the state(5) to be set 00:13:04.149 [2024-04-16 22:50:55.238341] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x803480 is same with the state(5) to be set 00:13:04.149 [2024-04-16 22:50:55.238352] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x803480 is same with the state(5) to be set 00:13:04.149 [2024-04-16 22:50:55.238373] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x803480 is same with the state(5) to be set 00:13:04.149 [2024-04-16 22:50:55.238385] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x803480 is same with the state(5) to be set 00:13:04.149 [2024-04-16 22:50:55.238397] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x803480 is same with the state(5) to be set 00:13:04.149 [2024-04-16 22:50:55.238408] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x803480 is same with the state(5) to be set 00:13:04.149 [2024-04-16 22:50:55.238419] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x803480 is same with the state(5) to be set 00:13:04.149 [2024-04-16 22:50:55.238431] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x803480 is same with the state(5) to be set 00:13:04.149 [2024-04-16 22:50:55.238443] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x803480 is same with the state(5) to be set 00:13:04.149 [2024-04-16 22:50:55.238455] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x803480 is same with the state(5) to be set 00:13:04.149 [2024-04-16 22:50:55.238477] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x803480 is same with the state(5) to be set 00:13:04.149 [2024-04-16 22:50:55.238501] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x803480 is same with the state(5) to be set 00:13:04.149 [2024-04-16 22:50:55.238512] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x803480 is same with the state(5) to be set 00:13:04.149 [2024-04-16 22:50:55.238524] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x803480 is same with the state(5) to be set 00:13:04.149 [2024-04-16 22:50:55.238535] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x803480 is same with the state(5) to be set 00:13:04.149 [2024-04-16 22:50:55.238547] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x803480 is same with the state(5) to be set 00:13:04.149 [2024-04-16 22:50:55.238558] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x803480 is same with the state(5) to be set 00:13:04.149 [2024-04-16 22:50:55.238570] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x803480 is same with the state(5) to be set 00:13:04.149 [2024-04-16 22:50:55.238582] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x803480 is same with the state(5) to be set 00:13:04.149 [2024-04-16 22:50:55.238594] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x803480 is same with the state(5) to be set 00:13:04.149 [2024-04-16 22:50:55.238606] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x803480 is same with the state(5) to be set 00:13:04.149 [2024-04-16 22:50:55.238617] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x803480 is same with the state(5) to be set 00:13:04.149 [2024-04-16 22:50:55.238629] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x803480 is same with the state(5) to be set 00:13:04.149 [2024-04-16 22:50:55.238640] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x803480 is same with the state(5) to be set 00:13:04.149 [2024-04-16 22:50:55.238652] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x803480 is same with the state(5) to be set 00:13:04.149 [2024-04-16 22:50:55.238664] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x803480 is same with the state(5) to be set 00:13:04.149 [2024-04-16 22:50:55.238675] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x803480 is same with the state(5) to be set 00:13:04.149 [2024-04-16 22:50:55.238688] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x803480 is same with the state(5) to be set 00:13:04.149 [2024-04-16 22:50:55.238699] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x803480 is same with the state(5) to be set 00:13:04.149 [2024-04-16 22:50:55.238711] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x803480 is same with the state(5) to be set 00:13:04.150 [2024-04-16 22:50:55.238724] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x803480 is same with the state(5) to be set 00:13:04.150 [2024-04-16 22:50:55.238735] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x803480 is same with the state(5) to be set 00:13:04.150 [2024-04-16 22:50:55.238747] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x803480 is same with the state(5) to be set 00:13:04.150 [2024-04-16 22:50:55.238758] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x803480 is same with the state(5) to be set 00:13:04.150 [2024-04-16 22:50:55.238770] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x803480 is same with the state(5) to be set 00:13:04.150 [2024-04-16 22:50:55.238781] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x803480 is same with the state(5) to be set 00:13:04.150 [2024-04-16 22:50:55.238793] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x803480 is same with the state(5) to be set 00:13:04.150 [2024-04-16 22:50:55.238808] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x803480 is same with the state(5) to be set 00:13:04.150 [2024-04-16 22:50:55.238820] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x803480 is same with the state(5) to be set 00:13:04.150 [2024-04-16 22:50:55.238831] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x803480 is same with the state(5) to be set 00:13:04.150 [2024-04-16 22:50:55.238843] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x803480 is same with the state(5) to be set 00:13:04.150 [2024-04-16 22:50:55.238855] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x803480 is same with the state(5) to be set 00:13:04.150 [2024-04-16 22:50:55.238867] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x803480 is same with the state(5) to be set 00:13:04.150 [2024-04-16 22:50:55.238880] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x803480 is same with the state(5) to be set 00:13:04.150 [2024-04-16 22:50:55.238891] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x803480 is same with the state(5) to be set 00:13:04.150 [2024-04-16 22:50:55.238903] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x803480 is same with the state(5) to be set 00:13:04.150 [2024-04-16 22:50:55.238914] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x803480 is same with the state(5) to be set 00:13:04.150 [2024-04-16 22:50:55.238925] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x803480 is same with the state(5) to be set 00:13:04.150 [2024-04-16 22:50:55.238937] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x803480 is same with the state(5) to be set 00:13:04.150 [2024-04-16 22:50:55.238948] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x803480 is same with the state(5) to be set 00:13:04.150 [2024-04-16 22:50:55.238959] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x803480 is same with the state(5) to be set 00:13:04.150 [2024-04-16 22:50:55.238971] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x803480 is same with the state(5) to be set 00:13:04.150 [2024-04-16 22:50:55.239105] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:30 nsid:1 lba:110720 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:13:04.150 [2024-04-16 22:50:55.239147] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:13:04.150 [2024-04-16 22:50:55.239180] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:20 nsid:1 lba:110848 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:13:04.150 [2024-04-16 22:50:55.239199] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:13:04.150 [2024-04-16 22:50:55.239215] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:50 nsid:1 lba:111232 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:13:04.150 [2024-04-16 22:50:55.239230] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:13:04.150 [2024-04-16 22:50:55.239245] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:40 nsid:1 lba:111360 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:13:04.150 [2024-04-16 22:50:55.239259] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:13:04.150 [2024-04-16 22:50:55.239274] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:52 nsid:1 lba:111488 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:13:04.150 [2024-04-16 22:50:55.239287] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:13:04.150 [2024-04-16 22:50:55.239302] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:47 nsid:1 lba:111616 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:13:04.150 [2024-04-16 22:50:55.239321] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:13:04.150 [2024-04-16 22:50:55.239338] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:60 nsid:1 lba:111744 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:13:04.150 [2024-04-16 22:50:55.239352] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:13:04.150 [2024-04-16 22:50:55.239368] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:111872 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:13:04.150 [2024-04-16 22:50:55.239382] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:13:04.150 [2024-04-16 22:50:55.239397] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:29 nsid:1 lba:112000 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:13:04.150 [2024-04-16 22:50:55.239411] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:13:04.150 [2024-04-16 22:50:55.239426] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:25 nsid:1 lba:106496 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:13:04.150 [2024-04-16 22:50:55.239439] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:13:04.150 [2024-04-16 22:50:55.239454] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:38 nsid:1 lba:106624 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:13:04.150 [2024-04-16 22:50:55.239467] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:13:04.150 [2024-04-16 22:50:55.239493] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:12 nsid:1 lba:112128 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:13:04.150 [2024-04-16 22:50:55.239506] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:13:04.150 [2024-04-16 22:50:55.239521] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:41 nsid:1 lba:112256 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:13:04.150 [2024-04-16 22:50:55.239534] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:13:04.150 [2024-04-16 22:50:55.239550] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:42 nsid:1 lba:112384 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:13:04.150 [2024-04-16 22:50:55.239563] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:13:04.150 [2024-04-16 22:50:55.239578] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:55 nsid:1 lba:112512 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:13:04.150 [2024-04-16 22:50:55.239591] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:13:04.150 [2024-04-16 22:50:55.239607] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:36 nsid:1 lba:112640 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:13:04.150 [2024-04-16 22:50:55.239620] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:13:04.150 [2024-04-16 22:50:55.239635] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:51 nsid:1 lba:112768 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:13:04.150 [2024-04-16 22:50:55.239648] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:13:04.150 [2024-04-16 22:50:55.239663] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:45 nsid:1 lba:112896 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:13:04.150 [2024-04-16 22:50:55.239677] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:13:04.150 [2024-04-16 22:50:55.239695] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:13 nsid:1 lba:113024 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:13:04.150 [2024-04-16 22:50:55.239709] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:13:04.150 [2024-04-16 22:50:55.239724] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:37 nsid:1 lba:107008 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:13:04.150 [2024-04-16 22:50:55.239737] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:13:04.150 [2024-04-16 22:50:55.239752] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:33 nsid:1 lba:107136 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:13:04.150 [2024-04-16 22:50:55.239766] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:13:04.150 [2024-04-16 22:50:55.239781] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:107264 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:13:04.150 [2024-04-16 22:50:55.239794] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:13:04.150 [2024-04-16 22:50:55.239809] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:34 nsid:1 lba:113152 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:13:04.150 [2024-04-16 22:50:55.239823] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:13:04.150 [2024-04-16 22:50:55.239838] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:59 nsid:1 lba:113280 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:13:04.150 [2024-04-16 22:50:55.239851] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:13:04.150 [2024-04-16 22:50:55.239866] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:61 nsid:1 lba:113408 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:13:04.150 [2024-04-16 22:50:55.239879] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:13:04.150 [2024-04-16 22:50:55.239894] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:27 nsid:1 lba:113536 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:13:04.150 [2024-04-16 22:50:55.239907] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:13:04.150 [2024-04-16 22:50:55.239922] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:48 nsid:1 lba:107392 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:13:04.150 [2024-04-16 22:50:55.239935] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:13:04.150 [2024-04-16 22:50:55.239951] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:107648 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:13:04.150 [2024-04-16 22:50:55.239964] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:13:04.150 [2024-04-16 22:50:55.239979] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:44 nsid:1 lba:113664 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:13:04.150 [2024-04-16 22:50:55.239992] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:13:04.150 [2024-04-16 22:50:55.240007] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:31 nsid:1 lba:113792 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:13:04.151 [2024-04-16 22:50:55.240020] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:13:04.151 [2024-04-16 22:50:55.240035] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:113920 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:13:04.151 [2024-04-16 22:50:55.240051] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:13:04.151 [2024-04-16 22:50:55.240067] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:49 nsid:1 lba:114048 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:13:04.151 [2024-04-16 22:50:55.240081] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:13:04.151 [2024-04-16 22:50:55.240096] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:108032 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:13:04.151 [2024-04-16 22:50:55.240110] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:13:04.151 [2024-04-16 22:50:55.240125] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:57 nsid:1 lba:108160 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:13:04.151 [2024-04-16 22:50:55.240139] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:13:04.151 [2024-04-16 22:50:55.240154] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:58 nsid:1 lba:114176 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:13:04.151 [2024-04-16 22:50:55.240168] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:13:04.151 [2024-04-16 22:50:55.240192] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:62 nsid:1 lba:108416 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:13:04.151 [2024-04-16 22:50:55.240206] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:13:04.151 [2024-04-16 22:50:55.240230] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:22 nsid:1 lba:114304 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:13:04.151 [2024-04-16 22:50:55.240243] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:13:04.151 [2024-04-16 22:50:55.240258] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:6 nsid:1 lba:114432 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:13:04.151 [2024-04-16 22:50:55.240272] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:13:04.151 [2024-04-16 22:50:55.240287] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:114560 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:13:04.151 [2024-04-16 22:50:55.240300] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:13:04.151 [2024-04-16 22:50:55.240315] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:17 nsid:1 lba:108544 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:13:04.151 [2024-04-16 22:50:55.240329] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:13:04.151 [2024-04-16 22:50:55.240343] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:24 nsid:1 lba:114688 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:13:04.151 [2024-04-16 22:50:55.240357] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:13:04.151 [2024-04-16 22:50:55.240372] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:21 nsid:1 lba:114816 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:13:04.151 [2024-04-16 22:50:55.240385] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:13:04.151 [2024-04-16 22:50:55.240400] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:43 nsid:1 lba:108672 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:13:04.151 [2024-04-16 22:50:55.240413] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:13:04.151 [2024-04-16 22:50:55.240432] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:63 nsid:1 lba:108800 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:13:04.151 [2024-04-16 22:50:55.240446] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:13:04.151 [2024-04-16 22:50:55.240461] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:108928 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:13:04.151 [2024-04-16 22:50:55.240478] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:13:04.151 [2024-04-16 22:50:55.240493] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:19 nsid:1 lba:109184 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:13:04.151 [2024-04-16 22:50:55.240506] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:13:04.151 [2024-04-16 22:50:55.240521] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:18 nsid:1 lba:109312 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:13:04.151 [2024-04-16 22:50:55.240534] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:13:04.151 [2024-04-16 22:50:55.240550] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:109440 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:13:04.151 [2024-04-16 22:50:55.240563] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:13:04.151 [2024-04-16 22:50:55.240578] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:46 nsid:1 lba:109568 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:13:04.151 [2024-04-16 22:50:55.240592] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:13:04.151 [2024-04-16 22:50:55.240607] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:23 nsid:1 lba:109696 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:13:04.151 [2024-04-16 22:50:55.240620] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:13:04.151 [2024-04-16 22:50:55.240635] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:114944 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:13:04.151 [2024-04-16 22:50:55.240649] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:13:04.151 [2024-04-16 22:50:55.240663] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:35 nsid:1 lba:115072 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:13:04.151 [2024-04-16 22:50:55.240677] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:13:04.151 [2024-04-16 22:50:55.240691] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:16 nsid:1 lba:115200 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:13:04.151 [2024-04-16 22:50:55.240705] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:13:04.151 [2024-04-16 22:50:55.240721] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:54 nsid:1 lba:115328 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:13:04.151 [2024-04-16 22:50:55.240734] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:13:04.151 [2024-04-16 22:50:55.240749] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:10 nsid:1 lba:115456 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:13:04.151 [2024-04-16 22:50:55.240762] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:13:04.151 [2024-04-16 22:50:55.240776] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:53 nsid:1 lba:115584 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:13:04.151 [2024-04-16 22:50:55.240793] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:13:04.151 [2024-04-16 22:50:55.240809] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:26 nsid:1 lba:115712 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:13:04.151 [2024-04-16 22:50:55.240822] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:13:04.151 [2024-04-16 22:50:55.240837] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:110208 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:13:04.151 [2024-04-16 22:50:55.240850] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:13:04.151 [2024-04-16 22:50:55.240865] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:110336 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:13:04.151 [2024-04-16 22:50:55.240878] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:13:04.151 [2024-04-16 22:50:55.240893] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:56 nsid:1 lba:115840 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:13:04.151 [2024-04-16 22:50:55.240907] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:13:04.151 [2024-04-16 22:50:55.240921] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:32 nsid:1 lba:115968 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:13:04.151 [2024-04-16 22:50:55.240934] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:13:04.151 [2024-04-16 22:50:55.240949] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:116096 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:13:04.151 [2024-04-16 22:50:55.240962] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:13:04.151 [2024-04-16 22:50:55.240977] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:28 nsid:1 lba:116224 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:13:04.151 [2024-04-16 22:50:55.240990] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:13:04.151 [2024-04-16 22:50:55.241005] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:39 nsid:1 lba:116352 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:13:04.151 [2024-04-16 22:50:55.241019] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:13:04.151 [2024-04-16 22:50:55.241034] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1fc6b50 is same with the state(5) to be set 00:13:04.151 [2024-04-16 22:50:55.241110] bdev_nvme.c:1576:bdev_nvme_disconnected_qpair_cb: *NOTICE*: qpair 0x1fc6b50 was disconnected and freed. reset controller. 00:13:04.151 [2024-04-16 22:50:55.242278] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode0] resetting controller 00:13:04.151 22:50:55 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:13:04.151 22:50:55 -- target/host_management.sh@85 -- # rpc_cmd nvmf_subsystem_add_host nqn.2016-06.io.spdk:cnode0 nqn.2016-06.io.spdk:host0 00:13:04.151 22:50:55 -- common/autotest_common.sh@551 -- # xtrace_disable 00:13:04.151 22:50:55 -- common/autotest_common.sh@10 -- # set +x 00:13:04.151 task offset: 110720 on job bdev=Nvme0n1 fails 00:13:04.151 00:13:04.151 Latency(us) 00:13:04.151 Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:13:04.151 Job: Nvme0n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:13:04.151 Job: Nvme0n1 ended in about 0.65 seconds with error 00:13:04.151 Verification LBA range: start 0x0 length 0x400 00:13:04.151 Nvme0n1 : 0.65 2894.18 180.89 99.05 0.00 21068.21 3835.07 25049.32 00:13:04.151 =================================================================================================================== 00:13:04.151 Total : 2894.18 180.89 99.05 0.00 21068.21 3835.07 25049.32 00:13:04.152 [2024-04-16 22:50:55.244342] app.c: 910:spdk_app_stop: *WARNING*: spdk_app_stop'd on non-zero 00:13:04.152 [2024-04-16 22:50:55.244373] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1fc9400 (9): Bad file descriptor 00:13:04.152 22:50:55 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:13:04.152 22:50:55 -- target/host_management.sh@87 -- # sleep 1 00:13:04.409 [2024-04-16 22:50:55.346326] bdev_nvme.c:2026:_bdev_nvme_reset_ctrlr_complete: *NOTICE*: Resetting controller successful. 00:13:05.343 22:50:56 -- target/host_management.sh@91 -- # kill -9 247411 00:13:05.343 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/host_management.sh: line 91: kill: (247411) - No such process 00:13:05.343 22:50:56 -- target/host_management.sh@91 -- # true 00:13:05.343 22:50:56 -- target/host_management.sh@97 -- # rm -f /var/tmp/spdk_cpu_lock_001 /var/tmp/spdk_cpu_lock_002 /var/tmp/spdk_cpu_lock_003 /var/tmp/spdk_cpu_lock_004 00:13:05.343 22:50:56 -- target/host_management.sh@100 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -r /var/tmp/bdevperf.sock --json /dev/fd/62 -q 64 -o 65536 -w verify -t 1 00:13:05.343 22:50:56 -- target/host_management.sh@100 -- # gen_nvmf_target_json 0 00:13:05.343 22:50:56 -- nvmf/common.sh@520 -- # config=() 00:13:05.343 22:50:56 -- nvmf/common.sh@520 -- # local subsystem config 00:13:05.343 22:50:56 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:13:05.343 22:50:56 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:13:05.343 { 00:13:05.343 "params": { 00:13:05.343 "name": "Nvme$subsystem", 00:13:05.343 "trtype": "$TEST_TRANSPORT", 00:13:05.343 "traddr": "$NVMF_FIRST_TARGET_IP", 00:13:05.343 "adrfam": "ipv4", 00:13:05.343 "trsvcid": "$NVMF_PORT", 00:13:05.343 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:13:05.343 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:13:05.343 "hdgst": ${hdgst:-false}, 00:13:05.343 "ddgst": ${ddgst:-false} 00:13:05.343 }, 00:13:05.343 "method": "bdev_nvme_attach_controller" 00:13:05.343 } 00:13:05.343 EOF 00:13:05.343 )") 00:13:05.343 22:50:56 -- nvmf/common.sh@542 -- # cat 00:13:05.343 22:50:56 -- nvmf/common.sh@544 -- # jq . 00:13:05.343 22:50:56 -- nvmf/common.sh@545 -- # IFS=, 00:13:05.343 22:50:56 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:13:05.343 "params": { 00:13:05.343 "name": "Nvme0", 00:13:05.343 "trtype": "tcp", 00:13:05.343 "traddr": "10.0.0.2", 00:13:05.343 "adrfam": "ipv4", 00:13:05.343 "trsvcid": "4420", 00:13:05.343 "subnqn": "nqn.2016-06.io.spdk:cnode0", 00:13:05.343 "hostnqn": "nqn.2016-06.io.spdk:host0", 00:13:05.343 "hdgst": false, 00:13:05.343 "ddgst": false 00:13:05.343 }, 00:13:05.343 "method": "bdev_nvme_attach_controller" 00:13:05.343 }' 00:13:05.343 [2024-04-16 22:50:56.290830] Starting SPDK v24.01.1-pre git sha1 4b134b4ab / DPDK 23.11.0 initialization... 00:13:05.343 [2024-04-16 22:50:56.290923] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid247696 ] 00:13:05.343 EAL: No free 2048 kB hugepages reported on node 1 00:13:05.343 [2024-04-16 22:50:56.351535] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:13:05.343 [2024-04-16 22:50:56.459073] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:13:05.601 Running I/O for 1 seconds... 00:13:06.974 00:13:06.974 Latency(us) 00:13:06.974 Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:13:06.974 Job: Nvme0n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:13:06.974 Verification LBA range: start 0x0 length 0x400 00:13:06.974 Nvme0n1 : 1.01 3810.52 238.16 0.00 0.00 16549.37 1140.81 22622.06 00:13:06.974 =================================================================================================================== 00:13:06.974 Total : 3810.52 238.16 0.00 0.00 16549.37 1140.81 22622.06 00:13:06.974 22:50:57 -- target/host_management.sh@101 -- # stoptarget 00:13:06.974 22:50:57 -- target/host_management.sh@36 -- # rm -f ./local-job0-0-verify.state 00:13:06.974 22:50:57 -- target/host_management.sh@37 -- # rm -rf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/bdevperf.conf 00:13:06.974 22:50:57 -- target/host_management.sh@38 -- # rm -rf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/rpcs.txt 00:13:06.974 22:50:57 -- target/host_management.sh@40 -- # nvmftestfini 00:13:06.974 22:50:57 -- nvmf/common.sh@476 -- # nvmfcleanup 00:13:06.974 22:50:57 -- nvmf/common.sh@116 -- # sync 00:13:06.974 22:50:57 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:13:06.974 22:50:57 -- nvmf/common.sh@119 -- # set +e 00:13:06.974 22:50:57 -- nvmf/common.sh@120 -- # for i in {1..20} 00:13:06.974 22:50:57 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:13:06.974 rmmod nvme_tcp 00:13:06.974 rmmod nvme_fabrics 00:13:06.974 rmmod nvme_keyring 00:13:06.974 22:50:58 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:13:06.974 22:50:58 -- nvmf/common.sh@123 -- # set -e 00:13:06.974 22:50:58 -- nvmf/common.sh@124 -- # return 0 00:13:06.974 22:50:58 -- nvmf/common.sh@477 -- # '[' -n 247230 ']' 00:13:06.974 22:50:58 -- nvmf/common.sh@478 -- # killprocess 247230 00:13:06.974 22:50:58 -- common/autotest_common.sh@926 -- # '[' -z 247230 ']' 00:13:06.974 22:50:58 -- common/autotest_common.sh@930 -- # kill -0 247230 00:13:06.974 22:50:58 -- common/autotest_common.sh@931 -- # uname 00:13:06.974 22:50:58 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:13:06.974 22:50:58 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 247230 00:13:06.974 22:50:58 -- common/autotest_common.sh@932 -- # process_name=reactor_1 00:13:06.974 22:50:58 -- common/autotest_common.sh@936 -- # '[' reactor_1 = sudo ']' 00:13:06.974 22:50:58 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 247230' 00:13:06.974 killing process with pid 247230 00:13:06.974 22:50:58 -- common/autotest_common.sh@945 -- # kill 247230 00:13:06.974 22:50:58 -- common/autotest_common.sh@950 -- # wait 247230 00:13:07.232 [2024-04-16 22:50:58.323879] app.c: 605:unclaim_cpu_cores: *ERROR*: Failed to unlink lock fd for core 1, errno: 2 00:13:07.232 22:50:58 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:13:07.232 22:50:58 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:13:07.232 22:50:58 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:13:07.232 22:50:58 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:13:07.232 22:50:58 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:13:07.232 22:50:58 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:13:07.232 22:50:58 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:13:07.232 22:50:58 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:13:09.767 22:51:00 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:13:09.767 00:13:09.767 real 0m7.348s 00:13:09.767 user 0m22.738s 00:13:09.767 sys 0m1.434s 00:13:09.767 22:51:00 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:13:09.767 22:51:00 -- common/autotest_common.sh@10 -- # set +x 00:13:09.767 ************************************ 00:13:09.767 END TEST nvmf_host_management 00:13:09.767 ************************************ 00:13:09.767 22:51:00 -- target/host_management.sh@108 -- # trap - SIGINT SIGTERM EXIT 00:13:09.767 00:13:09.767 real 0m9.634s 00:13:09.767 user 0m23.595s 00:13:09.767 sys 0m2.889s 00:13:09.767 22:51:00 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:13:09.767 22:51:00 -- common/autotest_common.sh@10 -- # set +x 00:13:09.767 ************************************ 00:13:09.767 END TEST nvmf_host_management 00:13:09.767 ************************************ 00:13:09.767 22:51:00 -- nvmf/nvmf.sh@47 -- # run_test nvmf_lvol /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/nvmf_lvol.sh --transport=tcp 00:13:09.767 22:51:00 -- common/autotest_common.sh@1077 -- # '[' 3 -le 1 ']' 00:13:09.767 22:51:00 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:13:09.767 22:51:00 -- common/autotest_common.sh@10 -- # set +x 00:13:09.767 ************************************ 00:13:09.767 START TEST nvmf_lvol 00:13:09.767 ************************************ 00:13:09.767 22:51:00 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/nvmf_lvol.sh --transport=tcp 00:13:09.767 * Looking for test storage... 00:13:09.767 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:13:09.767 22:51:00 -- target/nvmf_lvol.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:13:09.767 22:51:00 -- nvmf/common.sh@7 -- # uname -s 00:13:09.767 22:51:00 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:13:09.767 22:51:00 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:13:09.767 22:51:00 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:13:09.767 22:51:00 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:13:09.767 22:51:00 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:13:09.767 22:51:00 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:13:09.767 22:51:00 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:13:09.767 22:51:00 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:13:09.767 22:51:00 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:13:09.767 22:51:00 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:13:09.767 22:51:00 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:13:09.767 22:51:00 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:13:09.767 22:51:00 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:13:09.767 22:51:00 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:13:09.767 22:51:00 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:13:09.767 22:51:00 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:13:09.767 22:51:00 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:13:09.767 22:51:00 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:13:09.767 22:51:00 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:13:09.767 22:51:00 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:09.767 22:51:00 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:09.767 22:51:00 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:09.767 22:51:00 -- paths/export.sh@5 -- # export PATH 00:13:09.767 22:51:00 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:09.767 22:51:00 -- nvmf/common.sh@46 -- # : 0 00:13:09.767 22:51:00 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:13:09.767 22:51:00 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:13:09.767 22:51:00 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:13:09.767 22:51:00 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:13:09.767 22:51:00 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:13:09.767 22:51:00 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:13:09.767 22:51:00 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:13:09.767 22:51:00 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:13:09.767 22:51:00 -- target/nvmf_lvol.sh@11 -- # MALLOC_BDEV_SIZE=64 00:13:09.767 22:51:00 -- target/nvmf_lvol.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:13:09.767 22:51:00 -- target/nvmf_lvol.sh@13 -- # LVOL_BDEV_INIT_SIZE=20 00:13:09.767 22:51:00 -- target/nvmf_lvol.sh@14 -- # LVOL_BDEV_FINAL_SIZE=30 00:13:09.767 22:51:00 -- target/nvmf_lvol.sh@16 -- # rpc_py=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:13:09.768 22:51:00 -- target/nvmf_lvol.sh@18 -- # nvmftestinit 00:13:09.768 22:51:00 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:13:09.768 22:51:00 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:13:09.768 22:51:00 -- nvmf/common.sh@436 -- # prepare_net_devs 00:13:09.768 22:51:00 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:13:09.768 22:51:00 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:13:09.768 22:51:00 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:13:09.768 22:51:00 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:13:09.768 22:51:00 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:13:09.768 22:51:00 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:13:09.768 22:51:00 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:13:09.768 22:51:00 -- nvmf/common.sh@284 -- # xtrace_disable 00:13:09.768 22:51:00 -- common/autotest_common.sh@10 -- # set +x 00:13:11.670 22:51:02 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:13:11.670 22:51:02 -- nvmf/common.sh@290 -- # pci_devs=() 00:13:11.670 22:51:02 -- nvmf/common.sh@290 -- # local -a pci_devs 00:13:11.670 22:51:02 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:13:11.670 22:51:02 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:13:11.670 22:51:02 -- nvmf/common.sh@292 -- # pci_drivers=() 00:13:11.670 22:51:02 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:13:11.670 22:51:02 -- nvmf/common.sh@294 -- # net_devs=() 00:13:11.670 22:51:02 -- nvmf/common.sh@294 -- # local -ga net_devs 00:13:11.670 22:51:02 -- nvmf/common.sh@295 -- # e810=() 00:13:11.670 22:51:02 -- nvmf/common.sh@295 -- # local -ga e810 00:13:11.670 22:51:02 -- nvmf/common.sh@296 -- # x722=() 00:13:11.670 22:51:02 -- nvmf/common.sh@296 -- # local -ga x722 00:13:11.670 22:51:02 -- nvmf/common.sh@297 -- # mlx=() 00:13:11.670 22:51:02 -- nvmf/common.sh@297 -- # local -ga mlx 00:13:11.670 22:51:02 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:13:11.670 22:51:02 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:13:11.670 22:51:02 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:13:11.670 22:51:02 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:13:11.670 22:51:02 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:13:11.670 22:51:02 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:13:11.670 22:51:02 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:13:11.670 22:51:02 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:13:11.670 22:51:02 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:13:11.670 22:51:02 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:13:11.670 22:51:02 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:13:11.670 22:51:02 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:13:11.670 22:51:02 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:13:11.670 22:51:02 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:13:11.670 22:51:02 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:13:11.670 22:51:02 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:13:11.670 22:51:02 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:13:11.670 22:51:02 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:13:11.670 22:51:02 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:13:11.670 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:13:11.670 22:51:02 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:13:11.670 22:51:02 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:13:11.670 22:51:02 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:13:11.670 22:51:02 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:13:11.670 22:51:02 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:13:11.670 22:51:02 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:13:11.670 22:51:02 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:13:11.670 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:13:11.670 22:51:02 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:13:11.670 22:51:02 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:13:11.670 22:51:02 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:13:11.670 22:51:02 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:13:11.670 22:51:02 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:13:11.670 22:51:02 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:13:11.670 22:51:02 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:13:11.670 22:51:02 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:13:11.670 22:51:02 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:13:11.670 22:51:02 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:13:11.670 22:51:02 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:13:11.670 22:51:02 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:13:11.670 22:51:02 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:13:11.670 Found net devices under 0000:0a:00.0: cvl_0_0 00:13:11.670 22:51:02 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:13:11.670 22:51:02 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:13:11.670 22:51:02 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:13:11.670 22:51:02 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:13:11.670 22:51:02 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:13:11.670 22:51:02 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:13:11.670 Found net devices under 0000:0a:00.1: cvl_0_1 00:13:11.670 22:51:02 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:13:11.670 22:51:02 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:13:11.670 22:51:02 -- nvmf/common.sh@402 -- # is_hw=yes 00:13:11.671 22:51:02 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:13:11.671 22:51:02 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:13:11.671 22:51:02 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:13:11.671 22:51:02 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:13:11.671 22:51:02 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:13:11.671 22:51:02 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:13:11.671 22:51:02 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:13:11.671 22:51:02 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:13:11.671 22:51:02 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:13:11.671 22:51:02 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:13:11.671 22:51:02 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:13:11.671 22:51:02 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:13:11.671 22:51:02 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:13:11.671 22:51:02 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:13:11.671 22:51:02 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:13:11.671 22:51:02 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:13:11.671 22:51:02 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:13:11.671 22:51:02 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:13:11.671 22:51:02 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:13:11.671 22:51:02 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:13:11.671 22:51:02 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:13:11.671 22:51:02 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:13:11.671 22:51:02 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:13:11.671 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:13:11.671 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.209 ms 00:13:11.671 00:13:11.671 --- 10.0.0.2 ping statistics --- 00:13:11.671 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:13:11.671 rtt min/avg/max/mdev = 0.209/0.209/0.209/0.000 ms 00:13:11.671 22:51:02 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:13:11.671 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:13:11.671 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.095 ms 00:13:11.671 00:13:11.671 --- 10.0.0.1 ping statistics --- 00:13:11.671 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:13:11.671 rtt min/avg/max/mdev = 0.095/0.095/0.095/0.000 ms 00:13:11.671 22:51:02 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:13:11.671 22:51:02 -- nvmf/common.sh@410 -- # return 0 00:13:11.671 22:51:02 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:13:11.671 22:51:02 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:13:11.671 22:51:02 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:13:11.671 22:51:02 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:13:11.671 22:51:02 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:13:11.671 22:51:02 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:13:11.671 22:51:02 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:13:11.671 22:51:02 -- target/nvmf_lvol.sh@19 -- # nvmfappstart -m 0x7 00:13:11.671 22:51:02 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:13:11.671 22:51:02 -- common/autotest_common.sh@712 -- # xtrace_disable 00:13:11.671 22:51:02 -- common/autotest_common.sh@10 -- # set +x 00:13:11.671 22:51:02 -- nvmf/common.sh@469 -- # nvmfpid=249918 00:13:11.671 22:51:02 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x7 00:13:11.671 22:51:02 -- nvmf/common.sh@470 -- # waitforlisten 249918 00:13:11.671 22:51:02 -- common/autotest_common.sh@819 -- # '[' -z 249918 ']' 00:13:11.671 22:51:02 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk.sock 00:13:11.671 22:51:02 -- common/autotest_common.sh@824 -- # local max_retries=100 00:13:11.671 22:51:02 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:13:11.671 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:13:11.671 22:51:02 -- common/autotest_common.sh@828 -- # xtrace_disable 00:13:11.671 22:51:02 -- common/autotest_common.sh@10 -- # set +x 00:13:11.671 [2024-04-16 22:51:02.709109] Starting SPDK v24.01.1-pre git sha1 4b134b4ab / DPDK 23.11.0 initialization... 00:13:11.671 [2024-04-16 22:51:02.709195] [ DPDK EAL parameters: nvmf -c 0x7 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:13:11.671 EAL: No free 2048 kB hugepages reported on node 1 00:13:11.671 [2024-04-16 22:51:02.781905] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 3 00:13:11.929 [2024-04-16 22:51:02.906260] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:13:11.929 [2024-04-16 22:51:02.906390] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:13:11.929 [2024-04-16 22:51:02.906408] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:13:11.929 [2024-04-16 22:51:02.906422] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:13:11.929 [2024-04-16 22:51:02.906489] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:13:11.929 [2024-04-16 22:51:02.906517] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:13:11.929 [2024-04-16 22:51:02.906521] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:13:12.862 22:51:03 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:13:12.862 22:51:03 -- common/autotest_common.sh@852 -- # return 0 00:13:12.862 22:51:03 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:13:12.862 22:51:03 -- common/autotest_common.sh@718 -- # xtrace_disable 00:13:12.862 22:51:03 -- common/autotest_common.sh@10 -- # set +x 00:13:12.862 22:51:03 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:13:12.862 22:51:03 -- target/nvmf_lvol.sh@21 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_transport -t tcp -o -u 8192 00:13:12.862 [2024-04-16 22:51:03.920464] tcp.c: 659:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:13:12.862 22:51:03 -- target/nvmf_lvol.sh@24 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 00:13:13.119 22:51:04 -- target/nvmf_lvol.sh@24 -- # base_bdevs='Malloc0 ' 00:13:13.120 22:51:04 -- target/nvmf_lvol.sh@25 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 00:13:13.377 22:51:04 -- target/nvmf_lvol.sh@25 -- # base_bdevs+=Malloc1 00:13:13.377 22:51:04 -- target/nvmf_lvol.sh@26 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_raid_create -n raid0 -z 64 -r 0 -b 'Malloc0 Malloc1' 00:13:13.634 22:51:04 -- target/nvmf_lvol.sh@29 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_create_lvstore raid0 lvs 00:13:14.198 22:51:05 -- target/nvmf_lvol.sh@29 -- # lvs=e9314bc2-f379-4f1a-91b5-a1386b6c9977 00:13:14.198 22:51:05 -- target/nvmf_lvol.sh@32 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_create -u e9314bc2-f379-4f1a-91b5-a1386b6c9977 lvol 20 00:13:14.198 22:51:05 -- target/nvmf_lvol.sh@32 -- # lvol=4cf2587d-4a8a-4bc6-bad0-3381f59dd681 00:13:14.198 22:51:05 -- target/nvmf_lvol.sh@35 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode0 -a -s SPDK0 00:13:14.455 22:51:05 -- target/nvmf_lvol.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode0 4cf2587d-4a8a-4bc6-bad0-3381f59dd681 00:13:14.713 22:51:05 -- target/nvmf_lvol.sh@37 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode0 -t tcp -a 10.0.0.2 -s 4420 00:13:14.970 [2024-04-16 22:51:05.997136] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:13:14.970 22:51:06 -- target/nvmf_lvol.sh@38 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener discovery -t tcp -a 10.0.0.2 -s 4420 00:13:15.227 22:51:06 -- target/nvmf_lvol.sh@42 -- # perf_pid=250482 00:13:15.227 22:51:06 -- target/nvmf_lvol.sh@41 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' -o 4096 -q 128 -s 512 -w randwrite -t 10 -c 0x18 00:13:15.227 22:51:06 -- target/nvmf_lvol.sh@44 -- # sleep 1 00:13:15.227 EAL: No free 2048 kB hugepages reported on node 1 00:13:16.159 22:51:07 -- target/nvmf_lvol.sh@47 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_snapshot 4cf2587d-4a8a-4bc6-bad0-3381f59dd681 MY_SNAPSHOT 00:13:16.724 22:51:07 -- target/nvmf_lvol.sh@47 -- # snapshot=baf9fe6e-2f41-421a-bbdd-d8f545620d29 00:13:16.724 22:51:07 -- target/nvmf_lvol.sh@48 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_resize 4cf2587d-4a8a-4bc6-bad0-3381f59dd681 30 00:13:16.982 22:51:07 -- target/nvmf_lvol.sh@49 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_clone baf9fe6e-2f41-421a-bbdd-d8f545620d29 MY_CLONE 00:13:17.240 22:51:08 -- target/nvmf_lvol.sh@49 -- # clone=cfba1355-781e-4a3b-9b37-4a3730cf4917 00:13:17.240 22:51:08 -- target/nvmf_lvol.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_inflate cfba1355-781e-4a3b-9b37-4a3730cf4917 00:13:17.806 22:51:08 -- target/nvmf_lvol.sh@53 -- # wait 250482 00:13:25.960 Initializing NVMe Controllers 00:13:25.960 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode0 00:13:25.960 Controller IO queue size 128, less than required. 00:13:25.960 Consider using lower queue depth or smaller IO size, because IO requests may be queued at the NVMe driver. 00:13:25.960 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode0) NSID 1 with lcore 3 00:13:25.960 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode0) NSID 1 with lcore 4 00:13:25.960 Initialization complete. Launching workers. 00:13:25.960 ======================================================== 00:13:25.960 Latency(us) 00:13:25.960 Device Information : IOPS MiB/s Average min max 00:13:25.960 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode0) NSID 1 from core 3: 9711.50 37.94 13186.50 1959.58 119371.22 00:13:25.960 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode0) NSID 1 from core 4: 10931.40 42.70 11709.96 2056.27 57551.69 00:13:25.960 ======================================================== 00:13:25.960 Total : 20642.90 80.64 12404.61 1959.58 119371.22 00:13:25.960 00:13:25.960 22:51:16 -- target/nvmf_lvol.sh@56 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode0 00:13:25.960 22:51:16 -- target/nvmf_lvol.sh@57 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_delete 4cf2587d-4a8a-4bc6-bad0-3381f59dd681 00:13:26.218 22:51:17 -- target/nvmf_lvol.sh@58 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_delete_lvstore -u e9314bc2-f379-4f1a-91b5-a1386b6c9977 00:13:26.477 22:51:17 -- target/nvmf_lvol.sh@60 -- # rm -f 00:13:26.477 22:51:17 -- target/nvmf_lvol.sh@62 -- # trap - SIGINT SIGTERM EXIT 00:13:26.477 22:51:17 -- target/nvmf_lvol.sh@64 -- # nvmftestfini 00:13:26.477 22:51:17 -- nvmf/common.sh@476 -- # nvmfcleanup 00:13:26.477 22:51:17 -- nvmf/common.sh@116 -- # sync 00:13:26.477 22:51:17 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:13:26.477 22:51:17 -- nvmf/common.sh@119 -- # set +e 00:13:26.477 22:51:17 -- nvmf/common.sh@120 -- # for i in {1..20} 00:13:26.477 22:51:17 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:13:26.477 rmmod nvme_tcp 00:13:26.477 rmmod nvme_fabrics 00:13:26.477 rmmod nvme_keyring 00:13:26.477 22:51:17 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:13:26.477 22:51:17 -- nvmf/common.sh@123 -- # set -e 00:13:26.477 22:51:17 -- nvmf/common.sh@124 -- # return 0 00:13:26.477 22:51:17 -- nvmf/common.sh@477 -- # '[' -n 249918 ']' 00:13:26.477 22:51:17 -- nvmf/common.sh@478 -- # killprocess 249918 00:13:26.477 22:51:17 -- common/autotest_common.sh@926 -- # '[' -z 249918 ']' 00:13:26.477 22:51:17 -- common/autotest_common.sh@930 -- # kill -0 249918 00:13:26.477 22:51:17 -- common/autotest_common.sh@931 -- # uname 00:13:26.477 22:51:17 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:13:26.477 22:51:17 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 249918 00:13:26.477 22:51:17 -- common/autotest_common.sh@932 -- # process_name=reactor_0 00:13:26.477 22:51:17 -- common/autotest_common.sh@936 -- # '[' reactor_0 = sudo ']' 00:13:26.477 22:51:17 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 249918' 00:13:26.477 killing process with pid 249918 00:13:26.477 22:51:17 -- common/autotest_common.sh@945 -- # kill 249918 00:13:26.477 22:51:17 -- common/autotest_common.sh@950 -- # wait 249918 00:13:27.044 22:51:17 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:13:27.044 22:51:17 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:13:27.044 22:51:17 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:13:27.044 22:51:17 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:13:27.044 22:51:17 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:13:27.044 22:51:17 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:13:27.044 22:51:17 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:13:27.044 22:51:17 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:13:28.948 22:51:19 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:13:28.948 00:13:28.948 real 0m19.480s 00:13:28.948 user 1m4.993s 00:13:28.948 sys 0m6.051s 00:13:28.948 22:51:19 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:13:28.948 22:51:19 -- common/autotest_common.sh@10 -- # set +x 00:13:28.948 ************************************ 00:13:28.948 END TEST nvmf_lvol 00:13:28.948 ************************************ 00:13:28.948 22:51:19 -- nvmf/nvmf.sh@48 -- # run_test nvmf_lvs_grow /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/nvmf_lvs_grow.sh --transport=tcp 00:13:28.948 22:51:19 -- common/autotest_common.sh@1077 -- # '[' 3 -le 1 ']' 00:13:28.948 22:51:19 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:13:28.948 22:51:19 -- common/autotest_common.sh@10 -- # set +x 00:13:28.948 ************************************ 00:13:28.948 START TEST nvmf_lvs_grow 00:13:28.948 ************************************ 00:13:28.948 22:51:19 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/nvmf_lvs_grow.sh --transport=tcp 00:13:28.948 * Looking for test storage... 00:13:28.948 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:13:28.948 22:51:19 -- target/nvmf_lvs_grow.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:13:28.948 22:51:19 -- nvmf/common.sh@7 -- # uname -s 00:13:28.948 22:51:20 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:13:28.948 22:51:20 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:13:28.948 22:51:20 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:13:28.948 22:51:20 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:13:28.948 22:51:20 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:13:28.948 22:51:20 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:13:28.948 22:51:20 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:13:28.949 22:51:20 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:13:28.949 22:51:20 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:13:28.949 22:51:20 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:13:28.949 22:51:20 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:13:28.949 22:51:20 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:13:28.949 22:51:20 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:13:28.949 22:51:20 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:13:28.949 22:51:20 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:13:28.949 22:51:20 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:13:28.949 22:51:20 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:13:28.949 22:51:20 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:13:28.949 22:51:20 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:13:28.949 22:51:20 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:28.949 22:51:20 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:28.949 22:51:20 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:28.949 22:51:20 -- paths/export.sh@5 -- # export PATH 00:13:28.949 22:51:20 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:28.949 22:51:20 -- nvmf/common.sh@46 -- # : 0 00:13:28.949 22:51:20 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:13:28.949 22:51:20 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:13:28.949 22:51:20 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:13:28.949 22:51:20 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:13:28.949 22:51:20 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:13:28.949 22:51:20 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:13:28.949 22:51:20 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:13:28.949 22:51:20 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:13:28.949 22:51:20 -- target/nvmf_lvs_grow.sh@11 -- # rpc_py=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:13:28.949 22:51:20 -- target/nvmf_lvs_grow.sh@12 -- # bdevperf_rpc_sock=/var/tmp/bdevperf.sock 00:13:28.949 22:51:20 -- target/nvmf_lvs_grow.sh@97 -- # nvmftestinit 00:13:28.949 22:51:20 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:13:28.949 22:51:20 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:13:28.949 22:51:20 -- nvmf/common.sh@436 -- # prepare_net_devs 00:13:28.949 22:51:20 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:13:28.949 22:51:20 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:13:28.949 22:51:20 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:13:28.949 22:51:20 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:13:28.949 22:51:20 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:13:28.949 22:51:20 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:13:28.949 22:51:20 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:13:28.949 22:51:20 -- nvmf/common.sh@284 -- # xtrace_disable 00:13:28.949 22:51:20 -- common/autotest_common.sh@10 -- # set +x 00:13:30.850 22:51:21 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:13:30.850 22:51:21 -- nvmf/common.sh@290 -- # pci_devs=() 00:13:30.850 22:51:21 -- nvmf/common.sh@290 -- # local -a pci_devs 00:13:30.850 22:51:21 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:13:30.850 22:51:21 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:13:30.850 22:51:21 -- nvmf/common.sh@292 -- # pci_drivers=() 00:13:30.850 22:51:21 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:13:30.850 22:51:21 -- nvmf/common.sh@294 -- # net_devs=() 00:13:30.850 22:51:21 -- nvmf/common.sh@294 -- # local -ga net_devs 00:13:30.850 22:51:21 -- nvmf/common.sh@295 -- # e810=() 00:13:30.850 22:51:21 -- nvmf/common.sh@295 -- # local -ga e810 00:13:30.850 22:51:21 -- nvmf/common.sh@296 -- # x722=() 00:13:30.850 22:51:21 -- nvmf/common.sh@296 -- # local -ga x722 00:13:30.850 22:51:21 -- nvmf/common.sh@297 -- # mlx=() 00:13:30.850 22:51:21 -- nvmf/common.sh@297 -- # local -ga mlx 00:13:30.850 22:51:21 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:13:30.850 22:51:21 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:13:30.850 22:51:21 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:13:30.850 22:51:21 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:13:30.850 22:51:21 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:13:30.850 22:51:21 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:13:30.850 22:51:21 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:13:30.850 22:51:21 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:13:30.850 22:51:21 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:13:30.850 22:51:21 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:13:30.850 22:51:21 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:13:30.850 22:51:21 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:13:30.850 22:51:21 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:13:30.850 22:51:21 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:13:30.850 22:51:21 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:13:30.850 22:51:21 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:13:30.850 22:51:21 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:13:30.850 22:51:21 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:13:30.850 22:51:21 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:13:30.850 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:13:30.850 22:51:21 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:13:30.850 22:51:21 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:13:30.850 22:51:21 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:13:30.850 22:51:21 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:13:30.850 22:51:21 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:13:30.850 22:51:21 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:13:30.850 22:51:21 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:13:30.850 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:13:30.850 22:51:21 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:13:30.850 22:51:21 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:13:30.850 22:51:21 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:13:30.850 22:51:21 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:13:30.850 22:51:21 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:13:30.850 22:51:21 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:13:30.850 22:51:21 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:13:30.850 22:51:21 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:13:30.850 22:51:21 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:13:30.850 22:51:21 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:13:30.850 22:51:21 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:13:30.850 22:51:21 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:13:30.850 22:51:21 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:13:30.850 Found net devices under 0000:0a:00.0: cvl_0_0 00:13:30.850 22:51:21 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:13:30.850 22:51:21 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:13:30.850 22:51:21 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:13:30.850 22:51:21 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:13:30.850 22:51:21 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:13:30.850 22:51:21 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:13:30.850 Found net devices under 0000:0a:00.1: cvl_0_1 00:13:30.850 22:51:21 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:13:30.850 22:51:21 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:13:30.850 22:51:21 -- nvmf/common.sh@402 -- # is_hw=yes 00:13:30.850 22:51:21 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:13:30.850 22:51:21 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:13:30.850 22:51:21 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:13:30.850 22:51:21 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:13:30.850 22:51:21 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:13:30.850 22:51:21 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:13:30.850 22:51:21 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:13:30.850 22:51:21 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:13:30.850 22:51:21 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:13:30.850 22:51:21 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:13:30.850 22:51:21 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:13:30.850 22:51:21 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:13:30.850 22:51:21 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:13:30.850 22:51:21 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:13:30.850 22:51:21 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:13:30.850 22:51:21 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:13:30.850 22:51:21 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:13:30.850 22:51:21 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:13:30.850 22:51:21 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:13:30.850 22:51:21 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:13:30.850 22:51:21 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:13:30.850 22:51:21 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:13:30.850 22:51:21 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:13:30.850 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:13:30.850 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.108 ms 00:13:30.850 00:13:30.850 --- 10.0.0.2 ping statistics --- 00:13:30.850 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:13:30.850 rtt min/avg/max/mdev = 0.108/0.108/0.108/0.000 ms 00:13:30.850 22:51:21 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:13:31.109 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:13:31.109 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.066 ms 00:13:31.109 00:13:31.109 --- 10.0.0.1 ping statistics --- 00:13:31.109 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:13:31.109 rtt min/avg/max/mdev = 0.066/0.066/0.066/0.000 ms 00:13:31.109 22:51:21 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:13:31.109 22:51:21 -- nvmf/common.sh@410 -- # return 0 00:13:31.109 22:51:21 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:13:31.109 22:51:21 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:13:31.109 22:51:21 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:13:31.109 22:51:21 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:13:31.109 22:51:21 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:13:31.109 22:51:21 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:13:31.109 22:51:21 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:13:31.109 22:51:21 -- target/nvmf_lvs_grow.sh@98 -- # nvmfappstart -m 0x1 00:13:31.109 22:51:21 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:13:31.109 22:51:21 -- common/autotest_common.sh@712 -- # xtrace_disable 00:13:31.109 22:51:21 -- common/autotest_common.sh@10 -- # set +x 00:13:31.109 22:51:22 -- nvmf/common.sh@469 -- # nvmfpid=254201 00:13:31.109 22:51:22 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x1 00:13:31.109 22:51:22 -- nvmf/common.sh@470 -- # waitforlisten 254201 00:13:31.109 22:51:22 -- common/autotest_common.sh@819 -- # '[' -z 254201 ']' 00:13:31.109 22:51:22 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk.sock 00:13:31.109 22:51:22 -- common/autotest_common.sh@824 -- # local max_retries=100 00:13:31.109 22:51:22 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:13:31.109 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:13:31.109 22:51:22 -- common/autotest_common.sh@828 -- # xtrace_disable 00:13:31.109 22:51:22 -- common/autotest_common.sh@10 -- # set +x 00:13:31.109 [2024-04-16 22:51:22.044441] Starting SPDK v24.01.1-pre git sha1 4b134b4ab / DPDK 23.11.0 initialization... 00:13:31.109 [2024-04-16 22:51:22.044544] [ DPDK EAL parameters: nvmf -c 0x1 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:13:31.109 EAL: No free 2048 kB hugepages reported on node 1 00:13:31.109 [2024-04-16 22:51:22.108234] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:13:31.109 [2024-04-16 22:51:22.215789] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:13:31.109 [2024-04-16 22:51:22.215928] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:13:31.109 [2024-04-16 22:51:22.215945] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:13:31.109 [2024-04-16 22:51:22.215956] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:13:31.109 [2024-04-16 22:51:22.215981] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:13:32.042 22:51:22 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:13:32.042 22:51:22 -- common/autotest_common.sh@852 -- # return 0 00:13:32.042 22:51:22 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:13:32.042 22:51:22 -- common/autotest_common.sh@718 -- # xtrace_disable 00:13:32.042 22:51:22 -- common/autotest_common.sh@10 -- # set +x 00:13:32.042 22:51:23 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:13:32.042 22:51:23 -- target/nvmf_lvs_grow.sh@99 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_transport -t tcp -o -u 8192 00:13:32.300 [2024-04-16 22:51:23.236139] tcp.c: 659:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:13:32.300 22:51:23 -- target/nvmf_lvs_grow.sh@101 -- # run_test lvs_grow_clean lvs_grow 00:13:32.300 22:51:23 -- common/autotest_common.sh@1077 -- # '[' 2 -le 1 ']' 00:13:32.300 22:51:23 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:13:32.300 22:51:23 -- common/autotest_common.sh@10 -- # set +x 00:13:32.300 ************************************ 00:13:32.300 START TEST lvs_grow_clean 00:13:32.300 ************************************ 00:13:32.300 22:51:23 -- common/autotest_common.sh@1104 -- # lvs_grow 00:13:32.300 22:51:23 -- target/nvmf_lvs_grow.sh@15 -- # local aio_bdev lvs lvol 00:13:32.300 22:51:23 -- target/nvmf_lvs_grow.sh@16 -- # local data_clusters free_clusters 00:13:32.300 22:51:23 -- target/nvmf_lvs_grow.sh@17 -- # local bdevperf_pid run_test_pid 00:13:32.300 22:51:23 -- target/nvmf_lvs_grow.sh@18 -- # local aio_init_size_mb=200 00:13:32.300 22:51:23 -- target/nvmf_lvs_grow.sh@19 -- # local aio_final_size_mb=400 00:13:32.300 22:51:23 -- target/nvmf_lvs_grow.sh@20 -- # local lvol_bdev_size_mb=150 00:13:32.300 22:51:23 -- target/nvmf_lvs_grow.sh@23 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/aio_bdev 00:13:32.300 22:51:23 -- target/nvmf_lvs_grow.sh@24 -- # truncate -s 200M /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/aio_bdev 00:13:32.300 22:51:23 -- target/nvmf_lvs_grow.sh@25 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_aio_create /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/aio_bdev aio_bdev 4096 00:13:32.558 22:51:23 -- target/nvmf_lvs_grow.sh@25 -- # aio_bdev=aio_bdev 00:13:32.558 22:51:23 -- target/nvmf_lvs_grow.sh@28 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_create_lvstore --cluster-sz 4194304 --md-pages-per-cluster-ratio 300 aio_bdev lvs 00:13:32.816 22:51:23 -- target/nvmf_lvs_grow.sh@28 -- # lvs=b4364e8c-8bc9-4778-a9d4-597457c85d2f 00:13:32.816 22:51:23 -- target/nvmf_lvs_grow.sh@29 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u b4364e8c-8bc9-4778-a9d4-597457c85d2f 00:13:32.816 22:51:23 -- target/nvmf_lvs_grow.sh@29 -- # jq -r '.[0].total_data_clusters' 00:13:33.074 22:51:23 -- target/nvmf_lvs_grow.sh@29 -- # data_clusters=49 00:13:33.074 22:51:23 -- target/nvmf_lvs_grow.sh@30 -- # (( data_clusters == 49 )) 00:13:33.074 22:51:23 -- target/nvmf_lvs_grow.sh@33 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_create -u b4364e8c-8bc9-4778-a9d4-597457c85d2f lvol 150 00:13:33.331 22:51:24 -- target/nvmf_lvs_grow.sh@33 -- # lvol=19db6c03-20e2-40b8-9eb1-7274a0fa6fcd 00:13:33.331 22:51:24 -- target/nvmf_lvs_grow.sh@36 -- # truncate -s 400M /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/aio_bdev 00:13:33.331 22:51:24 -- target/nvmf_lvs_grow.sh@37 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_aio_rescan aio_bdev 00:13:33.331 [2024-04-16 22:51:24.459310] bdev_aio.c: 959:bdev_aio_rescan: *NOTICE*: AIO device is resized: bdev name /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/aio_bdev, old block count 51200, new block count 102400 00:13:33.331 [2024-04-16 22:51:24.459394] vbdev_lvol.c: 165:vbdev_lvs_base_bdev_event_cb: *NOTICE*: Unsupported bdev event: type 1 00:13:33.589 true 00:13:33.589 22:51:24 -- target/nvmf_lvs_grow.sh@38 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u b4364e8c-8bc9-4778-a9d4-597457c85d2f 00:13:33.589 22:51:24 -- target/nvmf_lvs_grow.sh@38 -- # jq -r '.[0].total_data_clusters' 00:13:33.589 22:51:24 -- target/nvmf_lvs_grow.sh@38 -- # (( data_clusters == 49 )) 00:13:33.589 22:51:24 -- target/nvmf_lvs_grow.sh@41 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode0 -a -s SPDK0 00:13:34.154 22:51:24 -- target/nvmf_lvs_grow.sh@42 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode0 19db6c03-20e2-40b8-9eb1-7274a0fa6fcd 00:13:34.154 22:51:25 -- target/nvmf_lvs_grow.sh@43 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode0 -t tcp -a 10.0.0.2 -s 4420 00:13:34.412 [2024-04-16 22:51:25.442328] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:13:34.412 22:51:25 -- target/nvmf_lvs_grow.sh@44 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener discovery -t tcp -a 10.0.0.2 -s 4420 00:13:34.670 22:51:25 -- target/nvmf_lvs_grow.sh@48 -- # bdevperf_pid=254752 00:13:34.670 22:51:25 -- target/nvmf_lvs_grow.sh@47 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -r /var/tmp/bdevperf.sock -m 0x2 -o 4096 -q 128 -w randwrite -t 10 -S 1 -z 00:13:34.670 22:51:25 -- target/nvmf_lvs_grow.sh@49 -- # trap 'killprocess $bdevperf_pid; nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:13:34.670 22:51:25 -- target/nvmf_lvs_grow.sh@50 -- # waitforlisten 254752 /var/tmp/bdevperf.sock 00:13:34.670 22:51:25 -- common/autotest_common.sh@819 -- # '[' -z 254752 ']' 00:13:34.670 22:51:25 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:13:34.670 22:51:25 -- common/autotest_common.sh@824 -- # local max_retries=100 00:13:34.670 22:51:25 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:13:34.670 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:13:34.670 22:51:25 -- common/autotest_common.sh@828 -- # xtrace_disable 00:13:34.670 22:51:25 -- common/autotest_common.sh@10 -- # set +x 00:13:34.670 [2024-04-16 22:51:25.730242] Starting SPDK v24.01.1-pre git sha1 4b134b4ab / DPDK 23.11.0 initialization... 00:13:34.670 [2024-04-16 22:51:25.730311] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x2 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid254752 ] 00:13:34.670 EAL: No free 2048 kB hugepages reported on node 1 00:13:34.670 [2024-04-16 22:51:25.795394] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:13:34.928 [2024-04-16 22:51:25.909831] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:13:35.860 22:51:26 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:13:35.860 22:51:26 -- common/autotest_common.sh@852 -- # return 0 00:13:35.860 22:51:26 -- target/nvmf_lvs_grow.sh@52 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b Nvme0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode0 00:13:36.118 Nvme0n1 00:13:36.118 22:51:27 -- target/nvmf_lvs_grow.sh@53 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_get_bdevs -b Nvme0n1 -t 3000 00:13:36.376 [ 00:13:36.376 { 00:13:36.376 "name": "Nvme0n1", 00:13:36.376 "aliases": [ 00:13:36.376 "19db6c03-20e2-40b8-9eb1-7274a0fa6fcd" 00:13:36.376 ], 00:13:36.376 "product_name": "NVMe disk", 00:13:36.376 "block_size": 4096, 00:13:36.376 "num_blocks": 38912, 00:13:36.376 "uuid": "19db6c03-20e2-40b8-9eb1-7274a0fa6fcd", 00:13:36.376 "assigned_rate_limits": { 00:13:36.376 "rw_ios_per_sec": 0, 00:13:36.376 "rw_mbytes_per_sec": 0, 00:13:36.376 "r_mbytes_per_sec": 0, 00:13:36.376 "w_mbytes_per_sec": 0 00:13:36.376 }, 00:13:36.376 "claimed": false, 00:13:36.376 "zoned": false, 00:13:36.376 "supported_io_types": { 00:13:36.376 "read": true, 00:13:36.376 "write": true, 00:13:36.376 "unmap": true, 00:13:36.376 "write_zeroes": true, 00:13:36.376 "flush": true, 00:13:36.376 "reset": true, 00:13:36.376 "compare": true, 00:13:36.376 "compare_and_write": true, 00:13:36.376 "abort": true, 00:13:36.376 "nvme_admin": true, 00:13:36.376 "nvme_io": true 00:13:36.376 }, 00:13:36.376 "driver_specific": { 00:13:36.376 "nvme": [ 00:13:36.376 { 00:13:36.376 "trid": { 00:13:36.376 "trtype": "TCP", 00:13:36.376 "adrfam": "IPv4", 00:13:36.376 "traddr": "10.0.0.2", 00:13:36.376 "trsvcid": "4420", 00:13:36.376 "subnqn": "nqn.2016-06.io.spdk:cnode0" 00:13:36.376 }, 00:13:36.376 "ctrlr_data": { 00:13:36.376 "cntlid": 1, 00:13:36.376 "vendor_id": "0x8086", 00:13:36.376 "model_number": "SPDK bdev Controller", 00:13:36.376 "serial_number": "SPDK0", 00:13:36.376 "firmware_revision": "24.01.1", 00:13:36.376 "subnqn": "nqn.2016-06.io.spdk:cnode0", 00:13:36.376 "oacs": { 00:13:36.376 "security": 0, 00:13:36.376 "format": 0, 00:13:36.376 "firmware": 0, 00:13:36.376 "ns_manage": 0 00:13:36.376 }, 00:13:36.376 "multi_ctrlr": true, 00:13:36.376 "ana_reporting": false 00:13:36.376 }, 00:13:36.376 "vs": { 00:13:36.376 "nvme_version": "1.3" 00:13:36.376 }, 00:13:36.376 "ns_data": { 00:13:36.376 "id": 1, 00:13:36.376 "can_share": true 00:13:36.376 } 00:13:36.376 } 00:13:36.376 ], 00:13:36.376 "mp_policy": "active_passive" 00:13:36.376 } 00:13:36.376 } 00:13:36.376 ] 00:13:36.376 22:51:27 -- target/nvmf_lvs_grow.sh@56 -- # run_test_pid=254906 00:13:36.376 22:51:27 -- target/nvmf_lvs_grow.sh@55 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bdevperf.sock perform_tests 00:13:36.376 22:51:27 -- target/nvmf_lvs_grow.sh@57 -- # sleep 2 00:13:36.376 Running I/O for 10 seconds... 00:13:37.751 Latency(us) 00:13:37.751 Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:13:37.751 Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:13:37.751 Nvme0n1 : 1.00 13952.00 54.50 0.00 0.00 0.00 0.00 0.00 00:13:37.751 =================================================================================================================== 00:13:37.751 Total : 13952.00 54.50 0.00 0.00 0.00 0.00 0.00 00:13:37.751 00:13:38.319 22:51:29 -- target/nvmf_lvs_grow.sh@60 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_grow_lvstore -u b4364e8c-8bc9-4778-a9d4-597457c85d2f 00:13:38.578 Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:13:38.578 Nvme0n1 : 2.00 14112.50 55.13 0.00 0.00 0.00 0.00 0.00 00:13:38.578 =================================================================================================================== 00:13:38.578 Total : 14112.50 55.13 0.00 0.00 0.00 0.00 0.00 00:13:38.578 00:13:38.578 true 00:13:38.578 22:51:29 -- target/nvmf_lvs_grow.sh@61 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u b4364e8c-8bc9-4778-a9d4-597457c85d2f 00:13:38.578 22:51:29 -- target/nvmf_lvs_grow.sh@61 -- # jq -r '.[0].total_data_clusters' 00:13:38.836 22:51:29 -- target/nvmf_lvs_grow.sh@61 -- # data_clusters=99 00:13:38.836 22:51:29 -- target/nvmf_lvs_grow.sh@62 -- # (( data_clusters == 99 )) 00:13:38.836 22:51:29 -- target/nvmf_lvs_grow.sh@65 -- # wait 254906 00:13:39.401 Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:13:39.401 Nvme0n1 : 3.00 14187.00 55.42 0.00 0.00 0.00 0.00 0.00 00:13:39.402 =================================================================================================================== 00:13:39.402 Total : 14187.00 55.42 0.00 0.00 0.00 0.00 0.00 00:13:39.402 00:13:40.336 Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:13:40.336 Nvme0n1 : 4.00 14288.00 55.81 0.00 0.00 0.00 0.00 0.00 00:13:40.336 =================================================================================================================== 00:13:40.336 Total : 14288.00 55.81 0.00 0.00 0.00 0.00 0.00 00:13:40.336 00:13:41.712 Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:13:41.712 Nvme0n1 : 5.00 14374.40 56.15 0.00 0.00 0.00 0.00 0.00 00:13:41.712 =================================================================================================================== 00:13:41.712 Total : 14374.40 56.15 0.00 0.00 0.00 0.00 0.00 00:13:41.712 00:13:42.676 Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:13:42.676 Nvme0n1 : 6.00 14431.83 56.37 0.00 0.00 0.00 0.00 0.00 00:13:42.676 =================================================================================================================== 00:13:42.676 Total : 14431.83 56.37 0.00 0.00 0.00 0.00 0.00 00:13:42.676 00:13:43.611 Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:13:43.611 Nvme0n1 : 7.00 14472.86 56.53 0.00 0.00 0.00 0.00 0.00 00:13:43.611 =================================================================================================================== 00:13:43.611 Total : 14472.86 56.53 0.00 0.00 0.00 0.00 0.00 00:13:43.611 00:13:44.545 Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:13:44.545 Nvme0n1 : 8.00 14511.62 56.69 0.00 0.00 0.00 0.00 0.00 00:13:44.546 =================================================================================================================== 00:13:44.546 Total : 14511.62 56.69 0.00 0.00 0.00 0.00 0.00 00:13:44.546 00:13:45.477 Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:13:45.477 Nvme0n1 : 9.00 14548.78 56.83 0.00 0.00 0.00 0.00 0.00 00:13:45.477 =================================================================================================================== 00:13:45.477 Total : 14548.78 56.83 0.00 0.00 0.00 0.00 0.00 00:13:45.477 00:13:46.410 Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:13:46.410 Nvme0n1 : 10.00 14566.00 56.90 0.00 0.00 0.00 0.00 0.00 00:13:46.410 =================================================================================================================== 00:13:46.410 Total : 14566.00 56.90 0.00 0.00 0.00 0.00 0.00 00:13:46.410 00:13:46.410 00:13:46.410 Latency(us) 00:13:46.410 Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:13:46.410 Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:13:46.410 Nvme0n1 : 10.00 14572.09 56.92 0.00 0.00 8779.17 5000.15 19223.89 00:13:46.410 =================================================================================================================== 00:13:46.410 Total : 14572.09 56.92 0.00 0.00 8779.17 5000.15 19223.89 00:13:46.410 0 00:13:46.410 22:51:37 -- target/nvmf_lvs_grow.sh@66 -- # killprocess 254752 00:13:46.410 22:51:37 -- common/autotest_common.sh@926 -- # '[' -z 254752 ']' 00:13:46.410 22:51:37 -- common/autotest_common.sh@930 -- # kill -0 254752 00:13:46.410 22:51:37 -- common/autotest_common.sh@931 -- # uname 00:13:46.410 22:51:37 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:13:46.410 22:51:37 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 254752 00:13:46.410 22:51:37 -- common/autotest_common.sh@932 -- # process_name=reactor_1 00:13:46.410 22:51:37 -- common/autotest_common.sh@936 -- # '[' reactor_1 = sudo ']' 00:13:46.410 22:51:37 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 254752' 00:13:46.410 killing process with pid 254752 00:13:46.410 22:51:37 -- common/autotest_common.sh@945 -- # kill 254752 00:13:46.410 Received shutdown signal, test time was about 10.000000 seconds 00:13:46.410 00:13:46.410 Latency(us) 00:13:46.410 Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:13:46.411 =================================================================================================================== 00:13:46.411 Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:13:46.411 22:51:37 -- common/autotest_common.sh@950 -- # wait 254752 00:13:46.668 22:51:37 -- target/nvmf_lvs_grow.sh@68 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode0 00:13:46.924 22:51:38 -- target/nvmf_lvs_grow.sh@69 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u b4364e8c-8bc9-4778-a9d4-597457c85d2f 00:13:46.924 22:51:38 -- target/nvmf_lvs_grow.sh@69 -- # jq -r '.[0].free_clusters' 00:13:47.180 22:51:38 -- target/nvmf_lvs_grow.sh@69 -- # free_clusters=61 00:13:47.180 22:51:38 -- target/nvmf_lvs_grow.sh@71 -- # [[ '' == \d\i\r\t\y ]] 00:13:47.180 22:51:38 -- target/nvmf_lvs_grow.sh@83 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_aio_delete aio_bdev 00:13:47.436 [2024-04-16 22:51:38.533041] vbdev_lvol.c: 150:vbdev_lvs_hotremove_cb: *NOTICE*: bdev aio_bdev being removed: closing lvstore lvs 00:13:47.694 22:51:38 -- target/nvmf_lvs_grow.sh@84 -- # NOT /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u b4364e8c-8bc9-4778-a9d4-597457c85d2f 00:13:47.694 22:51:38 -- common/autotest_common.sh@640 -- # local es=0 00:13:47.694 22:51:38 -- common/autotest_common.sh@642 -- # valid_exec_arg /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u b4364e8c-8bc9-4778-a9d4-597457c85d2f 00:13:47.694 22:51:38 -- common/autotest_common.sh@628 -- # local arg=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:13:47.694 22:51:38 -- common/autotest_common.sh@632 -- # case "$(type -t "$arg")" in 00:13:47.694 22:51:38 -- common/autotest_common.sh@632 -- # type -t /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:13:47.694 22:51:38 -- common/autotest_common.sh@632 -- # case "$(type -t "$arg")" in 00:13:47.694 22:51:38 -- common/autotest_common.sh@634 -- # type -P /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:13:47.694 22:51:38 -- common/autotest_common.sh@632 -- # case "$(type -t "$arg")" in 00:13:47.694 22:51:38 -- common/autotest_common.sh@634 -- # arg=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:13:47.694 22:51:38 -- common/autotest_common.sh@634 -- # [[ -x /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py ]] 00:13:47.694 22:51:38 -- common/autotest_common.sh@643 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u b4364e8c-8bc9-4778-a9d4-597457c85d2f 00:13:47.694 request: 00:13:47.694 { 00:13:47.694 "uuid": "b4364e8c-8bc9-4778-a9d4-597457c85d2f", 00:13:47.694 "method": "bdev_lvol_get_lvstores", 00:13:47.694 "req_id": 1 00:13:47.694 } 00:13:47.694 Got JSON-RPC error response 00:13:47.694 response: 00:13:47.694 { 00:13:47.694 "code": -19, 00:13:47.694 "message": "No such device" 00:13:47.694 } 00:13:47.694 22:51:38 -- common/autotest_common.sh@643 -- # es=1 00:13:47.694 22:51:38 -- common/autotest_common.sh@651 -- # (( es > 128 )) 00:13:47.694 22:51:38 -- common/autotest_common.sh@662 -- # [[ -n '' ]] 00:13:47.694 22:51:38 -- common/autotest_common.sh@667 -- # (( !es == 0 )) 00:13:47.694 22:51:38 -- target/nvmf_lvs_grow.sh@85 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_aio_create /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/aio_bdev aio_bdev 4096 00:13:47.951 aio_bdev 00:13:48.208 22:51:39 -- target/nvmf_lvs_grow.sh@86 -- # waitforbdev 19db6c03-20e2-40b8-9eb1-7274a0fa6fcd 00:13:48.208 22:51:39 -- common/autotest_common.sh@887 -- # local bdev_name=19db6c03-20e2-40b8-9eb1-7274a0fa6fcd 00:13:48.208 22:51:39 -- common/autotest_common.sh@888 -- # local bdev_timeout= 00:13:48.208 22:51:39 -- common/autotest_common.sh@889 -- # local i 00:13:48.208 22:51:39 -- common/autotest_common.sh@890 -- # [[ -z '' ]] 00:13:48.208 22:51:39 -- common/autotest_common.sh@890 -- # bdev_timeout=2000 00:13:48.208 22:51:39 -- common/autotest_common.sh@892 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_wait_for_examine 00:13:48.466 22:51:39 -- common/autotest_common.sh@894 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_get_bdevs -b 19db6c03-20e2-40b8-9eb1-7274a0fa6fcd -t 2000 00:13:48.725 [ 00:13:48.725 { 00:13:48.725 "name": "19db6c03-20e2-40b8-9eb1-7274a0fa6fcd", 00:13:48.725 "aliases": [ 00:13:48.725 "lvs/lvol" 00:13:48.725 ], 00:13:48.725 "product_name": "Logical Volume", 00:13:48.725 "block_size": 4096, 00:13:48.725 "num_blocks": 38912, 00:13:48.725 "uuid": "19db6c03-20e2-40b8-9eb1-7274a0fa6fcd", 00:13:48.725 "assigned_rate_limits": { 00:13:48.725 "rw_ios_per_sec": 0, 00:13:48.725 "rw_mbytes_per_sec": 0, 00:13:48.725 "r_mbytes_per_sec": 0, 00:13:48.725 "w_mbytes_per_sec": 0 00:13:48.725 }, 00:13:48.725 "claimed": false, 00:13:48.725 "zoned": false, 00:13:48.725 "supported_io_types": { 00:13:48.725 "read": true, 00:13:48.725 "write": true, 00:13:48.725 "unmap": true, 00:13:48.725 "write_zeroes": true, 00:13:48.725 "flush": false, 00:13:48.725 "reset": true, 00:13:48.725 "compare": false, 00:13:48.725 "compare_and_write": false, 00:13:48.725 "abort": false, 00:13:48.725 "nvme_admin": false, 00:13:48.725 "nvme_io": false 00:13:48.725 }, 00:13:48.725 "driver_specific": { 00:13:48.725 "lvol": { 00:13:48.725 "lvol_store_uuid": "b4364e8c-8bc9-4778-a9d4-597457c85d2f", 00:13:48.725 "base_bdev": "aio_bdev", 00:13:48.725 "thin_provision": false, 00:13:48.725 "snapshot": false, 00:13:48.725 "clone": false, 00:13:48.725 "esnap_clone": false 00:13:48.725 } 00:13:48.725 } 00:13:48.725 } 00:13:48.725 ] 00:13:48.725 22:51:39 -- common/autotest_common.sh@895 -- # return 0 00:13:48.725 22:51:39 -- target/nvmf_lvs_grow.sh@87 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u b4364e8c-8bc9-4778-a9d4-597457c85d2f 00:13:48.725 22:51:39 -- target/nvmf_lvs_grow.sh@87 -- # jq -r '.[0].free_clusters' 00:13:48.983 22:51:39 -- target/nvmf_lvs_grow.sh@87 -- # (( free_clusters == 61 )) 00:13:48.983 22:51:39 -- target/nvmf_lvs_grow.sh@88 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u b4364e8c-8bc9-4778-a9d4-597457c85d2f 00:13:48.983 22:51:39 -- target/nvmf_lvs_grow.sh@88 -- # jq -r '.[0].total_data_clusters' 00:13:49.241 22:51:40 -- target/nvmf_lvs_grow.sh@88 -- # (( data_clusters == 99 )) 00:13:49.241 22:51:40 -- target/nvmf_lvs_grow.sh@91 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_delete 19db6c03-20e2-40b8-9eb1-7274a0fa6fcd 00:13:49.499 22:51:40 -- target/nvmf_lvs_grow.sh@92 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_delete_lvstore -u b4364e8c-8bc9-4778-a9d4-597457c85d2f 00:13:49.757 22:51:40 -- target/nvmf_lvs_grow.sh@93 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_aio_delete aio_bdev 00:13:50.015 22:51:40 -- target/nvmf_lvs_grow.sh@94 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/aio_bdev 00:13:50.015 00:13:50.015 real 0m17.718s 00:13:50.015 user 0m17.358s 00:13:50.015 sys 0m1.863s 00:13:50.015 22:51:40 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:13:50.015 22:51:40 -- common/autotest_common.sh@10 -- # set +x 00:13:50.015 ************************************ 00:13:50.015 END TEST lvs_grow_clean 00:13:50.015 ************************************ 00:13:50.015 22:51:40 -- target/nvmf_lvs_grow.sh@102 -- # run_test lvs_grow_dirty lvs_grow dirty 00:13:50.015 22:51:40 -- common/autotest_common.sh@1077 -- # '[' 3 -le 1 ']' 00:13:50.015 22:51:40 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:13:50.015 22:51:40 -- common/autotest_common.sh@10 -- # set +x 00:13:50.015 ************************************ 00:13:50.015 START TEST lvs_grow_dirty 00:13:50.015 ************************************ 00:13:50.015 22:51:41 -- common/autotest_common.sh@1104 -- # lvs_grow dirty 00:13:50.015 22:51:41 -- target/nvmf_lvs_grow.sh@15 -- # local aio_bdev lvs lvol 00:13:50.015 22:51:41 -- target/nvmf_lvs_grow.sh@16 -- # local data_clusters free_clusters 00:13:50.015 22:51:41 -- target/nvmf_lvs_grow.sh@17 -- # local bdevperf_pid run_test_pid 00:13:50.015 22:51:41 -- target/nvmf_lvs_grow.sh@18 -- # local aio_init_size_mb=200 00:13:50.015 22:51:41 -- target/nvmf_lvs_grow.sh@19 -- # local aio_final_size_mb=400 00:13:50.015 22:51:41 -- target/nvmf_lvs_grow.sh@20 -- # local lvol_bdev_size_mb=150 00:13:50.015 22:51:41 -- target/nvmf_lvs_grow.sh@23 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/aio_bdev 00:13:50.015 22:51:41 -- target/nvmf_lvs_grow.sh@24 -- # truncate -s 200M /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/aio_bdev 00:13:50.015 22:51:41 -- target/nvmf_lvs_grow.sh@25 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_aio_create /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/aio_bdev aio_bdev 4096 00:13:50.274 22:51:41 -- target/nvmf_lvs_grow.sh@25 -- # aio_bdev=aio_bdev 00:13:50.274 22:51:41 -- target/nvmf_lvs_grow.sh@28 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_create_lvstore --cluster-sz 4194304 --md-pages-per-cluster-ratio 300 aio_bdev lvs 00:13:50.531 22:51:41 -- target/nvmf_lvs_grow.sh@28 -- # lvs=c1d00be0-ad2b-4c96-9010-ec7ed301102d 00:13:50.531 22:51:41 -- target/nvmf_lvs_grow.sh@29 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u c1d00be0-ad2b-4c96-9010-ec7ed301102d 00:13:50.531 22:51:41 -- target/nvmf_lvs_grow.sh@29 -- # jq -r '.[0].total_data_clusters' 00:13:50.789 22:51:41 -- target/nvmf_lvs_grow.sh@29 -- # data_clusters=49 00:13:50.789 22:51:41 -- target/nvmf_lvs_grow.sh@30 -- # (( data_clusters == 49 )) 00:13:50.789 22:51:41 -- target/nvmf_lvs_grow.sh@33 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_create -u c1d00be0-ad2b-4c96-9010-ec7ed301102d lvol 150 00:13:51.047 22:51:42 -- target/nvmf_lvs_grow.sh@33 -- # lvol=e1dc0e93-6d89-4ec2-8250-181da314947a 00:13:51.047 22:51:42 -- target/nvmf_lvs_grow.sh@36 -- # truncate -s 400M /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/aio_bdev 00:13:51.047 22:51:42 -- target/nvmf_lvs_grow.sh@37 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_aio_rescan aio_bdev 00:13:51.305 [2024-04-16 22:51:42.267463] bdev_aio.c: 959:bdev_aio_rescan: *NOTICE*: AIO device is resized: bdev name /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/aio_bdev, old block count 51200, new block count 102400 00:13:51.305 [2024-04-16 22:51:42.267568] vbdev_lvol.c: 165:vbdev_lvs_base_bdev_event_cb: *NOTICE*: Unsupported bdev event: type 1 00:13:51.305 true 00:13:51.305 22:51:42 -- target/nvmf_lvs_grow.sh@38 -- # jq -r '.[0].total_data_clusters' 00:13:51.305 22:51:42 -- target/nvmf_lvs_grow.sh@38 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u c1d00be0-ad2b-4c96-9010-ec7ed301102d 00:13:51.563 22:51:42 -- target/nvmf_lvs_grow.sh@38 -- # (( data_clusters == 49 )) 00:13:51.563 22:51:42 -- target/nvmf_lvs_grow.sh@41 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode0 -a -s SPDK0 00:13:51.821 22:51:42 -- target/nvmf_lvs_grow.sh@42 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode0 e1dc0e93-6d89-4ec2-8250-181da314947a 00:13:52.079 22:51:43 -- target/nvmf_lvs_grow.sh@43 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode0 -t tcp -a 10.0.0.2 -s 4420 00:13:52.338 22:51:43 -- target/nvmf_lvs_grow.sh@44 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener discovery -t tcp -a 10.0.0.2 -s 4420 00:13:52.596 22:51:43 -- target/nvmf_lvs_grow.sh@48 -- # bdevperf_pid=256929 00:13:52.596 22:51:43 -- target/nvmf_lvs_grow.sh@47 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -r /var/tmp/bdevperf.sock -m 0x2 -o 4096 -q 128 -w randwrite -t 10 -S 1 -z 00:13:52.596 22:51:43 -- target/nvmf_lvs_grow.sh@49 -- # trap 'killprocess $bdevperf_pid; nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:13:52.596 22:51:43 -- target/nvmf_lvs_grow.sh@50 -- # waitforlisten 256929 /var/tmp/bdevperf.sock 00:13:52.596 22:51:43 -- common/autotest_common.sh@819 -- # '[' -z 256929 ']' 00:13:52.596 22:51:43 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:13:52.596 22:51:43 -- common/autotest_common.sh@824 -- # local max_retries=100 00:13:52.596 22:51:43 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:13:52.596 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:13:52.596 22:51:43 -- common/autotest_common.sh@828 -- # xtrace_disable 00:13:52.596 22:51:43 -- common/autotest_common.sh@10 -- # set +x 00:13:52.596 [2024-04-16 22:51:43.594810] Starting SPDK v24.01.1-pre git sha1 4b134b4ab / DPDK 23.11.0 initialization... 00:13:52.596 [2024-04-16 22:51:43.594905] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x2 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid256929 ] 00:13:52.596 EAL: No free 2048 kB hugepages reported on node 1 00:13:52.596 [2024-04-16 22:51:43.658909] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:13:52.854 [2024-04-16 22:51:43.773095] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:13:53.788 22:51:44 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:13:53.788 22:51:44 -- common/autotest_common.sh@852 -- # return 0 00:13:53.788 22:51:44 -- target/nvmf_lvs_grow.sh@52 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b Nvme0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode0 00:13:54.045 Nvme0n1 00:13:54.045 22:51:44 -- target/nvmf_lvs_grow.sh@53 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_get_bdevs -b Nvme0n1 -t 3000 00:13:54.303 [ 00:13:54.303 { 00:13:54.303 "name": "Nvme0n1", 00:13:54.303 "aliases": [ 00:13:54.303 "e1dc0e93-6d89-4ec2-8250-181da314947a" 00:13:54.303 ], 00:13:54.303 "product_name": "NVMe disk", 00:13:54.303 "block_size": 4096, 00:13:54.303 "num_blocks": 38912, 00:13:54.303 "uuid": "e1dc0e93-6d89-4ec2-8250-181da314947a", 00:13:54.303 "assigned_rate_limits": { 00:13:54.303 "rw_ios_per_sec": 0, 00:13:54.303 "rw_mbytes_per_sec": 0, 00:13:54.303 "r_mbytes_per_sec": 0, 00:13:54.303 "w_mbytes_per_sec": 0 00:13:54.303 }, 00:13:54.303 "claimed": false, 00:13:54.303 "zoned": false, 00:13:54.303 "supported_io_types": { 00:13:54.303 "read": true, 00:13:54.303 "write": true, 00:13:54.303 "unmap": true, 00:13:54.303 "write_zeroes": true, 00:13:54.303 "flush": true, 00:13:54.303 "reset": true, 00:13:54.303 "compare": true, 00:13:54.303 "compare_and_write": true, 00:13:54.303 "abort": true, 00:13:54.303 "nvme_admin": true, 00:13:54.303 "nvme_io": true 00:13:54.303 }, 00:13:54.303 "driver_specific": { 00:13:54.303 "nvme": [ 00:13:54.303 { 00:13:54.303 "trid": { 00:13:54.303 "trtype": "TCP", 00:13:54.303 "adrfam": "IPv4", 00:13:54.303 "traddr": "10.0.0.2", 00:13:54.303 "trsvcid": "4420", 00:13:54.303 "subnqn": "nqn.2016-06.io.spdk:cnode0" 00:13:54.303 }, 00:13:54.303 "ctrlr_data": { 00:13:54.303 "cntlid": 1, 00:13:54.303 "vendor_id": "0x8086", 00:13:54.303 "model_number": "SPDK bdev Controller", 00:13:54.303 "serial_number": "SPDK0", 00:13:54.303 "firmware_revision": "24.01.1", 00:13:54.303 "subnqn": "nqn.2016-06.io.spdk:cnode0", 00:13:54.303 "oacs": { 00:13:54.303 "security": 0, 00:13:54.303 "format": 0, 00:13:54.303 "firmware": 0, 00:13:54.304 "ns_manage": 0 00:13:54.304 }, 00:13:54.304 "multi_ctrlr": true, 00:13:54.304 "ana_reporting": false 00:13:54.304 }, 00:13:54.304 "vs": { 00:13:54.304 "nvme_version": "1.3" 00:13:54.304 }, 00:13:54.304 "ns_data": { 00:13:54.304 "id": 1, 00:13:54.304 "can_share": true 00:13:54.304 } 00:13:54.304 } 00:13:54.304 ], 00:13:54.304 "mp_policy": "active_passive" 00:13:54.304 } 00:13:54.304 } 00:13:54.304 ] 00:13:54.304 22:51:45 -- target/nvmf_lvs_grow.sh@56 -- # run_test_pid=257147 00:13:54.304 22:51:45 -- target/nvmf_lvs_grow.sh@57 -- # sleep 2 00:13:54.304 22:51:45 -- target/nvmf_lvs_grow.sh@55 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bdevperf.sock perform_tests 00:13:54.304 Running I/O for 10 seconds... 00:13:55.235 Latency(us) 00:13:55.235 Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:13:55.235 Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:13:55.235 Nvme0n1 : 1.00 13402.00 52.35 0.00 0.00 0.00 0.00 0.00 00:13:55.235 =================================================================================================================== 00:13:55.235 Total : 13402.00 52.35 0.00 0.00 0.00 0.00 0.00 00:13:55.235 00:13:56.169 22:51:47 -- target/nvmf_lvs_grow.sh@60 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_grow_lvstore -u c1d00be0-ad2b-4c96-9010-ec7ed301102d 00:13:56.427 Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:13:56.427 Nvme0n1 : 2.00 13573.00 53.02 0.00 0.00 0.00 0.00 0.00 00:13:56.427 =================================================================================================================== 00:13:56.427 Total : 13573.00 53.02 0.00 0.00 0.00 0.00 0.00 00:13:56.427 00:13:56.427 true 00:13:56.427 22:51:47 -- target/nvmf_lvs_grow.sh@61 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u c1d00be0-ad2b-4c96-9010-ec7ed301102d 00:13:56.427 22:51:47 -- target/nvmf_lvs_grow.sh@61 -- # jq -r '.[0].total_data_clusters' 00:13:56.685 22:51:47 -- target/nvmf_lvs_grow.sh@61 -- # data_clusters=99 00:13:56.685 22:51:47 -- target/nvmf_lvs_grow.sh@62 -- # (( data_clusters == 99 )) 00:13:56.686 22:51:47 -- target/nvmf_lvs_grow.sh@65 -- # wait 257147 00:13:57.252 Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:13:57.252 Nvme0n1 : 3.00 13656.67 53.35 0.00 0.00 0.00 0.00 0.00 00:13:57.252 =================================================================================================================== 00:13:57.252 Total : 13656.67 53.35 0.00 0.00 0.00 0.00 0.00 00:13:57.252 00:13:58.627 Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:13:58.627 Nvme0n1 : 4.00 13730.50 53.63 0.00 0.00 0.00 0.00 0.00 00:13:58.627 =================================================================================================================== 00:13:58.627 Total : 13730.50 53.63 0.00 0.00 0.00 0.00 0.00 00:13:58.627 00:13:59.560 Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:13:59.560 Nvme0n1 : 5.00 13773.20 53.80 0.00 0.00 0.00 0.00 0.00 00:13:59.560 =================================================================================================================== 00:13:59.560 Total : 13773.20 53.80 0.00 0.00 0.00 0.00 0.00 00:13:59.560 00:14:00.523 Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:14:00.523 Nvme0n1 : 6.00 13819.00 53.98 0.00 0.00 0.00 0.00 0.00 00:14:00.523 =================================================================================================================== 00:14:00.523 Total : 13819.00 53.98 0.00 0.00 0.00 0.00 0.00 00:14:00.523 00:14:01.458 Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:14:01.458 Nvme0n1 : 7.00 13862.00 54.15 0.00 0.00 0.00 0.00 0.00 00:14:01.458 =================================================================================================================== 00:14:01.458 Total : 13862.00 54.15 0.00 0.00 0.00 0.00 0.00 00:14:01.458 00:14:02.391 Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:14:02.392 Nvme0n1 : 8.00 13895.25 54.28 0.00 0.00 0.00 0.00 0.00 00:14:02.392 =================================================================================================================== 00:14:02.392 Total : 13895.25 54.28 0.00 0.00 0.00 0.00 0.00 00:14:02.392 00:14:03.324 Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:14:03.324 Nvme0n1 : 9.00 13922.89 54.39 0.00 0.00 0.00 0.00 0.00 00:14:03.324 =================================================================================================================== 00:14:03.324 Total : 13922.89 54.39 0.00 0.00 0.00 0.00 0.00 00:14:03.324 00:14:04.258 Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:14:04.258 Nvme0n1 : 10.00 13948.20 54.49 0.00 0.00 0.00 0.00 0.00 00:14:04.258 =================================================================================================================== 00:14:04.258 Total : 13948.20 54.49 0.00 0.00 0.00 0.00 0.00 00:14:04.258 00:14:04.258 00:14:04.258 Latency(us) 00:14:04.258 Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:14:04.258 Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:14:04.258 Nvme0n1 : 10.01 13947.79 54.48 0.00 0.00 9168.94 7330.32 18350.08 00:14:04.258 =================================================================================================================== 00:14:04.258 Total : 13947.79 54.48 0.00 0.00 9168.94 7330.32 18350.08 00:14:04.258 0 00:14:04.258 22:51:55 -- target/nvmf_lvs_grow.sh@66 -- # killprocess 256929 00:14:04.258 22:51:55 -- common/autotest_common.sh@926 -- # '[' -z 256929 ']' 00:14:04.258 22:51:55 -- common/autotest_common.sh@930 -- # kill -0 256929 00:14:04.258 22:51:55 -- common/autotest_common.sh@931 -- # uname 00:14:04.258 22:51:55 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:14:04.258 22:51:55 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 256929 00:14:04.516 22:51:55 -- common/autotest_common.sh@932 -- # process_name=reactor_1 00:14:04.516 22:51:55 -- common/autotest_common.sh@936 -- # '[' reactor_1 = sudo ']' 00:14:04.516 22:51:55 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 256929' 00:14:04.516 killing process with pid 256929 00:14:04.516 22:51:55 -- common/autotest_common.sh@945 -- # kill 256929 00:14:04.516 Received shutdown signal, test time was about 10.000000 seconds 00:14:04.516 00:14:04.516 Latency(us) 00:14:04.516 Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:14:04.516 =================================================================================================================== 00:14:04.516 Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:14:04.516 22:51:55 -- common/autotest_common.sh@950 -- # wait 256929 00:14:04.773 22:51:55 -- target/nvmf_lvs_grow.sh@68 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode0 00:14:05.031 22:51:55 -- target/nvmf_lvs_grow.sh@69 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u c1d00be0-ad2b-4c96-9010-ec7ed301102d 00:14:05.031 22:51:55 -- target/nvmf_lvs_grow.sh@69 -- # jq -r '.[0].free_clusters' 00:14:05.289 22:51:56 -- target/nvmf_lvs_grow.sh@69 -- # free_clusters=61 00:14:05.289 22:51:56 -- target/nvmf_lvs_grow.sh@71 -- # [[ dirty == \d\i\r\t\y ]] 00:14:05.289 22:51:56 -- target/nvmf_lvs_grow.sh@73 -- # kill -9 254201 00:14:05.289 22:51:56 -- target/nvmf_lvs_grow.sh@74 -- # wait 254201 00:14:05.289 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/nvmf_lvs_grow.sh: line 74: 254201 Killed "${NVMF_APP[@]}" "$@" 00:14:05.289 22:51:56 -- target/nvmf_lvs_grow.sh@74 -- # true 00:14:05.289 22:51:56 -- target/nvmf_lvs_grow.sh@75 -- # nvmfappstart -m 0x1 00:14:05.289 22:51:56 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:14:05.289 22:51:56 -- common/autotest_common.sh@712 -- # xtrace_disable 00:14:05.289 22:51:56 -- common/autotest_common.sh@10 -- # set +x 00:14:05.289 22:51:56 -- nvmf/common.sh@469 -- # nvmfpid=258512 00:14:05.289 22:51:56 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x1 00:14:05.289 22:51:56 -- nvmf/common.sh@470 -- # waitforlisten 258512 00:14:05.289 22:51:56 -- common/autotest_common.sh@819 -- # '[' -z 258512 ']' 00:14:05.289 22:51:56 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk.sock 00:14:05.289 22:51:56 -- common/autotest_common.sh@824 -- # local max_retries=100 00:14:05.289 22:51:56 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:14:05.289 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:14:05.289 22:51:56 -- common/autotest_common.sh@828 -- # xtrace_disable 00:14:05.289 22:51:56 -- common/autotest_common.sh@10 -- # set +x 00:14:05.289 [2024-04-16 22:51:56.314450] Starting SPDK v24.01.1-pre git sha1 4b134b4ab / DPDK 23.11.0 initialization... 00:14:05.289 [2024-04-16 22:51:56.314526] [ DPDK EAL parameters: nvmf -c 0x1 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:14:05.289 EAL: No free 2048 kB hugepages reported on node 1 00:14:05.289 [2024-04-16 22:51:56.384165] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:14:05.548 [2024-04-16 22:51:56.499548] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:14:05.548 [2024-04-16 22:51:56.499701] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:14:05.548 [2024-04-16 22:51:56.499721] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:14:05.548 [2024-04-16 22:51:56.499744] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:14:05.548 [2024-04-16 22:51:56.499780] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:14:06.482 22:51:57 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:14:06.482 22:51:57 -- common/autotest_common.sh@852 -- # return 0 00:14:06.482 22:51:57 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:14:06.482 22:51:57 -- common/autotest_common.sh@718 -- # xtrace_disable 00:14:06.482 22:51:57 -- common/autotest_common.sh@10 -- # set +x 00:14:06.482 22:51:57 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:14:06.482 22:51:57 -- target/nvmf_lvs_grow.sh@76 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_aio_create /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/aio_bdev aio_bdev 4096 00:14:06.482 [2024-04-16 22:51:57.579698] blobstore.c:4642:bs_recover: *NOTICE*: Performing recovery on blobstore 00:14:06.482 [2024-04-16 22:51:57.579836] blobstore.c:4589:bs_load_replay_md_cpl: *NOTICE*: Recover: blob 0x0 00:14:06.482 [2024-04-16 22:51:57.579893] blobstore.c:4589:bs_load_replay_md_cpl: *NOTICE*: Recover: blob 0x1 00:14:06.482 22:51:57 -- target/nvmf_lvs_grow.sh@76 -- # aio_bdev=aio_bdev 00:14:06.482 22:51:57 -- target/nvmf_lvs_grow.sh@77 -- # waitforbdev e1dc0e93-6d89-4ec2-8250-181da314947a 00:14:06.482 22:51:57 -- common/autotest_common.sh@887 -- # local bdev_name=e1dc0e93-6d89-4ec2-8250-181da314947a 00:14:06.482 22:51:57 -- common/autotest_common.sh@888 -- # local bdev_timeout= 00:14:06.482 22:51:57 -- common/autotest_common.sh@889 -- # local i 00:14:06.482 22:51:57 -- common/autotest_common.sh@890 -- # [[ -z '' ]] 00:14:06.482 22:51:57 -- common/autotest_common.sh@890 -- # bdev_timeout=2000 00:14:06.482 22:51:57 -- common/autotest_common.sh@892 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_wait_for_examine 00:14:06.740 22:51:57 -- common/autotest_common.sh@894 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_get_bdevs -b e1dc0e93-6d89-4ec2-8250-181da314947a -t 2000 00:14:06.997 [ 00:14:06.997 { 00:14:06.997 "name": "e1dc0e93-6d89-4ec2-8250-181da314947a", 00:14:06.998 "aliases": [ 00:14:06.998 "lvs/lvol" 00:14:06.998 ], 00:14:06.998 "product_name": "Logical Volume", 00:14:06.998 "block_size": 4096, 00:14:06.998 "num_blocks": 38912, 00:14:06.998 "uuid": "e1dc0e93-6d89-4ec2-8250-181da314947a", 00:14:06.998 "assigned_rate_limits": { 00:14:06.998 "rw_ios_per_sec": 0, 00:14:06.998 "rw_mbytes_per_sec": 0, 00:14:06.998 "r_mbytes_per_sec": 0, 00:14:06.998 "w_mbytes_per_sec": 0 00:14:06.998 }, 00:14:06.998 "claimed": false, 00:14:06.998 "zoned": false, 00:14:06.998 "supported_io_types": { 00:14:06.998 "read": true, 00:14:06.998 "write": true, 00:14:06.998 "unmap": true, 00:14:06.998 "write_zeroes": true, 00:14:06.998 "flush": false, 00:14:06.998 "reset": true, 00:14:06.998 "compare": false, 00:14:06.998 "compare_and_write": false, 00:14:06.998 "abort": false, 00:14:06.998 "nvme_admin": false, 00:14:06.998 "nvme_io": false 00:14:06.998 }, 00:14:06.998 "driver_specific": { 00:14:06.998 "lvol": { 00:14:06.998 "lvol_store_uuid": "c1d00be0-ad2b-4c96-9010-ec7ed301102d", 00:14:06.998 "base_bdev": "aio_bdev", 00:14:06.998 "thin_provision": false, 00:14:06.998 "snapshot": false, 00:14:06.998 "clone": false, 00:14:06.998 "esnap_clone": false 00:14:06.998 } 00:14:06.998 } 00:14:06.998 } 00:14:06.998 ] 00:14:06.998 22:51:58 -- common/autotest_common.sh@895 -- # return 0 00:14:06.998 22:51:58 -- target/nvmf_lvs_grow.sh@78 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u c1d00be0-ad2b-4c96-9010-ec7ed301102d 00:14:06.998 22:51:58 -- target/nvmf_lvs_grow.sh@78 -- # jq -r '.[0].free_clusters' 00:14:07.563 22:51:58 -- target/nvmf_lvs_grow.sh@78 -- # (( free_clusters == 61 )) 00:14:07.563 22:51:58 -- target/nvmf_lvs_grow.sh@79 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u c1d00be0-ad2b-4c96-9010-ec7ed301102d 00:14:07.563 22:51:58 -- target/nvmf_lvs_grow.sh@79 -- # jq -r '.[0].total_data_clusters' 00:14:07.563 22:51:58 -- target/nvmf_lvs_grow.sh@79 -- # (( data_clusters == 99 )) 00:14:07.563 22:51:58 -- target/nvmf_lvs_grow.sh@83 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_aio_delete aio_bdev 00:14:07.821 [2024-04-16 22:51:58.888799] vbdev_lvol.c: 150:vbdev_lvs_hotremove_cb: *NOTICE*: bdev aio_bdev being removed: closing lvstore lvs 00:14:07.821 22:51:58 -- target/nvmf_lvs_grow.sh@84 -- # NOT /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u c1d00be0-ad2b-4c96-9010-ec7ed301102d 00:14:07.821 22:51:58 -- common/autotest_common.sh@640 -- # local es=0 00:14:07.821 22:51:58 -- common/autotest_common.sh@642 -- # valid_exec_arg /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u c1d00be0-ad2b-4c96-9010-ec7ed301102d 00:14:07.821 22:51:58 -- common/autotest_common.sh@628 -- # local arg=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:14:07.821 22:51:58 -- common/autotest_common.sh@632 -- # case "$(type -t "$arg")" in 00:14:07.821 22:51:58 -- common/autotest_common.sh@632 -- # type -t /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:14:07.821 22:51:58 -- common/autotest_common.sh@632 -- # case "$(type -t "$arg")" in 00:14:07.821 22:51:58 -- common/autotest_common.sh@634 -- # type -P /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:14:07.821 22:51:58 -- common/autotest_common.sh@632 -- # case "$(type -t "$arg")" in 00:14:07.821 22:51:58 -- common/autotest_common.sh@634 -- # arg=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:14:07.821 22:51:58 -- common/autotest_common.sh@634 -- # [[ -x /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py ]] 00:14:07.821 22:51:58 -- common/autotest_common.sh@643 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u c1d00be0-ad2b-4c96-9010-ec7ed301102d 00:14:08.078 request: 00:14:08.078 { 00:14:08.078 "uuid": "c1d00be0-ad2b-4c96-9010-ec7ed301102d", 00:14:08.078 "method": "bdev_lvol_get_lvstores", 00:14:08.078 "req_id": 1 00:14:08.078 } 00:14:08.078 Got JSON-RPC error response 00:14:08.078 response: 00:14:08.078 { 00:14:08.078 "code": -19, 00:14:08.078 "message": "No such device" 00:14:08.078 } 00:14:08.078 22:51:59 -- common/autotest_common.sh@643 -- # es=1 00:14:08.078 22:51:59 -- common/autotest_common.sh@651 -- # (( es > 128 )) 00:14:08.078 22:51:59 -- common/autotest_common.sh@662 -- # [[ -n '' ]] 00:14:08.078 22:51:59 -- common/autotest_common.sh@667 -- # (( !es == 0 )) 00:14:08.078 22:51:59 -- target/nvmf_lvs_grow.sh@85 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_aio_create /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/aio_bdev aio_bdev 4096 00:14:08.335 aio_bdev 00:14:08.336 22:51:59 -- target/nvmf_lvs_grow.sh@86 -- # waitforbdev e1dc0e93-6d89-4ec2-8250-181da314947a 00:14:08.336 22:51:59 -- common/autotest_common.sh@887 -- # local bdev_name=e1dc0e93-6d89-4ec2-8250-181da314947a 00:14:08.336 22:51:59 -- common/autotest_common.sh@888 -- # local bdev_timeout= 00:14:08.336 22:51:59 -- common/autotest_common.sh@889 -- # local i 00:14:08.336 22:51:59 -- common/autotest_common.sh@890 -- # [[ -z '' ]] 00:14:08.336 22:51:59 -- common/autotest_common.sh@890 -- # bdev_timeout=2000 00:14:08.336 22:51:59 -- common/autotest_common.sh@892 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_wait_for_examine 00:14:08.593 22:51:59 -- common/autotest_common.sh@894 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_get_bdevs -b e1dc0e93-6d89-4ec2-8250-181da314947a -t 2000 00:14:08.850 [ 00:14:08.850 { 00:14:08.850 "name": "e1dc0e93-6d89-4ec2-8250-181da314947a", 00:14:08.850 "aliases": [ 00:14:08.850 "lvs/lvol" 00:14:08.850 ], 00:14:08.850 "product_name": "Logical Volume", 00:14:08.850 "block_size": 4096, 00:14:08.850 "num_blocks": 38912, 00:14:08.850 "uuid": "e1dc0e93-6d89-4ec2-8250-181da314947a", 00:14:08.850 "assigned_rate_limits": { 00:14:08.850 "rw_ios_per_sec": 0, 00:14:08.850 "rw_mbytes_per_sec": 0, 00:14:08.850 "r_mbytes_per_sec": 0, 00:14:08.850 "w_mbytes_per_sec": 0 00:14:08.850 }, 00:14:08.850 "claimed": false, 00:14:08.850 "zoned": false, 00:14:08.850 "supported_io_types": { 00:14:08.850 "read": true, 00:14:08.850 "write": true, 00:14:08.850 "unmap": true, 00:14:08.850 "write_zeroes": true, 00:14:08.850 "flush": false, 00:14:08.850 "reset": true, 00:14:08.850 "compare": false, 00:14:08.850 "compare_and_write": false, 00:14:08.850 "abort": false, 00:14:08.850 "nvme_admin": false, 00:14:08.850 "nvme_io": false 00:14:08.850 }, 00:14:08.850 "driver_specific": { 00:14:08.850 "lvol": { 00:14:08.850 "lvol_store_uuid": "c1d00be0-ad2b-4c96-9010-ec7ed301102d", 00:14:08.850 "base_bdev": "aio_bdev", 00:14:08.850 "thin_provision": false, 00:14:08.850 "snapshot": false, 00:14:08.850 "clone": false, 00:14:08.850 "esnap_clone": false 00:14:08.850 } 00:14:08.850 } 00:14:08.850 } 00:14:08.850 ] 00:14:08.850 22:51:59 -- common/autotest_common.sh@895 -- # return 0 00:14:08.851 22:51:59 -- target/nvmf_lvs_grow.sh@87 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u c1d00be0-ad2b-4c96-9010-ec7ed301102d 00:14:08.851 22:51:59 -- target/nvmf_lvs_grow.sh@87 -- # jq -r '.[0].free_clusters' 00:14:09.108 22:52:00 -- target/nvmf_lvs_grow.sh@87 -- # (( free_clusters == 61 )) 00:14:09.108 22:52:00 -- target/nvmf_lvs_grow.sh@88 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u c1d00be0-ad2b-4c96-9010-ec7ed301102d 00:14:09.108 22:52:00 -- target/nvmf_lvs_grow.sh@88 -- # jq -r '.[0].total_data_clusters' 00:14:09.366 22:52:00 -- target/nvmf_lvs_grow.sh@88 -- # (( data_clusters == 99 )) 00:14:09.366 22:52:00 -- target/nvmf_lvs_grow.sh@91 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_delete e1dc0e93-6d89-4ec2-8250-181da314947a 00:14:09.623 22:52:00 -- target/nvmf_lvs_grow.sh@92 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_delete_lvstore -u c1d00be0-ad2b-4c96-9010-ec7ed301102d 00:14:09.880 22:52:00 -- target/nvmf_lvs_grow.sh@93 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_aio_delete aio_bdev 00:14:10.138 22:52:01 -- target/nvmf_lvs_grow.sh@94 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/aio_bdev 00:14:10.138 00:14:10.138 real 0m20.215s 00:14:10.138 user 0m49.998s 00:14:10.138 sys 0m5.007s 00:14:10.138 22:52:01 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:14:10.138 22:52:01 -- common/autotest_common.sh@10 -- # set +x 00:14:10.138 ************************************ 00:14:10.138 END TEST lvs_grow_dirty 00:14:10.138 ************************************ 00:14:10.138 22:52:01 -- target/nvmf_lvs_grow.sh@1 -- # process_shm --id 0 00:14:10.138 22:52:01 -- common/autotest_common.sh@796 -- # type=--id 00:14:10.138 22:52:01 -- common/autotest_common.sh@797 -- # id=0 00:14:10.138 22:52:01 -- common/autotest_common.sh@798 -- # '[' --id = --pid ']' 00:14:10.138 22:52:01 -- common/autotest_common.sh@802 -- # find /dev/shm -name '*.0' -printf '%f\n' 00:14:10.138 22:52:01 -- common/autotest_common.sh@802 -- # shm_files=nvmf_trace.0 00:14:10.138 22:52:01 -- common/autotest_common.sh@804 -- # [[ -z nvmf_trace.0 ]] 00:14:10.138 22:52:01 -- common/autotest_common.sh@808 -- # for n in $shm_files 00:14:10.138 22:52:01 -- common/autotest_common.sh@809 -- # tar -C /dev/shm/ -cvzf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/nvmf_trace.0_shm.tar.gz nvmf_trace.0 00:14:10.138 nvmf_trace.0 00:14:10.138 22:52:01 -- common/autotest_common.sh@811 -- # return 0 00:14:10.138 22:52:01 -- target/nvmf_lvs_grow.sh@1 -- # nvmftestfini 00:14:10.138 22:52:01 -- nvmf/common.sh@476 -- # nvmfcleanup 00:14:10.138 22:52:01 -- nvmf/common.sh@116 -- # sync 00:14:10.396 22:52:01 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:14:10.396 22:52:01 -- nvmf/common.sh@119 -- # set +e 00:14:10.396 22:52:01 -- nvmf/common.sh@120 -- # for i in {1..20} 00:14:10.396 22:52:01 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:14:10.396 rmmod nvme_tcp 00:14:10.396 rmmod nvme_fabrics 00:14:10.396 rmmod nvme_keyring 00:14:10.396 22:52:01 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:14:10.396 22:52:01 -- nvmf/common.sh@123 -- # set -e 00:14:10.396 22:52:01 -- nvmf/common.sh@124 -- # return 0 00:14:10.396 22:52:01 -- nvmf/common.sh@477 -- # '[' -n 258512 ']' 00:14:10.396 22:52:01 -- nvmf/common.sh@478 -- # killprocess 258512 00:14:10.396 22:52:01 -- common/autotest_common.sh@926 -- # '[' -z 258512 ']' 00:14:10.396 22:52:01 -- common/autotest_common.sh@930 -- # kill -0 258512 00:14:10.396 22:52:01 -- common/autotest_common.sh@931 -- # uname 00:14:10.396 22:52:01 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:14:10.396 22:52:01 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 258512 00:14:10.396 22:52:01 -- common/autotest_common.sh@932 -- # process_name=reactor_0 00:14:10.396 22:52:01 -- common/autotest_common.sh@936 -- # '[' reactor_0 = sudo ']' 00:14:10.396 22:52:01 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 258512' 00:14:10.396 killing process with pid 258512 00:14:10.396 22:52:01 -- common/autotest_common.sh@945 -- # kill 258512 00:14:10.396 22:52:01 -- common/autotest_common.sh@950 -- # wait 258512 00:14:10.654 22:52:01 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:14:10.654 22:52:01 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:14:10.654 22:52:01 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:14:10.654 22:52:01 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:14:10.654 22:52:01 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:14:10.654 22:52:01 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:14:10.654 22:52:01 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:14:10.654 22:52:01 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:14:12.556 22:52:03 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:14:12.556 00:14:12.556 real 0m43.717s 00:14:12.556 user 1m13.872s 00:14:12.556 sys 0m8.626s 00:14:12.556 22:52:03 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:14:12.556 22:52:03 -- common/autotest_common.sh@10 -- # set +x 00:14:12.556 ************************************ 00:14:12.556 END TEST nvmf_lvs_grow 00:14:12.556 ************************************ 00:14:12.815 22:52:03 -- nvmf/nvmf.sh@49 -- # run_test nvmf_bdev_io_wait /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/bdev_io_wait.sh --transport=tcp 00:14:12.815 22:52:03 -- common/autotest_common.sh@1077 -- # '[' 3 -le 1 ']' 00:14:12.815 22:52:03 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:14:12.815 22:52:03 -- common/autotest_common.sh@10 -- # set +x 00:14:12.815 ************************************ 00:14:12.815 START TEST nvmf_bdev_io_wait 00:14:12.815 ************************************ 00:14:12.815 22:52:03 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/bdev_io_wait.sh --transport=tcp 00:14:12.815 * Looking for test storage... 00:14:12.815 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:14:12.815 22:52:03 -- target/bdev_io_wait.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:14:12.815 22:52:03 -- nvmf/common.sh@7 -- # uname -s 00:14:12.815 22:52:03 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:14:12.815 22:52:03 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:14:12.815 22:52:03 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:14:12.815 22:52:03 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:14:12.815 22:52:03 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:14:12.815 22:52:03 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:14:12.815 22:52:03 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:14:12.815 22:52:03 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:14:12.815 22:52:03 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:14:12.815 22:52:03 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:14:12.815 22:52:03 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:14:12.815 22:52:03 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:14:12.815 22:52:03 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:14:12.815 22:52:03 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:14:12.815 22:52:03 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:14:12.815 22:52:03 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:14:12.815 22:52:03 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:14:12.815 22:52:03 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:14:12.815 22:52:03 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:14:12.815 22:52:03 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:14:12.815 22:52:03 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:14:12.815 22:52:03 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:14:12.815 22:52:03 -- paths/export.sh@5 -- # export PATH 00:14:12.815 22:52:03 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:14:12.815 22:52:03 -- nvmf/common.sh@46 -- # : 0 00:14:12.815 22:52:03 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:14:12.815 22:52:03 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:14:12.815 22:52:03 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:14:12.815 22:52:03 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:14:12.815 22:52:03 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:14:12.815 22:52:03 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:14:12.815 22:52:03 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:14:12.815 22:52:03 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:14:12.815 22:52:03 -- target/bdev_io_wait.sh@11 -- # MALLOC_BDEV_SIZE=64 00:14:12.815 22:52:03 -- target/bdev_io_wait.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:14:12.815 22:52:03 -- target/bdev_io_wait.sh@14 -- # nvmftestinit 00:14:12.815 22:52:03 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:14:12.815 22:52:03 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:14:12.815 22:52:03 -- nvmf/common.sh@436 -- # prepare_net_devs 00:14:12.815 22:52:03 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:14:12.815 22:52:03 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:14:12.815 22:52:03 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:14:12.815 22:52:03 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:14:12.815 22:52:03 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:14:12.815 22:52:03 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:14:12.815 22:52:03 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:14:12.815 22:52:03 -- nvmf/common.sh@284 -- # xtrace_disable 00:14:12.815 22:52:03 -- common/autotest_common.sh@10 -- # set +x 00:14:14.717 22:52:05 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:14:14.717 22:52:05 -- nvmf/common.sh@290 -- # pci_devs=() 00:14:14.717 22:52:05 -- nvmf/common.sh@290 -- # local -a pci_devs 00:14:14.717 22:52:05 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:14:14.717 22:52:05 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:14:14.717 22:52:05 -- nvmf/common.sh@292 -- # pci_drivers=() 00:14:14.717 22:52:05 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:14:14.717 22:52:05 -- nvmf/common.sh@294 -- # net_devs=() 00:14:14.717 22:52:05 -- nvmf/common.sh@294 -- # local -ga net_devs 00:14:14.717 22:52:05 -- nvmf/common.sh@295 -- # e810=() 00:14:14.717 22:52:05 -- nvmf/common.sh@295 -- # local -ga e810 00:14:14.717 22:52:05 -- nvmf/common.sh@296 -- # x722=() 00:14:14.717 22:52:05 -- nvmf/common.sh@296 -- # local -ga x722 00:14:14.717 22:52:05 -- nvmf/common.sh@297 -- # mlx=() 00:14:14.717 22:52:05 -- nvmf/common.sh@297 -- # local -ga mlx 00:14:14.717 22:52:05 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:14:14.717 22:52:05 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:14:14.717 22:52:05 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:14:14.717 22:52:05 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:14:14.717 22:52:05 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:14:14.717 22:52:05 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:14:14.717 22:52:05 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:14:14.717 22:52:05 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:14:14.717 22:52:05 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:14:14.717 22:52:05 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:14:14.717 22:52:05 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:14:14.717 22:52:05 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:14:14.717 22:52:05 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:14:14.717 22:52:05 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:14:14.717 22:52:05 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:14:14.717 22:52:05 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:14:14.717 22:52:05 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:14:14.717 22:52:05 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:14:14.717 22:52:05 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:14:14.717 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:14:14.717 22:52:05 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:14:14.717 22:52:05 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:14:14.717 22:52:05 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:14:14.717 22:52:05 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:14:14.717 22:52:05 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:14:14.717 22:52:05 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:14:14.717 22:52:05 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:14:14.717 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:14:14.717 22:52:05 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:14:14.717 22:52:05 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:14:14.717 22:52:05 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:14:14.717 22:52:05 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:14:14.718 22:52:05 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:14:14.718 22:52:05 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:14:14.718 22:52:05 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:14:14.718 22:52:05 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:14:14.718 22:52:05 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:14:14.718 22:52:05 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:14:14.718 22:52:05 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:14:14.718 22:52:05 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:14:14.718 22:52:05 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:14:14.718 Found net devices under 0000:0a:00.0: cvl_0_0 00:14:14.718 22:52:05 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:14:14.718 22:52:05 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:14:14.718 22:52:05 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:14:14.718 22:52:05 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:14:14.718 22:52:05 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:14:14.718 22:52:05 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:14:14.718 Found net devices under 0000:0a:00.1: cvl_0_1 00:14:14.718 22:52:05 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:14:14.718 22:52:05 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:14:14.718 22:52:05 -- nvmf/common.sh@402 -- # is_hw=yes 00:14:14.718 22:52:05 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:14:14.718 22:52:05 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:14:14.718 22:52:05 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:14:14.718 22:52:05 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:14:14.718 22:52:05 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:14:14.718 22:52:05 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:14:14.718 22:52:05 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:14:14.718 22:52:05 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:14:14.718 22:52:05 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:14:14.718 22:52:05 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:14:14.718 22:52:05 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:14:14.718 22:52:05 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:14:14.718 22:52:05 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:14:14.718 22:52:05 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:14:14.718 22:52:05 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:14:14.718 22:52:05 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:14:14.718 22:52:05 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:14:14.718 22:52:05 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:14:14.718 22:52:05 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:14:14.718 22:52:05 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:14:14.976 22:52:05 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:14:14.976 22:52:05 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:14:14.976 22:52:05 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:14:14.976 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:14:14.976 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.126 ms 00:14:14.976 00:14:14.976 --- 10.0.0.2 ping statistics --- 00:14:14.976 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:14:14.976 rtt min/avg/max/mdev = 0.126/0.126/0.126/0.000 ms 00:14:14.976 22:52:05 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:14:14.976 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:14:14.976 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.109 ms 00:14:14.976 00:14:14.976 --- 10.0.0.1 ping statistics --- 00:14:14.976 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:14:14.976 rtt min/avg/max/mdev = 0.109/0.109/0.109/0.000 ms 00:14:14.976 22:52:05 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:14:14.976 22:52:05 -- nvmf/common.sh@410 -- # return 0 00:14:14.976 22:52:05 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:14:14.976 22:52:05 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:14:14.976 22:52:05 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:14:14.976 22:52:05 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:14:14.976 22:52:05 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:14:14.976 22:52:05 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:14:14.976 22:52:05 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:14:14.976 22:52:05 -- target/bdev_io_wait.sh@15 -- # nvmfappstart -m 0xF --wait-for-rpc 00:14:14.976 22:52:05 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:14:14.976 22:52:05 -- common/autotest_common.sh@712 -- # xtrace_disable 00:14:14.976 22:52:05 -- common/autotest_common.sh@10 -- # set +x 00:14:14.976 22:52:05 -- nvmf/common.sh@469 -- # nvmfpid=261067 00:14:14.976 22:52:05 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF --wait-for-rpc 00:14:14.976 22:52:05 -- nvmf/common.sh@470 -- # waitforlisten 261067 00:14:14.976 22:52:05 -- common/autotest_common.sh@819 -- # '[' -z 261067 ']' 00:14:14.976 22:52:05 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk.sock 00:14:14.976 22:52:05 -- common/autotest_common.sh@824 -- # local max_retries=100 00:14:14.976 22:52:05 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:14:14.976 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:14:14.976 22:52:05 -- common/autotest_common.sh@828 -- # xtrace_disable 00:14:14.976 22:52:05 -- common/autotest_common.sh@10 -- # set +x 00:14:14.976 [2024-04-16 22:52:05.928653] Starting SPDK v24.01.1-pre git sha1 4b134b4ab / DPDK 23.11.0 initialization... 00:14:14.976 [2024-04-16 22:52:05.928740] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:14:14.976 EAL: No free 2048 kB hugepages reported on node 1 00:14:14.976 [2024-04-16 22:52:05.992796] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:14:14.976 [2024-04-16 22:52:06.104671] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:14:14.976 [2024-04-16 22:52:06.104848] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:14:14.976 [2024-04-16 22:52:06.104872] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:14:14.976 [2024-04-16 22:52:06.104886] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:14:14.976 [2024-04-16 22:52:06.104945] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:14:14.976 [2024-04-16 22:52:06.104986] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:14:15.236 [2024-04-16 22:52:06.105037] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:14:15.236 [2024-04-16 22:52:06.105039] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:14:15.236 22:52:06 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:14:15.236 22:52:06 -- common/autotest_common.sh@852 -- # return 0 00:14:15.236 22:52:06 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:14:15.236 22:52:06 -- common/autotest_common.sh@718 -- # xtrace_disable 00:14:15.236 22:52:06 -- common/autotest_common.sh@10 -- # set +x 00:14:15.236 22:52:06 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:14:15.236 22:52:06 -- target/bdev_io_wait.sh@18 -- # rpc_cmd bdev_set_options -p 5 -c 1 00:14:15.236 22:52:06 -- common/autotest_common.sh@551 -- # xtrace_disable 00:14:15.236 22:52:06 -- common/autotest_common.sh@10 -- # set +x 00:14:15.236 22:52:06 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:14:15.236 22:52:06 -- target/bdev_io_wait.sh@19 -- # rpc_cmd framework_start_init 00:14:15.236 22:52:06 -- common/autotest_common.sh@551 -- # xtrace_disable 00:14:15.236 22:52:06 -- common/autotest_common.sh@10 -- # set +x 00:14:15.236 22:52:06 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:14:15.236 22:52:06 -- target/bdev_io_wait.sh@20 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:14:15.236 22:52:06 -- common/autotest_common.sh@551 -- # xtrace_disable 00:14:15.236 22:52:06 -- common/autotest_common.sh@10 -- # set +x 00:14:15.236 [2024-04-16 22:52:06.237846] tcp.c: 659:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:14:15.236 22:52:06 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:14:15.236 22:52:06 -- target/bdev_io_wait.sh@22 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc0 00:14:15.236 22:52:06 -- common/autotest_common.sh@551 -- # xtrace_disable 00:14:15.236 22:52:06 -- common/autotest_common.sh@10 -- # set +x 00:14:15.236 Malloc0 00:14:15.236 22:52:06 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:14:15.236 22:52:06 -- target/bdev_io_wait.sh@23 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:14:15.236 22:52:06 -- common/autotest_common.sh@551 -- # xtrace_disable 00:14:15.236 22:52:06 -- common/autotest_common.sh@10 -- # set +x 00:14:15.236 22:52:06 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:14:15.236 22:52:06 -- target/bdev_io_wait.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:14:15.236 22:52:06 -- common/autotest_common.sh@551 -- # xtrace_disable 00:14:15.236 22:52:06 -- common/autotest_common.sh@10 -- # set +x 00:14:15.236 22:52:06 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:14:15.236 22:52:06 -- target/bdev_io_wait.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:14:15.236 22:52:06 -- common/autotest_common.sh@551 -- # xtrace_disable 00:14:15.236 22:52:06 -- common/autotest_common.sh@10 -- # set +x 00:14:15.236 [2024-04-16 22:52:06.302815] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:14:15.236 22:52:06 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:14:15.236 22:52:06 -- target/bdev_io_wait.sh@28 -- # WRITE_PID=261216 00:14:15.236 22:52:06 -- target/bdev_io_wait.sh@30 -- # READ_PID=261217 00:14:15.236 22:52:06 -- target/bdev_io_wait.sh@27 -- # gen_nvmf_target_json 00:14:15.236 22:52:06 -- target/bdev_io_wait.sh@27 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 0x10 -i 1 --json /dev/fd/63 -q 128 -o 4096 -w write -t 1 -s 256 00:14:15.236 22:52:06 -- nvmf/common.sh@520 -- # config=() 00:14:15.236 22:52:06 -- nvmf/common.sh@520 -- # local subsystem config 00:14:15.236 22:52:06 -- target/bdev_io_wait.sh@29 -- # gen_nvmf_target_json 00:14:15.236 22:52:06 -- target/bdev_io_wait.sh@29 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 0x20 -i 2 --json /dev/fd/63 -q 128 -o 4096 -w read -t 1 -s 256 00:14:15.236 22:52:06 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:14:15.236 22:52:06 -- target/bdev_io_wait.sh@32 -- # FLUSH_PID=261220 00:14:15.236 22:52:06 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:14:15.236 { 00:14:15.236 "params": { 00:14:15.236 "name": "Nvme$subsystem", 00:14:15.236 "trtype": "$TEST_TRANSPORT", 00:14:15.236 "traddr": "$NVMF_FIRST_TARGET_IP", 00:14:15.236 "adrfam": "ipv4", 00:14:15.236 "trsvcid": "$NVMF_PORT", 00:14:15.236 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:14:15.236 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:14:15.236 "hdgst": ${hdgst:-false}, 00:14:15.236 "ddgst": ${ddgst:-false} 00:14:15.236 }, 00:14:15.236 "method": "bdev_nvme_attach_controller" 00:14:15.236 } 00:14:15.236 EOF 00:14:15.236 )") 00:14:15.236 22:52:06 -- nvmf/common.sh@520 -- # config=() 00:14:15.236 22:52:06 -- nvmf/common.sh@520 -- # local subsystem config 00:14:15.236 22:52:06 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:14:15.236 22:52:06 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:14:15.236 { 00:14:15.236 "params": { 00:14:15.236 "name": "Nvme$subsystem", 00:14:15.236 "trtype": "$TEST_TRANSPORT", 00:14:15.236 "traddr": "$NVMF_FIRST_TARGET_IP", 00:14:15.236 "adrfam": "ipv4", 00:14:15.236 "trsvcid": "$NVMF_PORT", 00:14:15.236 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:14:15.236 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:14:15.236 "hdgst": ${hdgst:-false}, 00:14:15.236 "ddgst": ${ddgst:-false} 00:14:15.236 }, 00:14:15.236 "method": "bdev_nvme_attach_controller" 00:14:15.236 } 00:14:15.236 EOF 00:14:15.236 )") 00:14:15.236 22:52:06 -- target/bdev_io_wait.sh@34 -- # UNMAP_PID=261222 00:14:15.236 22:52:06 -- target/bdev_io_wait.sh@31 -- # gen_nvmf_target_json 00:14:15.236 22:52:06 -- target/bdev_io_wait.sh@31 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 0x40 -i 3 --json /dev/fd/63 -q 128 -o 4096 -w flush -t 1 -s 256 00:14:15.236 22:52:06 -- target/bdev_io_wait.sh@35 -- # sync 00:14:15.236 22:52:06 -- nvmf/common.sh@520 -- # config=() 00:14:15.236 22:52:06 -- nvmf/common.sh@520 -- # local subsystem config 00:14:15.236 22:52:06 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:14:15.236 22:52:06 -- nvmf/common.sh@542 -- # cat 00:14:15.236 22:52:06 -- target/bdev_io_wait.sh@33 -- # gen_nvmf_target_json 00:14:15.236 22:52:06 -- target/bdev_io_wait.sh@33 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 0x80 -i 4 --json /dev/fd/63 -q 128 -o 4096 -w unmap -t 1 -s 256 00:14:15.236 22:52:06 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:14:15.236 { 00:14:15.236 "params": { 00:14:15.236 "name": "Nvme$subsystem", 00:14:15.236 "trtype": "$TEST_TRANSPORT", 00:14:15.236 "traddr": "$NVMF_FIRST_TARGET_IP", 00:14:15.236 "adrfam": "ipv4", 00:14:15.236 "trsvcid": "$NVMF_PORT", 00:14:15.236 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:14:15.236 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:14:15.236 "hdgst": ${hdgst:-false}, 00:14:15.236 "ddgst": ${ddgst:-false} 00:14:15.236 }, 00:14:15.236 "method": "bdev_nvme_attach_controller" 00:14:15.236 } 00:14:15.236 EOF 00:14:15.236 )") 00:14:15.236 22:52:06 -- nvmf/common.sh@520 -- # config=() 00:14:15.236 22:52:06 -- nvmf/common.sh@520 -- # local subsystem config 00:14:15.236 22:52:06 -- nvmf/common.sh@542 -- # cat 00:14:15.236 22:52:06 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:14:15.236 22:52:06 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:14:15.236 { 00:14:15.236 "params": { 00:14:15.236 "name": "Nvme$subsystem", 00:14:15.236 "trtype": "$TEST_TRANSPORT", 00:14:15.236 "traddr": "$NVMF_FIRST_TARGET_IP", 00:14:15.236 "adrfam": "ipv4", 00:14:15.236 "trsvcid": "$NVMF_PORT", 00:14:15.236 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:14:15.236 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:14:15.236 "hdgst": ${hdgst:-false}, 00:14:15.236 "ddgst": ${ddgst:-false} 00:14:15.236 }, 00:14:15.236 "method": "bdev_nvme_attach_controller" 00:14:15.236 } 00:14:15.236 EOF 00:14:15.236 )") 00:14:15.236 22:52:06 -- nvmf/common.sh@542 -- # cat 00:14:15.236 22:52:06 -- target/bdev_io_wait.sh@37 -- # wait 261216 00:14:15.236 22:52:06 -- nvmf/common.sh@542 -- # cat 00:14:15.236 22:52:06 -- nvmf/common.sh@544 -- # jq . 00:14:15.236 22:52:06 -- nvmf/common.sh@544 -- # jq . 00:14:15.236 22:52:06 -- nvmf/common.sh@544 -- # jq . 00:14:15.237 22:52:06 -- nvmf/common.sh@545 -- # IFS=, 00:14:15.237 22:52:06 -- nvmf/common.sh@544 -- # jq . 00:14:15.237 22:52:06 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:14:15.237 "params": { 00:14:15.237 "name": "Nvme1", 00:14:15.237 "trtype": "tcp", 00:14:15.237 "traddr": "10.0.0.2", 00:14:15.237 "adrfam": "ipv4", 00:14:15.237 "trsvcid": "4420", 00:14:15.237 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:14:15.237 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:14:15.237 "hdgst": false, 00:14:15.237 "ddgst": false 00:14:15.237 }, 00:14:15.237 "method": "bdev_nvme_attach_controller" 00:14:15.237 }' 00:14:15.237 22:52:06 -- nvmf/common.sh@545 -- # IFS=, 00:14:15.237 22:52:06 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:14:15.237 "params": { 00:14:15.237 "name": "Nvme1", 00:14:15.237 "trtype": "tcp", 00:14:15.237 "traddr": "10.0.0.2", 00:14:15.237 "adrfam": "ipv4", 00:14:15.237 "trsvcid": "4420", 00:14:15.237 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:14:15.237 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:14:15.237 "hdgst": false, 00:14:15.237 "ddgst": false 00:14:15.237 }, 00:14:15.237 "method": "bdev_nvme_attach_controller" 00:14:15.237 }' 00:14:15.237 22:52:06 -- nvmf/common.sh@545 -- # IFS=, 00:14:15.237 22:52:06 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:14:15.237 "params": { 00:14:15.237 "name": "Nvme1", 00:14:15.237 "trtype": "tcp", 00:14:15.237 "traddr": "10.0.0.2", 00:14:15.237 "adrfam": "ipv4", 00:14:15.237 "trsvcid": "4420", 00:14:15.237 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:14:15.237 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:14:15.237 "hdgst": false, 00:14:15.237 "ddgst": false 00:14:15.237 }, 00:14:15.237 "method": "bdev_nvme_attach_controller" 00:14:15.237 }' 00:14:15.237 22:52:06 -- nvmf/common.sh@545 -- # IFS=, 00:14:15.237 22:52:06 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:14:15.237 "params": { 00:14:15.237 "name": "Nvme1", 00:14:15.237 "trtype": "tcp", 00:14:15.237 "traddr": "10.0.0.2", 00:14:15.237 "adrfam": "ipv4", 00:14:15.237 "trsvcid": "4420", 00:14:15.237 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:14:15.237 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:14:15.237 "hdgst": false, 00:14:15.237 "ddgst": false 00:14:15.237 }, 00:14:15.237 "method": "bdev_nvme_attach_controller" 00:14:15.237 }' 00:14:15.237 [2024-04-16 22:52:06.346823] Starting SPDK v24.01.1-pre git sha1 4b134b4ab / DPDK 23.11.0 initialization... 00:14:15.237 [2024-04-16 22:52:06.346824] Starting SPDK v24.01.1-pre git sha1 4b134b4ab / DPDK 23.11.0 initialization... 00:14:15.237 [2024-04-16 22:52:06.346824] Starting SPDK v24.01.1-pre git sha1 4b134b4ab / DPDK 23.11.0 initialization... 00:14:15.237 [2024-04-16 22:52:06.346833] Starting SPDK v24.01.1-pre git sha1 4b134b4ab / DPDK 23.11.0 initialization... 00:14:15.237 [2024-04-16 22:52:06.346915] [ DPDK EAL parameters: bdevperf -c 0x40 -m 256 --no-telemetry --log-level=lib.eal:6 --log-level=lib[2024-04-16 22:52:06.346915] [ DPDK EAL parameters: bdevperf -c 0x10 -m 256 --no-telemetry --log-level=lib.eal:6 --log-level=lib[2024-04-16 22:52:06.346917] [ DPDK EAL parameters: bdevperf -c 0x20 -m 256 --no-telemetry --log-level=lib.eal:6 --log-level=lib[2024-04-16 22:52:06.346918] [ DPDK EAL parameters: bdevperf -c 0x80 -m 256 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk3 --proc-type=auto ] 00:14:15.237 .cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk1 --proc-type=auto ] 00:14:15.237 .cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk2 --proc-type=auto ] 00:14:15.237 .cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk4 --proc-type=auto ] 00:14:15.495 EAL: No free 2048 kB hugepages reported on node 1 00:14:15.495 EAL: No free 2048 kB hugepages reported on node 1 00:14:15.495 [2024-04-16 22:52:06.519966] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:14:15.495 EAL: No free 2048 kB hugepages reported on node 1 00:14:15.495 [2024-04-16 22:52:06.587401] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:14:15.495 [2024-04-16 22:52:06.612154] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 5 00:14:15.753 EAL: No free 2048 kB hugepages reported on node 1 00:14:15.753 [2024-04-16 22:52:06.677277] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 7 00:14:15.753 [2024-04-16 22:52:06.683664] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:14:15.753 [2024-04-16 22:52:06.777565] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 6 00:14:15.753 [2024-04-16 22:52:06.782150] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:14:15.753 [2024-04-16 22:52:06.872489] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 4 00:14:16.012 Running I/O for 1 seconds... 00:14:16.012 Running I/O for 1 seconds... 00:14:16.012 Running I/O for 1 seconds... 00:14:16.012 Running I/O for 1 seconds... 00:14:16.955 00:14:16.955 Latency(us) 00:14:16.955 Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:14:16.955 Job: Nvme1n1 (Core Mask 0x40, workload: flush, depth: 128, IO size: 4096) 00:14:16.955 Nvme1n1 : 1.00 193155.35 754.51 0.00 0.00 660.15 262.45 861.68 00:14:16.955 =================================================================================================================== 00:14:16.955 Total : 193155.35 754.51 0.00 0.00 660.15 262.45 861.68 00:14:16.955 00:14:16.955 Latency(us) 00:14:16.955 Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:14:16.955 Job: Nvme1n1 (Core Mask 0x10, workload: write, depth: 128, IO size: 4096) 00:14:16.955 Nvme1n1 : 1.02 6665.93 26.04 0.00 0.00 19034.36 8689.59 26796.94 00:14:16.955 =================================================================================================================== 00:14:16.955 Total : 6665.93 26.04 0.00 0.00 19034.36 8689.59 26796.94 00:14:17.213 00:14:17.213 Latency(us) 00:14:17.213 Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:14:17.214 Job: Nvme1n1 (Core Mask 0x80, workload: unmap, depth: 128, IO size: 4096) 00:14:17.214 Nvme1n1 : 1.01 10589.78 41.37 0.00 0.00 12039.75 6699.24 26020.22 00:14:17.214 =================================================================================================================== 00:14:17.214 Total : 10589.78 41.37 0.00 0.00 12039.75 6699.24 26020.22 00:14:17.214 00:14:17.214 Latency(us) 00:14:17.214 Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:14:17.214 Job: Nvme1n1 (Core Mask 0x20, workload: read, depth: 128, IO size: 4096) 00:14:17.214 Nvme1n1 : 1.01 6440.10 25.16 0.00 0.00 19810.21 6407.96 42719.76 00:14:17.214 =================================================================================================================== 00:14:17.214 Total : 6440.10 25.16 0.00 0.00 19810.21 6407.96 42719.76 00:14:17.214 22:52:08 -- target/bdev_io_wait.sh@38 -- # wait 261217 00:14:17.472 22:52:08 -- target/bdev_io_wait.sh@39 -- # wait 261220 00:14:17.472 22:52:08 -- target/bdev_io_wait.sh@40 -- # wait 261222 00:14:17.472 22:52:08 -- target/bdev_io_wait.sh@42 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:14:17.472 22:52:08 -- common/autotest_common.sh@551 -- # xtrace_disable 00:14:17.472 22:52:08 -- common/autotest_common.sh@10 -- # set +x 00:14:17.472 22:52:08 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:14:17.472 22:52:08 -- target/bdev_io_wait.sh@44 -- # trap - SIGINT SIGTERM EXIT 00:14:17.472 22:52:08 -- target/bdev_io_wait.sh@46 -- # nvmftestfini 00:14:17.472 22:52:08 -- nvmf/common.sh@476 -- # nvmfcleanup 00:14:17.472 22:52:08 -- nvmf/common.sh@116 -- # sync 00:14:17.472 22:52:08 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:14:17.472 22:52:08 -- nvmf/common.sh@119 -- # set +e 00:14:17.472 22:52:08 -- nvmf/common.sh@120 -- # for i in {1..20} 00:14:17.472 22:52:08 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:14:17.472 rmmod nvme_tcp 00:14:17.472 rmmod nvme_fabrics 00:14:17.472 rmmod nvme_keyring 00:14:17.472 22:52:08 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:14:17.472 22:52:08 -- nvmf/common.sh@123 -- # set -e 00:14:17.472 22:52:08 -- nvmf/common.sh@124 -- # return 0 00:14:17.472 22:52:08 -- nvmf/common.sh@477 -- # '[' -n 261067 ']' 00:14:17.472 22:52:08 -- nvmf/common.sh@478 -- # killprocess 261067 00:14:17.472 22:52:08 -- common/autotest_common.sh@926 -- # '[' -z 261067 ']' 00:14:17.472 22:52:08 -- common/autotest_common.sh@930 -- # kill -0 261067 00:14:17.472 22:52:08 -- common/autotest_common.sh@931 -- # uname 00:14:17.472 22:52:08 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:14:17.472 22:52:08 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 261067 00:14:17.472 22:52:08 -- common/autotest_common.sh@932 -- # process_name=reactor_0 00:14:17.472 22:52:08 -- common/autotest_common.sh@936 -- # '[' reactor_0 = sudo ']' 00:14:17.472 22:52:08 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 261067' 00:14:17.472 killing process with pid 261067 00:14:17.472 22:52:08 -- common/autotest_common.sh@945 -- # kill 261067 00:14:17.472 22:52:08 -- common/autotest_common.sh@950 -- # wait 261067 00:14:17.731 22:52:08 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:14:17.731 22:52:08 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:14:17.731 22:52:08 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:14:17.731 22:52:08 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:14:17.731 22:52:08 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:14:17.731 22:52:08 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:14:17.731 22:52:08 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:14:17.731 22:52:08 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:14:20.276 22:52:10 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:14:20.276 00:14:20.276 real 0m7.159s 00:14:20.276 user 0m16.660s 00:14:20.276 sys 0m3.441s 00:14:20.276 22:52:10 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:14:20.276 22:52:10 -- common/autotest_common.sh@10 -- # set +x 00:14:20.276 ************************************ 00:14:20.276 END TEST nvmf_bdev_io_wait 00:14:20.276 ************************************ 00:14:20.276 22:52:10 -- nvmf/nvmf.sh@50 -- # run_test nvmf_queue_depth /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/queue_depth.sh --transport=tcp 00:14:20.276 22:52:10 -- common/autotest_common.sh@1077 -- # '[' 3 -le 1 ']' 00:14:20.276 22:52:10 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:14:20.276 22:52:10 -- common/autotest_common.sh@10 -- # set +x 00:14:20.276 ************************************ 00:14:20.276 START TEST nvmf_queue_depth 00:14:20.276 ************************************ 00:14:20.276 22:52:10 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/queue_depth.sh --transport=tcp 00:14:20.276 * Looking for test storage... 00:14:20.276 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:14:20.276 22:52:10 -- target/queue_depth.sh@12 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:14:20.276 22:52:10 -- nvmf/common.sh@7 -- # uname -s 00:14:20.276 22:52:10 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:14:20.276 22:52:10 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:14:20.276 22:52:10 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:14:20.276 22:52:10 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:14:20.276 22:52:10 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:14:20.276 22:52:10 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:14:20.276 22:52:10 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:14:20.276 22:52:10 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:14:20.276 22:52:10 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:14:20.276 22:52:10 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:14:20.276 22:52:10 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:14:20.276 22:52:10 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:14:20.276 22:52:10 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:14:20.276 22:52:10 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:14:20.276 22:52:10 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:14:20.276 22:52:10 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:14:20.276 22:52:10 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:14:20.276 22:52:10 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:14:20.276 22:52:10 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:14:20.276 22:52:10 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:14:20.276 22:52:10 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:14:20.276 22:52:10 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:14:20.276 22:52:10 -- paths/export.sh@5 -- # export PATH 00:14:20.276 22:52:10 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:14:20.276 22:52:10 -- nvmf/common.sh@46 -- # : 0 00:14:20.276 22:52:10 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:14:20.276 22:52:10 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:14:20.276 22:52:10 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:14:20.276 22:52:10 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:14:20.276 22:52:10 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:14:20.276 22:52:10 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:14:20.276 22:52:10 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:14:20.276 22:52:10 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:14:20.276 22:52:10 -- target/queue_depth.sh@14 -- # MALLOC_BDEV_SIZE=64 00:14:20.276 22:52:10 -- target/queue_depth.sh@15 -- # MALLOC_BLOCK_SIZE=512 00:14:20.276 22:52:10 -- target/queue_depth.sh@17 -- # bdevperf_rpc_sock=/var/tmp/bdevperf.sock 00:14:20.276 22:52:10 -- target/queue_depth.sh@19 -- # nvmftestinit 00:14:20.276 22:52:10 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:14:20.276 22:52:10 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:14:20.276 22:52:10 -- nvmf/common.sh@436 -- # prepare_net_devs 00:14:20.276 22:52:10 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:14:20.276 22:52:10 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:14:20.276 22:52:10 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:14:20.276 22:52:10 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:14:20.276 22:52:10 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:14:20.276 22:52:10 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:14:20.276 22:52:10 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:14:20.276 22:52:10 -- nvmf/common.sh@284 -- # xtrace_disable 00:14:20.276 22:52:10 -- common/autotest_common.sh@10 -- # set +x 00:14:22.180 22:52:12 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:14:22.180 22:52:12 -- nvmf/common.sh@290 -- # pci_devs=() 00:14:22.180 22:52:12 -- nvmf/common.sh@290 -- # local -a pci_devs 00:14:22.180 22:52:12 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:14:22.180 22:52:12 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:14:22.180 22:52:12 -- nvmf/common.sh@292 -- # pci_drivers=() 00:14:22.180 22:52:12 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:14:22.180 22:52:12 -- nvmf/common.sh@294 -- # net_devs=() 00:14:22.180 22:52:12 -- nvmf/common.sh@294 -- # local -ga net_devs 00:14:22.180 22:52:12 -- nvmf/common.sh@295 -- # e810=() 00:14:22.180 22:52:12 -- nvmf/common.sh@295 -- # local -ga e810 00:14:22.180 22:52:12 -- nvmf/common.sh@296 -- # x722=() 00:14:22.180 22:52:12 -- nvmf/common.sh@296 -- # local -ga x722 00:14:22.180 22:52:12 -- nvmf/common.sh@297 -- # mlx=() 00:14:22.180 22:52:12 -- nvmf/common.sh@297 -- # local -ga mlx 00:14:22.180 22:52:12 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:14:22.180 22:52:12 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:14:22.180 22:52:12 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:14:22.180 22:52:12 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:14:22.180 22:52:12 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:14:22.180 22:52:12 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:14:22.180 22:52:12 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:14:22.180 22:52:12 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:14:22.180 22:52:12 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:14:22.180 22:52:12 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:14:22.180 22:52:12 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:14:22.180 22:52:12 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:14:22.180 22:52:12 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:14:22.180 22:52:12 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:14:22.180 22:52:12 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:14:22.180 22:52:12 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:14:22.180 22:52:12 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:14:22.180 22:52:12 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:14:22.180 22:52:12 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:14:22.180 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:14:22.180 22:52:12 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:14:22.180 22:52:12 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:14:22.180 22:52:12 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:14:22.180 22:52:12 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:14:22.180 22:52:12 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:14:22.180 22:52:12 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:14:22.180 22:52:12 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:14:22.180 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:14:22.180 22:52:12 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:14:22.180 22:52:12 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:14:22.180 22:52:12 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:14:22.180 22:52:12 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:14:22.180 22:52:12 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:14:22.180 22:52:12 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:14:22.180 22:52:12 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:14:22.180 22:52:12 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:14:22.180 22:52:12 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:14:22.180 22:52:12 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:14:22.180 22:52:12 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:14:22.180 22:52:12 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:14:22.180 22:52:12 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:14:22.180 Found net devices under 0000:0a:00.0: cvl_0_0 00:14:22.180 22:52:12 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:14:22.180 22:52:12 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:14:22.180 22:52:12 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:14:22.180 22:52:12 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:14:22.180 22:52:12 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:14:22.180 22:52:12 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:14:22.180 Found net devices under 0000:0a:00.1: cvl_0_1 00:14:22.180 22:52:12 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:14:22.180 22:52:12 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:14:22.180 22:52:12 -- nvmf/common.sh@402 -- # is_hw=yes 00:14:22.180 22:52:12 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:14:22.180 22:52:12 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:14:22.180 22:52:12 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:14:22.180 22:52:12 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:14:22.180 22:52:12 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:14:22.180 22:52:12 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:14:22.180 22:52:12 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:14:22.180 22:52:12 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:14:22.180 22:52:12 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:14:22.180 22:52:12 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:14:22.180 22:52:12 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:14:22.180 22:52:12 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:14:22.180 22:52:12 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:14:22.180 22:52:12 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:14:22.180 22:52:12 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:14:22.180 22:52:12 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:14:22.180 22:52:12 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:14:22.180 22:52:12 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:14:22.180 22:52:13 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:14:22.180 22:52:13 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:14:22.180 22:52:13 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:14:22.180 22:52:13 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:14:22.180 22:52:13 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:14:22.180 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:14:22.180 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.202 ms 00:14:22.180 00:14:22.180 --- 10.0.0.2 ping statistics --- 00:14:22.180 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:14:22.180 rtt min/avg/max/mdev = 0.202/0.202/0.202/0.000 ms 00:14:22.180 22:52:13 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:14:22.180 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:14:22.180 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.098 ms 00:14:22.180 00:14:22.180 --- 10.0.0.1 ping statistics --- 00:14:22.180 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:14:22.180 rtt min/avg/max/mdev = 0.098/0.098/0.098/0.000 ms 00:14:22.180 22:52:13 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:14:22.180 22:52:13 -- nvmf/common.sh@410 -- # return 0 00:14:22.180 22:52:13 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:14:22.180 22:52:13 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:14:22.180 22:52:13 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:14:22.180 22:52:13 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:14:22.180 22:52:13 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:14:22.180 22:52:13 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:14:22.180 22:52:13 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:14:22.180 22:52:13 -- target/queue_depth.sh@21 -- # nvmfappstart -m 0x2 00:14:22.180 22:52:13 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:14:22.180 22:52:13 -- common/autotest_common.sh@712 -- # xtrace_disable 00:14:22.180 22:52:13 -- common/autotest_common.sh@10 -- # set +x 00:14:22.180 22:52:13 -- nvmf/common.sh@469 -- # nvmfpid=263460 00:14:22.180 22:52:13 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x2 00:14:22.180 22:52:13 -- nvmf/common.sh@470 -- # waitforlisten 263460 00:14:22.180 22:52:13 -- common/autotest_common.sh@819 -- # '[' -z 263460 ']' 00:14:22.180 22:52:13 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk.sock 00:14:22.180 22:52:13 -- common/autotest_common.sh@824 -- # local max_retries=100 00:14:22.180 22:52:13 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:14:22.180 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:14:22.181 22:52:13 -- common/autotest_common.sh@828 -- # xtrace_disable 00:14:22.181 22:52:13 -- common/autotest_common.sh@10 -- # set +x 00:14:22.181 [2024-04-16 22:52:13.119680] Starting SPDK v24.01.1-pre git sha1 4b134b4ab / DPDK 23.11.0 initialization... 00:14:22.181 [2024-04-16 22:52:13.119751] [ DPDK EAL parameters: nvmf -c 0x2 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:14:22.181 EAL: No free 2048 kB hugepages reported on node 1 00:14:22.181 [2024-04-16 22:52:13.182983] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:14:22.181 [2024-04-16 22:52:13.293396] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:14:22.181 [2024-04-16 22:52:13.293528] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:14:22.181 [2024-04-16 22:52:13.293546] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:14:22.181 [2024-04-16 22:52:13.293559] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:14:22.181 [2024-04-16 22:52:13.293595] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:14:23.116 22:52:14 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:14:23.116 22:52:14 -- common/autotest_common.sh@852 -- # return 0 00:14:23.116 22:52:14 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:14:23.116 22:52:14 -- common/autotest_common.sh@718 -- # xtrace_disable 00:14:23.116 22:52:14 -- common/autotest_common.sh@10 -- # set +x 00:14:23.116 22:52:14 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:14:23.116 22:52:14 -- target/queue_depth.sh@23 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:14:23.116 22:52:14 -- common/autotest_common.sh@551 -- # xtrace_disable 00:14:23.116 22:52:14 -- common/autotest_common.sh@10 -- # set +x 00:14:23.116 [2024-04-16 22:52:14.089318] tcp.c: 659:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:14:23.116 22:52:14 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:14:23.116 22:52:14 -- target/queue_depth.sh@24 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc0 00:14:23.116 22:52:14 -- common/autotest_common.sh@551 -- # xtrace_disable 00:14:23.116 22:52:14 -- common/autotest_common.sh@10 -- # set +x 00:14:23.116 Malloc0 00:14:23.116 22:52:14 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:14:23.116 22:52:14 -- target/queue_depth.sh@25 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:14:23.116 22:52:14 -- common/autotest_common.sh@551 -- # xtrace_disable 00:14:23.116 22:52:14 -- common/autotest_common.sh@10 -- # set +x 00:14:23.116 22:52:14 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:14:23.116 22:52:14 -- target/queue_depth.sh@26 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:14:23.116 22:52:14 -- common/autotest_common.sh@551 -- # xtrace_disable 00:14:23.116 22:52:14 -- common/autotest_common.sh@10 -- # set +x 00:14:23.116 22:52:14 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:14:23.116 22:52:14 -- target/queue_depth.sh@27 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:14:23.116 22:52:14 -- common/autotest_common.sh@551 -- # xtrace_disable 00:14:23.116 22:52:14 -- common/autotest_common.sh@10 -- # set +x 00:14:23.116 [2024-04-16 22:52:14.150151] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:14:23.116 22:52:14 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:14:23.116 22:52:14 -- target/queue_depth.sh@30 -- # bdevperf_pid=263609 00:14:23.116 22:52:14 -- target/queue_depth.sh@29 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -z -r /var/tmp/bdevperf.sock -q 1024 -o 4096 -w verify -t 10 00:14:23.116 22:52:14 -- target/queue_depth.sh@32 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; killprocess $bdevperf_pid; nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:14:23.116 22:52:14 -- target/queue_depth.sh@33 -- # waitforlisten 263609 /var/tmp/bdevperf.sock 00:14:23.116 22:52:14 -- common/autotest_common.sh@819 -- # '[' -z 263609 ']' 00:14:23.116 22:52:14 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:14:23.116 22:52:14 -- common/autotest_common.sh@824 -- # local max_retries=100 00:14:23.116 22:52:14 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:14:23.116 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:14:23.116 22:52:14 -- common/autotest_common.sh@828 -- # xtrace_disable 00:14:23.116 22:52:14 -- common/autotest_common.sh@10 -- # set +x 00:14:23.116 [2024-04-16 22:52:14.194587] Starting SPDK v24.01.1-pre git sha1 4b134b4ab / DPDK 23.11.0 initialization... 00:14:23.116 [2024-04-16 22:52:14.194662] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid263609 ] 00:14:23.116 EAL: No free 2048 kB hugepages reported on node 1 00:14:23.374 [2024-04-16 22:52:14.261996] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:14:23.374 [2024-04-16 22:52:14.377287] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:14:24.306 22:52:15 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:14:24.306 22:52:15 -- common/autotest_common.sh@852 -- # return 0 00:14:24.306 22:52:15 -- target/queue_depth.sh@34 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 00:14:24.306 22:52:15 -- common/autotest_common.sh@551 -- # xtrace_disable 00:14:24.306 22:52:15 -- common/autotest_common.sh@10 -- # set +x 00:14:24.306 NVMe0n1 00:14:24.306 22:52:15 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:14:24.306 22:52:15 -- target/queue_depth.sh@35 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bdevperf.sock perform_tests 00:14:24.563 Running I/O for 10 seconds... 00:14:34.545 00:14:34.545 Latency(us) 00:14:34.545 Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:14:34.545 Job: NVMe0n1 (Core Mask 0x1, workload: verify, depth: 1024, IO size: 4096) 00:14:34.545 Verification LBA range: start 0x0 length 0x4000 00:14:34.545 NVMe0n1 : 10.07 12328.33 48.16 0.00 0.00 82733.08 13301.38 60196.03 00:14:34.545 =================================================================================================================== 00:14:34.545 Total : 12328.33 48.16 0.00 0.00 82733.08 13301.38 60196.03 00:14:34.545 0 00:14:34.545 22:52:25 -- target/queue_depth.sh@39 -- # killprocess 263609 00:14:34.545 22:52:25 -- common/autotest_common.sh@926 -- # '[' -z 263609 ']' 00:14:34.545 22:52:25 -- common/autotest_common.sh@930 -- # kill -0 263609 00:14:34.545 22:52:25 -- common/autotest_common.sh@931 -- # uname 00:14:34.545 22:52:25 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:14:34.545 22:52:25 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 263609 00:14:34.545 22:52:25 -- common/autotest_common.sh@932 -- # process_name=reactor_0 00:14:34.545 22:52:25 -- common/autotest_common.sh@936 -- # '[' reactor_0 = sudo ']' 00:14:34.545 22:52:25 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 263609' 00:14:34.545 killing process with pid 263609 00:14:34.545 22:52:25 -- common/autotest_common.sh@945 -- # kill 263609 00:14:34.545 Received shutdown signal, test time was about 10.000000 seconds 00:14:34.545 00:14:34.545 Latency(us) 00:14:34.545 Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:14:34.545 =================================================================================================================== 00:14:34.545 Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:14:34.545 22:52:25 -- common/autotest_common.sh@950 -- # wait 263609 00:14:34.803 22:52:25 -- target/queue_depth.sh@41 -- # trap - SIGINT SIGTERM EXIT 00:14:34.803 22:52:25 -- target/queue_depth.sh@43 -- # nvmftestfini 00:14:34.803 22:52:25 -- nvmf/common.sh@476 -- # nvmfcleanup 00:14:34.803 22:52:25 -- nvmf/common.sh@116 -- # sync 00:14:34.803 22:52:25 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:14:34.803 22:52:25 -- nvmf/common.sh@119 -- # set +e 00:14:34.803 22:52:25 -- nvmf/common.sh@120 -- # for i in {1..20} 00:14:34.803 22:52:25 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:14:34.803 rmmod nvme_tcp 00:14:34.803 rmmod nvme_fabrics 00:14:34.803 rmmod nvme_keyring 00:14:34.803 22:52:25 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:14:34.803 22:52:25 -- nvmf/common.sh@123 -- # set -e 00:14:34.803 22:52:25 -- nvmf/common.sh@124 -- # return 0 00:14:34.803 22:52:25 -- nvmf/common.sh@477 -- # '[' -n 263460 ']' 00:14:34.803 22:52:25 -- nvmf/common.sh@478 -- # killprocess 263460 00:14:34.803 22:52:25 -- common/autotest_common.sh@926 -- # '[' -z 263460 ']' 00:14:34.803 22:52:25 -- common/autotest_common.sh@930 -- # kill -0 263460 00:14:34.803 22:52:25 -- common/autotest_common.sh@931 -- # uname 00:14:34.803 22:52:25 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:14:34.803 22:52:25 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 263460 00:14:35.062 22:52:25 -- common/autotest_common.sh@932 -- # process_name=reactor_1 00:14:35.062 22:52:25 -- common/autotest_common.sh@936 -- # '[' reactor_1 = sudo ']' 00:14:35.062 22:52:25 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 263460' 00:14:35.062 killing process with pid 263460 00:14:35.062 22:52:25 -- common/autotest_common.sh@945 -- # kill 263460 00:14:35.062 22:52:25 -- common/autotest_common.sh@950 -- # wait 263460 00:14:35.320 22:52:26 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:14:35.320 22:52:26 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:14:35.320 22:52:26 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:14:35.320 22:52:26 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:14:35.320 22:52:26 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:14:35.320 22:52:26 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:14:35.320 22:52:26 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:14:35.320 22:52:26 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:14:37.227 22:52:28 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:14:37.227 00:14:37.227 real 0m17.395s 00:14:37.227 user 0m24.997s 00:14:37.227 sys 0m3.081s 00:14:37.227 22:52:28 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:14:37.227 22:52:28 -- common/autotest_common.sh@10 -- # set +x 00:14:37.227 ************************************ 00:14:37.227 END TEST nvmf_queue_depth 00:14:37.227 ************************************ 00:14:37.227 22:52:28 -- nvmf/nvmf.sh@51 -- # run_test nvmf_multipath /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/multipath.sh --transport=tcp 00:14:37.227 22:52:28 -- common/autotest_common.sh@1077 -- # '[' 3 -le 1 ']' 00:14:37.227 22:52:28 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:14:37.227 22:52:28 -- common/autotest_common.sh@10 -- # set +x 00:14:37.227 ************************************ 00:14:37.227 START TEST nvmf_multipath 00:14:37.227 ************************************ 00:14:37.227 22:52:28 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/multipath.sh --transport=tcp 00:14:37.227 * Looking for test storage... 00:14:37.227 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:14:37.227 22:52:28 -- target/multipath.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:14:37.227 22:52:28 -- nvmf/common.sh@7 -- # uname -s 00:14:37.227 22:52:28 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:14:37.227 22:52:28 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:14:37.227 22:52:28 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:14:37.227 22:52:28 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:14:37.227 22:52:28 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:14:37.227 22:52:28 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:14:37.227 22:52:28 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:14:37.227 22:52:28 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:14:37.227 22:52:28 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:14:37.227 22:52:28 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:14:37.227 22:52:28 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:14:37.227 22:52:28 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:14:37.227 22:52:28 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:14:37.227 22:52:28 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:14:37.227 22:52:28 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:14:37.227 22:52:28 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:14:37.227 22:52:28 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:14:37.227 22:52:28 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:14:37.227 22:52:28 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:14:37.227 22:52:28 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:14:37.227 22:52:28 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:14:37.485 22:52:28 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:14:37.485 22:52:28 -- paths/export.sh@5 -- # export PATH 00:14:37.486 22:52:28 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:14:37.486 22:52:28 -- nvmf/common.sh@46 -- # : 0 00:14:37.486 22:52:28 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:14:37.486 22:52:28 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:14:37.486 22:52:28 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:14:37.486 22:52:28 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:14:37.486 22:52:28 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:14:37.486 22:52:28 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:14:37.486 22:52:28 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:14:37.486 22:52:28 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:14:37.486 22:52:28 -- target/multipath.sh@11 -- # MALLOC_BDEV_SIZE=64 00:14:37.486 22:52:28 -- target/multipath.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:14:37.486 22:52:28 -- target/multipath.sh@13 -- # nqn=nqn.2016-06.io.spdk:cnode1 00:14:37.486 22:52:28 -- target/multipath.sh@15 -- # rpc_py=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:14:37.486 22:52:28 -- target/multipath.sh@43 -- # nvmftestinit 00:14:37.486 22:52:28 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:14:37.486 22:52:28 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:14:37.486 22:52:28 -- nvmf/common.sh@436 -- # prepare_net_devs 00:14:37.486 22:52:28 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:14:37.486 22:52:28 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:14:37.486 22:52:28 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:14:37.486 22:52:28 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:14:37.486 22:52:28 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:14:37.486 22:52:28 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:14:37.486 22:52:28 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:14:37.486 22:52:28 -- nvmf/common.sh@284 -- # xtrace_disable 00:14:37.486 22:52:28 -- common/autotest_common.sh@10 -- # set +x 00:14:39.387 22:52:30 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:14:39.387 22:52:30 -- nvmf/common.sh@290 -- # pci_devs=() 00:14:39.387 22:52:30 -- nvmf/common.sh@290 -- # local -a pci_devs 00:14:39.387 22:52:30 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:14:39.387 22:52:30 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:14:39.387 22:52:30 -- nvmf/common.sh@292 -- # pci_drivers=() 00:14:39.387 22:52:30 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:14:39.387 22:52:30 -- nvmf/common.sh@294 -- # net_devs=() 00:14:39.387 22:52:30 -- nvmf/common.sh@294 -- # local -ga net_devs 00:14:39.387 22:52:30 -- nvmf/common.sh@295 -- # e810=() 00:14:39.387 22:52:30 -- nvmf/common.sh@295 -- # local -ga e810 00:14:39.387 22:52:30 -- nvmf/common.sh@296 -- # x722=() 00:14:39.387 22:52:30 -- nvmf/common.sh@296 -- # local -ga x722 00:14:39.387 22:52:30 -- nvmf/common.sh@297 -- # mlx=() 00:14:39.387 22:52:30 -- nvmf/common.sh@297 -- # local -ga mlx 00:14:39.387 22:52:30 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:14:39.387 22:52:30 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:14:39.387 22:52:30 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:14:39.387 22:52:30 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:14:39.387 22:52:30 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:14:39.387 22:52:30 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:14:39.387 22:52:30 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:14:39.387 22:52:30 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:14:39.387 22:52:30 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:14:39.387 22:52:30 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:14:39.387 22:52:30 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:14:39.387 22:52:30 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:14:39.387 22:52:30 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:14:39.387 22:52:30 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:14:39.387 22:52:30 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:14:39.387 22:52:30 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:14:39.387 22:52:30 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:14:39.387 22:52:30 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:14:39.387 22:52:30 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:14:39.387 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:14:39.387 22:52:30 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:14:39.387 22:52:30 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:14:39.387 22:52:30 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:14:39.387 22:52:30 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:14:39.387 22:52:30 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:14:39.387 22:52:30 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:14:39.387 22:52:30 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:14:39.387 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:14:39.387 22:52:30 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:14:39.387 22:52:30 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:14:39.387 22:52:30 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:14:39.387 22:52:30 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:14:39.387 22:52:30 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:14:39.387 22:52:30 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:14:39.387 22:52:30 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:14:39.387 22:52:30 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:14:39.387 22:52:30 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:14:39.387 22:52:30 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:14:39.387 22:52:30 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:14:39.387 22:52:30 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:14:39.387 22:52:30 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:14:39.387 Found net devices under 0000:0a:00.0: cvl_0_0 00:14:39.387 22:52:30 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:14:39.387 22:52:30 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:14:39.387 22:52:30 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:14:39.387 22:52:30 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:14:39.387 22:52:30 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:14:39.387 22:52:30 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:14:39.387 Found net devices under 0000:0a:00.1: cvl_0_1 00:14:39.387 22:52:30 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:14:39.387 22:52:30 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:14:39.387 22:52:30 -- nvmf/common.sh@402 -- # is_hw=yes 00:14:39.387 22:52:30 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:14:39.387 22:52:30 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:14:39.387 22:52:30 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:14:39.387 22:52:30 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:14:39.387 22:52:30 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:14:39.387 22:52:30 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:14:39.387 22:52:30 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:14:39.387 22:52:30 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:14:39.387 22:52:30 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:14:39.387 22:52:30 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:14:39.387 22:52:30 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:14:39.387 22:52:30 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:14:39.387 22:52:30 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:14:39.387 22:52:30 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:14:39.387 22:52:30 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:14:39.387 22:52:30 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:14:39.387 22:52:30 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:14:39.387 22:52:30 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:14:39.387 22:52:30 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:14:39.387 22:52:30 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:14:39.387 22:52:30 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:14:39.387 22:52:30 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:14:39.387 22:52:30 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:14:39.387 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:14:39.387 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.273 ms 00:14:39.387 00:14:39.387 --- 10.0.0.2 ping statistics --- 00:14:39.387 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:14:39.387 rtt min/avg/max/mdev = 0.273/0.273/0.273/0.000 ms 00:14:39.387 22:52:30 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:14:39.387 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:14:39.387 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.139 ms 00:14:39.387 00:14:39.387 --- 10.0.0.1 ping statistics --- 00:14:39.387 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:14:39.387 rtt min/avg/max/mdev = 0.139/0.139/0.139/0.000 ms 00:14:39.387 22:52:30 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:14:39.387 22:52:30 -- nvmf/common.sh@410 -- # return 0 00:14:39.387 22:52:30 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:14:39.387 22:52:30 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:14:39.388 22:52:30 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:14:39.388 22:52:30 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:14:39.388 22:52:30 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:14:39.388 22:52:30 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:14:39.388 22:52:30 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:14:39.388 22:52:30 -- target/multipath.sh@45 -- # '[' -z ']' 00:14:39.388 22:52:30 -- target/multipath.sh@46 -- # echo 'only one NIC for nvmf test' 00:14:39.388 only one NIC for nvmf test 00:14:39.388 22:52:30 -- target/multipath.sh@47 -- # nvmftestfini 00:14:39.388 22:52:30 -- nvmf/common.sh@476 -- # nvmfcleanup 00:14:39.388 22:52:30 -- nvmf/common.sh@116 -- # sync 00:14:39.388 22:52:30 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:14:39.388 22:52:30 -- nvmf/common.sh@119 -- # set +e 00:14:39.388 22:52:30 -- nvmf/common.sh@120 -- # for i in {1..20} 00:14:39.388 22:52:30 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:14:39.388 rmmod nvme_tcp 00:14:39.388 rmmod nvme_fabrics 00:14:39.388 rmmod nvme_keyring 00:14:39.388 22:52:30 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:14:39.388 22:52:30 -- nvmf/common.sh@123 -- # set -e 00:14:39.388 22:52:30 -- nvmf/common.sh@124 -- # return 0 00:14:39.388 22:52:30 -- nvmf/common.sh@477 -- # '[' -n '' ']' 00:14:39.388 22:52:30 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:14:39.388 22:52:30 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:14:39.388 22:52:30 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:14:39.388 22:52:30 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:14:39.388 22:52:30 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:14:39.388 22:52:30 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:14:39.388 22:52:30 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:14:39.388 22:52:30 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:14:41.923 22:52:32 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:14:41.923 22:52:32 -- target/multipath.sh@48 -- # exit 0 00:14:41.923 22:52:32 -- target/multipath.sh@1 -- # nvmftestfini 00:14:41.923 22:52:32 -- nvmf/common.sh@476 -- # nvmfcleanup 00:14:41.923 22:52:32 -- nvmf/common.sh@116 -- # sync 00:14:41.923 22:52:32 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:14:41.923 22:52:32 -- nvmf/common.sh@119 -- # set +e 00:14:41.923 22:52:32 -- nvmf/common.sh@120 -- # for i in {1..20} 00:14:41.923 22:52:32 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:14:41.923 22:52:32 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:14:41.923 22:52:32 -- nvmf/common.sh@123 -- # set -e 00:14:41.923 22:52:32 -- nvmf/common.sh@124 -- # return 0 00:14:41.923 22:52:32 -- nvmf/common.sh@477 -- # '[' -n '' ']' 00:14:41.923 22:52:32 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:14:41.923 22:52:32 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:14:41.923 22:52:32 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:14:41.923 22:52:32 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:14:41.923 22:52:32 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:14:41.923 22:52:32 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:14:41.923 22:52:32 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:14:41.923 22:52:32 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:14:41.923 22:52:32 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:14:41.923 00:14:41.923 real 0m4.266s 00:14:41.923 user 0m0.775s 00:14:41.923 sys 0m1.496s 00:14:41.923 22:52:32 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:14:41.923 22:52:32 -- common/autotest_common.sh@10 -- # set +x 00:14:41.923 ************************************ 00:14:41.923 END TEST nvmf_multipath 00:14:41.923 ************************************ 00:14:41.923 22:52:32 -- nvmf/nvmf.sh@52 -- # run_test nvmf_zcopy /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/zcopy.sh --transport=tcp 00:14:41.923 22:52:32 -- common/autotest_common.sh@1077 -- # '[' 3 -le 1 ']' 00:14:41.923 22:52:32 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:14:41.923 22:52:32 -- common/autotest_common.sh@10 -- # set +x 00:14:41.923 ************************************ 00:14:41.923 START TEST nvmf_zcopy 00:14:41.923 ************************************ 00:14:41.923 22:52:32 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/zcopy.sh --transport=tcp 00:14:41.923 * Looking for test storage... 00:14:41.923 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:14:41.923 22:52:32 -- target/zcopy.sh@10 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:14:41.923 22:52:32 -- nvmf/common.sh@7 -- # uname -s 00:14:41.923 22:52:32 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:14:41.923 22:52:32 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:14:41.923 22:52:32 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:14:41.923 22:52:32 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:14:41.923 22:52:32 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:14:41.923 22:52:32 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:14:41.923 22:52:32 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:14:41.923 22:52:32 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:14:41.923 22:52:32 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:14:41.923 22:52:32 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:14:41.923 22:52:32 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:14:41.923 22:52:32 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:14:41.923 22:52:32 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:14:41.923 22:52:32 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:14:41.923 22:52:32 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:14:41.923 22:52:32 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:14:41.923 22:52:32 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:14:41.923 22:52:32 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:14:41.923 22:52:32 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:14:41.923 22:52:32 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:14:41.923 22:52:32 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:14:41.923 22:52:32 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:14:41.923 22:52:32 -- paths/export.sh@5 -- # export PATH 00:14:41.923 22:52:32 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:14:41.923 22:52:32 -- nvmf/common.sh@46 -- # : 0 00:14:41.923 22:52:32 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:14:41.923 22:52:32 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:14:41.923 22:52:32 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:14:41.923 22:52:32 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:14:41.923 22:52:32 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:14:41.923 22:52:32 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:14:41.923 22:52:32 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:14:41.923 22:52:32 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:14:41.923 22:52:32 -- target/zcopy.sh@12 -- # nvmftestinit 00:14:41.923 22:52:32 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:14:41.923 22:52:32 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:14:41.923 22:52:32 -- nvmf/common.sh@436 -- # prepare_net_devs 00:14:41.923 22:52:32 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:14:41.923 22:52:32 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:14:41.923 22:52:32 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:14:41.923 22:52:32 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:14:41.923 22:52:32 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:14:41.923 22:52:32 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:14:41.923 22:52:32 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:14:41.923 22:52:32 -- nvmf/common.sh@284 -- # xtrace_disable 00:14:41.923 22:52:32 -- common/autotest_common.sh@10 -- # set +x 00:14:43.833 22:52:34 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:14:43.833 22:52:34 -- nvmf/common.sh@290 -- # pci_devs=() 00:14:43.833 22:52:34 -- nvmf/common.sh@290 -- # local -a pci_devs 00:14:43.833 22:52:34 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:14:43.833 22:52:34 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:14:43.833 22:52:34 -- nvmf/common.sh@292 -- # pci_drivers=() 00:14:43.833 22:52:34 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:14:43.833 22:52:34 -- nvmf/common.sh@294 -- # net_devs=() 00:14:43.833 22:52:34 -- nvmf/common.sh@294 -- # local -ga net_devs 00:14:43.833 22:52:34 -- nvmf/common.sh@295 -- # e810=() 00:14:43.833 22:52:34 -- nvmf/common.sh@295 -- # local -ga e810 00:14:43.833 22:52:34 -- nvmf/common.sh@296 -- # x722=() 00:14:43.833 22:52:34 -- nvmf/common.sh@296 -- # local -ga x722 00:14:43.833 22:52:34 -- nvmf/common.sh@297 -- # mlx=() 00:14:43.833 22:52:34 -- nvmf/common.sh@297 -- # local -ga mlx 00:14:43.833 22:52:34 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:14:43.833 22:52:34 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:14:43.833 22:52:34 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:14:43.833 22:52:34 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:14:43.833 22:52:34 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:14:43.833 22:52:34 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:14:43.833 22:52:34 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:14:43.833 22:52:34 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:14:43.833 22:52:34 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:14:43.833 22:52:34 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:14:43.833 22:52:34 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:14:43.833 22:52:34 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:14:43.833 22:52:34 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:14:43.833 22:52:34 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:14:43.833 22:52:34 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:14:43.833 22:52:34 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:14:43.833 22:52:34 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:14:43.833 22:52:34 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:14:43.833 22:52:34 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:14:43.833 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:14:43.833 22:52:34 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:14:43.833 22:52:34 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:14:43.833 22:52:34 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:14:43.833 22:52:34 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:14:43.834 22:52:34 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:14:43.834 22:52:34 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:14:43.834 22:52:34 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:14:43.834 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:14:43.834 22:52:34 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:14:43.834 22:52:34 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:14:43.834 22:52:34 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:14:43.834 22:52:34 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:14:43.834 22:52:34 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:14:43.834 22:52:34 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:14:43.834 22:52:34 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:14:43.834 22:52:34 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:14:43.834 22:52:34 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:14:43.834 22:52:34 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:14:43.834 22:52:34 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:14:43.834 22:52:34 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:14:43.834 22:52:34 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:14:43.834 Found net devices under 0000:0a:00.0: cvl_0_0 00:14:43.834 22:52:34 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:14:43.834 22:52:34 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:14:43.834 22:52:34 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:14:43.834 22:52:34 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:14:43.834 22:52:34 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:14:43.834 22:52:34 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:14:43.834 Found net devices under 0000:0a:00.1: cvl_0_1 00:14:43.834 22:52:34 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:14:43.834 22:52:34 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:14:43.834 22:52:34 -- nvmf/common.sh@402 -- # is_hw=yes 00:14:43.834 22:52:34 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:14:43.834 22:52:34 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:14:43.834 22:52:34 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:14:43.834 22:52:34 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:14:43.834 22:52:34 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:14:43.834 22:52:34 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:14:43.834 22:52:34 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:14:43.834 22:52:34 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:14:43.834 22:52:34 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:14:43.834 22:52:34 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:14:43.834 22:52:34 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:14:43.834 22:52:34 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:14:43.834 22:52:34 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:14:43.834 22:52:34 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:14:43.834 22:52:34 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:14:43.834 22:52:34 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:14:43.834 22:52:34 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:14:43.834 22:52:34 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:14:43.834 22:52:34 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:14:43.834 22:52:34 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:14:43.834 22:52:34 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:14:43.834 22:52:34 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:14:43.834 22:52:34 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:14:43.834 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:14:43.834 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.237 ms 00:14:43.834 00:14:43.834 --- 10.0.0.2 ping statistics --- 00:14:43.834 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:14:43.834 rtt min/avg/max/mdev = 0.237/0.237/0.237/0.000 ms 00:14:43.834 22:52:34 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:14:43.834 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:14:43.834 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.095 ms 00:14:43.834 00:14:43.834 --- 10.0.0.1 ping statistics --- 00:14:43.834 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:14:43.834 rtt min/avg/max/mdev = 0.095/0.095/0.095/0.000 ms 00:14:43.834 22:52:34 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:14:43.834 22:52:34 -- nvmf/common.sh@410 -- # return 0 00:14:43.834 22:52:34 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:14:43.834 22:52:34 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:14:43.834 22:52:34 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:14:43.834 22:52:34 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:14:43.834 22:52:34 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:14:43.834 22:52:34 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:14:43.834 22:52:34 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:14:43.834 22:52:34 -- target/zcopy.sh@13 -- # nvmfappstart -m 0x2 00:14:43.834 22:52:34 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:14:43.834 22:52:34 -- common/autotest_common.sh@712 -- # xtrace_disable 00:14:43.834 22:52:34 -- common/autotest_common.sh@10 -- # set +x 00:14:43.834 22:52:34 -- nvmf/common.sh@469 -- # nvmfpid=268871 00:14:43.834 22:52:34 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x2 00:14:43.834 22:52:34 -- nvmf/common.sh@470 -- # waitforlisten 268871 00:14:43.834 22:52:34 -- common/autotest_common.sh@819 -- # '[' -z 268871 ']' 00:14:43.834 22:52:34 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk.sock 00:14:43.834 22:52:34 -- common/autotest_common.sh@824 -- # local max_retries=100 00:14:43.834 22:52:34 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:14:43.834 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:14:43.834 22:52:34 -- common/autotest_common.sh@828 -- # xtrace_disable 00:14:43.834 22:52:34 -- common/autotest_common.sh@10 -- # set +x 00:14:43.834 [2024-04-16 22:52:34.804109] Starting SPDK v24.01.1-pre git sha1 4b134b4ab / DPDK 23.11.0 initialization... 00:14:43.834 [2024-04-16 22:52:34.804201] [ DPDK EAL parameters: nvmf -c 0x2 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:14:43.834 EAL: No free 2048 kB hugepages reported on node 1 00:14:43.834 [2024-04-16 22:52:34.872126] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:14:44.092 [2024-04-16 22:52:34.994848] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:14:44.092 [2024-04-16 22:52:34.995005] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:14:44.092 [2024-04-16 22:52:34.995024] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:14:44.092 [2024-04-16 22:52:34.995038] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:14:44.092 [2024-04-16 22:52:34.995075] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:14:45.030 22:52:35 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:14:45.030 22:52:35 -- common/autotest_common.sh@852 -- # return 0 00:14:45.030 22:52:35 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:14:45.030 22:52:35 -- common/autotest_common.sh@718 -- # xtrace_disable 00:14:45.030 22:52:35 -- common/autotest_common.sh@10 -- # set +x 00:14:45.030 22:52:35 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:14:45.030 22:52:35 -- target/zcopy.sh@15 -- # '[' tcp '!=' tcp ']' 00:14:45.030 22:52:35 -- target/zcopy.sh@22 -- # rpc_cmd nvmf_create_transport -t tcp -o -c 0 --zcopy 00:14:45.030 22:52:35 -- common/autotest_common.sh@551 -- # xtrace_disable 00:14:45.030 22:52:35 -- common/autotest_common.sh@10 -- # set +x 00:14:45.030 [2024-04-16 22:52:35.816900] tcp.c: 659:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:14:45.030 22:52:35 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:14:45.030 22:52:35 -- target/zcopy.sh@24 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 -m 10 00:14:45.030 22:52:35 -- common/autotest_common.sh@551 -- # xtrace_disable 00:14:45.030 22:52:35 -- common/autotest_common.sh@10 -- # set +x 00:14:45.030 22:52:35 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:14:45.030 22:52:35 -- target/zcopy.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:14:45.030 22:52:35 -- common/autotest_common.sh@551 -- # xtrace_disable 00:14:45.030 22:52:35 -- common/autotest_common.sh@10 -- # set +x 00:14:45.030 [2024-04-16 22:52:35.833048] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:14:45.030 22:52:35 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:14:45.031 22:52:35 -- target/zcopy.sh@27 -- # rpc_cmd nvmf_subsystem_add_listener discovery -t tcp -a 10.0.0.2 -s 4420 00:14:45.031 22:52:35 -- common/autotest_common.sh@551 -- # xtrace_disable 00:14:45.031 22:52:35 -- common/autotest_common.sh@10 -- # set +x 00:14:45.031 22:52:35 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:14:45.031 22:52:35 -- target/zcopy.sh@29 -- # rpc_cmd bdev_malloc_create 32 4096 -b malloc0 00:14:45.031 22:52:35 -- common/autotest_common.sh@551 -- # xtrace_disable 00:14:45.031 22:52:35 -- common/autotest_common.sh@10 -- # set +x 00:14:45.031 malloc0 00:14:45.031 22:52:35 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:14:45.031 22:52:35 -- target/zcopy.sh@30 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 malloc0 -n 1 00:14:45.031 22:52:35 -- common/autotest_common.sh@551 -- # xtrace_disable 00:14:45.031 22:52:35 -- common/autotest_common.sh@10 -- # set +x 00:14:45.031 22:52:35 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:14:45.031 22:52:35 -- target/zcopy.sh@33 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf --json /dev/fd/62 -t 10 -q 128 -w verify -o 8192 00:14:45.031 22:52:35 -- target/zcopy.sh@33 -- # gen_nvmf_target_json 00:14:45.031 22:52:35 -- nvmf/common.sh@520 -- # config=() 00:14:45.031 22:52:35 -- nvmf/common.sh@520 -- # local subsystem config 00:14:45.031 22:52:35 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:14:45.031 22:52:35 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:14:45.031 { 00:14:45.031 "params": { 00:14:45.031 "name": "Nvme$subsystem", 00:14:45.031 "trtype": "$TEST_TRANSPORT", 00:14:45.031 "traddr": "$NVMF_FIRST_TARGET_IP", 00:14:45.031 "adrfam": "ipv4", 00:14:45.031 "trsvcid": "$NVMF_PORT", 00:14:45.031 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:14:45.031 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:14:45.031 "hdgst": ${hdgst:-false}, 00:14:45.031 "ddgst": ${ddgst:-false} 00:14:45.031 }, 00:14:45.031 "method": "bdev_nvme_attach_controller" 00:14:45.031 } 00:14:45.031 EOF 00:14:45.031 )") 00:14:45.031 22:52:35 -- nvmf/common.sh@542 -- # cat 00:14:45.031 22:52:35 -- nvmf/common.sh@544 -- # jq . 00:14:45.031 22:52:35 -- nvmf/common.sh@545 -- # IFS=, 00:14:45.031 22:52:35 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:14:45.031 "params": { 00:14:45.031 "name": "Nvme1", 00:14:45.031 "trtype": "tcp", 00:14:45.031 "traddr": "10.0.0.2", 00:14:45.031 "adrfam": "ipv4", 00:14:45.031 "trsvcid": "4420", 00:14:45.031 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:14:45.031 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:14:45.031 "hdgst": false, 00:14:45.031 "ddgst": false 00:14:45.031 }, 00:14:45.031 "method": "bdev_nvme_attach_controller" 00:14:45.031 }' 00:14:45.031 [2024-04-16 22:52:35.901581] Starting SPDK v24.01.1-pre git sha1 4b134b4ab / DPDK 23.11.0 initialization... 00:14:45.031 [2024-04-16 22:52:35.901667] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid269027 ] 00:14:45.031 EAL: No free 2048 kB hugepages reported on node 1 00:14:45.031 [2024-04-16 22:52:35.964370] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:14:45.031 [2024-04-16 22:52:36.078856] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:14:45.291 Running I/O for 10 seconds... 00:14:55.303 00:14:55.303 Latency(us) 00:14:55.303 Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:14:55.303 Job: Nvme1n1 (Core Mask 0x1, workload: verify, depth: 128, IO size: 8192) 00:14:55.303 Verification LBA range: start 0x0 length 0x1000 00:14:55.303 Nvme1n1 : 10.01 8647.57 67.56 0.00 0.00 14767.54 1165.08 23204.60 00:14:55.303 =================================================================================================================== 00:14:55.303 Total : 8647.57 67.56 0.00 0.00 14767.54 1165.08 23204.60 00:14:55.562 22:52:46 -- target/zcopy.sh@39 -- # perfpid=270255 00:14:55.562 22:52:46 -- target/zcopy.sh@41 -- # xtrace_disable 00:14:55.562 22:52:46 -- common/autotest_common.sh@10 -- # set +x 00:14:55.562 22:52:46 -- target/zcopy.sh@37 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf --json /dev/fd/63 -t 5 -q 128 -w randrw -M 50 -o 8192 00:14:55.562 22:52:46 -- target/zcopy.sh@37 -- # gen_nvmf_target_json 00:14:55.562 22:52:46 -- nvmf/common.sh@520 -- # config=() 00:14:55.562 22:52:46 -- nvmf/common.sh@520 -- # local subsystem config 00:14:55.562 22:52:46 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:14:55.562 22:52:46 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:14:55.562 { 00:14:55.562 "params": { 00:14:55.562 "name": "Nvme$subsystem", 00:14:55.562 "trtype": "$TEST_TRANSPORT", 00:14:55.562 "traddr": "$NVMF_FIRST_TARGET_IP", 00:14:55.562 "adrfam": "ipv4", 00:14:55.562 "trsvcid": "$NVMF_PORT", 00:14:55.562 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:14:55.562 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:14:55.562 "hdgst": ${hdgst:-false}, 00:14:55.562 "ddgst": ${ddgst:-false} 00:14:55.562 }, 00:14:55.562 "method": "bdev_nvme_attach_controller" 00:14:55.562 } 00:14:55.562 EOF 00:14:55.562 )") 00:14:55.562 22:52:46 -- nvmf/common.sh@542 -- # cat 00:14:55.562 [2024-04-16 22:52:46.592130] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:14:55.562 [2024-04-16 22:52:46.592183] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:14:55.562 22:52:46 -- nvmf/common.sh@544 -- # jq . 00:14:55.562 22:52:46 -- nvmf/common.sh@545 -- # IFS=, 00:14:55.562 22:52:46 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:14:55.562 "params": { 00:14:55.562 "name": "Nvme1", 00:14:55.562 "trtype": "tcp", 00:14:55.562 "traddr": "10.0.0.2", 00:14:55.562 "adrfam": "ipv4", 00:14:55.562 "trsvcid": "4420", 00:14:55.562 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:14:55.562 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:14:55.562 "hdgst": false, 00:14:55.562 "ddgst": false 00:14:55.562 }, 00:14:55.562 "method": "bdev_nvme_attach_controller" 00:14:55.562 }' 00:14:55.562 [2024-04-16 22:52:46.600098] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:14:55.562 [2024-04-16 22:52:46.600125] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:14:55.562 [2024-04-16 22:52:46.608121] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:14:55.562 [2024-04-16 22:52:46.608146] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:14:55.562 [2024-04-16 22:52:46.616142] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:14:55.562 [2024-04-16 22:52:46.616167] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:14:55.562 [2024-04-16 22:52:46.624164] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:14:55.562 [2024-04-16 22:52:46.624204] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:14:55.562 [2024-04-16 22:52:46.626567] Starting SPDK v24.01.1-pre git sha1 4b134b4ab / DPDK 23.11.0 initialization... 00:14:55.562 [2024-04-16 22:52:46.626634] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid270255 ] 00:14:55.562 [2024-04-16 22:52:46.632195] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:14:55.562 [2024-04-16 22:52:46.632220] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:14:55.562 [2024-04-16 22:52:46.640212] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:14:55.562 [2024-04-16 22:52:46.640240] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:14:55.562 [2024-04-16 22:52:46.648237] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:14:55.562 [2024-04-16 22:52:46.648261] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:14:55.562 [2024-04-16 22:52:46.656252] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:14:55.562 [2024-04-16 22:52:46.656276] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:14:55.562 EAL: No free 2048 kB hugepages reported on node 1 00:14:55.562 [2024-04-16 22:52:46.664272] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:14:55.562 [2024-04-16 22:52:46.664296] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:14:55.562 [2024-04-16 22:52:46.672297] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:14:55.562 [2024-04-16 22:52:46.672321] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:14:55.562 [2024-04-16 22:52:46.680313] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:14:55.562 [2024-04-16 22:52:46.680338] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:14:55.562 [2024-04-16 22:52:46.688339] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:14:55.562 [2024-04-16 22:52:46.688363] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:14:55.821 [2024-04-16 22:52:46.694499] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:14:55.821 [2024-04-16 22:52:46.696357] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:14:55.821 [2024-04-16 22:52:46.696381] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:14:55.821 [2024-04-16 22:52:46.704409] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:14:55.821 [2024-04-16 22:52:46.704444] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:14:55.821 [2024-04-16 22:52:46.712410] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:14:55.821 [2024-04-16 22:52:46.712437] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:14:55.821 [2024-04-16 22:52:46.720426] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:14:55.821 [2024-04-16 22:52:46.720450] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:14:55.821 [2024-04-16 22:52:46.728447] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:14:55.821 [2024-04-16 22:52:46.728471] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:14:55.821 [2024-04-16 22:52:46.736474] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:14:55.821 [2024-04-16 22:52:46.736500] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:14:55.821 [2024-04-16 22:52:46.744490] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:14:55.821 [2024-04-16 22:52:46.744514] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:14:55.821 [2024-04-16 22:52:46.752514] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:14:55.821 [2024-04-16 22:52:46.752538] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:14:55.821 [2024-04-16 22:52:46.760542] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:14:55.821 [2024-04-16 22:52:46.760569] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:14:55.821 [2024-04-16 22:52:46.768580] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:14:55.821 [2024-04-16 22:52:46.768615] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:14:55.821 [2024-04-16 22:52:46.776583] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:14:55.821 [2024-04-16 22:52:46.776607] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:14:55.821 [2024-04-16 22:52:46.784606] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:14:55.821 [2024-04-16 22:52:46.784630] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:14:55.821 [2024-04-16 22:52:46.792630] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:14:55.821 [2024-04-16 22:52:46.792654] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:14:55.821 [2024-04-16 22:52:46.800651] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:14:55.821 [2024-04-16 22:52:46.800675] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:14:55.821 [2024-04-16 22:52:46.808673] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:14:55.821 [2024-04-16 22:52:46.808699] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:14:55.821 [2024-04-16 22:52:46.816695] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:14:55.821 [2024-04-16 22:52:46.816719] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:14:55.821 [2024-04-16 22:52:46.816717] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:14:55.821 [2024-04-16 22:52:46.824719] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:14:55.821 [2024-04-16 22:52:46.824743] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:14:55.821 [2024-04-16 22:52:46.832756] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:14:55.821 [2024-04-16 22:52:46.832788] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:14:55.821 [2024-04-16 22:52:46.840787] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:14:55.821 [2024-04-16 22:52:46.840823] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:14:55.821 [2024-04-16 22:52:46.848820] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:14:55.821 [2024-04-16 22:52:46.848864] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:14:55.821 [2024-04-16 22:52:46.856846] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:14:55.821 [2024-04-16 22:52:46.856886] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:14:55.821 [2024-04-16 22:52:46.864864] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:14:55.821 [2024-04-16 22:52:46.864904] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:14:55.821 [2024-04-16 22:52:46.872891] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:14:55.821 [2024-04-16 22:52:46.872929] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:14:55.822 [2024-04-16 22:52:46.880889] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:14:55.822 [2024-04-16 22:52:46.880924] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:14:55.822 [2024-04-16 22:52:46.888903] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:14:55.822 [2024-04-16 22:52:46.888929] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:14:55.822 [2024-04-16 22:52:46.896946] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:14:55.822 [2024-04-16 22:52:46.896984] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:14:55.822 [2024-04-16 22:52:46.904973] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:14:55.822 [2024-04-16 22:52:46.905021] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:14:55.822 [2024-04-16 22:52:46.912967] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:14:55.822 [2024-04-16 22:52:46.912991] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:14:55.822 [2024-04-16 22:52:46.920997] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:14:55.822 [2024-04-16 22:52:46.921026] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:14:55.822 [2024-04-16 22:52:46.929028] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:14:55.822 [2024-04-16 22:52:46.929057] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:14:55.822 [2024-04-16 22:52:46.937093] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:14:55.822 [2024-04-16 22:52:46.937127] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:14:55.822 [2024-04-16 22:52:46.945113] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:14:55.822 [2024-04-16 22:52:46.945141] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:14:56.081 [2024-04-16 22:52:46.953170] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:14:56.081 [2024-04-16 22:52:46.953209] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:14:56.081 [2024-04-16 22:52:46.961167] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:14:56.081 [2024-04-16 22:52:46.961200] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:14:56.081 [2024-04-16 22:52:46.969197] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:14:56.081 [2024-04-16 22:52:46.969234] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:14:56.081 [2024-04-16 22:52:46.977219] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:14:56.081 [2024-04-16 22:52:46.977254] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:14:56.081 [2024-04-16 22:52:46.985244] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:14:56.081 [2024-04-16 22:52:46.985269] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:14:56.081 [2024-04-16 22:52:46.993262] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:14:56.081 [2024-04-16 22:52:46.993287] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:14:56.081 [2024-04-16 22:52:47.001373] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:14:56.081 [2024-04-16 22:52:47.001401] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:14:56.081 [2024-04-16 22:52:47.009381] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:14:56.081 [2024-04-16 22:52:47.009409] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:14:56.081 [2024-04-16 22:52:47.017401] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:14:56.081 [2024-04-16 22:52:47.017426] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:14:56.081 [2024-04-16 22:52:47.025420] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:14:56.081 [2024-04-16 22:52:47.025445] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:14:56.081 [2024-04-16 22:52:47.033443] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:14:56.081 [2024-04-16 22:52:47.033467] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:14:56.081 [2024-04-16 22:52:47.041467] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:14:56.081 [2024-04-16 22:52:47.041491] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:14:56.081 [2024-04-16 22:52:47.049492] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:14:56.082 [2024-04-16 22:52:47.049518] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:14:56.082 [2024-04-16 22:52:47.057515] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:14:56.082 [2024-04-16 22:52:47.057549] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:14:56.082 [2024-04-16 22:52:47.065535] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:14:56.082 [2024-04-16 22:52:47.065559] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:14:56.082 [2024-04-16 22:52:47.073559] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:14:56.082 [2024-04-16 22:52:47.073583] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:14:56.082 [2024-04-16 22:52:47.081580] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:14:56.082 [2024-04-16 22:52:47.081605] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:14:56.082 [2024-04-16 22:52:47.089605] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:14:56.082 [2024-04-16 22:52:47.089630] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:14:56.082 [2024-04-16 22:52:47.097634] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:14:56.082 [2024-04-16 22:52:47.097662] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:14:56.082 [2024-04-16 22:52:47.105653] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:14:56.082 [2024-04-16 22:52:47.105678] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:14:56.082 [2024-04-16 22:52:47.113677] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:14:56.082 [2024-04-16 22:52:47.113701] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:14:56.082 [2024-04-16 22:52:47.121701] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:14:56.082 [2024-04-16 22:52:47.121725] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:14:56.082 [2024-04-16 22:52:47.129726] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:14:56.082 [2024-04-16 22:52:47.129750] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:14:56.082 [2024-04-16 22:52:47.137752] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:14:56.082 [2024-04-16 22:52:47.137777] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:14:56.082 [2024-04-16 22:52:47.145773] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:14:56.082 [2024-04-16 22:52:47.145797] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:14:56.082 [2024-04-16 22:52:47.153807] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:14:56.082 [2024-04-16 22:52:47.153836] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:14:56.082 Running I/O for 5 seconds... 00:14:56.082 [2024-04-16 22:52:47.161824] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:14:56.082 [2024-04-16 22:52:47.161849] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:14:56.082 [2024-04-16 22:52:47.173888] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:14:56.082 [2024-04-16 22:52:47.173919] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:14:56.082 [2024-04-16 22:52:47.184121] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:14:56.082 [2024-04-16 22:52:47.184153] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:14:56.082 [2024-04-16 22:52:47.195823] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:14:56.082 [2024-04-16 22:52:47.195854] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:14:56.082 [2024-04-16 22:52:47.206395] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:14:56.082 [2024-04-16 22:52:47.206425] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:14:56.339 [2024-04-16 22:52:47.217651] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:14:56.339 [2024-04-16 22:52:47.217682] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:14:56.339 [2024-04-16 22:52:47.230487] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:14:56.340 [2024-04-16 22:52:47.230518] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:14:56.340 [2024-04-16 22:52:47.240404] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:14:56.340 [2024-04-16 22:52:47.240435] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:14:56.340 [2024-04-16 22:52:47.252482] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:14:56.340 [2024-04-16 22:52:47.252512] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:14:56.340 [2024-04-16 22:52:47.265250] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:14:56.340 [2024-04-16 22:52:47.265280] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:14:56.340 [2024-04-16 22:52:47.275298] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:14:56.340 [2024-04-16 22:52:47.275328] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:14:56.340 [2024-04-16 22:52:47.286367] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:14:56.340 [2024-04-16 22:52:47.286397] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:14:56.340 [2024-04-16 22:52:47.299163] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:14:56.340 [2024-04-16 22:52:47.299202] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:14:56.340 [2024-04-16 22:52:47.309083] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:14:56.340 [2024-04-16 22:52:47.309113] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:14:56.340 [2024-04-16 22:52:47.320860] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:14:56.340 [2024-04-16 22:52:47.320890] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:14:56.340 [2024-04-16 22:52:47.332023] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:14:56.340 [2024-04-16 22:52:47.332053] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:14:56.340 [2024-04-16 22:52:47.343144] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:14:56.340 [2024-04-16 22:52:47.343183] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:14:56.340 [2024-04-16 22:52:47.353914] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:14:56.340 [2024-04-16 22:52:47.353944] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:14:56.340 [2024-04-16 22:52:47.366722] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:14:56.340 [2024-04-16 22:52:47.366752] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:14:56.340 [2024-04-16 22:52:47.375878] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:14:56.340 [2024-04-16 22:52:47.375908] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:14:56.340 [2024-04-16 22:52:47.387470] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:14:56.340 [2024-04-16 22:52:47.387500] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:14:56.340 [2024-04-16 22:52:47.400106] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:14:56.340 [2024-04-16 22:52:47.400135] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:14:56.340 [2024-04-16 22:52:47.410072] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:14:56.340 [2024-04-16 22:52:47.410102] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:14:56.340 [2024-04-16 22:52:47.421099] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:14:56.340 [2024-04-16 22:52:47.421129] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:14:56.340 [2024-04-16 22:52:47.432659] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:14:56.340 [2024-04-16 22:52:47.432688] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:14:56.340 [2024-04-16 22:52:47.444054] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:14:56.340 [2024-04-16 22:52:47.444084] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:14:56.340 [2024-04-16 22:52:47.455367] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:14:56.340 [2024-04-16 22:52:47.455397] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:14:56.340 [2024-04-16 22:52:47.468198] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:14:56.340 [2024-04-16 22:52:47.468228] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:14:56.597 [2024-04-16 22:52:47.478785] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:14:56.597 [2024-04-16 22:52:47.478815] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:14:56.597 [2024-04-16 22:52:47.489667] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:14:56.597 [2024-04-16 22:52:47.489696] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:14:56.597 [2024-04-16 22:52:47.502637] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:14:56.597 [2024-04-16 22:52:47.502668] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:14:56.597 [2024-04-16 22:52:47.512486] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:14:56.597 [2024-04-16 22:52:47.512522] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:14:56.597 [2024-04-16 22:52:47.523416] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:14:56.597 [2024-04-16 22:52:47.523446] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:14:56.597 [2024-04-16 22:52:47.535986] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:14:56.597 [2024-04-16 22:52:47.536017] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:14:56.597 [2024-04-16 22:52:47.546252] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:14:56.597 [2024-04-16 22:52:47.546282] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:14:56.597 [2024-04-16 22:52:47.557721] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:14:56.597 [2024-04-16 22:52:47.557751] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:14:56.597 [2024-04-16 22:52:47.568683] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:14:56.597 [2024-04-16 22:52:47.568713] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:14:56.597 [2024-04-16 22:52:47.579983] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:14:56.597 [2024-04-16 22:52:47.580014] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:14:56.597 [2024-04-16 22:52:47.590895] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:14:56.597 [2024-04-16 22:52:47.590924] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:14:56.597 [2024-04-16 22:52:47.602276] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:14:56.597 [2024-04-16 22:52:47.602306] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:14:56.597 [2024-04-16 22:52:47.613277] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:14:56.597 [2024-04-16 22:52:47.613307] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:14:56.597 [2024-04-16 22:52:47.626161] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:14:56.597 [2024-04-16 22:52:47.626207] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:14:56.597 [2024-04-16 22:52:47.635877] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:14:56.597 [2024-04-16 22:52:47.635907] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:14:56.597 [2024-04-16 22:52:47.646449] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:14:56.597 [2024-04-16 22:52:47.646478] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:14:56.597 [2024-04-16 22:52:47.657376] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:14:56.597 [2024-04-16 22:52:47.657407] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:14:56.597 [2024-04-16 22:52:47.669028] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:14:56.597 [2024-04-16 22:52:47.669058] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:14:56.597 [2024-04-16 22:52:47.679829] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:14:56.597 [2024-04-16 22:52:47.679859] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:14:56.597 [2024-04-16 22:52:47.690410] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:14:56.597 [2024-04-16 22:52:47.690441] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:14:56.598 [2024-04-16 22:52:47.701495] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:14:56.598 [2024-04-16 22:52:47.701531] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:14:56.598 [2024-04-16 22:52:47.714465] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:14:56.598 [2024-04-16 22:52:47.714495] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:14:56.598 [2024-04-16 22:52:47.725378] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:14:56.598 [2024-04-16 22:52:47.725409] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:14:56.855 [2024-04-16 22:52:47.736639] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:14:56.855 [2024-04-16 22:52:47.736670] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:14:56.855 [2024-04-16 22:52:47.747730] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:14:56.855 [2024-04-16 22:52:47.747761] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:14:56.855 [2024-04-16 22:52:47.759240] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:14:56.855 [2024-04-16 22:52:47.759270] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:14:56.855 [2024-04-16 22:52:47.770263] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:14:56.855 [2024-04-16 22:52:47.770293] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:14:56.855 [2024-04-16 22:52:47.781336] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:14:56.855 [2024-04-16 22:52:47.781366] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:14:56.855 [2024-04-16 22:52:47.792746] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:14:56.855 [2024-04-16 22:52:47.792776] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:14:56.855 [2024-04-16 22:52:47.804120] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:14:56.855 [2024-04-16 22:52:47.804149] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:14:56.855 [2024-04-16 22:52:47.815013] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:14:56.855 [2024-04-16 22:52:47.815043] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:14:56.855 [2024-04-16 22:52:47.826152] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:14:56.855 [2024-04-16 22:52:47.826190] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:14:56.855 [2024-04-16 22:52:47.839053] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:14:56.855 [2024-04-16 22:52:47.839083] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:14:56.855 [2024-04-16 22:52:47.848981] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:14:56.855 [2024-04-16 22:52:47.849011] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:14:56.855 [2024-04-16 22:52:47.859776] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:14:56.855 [2024-04-16 22:52:47.859806] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:14:56.855 [2024-04-16 22:52:47.870785] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:14:56.855 [2024-04-16 22:52:47.870815] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:14:56.855 [2024-04-16 22:52:47.881976] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:14:56.855 [2024-04-16 22:52:47.882006] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:14:56.855 [2024-04-16 22:52:47.895090] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:14:56.855 [2024-04-16 22:52:47.895120] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:14:56.855 [2024-04-16 22:52:47.905705] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:14:56.855 [2024-04-16 22:52:47.905735] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:14:56.855 [2024-04-16 22:52:47.917555] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:14:56.855 [2024-04-16 22:52:47.917584] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:14:56.855 [2024-04-16 22:52:47.928980] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:14:56.855 [2024-04-16 22:52:47.929010] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:14:56.855 [2024-04-16 22:52:47.941608] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:14:56.855 [2024-04-16 22:52:47.941637] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:14:56.855 [2024-04-16 22:52:47.951345] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:14:56.855 [2024-04-16 22:52:47.951377] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:14:56.855 [2024-04-16 22:52:47.963124] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:14:56.855 [2024-04-16 22:52:47.963154] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:14:56.855 [2024-04-16 22:52:47.973990] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:14:56.855 [2024-04-16 22:52:47.974020] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:14:57.114 [2024-04-16 22:52:47.984715] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:14:57.114 [2024-04-16 22:52:47.984746] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:14:57.114 [2024-04-16 22:52:47.996127] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:14:57.114 [2024-04-16 22:52:47.996157] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:14:57.114 [2024-04-16 22:52:48.007823] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:14:57.114 [2024-04-16 22:52:48.007853] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:14:57.114 [2024-04-16 22:52:48.018770] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:14:57.114 [2024-04-16 22:52:48.018800] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:14:57.114 [2024-04-16 22:52:48.029847] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:14:57.114 [2024-04-16 22:52:48.029879] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:14:57.114 [2024-04-16 22:52:48.040685] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:14:57.114 [2024-04-16 22:52:48.040716] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:14:57.114 [2024-04-16 22:52:48.053472] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:14:57.114 [2024-04-16 22:52:48.053503] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:14:57.114 [2024-04-16 22:52:48.063401] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:14:57.115 [2024-04-16 22:52:48.063431] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:14:57.115 [2024-04-16 22:52:48.075038] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:14:57.115 [2024-04-16 22:52:48.075078] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:14:57.115 [2024-04-16 22:52:48.086349] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:14:57.115 [2024-04-16 22:52:48.086380] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:14:57.115 [2024-04-16 22:52:48.096903] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:14:57.115 [2024-04-16 22:52:48.096934] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:14:57.115 [2024-04-16 22:52:48.107843] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:14:57.115 [2024-04-16 22:52:48.107875] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:14:57.115 [2024-04-16 22:52:48.120790] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:14:57.115 [2024-04-16 22:52:48.120821] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:14:57.115 [2024-04-16 22:52:48.131045] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:14:57.115 [2024-04-16 22:52:48.131076] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:14:57.115 [2024-04-16 22:52:48.142104] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:14:57.115 [2024-04-16 22:52:48.142135] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:14:57.115 [2024-04-16 22:52:48.155221] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:14:57.115 [2024-04-16 22:52:48.155252] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:14:57.115 [2024-04-16 22:52:48.165009] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:14:57.115 [2024-04-16 22:52:48.165039] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:14:57.115 [2024-04-16 22:52:48.176438] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:14:57.115 [2024-04-16 22:52:48.176469] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:14:57.115 [2024-04-16 22:52:48.187245] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:14:57.115 [2024-04-16 22:52:48.187276] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:14:57.115 [2024-04-16 22:52:48.198124] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:14:57.115 [2024-04-16 22:52:48.198154] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:14:57.115 [2024-04-16 22:52:48.211349] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:14:57.115 [2024-04-16 22:52:48.211379] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:14:57.115 [2024-04-16 22:52:48.221968] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:14:57.115 [2024-04-16 22:52:48.221999] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:14:57.115 [2024-04-16 22:52:48.232748] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:14:57.115 [2024-04-16 22:52:48.232778] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:14:57.374 [2024-04-16 22:52:48.245767] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:14:57.374 [2024-04-16 22:52:48.245798] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:14:57.374 [2024-04-16 22:52:48.256428] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:14:57.374 [2024-04-16 22:52:48.256457] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:14:57.374 [2024-04-16 22:52:48.267040] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:14:57.374 [2024-04-16 22:52:48.267070] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:14:57.374 [2024-04-16 22:52:48.277898] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:14:57.374 [2024-04-16 22:52:48.277928] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:14:57.374 [2024-04-16 22:52:48.288557] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:14:57.374 [2024-04-16 22:52:48.288596] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:14:57.374 [2024-04-16 22:52:48.300914] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:14:57.374 [2024-04-16 22:52:48.300944] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:14:57.374 [2024-04-16 22:52:48.310502] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:14:57.374 [2024-04-16 22:52:48.310532] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:14:57.374 [2024-04-16 22:52:48.321974] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:14:57.374 [2024-04-16 22:52:48.322003] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:14:57.374 [2024-04-16 22:52:48.334394] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:14:57.374 [2024-04-16 22:52:48.334424] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:14:57.374 [2024-04-16 22:52:48.343504] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:14:57.374 [2024-04-16 22:52:48.343534] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:14:57.374 [2024-04-16 22:52:48.356626] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:14:57.374 [2024-04-16 22:52:48.356656] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:14:57.374 [2024-04-16 22:52:48.367115] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:14:57.374 [2024-04-16 22:52:48.367144] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:14:57.374 [2024-04-16 22:52:48.377933] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:14:57.375 [2024-04-16 22:52:48.377963] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:14:57.375 [2024-04-16 22:52:48.390927] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:14:57.375 [2024-04-16 22:52:48.390956] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:14:57.375 [2024-04-16 22:52:48.401684] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:14:57.375 [2024-04-16 22:52:48.401714] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:14:57.375 [2024-04-16 22:52:48.413062] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:14:57.375 [2024-04-16 22:52:48.413091] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:14:57.375 [2024-04-16 22:52:48.424201] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:14:57.375 [2024-04-16 22:52:48.424231] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:14:57.375 [2024-04-16 22:52:48.434788] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:14:57.375 [2024-04-16 22:52:48.434817] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:14:57.375 [2024-04-16 22:52:48.447210] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:14:57.375 [2024-04-16 22:52:48.447240] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:14:57.375 [2024-04-16 22:52:48.456937] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:14:57.375 [2024-04-16 22:52:48.456967] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:14:57.375 [2024-04-16 22:52:48.468607] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:14:57.375 [2024-04-16 22:52:48.468638] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:14:57.375 [2024-04-16 22:52:48.479650] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:14:57.375 [2024-04-16 22:52:48.479680] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:14:57.375 [2024-04-16 22:52:48.490454] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:14:57.375 [2024-04-16 22:52:48.490484] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:14:57.375 [2024-04-16 22:52:48.501439] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:14:57.375 [2024-04-16 22:52:48.501482] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:14:57.635 [2024-04-16 22:52:48.512663] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:14:57.635 [2024-04-16 22:52:48.512694] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:14:57.635 [2024-04-16 22:52:48.525662] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:14:57.635 [2024-04-16 22:52:48.525692] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:14:57.635 [2024-04-16 22:52:48.535890] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:14:57.635 [2024-04-16 22:52:48.535920] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:14:57.635 [2024-04-16 22:52:48.546752] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:14:57.635 [2024-04-16 22:52:48.546782] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:14:57.635 [2024-04-16 22:52:48.557973] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:14:57.635 [2024-04-16 22:52:48.558003] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:14:57.635 [2024-04-16 22:52:48.569258] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:14:57.635 [2024-04-16 22:52:48.569288] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:14:57.635 [2024-04-16 22:52:48.582254] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:14:57.635 [2024-04-16 22:52:48.582284] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:14:57.635 [2024-04-16 22:52:48.591929] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:14:57.635 [2024-04-16 22:52:48.591958] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:14:57.635 [2024-04-16 22:52:48.603536] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:14:57.635 [2024-04-16 22:52:48.603566] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:14:57.635 [2024-04-16 22:52:48.614213] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:14:57.635 [2024-04-16 22:52:48.614243] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:14:57.635 [2024-04-16 22:52:48.624869] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:14:57.635 [2024-04-16 22:52:48.624899] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:14:57.635 [2024-04-16 22:52:48.635667] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:14:57.635 [2024-04-16 22:52:48.635697] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:14:57.635 [2024-04-16 22:52:48.646276] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:14:57.635 [2024-04-16 22:52:48.646307] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:14:57.635 [2024-04-16 22:52:48.657424] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:14:57.635 [2024-04-16 22:52:48.657454] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:14:57.635 [2024-04-16 22:52:48.668186] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:14:57.635 [2024-04-16 22:52:48.668216] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:14:57.635 [2024-04-16 22:52:48.679267] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:14:57.635 [2024-04-16 22:52:48.679296] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:14:57.635 [2024-04-16 22:52:48.690124] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:14:57.635 [2024-04-16 22:52:48.690153] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:14:57.635 [2024-04-16 22:52:48.703212] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:14:57.635 [2024-04-16 22:52:48.703252] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:14:57.635 [2024-04-16 22:52:48.713648] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:14:57.635 [2024-04-16 22:52:48.713687] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:14:57.635 [2024-04-16 22:52:48.725014] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:14:57.635 [2024-04-16 22:52:48.725044] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:14:57.635 [2024-04-16 22:52:48.736062] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:14:57.635 [2024-04-16 22:52:48.736091] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:14:57.635 [2024-04-16 22:52:48.747203] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:14:57.635 [2024-04-16 22:52:48.747242] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:14:57.635 [2024-04-16 22:52:48.758569] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:14:57.635 [2024-04-16 22:52:48.758599] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:14:57.893 [2024-04-16 22:52:48.769593] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:14:57.893 [2024-04-16 22:52:48.769624] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:14:57.893 [2024-04-16 22:52:48.782580] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:14:57.893 [2024-04-16 22:52:48.782612] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:14:57.893 [2024-04-16 22:52:48.793170] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:14:57.893 [2024-04-16 22:52:48.793209] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:14:57.893 [2024-04-16 22:52:48.804536] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:14:57.893 [2024-04-16 22:52:48.804565] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:14:57.893 [2024-04-16 22:52:48.817451] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:14:57.893 [2024-04-16 22:52:48.817482] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:14:57.893 [2024-04-16 22:52:48.827694] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:14:57.893 [2024-04-16 22:52:48.827724] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:14:57.893 [2024-04-16 22:52:48.838397] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:14:57.893 [2024-04-16 22:52:48.838427] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:14:57.893 [2024-04-16 22:52:48.851775] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:14:57.893 [2024-04-16 22:52:48.851805] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:14:57.893 [2024-04-16 22:52:48.861995] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:14:57.893 [2024-04-16 22:52:48.862025] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:14:57.893 [2024-04-16 22:52:48.872858] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:14:57.893 [2024-04-16 22:52:48.872887] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:14:57.893 [2024-04-16 22:52:48.885689] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:14:57.893 [2024-04-16 22:52:48.885719] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:14:57.893 [2024-04-16 22:52:48.895931] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:14:57.893 [2024-04-16 22:52:48.895960] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:14:57.893 [2024-04-16 22:52:48.906539] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:14:57.893 [2024-04-16 22:52:48.906569] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:14:57.893 [2024-04-16 22:52:48.919260] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:14:57.893 [2024-04-16 22:52:48.919290] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:14:57.893 [2024-04-16 22:52:48.929070] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:14:57.893 [2024-04-16 22:52:48.929100] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:14:57.893 [2024-04-16 22:52:48.940292] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:14:57.893 [2024-04-16 22:52:48.940323] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:14:57.893 [2024-04-16 22:52:48.951522] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:14:57.893 [2024-04-16 22:52:48.951551] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:14:57.893 [2024-04-16 22:52:48.962992] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:14:57.893 [2024-04-16 22:52:48.963022] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:14:57.893 [2024-04-16 22:52:48.973660] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:14:57.893 [2024-04-16 22:52:48.973689] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:14:57.893 [2024-04-16 22:52:48.984534] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:14:57.893 [2024-04-16 22:52:48.984564] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:14:57.893 [2024-04-16 22:52:48.997750] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:14:57.893 [2024-04-16 22:52:48.997781] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:14:57.893 [2024-04-16 22:52:49.007739] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:14:57.893 [2024-04-16 22:52:49.007769] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:14:57.893 [2024-04-16 22:52:49.018603] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:14:57.893 [2024-04-16 22:52:49.018633] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:14:58.151 [2024-04-16 22:52:49.031622] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:14:58.151 [2024-04-16 22:52:49.031653] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:14:58.151 [2024-04-16 22:52:49.041665] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:14:58.151 [2024-04-16 22:52:49.041695] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:14:58.151 [2024-04-16 22:52:49.052384] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:14:58.151 [2024-04-16 22:52:49.052414] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:14:58.151 [2024-04-16 22:52:49.064906] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:14:58.151 [2024-04-16 22:52:49.064936] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:14:58.151 [2024-04-16 22:52:49.074905] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:14:58.151 [2024-04-16 22:52:49.074935] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:14:58.151 [2024-04-16 22:52:49.086482] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:14:58.151 [2024-04-16 22:52:49.086512] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:14:58.151 [2024-04-16 22:52:49.097368] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:14:58.151 [2024-04-16 22:52:49.097399] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:14:58.151 [2024-04-16 22:52:49.108643] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:14:58.151 [2024-04-16 22:52:49.108673] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:14:58.151 [2024-04-16 22:52:49.119612] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:14:58.151 [2024-04-16 22:52:49.119642] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:14:58.151 [2024-04-16 22:52:49.130581] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:14:58.151 [2024-04-16 22:52:49.130612] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:14:58.151 [2024-04-16 22:52:49.142052] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:14:58.151 [2024-04-16 22:52:49.142083] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:14:58.151 [2024-04-16 22:52:49.153763] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:14:58.151 [2024-04-16 22:52:49.153794] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:14:58.151 [2024-04-16 22:52:49.165055] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:14:58.151 [2024-04-16 22:52:49.165085] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:14:58.151 [2024-04-16 22:52:49.178095] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:14:58.151 [2024-04-16 22:52:49.178126] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:14:58.151 [2024-04-16 22:52:49.188083] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:14:58.151 [2024-04-16 22:52:49.188113] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:14:58.151 [2024-04-16 22:52:49.199896] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:14:58.151 [2024-04-16 22:52:49.199927] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:14:58.151 [2024-04-16 22:52:49.211261] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:14:58.151 [2024-04-16 22:52:49.211293] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:14:58.151 [2024-04-16 22:52:49.222604] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:14:58.151 [2024-04-16 22:52:49.222635] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:14:58.151 [2024-04-16 22:52:49.234154] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:14:58.151 [2024-04-16 22:52:49.234193] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:14:58.151 [2024-04-16 22:52:49.245109] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:14:58.151 [2024-04-16 22:52:49.245140] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:14:58.151 [2024-04-16 22:52:49.256270] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:14:58.151 [2024-04-16 22:52:49.256301] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:14:58.151 [2024-04-16 22:52:49.269261] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:14:58.151 [2024-04-16 22:52:49.269292] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:14:58.410 [2024-04-16 22:52:49.279578] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:14:58.410 [2024-04-16 22:52:49.279610] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:14:58.410 [2024-04-16 22:52:49.290153] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:14:58.410 [2024-04-16 22:52:49.290193] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:14:58.410 [2024-04-16 22:52:49.302955] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:14:58.410 [2024-04-16 22:52:49.302985] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:14:58.410 [2024-04-16 22:52:49.313136] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:14:58.411 [2024-04-16 22:52:49.313166] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:14:58.411 [2024-04-16 22:52:49.324770] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:14:58.411 [2024-04-16 22:52:49.324800] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:14:58.411 [2024-04-16 22:52:49.336425] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:14:58.411 [2024-04-16 22:52:49.336455] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:14:58.411 [2024-04-16 22:52:49.347252] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:14:58.411 [2024-04-16 22:52:49.347282] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:14:58.411 [2024-04-16 22:52:49.357926] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:14:58.411 [2024-04-16 22:52:49.357956] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:14:58.411 [2024-04-16 22:52:49.370920] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:14:58.411 [2024-04-16 22:52:49.370950] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:14:58.411 [2024-04-16 22:52:49.380825] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:14:58.411 [2024-04-16 22:52:49.380855] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:14:58.411 [2024-04-16 22:52:49.391918] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:14:58.411 [2024-04-16 22:52:49.391948] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:14:58.411 [2024-04-16 22:52:49.404432] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:14:58.411 [2024-04-16 22:52:49.404462] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:14:58.411 [2024-04-16 22:52:49.414271] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:14:58.411 [2024-04-16 22:52:49.414301] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:14:58.411 [2024-04-16 22:52:49.425875] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:14:58.411 [2024-04-16 22:52:49.425905] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:14:58.411 [2024-04-16 22:52:49.436748] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:14:58.411 [2024-04-16 22:52:49.436778] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:14:58.411 [2024-04-16 22:52:49.447548] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:14:58.411 [2024-04-16 22:52:49.447578] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:14:58.411 [2024-04-16 22:52:49.460160] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:14:58.411 [2024-04-16 22:52:49.460199] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:14:58.411 [2024-04-16 22:52:49.469934] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:14:58.411 [2024-04-16 22:52:49.469964] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:14:58.411 [2024-04-16 22:52:49.481450] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:14:58.411 [2024-04-16 22:52:49.481480] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:14:58.411 [2024-04-16 22:52:49.494210] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:14:58.411 [2024-04-16 22:52:49.494240] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:14:58.411 [2024-04-16 22:52:49.504112] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:14:58.411 [2024-04-16 22:52:49.504142] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:14:58.411 [2024-04-16 22:52:49.515632] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:14:58.411 [2024-04-16 22:52:49.515662] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:14:58.411 [2024-04-16 22:52:49.526669] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:14:58.411 [2024-04-16 22:52:49.526699] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:14:58.411 [2024-04-16 22:52:49.537435] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:14:58.411 [2024-04-16 22:52:49.537465] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:14:58.671 [2024-04-16 22:52:49.548271] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:14:58.671 [2024-04-16 22:52:49.548302] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:14:58.671 [2024-04-16 22:52:49.559090] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:14:58.671 [2024-04-16 22:52:49.559121] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:14:58.671 [2024-04-16 22:52:49.570546] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:14:58.671 [2024-04-16 22:52:49.570576] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:14:58.671 [2024-04-16 22:52:49.581397] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:14:58.671 [2024-04-16 22:52:49.581427] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:14:58.671 [2024-04-16 22:52:49.591837] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:14:58.671 [2024-04-16 22:52:49.591867] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:14:58.671 [2024-04-16 22:52:49.602856] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:14:58.671 [2024-04-16 22:52:49.602886] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:14:58.671 [2024-04-16 22:52:49.615791] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:14:58.671 [2024-04-16 22:52:49.615821] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:14:58.671 [2024-04-16 22:52:49.625958] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:14:58.671 [2024-04-16 22:52:49.625988] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:14:58.671 [2024-04-16 22:52:49.636902] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:14:58.671 [2024-04-16 22:52:49.636932] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:14:58.671 [2024-04-16 22:52:49.649028] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:14:58.671 [2024-04-16 22:52:49.649058] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:14:58.671 [2024-04-16 22:52:49.658008] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:14:58.671 [2024-04-16 22:52:49.658038] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:14:58.671 [2024-04-16 22:52:49.671281] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:14:58.671 [2024-04-16 22:52:49.671311] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:14:58.671 [2024-04-16 22:52:49.681720] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:14:58.671 [2024-04-16 22:52:49.681750] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:14:58.671 [2024-04-16 22:52:49.692141] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:14:58.671 [2024-04-16 22:52:49.692170] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:14:58.671 [2024-04-16 22:52:49.702989] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:14:58.671 [2024-04-16 22:52:49.703019] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:14:58.671 [2024-04-16 22:52:49.716076] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:14:58.671 [2024-04-16 22:52:49.716108] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:14:58.671 [2024-04-16 22:52:49.726474] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:14:58.671 [2024-04-16 22:52:49.726504] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:14:58.671 [2024-04-16 22:52:49.737447] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:14:58.671 [2024-04-16 22:52:49.737477] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:14:58.671 [2024-04-16 22:52:49.750641] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:14:58.671 [2024-04-16 22:52:49.750671] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:14:58.671 [2024-04-16 22:52:49.761153] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:14:58.671 [2024-04-16 22:52:49.761192] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:14:58.671 [2024-04-16 22:52:49.771843] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:14:58.671 [2024-04-16 22:52:49.771880] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:14:58.671 [2024-04-16 22:52:49.784885] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:14:58.671 [2024-04-16 22:52:49.784914] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:14:58.671 [2024-04-16 22:52:49.795126] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:14:58.671 [2024-04-16 22:52:49.795155] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:14:58.932 [2024-04-16 22:52:49.805895] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:14:58.932 [2024-04-16 22:52:49.805926] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:14:58.932 [2024-04-16 22:52:49.816626] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:14:58.932 [2024-04-16 22:52:49.816656] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:14:58.932 [2024-04-16 22:52:49.828108] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:14:58.932 [2024-04-16 22:52:49.828138] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:14:58.932 [2024-04-16 22:52:49.839282] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:14:58.932 [2024-04-16 22:52:49.839312] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:14:58.932 [2024-04-16 22:52:49.852475] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:14:58.932 [2024-04-16 22:52:49.852505] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:14:58.932 [2024-04-16 22:52:49.862735] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:14:58.932 [2024-04-16 22:52:49.862764] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:14:58.932 [2024-04-16 22:52:49.873671] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:14:58.932 [2024-04-16 22:52:49.873700] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:14:58.932 [2024-04-16 22:52:49.886825] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:14:58.932 [2024-04-16 22:52:49.886855] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:14:58.932 [2024-04-16 22:52:49.897577] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:14:58.932 [2024-04-16 22:52:49.897607] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:14:58.932 [2024-04-16 22:52:49.908485] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:14:58.932 [2024-04-16 22:52:49.908515] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:14:58.932 [2024-04-16 22:52:49.921361] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:14:58.932 [2024-04-16 22:52:49.921390] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:14:58.932 [2024-04-16 22:52:49.932067] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:14:58.932 [2024-04-16 22:52:49.932096] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:14:58.932 [2024-04-16 22:52:49.942935] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:14:58.932 [2024-04-16 22:52:49.942964] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:14:58.932 [2024-04-16 22:52:49.954069] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:14:58.932 [2024-04-16 22:52:49.954099] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:14:58.932 [2024-04-16 22:52:49.965103] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:14:58.932 [2024-04-16 22:52:49.965133] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:14:58.932 [2024-04-16 22:52:49.978238] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:14:58.932 [2024-04-16 22:52:49.978268] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:14:58.932 [2024-04-16 22:52:49.988770] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:14:58.932 [2024-04-16 22:52:49.988809] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:14:58.932 [2024-04-16 22:52:49.999551] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:14:58.932 [2024-04-16 22:52:49.999581] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:14:58.932 [2024-04-16 22:52:50.012011] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:14:58.932 [2024-04-16 22:52:50.012042] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:14:58.932 [2024-04-16 22:52:50.021518] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:14:58.932 [2024-04-16 22:52:50.021548] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:14:58.932 [2024-04-16 22:52:50.035737] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:14:58.932 [2024-04-16 22:52:50.035769] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:14:58.932 [2024-04-16 22:52:50.046470] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:14:58.932 [2024-04-16 22:52:50.046501] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:14:58.932 [2024-04-16 22:52:50.057369] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:14:58.932 [2024-04-16 22:52:50.057400] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:14:59.190 [2024-04-16 22:52:50.068455] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:14:59.190 [2024-04-16 22:52:50.068486] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:14:59.190 [2024-04-16 22:52:50.079602] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:14:59.190 [2024-04-16 22:52:50.079632] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:14:59.190 [2024-04-16 22:52:50.090743] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:14:59.190 [2024-04-16 22:52:50.090773] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:14:59.190 [2024-04-16 22:52:50.103597] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:14:59.190 [2024-04-16 22:52:50.103627] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:14:59.190 [2024-04-16 22:52:50.113908] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:14:59.190 [2024-04-16 22:52:50.113938] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:14:59.190 [2024-04-16 22:52:50.124873] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:14:59.190 [2024-04-16 22:52:50.124903] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:14:59.190 [2024-04-16 22:52:50.137558] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:14:59.191 [2024-04-16 22:52:50.137588] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:14:59.191 [2024-04-16 22:52:50.147442] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:14:59.191 [2024-04-16 22:52:50.147472] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:14:59.191 [2024-04-16 22:52:50.159151] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:14:59.191 [2024-04-16 22:52:50.159188] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:14:59.191 [2024-04-16 22:52:50.170377] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:14:59.191 [2024-04-16 22:52:50.170407] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:14:59.191 [2024-04-16 22:52:50.182943] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:14:59.191 [2024-04-16 22:52:50.182973] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:14:59.191 [2024-04-16 22:52:50.193205] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:14:59.191 [2024-04-16 22:52:50.193235] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:14:59.191 [2024-04-16 22:52:50.204223] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:14:59.191 [2024-04-16 22:52:50.204261] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:14:59.191 [2024-04-16 22:52:50.214977] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:14:59.191 [2024-04-16 22:52:50.215008] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:14:59.191 [2024-04-16 22:52:50.226295] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:14:59.191 [2024-04-16 22:52:50.226326] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:14:59.191 [2024-04-16 22:52:50.239127] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:14:59.191 [2024-04-16 22:52:50.239157] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:14:59.191 [2024-04-16 22:52:50.249047] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:14:59.191 [2024-04-16 22:52:50.249078] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:14:59.191 [2024-04-16 22:52:50.259855] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:14:59.191 [2024-04-16 22:52:50.259885] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:14:59.191 [2024-04-16 22:52:50.271036] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:14:59.191 [2024-04-16 22:52:50.271066] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:14:59.191 [2024-04-16 22:52:50.282506] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:14:59.191 [2024-04-16 22:52:50.282540] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:14:59.191 [2024-04-16 22:52:50.294246] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:14:59.191 [2024-04-16 22:52:50.294277] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:14:59.191 [2024-04-16 22:52:50.306095] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:14:59.191 [2024-04-16 22:52:50.306126] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:14:59.191 [2024-04-16 22:52:50.317488] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:14:59.191 [2024-04-16 22:52:50.317518] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:14:59.448 [2024-04-16 22:52:50.328409] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:14:59.448 [2024-04-16 22:52:50.328439] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:14:59.448 [2024-04-16 22:52:50.340884] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:14:59.448 [2024-04-16 22:52:50.340914] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:14:59.448 [2024-04-16 22:52:50.351088] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:14:59.448 [2024-04-16 22:52:50.351119] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:14:59.448 [2024-04-16 22:52:50.363420] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:14:59.448 [2024-04-16 22:52:50.363451] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:14:59.448 [2024-04-16 22:52:50.374456] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:14:59.448 [2024-04-16 22:52:50.374486] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:14:59.448 [2024-04-16 22:52:50.385165] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:14:59.448 [2024-04-16 22:52:50.385206] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:14:59.448 [2024-04-16 22:52:50.396060] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:14:59.448 [2024-04-16 22:52:50.396090] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:14:59.448 [2024-04-16 22:52:50.409029] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:14:59.448 [2024-04-16 22:52:50.409060] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:14:59.448 [2024-04-16 22:52:50.419513] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:14:59.448 [2024-04-16 22:52:50.419552] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:14:59.448 [2024-04-16 22:52:50.430999] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:14:59.448 [2024-04-16 22:52:50.431030] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:14:59.448 [2024-04-16 22:52:50.442097] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:14:59.449 [2024-04-16 22:52:50.442127] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:14:59.449 [2024-04-16 22:52:50.453372] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:14:59.449 [2024-04-16 22:52:50.453402] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:14:59.449 [2024-04-16 22:52:50.464874] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:14:59.449 [2024-04-16 22:52:50.464911] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:14:59.449 [2024-04-16 22:52:50.476170] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:14:59.449 [2024-04-16 22:52:50.476211] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:14:59.449 [2024-04-16 22:52:50.487566] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:14:59.449 [2024-04-16 22:52:50.487597] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:14:59.449 [2024-04-16 22:52:50.500995] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:14:59.449 [2024-04-16 22:52:50.501025] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:14:59.449 [2024-04-16 22:52:50.510856] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:14:59.449 [2024-04-16 22:52:50.510886] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:14:59.449 [2024-04-16 22:52:50.521621] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:14:59.449 [2024-04-16 22:52:50.521650] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:14:59.449 [2024-04-16 22:52:50.534367] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:14:59.449 [2024-04-16 22:52:50.534397] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:14:59.449 [2024-04-16 22:52:50.544094] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:14:59.449 [2024-04-16 22:52:50.544124] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:14:59.449 [2024-04-16 22:52:50.555326] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:14:59.449 [2024-04-16 22:52:50.555355] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:14:59.449 [2024-04-16 22:52:50.567830] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:14:59.449 [2024-04-16 22:52:50.567860] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:14:59.708 [2024-04-16 22:52:50.578191] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:14:59.708 [2024-04-16 22:52:50.578221] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:14:59.708 [2024-04-16 22:52:50.588968] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:14:59.708 [2024-04-16 22:52:50.588997] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:14:59.708 [2024-04-16 22:52:50.599825] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:14:59.708 [2024-04-16 22:52:50.599855] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:14:59.708 [2024-04-16 22:52:50.611131] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:14:59.708 [2024-04-16 22:52:50.611161] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:14:59.708 [2024-04-16 22:52:50.622009] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:14:59.708 [2024-04-16 22:52:50.622039] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:14:59.708 [2024-04-16 22:52:50.633424] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:14:59.708 [2024-04-16 22:52:50.633454] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:14:59.708 [2024-04-16 22:52:50.644763] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:14:59.708 [2024-04-16 22:52:50.644793] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:14:59.708 [2024-04-16 22:52:50.655565] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:14:59.708 [2024-04-16 22:52:50.655595] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:14:59.708 [2024-04-16 22:52:50.666534] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:14:59.708 [2024-04-16 22:52:50.666564] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:14:59.708 [2024-04-16 22:52:50.677433] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:14:59.708 [2024-04-16 22:52:50.677464] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:14:59.709 [2024-04-16 22:52:50.688497] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:14:59.709 [2024-04-16 22:52:50.688527] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:14:59.709 [2024-04-16 22:52:50.699570] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:14:59.709 [2024-04-16 22:52:50.699600] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:14:59.709 [2024-04-16 22:52:50.710600] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:14:59.709 [2024-04-16 22:52:50.710630] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:14:59.709 [2024-04-16 22:52:50.723560] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:14:59.709 [2024-04-16 22:52:50.723591] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:14:59.709 [2024-04-16 22:52:50.733966] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:14:59.709 [2024-04-16 22:52:50.733997] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:14:59.709 [2024-04-16 22:52:50.744835] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:14:59.709 [2024-04-16 22:52:50.744866] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:14:59.709 [2024-04-16 22:52:50.758037] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:14:59.709 [2024-04-16 22:52:50.758067] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:14:59.709 [2024-04-16 22:52:50.768168] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:14:59.709 [2024-04-16 22:52:50.768208] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:14:59.709 [2024-04-16 22:52:50.779057] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:14:59.709 [2024-04-16 22:52:50.779086] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:14:59.709 [2024-04-16 22:52:50.792137] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:14:59.709 [2024-04-16 22:52:50.792167] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:14:59.709 [2024-04-16 22:52:50.802371] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:14:59.709 [2024-04-16 22:52:50.802402] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:14:59.709 [2024-04-16 22:52:50.813636] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:14:59.709 [2024-04-16 22:52:50.813666] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:14:59.709 [2024-04-16 22:52:50.824413] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:14:59.709 [2024-04-16 22:52:50.824443] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:14:59.709 [2024-04-16 22:52:50.834587] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:14:59.709 [2024-04-16 22:52:50.834617] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:14:59.969 [2024-04-16 22:52:50.845652] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:14:59.969 [2024-04-16 22:52:50.845682] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:14:59.969 [2024-04-16 22:52:50.858483] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:14:59.969 [2024-04-16 22:52:50.858513] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:14:59.969 [2024-04-16 22:52:50.868393] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:14:59.969 [2024-04-16 22:52:50.868422] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:14:59.969 [2024-04-16 22:52:50.879354] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:14:59.969 [2024-04-16 22:52:50.879383] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:14:59.969 [2024-04-16 22:52:50.890886] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:14:59.969 [2024-04-16 22:52:50.890915] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:14:59.969 [2024-04-16 22:52:50.901936] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:14:59.969 [2024-04-16 22:52:50.901965] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:14:59.969 [2024-04-16 22:52:50.915052] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:14:59.969 [2024-04-16 22:52:50.915081] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:14:59.969 [2024-04-16 22:52:50.925419] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:14:59.969 [2024-04-16 22:52:50.925448] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:14:59.969 [2024-04-16 22:52:50.936138] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:14:59.969 [2024-04-16 22:52:50.936168] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:14:59.969 [2024-04-16 22:52:50.949052] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:14:59.969 [2024-04-16 22:52:50.949082] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:14:59.969 [2024-04-16 22:52:50.958830] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:14:59.969 [2024-04-16 22:52:50.958861] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:14:59.969 [2024-04-16 22:52:50.969832] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:14:59.969 [2024-04-16 22:52:50.969862] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:14:59.969 [2024-04-16 22:52:50.980795] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:14:59.969 [2024-04-16 22:52:50.980825] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:14:59.969 [2024-04-16 22:52:50.991749] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:14:59.969 [2024-04-16 22:52:50.991779] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:14:59.969 [2024-04-16 22:52:51.005042] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:14:59.969 [2024-04-16 22:52:51.005072] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:14:59.969 [2024-04-16 22:52:51.015000] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:14:59.969 [2024-04-16 22:52:51.015030] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:14:59.969 [2024-04-16 22:52:51.026057] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:14:59.969 [2024-04-16 22:52:51.026088] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:14:59.969 [2024-04-16 22:52:51.039077] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:14:59.969 [2024-04-16 22:52:51.039107] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:14:59.969 [2024-04-16 22:52:51.049538] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:14:59.969 [2024-04-16 22:52:51.049567] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:14:59.969 [2024-04-16 22:52:51.060183] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:14:59.969 [2024-04-16 22:52:51.060213] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:14:59.969 [2024-04-16 22:52:51.071097] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:14:59.969 [2024-04-16 22:52:51.071127] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:14:59.969 [2024-04-16 22:52:51.081987] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:14:59.969 [2024-04-16 22:52:51.082017] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:14:59.969 [2024-04-16 22:52:51.094781] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:14:59.969 [2024-04-16 22:52:51.094811] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:00.230 [2024-04-16 22:52:51.104672] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:00.230 [2024-04-16 22:52:51.104702] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:00.230 [2024-04-16 22:52:51.115200] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:00.230 [2024-04-16 22:52:51.115229] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:00.230 [2024-04-16 22:52:51.126140] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:00.230 [2024-04-16 22:52:51.126170] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:00.230 [2024-04-16 22:52:51.137109] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:00.230 [2024-04-16 22:52:51.137139] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:00.230 [2024-04-16 22:52:51.148292] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:00.230 [2024-04-16 22:52:51.148322] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:00.230 [2024-04-16 22:52:51.159636] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:00.230 [2024-04-16 22:52:51.159666] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:00.230 [2024-04-16 22:52:51.170299] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:00.230 [2024-04-16 22:52:51.170328] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:00.230 [2024-04-16 22:52:51.181545] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:00.230 [2024-04-16 22:52:51.181575] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:00.230 [2024-04-16 22:52:51.192765] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:00.230 [2024-04-16 22:52:51.192794] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:00.230 [2024-04-16 22:52:51.203419] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:00.230 [2024-04-16 22:52:51.203449] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:00.230 [2024-04-16 22:52:51.214841] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:00.230 [2024-04-16 22:52:51.214871] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:00.230 [2024-04-16 22:52:51.225664] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:00.230 [2024-04-16 22:52:51.225693] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:00.230 [2024-04-16 22:52:51.236504] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:00.230 [2024-04-16 22:52:51.236534] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:00.230 [2024-04-16 22:52:51.247751] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:00.230 [2024-04-16 22:52:51.247780] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:00.230 [2024-04-16 22:52:51.260592] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:00.230 [2024-04-16 22:52:51.260622] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:00.230 [2024-04-16 22:52:51.270989] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:00.230 [2024-04-16 22:52:51.271018] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:00.230 [2024-04-16 22:52:51.282354] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:00.230 [2024-04-16 22:52:51.282385] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:00.230 [2024-04-16 22:52:51.295304] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:00.230 [2024-04-16 22:52:51.295334] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:00.230 [2024-04-16 22:52:51.305197] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:00.230 [2024-04-16 22:52:51.305227] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:00.230 [2024-04-16 22:52:51.316084] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:00.230 [2024-04-16 22:52:51.316114] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:00.230 [2024-04-16 22:52:51.328625] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:00.230 [2024-04-16 22:52:51.328655] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:00.230 [2024-04-16 22:52:51.338822] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:00.230 [2024-04-16 22:52:51.338852] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:00.230 [2024-04-16 22:52:51.350447] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:00.230 [2024-04-16 22:52:51.350477] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:00.489 [2024-04-16 22:52:51.361115] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:00.489 [2024-04-16 22:52:51.361145] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:00.489 [2024-04-16 22:52:51.372326] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:00.489 [2024-04-16 22:52:51.372356] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:00.489 [2024-04-16 22:52:51.385352] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:00.489 [2024-04-16 22:52:51.385381] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:00.489 [2024-04-16 22:52:51.395289] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:00.489 [2024-04-16 22:52:51.395320] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:00.489 [2024-04-16 22:52:51.406103] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:00.489 [2024-04-16 22:52:51.406133] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:00.489 [2024-04-16 22:52:51.418766] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:00.489 [2024-04-16 22:52:51.418796] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:00.489 [2024-04-16 22:52:51.429064] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:00.489 [2024-04-16 22:52:51.429093] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:00.489 [2024-04-16 22:52:51.440165] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:00.489 [2024-04-16 22:52:51.440208] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:00.489 [2024-04-16 22:52:51.453967] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:00.489 [2024-04-16 22:52:51.453997] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:00.489 [2024-04-16 22:52:51.465037] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:00.489 [2024-04-16 22:52:51.465067] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:00.489 [2024-04-16 22:52:51.475990] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:00.489 [2024-04-16 22:52:51.476030] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:00.489 [2024-04-16 22:52:51.486841] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:00.489 [2024-04-16 22:52:51.486871] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:00.489 [2024-04-16 22:52:51.504586] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:00.489 [2024-04-16 22:52:51.504621] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:00.489 [2024-04-16 22:52:51.514888] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:00.489 [2024-04-16 22:52:51.514919] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:00.489 [2024-04-16 22:52:51.526863] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:00.489 [2024-04-16 22:52:51.526896] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:00.489 [2024-04-16 22:52:51.538409] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:00.489 [2024-04-16 22:52:51.538448] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:00.489 [2024-04-16 22:52:51.549277] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:00.489 [2024-04-16 22:52:51.549308] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:00.489 [2024-04-16 22:52:51.560637] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:00.489 [2024-04-16 22:52:51.560667] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:00.489 [2024-04-16 22:52:51.571361] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:00.489 [2024-04-16 22:52:51.571392] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:00.489 [2024-04-16 22:52:51.582316] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:00.490 [2024-04-16 22:52:51.582347] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:00.490 [2024-04-16 22:52:51.593295] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:00.490 [2024-04-16 22:52:51.593325] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:00.490 [2024-04-16 22:52:51.604304] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:00.490 [2024-04-16 22:52:51.604335] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:00.490 [2024-04-16 22:52:51.615107] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:00.490 [2024-04-16 22:52:51.615137] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:00.748 [2024-04-16 22:52:51.626508] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:00.748 [2024-04-16 22:52:51.626540] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:00.748 [2024-04-16 22:52:51.637554] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:00.748 [2024-04-16 22:52:51.637583] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:00.748 [2024-04-16 22:52:51.648694] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:00.748 [2024-04-16 22:52:51.648724] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:00.748 [2024-04-16 22:52:51.659493] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:00.748 [2024-04-16 22:52:51.659523] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:00.748 [2024-04-16 22:52:51.672226] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:00.748 [2024-04-16 22:52:51.672256] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:00.748 [2024-04-16 22:52:51.681994] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:00.748 [2024-04-16 22:52:51.682024] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:00.748 [2024-04-16 22:52:51.693195] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:00.748 [2024-04-16 22:52:51.693238] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:00.748 [2024-04-16 22:52:51.703885] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:00.748 [2024-04-16 22:52:51.703915] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:00.748 [2024-04-16 22:52:51.714768] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:00.748 [2024-04-16 22:52:51.714798] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:00.748 [2024-04-16 22:52:51.725830] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:00.748 [2024-04-16 22:52:51.725860] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:00.748 [2024-04-16 22:52:51.736268] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:00.748 [2024-04-16 22:52:51.736299] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:00.748 [2024-04-16 22:52:51.747134] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:00.748 [2024-04-16 22:52:51.747165] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:00.748 [2024-04-16 22:52:51.757908] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:00.748 [2024-04-16 22:52:51.757938] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:00.748 [2024-04-16 22:52:51.769163] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:00.748 [2024-04-16 22:52:51.769202] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:00.748 [2024-04-16 22:52:51.780736] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:00.748 [2024-04-16 22:52:51.780765] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:00.748 [2024-04-16 22:52:51.792026] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:00.748 [2024-04-16 22:52:51.792056] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:00.748 [2024-04-16 22:52:51.804553] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:00.749 [2024-04-16 22:52:51.804583] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:00.749 [2024-04-16 22:52:51.814774] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:00.749 [2024-04-16 22:52:51.814803] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:00.749 [2024-04-16 22:52:51.825540] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:00.749 [2024-04-16 22:52:51.825569] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:00.749 [2024-04-16 22:52:51.838198] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:00.749 [2024-04-16 22:52:51.838228] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:00.749 [2024-04-16 22:52:51.848183] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:00.749 [2024-04-16 22:52:51.848213] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:00.749 [2024-04-16 22:52:51.859638] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:00.749 [2024-04-16 22:52:51.859668] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:00.749 [2024-04-16 22:52:51.871113] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:00.749 [2024-04-16 22:52:51.871143] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:01.007 [2024-04-16 22:52:51.881893] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:01.007 [2024-04-16 22:52:51.881924] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:01.007 [2024-04-16 22:52:51.892895] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:01.007 [2024-04-16 22:52:51.892925] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:01.007 [2024-04-16 22:52:51.904031] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:01.007 [2024-04-16 22:52:51.904069] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:01.007 [2024-04-16 22:52:51.914696] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:01.007 [2024-04-16 22:52:51.914726] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:01.007 [2024-04-16 22:52:51.925704] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:01.007 [2024-04-16 22:52:51.925733] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:01.007 [2024-04-16 22:52:51.938642] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:01.007 [2024-04-16 22:52:51.938671] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:01.007 [2024-04-16 22:52:51.948661] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:01.007 [2024-04-16 22:52:51.948691] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:01.007 [2024-04-16 22:52:51.959480] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:01.007 [2024-04-16 22:52:51.959509] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:01.007 [2024-04-16 22:52:51.970622] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:01.007 [2024-04-16 22:52:51.970652] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:01.007 [2024-04-16 22:52:51.981441] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:01.007 [2024-04-16 22:52:51.981471] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:01.007 [2024-04-16 22:52:51.992244] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:01.007 [2024-04-16 22:52:51.992274] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:01.007 [2024-04-16 22:52:52.003120] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:01.007 [2024-04-16 22:52:52.003150] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:01.007 [2024-04-16 22:52:52.015741] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:01.007 [2024-04-16 22:52:52.015771] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:01.007 [2024-04-16 22:52:52.025711] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:01.007 [2024-04-16 22:52:52.025741] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:01.007 [2024-04-16 22:52:52.035966] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:01.007 [2024-04-16 22:52:52.035996] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:01.007 [2024-04-16 22:52:52.047255] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:01.007 [2024-04-16 22:52:52.047286] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:01.007 [2024-04-16 22:52:52.058237] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:01.007 [2024-04-16 22:52:52.058267] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:01.007 [2024-04-16 22:52:52.069418] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:01.007 [2024-04-16 22:52:52.069449] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:01.007 [2024-04-16 22:52:52.081060] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:01.007 [2024-04-16 22:52:52.081090] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:01.007 [2024-04-16 22:52:52.092291] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:01.007 [2024-04-16 22:52:52.092321] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:01.007 [2024-04-16 22:52:52.105695] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:01.007 [2024-04-16 22:52:52.105725] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:01.007 [2024-04-16 22:52:52.116375] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:01.007 [2024-04-16 22:52:52.116412] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:01.007 [2024-04-16 22:52:52.127420] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:01.007 [2024-04-16 22:52:52.127450] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:01.267 [2024-04-16 22:52:52.140422] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:01.267 [2024-04-16 22:52:52.140452] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:01.267 [2024-04-16 22:52:52.150891] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:01.267 [2024-04-16 22:52:52.150922] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:01.267 [2024-04-16 22:52:52.162129] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:01.267 [2024-04-16 22:52:52.162159] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:01.267 [2024-04-16 22:52:52.175016] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:01.267 [2024-04-16 22:52:52.175046] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:01.267 [2024-04-16 22:52:52.182581] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:01.267 [2024-04-16 22:52:52.182611] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:01.267 00:15:01.267 Latency(us) 00:15:01.267 Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:15:01.267 Job: Nvme1n1 (Core Mask 0x1, workload: randrw, percentage: 50, depth: 128, IO size: 8192) 00:15:01.267 Nvme1n1 : 5.01 11557.32 90.29 0.00 0.00 11061.66 4708.88 21262.79 00:15:01.267 =================================================================================================================== 00:15:01.267 Total : 11557.32 90.29 0.00 0.00 11061.66 4708.88 21262.79 00:15:01.267 [2024-04-16 22:52:52.190379] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:01.267 [2024-04-16 22:52:52.190408] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:01.267 [2024-04-16 22:52:52.198392] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:01.267 [2024-04-16 22:52:52.198419] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:01.267 [2024-04-16 22:52:52.206411] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:01.267 [2024-04-16 22:52:52.206437] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:01.267 [2024-04-16 22:52:52.214473] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:01.267 [2024-04-16 22:52:52.214518] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:01.267 [2024-04-16 22:52:52.222497] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:01.267 [2024-04-16 22:52:52.222543] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:01.267 [2024-04-16 22:52:52.230513] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:01.267 [2024-04-16 22:52:52.230559] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:01.267 [2024-04-16 22:52:52.238536] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:01.267 [2024-04-16 22:52:52.238578] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:01.267 [2024-04-16 22:52:52.246553] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:01.267 [2024-04-16 22:52:52.246596] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:01.267 [2024-04-16 22:52:52.254586] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:01.267 [2024-04-16 22:52:52.254628] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:01.267 [2024-04-16 22:52:52.262606] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:01.267 [2024-04-16 22:52:52.262651] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:01.268 [2024-04-16 22:52:52.270624] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:01.268 [2024-04-16 22:52:52.270666] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:01.268 [2024-04-16 22:52:52.278647] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:01.268 [2024-04-16 22:52:52.278693] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:01.268 [2024-04-16 22:52:52.286677] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:01.268 [2024-04-16 22:52:52.286723] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:01.268 [2024-04-16 22:52:52.294691] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:01.268 [2024-04-16 22:52:52.294735] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:01.268 [2024-04-16 22:52:52.302720] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:01.268 [2024-04-16 22:52:52.302766] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:01.268 [2024-04-16 22:52:52.310732] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:01.268 [2024-04-16 22:52:52.310774] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:01.268 [2024-04-16 22:52:52.318756] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:01.268 [2024-04-16 22:52:52.318799] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:01.268 [2024-04-16 22:52:52.326776] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:01.268 [2024-04-16 22:52:52.326819] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:01.268 [2024-04-16 22:52:52.334775] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:01.268 [2024-04-16 22:52:52.334807] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:01.268 [2024-04-16 22:52:52.342785] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:01.268 [2024-04-16 22:52:52.342809] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:01.268 [2024-04-16 22:52:52.350806] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:01.268 [2024-04-16 22:52:52.350830] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:01.268 [2024-04-16 22:52:52.358828] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:01.268 [2024-04-16 22:52:52.358852] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:01.268 [2024-04-16 22:52:52.366850] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:01.268 [2024-04-16 22:52:52.366875] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:01.268 [2024-04-16 22:52:52.374896] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:01.268 [2024-04-16 22:52:52.374933] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:01.268 [2024-04-16 22:52:52.382930] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:01.268 [2024-04-16 22:52:52.382971] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:01.268 [2024-04-16 22:52:52.390954] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:01.268 [2024-04-16 22:52:52.390998] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:01.527 [2024-04-16 22:52:52.398940] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:01.527 [2024-04-16 22:52:52.398965] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:01.527 [2024-04-16 22:52:52.406960] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:01.527 [2024-04-16 22:52:52.406984] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:01.527 [2024-04-16 22:52:52.414984] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:01.527 [2024-04-16 22:52:52.415008] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:01.527 [2024-04-16 22:52:52.423005] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:01.527 [2024-04-16 22:52:52.423028] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:01.527 [2024-04-16 22:52:52.431029] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:01.527 [2024-04-16 22:52:52.431054] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:01.527 [2024-04-16 22:52:52.439089] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:01.527 [2024-04-16 22:52:52.439133] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:01.527 [2024-04-16 22:52:52.447106] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:01.527 [2024-04-16 22:52:52.447150] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:01.527 [2024-04-16 22:52:52.455097] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:01.527 [2024-04-16 22:52:52.455121] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:01.527 [2024-04-16 22:52:52.463117] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:01.527 [2024-04-16 22:52:52.463141] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:01.527 [2024-04-16 22:52:52.471142] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:01.527 [2024-04-16 22:52:52.471166] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:01.527 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/zcopy.sh: line 42: kill: (270255) - No such process 00:15:01.527 22:52:52 -- target/zcopy.sh@49 -- # wait 270255 00:15:01.527 22:52:52 -- target/zcopy.sh@52 -- # rpc_cmd nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:15:01.527 22:52:52 -- common/autotest_common.sh@551 -- # xtrace_disable 00:15:01.527 22:52:52 -- common/autotest_common.sh@10 -- # set +x 00:15:01.527 22:52:52 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:15:01.527 22:52:52 -- target/zcopy.sh@53 -- # rpc_cmd bdev_delay_create -b malloc0 -d delay0 -r 1000000 -t 1000000 -w 1000000 -n 1000000 00:15:01.527 22:52:52 -- common/autotest_common.sh@551 -- # xtrace_disable 00:15:01.527 22:52:52 -- common/autotest_common.sh@10 -- # set +x 00:15:01.527 delay0 00:15:01.527 22:52:52 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:15:01.527 22:52:52 -- target/zcopy.sh@54 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 delay0 -n 1 00:15:01.527 22:52:52 -- common/autotest_common.sh@551 -- # xtrace_disable 00:15:01.527 22:52:52 -- common/autotest_common.sh@10 -- # set +x 00:15:01.527 22:52:52 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:15:01.527 22:52:52 -- target/zcopy.sh@56 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/abort -c 0x1 -t 5 -q 64 -w randrw -M 50 -l warning -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 ns:1' 00:15:01.527 EAL: No free 2048 kB hugepages reported on node 1 00:15:01.527 [2024-04-16 22:52:52.549454] nvme_fabric.c: 295:nvme_fabric_discover_probe: *WARNING*: Skipping unsupported current discovery service or discovery service referral 00:15:08.097 Initializing NVMe Controllers 00:15:08.097 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:15:08.097 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 0 00:15:08.098 Initialization complete. Launching workers. 00:15:08.098 NS: TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 I/O completed: 320, failed: 277 00:15:08.098 CTRLR: TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) abort submitted 564, failed to submit 33 00:15:08.098 success 400, unsuccess 164, failed 0 00:15:08.098 22:52:58 -- target/zcopy.sh@59 -- # trap - SIGINT SIGTERM EXIT 00:15:08.098 22:52:58 -- target/zcopy.sh@60 -- # nvmftestfini 00:15:08.098 22:52:58 -- nvmf/common.sh@476 -- # nvmfcleanup 00:15:08.098 22:52:58 -- nvmf/common.sh@116 -- # sync 00:15:08.098 22:52:58 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:15:08.098 22:52:58 -- nvmf/common.sh@119 -- # set +e 00:15:08.098 22:52:58 -- nvmf/common.sh@120 -- # for i in {1..20} 00:15:08.098 22:52:58 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:15:08.098 rmmod nvme_tcp 00:15:08.098 rmmod nvme_fabrics 00:15:08.098 rmmod nvme_keyring 00:15:08.098 22:52:58 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:15:08.098 22:52:58 -- nvmf/common.sh@123 -- # set -e 00:15:08.098 22:52:58 -- nvmf/common.sh@124 -- # return 0 00:15:08.098 22:52:58 -- nvmf/common.sh@477 -- # '[' -n 268871 ']' 00:15:08.098 22:52:58 -- nvmf/common.sh@478 -- # killprocess 268871 00:15:08.098 22:52:58 -- common/autotest_common.sh@926 -- # '[' -z 268871 ']' 00:15:08.098 22:52:58 -- common/autotest_common.sh@930 -- # kill -0 268871 00:15:08.098 22:52:58 -- common/autotest_common.sh@931 -- # uname 00:15:08.098 22:52:58 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:15:08.098 22:52:58 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 268871 00:15:08.098 22:52:58 -- common/autotest_common.sh@932 -- # process_name=reactor_1 00:15:08.098 22:52:58 -- common/autotest_common.sh@936 -- # '[' reactor_1 = sudo ']' 00:15:08.098 22:52:58 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 268871' 00:15:08.098 killing process with pid 268871 00:15:08.098 22:52:58 -- common/autotest_common.sh@945 -- # kill 268871 00:15:08.098 22:52:58 -- common/autotest_common.sh@950 -- # wait 268871 00:15:08.098 22:52:59 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:15:08.098 22:52:59 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:15:08.098 22:52:59 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:15:08.098 22:52:59 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:15:08.098 22:52:59 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:15:08.098 22:52:59 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:15:08.098 22:52:59 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:15:08.098 22:52:59 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:15:10.635 22:53:01 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:15:10.635 00:15:10.635 real 0m28.565s 00:15:10.635 user 0m41.998s 00:15:10.635 sys 0m8.410s 00:15:10.635 22:53:01 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:15:10.635 22:53:01 -- common/autotest_common.sh@10 -- # set +x 00:15:10.635 ************************************ 00:15:10.635 END TEST nvmf_zcopy 00:15:10.635 ************************************ 00:15:10.635 22:53:01 -- nvmf/nvmf.sh@53 -- # run_test nvmf_nmic /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/nmic.sh --transport=tcp 00:15:10.635 22:53:01 -- common/autotest_common.sh@1077 -- # '[' 3 -le 1 ']' 00:15:10.635 22:53:01 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:15:10.635 22:53:01 -- common/autotest_common.sh@10 -- # set +x 00:15:10.635 ************************************ 00:15:10.635 START TEST nvmf_nmic 00:15:10.635 ************************************ 00:15:10.635 22:53:01 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/nmic.sh --transport=tcp 00:15:10.635 * Looking for test storage... 00:15:10.635 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:15:10.635 22:53:01 -- target/nmic.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:15:10.635 22:53:01 -- nvmf/common.sh@7 -- # uname -s 00:15:10.635 22:53:01 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:15:10.635 22:53:01 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:15:10.635 22:53:01 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:15:10.635 22:53:01 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:15:10.635 22:53:01 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:15:10.635 22:53:01 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:15:10.635 22:53:01 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:15:10.635 22:53:01 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:15:10.635 22:53:01 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:15:10.635 22:53:01 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:15:10.635 22:53:01 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:15:10.635 22:53:01 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:15:10.635 22:53:01 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:15:10.635 22:53:01 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:15:10.635 22:53:01 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:15:10.635 22:53:01 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:15:10.635 22:53:01 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:15:10.635 22:53:01 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:15:10.635 22:53:01 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:15:10.635 22:53:01 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:15:10.635 22:53:01 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:15:10.635 22:53:01 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:15:10.635 22:53:01 -- paths/export.sh@5 -- # export PATH 00:15:10.635 22:53:01 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:15:10.635 22:53:01 -- nvmf/common.sh@46 -- # : 0 00:15:10.635 22:53:01 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:15:10.635 22:53:01 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:15:10.635 22:53:01 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:15:10.635 22:53:01 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:15:10.635 22:53:01 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:15:10.635 22:53:01 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:15:10.635 22:53:01 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:15:10.635 22:53:01 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:15:10.635 22:53:01 -- target/nmic.sh@11 -- # MALLOC_BDEV_SIZE=64 00:15:10.635 22:53:01 -- target/nmic.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:15:10.635 22:53:01 -- target/nmic.sh@14 -- # nvmftestinit 00:15:10.635 22:53:01 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:15:10.635 22:53:01 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:15:10.635 22:53:01 -- nvmf/common.sh@436 -- # prepare_net_devs 00:15:10.635 22:53:01 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:15:10.635 22:53:01 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:15:10.635 22:53:01 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:15:10.635 22:53:01 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:15:10.635 22:53:01 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:15:10.635 22:53:01 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:15:10.635 22:53:01 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:15:10.635 22:53:01 -- nvmf/common.sh@284 -- # xtrace_disable 00:15:10.635 22:53:01 -- common/autotest_common.sh@10 -- # set +x 00:15:12.543 22:53:03 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:15:12.543 22:53:03 -- nvmf/common.sh@290 -- # pci_devs=() 00:15:12.543 22:53:03 -- nvmf/common.sh@290 -- # local -a pci_devs 00:15:12.543 22:53:03 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:15:12.543 22:53:03 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:15:12.543 22:53:03 -- nvmf/common.sh@292 -- # pci_drivers=() 00:15:12.543 22:53:03 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:15:12.543 22:53:03 -- nvmf/common.sh@294 -- # net_devs=() 00:15:12.543 22:53:03 -- nvmf/common.sh@294 -- # local -ga net_devs 00:15:12.543 22:53:03 -- nvmf/common.sh@295 -- # e810=() 00:15:12.543 22:53:03 -- nvmf/common.sh@295 -- # local -ga e810 00:15:12.543 22:53:03 -- nvmf/common.sh@296 -- # x722=() 00:15:12.543 22:53:03 -- nvmf/common.sh@296 -- # local -ga x722 00:15:12.543 22:53:03 -- nvmf/common.sh@297 -- # mlx=() 00:15:12.543 22:53:03 -- nvmf/common.sh@297 -- # local -ga mlx 00:15:12.543 22:53:03 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:15:12.543 22:53:03 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:15:12.543 22:53:03 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:15:12.543 22:53:03 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:15:12.543 22:53:03 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:15:12.543 22:53:03 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:15:12.543 22:53:03 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:15:12.543 22:53:03 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:15:12.543 22:53:03 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:15:12.543 22:53:03 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:15:12.543 22:53:03 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:15:12.543 22:53:03 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:15:12.543 22:53:03 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:15:12.543 22:53:03 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:15:12.543 22:53:03 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:15:12.543 22:53:03 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:15:12.543 22:53:03 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:15:12.543 22:53:03 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:15:12.543 22:53:03 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:15:12.543 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:15:12.543 22:53:03 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:15:12.543 22:53:03 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:15:12.543 22:53:03 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:15:12.543 22:53:03 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:15:12.543 22:53:03 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:15:12.543 22:53:03 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:15:12.543 22:53:03 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:15:12.543 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:15:12.543 22:53:03 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:15:12.543 22:53:03 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:15:12.543 22:53:03 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:15:12.543 22:53:03 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:15:12.543 22:53:03 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:15:12.543 22:53:03 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:15:12.543 22:53:03 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:15:12.543 22:53:03 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:15:12.543 22:53:03 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:15:12.543 22:53:03 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:15:12.543 22:53:03 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:15:12.543 22:53:03 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:15:12.543 22:53:03 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:15:12.543 Found net devices under 0000:0a:00.0: cvl_0_0 00:15:12.543 22:53:03 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:15:12.543 22:53:03 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:15:12.543 22:53:03 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:15:12.543 22:53:03 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:15:12.543 22:53:03 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:15:12.543 22:53:03 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:15:12.543 Found net devices under 0000:0a:00.1: cvl_0_1 00:15:12.543 22:53:03 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:15:12.543 22:53:03 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:15:12.543 22:53:03 -- nvmf/common.sh@402 -- # is_hw=yes 00:15:12.543 22:53:03 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:15:12.543 22:53:03 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:15:12.543 22:53:03 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:15:12.543 22:53:03 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:15:12.543 22:53:03 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:15:12.543 22:53:03 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:15:12.543 22:53:03 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:15:12.543 22:53:03 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:15:12.543 22:53:03 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:15:12.544 22:53:03 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:15:12.544 22:53:03 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:15:12.544 22:53:03 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:15:12.544 22:53:03 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:15:12.544 22:53:03 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:15:12.544 22:53:03 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:15:12.544 22:53:03 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:15:12.544 22:53:03 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:15:12.544 22:53:03 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:15:12.544 22:53:03 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:15:12.544 22:53:03 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:15:12.544 22:53:03 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:15:12.544 22:53:03 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:15:12.544 22:53:03 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:15:12.544 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:15:12.544 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.249 ms 00:15:12.544 00:15:12.544 --- 10.0.0.2 ping statistics --- 00:15:12.544 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:15:12.544 rtt min/avg/max/mdev = 0.249/0.249/0.249/0.000 ms 00:15:12.544 22:53:03 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:15:12.544 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:15:12.544 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.147 ms 00:15:12.544 00:15:12.544 --- 10.0.0.1 ping statistics --- 00:15:12.544 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:15:12.544 rtt min/avg/max/mdev = 0.147/0.147/0.147/0.000 ms 00:15:12.544 22:53:03 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:15:12.544 22:53:03 -- nvmf/common.sh@410 -- # return 0 00:15:12.544 22:53:03 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:15:12.544 22:53:03 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:15:12.544 22:53:03 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:15:12.544 22:53:03 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:15:12.544 22:53:03 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:15:12.544 22:53:03 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:15:12.544 22:53:03 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:15:12.544 22:53:03 -- target/nmic.sh@15 -- # nvmfappstart -m 0xF 00:15:12.544 22:53:03 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:15:12.544 22:53:03 -- common/autotest_common.sh@712 -- # xtrace_disable 00:15:12.544 22:53:03 -- common/autotest_common.sh@10 -- # set +x 00:15:12.544 22:53:03 -- nvmf/common.sh@469 -- # nvmfpid=273697 00:15:12.544 22:53:03 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:15:12.544 22:53:03 -- nvmf/common.sh@470 -- # waitforlisten 273697 00:15:12.544 22:53:03 -- common/autotest_common.sh@819 -- # '[' -z 273697 ']' 00:15:12.544 22:53:03 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk.sock 00:15:12.544 22:53:03 -- common/autotest_common.sh@824 -- # local max_retries=100 00:15:12.544 22:53:03 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:15:12.544 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:15:12.544 22:53:03 -- common/autotest_common.sh@828 -- # xtrace_disable 00:15:12.544 22:53:03 -- common/autotest_common.sh@10 -- # set +x 00:15:12.544 [2024-04-16 22:53:03.372143] Starting SPDK v24.01.1-pre git sha1 4b134b4ab / DPDK 23.11.0 initialization... 00:15:12.544 [2024-04-16 22:53:03.372242] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:15:12.544 EAL: No free 2048 kB hugepages reported on node 1 00:15:12.544 [2024-04-16 22:53:03.443079] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:15:12.544 [2024-04-16 22:53:03.563946] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:15:12.544 [2024-04-16 22:53:03.564108] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:15:12.544 [2024-04-16 22:53:03.564127] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:15:12.544 [2024-04-16 22:53:03.564142] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:15:12.544 [2024-04-16 22:53:03.564206] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:15:12.544 [2024-04-16 22:53:03.564251] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:15:12.544 [2024-04-16 22:53:03.564305] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:15:12.544 [2024-04-16 22:53:03.564309] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:15:13.482 22:53:04 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:15:13.482 22:53:04 -- common/autotest_common.sh@852 -- # return 0 00:15:13.482 22:53:04 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:15:13.482 22:53:04 -- common/autotest_common.sh@718 -- # xtrace_disable 00:15:13.482 22:53:04 -- common/autotest_common.sh@10 -- # set +x 00:15:13.482 22:53:04 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:15:13.482 22:53:04 -- target/nmic.sh@17 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:15:13.482 22:53:04 -- common/autotest_common.sh@551 -- # xtrace_disable 00:15:13.482 22:53:04 -- common/autotest_common.sh@10 -- # set +x 00:15:13.482 [2024-04-16 22:53:04.330613] tcp.c: 659:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:15:13.482 22:53:04 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:15:13.482 22:53:04 -- target/nmic.sh@20 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc0 00:15:13.482 22:53:04 -- common/autotest_common.sh@551 -- # xtrace_disable 00:15:13.482 22:53:04 -- common/autotest_common.sh@10 -- # set +x 00:15:13.482 Malloc0 00:15:13.482 22:53:04 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:15:13.482 22:53:04 -- target/nmic.sh@21 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDKISFASTANDAWESOME 00:15:13.482 22:53:04 -- common/autotest_common.sh@551 -- # xtrace_disable 00:15:13.482 22:53:04 -- common/autotest_common.sh@10 -- # set +x 00:15:13.482 22:53:04 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:15:13.482 22:53:04 -- target/nmic.sh@22 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:15:13.482 22:53:04 -- common/autotest_common.sh@551 -- # xtrace_disable 00:15:13.482 22:53:04 -- common/autotest_common.sh@10 -- # set +x 00:15:13.482 22:53:04 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:15:13.482 22:53:04 -- target/nmic.sh@23 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:15:13.482 22:53:04 -- common/autotest_common.sh@551 -- # xtrace_disable 00:15:13.482 22:53:04 -- common/autotest_common.sh@10 -- # set +x 00:15:13.482 [2024-04-16 22:53:04.384151] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:15:13.482 22:53:04 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:15:13.482 22:53:04 -- target/nmic.sh@25 -- # echo 'test case1: single bdev can'\''t be used in multiple subsystems' 00:15:13.482 test case1: single bdev can't be used in multiple subsystems 00:15:13.482 22:53:04 -- target/nmic.sh@26 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode2 -a -s SPDK2 00:15:13.482 22:53:04 -- common/autotest_common.sh@551 -- # xtrace_disable 00:15:13.482 22:53:04 -- common/autotest_common.sh@10 -- # set +x 00:15:13.482 22:53:04 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:15:13.482 22:53:04 -- target/nmic.sh@27 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode2 -t tcp -a 10.0.0.2 -s 4420 00:15:13.482 22:53:04 -- common/autotest_common.sh@551 -- # xtrace_disable 00:15:13.482 22:53:04 -- common/autotest_common.sh@10 -- # set +x 00:15:13.482 22:53:04 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:15:13.482 22:53:04 -- target/nmic.sh@28 -- # nmic_status=0 00:15:13.482 22:53:04 -- target/nmic.sh@29 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode2 Malloc0 00:15:13.482 22:53:04 -- common/autotest_common.sh@551 -- # xtrace_disable 00:15:13.482 22:53:04 -- common/autotest_common.sh@10 -- # set +x 00:15:13.482 [2024-04-16 22:53:04.408033] bdev.c:7935:bdev_open: *ERROR*: bdev Malloc0 already claimed: type exclusive_write by module NVMe-oF Target 00:15:13.482 [2024-04-16 22:53:04.408068] subsystem.c:1779:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Subsystem nqn.2016-06.io.spdk:cnode2: bdev Malloc0 cannot be opened, error=-1 00:15:13.482 [2024-04-16 22:53:04.408099] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:13.482 request: 00:15:13.482 { 00:15:13.482 "nqn": "nqn.2016-06.io.spdk:cnode2", 00:15:13.482 "namespace": { 00:15:13.482 "bdev_name": "Malloc0" 00:15:13.482 }, 00:15:13.482 "method": "nvmf_subsystem_add_ns", 00:15:13.482 "req_id": 1 00:15:13.482 } 00:15:13.482 Got JSON-RPC error response 00:15:13.482 response: 00:15:13.482 { 00:15:13.482 "code": -32602, 00:15:13.482 "message": "Invalid parameters" 00:15:13.482 } 00:15:13.482 22:53:04 -- common/autotest_common.sh@579 -- # [[ 1 == 0 ]] 00:15:13.482 22:53:04 -- target/nmic.sh@29 -- # nmic_status=1 00:15:13.482 22:53:04 -- target/nmic.sh@31 -- # '[' 1 -eq 0 ']' 00:15:13.482 22:53:04 -- target/nmic.sh@36 -- # echo ' Adding namespace failed - expected result.' 00:15:13.482 Adding namespace failed - expected result. 00:15:13.482 22:53:04 -- target/nmic.sh@39 -- # echo 'test case2: host connect to nvmf target in multiple paths' 00:15:13.482 test case2: host connect to nvmf target in multiple paths 00:15:13.482 22:53:04 -- target/nmic.sh@40 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4421 00:15:13.482 22:53:04 -- common/autotest_common.sh@551 -- # xtrace_disable 00:15:13.482 22:53:04 -- common/autotest_common.sh@10 -- # set +x 00:15:13.482 [2024-04-16 22:53:04.416150] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4421 *** 00:15:13.482 22:53:04 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:15:13.482 22:53:04 -- target/nmic.sh@41 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:15:14.051 22:53:05 -- target/nmic.sh@42 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4421 00:15:14.621 22:53:05 -- target/nmic.sh@44 -- # waitforserial SPDKISFASTANDAWESOME 00:15:14.621 22:53:05 -- common/autotest_common.sh@1177 -- # local i=0 00:15:14.621 22:53:05 -- common/autotest_common.sh@1178 -- # local nvme_device_counter=1 nvme_devices=0 00:15:14.621 22:53:05 -- common/autotest_common.sh@1179 -- # [[ -n '' ]] 00:15:14.621 22:53:05 -- common/autotest_common.sh@1184 -- # sleep 2 00:15:16.552 22:53:07 -- common/autotest_common.sh@1185 -- # (( i++ <= 15 )) 00:15:16.552 22:53:07 -- common/autotest_common.sh@1186 -- # lsblk -l -o NAME,SERIAL 00:15:16.552 22:53:07 -- common/autotest_common.sh@1186 -- # grep -c SPDKISFASTANDAWESOME 00:15:16.552 22:53:07 -- common/autotest_common.sh@1186 -- # nvme_devices=1 00:15:16.552 22:53:07 -- common/autotest_common.sh@1187 -- # (( nvme_devices == nvme_device_counter )) 00:15:16.552 22:53:07 -- common/autotest_common.sh@1187 -- # return 0 00:15:16.552 22:53:07 -- target/nmic.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/fio-wrapper -p nvmf -i 4096 -d 1 -t write -r 1 -v 00:15:16.552 [global] 00:15:16.552 thread=1 00:15:16.552 invalidate=1 00:15:16.552 rw=write 00:15:16.552 time_based=1 00:15:16.552 runtime=1 00:15:16.552 ioengine=libaio 00:15:16.552 direct=1 00:15:16.552 bs=4096 00:15:16.552 iodepth=1 00:15:16.552 norandommap=0 00:15:16.552 numjobs=1 00:15:16.552 00:15:16.552 verify_dump=1 00:15:16.552 verify_backlog=512 00:15:16.552 verify_state_save=0 00:15:16.552 do_verify=1 00:15:16.552 verify=crc32c-intel 00:15:16.552 [job0] 00:15:16.552 filename=/dev/nvme0n1 00:15:16.552 Could not set queue depth (nvme0n1) 00:15:16.810 job0: (g=0): rw=write, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:15:16.810 fio-3.35 00:15:16.810 Starting 1 thread 00:15:18.189 00:15:18.189 job0: (groupid=0, jobs=1): err= 0: pid=274357: Tue Apr 16 22:53:09 2024 00:15:18.189 read: IOPS=717, BW=2869KiB/s (2938kB/s)(2924KiB/1019msec) 00:15:18.189 slat (nsec): min=5366, max=50798, avg=9989.53, stdev=6260.13 00:15:18.189 clat (usec): min=309, max=42050, avg=974.76, stdev=5020.17 00:15:18.189 lat (usec): min=315, max=42066, avg=984.75, stdev=5021.82 00:15:18.189 clat percentiles (usec): 00:15:18.189 | 1.00th=[ 314], 5.00th=[ 322], 10.00th=[ 326], 20.00th=[ 334], 00:15:18.189 | 30.00th=[ 338], 40.00th=[ 347], 50.00th=[ 351], 60.00th=[ 359], 00:15:18.189 | 70.00th=[ 371], 80.00th=[ 379], 90.00th=[ 388], 95.00th=[ 400], 00:15:18.189 | 99.00th=[41157], 99.50th=[42206], 99.90th=[42206], 99.95th=[42206], 00:15:18.189 | 99.99th=[42206] 00:15:18.189 write: IOPS=1004, BW=4020KiB/s (4116kB/s)(4096KiB/1019msec); 0 zone resets 00:15:18.189 slat (usec): min=7, max=28505, avg=43.69, stdev=890.33 00:15:18.189 clat (usec): min=165, max=457, avg=242.13, stdev=53.95 00:15:18.189 lat (usec): min=174, max=28743, avg=285.83, stdev=891.99 00:15:18.189 clat percentiles (usec): 00:15:18.189 | 1.00th=[ 174], 5.00th=[ 180], 10.00th=[ 184], 20.00th=[ 192], 00:15:18.189 | 30.00th=[ 204], 40.00th=[ 221], 50.00th=[ 239], 60.00th=[ 253], 00:15:18.189 | 70.00th=[ 262], 80.00th=[ 269], 90.00th=[ 310], 95.00th=[ 383], 00:15:18.189 | 99.00th=[ 400], 99.50th=[ 424], 99.90th=[ 457], 99.95th=[ 457], 00:15:18.189 | 99.99th=[ 457] 00:15:18.189 bw ( KiB/s): min= 8192, max= 8192, per=100.00%, avg=8192.00, stdev= 0.00, samples=1 00:15:18.189 iops : min= 2048, max= 2048, avg=2048.00, stdev= 0.00, samples=1 00:15:18.189 lat (usec) : 250=32.76%, 500=66.61% 00:15:18.189 lat (msec) : 50=0.63% 00:15:18.189 cpu : usr=1.38%, sys=3.34%, ctx=1757, majf=0, minf=2 00:15:18.189 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:15:18.189 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:15:18.189 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:15:18.189 issued rwts: total=731,1024,0,0 short=0,0,0,0 dropped=0,0,0,0 00:15:18.189 latency : target=0, window=0, percentile=100.00%, depth=1 00:15:18.189 00:15:18.189 Run status group 0 (all jobs): 00:15:18.189 READ: bw=2869KiB/s (2938kB/s), 2869KiB/s-2869KiB/s (2938kB/s-2938kB/s), io=2924KiB (2994kB), run=1019-1019msec 00:15:18.189 WRITE: bw=4020KiB/s (4116kB/s), 4020KiB/s-4020KiB/s (4116kB/s-4116kB/s), io=4096KiB (4194kB), run=1019-1019msec 00:15:18.189 00:15:18.189 Disk stats (read/write): 00:15:18.189 nvme0n1: ios=753/1024, merge=0/0, ticks=1537/235, in_queue=1772, util=98.60% 00:15:18.189 22:53:09 -- target/nmic.sh@48 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:15:18.189 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 2 controller(s) 00:15:18.189 22:53:09 -- target/nmic.sh@49 -- # waitforserial_disconnect SPDKISFASTANDAWESOME 00:15:18.189 22:53:09 -- common/autotest_common.sh@1198 -- # local i=0 00:15:18.189 22:53:09 -- common/autotest_common.sh@1199 -- # lsblk -o NAME,SERIAL 00:15:18.189 22:53:09 -- common/autotest_common.sh@1199 -- # grep -q -w SPDKISFASTANDAWESOME 00:15:18.189 22:53:09 -- common/autotest_common.sh@1206 -- # lsblk -l -o NAME,SERIAL 00:15:18.189 22:53:09 -- common/autotest_common.sh@1206 -- # grep -q -w SPDKISFASTANDAWESOME 00:15:18.189 22:53:09 -- common/autotest_common.sh@1210 -- # return 0 00:15:18.189 22:53:09 -- target/nmic.sh@51 -- # trap - SIGINT SIGTERM EXIT 00:15:18.189 22:53:09 -- target/nmic.sh@53 -- # nvmftestfini 00:15:18.189 22:53:09 -- nvmf/common.sh@476 -- # nvmfcleanup 00:15:18.189 22:53:09 -- nvmf/common.sh@116 -- # sync 00:15:18.189 22:53:09 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:15:18.189 22:53:09 -- nvmf/common.sh@119 -- # set +e 00:15:18.189 22:53:09 -- nvmf/common.sh@120 -- # for i in {1..20} 00:15:18.189 22:53:09 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:15:18.189 rmmod nvme_tcp 00:15:18.189 rmmod nvme_fabrics 00:15:18.189 rmmod nvme_keyring 00:15:18.189 22:53:09 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:15:18.189 22:53:09 -- nvmf/common.sh@123 -- # set -e 00:15:18.189 22:53:09 -- nvmf/common.sh@124 -- # return 0 00:15:18.189 22:53:09 -- nvmf/common.sh@477 -- # '[' -n 273697 ']' 00:15:18.189 22:53:09 -- nvmf/common.sh@478 -- # killprocess 273697 00:15:18.189 22:53:09 -- common/autotest_common.sh@926 -- # '[' -z 273697 ']' 00:15:18.189 22:53:09 -- common/autotest_common.sh@930 -- # kill -0 273697 00:15:18.189 22:53:09 -- common/autotest_common.sh@931 -- # uname 00:15:18.189 22:53:09 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:15:18.189 22:53:09 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 273697 00:15:18.189 22:53:09 -- common/autotest_common.sh@932 -- # process_name=reactor_0 00:15:18.189 22:53:09 -- common/autotest_common.sh@936 -- # '[' reactor_0 = sudo ']' 00:15:18.189 22:53:09 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 273697' 00:15:18.189 killing process with pid 273697 00:15:18.189 22:53:09 -- common/autotest_common.sh@945 -- # kill 273697 00:15:18.189 22:53:09 -- common/autotest_common.sh@950 -- # wait 273697 00:15:18.447 22:53:09 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:15:18.447 22:53:09 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:15:18.447 22:53:09 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:15:18.447 22:53:09 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:15:18.448 22:53:09 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:15:18.448 22:53:09 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:15:18.448 22:53:09 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:15:18.448 22:53:09 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:15:20.984 22:53:11 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:15:20.984 00:15:20.984 real 0m10.360s 00:15:20.984 user 0m24.600s 00:15:20.984 sys 0m2.257s 00:15:20.984 22:53:11 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:15:20.984 22:53:11 -- common/autotest_common.sh@10 -- # set +x 00:15:20.984 ************************************ 00:15:20.984 END TEST nvmf_nmic 00:15:20.984 ************************************ 00:15:20.984 22:53:11 -- nvmf/nvmf.sh@54 -- # run_test nvmf_fio_target /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/fio.sh --transport=tcp 00:15:20.984 22:53:11 -- common/autotest_common.sh@1077 -- # '[' 3 -le 1 ']' 00:15:20.984 22:53:11 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:15:20.984 22:53:11 -- common/autotest_common.sh@10 -- # set +x 00:15:20.984 ************************************ 00:15:20.984 START TEST nvmf_fio_target 00:15:20.984 ************************************ 00:15:20.984 22:53:11 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/fio.sh --transport=tcp 00:15:20.984 * Looking for test storage... 00:15:20.984 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:15:20.984 22:53:11 -- target/fio.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:15:20.984 22:53:11 -- nvmf/common.sh@7 -- # uname -s 00:15:20.984 22:53:11 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:15:20.984 22:53:11 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:15:20.984 22:53:11 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:15:20.984 22:53:11 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:15:20.984 22:53:11 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:15:20.984 22:53:11 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:15:20.984 22:53:11 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:15:20.984 22:53:11 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:15:20.984 22:53:11 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:15:20.984 22:53:11 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:15:20.984 22:53:11 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:15:20.984 22:53:11 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:15:20.984 22:53:11 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:15:20.984 22:53:11 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:15:20.984 22:53:11 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:15:20.984 22:53:11 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:15:20.984 22:53:11 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:15:20.984 22:53:11 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:15:20.984 22:53:11 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:15:20.984 22:53:11 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:15:20.984 22:53:11 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:15:20.984 22:53:11 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:15:20.984 22:53:11 -- paths/export.sh@5 -- # export PATH 00:15:20.984 22:53:11 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:15:20.984 22:53:11 -- nvmf/common.sh@46 -- # : 0 00:15:20.984 22:53:11 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:15:20.984 22:53:11 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:15:20.984 22:53:11 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:15:20.984 22:53:11 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:15:20.984 22:53:11 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:15:20.984 22:53:11 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:15:20.984 22:53:11 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:15:20.984 22:53:11 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:15:20.985 22:53:11 -- target/fio.sh@11 -- # MALLOC_BDEV_SIZE=64 00:15:20.985 22:53:11 -- target/fio.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:15:20.985 22:53:11 -- target/fio.sh@14 -- # rpc_py=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:15:20.985 22:53:11 -- target/fio.sh@16 -- # nvmftestinit 00:15:20.985 22:53:11 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:15:20.985 22:53:11 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:15:20.985 22:53:11 -- nvmf/common.sh@436 -- # prepare_net_devs 00:15:20.985 22:53:11 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:15:20.985 22:53:11 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:15:20.985 22:53:11 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:15:20.985 22:53:11 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:15:20.985 22:53:11 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:15:20.985 22:53:11 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:15:20.985 22:53:11 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:15:20.985 22:53:11 -- nvmf/common.sh@284 -- # xtrace_disable 00:15:20.985 22:53:11 -- common/autotest_common.sh@10 -- # set +x 00:15:22.887 22:53:13 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:15:22.887 22:53:13 -- nvmf/common.sh@290 -- # pci_devs=() 00:15:22.887 22:53:13 -- nvmf/common.sh@290 -- # local -a pci_devs 00:15:22.887 22:53:13 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:15:22.887 22:53:13 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:15:22.887 22:53:13 -- nvmf/common.sh@292 -- # pci_drivers=() 00:15:22.887 22:53:13 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:15:22.887 22:53:13 -- nvmf/common.sh@294 -- # net_devs=() 00:15:22.887 22:53:13 -- nvmf/common.sh@294 -- # local -ga net_devs 00:15:22.887 22:53:13 -- nvmf/common.sh@295 -- # e810=() 00:15:22.887 22:53:13 -- nvmf/common.sh@295 -- # local -ga e810 00:15:22.887 22:53:13 -- nvmf/common.sh@296 -- # x722=() 00:15:22.887 22:53:13 -- nvmf/common.sh@296 -- # local -ga x722 00:15:22.887 22:53:13 -- nvmf/common.sh@297 -- # mlx=() 00:15:22.887 22:53:13 -- nvmf/common.sh@297 -- # local -ga mlx 00:15:22.888 22:53:13 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:15:22.888 22:53:13 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:15:22.888 22:53:13 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:15:22.888 22:53:13 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:15:22.888 22:53:13 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:15:22.888 22:53:13 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:15:22.888 22:53:13 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:15:22.888 22:53:13 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:15:22.888 22:53:13 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:15:22.888 22:53:13 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:15:22.888 22:53:13 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:15:22.888 22:53:13 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:15:22.888 22:53:13 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:15:22.888 22:53:13 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:15:22.888 22:53:13 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:15:22.888 22:53:13 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:15:22.888 22:53:13 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:15:22.888 22:53:13 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:15:22.888 22:53:13 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:15:22.888 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:15:22.888 22:53:13 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:15:22.888 22:53:13 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:15:22.888 22:53:13 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:15:22.888 22:53:13 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:15:22.888 22:53:13 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:15:22.888 22:53:13 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:15:22.888 22:53:13 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:15:22.888 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:15:22.888 22:53:13 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:15:22.888 22:53:13 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:15:22.888 22:53:13 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:15:22.888 22:53:13 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:15:22.888 22:53:13 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:15:22.888 22:53:13 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:15:22.888 22:53:13 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:15:22.888 22:53:13 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:15:22.888 22:53:13 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:15:22.888 22:53:13 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:15:22.888 22:53:13 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:15:22.888 22:53:13 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:15:22.888 22:53:13 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:15:22.888 Found net devices under 0000:0a:00.0: cvl_0_0 00:15:22.888 22:53:13 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:15:22.888 22:53:13 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:15:22.888 22:53:13 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:15:22.888 22:53:13 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:15:22.888 22:53:13 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:15:22.888 22:53:13 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:15:22.888 Found net devices under 0000:0a:00.1: cvl_0_1 00:15:22.888 22:53:13 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:15:22.888 22:53:13 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:15:22.888 22:53:13 -- nvmf/common.sh@402 -- # is_hw=yes 00:15:22.888 22:53:13 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:15:22.888 22:53:13 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:15:22.888 22:53:13 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:15:22.888 22:53:13 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:15:22.888 22:53:13 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:15:22.888 22:53:13 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:15:22.888 22:53:13 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:15:22.888 22:53:13 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:15:22.888 22:53:13 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:15:22.888 22:53:13 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:15:22.888 22:53:13 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:15:22.888 22:53:13 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:15:22.888 22:53:13 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:15:22.888 22:53:13 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:15:22.888 22:53:13 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:15:22.888 22:53:13 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:15:22.888 22:53:13 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:15:22.888 22:53:13 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:15:22.888 22:53:13 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:15:22.888 22:53:13 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:15:22.888 22:53:13 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:15:22.888 22:53:13 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:15:22.888 22:53:13 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:15:22.888 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:15:22.888 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.178 ms 00:15:22.888 00:15:22.888 --- 10.0.0.2 ping statistics --- 00:15:22.888 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:15:22.888 rtt min/avg/max/mdev = 0.178/0.178/0.178/0.000 ms 00:15:22.888 22:53:13 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:15:22.888 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:15:22.888 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.103 ms 00:15:22.888 00:15:22.888 --- 10.0.0.1 ping statistics --- 00:15:22.888 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:15:22.888 rtt min/avg/max/mdev = 0.103/0.103/0.103/0.000 ms 00:15:22.888 22:53:13 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:15:22.888 22:53:13 -- nvmf/common.sh@410 -- # return 0 00:15:22.888 22:53:13 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:15:22.888 22:53:13 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:15:22.888 22:53:13 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:15:22.888 22:53:13 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:15:22.888 22:53:13 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:15:22.888 22:53:13 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:15:22.888 22:53:13 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:15:22.888 22:53:13 -- target/fio.sh@17 -- # nvmfappstart -m 0xF 00:15:22.888 22:53:13 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:15:22.888 22:53:13 -- common/autotest_common.sh@712 -- # xtrace_disable 00:15:22.888 22:53:13 -- common/autotest_common.sh@10 -- # set +x 00:15:22.888 22:53:13 -- nvmf/common.sh@469 -- # nvmfpid=276446 00:15:22.888 22:53:13 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:15:22.888 22:53:13 -- nvmf/common.sh@470 -- # waitforlisten 276446 00:15:22.888 22:53:13 -- common/autotest_common.sh@819 -- # '[' -z 276446 ']' 00:15:22.888 22:53:13 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk.sock 00:15:22.888 22:53:13 -- common/autotest_common.sh@824 -- # local max_retries=100 00:15:22.888 22:53:13 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:15:22.888 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:15:22.888 22:53:13 -- common/autotest_common.sh@828 -- # xtrace_disable 00:15:22.888 22:53:13 -- common/autotest_common.sh@10 -- # set +x 00:15:22.888 [2024-04-16 22:53:13.776890] Starting SPDK v24.01.1-pre git sha1 4b134b4ab / DPDK 23.11.0 initialization... 00:15:22.888 [2024-04-16 22:53:13.776975] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:15:22.888 EAL: No free 2048 kB hugepages reported on node 1 00:15:22.888 [2024-04-16 22:53:13.841335] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:15:22.888 [2024-04-16 22:53:13.946732] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:15:22.888 [2024-04-16 22:53:13.946904] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:15:22.888 [2024-04-16 22:53:13.946922] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:15:22.888 [2024-04-16 22:53:13.946933] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:15:22.888 [2024-04-16 22:53:13.947061] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:15:22.888 [2024-04-16 22:53:13.947120] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:15:22.888 [2024-04-16 22:53:13.947193] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:15:22.888 [2024-04-16 22:53:13.947197] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:15:23.822 22:53:14 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:15:23.822 22:53:14 -- common/autotest_common.sh@852 -- # return 0 00:15:23.822 22:53:14 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:15:23.822 22:53:14 -- common/autotest_common.sh@718 -- # xtrace_disable 00:15:23.822 22:53:14 -- common/autotest_common.sh@10 -- # set +x 00:15:23.822 22:53:14 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:15:23.822 22:53:14 -- target/fio.sh@19 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_transport -t tcp -o -u 8192 00:15:24.080 [2024-04-16 22:53:15.012647] tcp.c: 659:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:15:24.080 22:53:15 -- target/fio.sh@21 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 00:15:24.338 22:53:15 -- target/fio.sh@21 -- # malloc_bdevs='Malloc0 ' 00:15:24.338 22:53:15 -- target/fio.sh@22 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 00:15:24.596 22:53:15 -- target/fio.sh@22 -- # malloc_bdevs+=Malloc1 00:15:24.596 22:53:15 -- target/fio.sh@24 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 00:15:24.854 22:53:15 -- target/fio.sh@24 -- # raid_malloc_bdevs='Malloc2 ' 00:15:24.854 22:53:15 -- target/fio.sh@25 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 00:15:25.113 22:53:16 -- target/fio.sh@25 -- # raid_malloc_bdevs+=Malloc3 00:15:25.113 22:53:16 -- target/fio.sh@26 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_raid_create -n raid0 -z 64 -r 0 -b 'Malloc2 Malloc3' 00:15:25.371 22:53:16 -- target/fio.sh@29 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 00:15:25.629 22:53:16 -- target/fio.sh@29 -- # concat_malloc_bdevs='Malloc4 ' 00:15:25.629 22:53:16 -- target/fio.sh@30 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 00:15:25.887 22:53:16 -- target/fio.sh@30 -- # concat_malloc_bdevs+='Malloc5 ' 00:15:25.887 22:53:16 -- target/fio.sh@31 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 00:15:26.145 22:53:17 -- target/fio.sh@31 -- # concat_malloc_bdevs+=Malloc6 00:15:26.145 22:53:17 -- target/fio.sh@32 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_raid_create -n concat0 -r concat -z 64 -b 'Malloc4 Malloc5 Malloc6' 00:15:26.403 22:53:17 -- target/fio.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDKISFASTANDAWESOME 00:15:26.403 22:53:17 -- target/fio.sh@35 -- # for malloc_bdev in $malloc_bdevs 00:15:26.403 22:53:17 -- target/fio.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:15:26.662 22:53:17 -- target/fio.sh@35 -- # for malloc_bdev in $malloc_bdevs 00:15:26.662 22:53:17 -- target/fio.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:15:26.920 22:53:18 -- target/fio.sh@38 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:15:27.177 [2024-04-16 22:53:18.252894] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:15:27.177 22:53:18 -- target/fio.sh@41 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 raid0 00:15:27.434 22:53:18 -- target/fio.sh@44 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 concat0 00:15:27.691 22:53:18 -- target/fio.sh@46 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:15:28.257 22:53:19 -- target/fio.sh@48 -- # waitforserial SPDKISFASTANDAWESOME 4 00:15:28.257 22:53:19 -- common/autotest_common.sh@1177 -- # local i=0 00:15:28.257 22:53:19 -- common/autotest_common.sh@1178 -- # local nvme_device_counter=1 nvme_devices=0 00:15:28.257 22:53:19 -- common/autotest_common.sh@1179 -- # [[ -n 4 ]] 00:15:28.257 22:53:19 -- common/autotest_common.sh@1180 -- # nvme_device_counter=4 00:15:28.257 22:53:19 -- common/autotest_common.sh@1184 -- # sleep 2 00:15:30.789 22:53:21 -- common/autotest_common.sh@1185 -- # (( i++ <= 15 )) 00:15:30.789 22:53:21 -- common/autotest_common.sh@1186 -- # lsblk -l -o NAME,SERIAL 00:15:30.789 22:53:21 -- common/autotest_common.sh@1186 -- # grep -c SPDKISFASTANDAWESOME 00:15:30.789 22:53:21 -- common/autotest_common.sh@1186 -- # nvme_devices=4 00:15:30.789 22:53:21 -- common/autotest_common.sh@1187 -- # (( nvme_devices == nvme_device_counter )) 00:15:30.789 22:53:21 -- common/autotest_common.sh@1187 -- # return 0 00:15:30.789 22:53:21 -- target/fio.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/fio-wrapper -p nvmf -i 4096 -d 1 -t write -r 1 -v 00:15:30.789 [global] 00:15:30.789 thread=1 00:15:30.789 invalidate=1 00:15:30.789 rw=write 00:15:30.789 time_based=1 00:15:30.789 runtime=1 00:15:30.789 ioengine=libaio 00:15:30.789 direct=1 00:15:30.789 bs=4096 00:15:30.789 iodepth=1 00:15:30.789 norandommap=0 00:15:30.789 numjobs=1 00:15:30.789 00:15:30.789 verify_dump=1 00:15:30.789 verify_backlog=512 00:15:30.789 verify_state_save=0 00:15:30.789 do_verify=1 00:15:30.789 verify=crc32c-intel 00:15:30.789 [job0] 00:15:30.789 filename=/dev/nvme0n1 00:15:30.789 [job1] 00:15:30.789 filename=/dev/nvme0n2 00:15:30.789 [job2] 00:15:30.789 filename=/dev/nvme0n3 00:15:30.789 [job3] 00:15:30.789 filename=/dev/nvme0n4 00:15:30.789 Could not set queue depth (nvme0n1) 00:15:30.789 Could not set queue depth (nvme0n2) 00:15:30.789 Could not set queue depth (nvme0n3) 00:15:30.789 Could not set queue depth (nvme0n4) 00:15:30.789 job0: (g=0): rw=write, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:15:30.789 job1: (g=0): rw=write, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:15:30.789 job2: (g=0): rw=write, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:15:30.789 job3: (g=0): rw=write, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:15:30.789 fio-3.35 00:15:30.789 Starting 4 threads 00:15:31.724 00:15:31.724 job0: (groupid=0, jobs=1): err= 0: pid=277550: Tue Apr 16 22:53:22 2024 00:15:31.724 read: IOPS=1116, BW=4466KiB/s (4573kB/s)(4564KiB/1022msec) 00:15:31.725 slat (nsec): min=5691, max=75238, avg=13073.50, stdev=5779.08 00:15:31.725 clat (usec): min=277, max=41413, avg=524.80, stdev=2693.90 00:15:31.725 lat (usec): min=284, max=41425, avg=537.87, stdev=2693.87 00:15:31.725 clat percentiles (usec): 00:15:31.725 | 1.00th=[ 289], 5.00th=[ 302], 10.00th=[ 310], 20.00th=[ 318], 00:15:31.725 | 30.00th=[ 322], 40.00th=[ 326], 50.00th=[ 330], 60.00th=[ 334], 00:15:31.725 | 70.00th=[ 343], 80.00th=[ 355], 90.00th=[ 400], 95.00th=[ 449], 00:15:31.725 | 99.00th=[ 611], 99.50th=[ 3064], 99.90th=[41157], 99.95th=[41157], 00:15:31.725 | 99.99th=[41157] 00:15:31.725 write: IOPS=1502, BW=6012KiB/s (6156kB/s)(6144KiB/1022msec); 0 zone resets 00:15:31.725 slat (nsec): min=7047, max=70248, avg=15751.18, stdev=9475.42 00:15:31.725 clat (usec): min=160, max=533, avg=242.45, stdev=78.37 00:15:31.725 lat (usec): min=168, max=558, avg=258.20, stdev=82.32 00:15:31.725 clat percentiles (usec): 00:15:31.725 | 1.00th=[ 163], 5.00th=[ 174], 10.00th=[ 178], 20.00th=[ 184], 00:15:31.725 | 30.00th=[ 190], 40.00th=[ 196], 50.00th=[ 204], 60.00th=[ 227], 00:15:31.725 | 70.00th=[ 262], 80.00th=[ 306], 90.00th=[ 379], 95.00th=[ 408], 00:15:31.725 | 99.00th=[ 478], 99.50th=[ 494], 99.90th=[ 519], 99.95th=[ 537], 00:15:31.725 | 99.99th=[ 537] 00:15:31.725 bw ( KiB/s): min= 4096, max= 8192, per=33.64%, avg=6144.00, stdev=2896.31, samples=2 00:15:31.725 iops : min= 1024, max= 2048, avg=1536.00, stdev=724.08, samples=2 00:15:31.725 lat (usec) : 250=38.06%, 500=60.78%, 750=0.90%, 1000=0.04% 00:15:31.725 lat (msec) : 4=0.04%, 50=0.19% 00:15:31.725 cpu : usr=3.62%, sys=4.51%, ctx=2677, majf=0, minf=1 00:15:31.725 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:15:31.725 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:15:31.725 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:15:31.725 issued rwts: total=1141,1536,0,0 short=0,0,0,0 dropped=0,0,0,0 00:15:31.725 latency : target=0, window=0, percentile=100.00%, depth=1 00:15:31.725 job1: (groupid=0, jobs=1): err= 0: pid=277551: Tue Apr 16 22:53:22 2024 00:15:31.725 read: IOPS=511, BW=2046KiB/s (2095kB/s)(2048KiB/1001msec) 00:15:31.725 slat (nsec): min=4618, max=45362, avg=10473.23, stdev=4318.32 00:15:31.725 clat (usec): min=286, max=41016, avg=1567.40, stdev=6848.26 00:15:31.725 lat (usec): min=292, max=41031, avg=1577.87, stdev=6849.43 00:15:31.725 clat percentiles (usec): 00:15:31.725 | 1.00th=[ 297], 5.00th=[ 310], 10.00th=[ 318], 20.00th=[ 330], 00:15:31.725 | 30.00th=[ 343], 40.00th=[ 371], 50.00th=[ 388], 60.00th=[ 392], 00:15:31.725 | 70.00th=[ 396], 80.00th=[ 416], 90.00th=[ 469], 95.00th=[ 486], 00:15:31.725 | 99.00th=[41157], 99.50th=[41157], 99.90th=[41157], 99.95th=[41157], 00:15:31.725 | 99.99th=[41157] 00:15:31.725 write: IOPS=875, BW=3500KiB/s (3585kB/s)(3504KiB/1001msec); 0 zone resets 00:15:31.725 slat (nsec): min=5890, max=48757, avg=10935.94, stdev=5550.61 00:15:31.725 clat (usec): min=162, max=281, avg=204.10, stdev=20.54 00:15:31.725 lat (usec): min=168, max=301, avg=215.03, stdev=23.21 00:15:31.725 clat percentiles (usec): 00:15:31.725 | 1.00th=[ 167], 5.00th=[ 172], 10.00th=[ 176], 20.00th=[ 184], 00:15:31.725 | 30.00th=[ 192], 40.00th=[ 200], 50.00th=[ 204], 60.00th=[ 210], 00:15:31.725 | 70.00th=[ 217], 80.00th=[ 223], 90.00th=[ 231], 95.00th=[ 239], 00:15:31.725 | 99.00th=[ 251], 99.50th=[ 255], 99.90th=[ 281], 99.95th=[ 281], 00:15:31.725 | 99.99th=[ 281] 00:15:31.725 bw ( KiB/s): min= 4096, max= 4096, per=22.43%, avg=4096.00, stdev= 0.00, samples=1 00:15:31.725 iops : min= 1024, max= 1024, avg=1024.00, stdev= 0.00, samples=1 00:15:31.725 lat (usec) : 250=62.32%, 500=36.46%, 750=0.14% 00:15:31.725 lat (msec) : 50=1.08% 00:15:31.725 cpu : usr=1.10%, sys=1.20%, ctx=1388, majf=0, minf=2 00:15:31.725 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:15:31.725 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:15:31.725 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:15:31.725 issued rwts: total=512,876,0,0 short=0,0,0,0 dropped=0,0,0,0 00:15:31.725 latency : target=0, window=0, percentile=100.00%, depth=1 00:15:31.725 job2: (groupid=0, jobs=1): err= 0: pid=277552: Tue Apr 16 22:53:22 2024 00:15:31.725 read: IOPS=1534, BW=6138KiB/s (6285kB/s)(6144KiB/1001msec) 00:15:31.725 slat (nsec): min=6036, max=51642, avg=12234.39, stdev=5853.04 00:15:31.725 clat (usec): min=249, max=636, avg=334.17, stdev=57.58 00:15:31.725 lat (usec): min=258, max=644, avg=346.41, stdev=59.13 00:15:31.725 clat percentiles (usec): 00:15:31.725 | 1.00th=[ 265], 5.00th=[ 281], 10.00th=[ 285], 20.00th=[ 293], 00:15:31.725 | 30.00th=[ 302], 40.00th=[ 310], 50.00th=[ 318], 60.00th=[ 330], 00:15:31.725 | 70.00th=[ 338], 80.00th=[ 359], 90.00th=[ 412], 95.00th=[ 465], 00:15:31.725 | 99.00th=[ 553], 99.50th=[ 594], 99.90th=[ 619], 99.95th=[ 635], 00:15:31.725 | 99.99th=[ 635] 00:15:31.725 write: IOPS=1754, BW=7017KiB/s (7185kB/s)(7024KiB/1001msec); 0 zone resets 00:15:31.725 slat (nsec): min=7569, max=73232, avg=15803.52, stdev=9709.28 00:15:31.725 clat (usec): min=167, max=557, avg=243.25, stdev=82.39 00:15:31.725 lat (usec): min=177, max=594, avg=259.05, stdev=87.98 00:15:31.725 clat percentiles (usec): 00:15:31.725 | 1.00th=[ 172], 5.00th=[ 176], 10.00th=[ 182], 20.00th=[ 188], 00:15:31.725 | 30.00th=[ 194], 40.00th=[ 202], 50.00th=[ 208], 60.00th=[ 219], 00:15:31.725 | 70.00th=[ 247], 80.00th=[ 289], 90.00th=[ 388], 95.00th=[ 433], 00:15:31.725 | 99.00th=[ 523], 99.50th=[ 529], 99.90th=[ 553], 99.95th=[ 553], 00:15:31.725 | 99.99th=[ 553] 00:15:31.725 bw ( KiB/s): min= 8192, max= 8192, per=44.85%, avg=8192.00, stdev= 0.00, samples=1 00:15:31.725 iops : min= 2048, max= 2048, avg=2048.00, stdev= 0.00, samples=1 00:15:31.725 lat (usec) : 250=38.00%, 500=59.84%, 750=2.16% 00:15:31.725 cpu : usr=4.00%, sys=5.70%, ctx=3292, majf=0, minf=1 00:15:31.725 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:15:31.725 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:15:31.725 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:15:31.725 issued rwts: total=1536,1756,0,0 short=0,0,0,0 dropped=0,0,0,0 00:15:31.725 latency : target=0, window=0, percentile=100.00%, depth=1 00:15:31.725 job3: (groupid=0, jobs=1): err= 0: pid=277553: Tue Apr 16 22:53:22 2024 00:15:31.725 read: IOPS=30, BW=121KiB/s (124kB/s)(124KiB/1025msec) 00:15:31.725 slat (nsec): min=6318, max=20666, avg=13562.84, stdev=4311.47 00:15:31.725 clat (usec): min=327, max=41978, avg=27350.98, stdev=19331.62 00:15:31.725 lat (usec): min=336, max=41994, avg=27364.54, stdev=19334.26 00:15:31.725 clat percentiles (usec): 00:15:31.725 | 1.00th=[ 326], 5.00th=[ 355], 10.00th=[ 363], 20.00th=[ 375], 00:15:31.725 | 30.00th=[ 429], 40.00th=[41157], 50.00th=[41157], 60.00th=[41157], 00:15:31.725 | 70.00th=[41157], 80.00th=[41157], 90.00th=[42206], 95.00th=[42206], 00:15:31.725 | 99.00th=[42206], 99.50th=[42206], 99.90th=[42206], 99.95th=[42206], 00:15:31.725 | 99.99th=[42206] 00:15:31.725 write: IOPS=499, BW=1998KiB/s (2046kB/s)(2048KiB/1025msec); 0 zone resets 00:15:31.725 slat (nsec): min=7454, max=68389, avg=22863.65, stdev=11612.92 00:15:31.725 clat (usec): min=191, max=559, avg=316.21, stdev=77.05 00:15:31.725 lat (usec): min=205, max=594, avg=339.07, stdev=76.06 00:15:31.725 clat percentiles (usec): 00:15:31.725 | 1.00th=[ 202], 5.00th=[ 217], 10.00th=[ 233], 20.00th=[ 251], 00:15:31.725 | 30.00th=[ 262], 40.00th=[ 273], 50.00th=[ 297], 60.00th=[ 322], 00:15:31.725 | 70.00th=[ 363], 80.00th=[ 392], 90.00th=[ 420], 95.00th=[ 461], 00:15:31.725 | 99.00th=[ 519], 99.50th=[ 529], 99.90th=[ 562], 99.95th=[ 562], 00:15:31.725 | 99.99th=[ 562] 00:15:31.725 bw ( KiB/s): min= 4096, max= 4096, per=22.43%, avg=4096.00, stdev= 0.00, samples=1 00:15:31.725 iops : min= 1024, max= 1024, avg=1024.00, stdev= 0.00, samples=1 00:15:31.725 lat (usec) : 250=18.23%, 500=76.24%, 750=1.66% 00:15:31.725 lat (msec) : 20=0.18%, 50=3.68% 00:15:31.725 cpu : usr=0.68%, sys=1.56%, ctx=543, majf=0, minf=1 00:15:31.725 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:15:31.725 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:15:31.725 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:15:31.725 issued rwts: total=31,512,0,0 short=0,0,0,0 dropped=0,0,0,0 00:15:31.725 latency : target=0, window=0, percentile=100.00%, depth=1 00:15:31.725 00:15:31.725 Run status group 0 (all jobs): 00:15:31.725 READ: bw=12.3MiB/s (12.9MB/s), 121KiB/s-6138KiB/s (124kB/s-6285kB/s), io=12.6MiB (13.2MB), run=1001-1025msec 00:15:31.725 WRITE: bw=17.8MiB/s (18.7MB/s), 1998KiB/s-7017KiB/s (2046kB/s-7185kB/s), io=18.3MiB (19.2MB), run=1001-1025msec 00:15:31.725 00:15:31.725 Disk stats (read/write): 00:15:31.725 nvme0n1: ios=1184/1536, merge=0/0, ticks=628/346, in_queue=974, util=90.88% 00:15:31.725 nvme0n2: ios=342/512, merge=0/0, ticks=759/104, in_queue=863, util=88.07% 00:15:31.725 nvme0n3: ios=1196/1536, merge=0/0, ticks=400/360, in_queue=760, util=88.98% 00:15:31.725 nvme0n4: ios=26/512, merge=0/0, ticks=644/144, in_queue=788, util=89.64% 00:15:31.725 22:53:22 -- target/fio.sh@51 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/fio-wrapper -p nvmf -i 4096 -d 1 -t randwrite -r 1 -v 00:15:31.725 [global] 00:15:31.725 thread=1 00:15:31.725 invalidate=1 00:15:31.725 rw=randwrite 00:15:31.725 time_based=1 00:15:31.725 runtime=1 00:15:31.725 ioengine=libaio 00:15:31.725 direct=1 00:15:31.725 bs=4096 00:15:31.725 iodepth=1 00:15:31.725 norandommap=0 00:15:31.725 numjobs=1 00:15:31.725 00:15:31.725 verify_dump=1 00:15:31.725 verify_backlog=512 00:15:31.725 verify_state_save=0 00:15:31.725 do_verify=1 00:15:31.725 verify=crc32c-intel 00:15:31.725 [job0] 00:15:31.725 filename=/dev/nvme0n1 00:15:31.725 [job1] 00:15:31.725 filename=/dev/nvme0n2 00:15:31.725 [job2] 00:15:31.725 filename=/dev/nvme0n3 00:15:31.725 [job3] 00:15:31.725 filename=/dev/nvme0n4 00:15:31.984 Could not set queue depth (nvme0n1) 00:15:31.984 Could not set queue depth (nvme0n2) 00:15:31.984 Could not set queue depth (nvme0n3) 00:15:31.984 Could not set queue depth (nvme0n4) 00:15:31.984 job0: (g=0): rw=randwrite, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:15:31.984 job1: (g=0): rw=randwrite, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:15:31.984 job2: (g=0): rw=randwrite, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:15:31.984 job3: (g=0): rw=randwrite, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:15:31.984 fio-3.35 00:15:31.984 Starting 4 threads 00:15:33.359 00:15:33.359 job0: (groupid=0, jobs=1): err= 0: pid=277781: Tue Apr 16 22:53:24 2024 00:15:33.359 read: IOPS=511, BW=2046KiB/s (2095kB/s)(2048KiB/1001msec) 00:15:33.359 slat (nsec): min=6654, max=33682, avg=16601.59, stdev=4078.27 00:15:33.359 clat (usec): min=282, max=41280, avg=1632.81, stdev=7070.30 00:15:33.359 lat (usec): min=291, max=41289, avg=1649.41, stdev=7071.33 00:15:33.359 clat percentiles (usec): 00:15:33.359 | 1.00th=[ 289], 5.00th=[ 306], 10.00th=[ 326], 20.00th=[ 338], 00:15:33.359 | 30.00th=[ 347], 40.00th=[ 355], 50.00th=[ 359], 60.00th=[ 367], 00:15:33.359 | 70.00th=[ 375], 80.00th=[ 388], 90.00th=[ 412], 95.00th=[ 486], 00:15:33.359 | 99.00th=[41157], 99.50th=[41157], 99.90th=[41157], 99.95th=[41157], 00:15:33.359 | 99.99th=[41157] 00:15:33.359 write: IOPS=576, BW=2306KiB/s (2361kB/s)(2308KiB/1001msec); 0 zone resets 00:15:33.359 slat (nsec): min=6455, max=44229, avg=11822.12, stdev=5914.65 00:15:33.359 clat (usec): min=151, max=510, avg=249.55, stdev=52.35 00:15:33.359 lat (usec): min=161, max=530, avg=261.37, stdev=54.04 00:15:33.359 clat percentiles (usec): 00:15:33.359 | 1.00th=[ 159], 5.00th=[ 182], 10.00th=[ 194], 20.00th=[ 210], 00:15:33.359 | 30.00th=[ 225], 40.00th=[ 233], 50.00th=[ 241], 60.00th=[ 247], 00:15:33.359 | 70.00th=[ 255], 80.00th=[ 281], 90.00th=[ 318], 95.00th=[ 363], 00:15:33.359 | 99.00th=[ 424], 99.50th=[ 453], 99.90th=[ 510], 99.95th=[ 510], 00:15:33.359 | 99.99th=[ 510] 00:15:33.359 bw ( KiB/s): min= 4087, max= 4087, per=39.74%, avg=4087.00, stdev= 0.00, samples=1 00:15:33.359 iops : min= 1021, max= 1021, avg=1021.00, stdev= 0.00, samples=1 00:15:33.359 lat (usec) : 250=34.07%, 500=63.82%, 750=0.55%, 1000=0.09% 00:15:33.359 lat (msec) : 50=1.47% 00:15:33.359 cpu : usr=0.80%, sys=2.20%, ctx=1089, majf=0, minf=1 00:15:33.359 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:15:33.359 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:15:33.359 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:15:33.359 issued rwts: total=512,577,0,0 short=0,0,0,0 dropped=0,0,0,0 00:15:33.359 latency : target=0, window=0, percentile=100.00%, depth=1 00:15:33.359 job1: (groupid=0, jobs=1): err= 0: pid=277782: Tue Apr 16 22:53:24 2024 00:15:33.359 read: IOPS=35, BW=142KiB/s (146kB/s)(144KiB/1013msec) 00:15:33.359 slat (nsec): min=6997, max=37127, avg=22351.75, stdev=11161.94 00:15:33.359 clat (usec): min=283, max=41479, avg=24548.67, stdev=19948.21 00:15:33.359 lat (usec): min=293, max=41511, avg=24571.02, stdev=19949.16 00:15:33.359 clat percentiles (usec): 00:15:33.359 | 1.00th=[ 285], 5.00th=[ 289], 10.00th=[ 302], 20.00th=[ 383], 00:15:33.359 | 30.00th=[ 408], 40.00th=[17695], 50.00th=[40633], 60.00th=[41157], 00:15:33.359 | 70.00th=[41157], 80.00th=[41157], 90.00th=[41157], 95.00th=[41681], 00:15:33.359 | 99.00th=[41681], 99.50th=[41681], 99.90th=[41681], 99.95th=[41681], 00:15:33.359 | 99.99th=[41681] 00:15:33.359 write: IOPS=505, BW=2022KiB/s (2070kB/s)(2048KiB/1013msec); 0 zone resets 00:15:33.359 slat (nsec): min=6188, max=37947, avg=10300.39, stdev=5006.05 00:15:33.359 clat (usec): min=172, max=486, avg=237.09, stdev=35.02 00:15:33.359 lat (usec): min=186, max=515, avg=247.39, stdev=35.37 00:15:33.359 clat percentiles (usec): 00:15:33.359 | 1.00th=[ 184], 5.00th=[ 194], 10.00th=[ 202], 20.00th=[ 215], 00:15:33.359 | 30.00th=[ 223], 40.00th=[ 229], 50.00th=[ 235], 60.00th=[ 241], 00:15:33.359 | 70.00th=[ 245], 80.00th=[ 251], 90.00th=[ 262], 95.00th=[ 289], 00:15:33.359 | 99.00th=[ 400], 99.50th=[ 420], 99.90th=[ 486], 99.95th=[ 486], 00:15:33.359 | 99.99th=[ 486] 00:15:33.359 bw ( KiB/s): min= 4087, max= 4087, per=39.74%, avg=4087.00, stdev= 0.00, samples=1 00:15:33.359 iops : min= 1021, max= 1021, avg=1021.00, stdev= 0.00, samples=1 00:15:33.359 lat (usec) : 250=73.91%, 500=22.08% 00:15:33.359 lat (msec) : 20=0.18%, 50=3.83% 00:15:33.359 cpu : usr=0.49%, sys=0.49%, ctx=548, majf=0, minf=2 00:15:33.359 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:15:33.359 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:15:33.359 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:15:33.359 issued rwts: total=36,512,0,0 short=0,0,0,0 dropped=0,0,0,0 00:15:33.359 latency : target=0, window=0, percentile=100.00%, depth=1 00:15:33.359 job2: (groupid=0, jobs=1): err= 0: pid=277783: Tue Apr 16 22:53:24 2024 00:15:33.359 read: IOPS=29, BW=119KiB/s (122kB/s)(120KiB/1005msec) 00:15:33.359 slat (nsec): min=7174, max=37428, avg=27617.90, stdev=9328.93 00:15:33.359 clat (usec): min=397, max=41438, avg=28886.36, stdev=18901.89 00:15:33.359 lat (usec): min=434, max=41471, avg=28913.97, stdev=18897.30 00:15:33.359 clat percentiles (usec): 00:15:33.359 | 1.00th=[ 400], 5.00th=[ 465], 10.00th=[ 469], 20.00th=[ 510], 00:15:33.359 | 30.00th=[ 553], 40.00th=[40633], 50.00th=[41157], 60.00th=[41157], 00:15:33.359 | 70.00th=[41157], 80.00th=[41157], 90.00th=[41157], 95.00th=[41681], 00:15:33.359 | 99.00th=[41681], 99.50th=[41681], 99.90th=[41681], 99.95th=[41681], 00:15:33.359 | 99.99th=[41681] 00:15:33.359 write: IOPS=509, BW=2038KiB/s (2087kB/s)(2048KiB/1005msec); 0 zone resets 00:15:33.359 slat (nsec): min=7524, max=40203, avg=12258.00, stdev=5542.54 00:15:33.359 clat (usec): min=182, max=521, avg=252.29, stdev=46.99 00:15:33.359 lat (usec): min=193, max=532, avg=264.55, stdev=47.81 00:15:33.359 clat percentiles (usec): 00:15:33.359 | 1.00th=[ 190], 5.00th=[ 208], 10.00th=[ 215], 20.00th=[ 225], 00:15:33.359 | 30.00th=[ 231], 40.00th=[ 237], 50.00th=[ 241], 60.00th=[ 247], 00:15:33.359 | 70.00th=[ 255], 80.00th=[ 265], 90.00th=[ 302], 95.00th=[ 355], 00:15:33.359 | 99.00th=[ 437], 99.50th=[ 474], 99.90th=[ 523], 99.95th=[ 523], 00:15:33.359 | 99.99th=[ 523] 00:15:33.359 bw ( KiB/s): min= 4087, max= 4087, per=39.74%, avg=4087.00, stdev= 0.00, samples=1 00:15:33.359 iops : min= 1021, max= 1021, avg=1021.00, stdev= 0.00, samples=1 00:15:33.359 lat (usec) : 250=61.62%, 500=33.21%, 750=1.29% 00:15:33.359 lat (msec) : 50=3.87% 00:15:33.359 cpu : usr=0.40%, sys=1.00%, ctx=544, majf=0, minf=1 00:15:33.359 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:15:33.359 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:15:33.359 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:15:33.359 issued rwts: total=30,512,0,0 short=0,0,0,0 dropped=0,0,0,0 00:15:33.359 latency : target=0, window=0, percentile=100.00%, depth=1 00:15:33.359 job3: (groupid=0, jobs=1): err= 0: pid=277784: Tue Apr 16 22:53:24 2024 00:15:33.359 read: IOPS=522, BW=2088KiB/s (2138kB/s)(2132KiB/1021msec) 00:15:33.359 slat (nsec): min=7716, max=35948, avg=18465.93, stdev=5448.93 00:15:33.359 clat (usec): min=259, max=41450, avg=1438.23, stdev=6506.92 00:15:33.359 lat (usec): min=268, max=41484, avg=1456.70, stdev=6507.41 00:15:33.359 clat percentiles (usec): 00:15:33.359 | 1.00th=[ 269], 5.00th=[ 302], 10.00th=[ 314], 20.00th=[ 334], 00:15:33.359 | 30.00th=[ 343], 40.00th=[ 351], 50.00th=[ 355], 60.00th=[ 363], 00:15:33.359 | 70.00th=[ 371], 80.00th=[ 383], 90.00th=[ 498], 95.00th=[ 619], 00:15:33.359 | 99.00th=[41157], 99.50th=[41157], 99.90th=[41681], 99.95th=[41681], 00:15:33.359 | 99.99th=[41681] 00:15:33.359 write: IOPS=1002, BW=4012KiB/s (4108kB/s)(4096KiB/1021msec); 0 zone resets 00:15:33.359 slat (nsec): min=8159, max=48063, avg=12830.82, stdev=5624.86 00:15:33.359 clat (usec): min=167, max=398, avg=219.08, stdev=33.62 00:15:33.359 lat (usec): min=177, max=419, avg=231.91, stdev=34.61 00:15:33.359 clat percentiles (usec): 00:15:33.359 | 1.00th=[ 174], 5.00th=[ 180], 10.00th=[ 182], 20.00th=[ 188], 00:15:33.359 | 30.00th=[ 200], 40.00th=[ 208], 50.00th=[ 215], 60.00th=[ 225], 00:15:33.359 | 70.00th=[ 231], 80.00th=[ 241], 90.00th=[ 260], 95.00th=[ 277], 00:15:33.359 | 99.00th=[ 338], 99.50th=[ 375], 99.90th=[ 396], 99.95th=[ 400], 00:15:33.359 | 99.99th=[ 400] 00:15:33.359 bw ( KiB/s): min= 8175, max= 8175, per=79.49%, avg=8175.00, stdev= 0.00, samples=1 00:15:33.359 iops : min= 2043, max= 2043, avg=2043.00, stdev= 0.00, samples=1 00:15:33.359 lat (usec) : 250=56.65%, 500=40.14%, 750=2.31% 00:15:33.359 lat (msec) : 50=0.90% 00:15:33.359 cpu : usr=1.96%, sys=2.75%, ctx=1557, majf=0, minf=1 00:15:33.359 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:15:33.359 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:15:33.359 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:15:33.359 issued rwts: total=533,1024,0,0 short=0,0,0,0 dropped=0,0,0,0 00:15:33.359 latency : target=0, window=0, percentile=100.00%, depth=1 00:15:33.359 00:15:33.359 Run status group 0 (all jobs): 00:15:33.359 READ: bw=4353KiB/s (4457kB/s), 119KiB/s-2088KiB/s (122kB/s-2138kB/s), io=4444KiB (4551kB), run=1001-1021msec 00:15:33.359 WRITE: bw=10.0MiB/s (10.5MB/s), 2022KiB/s-4012KiB/s (2070kB/s-4108kB/s), io=10.3MiB (10.8MB), run=1001-1021msec 00:15:33.359 00:15:33.359 Disk stats (read/write): 00:15:33.359 nvme0n1: ios=551/512, merge=0/0, ticks=731/129, in_queue=860, util=87.98% 00:15:33.359 nvme0n2: ios=44/512, merge=0/0, ticks=693/120, in_queue=813, util=86.67% 00:15:33.359 nvme0n3: ios=26/512, merge=0/0, ticks=704/125, in_queue=829, util=89.01% 00:15:33.359 nvme0n4: ios=528/1024, merge=0/0, ticks=559/217, in_queue=776, util=89.66% 00:15:33.359 22:53:24 -- target/fio.sh@52 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/fio-wrapper -p nvmf -i 4096 -d 128 -t write -r 1 -v 00:15:33.359 [global] 00:15:33.359 thread=1 00:15:33.359 invalidate=1 00:15:33.359 rw=write 00:15:33.359 time_based=1 00:15:33.359 runtime=1 00:15:33.359 ioengine=libaio 00:15:33.359 direct=1 00:15:33.359 bs=4096 00:15:33.359 iodepth=128 00:15:33.359 norandommap=0 00:15:33.359 numjobs=1 00:15:33.359 00:15:33.359 verify_dump=1 00:15:33.359 verify_backlog=512 00:15:33.359 verify_state_save=0 00:15:33.359 do_verify=1 00:15:33.359 verify=crc32c-intel 00:15:33.359 [job0] 00:15:33.359 filename=/dev/nvme0n1 00:15:33.359 [job1] 00:15:33.359 filename=/dev/nvme0n2 00:15:33.359 [job2] 00:15:33.359 filename=/dev/nvme0n3 00:15:33.359 [job3] 00:15:33.359 filename=/dev/nvme0n4 00:15:33.359 Could not set queue depth (nvme0n1) 00:15:33.359 Could not set queue depth (nvme0n2) 00:15:33.359 Could not set queue depth (nvme0n3) 00:15:33.359 Could not set queue depth (nvme0n4) 00:15:33.359 job0: (g=0): rw=write, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=128 00:15:33.359 job1: (g=0): rw=write, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=128 00:15:33.359 job2: (g=0): rw=write, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=128 00:15:33.359 job3: (g=0): rw=write, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=128 00:15:33.359 fio-3.35 00:15:33.359 Starting 4 threads 00:15:34.738 00:15:34.738 job0: (groupid=0, jobs=1): err= 0: pid=278141: Tue Apr 16 22:53:25 2024 00:15:34.738 read: IOPS=3645, BW=14.2MiB/s (14.9MB/s)(14.4MiB/1014msec) 00:15:34.738 slat (usec): min=3, max=18478, avg=119.49, stdev=847.83 00:15:34.738 clat (usec): min=4311, max=39004, avg=15127.25, stdev=6004.19 00:15:34.738 lat (usec): min=4322, max=44664, avg=15246.74, stdev=6059.64 00:15:34.738 clat percentiles (usec): 00:15:34.738 | 1.00th=[ 5145], 5.00th=[ 8979], 10.00th=[ 9503], 20.00th=[10814], 00:15:34.738 | 30.00th=[11994], 40.00th=[12649], 50.00th=[13304], 60.00th=[14353], 00:15:34.738 | 70.00th=[15926], 80.00th=[18482], 90.00th=[21627], 95.00th=[29754], 00:15:34.738 | 99.00th=[35914], 99.50th=[39060], 99.90th=[39060], 99.95th=[39060], 00:15:34.738 | 99.99th=[39060] 00:15:34.738 write: IOPS=4039, BW=15.8MiB/s (16.5MB/s)(16.0MiB/1014msec); 0 zone resets 00:15:34.738 slat (usec): min=3, max=19799, avg=128.66, stdev=856.41 00:15:34.738 clat (msec): min=5, max=109, avg=17.05, stdev=14.25 00:15:34.738 lat (msec): min=5, max=109, avg=17.17, stdev=14.33 00:15:34.738 clat percentiles (msec): 00:15:34.738 | 1.00th=[ 7], 5.00th=[ 9], 10.00th=[ 9], 20.00th=[ 11], 00:15:34.738 | 30.00th=[ 12], 40.00th=[ 13], 50.00th=[ 13], 60.00th=[ 14], 00:15:34.738 | 70.00th=[ 16], 80.00th=[ 20], 90.00th=[ 26], 95.00th=[ 32], 00:15:34.738 | 99.00th=[ 94], 99.50th=[ 100], 99.90th=[ 108], 99.95th=[ 109], 00:15:34.738 | 99.99th=[ 109] 00:15:34.738 bw ( KiB/s): min=12168, max=20480, per=25.26%, avg=16324.00, stdev=5877.47, samples=2 00:15:34.738 iops : min= 3042, max= 5120, avg=4081.00, stdev=1469.37, samples=2 00:15:34.738 lat (msec) : 10=14.54%, 20=67.30%, 50=16.13%, 100=1.78%, 250=0.24% 00:15:34.738 cpu : usr=5.73%, sys=6.91%, ctx=376, majf=0, minf=17 00:15:34.738 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.2%, 32=0.4%, >=64=99.2% 00:15:34.738 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:15:34.738 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:15:34.738 issued rwts: total=3697,4096,0,0 short=0,0,0,0 dropped=0,0,0,0 00:15:34.738 latency : target=0, window=0, percentile=100.00%, depth=128 00:15:34.738 job1: (groupid=0, jobs=1): err= 0: pid=278143: Tue Apr 16 22:53:25 2024 00:15:34.738 read: IOPS=4001, BW=15.6MiB/s (16.4MB/s)(15.8MiB/1012msec) 00:15:34.738 slat (usec): min=2, max=58311, avg=129.42, stdev=1290.94 00:15:34.738 clat (usec): min=6261, max=93332, avg=18484.34, stdev=16434.22 00:15:34.738 lat (usec): min=7036, max=93349, avg=18613.76, stdev=16529.26 00:15:34.738 clat percentiles (usec): 00:15:34.738 | 1.00th=[ 7767], 5.00th=[ 8455], 10.00th=[ 9372], 20.00th=[10552], 00:15:34.738 | 30.00th=[10814], 40.00th=[11338], 50.00th=[11863], 60.00th=[13435], 00:15:34.738 | 70.00th=[16057], 80.00th=[20579], 90.00th=[30278], 95.00th=[65274], 00:15:34.738 | 99.00th=[86508], 99.50th=[92799], 99.90th=[92799], 99.95th=[93848], 00:15:34.738 | 99.99th=[93848] 00:15:34.738 write: IOPS=4047, BW=15.8MiB/s (16.6MB/s)(16.0MiB/1012msec); 0 zone resets 00:15:34.738 slat (usec): min=3, max=23477, avg=103.90, stdev=762.94 00:15:34.738 clat (usec): min=4641, max=32368, avg=13012.77, stdev=3872.90 00:15:34.738 lat (usec): min=4648, max=32730, avg=13116.67, stdev=3920.45 00:15:34.738 clat percentiles (usec): 00:15:34.738 | 1.00th=[ 7963], 5.00th=[ 8848], 10.00th=[ 9634], 20.00th=[10683], 00:15:34.738 | 30.00th=[11207], 40.00th=[11338], 50.00th=[11600], 60.00th=[12387], 00:15:34.738 | 70.00th=[13435], 80.00th=[14615], 90.00th=[18744], 95.00th=[22414], 00:15:34.738 | 99.00th=[26870], 99.50th=[26870], 99.90th=[26870], 99.95th=[26870], 00:15:34.738 | 99.99th=[32375] 00:15:34.738 bw ( KiB/s): min=16384, max=16384, per=25.35%, avg=16384.00, stdev= 0.00, samples=2 00:15:34.738 iops : min= 4096, max= 4096, avg=4096.00, stdev= 0.00, samples=2 00:15:34.738 lat (msec) : 10=12.42%, 20=73.66%, 50=10.29%, 100=3.63% 00:15:34.738 cpu : usr=3.07%, sys=5.24%, ctx=326, majf=0, minf=9 00:15:34.738 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.2%, 32=0.4%, >=64=99.2% 00:15:34.738 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:15:34.738 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:15:34.738 issued rwts: total=4050,4096,0,0 short=0,0,0,0 dropped=0,0,0,0 00:15:34.738 latency : target=0, window=0, percentile=100.00%, depth=128 00:15:34.738 job2: (groupid=0, jobs=1): err= 0: pid=278144: Tue Apr 16 22:53:25 2024 00:15:34.738 read: IOPS=3154, BW=12.3MiB/s (12.9MB/s)(12.5MiB/1014msec) 00:15:34.738 slat (usec): min=2, max=27608, avg=164.18, stdev=1168.70 00:15:34.738 clat (msec): min=3, max=122, avg=19.40, stdev=14.53 00:15:34.738 lat (msec): min=4, max=122, avg=19.56, stdev=14.65 00:15:34.738 clat percentiles (msec): 00:15:34.738 | 1.00th=[ 9], 5.00th=[ 11], 10.00th=[ 13], 20.00th=[ 13], 00:15:34.738 | 30.00th=[ 14], 40.00th=[ 15], 50.00th=[ 17], 60.00th=[ 18], 00:15:34.738 | 70.00th=[ 19], 80.00th=[ 22], 90.00th=[ 28], 95.00th=[ 33], 00:15:34.738 | 99.00th=[ 104], 99.50th=[ 111], 99.90th=[ 123], 99.95th=[ 123], 00:15:34.738 | 99.99th=[ 123] 00:15:34.738 write: IOPS=3534, BW=13.8MiB/s (14.5MB/s)(14.0MiB/1014msec); 0 zone resets 00:15:34.738 slat (usec): min=3, max=16529, avg=125.84, stdev=770.04 00:15:34.738 clat (usec): min=1232, max=122342, avg=18454.84, stdev=11675.42 00:15:34.738 lat (usec): min=1302, max=122362, avg=18580.68, stdev=11709.06 00:15:34.738 clat percentiles (msec): 00:15:34.738 | 1.00th=[ 5], 5.00th=[ 7], 10.00th=[ 9], 20.00th=[ 12], 00:15:34.738 | 30.00th=[ 13], 40.00th=[ 14], 50.00th=[ 16], 60.00th=[ 18], 00:15:34.738 | 70.00th=[ 20], 80.00th=[ 25], 90.00th=[ 29], 95.00th=[ 40], 00:15:34.738 | 99.00th=[ 71], 99.50th=[ 89], 99.90th=[ 96], 99.95th=[ 123], 00:15:34.738 | 99.99th=[ 123] 00:15:34.738 bw ( KiB/s): min=12280, max=16384, per=22.18%, avg=14332.00, stdev=2901.97, samples=2 00:15:34.738 iops : min= 3070, max= 4096, avg=3583.00, stdev=725.49, samples=2 00:15:34.738 lat (msec) : 2=0.06%, 4=0.22%, 10=8.18%, 20=63.84%, 50=25.00% 00:15:34.738 lat (msec) : 100=2.12%, 250=0.57% 00:15:34.738 cpu : usr=4.24%, sys=6.61%, ctx=317, majf=0, minf=7 00:15:34.738 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.2%, 32=0.5%, >=64=99.1% 00:15:34.738 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:15:34.738 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:15:34.738 issued rwts: total=3199,3584,0,0 short=0,0,0,0 dropped=0,0,0,0 00:15:34.738 latency : target=0, window=0, percentile=100.00%, depth=128 00:15:34.738 job3: (groupid=0, jobs=1): err= 0: pid=278145: Tue Apr 16 22:53:25 2024 00:15:34.738 read: IOPS=4328, BW=16.9MiB/s (17.7MB/s)(17.0MiB/1003msec) 00:15:34.738 slat (usec): min=2, max=46702, avg=121.02, stdev=1005.93 00:15:34.738 clat (usec): min=399, max=65438, avg=14582.76, stdev=10146.58 00:15:34.738 lat (usec): min=3075, max=65459, avg=14703.78, stdev=10202.90 00:15:34.738 clat percentiles (usec): 00:15:34.738 | 1.00th=[ 6390], 5.00th=[ 9110], 10.00th=[ 9503], 20.00th=[10683], 00:15:34.738 | 30.00th=[11338], 40.00th=[11731], 50.00th=[11994], 60.00th=[12649], 00:15:34.738 | 70.00th=[13698], 80.00th=[14877], 90.00th=[16188], 95.00th=[26608], 00:15:34.738 | 99.00th=[64750], 99.50th=[65274], 99.90th=[65274], 99.95th=[65274], 00:15:34.738 | 99.99th=[65274] 00:15:34.738 write: IOPS=4594, BW=17.9MiB/s (18.8MB/s)(18.0MiB/1003msec); 0 zone resets 00:15:34.738 slat (usec): min=3, max=10244, avg=95.75, stdev=502.70 00:15:34.738 clat (usec): min=6151, max=63984, avg=13650.79, stdev=7313.63 00:15:34.738 lat (usec): min=6164, max=63993, avg=13746.54, stdev=7320.37 00:15:34.738 clat percentiles (usec): 00:15:34.738 | 1.00th=[ 6915], 5.00th=[ 8717], 10.00th=[ 9241], 20.00th=[10028], 00:15:34.738 | 30.00th=[10683], 40.00th=[11731], 50.00th=[12387], 60.00th=[12911], 00:15:34.738 | 70.00th=[14222], 80.00th=[15795], 90.00th=[16712], 95.00th=[19268], 00:15:34.738 | 99.00th=[62129], 99.50th=[63177], 99.90th=[63701], 99.95th=[63701], 00:15:34.738 | 99.99th=[64226] 00:15:34.738 bw ( KiB/s): min=13488, max=23376, per=28.52%, avg=18432.00, stdev=6991.87, samples=2 00:15:34.738 iops : min= 3372, max= 5844, avg=4608.00, stdev=1747.97, samples=2 00:15:34.738 lat (usec) : 500=0.01% 00:15:34.738 lat (msec) : 4=0.36%, 10=16.59%, 20=76.95%, 50=3.59%, 100=2.50% 00:15:34.738 cpu : usr=4.59%, sys=6.59%, ctx=472, majf=0, minf=17 00:15:34.738 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.2%, 32=0.4%, >=64=99.3% 00:15:34.738 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:15:34.738 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:15:34.738 issued rwts: total=4341,4608,0,0 short=0,0,0,0 dropped=0,0,0,0 00:15:34.738 latency : target=0, window=0, percentile=100.00%, depth=128 00:15:34.738 00:15:34.738 Run status group 0 (all jobs): 00:15:34.739 READ: bw=58.9MiB/s (61.8MB/s), 12.3MiB/s-16.9MiB/s (12.9MB/s-17.7MB/s), io=59.7MiB (62.6MB), run=1003-1014msec 00:15:34.739 WRITE: bw=63.1MiB/s (66.2MB/s), 13.8MiB/s-17.9MiB/s (14.5MB/s-18.8MB/s), io=64.0MiB (67.1MB), run=1003-1014msec 00:15:34.739 00:15:34.739 Disk stats (read/write): 00:15:34.739 nvme0n1: ios=3113/3584, merge=0/0, ticks=20459/38665, in_queue=59124, util=97.60% 00:15:34.739 nvme0n2: ios=3597/3595, merge=0/0, ticks=24327/15206, in_queue=39533, util=85.98% 00:15:34.739 nvme0n3: ios=2685/3072, merge=0/0, ticks=44369/40344, in_queue=84713, util=88.61% 00:15:34.739 nvme0n4: ios=3603/3584, merge=0/0, ticks=16873/13019, in_queue=29892, util=95.15% 00:15:34.739 22:53:25 -- target/fio.sh@53 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/fio-wrapper -p nvmf -i 4096 -d 128 -t randwrite -r 1 -v 00:15:34.739 [global] 00:15:34.739 thread=1 00:15:34.739 invalidate=1 00:15:34.739 rw=randwrite 00:15:34.739 time_based=1 00:15:34.739 runtime=1 00:15:34.739 ioengine=libaio 00:15:34.739 direct=1 00:15:34.739 bs=4096 00:15:34.739 iodepth=128 00:15:34.739 norandommap=0 00:15:34.739 numjobs=1 00:15:34.739 00:15:34.739 verify_dump=1 00:15:34.739 verify_backlog=512 00:15:34.739 verify_state_save=0 00:15:34.739 do_verify=1 00:15:34.739 verify=crc32c-intel 00:15:34.739 [job0] 00:15:34.739 filename=/dev/nvme0n1 00:15:34.739 [job1] 00:15:34.739 filename=/dev/nvme0n2 00:15:34.739 [job2] 00:15:34.739 filename=/dev/nvme0n3 00:15:34.739 [job3] 00:15:34.739 filename=/dev/nvme0n4 00:15:34.739 Could not set queue depth (nvme0n1) 00:15:34.739 Could not set queue depth (nvme0n2) 00:15:34.739 Could not set queue depth (nvme0n3) 00:15:34.739 Could not set queue depth (nvme0n4) 00:15:34.997 job0: (g=0): rw=randwrite, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=128 00:15:34.997 job1: (g=0): rw=randwrite, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=128 00:15:34.997 job2: (g=0): rw=randwrite, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=128 00:15:34.997 job3: (g=0): rw=randwrite, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=128 00:15:34.997 fio-3.35 00:15:34.997 Starting 4 threads 00:15:36.399 00:15:36.399 job0: (groupid=0, jobs=1): err= 0: pid=278374: Tue Apr 16 22:53:27 2024 00:15:36.399 read: IOPS=4087, BW=16.0MiB/s (16.7MB/s)(16.0MiB/1002msec) 00:15:36.399 slat (usec): min=2, max=12744, avg=117.84, stdev=577.71 00:15:36.399 clat (usec): min=7369, max=36370, avg=15618.79, stdev=5415.06 00:15:36.399 lat (usec): min=7852, max=36383, avg=15736.63, stdev=5429.69 00:15:36.399 clat percentiles (usec): 00:15:36.399 | 1.00th=[ 8717], 5.00th=[ 9765], 10.00th=[10290], 20.00th=[11338], 00:15:36.399 | 30.00th=[12256], 40.00th=[13042], 50.00th=[13960], 60.00th=[15008], 00:15:36.399 | 70.00th=[17171], 80.00th=[19268], 90.00th=[22676], 95.00th=[27919], 00:15:36.399 | 99.00th=[33817], 99.50th=[34341], 99.90th=[36439], 99.95th=[36439], 00:15:36.399 | 99.99th=[36439] 00:15:36.399 write: IOPS=4400, BW=17.2MiB/s (18.0MB/s)(17.2MiB/1002msec); 0 zone resets 00:15:36.399 slat (usec): min=3, max=8523, avg=108.74, stdev=558.83 00:15:36.399 clat (usec): min=264, max=30753, avg=14229.27, stdev=4475.37 00:15:36.399 lat (usec): min=2771, max=30774, avg=14338.01, stdev=4481.25 00:15:36.399 clat percentiles (usec): 00:15:36.399 | 1.00th=[ 5932], 5.00th=[ 9372], 10.00th=[10028], 20.00th=[10683], 00:15:36.399 | 30.00th=[11731], 40.00th=[12125], 50.00th=[13304], 60.00th=[14353], 00:15:36.399 | 70.00th=[15401], 80.00th=[16712], 90.00th=[21365], 95.00th=[23462], 00:15:36.399 | 99.00th=[27657], 99.50th=[29754], 99.90th=[30802], 99.95th=[30802], 00:15:36.399 | 99.99th=[30802] 00:15:36.399 bw ( KiB/s): min=14208, max=20040, per=27.03%, avg=17124.00, stdev=4123.85, samples=2 00:15:36.399 iops : min= 3552, max= 5010, avg=4281.00, stdev=1030.96, samples=2 00:15:36.399 lat (usec) : 500=0.01% 00:15:36.399 lat (msec) : 4=0.38%, 10=7.83%, 20=76.60%, 50=15.18% 00:15:36.399 cpu : usr=4.10%, sys=7.79%, ctx=437, majf=0, minf=1 00:15:36.399 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.2%, 32=0.4%, >=64=99.3% 00:15:36.399 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:15:36.399 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:15:36.399 issued rwts: total=4096,4409,0,0 short=0,0,0,0 dropped=0,0,0,0 00:15:36.399 latency : target=0, window=0, percentile=100.00%, depth=128 00:15:36.399 job1: (groupid=0, jobs=1): err= 0: pid=278375: Tue Apr 16 22:53:27 2024 00:15:36.399 read: IOPS=4598, BW=18.0MiB/s (18.8MB/s)(18.0MiB/1002msec) 00:15:36.399 slat (usec): min=3, max=10670, avg=104.54, stdev=553.08 00:15:36.399 clat (usec): min=7552, max=39824, avg=14122.64, stdev=5672.68 00:15:36.399 lat (usec): min=7568, max=39858, avg=14227.17, stdev=5722.34 00:15:36.399 clat percentiles (usec): 00:15:36.399 | 1.00th=[ 8291], 5.00th=[ 9634], 10.00th=[ 9896], 20.00th=[10159], 00:15:36.399 | 30.00th=[10552], 40.00th=[10945], 50.00th=[11469], 60.00th=[11994], 00:15:36.399 | 70.00th=[15533], 80.00th=[17171], 90.00th=[24249], 95.00th=[27919], 00:15:36.399 | 99.00th=[30540], 99.50th=[32113], 99.90th=[34866], 99.95th=[35390], 00:15:36.399 | 99.99th=[39584] 00:15:36.399 write: IOPS=4758, BW=18.6MiB/s (19.5MB/s)(18.6MiB/1002msec); 0 zone resets 00:15:36.399 slat (usec): min=4, max=11356, avg=96.01, stdev=469.64 00:15:36.399 clat (usec): min=565, max=32458, avg=12846.67, stdev=4443.60 00:15:36.399 lat (usec): min=4424, max=32498, avg=12942.67, stdev=4466.07 00:15:36.399 clat percentiles (usec): 00:15:36.399 | 1.00th=[ 7242], 5.00th=[ 8848], 10.00th=[ 9765], 20.00th=[10290], 00:15:36.399 | 30.00th=[10552], 40.00th=[10814], 50.00th=[11338], 60.00th=[12125], 00:15:36.399 | 70.00th=[12649], 80.00th=[14222], 90.00th=[17695], 95.00th=[24249], 00:15:36.399 | 99.00th=[29492], 99.50th=[31327], 99.90th=[32375], 99.95th=[32375], 00:15:36.399 | 99.99th=[32375] 00:15:36.399 bw ( KiB/s): min=16256, max=20872, per=29.30%, avg=18564.00, stdev=3264.00, samples=2 00:15:36.399 iops : min= 4064, max= 5218, avg=4641.00, stdev=816.00, samples=2 00:15:36.399 lat (usec) : 750=0.01% 00:15:36.399 lat (msec) : 10=13.43%, 20=76.34%, 50=10.22% 00:15:36.399 cpu : usr=7.99%, sys=11.69%, ctx=494, majf=0, minf=1 00:15:36.399 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.2%, 32=0.3%, >=64=99.3% 00:15:36.399 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:15:36.399 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:15:36.399 issued rwts: total=4608,4768,0,0 short=0,0,0,0 dropped=0,0,0,0 00:15:36.399 latency : target=0, window=0, percentile=100.00%, depth=128 00:15:36.399 job2: (groupid=0, jobs=1): err= 0: pid=278378: Tue Apr 16 22:53:27 2024 00:15:36.399 read: IOPS=2457, BW=9830KiB/s (10.1MB/s)(10.2MiB/1060msec) 00:15:36.399 slat (usec): min=2, max=48408, avg=204.58, stdev=1976.18 00:15:36.399 clat (msec): min=4, max=104, avg=26.20, stdev=23.81 00:15:36.399 lat (msec): min=4, max=104, avg=26.40, stdev=24.03 00:15:36.399 clat percentiles (msec): 00:15:36.399 | 1.00th=[ 9], 5.00th=[ 10], 10.00th=[ 11], 20.00th=[ 12], 00:15:36.399 | 30.00th=[ 12], 40.00th=[ 13], 50.00th=[ 14], 60.00th=[ 16], 00:15:36.399 | 70.00th=[ 24], 80.00th=[ 58], 90.00th=[ 68], 95.00th=[ 81], 00:15:36.399 | 99.00th=[ 91], 99.50th=[ 91], 99.90th=[ 99], 99.95th=[ 105], 00:15:36.399 | 99.99th=[ 105] 00:15:36.399 write: IOPS=2898, BW=11.3MiB/s (11.9MB/s)(12.0MiB/1060msec); 0 zone resets 00:15:36.399 slat (usec): min=3, max=20080, avg=148.97, stdev=1204.98 00:15:36.399 clat (msec): min=3, max=111, avg=21.42, stdev=18.41 00:15:36.399 lat (msec): min=3, max=111, avg=21.57, stdev=18.48 00:15:36.399 clat percentiles (msec): 00:15:36.399 | 1.00th=[ 4], 5.00th=[ 7], 10.00th=[ 9], 20.00th=[ 11], 00:15:36.399 | 30.00th=[ 12], 40.00th=[ 14], 50.00th=[ 16], 60.00th=[ 17], 00:15:36.399 | 70.00th=[ 22], 80.00th=[ 32], 90.00th=[ 41], 95.00th=[ 52], 00:15:36.399 | 99.00th=[ 106], 99.50th=[ 112], 99.90th=[ 112], 99.95th=[ 112], 00:15:36.399 | 99.99th=[ 112] 00:15:36.399 bw ( KiB/s): min= 5456, max=18456, per=18.87%, avg=11956.00, stdev=9192.39, samples=2 00:15:36.399 iops : min= 1364, max= 4614, avg=2989.00, stdev=2298.10, samples=2 00:15:36.399 lat (msec) : 4=0.58%, 10=10.96%, 20=56.51%, 50=19.39%, 100=11.08% 00:15:36.399 lat (msec) : 250=1.48% 00:15:36.399 cpu : usr=2.55%, sys=3.78%, ctx=161, majf=0, minf=1 00:15:36.399 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.3%, 32=0.6%, >=64=98.9% 00:15:36.399 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:15:36.399 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:15:36.400 issued rwts: total=2605,3072,0,0 short=0,0,0,0 dropped=0,0,0,0 00:15:36.400 latency : target=0, window=0, percentile=100.00%, depth=128 00:15:36.400 job3: (groupid=0, jobs=1): err= 0: pid=278379: Tue Apr 16 22:53:27 2024 00:15:36.400 read: IOPS=4059, BW=15.9MiB/s (16.6MB/s)(16.0MiB/1009msec) 00:15:36.400 slat (usec): min=2, max=13409, avg=114.39, stdev=892.05 00:15:36.400 clat (usec): min=4875, max=54245, avg=16443.27, stdev=6766.44 00:15:36.400 lat (usec): min=4881, max=54279, avg=16557.67, stdev=6814.60 00:15:36.400 clat percentiles (usec): 00:15:36.400 | 1.00th=[ 5276], 5.00th=[ 9634], 10.00th=[10945], 20.00th=[11994], 00:15:36.400 | 30.00th=[12518], 40.00th=[13829], 50.00th=[14091], 60.00th=[15401], 00:15:36.400 | 70.00th=[17695], 80.00th=[20055], 90.00th=[23462], 95.00th=[32900], 00:15:36.400 | 99.00th=[41681], 99.50th=[42206], 99.90th=[43254], 99.95th=[43254], 00:15:36.400 | 99.99th=[54264] 00:15:36.400 write: IOPS=4501, BW=17.6MiB/s (18.4MB/s)(17.7MiB/1009msec); 0 zone resets 00:15:36.400 slat (usec): min=3, max=13423, avg=93.05, stdev=688.06 00:15:36.400 clat (usec): min=2933, max=38144, avg=13187.95, stdev=5325.65 00:15:36.400 lat (usec): min=3041, max=38160, avg=13281.00, stdev=5360.86 00:15:36.400 clat percentiles (usec): 00:15:36.400 | 1.00th=[ 5014], 5.00th=[ 6456], 10.00th=[ 7635], 20.00th=[ 9372], 00:15:36.400 | 30.00th=[10552], 40.00th=[11207], 50.00th=[11600], 60.00th=[12911], 00:15:36.400 | 70.00th=[13435], 80.00th=[17171], 90.00th=[20579], 95.00th=[24249], 00:15:36.400 | 99.00th=[31589], 99.50th=[34866], 99.90th=[37487], 99.95th=[38011], 00:15:36.400 | 99.99th=[38011] 00:15:36.400 bw ( KiB/s): min=16384, max=18936, per=27.87%, avg=17660.00, stdev=1804.54, samples=2 00:15:36.400 iops : min= 4096, max= 4734, avg=4415.00, stdev=451.13, samples=2 00:15:36.400 lat (msec) : 4=0.32%, 10=15.00%, 20=69.01%, 50=15.65%, 100=0.01% 00:15:36.400 cpu : usr=4.27%, sys=5.85%, ctx=275, majf=0, minf=1 00:15:36.400 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.2%, 32=0.4%, >=64=99.3% 00:15:36.400 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:15:36.400 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:15:36.400 issued rwts: total=4096,4542,0,0 short=0,0,0,0 dropped=0,0,0,0 00:15:36.400 latency : target=0, window=0, percentile=100.00%, depth=128 00:15:36.400 00:15:36.400 Run status group 0 (all jobs): 00:15:36.400 READ: bw=56.8MiB/s (59.5MB/s), 9830KiB/s-18.0MiB/s (10.1MB/s-18.8MB/s), io=60.2MiB (63.1MB), run=1002-1060msec 00:15:36.400 WRITE: bw=61.9MiB/s (64.9MB/s), 11.3MiB/s-18.6MiB/s (11.9MB/s-19.5MB/s), io=65.6MiB (68.8MB), run=1002-1060msec 00:15:36.400 00:15:36.400 Disk stats (read/write): 00:15:36.400 nvme0n1: ios=3327/3584, merge=0/0, ticks=13480/12589, in_queue=26069, util=86.67% 00:15:36.400 nvme0n2: ios=3796/4096, merge=0/0, ticks=17522/15954, in_queue=33476, util=98.68% 00:15:36.400 nvme0n3: ios=2617/2654, merge=0/0, ticks=30819/22235, in_queue=53054, util=90.48% 00:15:36.400 nvme0n4: ios=3496/3584, merge=0/0, ticks=44065/34016, in_queue=78081, util=98.84% 00:15:36.400 22:53:27 -- target/fio.sh@55 -- # sync 00:15:36.400 22:53:27 -- target/fio.sh@59 -- # fio_pid=278530 00:15:36.400 22:53:27 -- target/fio.sh@58 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/fio-wrapper -p nvmf -i 4096 -d 1 -t read -r 10 00:15:36.400 22:53:27 -- target/fio.sh@61 -- # sleep 3 00:15:36.400 [global] 00:15:36.400 thread=1 00:15:36.400 invalidate=1 00:15:36.400 rw=read 00:15:36.400 time_based=1 00:15:36.400 runtime=10 00:15:36.400 ioengine=libaio 00:15:36.400 direct=1 00:15:36.400 bs=4096 00:15:36.400 iodepth=1 00:15:36.400 norandommap=1 00:15:36.400 numjobs=1 00:15:36.400 00:15:36.400 [job0] 00:15:36.400 filename=/dev/nvme0n1 00:15:36.400 [job1] 00:15:36.400 filename=/dev/nvme0n2 00:15:36.400 [job2] 00:15:36.400 filename=/dev/nvme0n3 00:15:36.400 [job3] 00:15:36.400 filename=/dev/nvme0n4 00:15:36.400 Could not set queue depth (nvme0n1) 00:15:36.400 Could not set queue depth (nvme0n2) 00:15:36.400 Could not set queue depth (nvme0n3) 00:15:36.400 Could not set queue depth (nvme0n4) 00:15:36.400 job0: (g=0): rw=read, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:15:36.400 job1: (g=0): rw=read, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:15:36.400 job2: (g=0): rw=read, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:15:36.400 job3: (g=0): rw=read, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:15:36.400 fio-3.35 00:15:36.400 Starting 4 threads 00:15:39.681 22:53:30 -- target/fio.sh@63 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_raid_delete concat0 00:15:39.681 fio: io_u error on file /dev/nvme0n4: Remote I/O error: read offset=18120704, buflen=4096 00:15:39.681 fio: pid=278621, err=121/file:io_u.c:1889, func=io_u error, error=Remote I/O error 00:15:39.681 22:53:30 -- target/fio.sh@64 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_raid_delete raid0 00:15:39.681 fio: io_u error on file /dev/nvme0n3: Remote I/O error: read offset=23654400, buflen=4096 00:15:39.681 fio: pid=278620, err=121/file:io_u.c:1889, func=io_u error, error=Remote I/O error 00:15:39.681 22:53:30 -- target/fio.sh@65 -- # for malloc_bdev in $malloc_bdevs $raid_malloc_bdevs $concat_malloc_bdevs 00:15:39.681 22:53:30 -- target/fio.sh@66 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_delete Malloc0 00:15:39.939 fio: io_u error on file /dev/nvme0n1: Remote I/O error: read offset=12238848, buflen=4096 00:15:39.939 fio: pid=278618, err=121/file:io_u.c:1889, func=io_u error, error=Remote I/O error 00:15:39.939 22:53:30 -- target/fio.sh@65 -- # for malloc_bdev in $malloc_bdevs $raid_malloc_bdevs $concat_malloc_bdevs 00:15:39.939 22:53:30 -- target/fio.sh@66 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_delete Malloc1 00:15:40.198 fio: io_u error on file /dev/nvme0n2: Remote I/O error: read offset=28475392, buflen=4096 00:15:40.198 fio: pid=278619, err=121/file:io_u.c:1889, func=io_u error, error=Remote I/O error 00:15:40.198 22:53:31 -- target/fio.sh@65 -- # for malloc_bdev in $malloc_bdevs $raid_malloc_bdevs $concat_malloc_bdevs 00:15:40.198 22:53:31 -- target/fio.sh@66 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_delete Malloc2 00:15:40.198 00:15:40.198 job0: (groupid=0, jobs=1): err=121 (file:io_u.c:1889, func=io_u error, error=Remote I/O error): pid=278618: Tue Apr 16 22:53:31 2024 00:15:40.198 read: IOPS=883, BW=3534KiB/s (3619kB/s)(11.7MiB/3382msec) 00:15:40.198 slat (usec): min=5, max=14847, avg=25.99, stdev=359.26 00:15:40.198 clat (usec): min=242, max=41515, avg=1101.48, stdev=5505.78 00:15:40.198 lat (usec): min=248, max=55967, avg=1127.48, stdev=5584.24 00:15:40.198 clat percentiles (usec): 00:15:40.198 | 1.00th=[ 265], 5.00th=[ 285], 10.00th=[ 297], 20.00th=[ 310], 00:15:40.198 | 30.00th=[ 318], 40.00th=[ 326], 50.00th=[ 334], 60.00th=[ 343], 00:15:40.198 | 70.00th=[ 351], 80.00th=[ 359], 90.00th=[ 388], 95.00th=[ 474], 00:15:40.198 | 99.00th=[41157], 99.50th=[41157], 99.90th=[41157], 99.95th=[41157], 00:15:40.198 | 99.99th=[41681] 00:15:40.198 bw ( KiB/s): min= 104, max=10328, per=18.01%, avg=3972.00, stdev=4136.66, samples=6 00:15:40.198 iops : min= 26, max= 2582, avg=993.00, stdev=1034.16, samples=6 00:15:40.198 lat (usec) : 250=0.03%, 500=95.68%, 750=2.34%, 1000=0.03% 00:15:40.198 lat (msec) : 50=1.87% 00:15:40.198 cpu : usr=0.80%, sys=2.40%, ctx=2994, majf=0, minf=1 00:15:40.198 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:15:40.198 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:15:40.198 complete : 0=0.1%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:15:40.198 issued rwts: total=2989,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:15:40.198 latency : target=0, window=0, percentile=100.00%, depth=1 00:15:40.198 job1: (groupid=0, jobs=1): err=121 (file:io_u.c:1889, func=io_u error, error=Remote I/O error): pid=278619: Tue Apr 16 22:53:31 2024 00:15:40.198 read: IOPS=1903, BW=7614KiB/s (7797kB/s)(27.2MiB/3652msec) 00:15:40.198 slat (usec): min=4, max=11673, avg=19.11, stdev=277.75 00:15:40.198 clat (usec): min=230, max=41395, avg=503.23, stdev=2798.43 00:15:40.198 lat (usec): min=236, max=41417, avg=520.67, stdev=2809.01 00:15:40.198 clat percentiles (usec): 00:15:40.198 | 1.00th=[ 239], 5.00th=[ 247], 10.00th=[ 251], 20.00th=[ 262], 00:15:40.198 | 30.00th=[ 273], 40.00th=[ 289], 50.00th=[ 302], 60.00th=[ 314], 00:15:40.198 | 70.00th=[ 326], 80.00th=[ 343], 90.00th=[ 367], 95.00th=[ 408], 00:15:40.198 | 99.00th=[ 603], 99.50th=[ 2008], 99.90th=[41157], 99.95th=[41157], 00:15:40.198 | 99.99th=[41157] 00:15:40.198 bw ( KiB/s): min= 112, max=13362, per=33.84%, avg=7465.43, stdev=5271.34, samples=7 00:15:40.198 iops : min= 28, max= 3340, avg=1866.29, stdev=1317.74, samples=7 00:15:40.198 lat (usec) : 250=8.28%, 500=89.89%, 750=1.08%, 1000=0.16% 00:15:40.198 lat (msec) : 2=0.07%, 4=0.01%, 20=0.01%, 50=0.47% 00:15:40.198 cpu : usr=1.40%, sys=3.29%, ctx=6960, majf=0, minf=1 00:15:40.198 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:15:40.198 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:15:40.198 complete : 0=0.1%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:15:40.198 issued rwts: total=6953,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:15:40.198 latency : target=0, window=0, percentile=100.00%, depth=1 00:15:40.198 job2: (groupid=0, jobs=1): err=121 (file:io_u.c:1889, func=io_u error, error=Remote I/O error): pid=278620: Tue Apr 16 22:53:31 2024 00:15:40.198 read: IOPS=1834, BW=7338KiB/s (7514kB/s)(22.6MiB/3148msec) 00:15:40.199 slat (nsec): min=5697, max=61221, avg=13254.09, stdev=5644.91 00:15:40.199 clat (usec): min=330, max=41027, avg=528.47, stdev=2131.54 00:15:40.199 lat (usec): min=337, max=41041, avg=541.72, stdev=2131.69 00:15:40.199 clat percentiles (usec): 00:15:40.199 | 1.00th=[ 338], 5.00th=[ 347], 10.00th=[ 351], 20.00th=[ 359], 00:15:40.199 | 30.00th=[ 371], 40.00th=[ 396], 50.00th=[ 412], 60.00th=[ 433], 00:15:40.199 | 70.00th=[ 449], 80.00th=[ 461], 90.00th=[ 482], 95.00th=[ 515], 00:15:40.199 | 99.00th=[ 603], 99.50th=[ 676], 99.90th=[41157], 99.95th=[41157], 00:15:40.199 | 99.99th=[41157] 00:15:40.199 bw ( KiB/s): min= 104, max=10888, per=34.88%, avg=7694.67, stdev=3852.13, samples=6 00:15:40.199 iops : min= 26, max= 2722, avg=1923.67, stdev=963.03, samples=6 00:15:40.199 lat (usec) : 500=93.63%, 750=5.96%, 1000=0.07% 00:15:40.199 lat (msec) : 2=0.02%, 4=0.03%, 50=0.28% 00:15:40.199 cpu : usr=1.84%, sys=3.75%, ctx=5776, majf=0, minf=1 00:15:40.199 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:15:40.199 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:15:40.199 complete : 0=0.1%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:15:40.199 issued rwts: total=5776,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:15:40.199 latency : target=0, window=0, percentile=100.00%, depth=1 00:15:40.199 job3: (groupid=0, jobs=1): err=121 (file:io_u.c:1889, func=io_u error, error=Remote I/O error): pid=278621: Tue Apr 16 22:53:31 2024 00:15:40.199 read: IOPS=1535, BW=6140KiB/s (6288kB/s)(17.3MiB/2882msec) 00:15:40.199 slat (nsec): min=4845, max=69891, avg=20971.19, stdev=11940.03 00:15:40.199 clat (usec): min=241, max=41020, avg=625.35, stdev=3039.76 00:15:40.199 lat (usec): min=247, max=41037, avg=646.32, stdev=3039.90 00:15:40.199 clat percentiles (usec): 00:15:40.199 | 1.00th=[ 251], 5.00th=[ 262], 10.00th=[ 269], 20.00th=[ 302], 00:15:40.199 | 30.00th=[ 379], 40.00th=[ 400], 50.00th=[ 420], 60.00th=[ 433], 00:15:40.199 | 70.00th=[ 441], 80.00th=[ 453], 90.00th=[ 478], 95.00th=[ 502], 00:15:40.199 | 99.00th=[ 553], 99.50th=[40633], 99.90th=[41157], 99.95th=[41157], 00:15:40.199 | 99.99th=[41157] 00:15:40.199 bw ( KiB/s): min= 96, max= 8704, per=23.08%, avg=5091.20, stdev=4006.31, samples=5 00:15:40.199 iops : min= 24, max= 2176, avg=1272.80, stdev=1001.58, samples=5 00:15:40.199 lat (usec) : 250=0.52%, 500=93.85%, 750=4.97% 00:15:40.199 lat (msec) : 2=0.07%, 50=0.56% 00:15:40.199 cpu : usr=1.28%, sys=3.75%, ctx=4427, majf=0, minf=1 00:15:40.199 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:15:40.199 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:15:40.199 complete : 0=0.1%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:15:40.199 issued rwts: total=4425,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:15:40.199 latency : target=0, window=0, percentile=100.00%, depth=1 00:15:40.199 00:15:40.199 Run status group 0 (all jobs): 00:15:40.199 READ: bw=21.5MiB/s (22.6MB/s), 3534KiB/s-7614KiB/s (3619kB/s-7797kB/s), io=78.7MiB (82.5MB), run=2882-3652msec 00:15:40.199 00:15:40.199 Disk stats (read/write): 00:15:40.199 nvme0n1: ios=3026/0, merge=0/0, ticks=4374/0, in_queue=4374, util=98.51% 00:15:40.199 nvme0n2: ios=6896/0, merge=0/0, ticks=4206/0, in_queue=4206, util=98.58% 00:15:40.199 nvme0n3: ios=5773/0, merge=0/0, ticks=2902/0, in_queue=2902, util=96.79% 00:15:40.199 nvme0n4: ios=4382/0, merge=0/0, ticks=3737/0, in_queue=3737, util=99.05% 00:15:40.457 22:53:31 -- target/fio.sh@65 -- # for malloc_bdev in $malloc_bdevs $raid_malloc_bdevs $concat_malloc_bdevs 00:15:40.457 22:53:31 -- target/fio.sh@66 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_delete Malloc3 00:15:40.715 22:53:31 -- target/fio.sh@65 -- # for malloc_bdev in $malloc_bdevs $raid_malloc_bdevs $concat_malloc_bdevs 00:15:40.715 22:53:31 -- target/fio.sh@66 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_delete Malloc4 00:15:40.972 22:53:31 -- target/fio.sh@65 -- # for malloc_bdev in $malloc_bdevs $raid_malloc_bdevs $concat_malloc_bdevs 00:15:40.972 22:53:31 -- target/fio.sh@66 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_delete Malloc5 00:15:41.231 22:53:32 -- target/fio.sh@65 -- # for malloc_bdev in $malloc_bdevs $raid_malloc_bdevs $concat_malloc_bdevs 00:15:41.231 22:53:32 -- target/fio.sh@66 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_delete Malloc6 00:15:41.488 22:53:32 -- target/fio.sh@69 -- # fio_status=0 00:15:41.488 22:53:32 -- target/fio.sh@70 -- # wait 278530 00:15:41.488 22:53:32 -- target/fio.sh@70 -- # fio_status=4 00:15:41.488 22:53:32 -- target/fio.sh@72 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:15:41.488 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:15:41.488 22:53:32 -- target/fio.sh@73 -- # waitforserial_disconnect SPDKISFASTANDAWESOME 00:15:41.488 22:53:32 -- common/autotest_common.sh@1198 -- # local i=0 00:15:41.488 22:53:32 -- common/autotest_common.sh@1199 -- # lsblk -o NAME,SERIAL 00:15:41.488 22:53:32 -- common/autotest_common.sh@1199 -- # grep -q -w SPDKISFASTANDAWESOME 00:15:41.488 22:53:32 -- common/autotest_common.sh@1206 -- # lsblk -l -o NAME,SERIAL 00:15:41.488 22:53:32 -- common/autotest_common.sh@1206 -- # grep -q -w SPDKISFASTANDAWESOME 00:15:41.488 22:53:32 -- common/autotest_common.sh@1210 -- # return 0 00:15:41.488 22:53:32 -- target/fio.sh@75 -- # '[' 4 -eq 0 ']' 00:15:41.488 22:53:32 -- target/fio.sh@80 -- # echo 'nvmf hotplug test: fio failed as expected' 00:15:41.488 nvmf hotplug test: fio failed as expected 00:15:41.488 22:53:32 -- target/fio.sh@83 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:15:41.745 22:53:32 -- target/fio.sh@85 -- # rm -f ./local-job0-0-verify.state 00:15:41.745 22:53:32 -- target/fio.sh@86 -- # rm -f ./local-job1-1-verify.state 00:15:41.745 22:53:32 -- target/fio.sh@87 -- # rm -f ./local-job2-2-verify.state 00:15:41.745 22:53:32 -- target/fio.sh@89 -- # trap - SIGINT SIGTERM EXIT 00:15:41.745 22:53:32 -- target/fio.sh@91 -- # nvmftestfini 00:15:41.745 22:53:32 -- nvmf/common.sh@476 -- # nvmfcleanup 00:15:41.745 22:53:32 -- nvmf/common.sh@116 -- # sync 00:15:41.745 22:53:32 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:15:41.745 22:53:32 -- nvmf/common.sh@119 -- # set +e 00:15:41.745 22:53:32 -- nvmf/common.sh@120 -- # for i in {1..20} 00:15:41.745 22:53:32 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:15:41.745 rmmod nvme_tcp 00:15:41.745 rmmod nvme_fabrics 00:15:42.003 rmmod nvme_keyring 00:15:42.003 22:53:32 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:15:42.003 22:53:32 -- nvmf/common.sh@123 -- # set -e 00:15:42.003 22:53:32 -- nvmf/common.sh@124 -- # return 0 00:15:42.003 22:53:32 -- nvmf/common.sh@477 -- # '[' -n 276446 ']' 00:15:42.003 22:53:32 -- nvmf/common.sh@478 -- # killprocess 276446 00:15:42.003 22:53:32 -- common/autotest_common.sh@926 -- # '[' -z 276446 ']' 00:15:42.003 22:53:32 -- common/autotest_common.sh@930 -- # kill -0 276446 00:15:42.003 22:53:32 -- common/autotest_common.sh@931 -- # uname 00:15:42.003 22:53:32 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:15:42.003 22:53:32 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 276446 00:15:42.003 22:53:32 -- common/autotest_common.sh@932 -- # process_name=reactor_0 00:15:42.003 22:53:32 -- common/autotest_common.sh@936 -- # '[' reactor_0 = sudo ']' 00:15:42.003 22:53:32 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 276446' 00:15:42.003 killing process with pid 276446 00:15:42.003 22:53:32 -- common/autotest_common.sh@945 -- # kill 276446 00:15:42.003 22:53:32 -- common/autotest_common.sh@950 -- # wait 276446 00:15:42.262 22:53:33 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:15:42.262 22:53:33 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:15:42.262 22:53:33 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:15:42.262 22:53:33 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:15:42.262 22:53:33 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:15:42.262 22:53:33 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:15:42.262 22:53:33 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:15:42.262 22:53:33 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:15:44.165 22:53:35 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:15:44.165 00:15:44.165 real 0m23.663s 00:15:44.165 user 1m22.454s 00:15:44.165 sys 0m6.896s 00:15:44.165 22:53:35 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:15:44.165 22:53:35 -- common/autotest_common.sh@10 -- # set +x 00:15:44.165 ************************************ 00:15:44.165 END TEST nvmf_fio_target 00:15:44.165 ************************************ 00:15:44.165 22:53:35 -- nvmf/nvmf.sh@55 -- # run_test nvmf_bdevio /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/bdevio.sh --transport=tcp 00:15:44.165 22:53:35 -- common/autotest_common.sh@1077 -- # '[' 3 -le 1 ']' 00:15:44.165 22:53:35 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:15:44.165 22:53:35 -- common/autotest_common.sh@10 -- # set +x 00:15:44.165 ************************************ 00:15:44.165 START TEST nvmf_bdevio 00:15:44.165 ************************************ 00:15:44.165 22:53:35 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/bdevio.sh --transport=tcp 00:15:44.424 * Looking for test storage... 00:15:44.424 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:15:44.424 22:53:35 -- target/bdevio.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:15:44.424 22:53:35 -- nvmf/common.sh@7 -- # uname -s 00:15:44.424 22:53:35 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:15:44.424 22:53:35 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:15:44.424 22:53:35 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:15:44.424 22:53:35 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:15:44.424 22:53:35 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:15:44.424 22:53:35 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:15:44.424 22:53:35 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:15:44.424 22:53:35 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:15:44.424 22:53:35 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:15:44.424 22:53:35 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:15:44.424 22:53:35 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:15:44.424 22:53:35 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:15:44.424 22:53:35 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:15:44.424 22:53:35 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:15:44.424 22:53:35 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:15:44.424 22:53:35 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:15:44.424 22:53:35 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:15:44.424 22:53:35 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:15:44.424 22:53:35 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:15:44.424 22:53:35 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:15:44.424 22:53:35 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:15:44.424 22:53:35 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:15:44.424 22:53:35 -- paths/export.sh@5 -- # export PATH 00:15:44.424 22:53:35 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:15:44.424 22:53:35 -- nvmf/common.sh@46 -- # : 0 00:15:44.424 22:53:35 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:15:44.424 22:53:35 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:15:44.424 22:53:35 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:15:44.424 22:53:35 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:15:44.424 22:53:35 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:15:44.424 22:53:35 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:15:44.424 22:53:35 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:15:44.424 22:53:35 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:15:44.424 22:53:35 -- target/bdevio.sh@11 -- # MALLOC_BDEV_SIZE=64 00:15:44.424 22:53:35 -- target/bdevio.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:15:44.424 22:53:35 -- target/bdevio.sh@14 -- # nvmftestinit 00:15:44.424 22:53:35 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:15:44.424 22:53:35 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:15:44.424 22:53:35 -- nvmf/common.sh@436 -- # prepare_net_devs 00:15:44.424 22:53:35 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:15:44.424 22:53:35 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:15:44.424 22:53:35 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:15:44.424 22:53:35 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:15:44.424 22:53:35 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:15:44.424 22:53:35 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:15:44.424 22:53:35 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:15:44.424 22:53:35 -- nvmf/common.sh@284 -- # xtrace_disable 00:15:44.424 22:53:35 -- common/autotest_common.sh@10 -- # set +x 00:15:46.324 22:53:37 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:15:46.324 22:53:37 -- nvmf/common.sh@290 -- # pci_devs=() 00:15:46.324 22:53:37 -- nvmf/common.sh@290 -- # local -a pci_devs 00:15:46.324 22:53:37 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:15:46.324 22:53:37 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:15:46.324 22:53:37 -- nvmf/common.sh@292 -- # pci_drivers=() 00:15:46.324 22:53:37 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:15:46.324 22:53:37 -- nvmf/common.sh@294 -- # net_devs=() 00:15:46.324 22:53:37 -- nvmf/common.sh@294 -- # local -ga net_devs 00:15:46.324 22:53:37 -- nvmf/common.sh@295 -- # e810=() 00:15:46.324 22:53:37 -- nvmf/common.sh@295 -- # local -ga e810 00:15:46.324 22:53:37 -- nvmf/common.sh@296 -- # x722=() 00:15:46.324 22:53:37 -- nvmf/common.sh@296 -- # local -ga x722 00:15:46.324 22:53:37 -- nvmf/common.sh@297 -- # mlx=() 00:15:46.324 22:53:37 -- nvmf/common.sh@297 -- # local -ga mlx 00:15:46.324 22:53:37 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:15:46.324 22:53:37 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:15:46.324 22:53:37 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:15:46.324 22:53:37 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:15:46.324 22:53:37 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:15:46.324 22:53:37 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:15:46.324 22:53:37 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:15:46.324 22:53:37 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:15:46.324 22:53:37 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:15:46.324 22:53:37 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:15:46.324 22:53:37 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:15:46.324 22:53:37 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:15:46.324 22:53:37 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:15:46.324 22:53:37 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:15:46.324 22:53:37 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:15:46.324 22:53:37 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:15:46.324 22:53:37 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:15:46.324 22:53:37 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:15:46.324 22:53:37 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:15:46.324 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:15:46.324 22:53:37 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:15:46.324 22:53:37 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:15:46.324 22:53:37 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:15:46.324 22:53:37 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:15:46.324 22:53:37 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:15:46.324 22:53:37 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:15:46.324 22:53:37 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:15:46.324 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:15:46.324 22:53:37 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:15:46.324 22:53:37 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:15:46.324 22:53:37 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:15:46.324 22:53:37 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:15:46.324 22:53:37 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:15:46.324 22:53:37 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:15:46.325 22:53:37 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:15:46.325 22:53:37 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:15:46.325 22:53:37 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:15:46.325 22:53:37 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:15:46.325 22:53:37 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:15:46.325 22:53:37 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:15:46.325 22:53:37 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:15:46.325 Found net devices under 0000:0a:00.0: cvl_0_0 00:15:46.325 22:53:37 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:15:46.325 22:53:37 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:15:46.325 22:53:37 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:15:46.325 22:53:37 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:15:46.325 22:53:37 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:15:46.325 22:53:37 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:15:46.325 Found net devices under 0000:0a:00.1: cvl_0_1 00:15:46.325 22:53:37 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:15:46.325 22:53:37 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:15:46.325 22:53:37 -- nvmf/common.sh@402 -- # is_hw=yes 00:15:46.325 22:53:37 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:15:46.325 22:53:37 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:15:46.325 22:53:37 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:15:46.325 22:53:37 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:15:46.325 22:53:37 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:15:46.325 22:53:37 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:15:46.325 22:53:37 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:15:46.325 22:53:37 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:15:46.325 22:53:37 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:15:46.325 22:53:37 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:15:46.325 22:53:37 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:15:46.325 22:53:37 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:15:46.325 22:53:37 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:15:46.325 22:53:37 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:15:46.325 22:53:37 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:15:46.325 22:53:37 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:15:46.325 22:53:37 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:15:46.325 22:53:37 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:15:46.325 22:53:37 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:15:46.325 22:53:37 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:15:46.325 22:53:37 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:15:46.325 22:53:37 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:15:46.325 22:53:37 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:15:46.325 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:15:46.325 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.208 ms 00:15:46.325 00:15:46.325 --- 10.0.0.2 ping statistics --- 00:15:46.325 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:15:46.325 rtt min/avg/max/mdev = 0.208/0.208/0.208/0.000 ms 00:15:46.325 22:53:37 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:15:46.325 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:15:46.325 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.131 ms 00:15:46.325 00:15:46.325 --- 10.0.0.1 ping statistics --- 00:15:46.325 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:15:46.325 rtt min/avg/max/mdev = 0.131/0.131/0.131/0.000 ms 00:15:46.325 22:53:37 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:15:46.325 22:53:37 -- nvmf/common.sh@410 -- # return 0 00:15:46.325 22:53:37 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:15:46.325 22:53:37 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:15:46.325 22:53:37 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:15:46.325 22:53:37 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:15:46.325 22:53:37 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:15:46.325 22:53:37 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:15:46.325 22:53:37 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:15:46.325 22:53:37 -- target/bdevio.sh@16 -- # nvmfappstart -m 0x78 00:15:46.325 22:53:37 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:15:46.325 22:53:37 -- common/autotest_common.sh@712 -- # xtrace_disable 00:15:46.325 22:53:37 -- common/autotest_common.sh@10 -- # set +x 00:15:46.325 22:53:37 -- nvmf/common.sh@469 -- # nvmfpid=281266 00:15:46.325 22:53:37 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x78 00:15:46.325 22:53:37 -- nvmf/common.sh@470 -- # waitforlisten 281266 00:15:46.325 22:53:37 -- common/autotest_common.sh@819 -- # '[' -z 281266 ']' 00:15:46.325 22:53:37 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk.sock 00:15:46.325 22:53:37 -- common/autotest_common.sh@824 -- # local max_retries=100 00:15:46.325 22:53:37 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:15:46.325 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:15:46.325 22:53:37 -- common/autotest_common.sh@828 -- # xtrace_disable 00:15:46.325 22:53:37 -- common/autotest_common.sh@10 -- # set +x 00:15:46.582 [2024-04-16 22:53:37.494259] Starting SPDK v24.01.1-pre git sha1 4b134b4ab / DPDK 23.11.0 initialization... 00:15:46.582 [2024-04-16 22:53:37.494350] [ DPDK EAL parameters: nvmf -c 0x78 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:15:46.582 EAL: No free 2048 kB hugepages reported on node 1 00:15:46.582 [2024-04-16 22:53:37.564132] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:15:46.582 [2024-04-16 22:53:37.683801] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:15:46.582 [2024-04-16 22:53:37.683973] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:15:46.582 [2024-04-16 22:53:37.683993] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:15:46.582 [2024-04-16 22:53:37.684008] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:15:46.582 [2024-04-16 22:53:37.684134] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 4 00:15:46.582 [2024-04-16 22:53:37.684224] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 5 00:15:46.582 [2024-04-16 22:53:37.684338] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 6 00:15:46.582 [2024-04-16 22:53:37.684343] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:15:47.515 22:53:38 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:15:47.515 22:53:38 -- common/autotest_common.sh@852 -- # return 0 00:15:47.515 22:53:38 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:15:47.515 22:53:38 -- common/autotest_common.sh@718 -- # xtrace_disable 00:15:47.515 22:53:38 -- common/autotest_common.sh@10 -- # set +x 00:15:47.515 22:53:38 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:15:47.515 22:53:38 -- target/bdevio.sh@18 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:15:47.515 22:53:38 -- common/autotest_common.sh@551 -- # xtrace_disable 00:15:47.515 22:53:38 -- common/autotest_common.sh@10 -- # set +x 00:15:47.515 [2024-04-16 22:53:38.490773] tcp.c: 659:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:15:47.515 22:53:38 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:15:47.515 22:53:38 -- target/bdevio.sh@19 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc0 00:15:47.515 22:53:38 -- common/autotest_common.sh@551 -- # xtrace_disable 00:15:47.515 22:53:38 -- common/autotest_common.sh@10 -- # set +x 00:15:47.515 Malloc0 00:15:47.515 22:53:38 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:15:47.515 22:53:38 -- target/bdevio.sh@20 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:15:47.515 22:53:38 -- common/autotest_common.sh@551 -- # xtrace_disable 00:15:47.515 22:53:38 -- common/autotest_common.sh@10 -- # set +x 00:15:47.515 22:53:38 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:15:47.515 22:53:38 -- target/bdevio.sh@21 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:15:47.515 22:53:38 -- common/autotest_common.sh@551 -- # xtrace_disable 00:15:47.515 22:53:38 -- common/autotest_common.sh@10 -- # set +x 00:15:47.515 22:53:38 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:15:47.515 22:53:38 -- target/bdevio.sh@22 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:15:47.515 22:53:38 -- common/autotest_common.sh@551 -- # xtrace_disable 00:15:47.515 22:53:38 -- common/autotest_common.sh@10 -- # set +x 00:15:47.515 [2024-04-16 22:53:38.542276] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:15:47.515 22:53:38 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:15:47.515 22:53:38 -- target/bdevio.sh@24 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/bdev/bdevio/bdevio --json /dev/fd/62 00:15:47.515 22:53:38 -- target/bdevio.sh@24 -- # gen_nvmf_target_json 00:15:47.515 22:53:38 -- nvmf/common.sh@520 -- # config=() 00:15:47.515 22:53:38 -- nvmf/common.sh@520 -- # local subsystem config 00:15:47.515 22:53:38 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:15:47.515 22:53:38 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:15:47.515 { 00:15:47.515 "params": { 00:15:47.515 "name": "Nvme$subsystem", 00:15:47.515 "trtype": "$TEST_TRANSPORT", 00:15:47.515 "traddr": "$NVMF_FIRST_TARGET_IP", 00:15:47.515 "adrfam": "ipv4", 00:15:47.515 "trsvcid": "$NVMF_PORT", 00:15:47.515 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:15:47.515 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:15:47.515 "hdgst": ${hdgst:-false}, 00:15:47.515 "ddgst": ${ddgst:-false} 00:15:47.515 }, 00:15:47.515 "method": "bdev_nvme_attach_controller" 00:15:47.515 } 00:15:47.515 EOF 00:15:47.515 )") 00:15:47.515 22:53:38 -- nvmf/common.sh@542 -- # cat 00:15:47.515 22:53:38 -- nvmf/common.sh@544 -- # jq . 00:15:47.515 22:53:38 -- nvmf/common.sh@545 -- # IFS=, 00:15:47.515 22:53:38 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:15:47.515 "params": { 00:15:47.515 "name": "Nvme1", 00:15:47.515 "trtype": "tcp", 00:15:47.515 "traddr": "10.0.0.2", 00:15:47.515 "adrfam": "ipv4", 00:15:47.515 "trsvcid": "4420", 00:15:47.515 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:15:47.515 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:15:47.515 "hdgst": false, 00:15:47.515 "ddgst": false 00:15:47.515 }, 00:15:47.515 "method": "bdev_nvme_attach_controller" 00:15:47.515 }' 00:15:47.515 [2024-04-16 22:53:38.583212] Starting SPDK v24.01.1-pre git sha1 4b134b4ab / DPDK 23.11.0 initialization... 00:15:47.515 [2024-04-16 22:53:38.583279] [ DPDK EAL parameters: bdevio --no-shconf -c 0x7 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid281425 ] 00:15:47.515 EAL: No free 2048 kB hugepages reported on node 1 00:15:47.773 [2024-04-16 22:53:38.644056] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 3 00:15:47.773 [2024-04-16 22:53:38.757502] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:15:47.773 [2024-04-16 22:53:38.757556] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:15:47.773 [2024-04-16 22:53:38.757559] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:15:48.030 [2024-04-16 22:53:38.933679] rpc.c: 181:spdk_rpc_listen: *ERROR*: RPC Unix domain socket path /var/tmp/spdk.sock in use. Specify another. 00:15:48.030 [2024-04-16 22:53:38.933729] rpc.c: 90:spdk_rpc_initialize: *ERROR*: Unable to start RPC service at /var/tmp/spdk.sock 00:15:48.030 I/O targets: 00:15:48.030 Nvme1n1: 131072 blocks of 512 bytes (64 MiB) 00:15:48.030 00:15:48.030 00:15:48.030 CUnit - A unit testing framework for C - Version 2.1-3 00:15:48.030 http://cunit.sourceforge.net/ 00:15:48.031 00:15:48.031 00:15:48.031 Suite: bdevio tests on: Nvme1n1 00:15:48.031 Test: blockdev write read block ...passed 00:15:48.031 Test: blockdev write zeroes read block ...passed 00:15:48.031 Test: blockdev write zeroes read no split ...passed 00:15:48.031 Test: blockdev write zeroes read split ...passed 00:15:48.031 Test: blockdev write zeroes read split partial ...passed 00:15:48.031 Test: blockdev reset ...[2024-04-16 22:53:39.096956] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:15:48.031 [2024-04-16 22:53:39.097048] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1d5c180 (9): Bad file descriptor 00:15:48.288 [2024-04-16 22:53:39.194356] bdev_nvme.c:2026:_bdev_nvme_reset_ctrlr_complete: *NOTICE*: Resetting controller successful. 00:15:48.288 passed 00:15:48.288 Test: blockdev write read 8 blocks ...passed 00:15:48.288 Test: blockdev write read size > 128k ...passed 00:15:48.288 Test: blockdev write read invalid size ...passed 00:15:48.288 Test: blockdev write read offset + nbytes == size of blockdev ...passed 00:15:48.288 Test: blockdev write read offset + nbytes > size of blockdev ...passed 00:15:48.288 Test: blockdev write read max offset ...passed 00:15:48.288 Test: blockdev write read 2 blocks on overlapped address offset ...passed 00:15:48.288 Test: blockdev writev readv 8 blocks ...passed 00:15:48.288 Test: blockdev writev readv 30 x 1block ...passed 00:15:48.288 Test: blockdev writev readv block ...passed 00:15:48.288 Test: blockdev writev readv size > 128k ...passed 00:15:48.288 Test: blockdev writev readv size > 128k in two iovs ...passed 00:15:48.288 Test: blockdev comparev and writev ...[2024-04-16 22:53:39.408833] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: COMPARE sqid:1 cid:0 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:15:48.288 [2024-04-16 22:53:39.408868] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMPARE FAILURE (02/85) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:15:48.288 [2024-04-16 22:53:39.408892] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:15:48.288 [2024-04-16 22:53:39.408908] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - FAILED FUSED (00/09) qid:1 cid:1 cdw0:0 sqhd:0022 p:0 m:0 dnr:0 00:15:48.288 [2024-04-16 22:53:39.409256] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: COMPARE sqid:1 cid:1 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:15:48.288 [2024-04-16 22:53:39.409287] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMPARE FAILURE (02/85) qid:1 cid:1 cdw0:0 sqhd:0023 p:0 m:0 dnr:0 00:15:48.288 [2024-04-16 22:53:39.409310] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:15:48.288 [2024-04-16 22:53:39.409326] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - FAILED FUSED (00/09) qid:1 cid:0 cdw0:0 sqhd:0024 p:0 m:0 dnr:0 00:15:48.288 [2024-04-16 22:53:39.409670] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: COMPARE sqid:1 cid:0 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:15:48.288 [2024-04-16 22:53:39.409693] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMPARE FAILURE (02/85) qid:1 cid:0 cdw0:0 sqhd:0025 p:0 m:0 dnr:0 00:15:48.288 [2024-04-16 22:53:39.409714] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:15:48.288 [2024-04-16 22:53:39.409729] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - FAILED FUSED (00/09) qid:1 cid:1 cdw0:0 sqhd:0026 p:0 m:0 dnr:0 00:15:48.288 [2024-04-16 22:53:39.410055] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: COMPARE sqid:1 cid:1 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:15:48.288 [2024-04-16 22:53:39.410078] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMPARE FAILURE (02/85) qid:1 cid:1 cdw0:0 sqhd:0027 p:0 m:0 dnr:0 00:15:48.288 [2024-04-16 22:53:39.410099] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:15:48.288 [2024-04-16 22:53:39.410114] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - FAILED FUSED (00/09) qid:1 cid:0 cdw0:0 sqhd:0028 p:0 m:0 dnr:0 00:15:48.545 passed 00:15:48.545 Test: blockdev nvme passthru rw ...passed 00:15:48.545 Test: blockdev nvme passthru vendor specific ...[2024-04-16 22:53:39.493493] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC CONNECT qid:1 cid:0 SGL DATA BLOCK OFFSET 0x0 len:0x0 00:15:48.545 [2024-04-16 22:53:39.493528] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: INVALID OPCODE (00/01) qid:1 cid:0 cdw0:0 sqhd:002c p:0 m:0 dnr:0 00:15:48.545 [2024-04-16 22:53:39.493704] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC CONNECT qid:1 cid:0 SGL DATA BLOCK OFFSET 0x0 len:0x0 00:15:48.545 [2024-04-16 22:53:39.493728] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: INVALID OPCODE (00/01) qid:1 cid:0 cdw0:0 sqhd:002d p:0 m:0 dnr:0 00:15:48.545 [2024-04-16 22:53:39.493905] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC CONNECT qid:1 cid:0 SGL DATA BLOCK OFFSET 0x0 len:0x0 00:15:48.545 [2024-04-16 22:53:39.493928] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: INVALID OPCODE (00/01) qid:1 cid:0 cdw0:0 sqhd:002e p:0 m:0 dnr:0 00:15:48.545 [2024-04-16 22:53:39.494102] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC CONNECT qid:1 cid:0 SGL DATA BLOCK OFFSET 0x0 len:0x0 00:15:48.545 [2024-04-16 22:53:39.494125] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: INVALID OPCODE (00/01) qid:1 cid:0 cdw0:0 sqhd:002f p:0 m:0 dnr:0 00:15:48.545 passed 00:15:48.545 Test: blockdev nvme admin passthru ...passed 00:15:48.545 Test: blockdev copy ...passed 00:15:48.545 00:15:48.545 Run Summary: Type Total Ran Passed Failed Inactive 00:15:48.545 suites 1 1 n/a 0 0 00:15:48.545 tests 23 23 23 0 0 00:15:48.545 asserts 152 152 152 0 n/a 00:15:48.545 00:15:48.545 Elapsed time = 1.226 seconds 00:15:48.802 22:53:39 -- target/bdevio.sh@26 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:15:48.802 22:53:39 -- common/autotest_common.sh@551 -- # xtrace_disable 00:15:48.802 22:53:39 -- common/autotest_common.sh@10 -- # set +x 00:15:48.802 22:53:39 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:15:48.802 22:53:39 -- target/bdevio.sh@28 -- # trap - SIGINT SIGTERM EXIT 00:15:48.802 22:53:39 -- target/bdevio.sh@30 -- # nvmftestfini 00:15:48.802 22:53:39 -- nvmf/common.sh@476 -- # nvmfcleanup 00:15:48.802 22:53:39 -- nvmf/common.sh@116 -- # sync 00:15:48.802 22:53:39 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:15:48.802 22:53:39 -- nvmf/common.sh@119 -- # set +e 00:15:48.802 22:53:39 -- nvmf/common.sh@120 -- # for i in {1..20} 00:15:48.802 22:53:39 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:15:48.802 rmmod nvme_tcp 00:15:48.802 rmmod nvme_fabrics 00:15:48.802 rmmod nvme_keyring 00:15:48.802 22:53:39 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:15:48.802 22:53:39 -- nvmf/common.sh@123 -- # set -e 00:15:48.802 22:53:39 -- nvmf/common.sh@124 -- # return 0 00:15:48.802 22:53:39 -- nvmf/common.sh@477 -- # '[' -n 281266 ']' 00:15:48.802 22:53:39 -- nvmf/common.sh@478 -- # killprocess 281266 00:15:48.802 22:53:39 -- common/autotest_common.sh@926 -- # '[' -z 281266 ']' 00:15:48.802 22:53:39 -- common/autotest_common.sh@930 -- # kill -0 281266 00:15:48.802 22:53:39 -- common/autotest_common.sh@931 -- # uname 00:15:48.802 22:53:39 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:15:48.802 22:53:39 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 281266 00:15:48.802 22:53:39 -- common/autotest_common.sh@932 -- # process_name=reactor_3 00:15:48.802 22:53:39 -- common/autotest_common.sh@936 -- # '[' reactor_3 = sudo ']' 00:15:48.802 22:53:39 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 281266' 00:15:48.802 killing process with pid 281266 00:15:48.802 22:53:39 -- common/autotest_common.sh@945 -- # kill 281266 00:15:48.802 22:53:39 -- common/autotest_common.sh@950 -- # wait 281266 00:15:49.059 22:53:40 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:15:49.059 22:53:40 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:15:49.059 22:53:40 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:15:49.059 22:53:40 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:15:49.059 22:53:40 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:15:49.059 22:53:40 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:15:49.059 22:53:40 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:15:49.059 22:53:40 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:15:51.595 22:53:42 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:15:51.595 00:15:51.595 real 0m6.966s 00:15:51.595 user 0m12.926s 00:15:51.595 sys 0m2.033s 00:15:51.595 22:53:42 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:15:51.595 22:53:42 -- common/autotest_common.sh@10 -- # set +x 00:15:51.595 ************************************ 00:15:51.595 END TEST nvmf_bdevio 00:15:51.595 ************************************ 00:15:51.595 22:53:42 -- nvmf/nvmf.sh@57 -- # '[' tcp = tcp ']' 00:15:51.595 22:53:42 -- nvmf/nvmf.sh@58 -- # run_test nvmf_bdevio_no_huge /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/bdevio.sh --transport=tcp --no-hugepages 00:15:51.595 22:53:42 -- common/autotest_common.sh@1077 -- # '[' 4 -le 1 ']' 00:15:51.595 22:53:42 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:15:51.595 22:53:42 -- common/autotest_common.sh@10 -- # set +x 00:15:51.595 ************************************ 00:15:51.595 START TEST nvmf_bdevio_no_huge 00:15:51.595 ************************************ 00:15:51.595 22:53:42 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/bdevio.sh --transport=tcp --no-hugepages 00:15:51.595 * Looking for test storage... 00:15:51.595 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:15:51.595 22:53:42 -- target/bdevio.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:15:51.595 22:53:42 -- nvmf/common.sh@7 -- # uname -s 00:15:51.595 22:53:42 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:15:51.595 22:53:42 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:15:51.595 22:53:42 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:15:51.595 22:53:42 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:15:51.595 22:53:42 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:15:51.595 22:53:42 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:15:51.595 22:53:42 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:15:51.595 22:53:42 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:15:51.595 22:53:42 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:15:51.595 22:53:42 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:15:51.595 22:53:42 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:15:51.595 22:53:42 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:15:51.595 22:53:42 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:15:51.595 22:53:42 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:15:51.595 22:53:42 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:15:51.595 22:53:42 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:15:51.595 22:53:42 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:15:51.595 22:53:42 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:15:51.595 22:53:42 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:15:51.595 22:53:42 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:15:51.595 22:53:42 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:15:51.595 22:53:42 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:15:51.595 22:53:42 -- paths/export.sh@5 -- # export PATH 00:15:51.595 22:53:42 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:15:51.595 22:53:42 -- nvmf/common.sh@46 -- # : 0 00:15:51.595 22:53:42 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:15:51.595 22:53:42 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:15:51.595 22:53:42 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:15:51.595 22:53:42 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:15:51.595 22:53:42 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:15:51.595 22:53:42 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:15:51.595 22:53:42 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:15:51.595 22:53:42 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:15:51.595 22:53:42 -- target/bdevio.sh@11 -- # MALLOC_BDEV_SIZE=64 00:15:51.595 22:53:42 -- target/bdevio.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:15:51.595 22:53:42 -- target/bdevio.sh@14 -- # nvmftestinit 00:15:51.595 22:53:42 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:15:51.595 22:53:42 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:15:51.595 22:53:42 -- nvmf/common.sh@436 -- # prepare_net_devs 00:15:51.595 22:53:42 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:15:51.595 22:53:42 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:15:51.595 22:53:42 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:15:51.595 22:53:42 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:15:51.595 22:53:42 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:15:51.595 22:53:42 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:15:51.595 22:53:42 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:15:51.595 22:53:42 -- nvmf/common.sh@284 -- # xtrace_disable 00:15:51.595 22:53:42 -- common/autotest_common.sh@10 -- # set +x 00:15:53.497 22:53:44 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:15:53.497 22:53:44 -- nvmf/common.sh@290 -- # pci_devs=() 00:15:53.497 22:53:44 -- nvmf/common.sh@290 -- # local -a pci_devs 00:15:53.497 22:53:44 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:15:53.497 22:53:44 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:15:53.497 22:53:44 -- nvmf/common.sh@292 -- # pci_drivers=() 00:15:53.497 22:53:44 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:15:53.497 22:53:44 -- nvmf/common.sh@294 -- # net_devs=() 00:15:53.497 22:53:44 -- nvmf/common.sh@294 -- # local -ga net_devs 00:15:53.497 22:53:44 -- nvmf/common.sh@295 -- # e810=() 00:15:53.497 22:53:44 -- nvmf/common.sh@295 -- # local -ga e810 00:15:53.497 22:53:44 -- nvmf/common.sh@296 -- # x722=() 00:15:53.497 22:53:44 -- nvmf/common.sh@296 -- # local -ga x722 00:15:53.497 22:53:44 -- nvmf/common.sh@297 -- # mlx=() 00:15:53.497 22:53:44 -- nvmf/common.sh@297 -- # local -ga mlx 00:15:53.497 22:53:44 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:15:53.497 22:53:44 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:15:53.497 22:53:44 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:15:53.497 22:53:44 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:15:53.497 22:53:44 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:15:53.497 22:53:44 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:15:53.497 22:53:44 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:15:53.497 22:53:44 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:15:53.497 22:53:44 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:15:53.497 22:53:44 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:15:53.497 22:53:44 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:15:53.497 22:53:44 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:15:53.497 22:53:44 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:15:53.497 22:53:44 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:15:53.497 22:53:44 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:15:53.497 22:53:44 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:15:53.497 22:53:44 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:15:53.497 22:53:44 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:15:53.497 22:53:44 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:15:53.497 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:15:53.497 22:53:44 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:15:53.497 22:53:44 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:15:53.497 22:53:44 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:15:53.497 22:53:44 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:15:53.497 22:53:44 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:15:53.497 22:53:44 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:15:53.497 22:53:44 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:15:53.497 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:15:53.497 22:53:44 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:15:53.497 22:53:44 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:15:53.497 22:53:44 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:15:53.497 22:53:44 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:15:53.497 22:53:44 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:15:53.497 22:53:44 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:15:53.497 22:53:44 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:15:53.497 22:53:44 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:15:53.497 22:53:44 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:15:53.497 22:53:44 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:15:53.497 22:53:44 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:15:53.497 22:53:44 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:15:53.497 22:53:44 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:15:53.497 Found net devices under 0000:0a:00.0: cvl_0_0 00:15:53.497 22:53:44 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:15:53.497 22:53:44 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:15:53.497 22:53:44 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:15:53.497 22:53:44 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:15:53.497 22:53:44 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:15:53.497 22:53:44 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:15:53.497 Found net devices under 0000:0a:00.1: cvl_0_1 00:15:53.497 22:53:44 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:15:53.497 22:53:44 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:15:53.497 22:53:44 -- nvmf/common.sh@402 -- # is_hw=yes 00:15:53.497 22:53:44 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:15:53.497 22:53:44 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:15:53.497 22:53:44 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:15:53.497 22:53:44 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:15:53.497 22:53:44 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:15:53.497 22:53:44 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:15:53.497 22:53:44 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:15:53.497 22:53:44 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:15:53.497 22:53:44 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:15:53.497 22:53:44 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:15:53.497 22:53:44 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:15:53.497 22:53:44 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:15:53.497 22:53:44 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:15:53.497 22:53:44 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:15:53.497 22:53:44 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:15:53.497 22:53:44 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:15:53.497 22:53:44 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:15:53.497 22:53:44 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:15:53.497 22:53:44 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:15:53.497 22:53:44 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:15:53.497 22:53:44 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:15:53.497 22:53:44 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:15:53.497 22:53:44 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:15:53.497 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:15:53.497 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.127 ms 00:15:53.497 00:15:53.497 --- 10.0.0.2 ping statistics --- 00:15:53.497 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:15:53.497 rtt min/avg/max/mdev = 0.127/0.127/0.127/0.000 ms 00:15:53.497 22:53:44 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:15:53.497 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:15:53.497 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.068 ms 00:15:53.497 00:15:53.497 --- 10.0.0.1 ping statistics --- 00:15:53.497 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:15:53.497 rtt min/avg/max/mdev = 0.068/0.068/0.068/0.000 ms 00:15:53.497 22:53:44 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:15:53.497 22:53:44 -- nvmf/common.sh@410 -- # return 0 00:15:53.497 22:53:44 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:15:53.497 22:53:44 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:15:53.497 22:53:44 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:15:53.497 22:53:44 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:15:53.497 22:53:44 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:15:53.497 22:53:44 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:15:53.497 22:53:44 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:15:53.497 22:53:44 -- target/bdevio.sh@16 -- # nvmfappstart -m 0x78 00:15:53.497 22:53:44 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:15:53.497 22:53:44 -- common/autotest_common.sh@712 -- # xtrace_disable 00:15:53.497 22:53:44 -- common/autotest_common.sh@10 -- # set +x 00:15:53.497 22:53:44 -- nvmf/common.sh@469 -- # nvmfpid=283511 00:15:53.497 22:53:44 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF --no-huge -s 1024 -m 0x78 00:15:53.497 22:53:44 -- nvmf/common.sh@470 -- # waitforlisten 283511 00:15:53.497 22:53:44 -- common/autotest_common.sh@819 -- # '[' -z 283511 ']' 00:15:53.497 22:53:44 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk.sock 00:15:53.497 22:53:44 -- common/autotest_common.sh@824 -- # local max_retries=100 00:15:53.497 22:53:44 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:15:53.498 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:15:53.498 22:53:44 -- common/autotest_common.sh@828 -- # xtrace_disable 00:15:53.498 22:53:44 -- common/autotest_common.sh@10 -- # set +x 00:15:53.498 [2024-04-16 22:53:44.543048] Starting SPDK v24.01.1-pre git sha1 4b134b4ab / DPDK 23.11.0 initialization... 00:15:53.498 [2024-04-16 22:53:44.543138] [ DPDK EAL parameters: nvmf -c 0x78 -m 1024 --no-huge --iova-mode=va --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --file-prefix=spdk0 --proc-type=auto ] 00:15:53.498 [2024-04-16 22:53:44.617997] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:15:53.755 [2024-04-16 22:53:44.741123] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:15:53.755 [2024-04-16 22:53:44.741286] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:15:53.755 [2024-04-16 22:53:44.741307] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:15:53.755 [2024-04-16 22:53:44.741321] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:15:53.755 [2024-04-16 22:53:44.741407] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 4 00:15:53.755 [2024-04-16 22:53:44.741461] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 5 00:15:53.755 [2024-04-16 22:53:44.741513] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 6 00:15:53.755 [2024-04-16 22:53:44.741517] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:15:54.687 22:53:45 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:15:54.687 22:53:45 -- common/autotest_common.sh@852 -- # return 0 00:15:54.687 22:53:45 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:15:54.687 22:53:45 -- common/autotest_common.sh@718 -- # xtrace_disable 00:15:54.687 22:53:45 -- common/autotest_common.sh@10 -- # set +x 00:15:54.687 22:53:45 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:15:54.687 22:53:45 -- target/bdevio.sh@18 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:15:54.687 22:53:45 -- common/autotest_common.sh@551 -- # xtrace_disable 00:15:54.687 22:53:45 -- common/autotest_common.sh@10 -- # set +x 00:15:54.687 [2024-04-16 22:53:45.546927] tcp.c: 659:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:15:54.687 22:53:45 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:15:54.687 22:53:45 -- target/bdevio.sh@19 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc0 00:15:54.687 22:53:45 -- common/autotest_common.sh@551 -- # xtrace_disable 00:15:54.687 22:53:45 -- common/autotest_common.sh@10 -- # set +x 00:15:54.687 Malloc0 00:15:54.687 22:53:45 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:15:54.687 22:53:45 -- target/bdevio.sh@20 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:15:54.687 22:53:45 -- common/autotest_common.sh@551 -- # xtrace_disable 00:15:54.687 22:53:45 -- common/autotest_common.sh@10 -- # set +x 00:15:54.687 22:53:45 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:15:54.687 22:53:45 -- target/bdevio.sh@21 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:15:54.687 22:53:45 -- common/autotest_common.sh@551 -- # xtrace_disable 00:15:54.687 22:53:45 -- common/autotest_common.sh@10 -- # set +x 00:15:54.687 22:53:45 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:15:54.687 22:53:45 -- target/bdevio.sh@22 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:15:54.687 22:53:45 -- common/autotest_common.sh@551 -- # xtrace_disable 00:15:54.687 22:53:45 -- common/autotest_common.sh@10 -- # set +x 00:15:54.687 [2024-04-16 22:53:45.584832] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:15:54.687 22:53:45 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:15:54.687 22:53:45 -- target/bdevio.sh@24 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/bdev/bdevio/bdevio --json /dev/fd/62 --no-huge -s 1024 00:15:54.687 22:53:45 -- target/bdevio.sh@24 -- # gen_nvmf_target_json 00:15:54.687 22:53:45 -- nvmf/common.sh@520 -- # config=() 00:15:54.687 22:53:45 -- nvmf/common.sh@520 -- # local subsystem config 00:15:54.687 22:53:45 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:15:54.687 22:53:45 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:15:54.687 { 00:15:54.687 "params": { 00:15:54.687 "name": "Nvme$subsystem", 00:15:54.687 "trtype": "$TEST_TRANSPORT", 00:15:54.687 "traddr": "$NVMF_FIRST_TARGET_IP", 00:15:54.687 "adrfam": "ipv4", 00:15:54.687 "trsvcid": "$NVMF_PORT", 00:15:54.687 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:15:54.687 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:15:54.687 "hdgst": ${hdgst:-false}, 00:15:54.687 "ddgst": ${ddgst:-false} 00:15:54.687 }, 00:15:54.687 "method": "bdev_nvme_attach_controller" 00:15:54.687 } 00:15:54.687 EOF 00:15:54.687 )") 00:15:54.687 22:53:45 -- nvmf/common.sh@542 -- # cat 00:15:54.687 22:53:45 -- nvmf/common.sh@544 -- # jq . 00:15:54.687 22:53:45 -- nvmf/common.sh@545 -- # IFS=, 00:15:54.687 22:53:45 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:15:54.687 "params": { 00:15:54.687 "name": "Nvme1", 00:15:54.687 "trtype": "tcp", 00:15:54.687 "traddr": "10.0.0.2", 00:15:54.687 "adrfam": "ipv4", 00:15:54.687 "trsvcid": "4420", 00:15:54.687 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:15:54.687 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:15:54.687 "hdgst": false, 00:15:54.687 "ddgst": false 00:15:54.687 }, 00:15:54.687 "method": "bdev_nvme_attach_controller" 00:15:54.687 }' 00:15:54.687 [2024-04-16 22:53:45.626929] Starting SPDK v24.01.1-pre git sha1 4b134b4ab / DPDK 23.11.0 initialization... 00:15:54.687 [2024-04-16 22:53:45.627000] [ DPDK EAL parameters: bdevio --no-shconf -c 0x7 -m 1024 --no-huge --iova-mode=va --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --file-prefix=spdk_pid283673 ] 00:15:54.687 [2024-04-16 22:53:45.689221] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 3 00:15:54.687 [2024-04-16 22:53:45.802591] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:15:54.687 [2024-04-16 22:53:45.802636] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:15:54.687 [2024-04-16 22:53:45.802639] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:15:54.953 [2024-04-16 22:53:46.040575] rpc.c: 181:spdk_rpc_listen: *ERROR*: RPC Unix domain socket path /var/tmp/spdk.sock in use. Specify another. 00:15:54.953 [2024-04-16 22:53:46.040626] rpc.c: 90:spdk_rpc_initialize: *ERROR*: Unable to start RPC service at /var/tmp/spdk.sock 00:15:54.953 I/O targets: 00:15:54.953 Nvme1n1: 131072 blocks of 512 bytes (64 MiB) 00:15:54.953 00:15:54.953 00:15:54.953 CUnit - A unit testing framework for C - Version 2.1-3 00:15:54.953 http://cunit.sourceforge.net/ 00:15:54.953 00:15:54.953 00:15:54.953 Suite: bdevio tests on: Nvme1n1 00:15:55.218 Test: blockdev write read block ...passed 00:15:55.218 Test: blockdev write zeroes read block ...passed 00:15:55.218 Test: blockdev write zeroes read no split ...passed 00:15:55.218 Test: blockdev write zeroes read split ...passed 00:15:55.218 Test: blockdev write zeroes read split partial ...passed 00:15:55.218 Test: blockdev reset ...[2024-04-16 22:53:46.253546] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:15:55.218 [2024-04-16 22:53:46.253647] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xfafb00 (9): Bad file descriptor 00:15:55.218 [2024-04-16 22:53:46.269662] bdev_nvme.c:2026:_bdev_nvme_reset_ctrlr_complete: *NOTICE*: Resetting controller successful. 00:15:55.218 passed 00:15:55.218 Test: blockdev write read 8 blocks ...passed 00:15:55.218 Test: blockdev write read size > 128k ...passed 00:15:55.218 Test: blockdev write read invalid size ...passed 00:15:55.475 Test: blockdev write read offset + nbytes == size of blockdev ...passed 00:15:55.476 Test: blockdev write read offset + nbytes > size of blockdev ...passed 00:15:55.476 Test: blockdev write read max offset ...passed 00:15:55.476 Test: blockdev write read 2 blocks on overlapped address offset ...passed 00:15:55.476 Test: blockdev writev readv 8 blocks ...passed 00:15:55.476 Test: blockdev writev readv 30 x 1block ...passed 00:15:55.476 Test: blockdev writev readv block ...passed 00:15:55.476 Test: blockdev writev readv size > 128k ...passed 00:15:55.476 Test: blockdev writev readv size > 128k in two iovs ...passed 00:15:55.476 Test: blockdev comparev and writev ...[2024-04-16 22:53:46.486265] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: COMPARE sqid:1 cid:0 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:15:55.476 [2024-04-16 22:53:46.486299] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMPARE FAILURE (02/85) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:15:55.476 [2024-04-16 22:53:46.486323] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:15:55.476 [2024-04-16 22:53:46.486339] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - FAILED FUSED (00/09) qid:1 cid:1 cdw0:0 sqhd:0022 p:0 m:0 dnr:0 00:15:55.476 [2024-04-16 22:53:46.486692] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: COMPARE sqid:1 cid:1 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:15:55.476 [2024-04-16 22:53:46.486716] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMPARE FAILURE (02/85) qid:1 cid:1 cdw0:0 sqhd:0023 p:0 m:0 dnr:0 00:15:55.476 [2024-04-16 22:53:46.486737] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:15:55.476 [2024-04-16 22:53:46.486753] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - FAILED FUSED (00/09) qid:1 cid:0 cdw0:0 sqhd:0024 p:0 m:0 dnr:0 00:15:55.476 [2024-04-16 22:53:46.487105] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: COMPARE sqid:1 cid:0 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:15:55.476 [2024-04-16 22:53:46.487129] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMPARE FAILURE (02/85) qid:1 cid:0 cdw0:0 sqhd:0025 p:0 m:0 dnr:0 00:15:55.476 [2024-04-16 22:53:46.487150] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:15:55.476 [2024-04-16 22:53:46.487165] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - FAILED FUSED (00/09) qid:1 cid:1 cdw0:0 sqhd:0026 p:0 m:0 dnr:0 00:15:55.476 [2024-04-16 22:53:46.487508] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: COMPARE sqid:1 cid:1 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:15:55.476 [2024-04-16 22:53:46.487532] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMPARE FAILURE (02/85) qid:1 cid:1 cdw0:0 sqhd:0027 p:0 m:0 dnr:0 00:15:55.476 [2024-04-16 22:53:46.487553] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:15:55.476 [2024-04-16 22:53:46.487568] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - FAILED FUSED (00/09) qid:1 cid:0 cdw0:0 sqhd:0028 p:0 m:0 dnr:0 00:15:55.476 passed 00:15:55.476 Test: blockdev nvme passthru rw ...passed 00:15:55.476 Test: blockdev nvme passthru vendor specific ...[2024-04-16 22:53:46.571484] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC CONNECT qid:1 cid:0 SGL DATA BLOCK OFFSET 0x0 len:0x0 00:15:55.476 [2024-04-16 22:53:46.571511] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: INVALID OPCODE (00/01) qid:1 cid:0 cdw0:0 sqhd:002c p:0 m:0 dnr:0 00:15:55.476 [2024-04-16 22:53:46.571699] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC CONNECT qid:1 cid:0 SGL DATA BLOCK OFFSET 0x0 len:0x0 00:15:55.476 [2024-04-16 22:53:46.571722] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: INVALID OPCODE (00/01) qid:1 cid:0 cdw0:0 sqhd:002d p:0 m:0 dnr:0 00:15:55.476 [2024-04-16 22:53:46.571901] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC CONNECT qid:1 cid:0 SGL DATA BLOCK OFFSET 0x0 len:0x0 00:15:55.476 [2024-04-16 22:53:46.571923] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: INVALID OPCODE (00/01) qid:1 cid:0 cdw0:0 sqhd:002e p:0 m:0 dnr:0 00:15:55.476 [2024-04-16 22:53:46.572106] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC CONNECT qid:1 cid:0 SGL DATA BLOCK OFFSET 0x0 len:0x0 00:15:55.476 [2024-04-16 22:53:46.572130] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: INVALID OPCODE (00/01) qid:1 cid:0 cdw0:0 sqhd:002f p:0 m:0 dnr:0 00:15:55.476 passed 00:15:55.476 Test: blockdev nvme admin passthru ...passed 00:15:55.734 Test: blockdev copy ...passed 00:15:55.734 00:15:55.734 Run Summary: Type Total Ran Passed Failed Inactive 00:15:55.734 suites 1 1 n/a 0 0 00:15:55.734 tests 23 23 23 0 0 00:15:55.734 asserts 152 152 152 0 n/a 00:15:55.734 00:15:55.734 Elapsed time = 1.171 seconds 00:15:55.992 22:53:46 -- target/bdevio.sh@26 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:15:55.992 22:53:46 -- common/autotest_common.sh@551 -- # xtrace_disable 00:15:55.992 22:53:46 -- common/autotest_common.sh@10 -- # set +x 00:15:55.992 22:53:46 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:15:55.992 22:53:46 -- target/bdevio.sh@28 -- # trap - SIGINT SIGTERM EXIT 00:15:55.992 22:53:46 -- target/bdevio.sh@30 -- # nvmftestfini 00:15:55.992 22:53:46 -- nvmf/common.sh@476 -- # nvmfcleanup 00:15:55.992 22:53:46 -- nvmf/common.sh@116 -- # sync 00:15:55.992 22:53:46 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:15:55.992 22:53:46 -- nvmf/common.sh@119 -- # set +e 00:15:55.992 22:53:46 -- nvmf/common.sh@120 -- # for i in {1..20} 00:15:55.992 22:53:46 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:15:55.992 rmmod nvme_tcp 00:15:55.992 rmmod nvme_fabrics 00:15:55.992 rmmod nvme_keyring 00:15:55.992 22:53:47 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:15:55.992 22:53:47 -- nvmf/common.sh@123 -- # set -e 00:15:55.992 22:53:47 -- nvmf/common.sh@124 -- # return 0 00:15:55.992 22:53:47 -- nvmf/common.sh@477 -- # '[' -n 283511 ']' 00:15:55.992 22:53:47 -- nvmf/common.sh@478 -- # killprocess 283511 00:15:55.992 22:53:47 -- common/autotest_common.sh@926 -- # '[' -z 283511 ']' 00:15:55.992 22:53:47 -- common/autotest_common.sh@930 -- # kill -0 283511 00:15:55.992 22:53:47 -- common/autotest_common.sh@931 -- # uname 00:15:55.992 22:53:47 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:15:55.992 22:53:47 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 283511 00:15:55.992 22:53:47 -- common/autotest_common.sh@932 -- # process_name=reactor_3 00:15:55.992 22:53:47 -- common/autotest_common.sh@936 -- # '[' reactor_3 = sudo ']' 00:15:55.992 22:53:47 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 283511' 00:15:55.992 killing process with pid 283511 00:15:55.992 22:53:47 -- common/autotest_common.sh@945 -- # kill 283511 00:15:55.992 22:53:47 -- common/autotest_common.sh@950 -- # wait 283511 00:15:56.559 22:53:47 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:15:56.559 22:53:47 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:15:56.559 22:53:47 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:15:56.559 22:53:47 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:15:56.559 22:53:47 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:15:56.559 22:53:47 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:15:56.559 22:53:47 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:15:56.559 22:53:47 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:15:58.460 22:53:49 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:15:58.460 00:15:58.460 real 0m7.285s 00:15:58.460 user 0m13.783s 00:15:58.460 sys 0m2.569s 00:15:58.460 22:53:49 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:15:58.460 22:53:49 -- common/autotest_common.sh@10 -- # set +x 00:15:58.460 ************************************ 00:15:58.460 END TEST nvmf_bdevio_no_huge 00:15:58.460 ************************************ 00:15:58.460 22:53:49 -- nvmf/nvmf.sh@59 -- # run_test nvmf_tls /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/tls.sh --transport=tcp 00:15:58.460 22:53:49 -- common/autotest_common.sh@1077 -- # '[' 3 -le 1 ']' 00:15:58.460 22:53:49 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:15:58.460 22:53:49 -- common/autotest_common.sh@10 -- # set +x 00:15:58.460 ************************************ 00:15:58.460 START TEST nvmf_tls 00:15:58.460 ************************************ 00:15:58.460 22:53:49 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/tls.sh --transport=tcp 00:15:58.718 * Looking for test storage... 00:15:58.718 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:15:58.718 22:53:49 -- target/tls.sh@10 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:15:58.718 22:53:49 -- nvmf/common.sh@7 -- # uname -s 00:15:58.718 22:53:49 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:15:58.718 22:53:49 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:15:58.718 22:53:49 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:15:58.718 22:53:49 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:15:58.718 22:53:49 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:15:58.718 22:53:49 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:15:58.718 22:53:49 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:15:58.718 22:53:49 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:15:58.718 22:53:49 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:15:58.718 22:53:49 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:15:58.718 22:53:49 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:15:58.718 22:53:49 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:15:58.718 22:53:49 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:15:58.718 22:53:49 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:15:58.718 22:53:49 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:15:58.718 22:53:49 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:15:58.718 22:53:49 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:15:58.718 22:53:49 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:15:58.718 22:53:49 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:15:58.718 22:53:49 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:15:58.718 22:53:49 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:15:58.718 22:53:49 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:15:58.718 22:53:49 -- paths/export.sh@5 -- # export PATH 00:15:58.718 22:53:49 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:15:58.718 22:53:49 -- nvmf/common.sh@46 -- # : 0 00:15:58.718 22:53:49 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:15:58.718 22:53:49 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:15:58.718 22:53:49 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:15:58.718 22:53:49 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:15:58.718 22:53:49 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:15:58.718 22:53:49 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:15:58.718 22:53:49 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:15:58.719 22:53:49 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:15:58.719 22:53:49 -- target/tls.sh@12 -- # rpc_py=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:15:58.719 22:53:49 -- target/tls.sh@71 -- # nvmftestinit 00:15:58.719 22:53:49 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:15:58.719 22:53:49 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:15:58.719 22:53:49 -- nvmf/common.sh@436 -- # prepare_net_devs 00:15:58.719 22:53:49 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:15:58.719 22:53:49 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:15:58.719 22:53:49 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:15:58.719 22:53:49 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:15:58.719 22:53:49 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:15:58.719 22:53:49 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:15:58.719 22:53:49 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:15:58.719 22:53:49 -- nvmf/common.sh@284 -- # xtrace_disable 00:15:58.719 22:53:49 -- common/autotest_common.sh@10 -- # set +x 00:16:00.619 22:53:51 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:16:00.619 22:53:51 -- nvmf/common.sh@290 -- # pci_devs=() 00:16:00.619 22:53:51 -- nvmf/common.sh@290 -- # local -a pci_devs 00:16:00.619 22:53:51 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:16:00.619 22:53:51 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:16:00.619 22:53:51 -- nvmf/common.sh@292 -- # pci_drivers=() 00:16:00.619 22:53:51 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:16:00.619 22:53:51 -- nvmf/common.sh@294 -- # net_devs=() 00:16:00.619 22:53:51 -- nvmf/common.sh@294 -- # local -ga net_devs 00:16:00.619 22:53:51 -- nvmf/common.sh@295 -- # e810=() 00:16:00.619 22:53:51 -- nvmf/common.sh@295 -- # local -ga e810 00:16:00.619 22:53:51 -- nvmf/common.sh@296 -- # x722=() 00:16:00.619 22:53:51 -- nvmf/common.sh@296 -- # local -ga x722 00:16:00.619 22:53:51 -- nvmf/common.sh@297 -- # mlx=() 00:16:00.619 22:53:51 -- nvmf/common.sh@297 -- # local -ga mlx 00:16:00.619 22:53:51 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:16:00.619 22:53:51 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:16:00.619 22:53:51 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:16:00.619 22:53:51 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:16:00.619 22:53:51 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:16:00.619 22:53:51 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:16:00.619 22:53:51 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:16:00.619 22:53:51 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:16:00.619 22:53:51 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:16:00.619 22:53:51 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:16:00.619 22:53:51 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:16:00.619 22:53:51 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:16:00.619 22:53:51 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:16:00.619 22:53:51 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:16:00.619 22:53:51 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:16:00.619 22:53:51 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:16:00.619 22:53:51 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:16:00.619 22:53:51 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:16:00.619 22:53:51 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:16:00.619 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:16:00.619 22:53:51 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:16:00.619 22:53:51 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:16:00.619 22:53:51 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:16:00.619 22:53:51 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:16:00.619 22:53:51 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:16:00.619 22:53:51 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:16:00.619 22:53:51 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:16:00.619 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:16:00.619 22:53:51 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:16:00.619 22:53:51 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:16:00.619 22:53:51 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:16:00.619 22:53:51 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:16:00.619 22:53:51 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:16:00.619 22:53:51 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:16:00.619 22:53:51 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:16:00.619 22:53:51 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:16:00.619 22:53:51 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:16:00.619 22:53:51 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:16:00.619 22:53:51 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:16:00.620 22:53:51 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:16:00.620 22:53:51 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:16:00.620 Found net devices under 0000:0a:00.0: cvl_0_0 00:16:00.620 22:53:51 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:16:00.620 22:53:51 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:16:00.620 22:53:51 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:16:00.620 22:53:51 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:16:00.620 22:53:51 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:16:00.620 22:53:51 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:16:00.620 Found net devices under 0000:0a:00.1: cvl_0_1 00:16:00.620 22:53:51 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:16:00.620 22:53:51 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:16:00.620 22:53:51 -- nvmf/common.sh@402 -- # is_hw=yes 00:16:00.620 22:53:51 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:16:00.620 22:53:51 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:16:00.620 22:53:51 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:16:00.620 22:53:51 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:16:00.620 22:53:51 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:16:00.620 22:53:51 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:16:00.620 22:53:51 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:16:00.620 22:53:51 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:16:00.620 22:53:51 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:16:00.620 22:53:51 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:16:00.620 22:53:51 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:16:00.620 22:53:51 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:16:00.620 22:53:51 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:16:00.620 22:53:51 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:16:00.620 22:53:51 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:16:00.620 22:53:51 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:16:00.620 22:53:51 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:16:00.620 22:53:51 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:16:00.620 22:53:51 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:16:00.620 22:53:51 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:16:00.620 22:53:51 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:16:00.620 22:53:51 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:16:00.620 22:53:51 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:16:00.620 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:16:00.620 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.118 ms 00:16:00.620 00:16:00.620 --- 10.0.0.2 ping statistics --- 00:16:00.620 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:16:00.620 rtt min/avg/max/mdev = 0.118/0.118/0.118/0.000 ms 00:16:00.620 22:53:51 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:16:00.620 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:16:00.620 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.094 ms 00:16:00.620 00:16:00.620 --- 10.0.0.1 ping statistics --- 00:16:00.620 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:16:00.620 rtt min/avg/max/mdev = 0.094/0.094/0.094/0.000 ms 00:16:00.620 22:53:51 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:16:00.620 22:53:51 -- nvmf/common.sh@410 -- # return 0 00:16:00.620 22:53:51 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:16:00.620 22:53:51 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:16:00.620 22:53:51 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:16:00.620 22:53:51 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:16:00.620 22:53:51 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:16:00.620 22:53:51 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:16:00.620 22:53:51 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:16:00.620 22:53:51 -- target/tls.sh@72 -- # nvmfappstart -m 0x2 --wait-for-rpc 00:16:00.620 22:53:51 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:16:00.620 22:53:51 -- common/autotest_common.sh@712 -- # xtrace_disable 00:16:00.620 22:53:51 -- common/autotest_common.sh@10 -- # set +x 00:16:00.620 22:53:51 -- nvmf/common.sh@469 -- # nvmfpid=285862 00:16:00.620 22:53:51 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x2 --wait-for-rpc 00:16:00.620 22:53:51 -- nvmf/common.sh@470 -- # waitforlisten 285862 00:16:00.620 22:53:51 -- common/autotest_common.sh@819 -- # '[' -z 285862 ']' 00:16:00.620 22:53:51 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk.sock 00:16:00.620 22:53:51 -- common/autotest_common.sh@824 -- # local max_retries=100 00:16:00.620 22:53:51 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:16:00.620 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:16:00.620 22:53:51 -- common/autotest_common.sh@828 -- # xtrace_disable 00:16:00.620 22:53:51 -- common/autotest_common.sh@10 -- # set +x 00:16:00.620 [2024-04-16 22:53:51.724622] Starting SPDK v24.01.1-pre git sha1 4b134b4ab / DPDK 23.11.0 initialization... 00:16:00.620 [2024-04-16 22:53:51.724698] [ DPDK EAL parameters: nvmf -c 0x2 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:16:00.878 EAL: No free 2048 kB hugepages reported on node 1 00:16:00.878 [2024-04-16 22:53:51.791218] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:16:00.878 [2024-04-16 22:53:51.899130] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:16:00.878 [2024-04-16 22:53:51.899295] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:16:00.878 [2024-04-16 22:53:51.899314] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:16:00.878 [2024-04-16 22:53:51.899327] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:16:00.878 [2024-04-16 22:53:51.899377] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:16:00.878 22:53:51 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:16:00.878 22:53:51 -- common/autotest_common.sh@852 -- # return 0 00:16:00.878 22:53:51 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:16:00.878 22:53:51 -- common/autotest_common.sh@718 -- # xtrace_disable 00:16:00.878 22:53:51 -- common/autotest_common.sh@10 -- # set +x 00:16:00.878 22:53:51 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:16:00.878 22:53:51 -- target/tls.sh@74 -- # '[' tcp '!=' tcp ']' 00:16:00.878 22:53:51 -- target/tls.sh@79 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py sock_set_default_impl -i ssl 00:16:01.136 true 00:16:01.136 22:53:52 -- target/tls.sh@82 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py sock_impl_get_options -i ssl 00:16:01.136 22:53:52 -- target/tls.sh@82 -- # jq -r .tls_version 00:16:01.394 22:53:52 -- target/tls.sh@82 -- # version=0 00:16:01.394 22:53:52 -- target/tls.sh@83 -- # [[ 0 != \0 ]] 00:16:01.394 22:53:52 -- target/tls.sh@89 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py sock_impl_set_options -i ssl --tls-version 13 00:16:01.652 22:53:52 -- target/tls.sh@90 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py sock_impl_get_options -i ssl 00:16:01.652 22:53:52 -- target/tls.sh@90 -- # jq -r .tls_version 00:16:01.910 22:53:52 -- target/tls.sh@90 -- # version=13 00:16:01.910 22:53:52 -- target/tls.sh@91 -- # [[ 13 != \1\3 ]] 00:16:01.910 22:53:52 -- target/tls.sh@97 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py sock_impl_set_options -i ssl --tls-version 7 00:16:02.167 22:53:53 -- target/tls.sh@98 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py sock_impl_get_options -i ssl 00:16:02.167 22:53:53 -- target/tls.sh@98 -- # jq -r .tls_version 00:16:02.425 22:53:53 -- target/tls.sh@98 -- # version=7 00:16:02.425 22:53:53 -- target/tls.sh@99 -- # [[ 7 != \7 ]] 00:16:02.425 22:53:53 -- target/tls.sh@105 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py sock_impl_get_options -i ssl 00:16:02.425 22:53:53 -- target/tls.sh@105 -- # jq -r .enable_ktls 00:16:02.683 22:53:53 -- target/tls.sh@105 -- # ktls=false 00:16:02.683 22:53:53 -- target/tls.sh@106 -- # [[ false != \f\a\l\s\e ]] 00:16:02.683 22:53:53 -- target/tls.sh@112 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py sock_impl_set_options -i ssl --enable-ktls 00:16:02.940 22:53:53 -- target/tls.sh@113 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py sock_impl_get_options -i ssl 00:16:02.940 22:53:53 -- target/tls.sh@113 -- # jq -r .enable_ktls 00:16:03.198 22:53:54 -- target/tls.sh@113 -- # ktls=true 00:16:03.198 22:53:54 -- target/tls.sh@114 -- # [[ true != \t\r\u\e ]] 00:16:03.198 22:53:54 -- target/tls.sh@120 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py sock_impl_set_options -i ssl --disable-ktls 00:16:03.455 22:53:54 -- target/tls.sh@121 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py sock_impl_get_options -i ssl 00:16:03.455 22:53:54 -- target/tls.sh@121 -- # jq -r .enable_ktls 00:16:03.712 22:53:54 -- target/tls.sh@121 -- # ktls=false 00:16:03.712 22:53:54 -- target/tls.sh@122 -- # [[ false != \f\a\l\s\e ]] 00:16:03.712 22:53:54 -- target/tls.sh@127 -- # format_interchange_psk 00112233445566778899aabbccddeeff 00:16:03.712 22:53:54 -- target/tls.sh@49 -- # local key hash crc 00:16:03.712 22:53:54 -- target/tls.sh@51 -- # key=00112233445566778899aabbccddeeff 00:16:03.712 22:53:54 -- target/tls.sh@51 -- # hash=01 00:16:03.712 22:53:54 -- target/tls.sh@52 -- # echo -n 00112233445566778899aabbccddeeff 00:16:03.712 22:53:54 -- target/tls.sh@52 -- # gzip -1 -c 00:16:03.712 22:53:54 -- target/tls.sh@52 -- # tail -c8 00:16:03.712 22:53:54 -- target/tls.sh@52 -- # head -c 4 00:16:03.712 22:53:54 -- target/tls.sh@52 -- # crc='p$H�' 00:16:03.712 22:53:54 -- target/tls.sh@54 -- # base64 /dev/fd/62 00:16:03.712 22:53:54 -- target/tls.sh@54 -- # echo -n '00112233445566778899aabbccddeeffp$H�' 00:16:03.712 22:53:54 -- target/tls.sh@54 -- # echo NVMeTLSkey-1:01:MDAxMTIyMzM0NDU1NjY3Nzg4OTlhYWJiY2NkZGVlZmZwJEiQ: 00:16:03.712 22:53:54 -- target/tls.sh@127 -- # key=NVMeTLSkey-1:01:MDAxMTIyMzM0NDU1NjY3Nzg4OTlhYWJiY2NkZGVlZmZwJEiQ: 00:16:03.712 22:53:54 -- target/tls.sh@128 -- # format_interchange_psk ffeeddccbbaa99887766554433221100 00:16:03.712 22:53:54 -- target/tls.sh@49 -- # local key hash crc 00:16:03.712 22:53:54 -- target/tls.sh@51 -- # key=ffeeddccbbaa99887766554433221100 00:16:03.712 22:53:54 -- target/tls.sh@51 -- # hash=01 00:16:03.712 22:53:54 -- target/tls.sh@52 -- # echo -n ffeeddccbbaa99887766554433221100 00:16:03.712 22:53:54 -- target/tls.sh@52 -- # gzip -1 -c 00:16:03.712 22:53:54 -- target/tls.sh@52 -- # tail -c8 00:16:03.712 22:53:54 -- target/tls.sh@52 -- # head -c 4 00:16:03.712 22:53:54 -- target/tls.sh@52 -- # crc=$'_\006o\330' 00:16:03.712 22:53:54 -- target/tls.sh@54 -- # base64 /dev/fd/62 00:16:03.712 22:53:54 -- target/tls.sh@54 -- # echo -n $'ffeeddccbbaa99887766554433221100_\006o\330' 00:16:03.712 22:53:54 -- target/tls.sh@54 -- # echo NVMeTLSkey-1:01:ZmZlZWRkY2NiYmFhOTk4ODc3NjY1NTQ0MzMyMjExMDBfBm/Y: 00:16:03.712 22:53:54 -- target/tls.sh@128 -- # key_2=NVMeTLSkey-1:01:ZmZlZWRkY2NiYmFhOTk4ODc3NjY1NTQ0MzMyMjExMDBfBm/Y: 00:16:03.712 22:53:54 -- target/tls.sh@130 -- # key_path=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt 00:16:03.712 22:53:54 -- target/tls.sh@131 -- # key_2_path=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key2.txt 00:16:03.712 22:53:54 -- target/tls.sh@133 -- # echo -n NVMeTLSkey-1:01:MDAxMTIyMzM0NDU1NjY3Nzg4OTlhYWJiY2NkZGVlZmZwJEiQ: 00:16:03.712 22:53:54 -- target/tls.sh@134 -- # echo -n NVMeTLSkey-1:01:ZmZlZWRkY2NiYmFhOTk4ODc3NjY1NTQ0MzMyMjExMDBfBm/Y: 00:16:03.712 22:53:54 -- target/tls.sh@136 -- # chmod 0600 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt 00:16:03.712 22:53:54 -- target/tls.sh@137 -- # chmod 0600 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key2.txt 00:16:03.712 22:53:54 -- target/tls.sh@139 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py sock_impl_set_options -i ssl --tls-version 13 00:16:03.969 22:53:54 -- target/tls.sh@140 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py framework_start_init 00:16:04.227 22:53:55 -- target/tls.sh@142 -- # setup_nvmf_tgt /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt 00:16:04.227 22:53:55 -- target/tls.sh@58 -- # local key=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt 00:16:04.227 22:53:55 -- target/tls.sh@60 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_transport -t tcp -o 00:16:04.484 [2024-04-16 22:53:55.438793] tcp.c: 659:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:16:04.484 22:53:55 -- target/tls.sh@61 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDK00000000000001 -m 10 00:16:04.742 22:53:55 -- target/tls.sh@62 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 -k 00:16:05.000 [2024-04-16 22:53:55.948165] tcp.c: 912:nvmf_tcp_listen: *NOTICE*: TLS support is considered experimental 00:16:05.000 [2024-04-16 22:53:55.948412] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:16:05.000 22:53:55 -- target/tls.sh@64 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 32 4096 -b malloc0 00:16:05.259 malloc0 00:16:05.259 22:53:56 -- target/tls.sh@65 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 malloc0 -n 1 00:16:05.516 22:53:56 -- target/tls.sh@67 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_host nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host1 --psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt 00:16:05.774 22:53:56 -- target/tls.sh@146 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -S ssl -q 64 -o 4096 -w randrw -M 30 -t 10 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 hostnqn:nqn.2016-06.io.spdk:host1' --psk-path /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt 00:16:05.774 EAL: No free 2048 kB hugepages reported on node 1 00:16:15.733 Initializing NVMe Controllers 00:16:15.733 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:16:15.733 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 0 00:16:15.733 Initialization complete. Launching workers. 00:16:15.733 ======================================================== 00:16:15.733 Latency(us) 00:16:15.733 Device Information : IOPS MiB/s Average min max 00:16:15.733 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 0: 7555.39 29.51 8473.77 1145.55 10029.41 00:16:15.733 ======================================================== 00:16:15.733 Total : 7555.39 29.51 8473.77 1145.55 10029.41 00:16:15.733 00:16:15.733 22:54:06 -- target/tls.sh@152 -- # run_bdevperf nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt 00:16:15.733 22:54:06 -- target/tls.sh@22 -- # local subnqn hostnqn psk 00:16:15.733 22:54:06 -- target/tls.sh@23 -- # subnqn=nqn.2016-06.io.spdk:cnode1 00:16:15.733 22:54:06 -- target/tls.sh@23 -- # hostnqn=nqn.2016-06.io.spdk:host1 00:16:15.733 22:54:06 -- target/tls.sh@23 -- # psk='--psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt' 00:16:15.733 22:54:06 -- target/tls.sh@25 -- # bdevperf_rpc_sock=/var/tmp/bdevperf.sock 00:16:15.733 22:54:06 -- target/tls.sh@28 -- # bdevperf_pid=287825 00:16:15.733 22:54:06 -- target/tls.sh@27 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 0x4 -z -r /var/tmp/bdevperf.sock -q 128 -o 4096 -w verify -t 10 00:16:15.733 22:54:06 -- target/tls.sh@30 -- # trap 'cleanup; exit 1' SIGINT SIGTERM EXIT 00:16:15.733 22:54:06 -- target/tls.sh@31 -- # waitforlisten 287825 /var/tmp/bdevperf.sock 00:16:15.733 22:54:06 -- common/autotest_common.sh@819 -- # '[' -z 287825 ']' 00:16:15.733 22:54:06 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:16:15.733 22:54:06 -- common/autotest_common.sh@824 -- # local max_retries=100 00:16:15.733 22:54:06 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:16:15.733 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:16:15.733 22:54:06 -- common/autotest_common.sh@828 -- # xtrace_disable 00:16:15.733 22:54:06 -- common/autotest_common.sh@10 -- # set +x 00:16:15.733 [2024-04-16 22:54:06.825659] Starting SPDK v24.01.1-pre git sha1 4b134b4ab / DPDK 23.11.0 initialization... 00:16:15.733 [2024-04-16 22:54:06.825752] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x4 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid287825 ] 00:16:15.733 EAL: No free 2048 kB hugepages reported on node 1 00:16:15.991 [2024-04-16 22:54:06.884832] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:16:15.991 [2024-04-16 22:54:06.991092] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:16:16.921 22:54:07 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:16:16.921 22:54:07 -- common/autotest_common.sh@852 -- # return 0 00:16:16.921 22:54:07 -- target/tls.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b TLSTEST -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -q nqn.2016-06.io.spdk:host1 --psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt 00:16:16.921 [2024-04-16 22:54:08.003700] bdev_nvme_rpc.c: 477:rpc_bdev_nvme_attach_controller: *NOTICE*: TLS support is considered experimental 00:16:17.179 TLSTESTn1 00:16:17.179 22:54:08 -- target/tls.sh@41 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -t 20 -s /var/tmp/bdevperf.sock perform_tests 00:16:17.179 Running I/O for 10 seconds... 00:16:27.205 00:16:27.205 Latency(us) 00:16:27.205 Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:16:27.205 Job: TLSTESTn1 (Core Mask 0x4, workload: verify, depth: 128, IO size: 4096) 00:16:27.205 Verification LBA range: start 0x0 length 0x2000 00:16:27.205 TLSTESTn1 : 10.02 3413.00 13.33 0.00 0.00 37449.51 4538.97 47962.64 00:16:27.205 =================================================================================================================== 00:16:27.205 Total : 3413.00 13.33 0.00 0.00 37449.51 4538.97 47962.64 00:16:27.205 0 00:16:27.205 22:54:18 -- target/tls.sh@44 -- # trap 'nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:16:27.205 22:54:18 -- target/tls.sh@45 -- # killprocess 287825 00:16:27.205 22:54:18 -- common/autotest_common.sh@926 -- # '[' -z 287825 ']' 00:16:27.205 22:54:18 -- common/autotest_common.sh@930 -- # kill -0 287825 00:16:27.205 22:54:18 -- common/autotest_common.sh@931 -- # uname 00:16:27.205 22:54:18 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:16:27.205 22:54:18 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 287825 00:16:27.205 22:54:18 -- common/autotest_common.sh@932 -- # process_name=reactor_2 00:16:27.205 22:54:18 -- common/autotest_common.sh@936 -- # '[' reactor_2 = sudo ']' 00:16:27.205 22:54:18 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 287825' 00:16:27.205 killing process with pid 287825 00:16:27.205 22:54:18 -- common/autotest_common.sh@945 -- # kill 287825 00:16:27.205 Received shutdown signal, test time was about 10.000000 seconds 00:16:27.205 00:16:27.205 Latency(us) 00:16:27.205 Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:16:27.205 =================================================================================================================== 00:16:27.205 Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:16:27.205 22:54:18 -- common/autotest_common.sh@950 -- # wait 287825 00:16:27.464 22:54:18 -- target/tls.sh@155 -- # NOT run_bdevperf nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key2.txt 00:16:27.464 22:54:18 -- common/autotest_common.sh@640 -- # local es=0 00:16:27.464 22:54:18 -- common/autotest_common.sh@642 -- # valid_exec_arg run_bdevperf nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key2.txt 00:16:27.464 22:54:18 -- common/autotest_common.sh@628 -- # local arg=run_bdevperf 00:16:27.464 22:54:18 -- common/autotest_common.sh@632 -- # case "$(type -t "$arg")" in 00:16:27.464 22:54:18 -- common/autotest_common.sh@632 -- # type -t run_bdevperf 00:16:27.464 22:54:18 -- common/autotest_common.sh@632 -- # case "$(type -t "$arg")" in 00:16:27.464 22:54:18 -- common/autotest_common.sh@643 -- # run_bdevperf nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key2.txt 00:16:27.464 22:54:18 -- target/tls.sh@22 -- # local subnqn hostnqn psk 00:16:27.464 22:54:18 -- target/tls.sh@23 -- # subnqn=nqn.2016-06.io.spdk:cnode1 00:16:27.464 22:54:18 -- target/tls.sh@23 -- # hostnqn=nqn.2016-06.io.spdk:host1 00:16:27.464 22:54:18 -- target/tls.sh@23 -- # psk='--psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key2.txt' 00:16:27.464 22:54:18 -- target/tls.sh@25 -- # bdevperf_rpc_sock=/var/tmp/bdevperf.sock 00:16:27.464 22:54:18 -- target/tls.sh@28 -- # bdevperf_pid=289700 00:16:27.464 22:54:18 -- target/tls.sh@27 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 0x4 -z -r /var/tmp/bdevperf.sock -q 128 -o 4096 -w verify -t 10 00:16:27.464 22:54:18 -- target/tls.sh@30 -- # trap 'cleanup; exit 1' SIGINT SIGTERM EXIT 00:16:27.464 22:54:18 -- target/tls.sh@31 -- # waitforlisten 289700 /var/tmp/bdevperf.sock 00:16:27.464 22:54:18 -- common/autotest_common.sh@819 -- # '[' -z 289700 ']' 00:16:27.464 22:54:18 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:16:27.464 22:54:18 -- common/autotest_common.sh@824 -- # local max_retries=100 00:16:27.464 22:54:18 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:16:27.464 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:16:27.464 22:54:18 -- common/autotest_common.sh@828 -- # xtrace_disable 00:16:27.464 22:54:18 -- common/autotest_common.sh@10 -- # set +x 00:16:27.464 [2024-04-16 22:54:18.584785] Starting SPDK v24.01.1-pre git sha1 4b134b4ab / DPDK 23.11.0 initialization... 00:16:27.464 [2024-04-16 22:54:18.584881] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x4 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid289700 ] 00:16:27.721 EAL: No free 2048 kB hugepages reported on node 1 00:16:27.721 [2024-04-16 22:54:18.643353] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:16:27.721 [2024-04-16 22:54:18.752357] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:16:28.654 22:54:19 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:16:28.654 22:54:19 -- common/autotest_common.sh@852 -- # return 0 00:16:28.654 22:54:19 -- target/tls.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b TLSTEST -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -q nqn.2016-06.io.spdk:host1 --psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key2.txt 00:16:28.912 [2024-04-16 22:54:19.813328] bdev_nvme_rpc.c: 477:rpc_bdev_nvme_attach_controller: *NOTICE*: TLS support is considered experimental 00:16:28.912 [2024-04-16 22:54:19.821327] /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/include/spdk_internal/nvme_tcp.h: 428:nvme_tcp_read_data: *ERROR*: spdk_sock_recv() failed, errno 107: Transport endpoint is not connected 00:16:28.912 [2024-04-16 22:54:19.821404] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xa0f870 (107): Transport endpoint is not connected 00:16:28.912 [2024-04-16 22:54:19.822379] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xa0f870 (9): Bad file descriptor 00:16:28.912 [2024-04-16 22:54:19.823377] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:16:28.912 [2024-04-16 22:54:19.823398] nvme.c: 708:nvme_ctrlr_poll_internal: *ERROR*: Failed to initialize SSD: 10.0.0.2 00:16:28.912 [2024-04-16 22:54:19.823414] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:16:28.912 request: 00:16:28.912 { 00:16:28.912 "name": "TLSTEST", 00:16:28.912 "trtype": "tcp", 00:16:28.912 "traddr": "10.0.0.2", 00:16:28.912 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:16:28.912 "adrfam": "ipv4", 00:16:28.912 "trsvcid": "4420", 00:16:28.912 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:16:28.912 "psk": "/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key2.txt", 00:16:28.912 "method": "bdev_nvme_attach_controller", 00:16:28.912 "req_id": 1 00:16:28.912 } 00:16:28.912 Got JSON-RPC error response 00:16:28.912 response: 00:16:28.912 { 00:16:28.912 "code": -32602, 00:16:28.912 "message": "Invalid parameters" 00:16:28.912 } 00:16:28.912 22:54:19 -- target/tls.sh@36 -- # killprocess 289700 00:16:28.912 22:54:19 -- common/autotest_common.sh@926 -- # '[' -z 289700 ']' 00:16:28.912 22:54:19 -- common/autotest_common.sh@930 -- # kill -0 289700 00:16:28.912 22:54:19 -- common/autotest_common.sh@931 -- # uname 00:16:28.912 22:54:19 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:16:28.912 22:54:19 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 289700 00:16:28.912 22:54:19 -- common/autotest_common.sh@932 -- # process_name=reactor_2 00:16:28.912 22:54:19 -- common/autotest_common.sh@936 -- # '[' reactor_2 = sudo ']' 00:16:28.912 22:54:19 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 289700' 00:16:28.912 killing process with pid 289700 00:16:28.912 22:54:19 -- common/autotest_common.sh@945 -- # kill 289700 00:16:28.912 Received shutdown signal, test time was about 10.000000 seconds 00:16:28.912 00:16:28.912 Latency(us) 00:16:28.912 Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:16:28.912 =================================================================================================================== 00:16:28.912 Total : 0.00 0.00 0.00 0.00 0.00 18446744073709551616.00 0.00 00:16:28.912 22:54:19 -- common/autotest_common.sh@950 -- # wait 289700 00:16:29.170 22:54:20 -- target/tls.sh@37 -- # return 1 00:16:29.170 22:54:20 -- common/autotest_common.sh@643 -- # es=1 00:16:29.170 22:54:20 -- common/autotest_common.sh@651 -- # (( es > 128 )) 00:16:29.170 22:54:20 -- common/autotest_common.sh@662 -- # [[ -n '' ]] 00:16:29.170 22:54:20 -- common/autotest_common.sh@667 -- # (( !es == 0 )) 00:16:29.170 22:54:20 -- target/tls.sh@158 -- # NOT run_bdevperf nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host2 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt 00:16:29.170 22:54:20 -- common/autotest_common.sh@640 -- # local es=0 00:16:29.170 22:54:20 -- common/autotest_common.sh@642 -- # valid_exec_arg run_bdevperf nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host2 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt 00:16:29.170 22:54:20 -- common/autotest_common.sh@628 -- # local arg=run_bdevperf 00:16:29.170 22:54:20 -- common/autotest_common.sh@632 -- # case "$(type -t "$arg")" in 00:16:29.170 22:54:20 -- common/autotest_common.sh@632 -- # type -t run_bdevperf 00:16:29.170 22:54:20 -- common/autotest_common.sh@632 -- # case "$(type -t "$arg")" in 00:16:29.170 22:54:20 -- common/autotest_common.sh@643 -- # run_bdevperf nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host2 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt 00:16:29.170 22:54:20 -- target/tls.sh@22 -- # local subnqn hostnqn psk 00:16:29.170 22:54:20 -- target/tls.sh@23 -- # subnqn=nqn.2016-06.io.spdk:cnode1 00:16:29.170 22:54:20 -- target/tls.sh@23 -- # hostnqn=nqn.2016-06.io.spdk:host2 00:16:29.170 22:54:20 -- target/tls.sh@23 -- # psk='--psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt' 00:16:29.170 22:54:20 -- target/tls.sh@25 -- # bdevperf_rpc_sock=/var/tmp/bdevperf.sock 00:16:29.170 22:54:20 -- target/tls.sh@28 -- # bdevperf_pid=289974 00:16:29.171 22:54:20 -- target/tls.sh@27 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 0x4 -z -r /var/tmp/bdevperf.sock -q 128 -o 4096 -w verify -t 10 00:16:29.171 22:54:20 -- target/tls.sh@30 -- # trap 'cleanup; exit 1' SIGINT SIGTERM EXIT 00:16:29.171 22:54:20 -- target/tls.sh@31 -- # waitforlisten 289974 /var/tmp/bdevperf.sock 00:16:29.171 22:54:20 -- common/autotest_common.sh@819 -- # '[' -z 289974 ']' 00:16:29.171 22:54:20 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:16:29.171 22:54:20 -- common/autotest_common.sh@824 -- # local max_retries=100 00:16:29.171 22:54:20 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:16:29.171 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:16:29.171 22:54:20 -- common/autotest_common.sh@828 -- # xtrace_disable 00:16:29.171 22:54:20 -- common/autotest_common.sh@10 -- # set +x 00:16:29.171 [2024-04-16 22:54:20.154255] Starting SPDK v24.01.1-pre git sha1 4b134b4ab / DPDK 23.11.0 initialization... 00:16:29.171 [2024-04-16 22:54:20.154344] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x4 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid289974 ] 00:16:29.171 EAL: No free 2048 kB hugepages reported on node 1 00:16:29.171 [2024-04-16 22:54:20.218100] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:16:29.429 [2024-04-16 22:54:20.326206] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:16:30.361 22:54:21 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:16:30.361 22:54:21 -- common/autotest_common.sh@852 -- # return 0 00:16:30.361 22:54:21 -- target/tls.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b TLSTEST -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -q nqn.2016-06.io.spdk:host2 --psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt 00:16:30.361 [2024-04-16 22:54:21.373035] bdev_nvme_rpc.c: 477:rpc_bdev_nvme_attach_controller: *NOTICE*: TLS support is considered experimental 00:16:30.361 [2024-04-16 22:54:21.378327] tcp.c: 866:tcp_sock_get_key: *ERROR*: Could not find PSK for identity: NVMe0R01 nqn.2016-06.io.spdk:host2 nqn.2016-06.io.spdk:cnode1 00:16:30.361 [2024-04-16 22:54:21.378360] posix.c: 583:posix_sock_psk_find_session_server_cb: *ERROR*: Unable to find PSK for identity: NVMe0R01 nqn.2016-06.io.spdk:host2 nqn.2016-06.io.spdk:cnode1 00:16:30.361 [2024-04-16 22:54:21.378398] /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/include/spdk_internal/nvme_tcp.h: 428:nvme_tcp_read_data: *ERROR*: spdk_sock_recv() failed, errno 107: Transport endpoint is not connected 00:16:30.361 [2024-04-16 22:54:21.378922] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x871870 (107): Transport endpoint is not connected 00:16:30.361 [2024-04-16 22:54:21.379909] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x871870 (9): Bad file descriptor 00:16:30.361 [2024-04-16 22:54:21.380908] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:16:30.361 [2024-04-16 22:54:21.380934] nvme.c: 708:nvme_ctrlr_poll_internal: *ERROR*: Failed to initialize SSD: 10.0.0.2 00:16:30.361 [2024-04-16 22:54:21.380950] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:16:30.361 request: 00:16:30.361 { 00:16:30.361 "name": "TLSTEST", 00:16:30.361 "trtype": "tcp", 00:16:30.361 "traddr": "10.0.0.2", 00:16:30.361 "hostnqn": "nqn.2016-06.io.spdk:host2", 00:16:30.361 "adrfam": "ipv4", 00:16:30.361 "trsvcid": "4420", 00:16:30.361 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:16:30.361 "psk": "/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt", 00:16:30.361 "method": "bdev_nvme_attach_controller", 00:16:30.361 "req_id": 1 00:16:30.361 } 00:16:30.361 Got JSON-RPC error response 00:16:30.361 response: 00:16:30.361 { 00:16:30.361 "code": -32602, 00:16:30.361 "message": "Invalid parameters" 00:16:30.361 } 00:16:30.361 22:54:21 -- target/tls.sh@36 -- # killprocess 289974 00:16:30.361 22:54:21 -- common/autotest_common.sh@926 -- # '[' -z 289974 ']' 00:16:30.361 22:54:21 -- common/autotest_common.sh@930 -- # kill -0 289974 00:16:30.361 22:54:21 -- common/autotest_common.sh@931 -- # uname 00:16:30.361 22:54:21 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:16:30.361 22:54:21 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 289974 00:16:30.361 22:54:21 -- common/autotest_common.sh@932 -- # process_name=reactor_2 00:16:30.361 22:54:21 -- common/autotest_common.sh@936 -- # '[' reactor_2 = sudo ']' 00:16:30.361 22:54:21 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 289974' 00:16:30.361 killing process with pid 289974 00:16:30.361 22:54:21 -- common/autotest_common.sh@945 -- # kill 289974 00:16:30.361 Received shutdown signal, test time was about 10.000000 seconds 00:16:30.361 00:16:30.361 Latency(us) 00:16:30.361 Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:16:30.361 =================================================================================================================== 00:16:30.361 Total : 0.00 0.00 0.00 0.00 0.00 18446744073709551616.00 0.00 00:16:30.361 22:54:21 -- common/autotest_common.sh@950 -- # wait 289974 00:16:30.619 22:54:21 -- target/tls.sh@37 -- # return 1 00:16:30.619 22:54:21 -- common/autotest_common.sh@643 -- # es=1 00:16:30.620 22:54:21 -- common/autotest_common.sh@651 -- # (( es > 128 )) 00:16:30.620 22:54:21 -- common/autotest_common.sh@662 -- # [[ -n '' ]] 00:16:30.620 22:54:21 -- common/autotest_common.sh@667 -- # (( !es == 0 )) 00:16:30.620 22:54:21 -- target/tls.sh@161 -- # NOT run_bdevperf nqn.2016-06.io.spdk:cnode2 nqn.2016-06.io.spdk:host1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt 00:16:30.620 22:54:21 -- common/autotest_common.sh@640 -- # local es=0 00:16:30.620 22:54:21 -- common/autotest_common.sh@642 -- # valid_exec_arg run_bdevperf nqn.2016-06.io.spdk:cnode2 nqn.2016-06.io.spdk:host1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt 00:16:30.620 22:54:21 -- common/autotest_common.sh@628 -- # local arg=run_bdevperf 00:16:30.620 22:54:21 -- common/autotest_common.sh@632 -- # case "$(type -t "$arg")" in 00:16:30.620 22:54:21 -- common/autotest_common.sh@632 -- # type -t run_bdevperf 00:16:30.620 22:54:21 -- common/autotest_common.sh@632 -- # case "$(type -t "$arg")" in 00:16:30.620 22:54:21 -- common/autotest_common.sh@643 -- # run_bdevperf nqn.2016-06.io.spdk:cnode2 nqn.2016-06.io.spdk:host1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt 00:16:30.620 22:54:21 -- target/tls.sh@22 -- # local subnqn hostnqn psk 00:16:30.620 22:54:21 -- target/tls.sh@23 -- # subnqn=nqn.2016-06.io.spdk:cnode2 00:16:30.620 22:54:21 -- target/tls.sh@23 -- # hostnqn=nqn.2016-06.io.spdk:host1 00:16:30.620 22:54:21 -- target/tls.sh@23 -- # psk='--psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt' 00:16:30.620 22:54:21 -- target/tls.sh@25 -- # bdevperf_rpc_sock=/var/tmp/bdevperf.sock 00:16:30.620 22:54:21 -- target/tls.sh@28 -- # bdevperf_pid=290125 00:16:30.620 22:54:21 -- target/tls.sh@27 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 0x4 -z -r /var/tmp/bdevperf.sock -q 128 -o 4096 -w verify -t 10 00:16:30.620 22:54:21 -- target/tls.sh@30 -- # trap 'cleanup; exit 1' SIGINT SIGTERM EXIT 00:16:30.620 22:54:21 -- target/tls.sh@31 -- # waitforlisten 290125 /var/tmp/bdevperf.sock 00:16:30.620 22:54:21 -- common/autotest_common.sh@819 -- # '[' -z 290125 ']' 00:16:30.620 22:54:21 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:16:30.620 22:54:21 -- common/autotest_common.sh@824 -- # local max_retries=100 00:16:30.620 22:54:21 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:16:30.620 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:16:30.620 22:54:21 -- common/autotest_common.sh@828 -- # xtrace_disable 00:16:30.620 22:54:21 -- common/autotest_common.sh@10 -- # set +x 00:16:30.620 [2024-04-16 22:54:21.705119] Starting SPDK v24.01.1-pre git sha1 4b134b4ab / DPDK 23.11.0 initialization... 00:16:30.620 [2024-04-16 22:54:21.705251] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x4 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid290125 ] 00:16:30.620 EAL: No free 2048 kB hugepages reported on node 1 00:16:30.878 [2024-04-16 22:54:21.764824] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:16:30.878 [2024-04-16 22:54:21.871049] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:16:31.809 22:54:22 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:16:31.809 22:54:22 -- common/autotest_common.sh@852 -- # return 0 00:16:31.809 22:54:22 -- target/tls.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b TLSTEST -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode2 -q nqn.2016-06.io.spdk:host1 --psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt 00:16:31.809 [2024-04-16 22:54:22.912000] bdev_nvme_rpc.c: 477:rpc_bdev_nvme_attach_controller: *NOTICE*: TLS support is considered experimental 00:16:31.809 [2024-04-16 22:54:22.919173] tcp.c: 866:tcp_sock_get_key: *ERROR*: Could not find PSK for identity: NVMe0R01 nqn.2016-06.io.spdk:host1 nqn.2016-06.io.spdk:cnode2 00:16:31.809 [2024-04-16 22:54:22.919225] posix.c: 583:posix_sock_psk_find_session_server_cb: *ERROR*: Unable to find PSK for identity: NVMe0R01 nqn.2016-06.io.spdk:host1 nqn.2016-06.io.spdk:cnode2 00:16:31.809 [2024-04-16 22:54:22.919322] /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/include/spdk_internal/nvme_tcp.h: 428:nvme_tcp_read_data: *ERROR*: spdk_sock_recv() failed, errno 107: Transport endpoint is not connected 00:16:31.809 [2024-04-16 22:54:22.919876] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x22cc870 (107): Transport endpoint is not connected 00:16:31.809 [2024-04-16 22:54:22.920867] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x22cc870 (9): Bad file descriptor 00:16:31.809 [2024-04-16 22:54:22.921866] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode2] Ctrlr is in error state 00:16:31.809 [2024-04-16 22:54:22.921886] nvme.c: 708:nvme_ctrlr_poll_internal: *ERROR*: Failed to initialize SSD: 10.0.0.2 00:16:31.809 [2024-04-16 22:54:22.921902] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode2] in failed state. 00:16:31.809 request: 00:16:31.809 { 00:16:31.809 "name": "TLSTEST", 00:16:31.809 "trtype": "tcp", 00:16:31.809 "traddr": "10.0.0.2", 00:16:31.809 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:16:31.809 "adrfam": "ipv4", 00:16:31.809 "trsvcid": "4420", 00:16:31.809 "subnqn": "nqn.2016-06.io.spdk:cnode2", 00:16:31.809 "psk": "/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt", 00:16:31.809 "method": "bdev_nvme_attach_controller", 00:16:31.809 "req_id": 1 00:16:31.809 } 00:16:31.809 Got JSON-RPC error response 00:16:31.809 response: 00:16:31.809 { 00:16:31.809 "code": -32602, 00:16:31.809 "message": "Invalid parameters" 00:16:31.809 } 00:16:32.066 22:54:22 -- target/tls.sh@36 -- # killprocess 290125 00:16:32.066 22:54:22 -- common/autotest_common.sh@926 -- # '[' -z 290125 ']' 00:16:32.066 22:54:22 -- common/autotest_common.sh@930 -- # kill -0 290125 00:16:32.066 22:54:22 -- common/autotest_common.sh@931 -- # uname 00:16:32.066 22:54:22 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:16:32.066 22:54:22 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 290125 00:16:32.066 22:54:22 -- common/autotest_common.sh@932 -- # process_name=reactor_2 00:16:32.066 22:54:22 -- common/autotest_common.sh@936 -- # '[' reactor_2 = sudo ']' 00:16:32.066 22:54:22 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 290125' 00:16:32.066 killing process with pid 290125 00:16:32.066 22:54:22 -- common/autotest_common.sh@945 -- # kill 290125 00:16:32.066 Received shutdown signal, test time was about 10.000000 seconds 00:16:32.066 00:16:32.066 Latency(us) 00:16:32.067 Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:16:32.067 =================================================================================================================== 00:16:32.067 Total : 0.00 0.00 0.00 0.00 0.00 18446744073709551616.00 0.00 00:16:32.067 22:54:22 -- common/autotest_common.sh@950 -- # wait 290125 00:16:32.325 22:54:23 -- target/tls.sh@37 -- # return 1 00:16:32.325 22:54:23 -- common/autotest_common.sh@643 -- # es=1 00:16:32.325 22:54:23 -- common/autotest_common.sh@651 -- # (( es > 128 )) 00:16:32.325 22:54:23 -- common/autotest_common.sh@662 -- # [[ -n '' ]] 00:16:32.325 22:54:23 -- common/autotest_common.sh@667 -- # (( !es == 0 )) 00:16:32.325 22:54:23 -- target/tls.sh@164 -- # NOT run_bdevperf nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host1 '' 00:16:32.325 22:54:23 -- common/autotest_common.sh@640 -- # local es=0 00:16:32.325 22:54:23 -- common/autotest_common.sh@642 -- # valid_exec_arg run_bdevperf nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host1 '' 00:16:32.325 22:54:23 -- common/autotest_common.sh@628 -- # local arg=run_bdevperf 00:16:32.325 22:54:23 -- common/autotest_common.sh@632 -- # case "$(type -t "$arg")" in 00:16:32.325 22:54:23 -- common/autotest_common.sh@632 -- # type -t run_bdevperf 00:16:32.325 22:54:23 -- common/autotest_common.sh@632 -- # case "$(type -t "$arg")" in 00:16:32.325 22:54:23 -- common/autotest_common.sh@643 -- # run_bdevperf nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host1 '' 00:16:32.325 22:54:23 -- target/tls.sh@22 -- # local subnqn hostnqn psk 00:16:32.325 22:54:23 -- target/tls.sh@23 -- # subnqn=nqn.2016-06.io.spdk:cnode1 00:16:32.325 22:54:23 -- target/tls.sh@23 -- # hostnqn=nqn.2016-06.io.spdk:host1 00:16:32.325 22:54:23 -- target/tls.sh@23 -- # psk= 00:16:32.325 22:54:23 -- target/tls.sh@25 -- # bdevperf_rpc_sock=/var/tmp/bdevperf.sock 00:16:32.325 22:54:23 -- target/tls.sh@28 -- # bdevperf_pid=290288 00:16:32.325 22:54:23 -- target/tls.sh@27 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 0x4 -z -r /var/tmp/bdevperf.sock -q 128 -o 4096 -w verify -t 10 00:16:32.325 22:54:23 -- target/tls.sh@30 -- # trap 'cleanup; exit 1' SIGINT SIGTERM EXIT 00:16:32.325 22:54:23 -- target/tls.sh@31 -- # waitforlisten 290288 /var/tmp/bdevperf.sock 00:16:32.325 22:54:23 -- common/autotest_common.sh@819 -- # '[' -z 290288 ']' 00:16:32.325 22:54:23 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:16:32.325 22:54:23 -- common/autotest_common.sh@824 -- # local max_retries=100 00:16:32.325 22:54:23 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:16:32.325 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:16:32.325 22:54:23 -- common/autotest_common.sh@828 -- # xtrace_disable 00:16:32.325 22:54:23 -- common/autotest_common.sh@10 -- # set +x 00:16:32.325 [2024-04-16 22:54:23.240953] Starting SPDK v24.01.1-pre git sha1 4b134b4ab / DPDK 23.11.0 initialization... 00:16:32.325 [2024-04-16 22:54:23.241049] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x4 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid290288 ] 00:16:32.325 EAL: No free 2048 kB hugepages reported on node 1 00:16:32.325 [2024-04-16 22:54:23.305410] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:16:32.325 [2024-04-16 22:54:23.409815] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:16:33.261 22:54:24 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:16:33.261 22:54:24 -- common/autotest_common.sh@852 -- # return 0 00:16:33.261 22:54:24 -- target/tls.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b TLSTEST -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -q nqn.2016-06.io.spdk:host1 00:16:33.521 [2024-04-16 22:54:24.473308] /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/include/spdk_internal/nvme_tcp.h: 428:nvme_tcp_read_data: *ERROR*: spdk_sock_recv() failed, errno 107: Transport endpoint is not connected 00:16:33.521 [2024-04-16 22:54:24.474808] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x16b4330 (9): Bad file descriptor 00:16:33.521 [2024-04-16 22:54:24.475803] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:16:33.521 [2024-04-16 22:54:24.475824] nvme.c: 708:nvme_ctrlr_poll_internal: *ERROR*: Failed to initialize SSD: 10.0.0.2 00:16:33.521 [2024-04-16 22:54:24.475840] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:16:33.521 request: 00:16:33.521 { 00:16:33.521 "name": "TLSTEST", 00:16:33.521 "trtype": "tcp", 00:16:33.521 "traddr": "10.0.0.2", 00:16:33.521 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:16:33.521 "adrfam": "ipv4", 00:16:33.521 "trsvcid": "4420", 00:16:33.521 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:16:33.521 "method": "bdev_nvme_attach_controller", 00:16:33.521 "req_id": 1 00:16:33.521 } 00:16:33.521 Got JSON-RPC error response 00:16:33.521 response: 00:16:33.521 { 00:16:33.521 "code": -32602, 00:16:33.521 "message": "Invalid parameters" 00:16:33.521 } 00:16:33.521 22:54:24 -- target/tls.sh@36 -- # killprocess 290288 00:16:33.521 22:54:24 -- common/autotest_common.sh@926 -- # '[' -z 290288 ']' 00:16:33.521 22:54:24 -- common/autotest_common.sh@930 -- # kill -0 290288 00:16:33.521 22:54:24 -- common/autotest_common.sh@931 -- # uname 00:16:33.521 22:54:24 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:16:33.521 22:54:24 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 290288 00:16:33.521 22:54:24 -- common/autotest_common.sh@932 -- # process_name=reactor_2 00:16:33.522 22:54:24 -- common/autotest_common.sh@936 -- # '[' reactor_2 = sudo ']' 00:16:33.522 22:54:24 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 290288' 00:16:33.522 killing process with pid 290288 00:16:33.522 22:54:24 -- common/autotest_common.sh@945 -- # kill 290288 00:16:33.522 Received shutdown signal, test time was about 10.000000 seconds 00:16:33.522 00:16:33.522 Latency(us) 00:16:33.522 Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:16:33.522 =================================================================================================================== 00:16:33.522 Total : 0.00 0.00 0.00 0.00 0.00 18446744073709551616.00 0.00 00:16:33.522 22:54:24 -- common/autotest_common.sh@950 -- # wait 290288 00:16:33.779 22:54:24 -- target/tls.sh@37 -- # return 1 00:16:33.779 22:54:24 -- common/autotest_common.sh@643 -- # es=1 00:16:33.779 22:54:24 -- common/autotest_common.sh@651 -- # (( es > 128 )) 00:16:33.779 22:54:24 -- common/autotest_common.sh@662 -- # [[ -n '' ]] 00:16:33.779 22:54:24 -- common/autotest_common.sh@667 -- # (( !es == 0 )) 00:16:33.779 22:54:24 -- target/tls.sh@167 -- # killprocess 285862 00:16:33.779 22:54:24 -- common/autotest_common.sh@926 -- # '[' -z 285862 ']' 00:16:33.779 22:54:24 -- common/autotest_common.sh@930 -- # kill -0 285862 00:16:33.779 22:54:24 -- common/autotest_common.sh@931 -- # uname 00:16:33.779 22:54:24 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:16:33.779 22:54:24 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 285862 00:16:33.779 22:54:24 -- common/autotest_common.sh@932 -- # process_name=reactor_1 00:16:33.779 22:54:24 -- common/autotest_common.sh@936 -- # '[' reactor_1 = sudo ']' 00:16:33.779 22:54:24 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 285862' 00:16:33.779 killing process with pid 285862 00:16:33.779 22:54:24 -- common/autotest_common.sh@945 -- # kill 285862 00:16:33.779 22:54:24 -- common/autotest_common.sh@950 -- # wait 285862 00:16:34.037 22:54:25 -- target/tls.sh@168 -- # format_interchange_psk 00112233445566778899aabbccddeeff0011223344556677 02 00:16:34.037 22:54:25 -- target/tls.sh@49 -- # local key hash crc 00:16:34.037 22:54:25 -- target/tls.sh@51 -- # key=00112233445566778899aabbccddeeff0011223344556677 00:16:34.037 22:54:25 -- target/tls.sh@51 -- # hash=02 00:16:34.037 22:54:25 -- target/tls.sh@52 -- # echo -n 00112233445566778899aabbccddeeff0011223344556677 00:16:34.037 22:54:25 -- target/tls.sh@52 -- # gzip -1 -c 00:16:34.037 22:54:25 -- target/tls.sh@52 -- # tail -c8 00:16:34.037 22:54:25 -- target/tls.sh@52 -- # head -c 4 00:16:34.037 22:54:25 -- target/tls.sh@52 -- # crc='�e�'\''' 00:16:34.037 22:54:25 -- target/tls.sh@54 -- # base64 /dev/fd/62 00:16:34.037 22:54:25 -- target/tls.sh@54 -- # echo -n '00112233445566778899aabbccddeeff0011223344556677�e�'\''' 00:16:34.037 22:54:25 -- target/tls.sh@54 -- # echo NVMeTLSkey-1:02:MDAxMTIyMzM0NDU1NjY3Nzg4OTlhYWJiY2NkZGVlZmYwMDExMjIzMzQ0NTU2Njc3wWXNJw==: 00:16:34.037 22:54:25 -- target/tls.sh@168 -- # key_long=NVMeTLSkey-1:02:MDAxMTIyMzM0NDU1NjY3Nzg4OTlhYWJiY2NkZGVlZmYwMDExMjIzMzQ0NTU2Njc3wWXNJw==: 00:16:34.037 22:54:25 -- target/tls.sh@169 -- # key_long_path=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:16:34.037 22:54:25 -- target/tls.sh@170 -- # echo -n NVMeTLSkey-1:02:MDAxMTIyMzM0NDU1NjY3Nzg4OTlhYWJiY2NkZGVlZmYwMDExMjIzMzQ0NTU2Njc3wWXNJw==: 00:16:34.037 22:54:25 -- target/tls.sh@171 -- # chmod 0600 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:16:34.037 22:54:25 -- target/tls.sh@172 -- # nvmfappstart -m 0x2 00:16:34.037 22:54:25 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:16:34.037 22:54:25 -- common/autotest_common.sh@712 -- # xtrace_disable 00:16:34.037 22:54:25 -- common/autotest_common.sh@10 -- # set +x 00:16:34.037 22:54:25 -- nvmf/common.sh@469 -- # nvmfpid=290572 00:16:34.037 22:54:25 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x2 00:16:34.037 22:54:25 -- nvmf/common.sh@470 -- # waitforlisten 290572 00:16:34.037 22:54:25 -- common/autotest_common.sh@819 -- # '[' -z 290572 ']' 00:16:34.037 22:54:25 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk.sock 00:16:34.037 22:54:25 -- common/autotest_common.sh@824 -- # local max_retries=100 00:16:34.037 22:54:25 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:16:34.037 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:16:34.037 22:54:25 -- common/autotest_common.sh@828 -- # xtrace_disable 00:16:34.037 22:54:25 -- common/autotest_common.sh@10 -- # set +x 00:16:34.037 [2024-04-16 22:54:25.154943] Starting SPDK v24.01.1-pre git sha1 4b134b4ab / DPDK 23.11.0 initialization... 00:16:34.037 [2024-04-16 22:54:25.155018] [ DPDK EAL parameters: nvmf -c 0x2 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:16:34.295 EAL: No free 2048 kB hugepages reported on node 1 00:16:34.295 [2024-04-16 22:54:25.222561] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:16:34.295 [2024-04-16 22:54:25.340868] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:16:34.295 [2024-04-16 22:54:25.341028] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:16:34.295 [2024-04-16 22:54:25.341047] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:16:34.295 [2024-04-16 22:54:25.341061] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:16:34.295 [2024-04-16 22:54:25.341092] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:16:35.229 22:54:26 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:16:35.229 22:54:26 -- common/autotest_common.sh@852 -- # return 0 00:16:35.229 22:54:26 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:16:35.229 22:54:26 -- common/autotest_common.sh@718 -- # xtrace_disable 00:16:35.229 22:54:26 -- common/autotest_common.sh@10 -- # set +x 00:16:35.229 22:54:26 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:16:35.229 22:54:26 -- target/tls.sh@174 -- # setup_nvmf_tgt /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:16:35.229 22:54:26 -- target/tls.sh@58 -- # local key=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:16:35.229 22:54:26 -- target/tls.sh@60 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_transport -t tcp -o 00:16:35.486 [2024-04-16 22:54:26.371071] tcp.c: 659:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:16:35.487 22:54:26 -- target/tls.sh@61 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDK00000000000001 -m 10 00:16:35.744 22:54:26 -- target/tls.sh@62 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 -k 00:16:35.744 [2024-04-16 22:54:26.852410] tcp.c: 912:nvmf_tcp_listen: *NOTICE*: TLS support is considered experimental 00:16:35.744 [2024-04-16 22:54:26.852645] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:16:35.744 22:54:26 -- target/tls.sh@64 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 32 4096 -b malloc0 00:16:36.002 malloc0 00:16:36.002 22:54:27 -- target/tls.sh@65 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 malloc0 -n 1 00:16:36.261 22:54:27 -- target/tls.sh@67 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_host nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host1 --psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:16:36.519 22:54:27 -- target/tls.sh@176 -- # run_bdevperf nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:16:36.519 22:54:27 -- target/tls.sh@22 -- # local subnqn hostnqn psk 00:16:36.519 22:54:27 -- target/tls.sh@23 -- # subnqn=nqn.2016-06.io.spdk:cnode1 00:16:36.519 22:54:27 -- target/tls.sh@23 -- # hostnqn=nqn.2016-06.io.spdk:host1 00:16:36.519 22:54:27 -- target/tls.sh@23 -- # psk='--psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt' 00:16:36.519 22:54:27 -- target/tls.sh@25 -- # bdevperf_rpc_sock=/var/tmp/bdevperf.sock 00:16:36.519 22:54:27 -- target/tls.sh@28 -- # bdevperf_pid=290870 00:16:36.519 22:54:27 -- target/tls.sh@27 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 0x4 -z -r /var/tmp/bdevperf.sock -q 128 -o 4096 -w verify -t 10 00:16:36.519 22:54:27 -- target/tls.sh@30 -- # trap 'cleanup; exit 1' SIGINT SIGTERM EXIT 00:16:36.519 22:54:27 -- target/tls.sh@31 -- # waitforlisten 290870 /var/tmp/bdevperf.sock 00:16:36.519 22:54:27 -- common/autotest_common.sh@819 -- # '[' -z 290870 ']' 00:16:36.519 22:54:27 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:16:36.519 22:54:27 -- common/autotest_common.sh@824 -- # local max_retries=100 00:16:36.519 22:54:27 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:16:36.519 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:16:36.519 22:54:27 -- common/autotest_common.sh@828 -- # xtrace_disable 00:16:36.519 22:54:27 -- common/autotest_common.sh@10 -- # set +x 00:16:36.519 [2024-04-16 22:54:27.634883] Starting SPDK v24.01.1-pre git sha1 4b134b4ab / DPDK 23.11.0 initialization... 00:16:36.519 [2024-04-16 22:54:27.634951] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x4 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid290870 ] 00:16:36.777 EAL: No free 2048 kB hugepages reported on node 1 00:16:36.777 [2024-04-16 22:54:27.692022] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:16:36.777 [2024-04-16 22:54:27.805074] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:16:37.711 22:54:28 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:16:37.711 22:54:28 -- common/autotest_common.sh@852 -- # return 0 00:16:37.711 22:54:28 -- target/tls.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b TLSTEST -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -q nqn.2016-06.io.spdk:host1 --psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:16:37.711 [2024-04-16 22:54:28.818891] bdev_nvme_rpc.c: 477:rpc_bdev_nvme_attach_controller: *NOTICE*: TLS support is considered experimental 00:16:37.968 TLSTESTn1 00:16:37.968 22:54:28 -- target/tls.sh@41 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -t 20 -s /var/tmp/bdevperf.sock perform_tests 00:16:37.968 Running I/O for 10 seconds... 00:16:47.983 00:16:47.983 Latency(us) 00:16:47.983 Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:16:47.983 Job: TLSTESTn1 (Core Mask 0x4, workload: verify, depth: 128, IO size: 4096) 00:16:47.983 Verification LBA range: start 0x0 length 0x2000 00:16:47.983 TLSTESTn1 : 10.02 3423.08 13.37 0.00 0.00 37342.87 6505.05 47768.46 00:16:47.983 =================================================================================================================== 00:16:47.983 Total : 3423.08 13.37 0.00 0.00 37342.87 6505.05 47768.46 00:16:47.983 0 00:16:47.983 22:54:39 -- target/tls.sh@44 -- # trap 'nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:16:47.983 22:54:39 -- target/tls.sh@45 -- # killprocess 290870 00:16:47.983 22:54:39 -- common/autotest_common.sh@926 -- # '[' -z 290870 ']' 00:16:47.983 22:54:39 -- common/autotest_common.sh@930 -- # kill -0 290870 00:16:47.983 22:54:39 -- common/autotest_common.sh@931 -- # uname 00:16:47.983 22:54:39 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:16:47.983 22:54:39 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 290870 00:16:48.241 22:54:39 -- common/autotest_common.sh@932 -- # process_name=reactor_2 00:16:48.241 22:54:39 -- common/autotest_common.sh@936 -- # '[' reactor_2 = sudo ']' 00:16:48.241 22:54:39 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 290870' 00:16:48.241 killing process with pid 290870 00:16:48.241 22:54:39 -- common/autotest_common.sh@945 -- # kill 290870 00:16:48.241 Received shutdown signal, test time was about 10.000000 seconds 00:16:48.241 00:16:48.241 Latency(us) 00:16:48.241 Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:16:48.241 =================================================================================================================== 00:16:48.241 Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:16:48.241 22:54:39 -- common/autotest_common.sh@950 -- # wait 290870 00:16:48.500 22:54:39 -- target/tls.sh@179 -- # chmod 0666 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:16:48.500 22:54:39 -- target/tls.sh@180 -- # NOT run_bdevperf nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:16:48.500 22:54:39 -- common/autotest_common.sh@640 -- # local es=0 00:16:48.500 22:54:39 -- common/autotest_common.sh@642 -- # valid_exec_arg run_bdevperf nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:16:48.500 22:54:39 -- common/autotest_common.sh@628 -- # local arg=run_bdevperf 00:16:48.500 22:54:39 -- common/autotest_common.sh@632 -- # case "$(type -t "$arg")" in 00:16:48.500 22:54:39 -- common/autotest_common.sh@632 -- # type -t run_bdevperf 00:16:48.500 22:54:39 -- common/autotest_common.sh@632 -- # case "$(type -t "$arg")" in 00:16:48.500 22:54:39 -- common/autotest_common.sh@643 -- # run_bdevperf nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:16:48.500 22:54:39 -- target/tls.sh@22 -- # local subnqn hostnqn psk 00:16:48.500 22:54:39 -- target/tls.sh@23 -- # subnqn=nqn.2016-06.io.spdk:cnode1 00:16:48.500 22:54:39 -- target/tls.sh@23 -- # hostnqn=nqn.2016-06.io.spdk:host1 00:16:48.500 22:54:39 -- target/tls.sh@23 -- # psk='--psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt' 00:16:48.500 22:54:39 -- target/tls.sh@25 -- # bdevperf_rpc_sock=/var/tmp/bdevperf.sock 00:16:48.500 22:54:39 -- target/tls.sh@28 -- # bdevperf_pid=292360 00:16:48.500 22:54:39 -- target/tls.sh@27 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 0x4 -z -r /var/tmp/bdevperf.sock -q 128 -o 4096 -w verify -t 10 00:16:48.500 22:54:39 -- target/tls.sh@30 -- # trap 'cleanup; exit 1' SIGINT SIGTERM EXIT 00:16:48.500 22:54:39 -- target/tls.sh@31 -- # waitforlisten 292360 /var/tmp/bdevperf.sock 00:16:48.500 22:54:39 -- common/autotest_common.sh@819 -- # '[' -z 292360 ']' 00:16:48.500 22:54:39 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:16:48.500 22:54:39 -- common/autotest_common.sh@824 -- # local max_retries=100 00:16:48.500 22:54:39 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:16:48.500 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:16:48.500 22:54:39 -- common/autotest_common.sh@828 -- # xtrace_disable 00:16:48.500 22:54:39 -- common/autotest_common.sh@10 -- # set +x 00:16:48.500 [2024-04-16 22:54:39.421920] Starting SPDK v24.01.1-pre git sha1 4b134b4ab / DPDK 23.11.0 initialization... 00:16:48.500 [2024-04-16 22:54:39.422006] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x4 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid292360 ] 00:16:48.500 EAL: No free 2048 kB hugepages reported on node 1 00:16:48.500 [2024-04-16 22:54:39.478632] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:16:48.500 [2024-04-16 22:54:39.578842] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:16:49.444 22:54:40 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:16:49.444 22:54:40 -- common/autotest_common.sh@852 -- # return 0 00:16:49.444 22:54:40 -- target/tls.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b TLSTEST -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -q nqn.2016-06.io.spdk:host1 --psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:16:49.444 [2024-04-16 22:54:40.565982] bdev_nvme_rpc.c: 477:rpc_bdev_nvme_attach_controller: *NOTICE*: TLS support is considered experimental 00:16:49.444 [2024-04-16 22:54:40.566055] bdev_nvme_rpc.c: 336:tcp_load_psk: *ERROR*: Incorrect permissions for PSK file 00:16:49.444 request: 00:16:49.444 { 00:16:49.444 "name": "TLSTEST", 00:16:49.444 "trtype": "tcp", 00:16:49.444 "traddr": "10.0.0.2", 00:16:49.444 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:16:49.444 "adrfam": "ipv4", 00:16:49.444 "trsvcid": "4420", 00:16:49.444 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:16:49.444 "psk": "/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt", 00:16:49.444 "method": "bdev_nvme_attach_controller", 00:16:49.444 "req_id": 1 00:16:49.444 } 00:16:49.444 Got JSON-RPC error response 00:16:49.444 response: 00:16:49.444 { 00:16:49.444 "code": -22, 00:16:49.444 "message": "Could not retrieve PSK from file: /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt" 00:16:49.444 } 00:16:49.702 22:54:40 -- target/tls.sh@36 -- # killprocess 292360 00:16:49.702 22:54:40 -- common/autotest_common.sh@926 -- # '[' -z 292360 ']' 00:16:49.702 22:54:40 -- common/autotest_common.sh@930 -- # kill -0 292360 00:16:49.702 22:54:40 -- common/autotest_common.sh@931 -- # uname 00:16:49.702 22:54:40 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:16:49.702 22:54:40 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 292360 00:16:49.702 22:54:40 -- common/autotest_common.sh@932 -- # process_name=reactor_2 00:16:49.702 22:54:40 -- common/autotest_common.sh@936 -- # '[' reactor_2 = sudo ']' 00:16:49.702 22:54:40 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 292360' 00:16:49.702 killing process with pid 292360 00:16:49.702 22:54:40 -- common/autotest_common.sh@945 -- # kill 292360 00:16:49.702 Received shutdown signal, test time was about 10.000000 seconds 00:16:49.702 00:16:49.702 Latency(us) 00:16:49.702 Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:16:49.702 =================================================================================================================== 00:16:49.702 Total : 0.00 0.00 0.00 0.00 0.00 18446744073709551616.00 0.00 00:16:49.702 22:54:40 -- common/autotest_common.sh@950 -- # wait 292360 00:16:49.960 22:54:40 -- target/tls.sh@37 -- # return 1 00:16:49.960 22:54:40 -- common/autotest_common.sh@643 -- # es=1 00:16:49.960 22:54:40 -- common/autotest_common.sh@651 -- # (( es > 128 )) 00:16:49.960 22:54:40 -- common/autotest_common.sh@662 -- # [[ -n '' ]] 00:16:49.960 22:54:40 -- common/autotest_common.sh@667 -- # (( !es == 0 )) 00:16:49.960 22:54:40 -- target/tls.sh@183 -- # killprocess 290572 00:16:49.960 22:54:40 -- common/autotest_common.sh@926 -- # '[' -z 290572 ']' 00:16:49.960 22:54:40 -- common/autotest_common.sh@930 -- # kill -0 290572 00:16:49.960 22:54:40 -- common/autotest_common.sh@931 -- # uname 00:16:49.960 22:54:40 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:16:49.960 22:54:40 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 290572 00:16:49.960 22:54:40 -- common/autotest_common.sh@932 -- # process_name=reactor_1 00:16:49.960 22:54:40 -- common/autotest_common.sh@936 -- # '[' reactor_1 = sudo ']' 00:16:49.960 22:54:40 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 290572' 00:16:49.960 killing process with pid 290572 00:16:49.960 22:54:40 -- common/autotest_common.sh@945 -- # kill 290572 00:16:49.960 22:54:40 -- common/autotest_common.sh@950 -- # wait 290572 00:16:50.218 22:54:41 -- target/tls.sh@184 -- # nvmfappstart -m 0x2 00:16:50.218 22:54:41 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:16:50.218 22:54:41 -- common/autotest_common.sh@712 -- # xtrace_disable 00:16:50.218 22:54:41 -- common/autotest_common.sh@10 -- # set +x 00:16:50.218 22:54:41 -- nvmf/common.sh@469 -- # nvmfpid=292528 00:16:50.218 22:54:41 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x2 00:16:50.218 22:54:41 -- nvmf/common.sh@470 -- # waitforlisten 292528 00:16:50.218 22:54:41 -- common/autotest_common.sh@819 -- # '[' -z 292528 ']' 00:16:50.218 22:54:41 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk.sock 00:16:50.218 22:54:41 -- common/autotest_common.sh@824 -- # local max_retries=100 00:16:50.218 22:54:41 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:16:50.218 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:16:50.218 22:54:41 -- common/autotest_common.sh@828 -- # xtrace_disable 00:16:50.218 22:54:41 -- common/autotest_common.sh@10 -- # set +x 00:16:50.218 [2024-04-16 22:54:41.243501] Starting SPDK v24.01.1-pre git sha1 4b134b4ab / DPDK 23.11.0 initialization... 00:16:50.218 [2024-04-16 22:54:41.243569] [ DPDK EAL parameters: nvmf -c 0x2 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:16:50.218 EAL: No free 2048 kB hugepages reported on node 1 00:16:50.218 [2024-04-16 22:54:41.307699] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:16:50.476 [2024-04-16 22:54:41.425785] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:16:50.476 [2024-04-16 22:54:41.425922] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:16:50.476 [2024-04-16 22:54:41.425938] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:16:50.476 [2024-04-16 22:54:41.425950] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:16:50.476 [2024-04-16 22:54:41.425975] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:16:51.408 22:54:42 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:16:51.408 22:54:42 -- common/autotest_common.sh@852 -- # return 0 00:16:51.408 22:54:42 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:16:51.408 22:54:42 -- common/autotest_common.sh@718 -- # xtrace_disable 00:16:51.408 22:54:42 -- common/autotest_common.sh@10 -- # set +x 00:16:51.408 22:54:42 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:16:51.408 22:54:42 -- target/tls.sh@186 -- # NOT setup_nvmf_tgt /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:16:51.408 22:54:42 -- common/autotest_common.sh@640 -- # local es=0 00:16:51.408 22:54:42 -- common/autotest_common.sh@642 -- # valid_exec_arg setup_nvmf_tgt /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:16:51.408 22:54:42 -- common/autotest_common.sh@628 -- # local arg=setup_nvmf_tgt 00:16:51.408 22:54:42 -- common/autotest_common.sh@632 -- # case "$(type -t "$arg")" in 00:16:51.408 22:54:42 -- common/autotest_common.sh@632 -- # type -t setup_nvmf_tgt 00:16:51.408 22:54:42 -- common/autotest_common.sh@632 -- # case "$(type -t "$arg")" in 00:16:51.408 22:54:42 -- common/autotest_common.sh@643 -- # setup_nvmf_tgt /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:16:51.408 22:54:42 -- target/tls.sh@58 -- # local key=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:16:51.408 22:54:42 -- target/tls.sh@60 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_transport -t tcp -o 00:16:51.408 [2024-04-16 22:54:42.495531] tcp.c: 659:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:16:51.408 22:54:42 -- target/tls.sh@61 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDK00000000000001 -m 10 00:16:51.666 22:54:42 -- target/tls.sh@62 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 -k 00:16:51.923 [2024-04-16 22:54:42.964821] tcp.c: 912:nvmf_tcp_listen: *NOTICE*: TLS support is considered experimental 00:16:51.923 [2024-04-16 22:54:42.965043] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:16:51.923 22:54:42 -- target/tls.sh@64 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 32 4096 -b malloc0 00:16:52.181 malloc0 00:16:52.181 22:54:43 -- target/tls.sh@65 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 malloc0 -n 1 00:16:52.438 22:54:43 -- target/tls.sh@67 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_host nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host1 --psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:16:52.696 [2024-04-16 22:54:43.686886] tcp.c:3549:tcp_load_psk: *ERROR*: Incorrect permissions for PSK file 00:16:52.696 [2024-04-16 22:54:43.686926] tcp.c:3618:nvmf_tcp_subsystem_add_host: *ERROR*: Could not retrieve PSK from file 00:16:52.696 [2024-04-16 22:54:43.686959] subsystem.c: 840:spdk_nvmf_subsystem_add_host: *ERROR*: Unable to add host to TCP transport 00:16:52.696 request: 00:16:52.696 { 00:16:52.696 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:16:52.696 "host": "nqn.2016-06.io.spdk:host1", 00:16:52.696 "psk": "/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt", 00:16:52.696 "method": "nvmf_subsystem_add_host", 00:16:52.696 "req_id": 1 00:16:52.696 } 00:16:52.696 Got JSON-RPC error response 00:16:52.696 response: 00:16:52.696 { 00:16:52.696 "code": -32603, 00:16:52.696 "message": "Internal error" 00:16:52.696 } 00:16:52.696 22:54:43 -- common/autotest_common.sh@643 -- # es=1 00:16:52.696 22:54:43 -- common/autotest_common.sh@651 -- # (( es > 128 )) 00:16:52.696 22:54:43 -- common/autotest_common.sh@662 -- # [[ -n '' ]] 00:16:52.696 22:54:43 -- common/autotest_common.sh@667 -- # (( !es == 0 )) 00:16:52.696 22:54:43 -- target/tls.sh@189 -- # killprocess 292528 00:16:52.696 22:54:43 -- common/autotest_common.sh@926 -- # '[' -z 292528 ']' 00:16:52.696 22:54:43 -- common/autotest_common.sh@930 -- # kill -0 292528 00:16:52.696 22:54:43 -- common/autotest_common.sh@931 -- # uname 00:16:52.696 22:54:43 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:16:52.696 22:54:43 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 292528 00:16:52.696 22:54:43 -- common/autotest_common.sh@932 -- # process_name=reactor_1 00:16:52.696 22:54:43 -- common/autotest_common.sh@936 -- # '[' reactor_1 = sudo ']' 00:16:52.696 22:54:43 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 292528' 00:16:52.696 killing process with pid 292528 00:16:52.696 22:54:43 -- common/autotest_common.sh@945 -- # kill 292528 00:16:52.696 22:54:43 -- common/autotest_common.sh@950 -- # wait 292528 00:16:52.955 22:54:44 -- target/tls.sh@190 -- # chmod 0600 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:16:52.955 22:54:44 -- target/tls.sh@193 -- # nvmfappstart -m 0x2 00:16:52.955 22:54:44 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:16:52.955 22:54:44 -- common/autotest_common.sh@712 -- # xtrace_disable 00:16:52.955 22:54:44 -- common/autotest_common.sh@10 -- # set +x 00:16:52.955 22:54:44 -- nvmf/common.sh@469 -- # nvmfpid=292956 00:16:52.955 22:54:44 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x2 00:16:52.955 22:54:44 -- nvmf/common.sh@470 -- # waitforlisten 292956 00:16:52.955 22:54:44 -- common/autotest_common.sh@819 -- # '[' -z 292956 ']' 00:16:52.955 22:54:44 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk.sock 00:16:52.955 22:54:44 -- common/autotest_common.sh@824 -- # local max_retries=100 00:16:52.955 22:54:44 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:16:52.955 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:16:52.955 22:54:44 -- common/autotest_common.sh@828 -- # xtrace_disable 00:16:52.955 22:54:44 -- common/autotest_common.sh@10 -- # set +x 00:16:52.955 [2024-04-16 22:54:44.082728] Starting SPDK v24.01.1-pre git sha1 4b134b4ab / DPDK 23.11.0 initialization... 00:16:52.955 [2024-04-16 22:54:44.082829] [ DPDK EAL parameters: nvmf -c 0x2 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:16:53.213 EAL: No free 2048 kB hugepages reported on node 1 00:16:53.213 [2024-04-16 22:54:44.151665] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:16:53.213 [2024-04-16 22:54:44.267421] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:16:53.213 [2024-04-16 22:54:44.267581] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:16:53.213 [2024-04-16 22:54:44.267597] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:16:53.213 [2024-04-16 22:54:44.267609] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:16:53.213 [2024-04-16 22:54:44.267640] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:16:54.145 22:54:44 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:16:54.145 22:54:44 -- common/autotest_common.sh@852 -- # return 0 00:16:54.145 22:54:44 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:16:54.145 22:54:44 -- common/autotest_common.sh@718 -- # xtrace_disable 00:16:54.145 22:54:44 -- common/autotest_common.sh@10 -- # set +x 00:16:54.145 22:54:45 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:16:54.145 22:54:45 -- target/tls.sh@194 -- # setup_nvmf_tgt /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:16:54.145 22:54:45 -- target/tls.sh@58 -- # local key=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:16:54.145 22:54:45 -- target/tls.sh@60 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_transport -t tcp -o 00:16:54.145 [2024-04-16 22:54:45.240235] tcp.c: 659:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:16:54.145 22:54:45 -- target/tls.sh@61 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDK00000000000001 -m 10 00:16:54.403 22:54:45 -- target/tls.sh@62 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 -k 00:16:54.661 [2024-04-16 22:54:45.749619] tcp.c: 912:nvmf_tcp_listen: *NOTICE*: TLS support is considered experimental 00:16:54.661 [2024-04-16 22:54:45.749855] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:16:54.661 22:54:45 -- target/tls.sh@64 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 32 4096 -b malloc0 00:16:54.918 malloc0 00:16:54.919 22:54:46 -- target/tls.sh@65 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 malloc0 -n 1 00:16:55.176 22:54:46 -- target/tls.sh@67 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_host nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host1 --psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:16:55.434 22:54:46 -- target/tls.sh@197 -- # bdevperf_pid=293256 00:16:55.434 22:54:46 -- target/tls.sh@196 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 0x4 -z -r /var/tmp/bdevperf.sock -q 128 -o 4096 -w verify -t 10 00:16:55.434 22:54:46 -- target/tls.sh@199 -- # trap 'cleanup; exit 1' SIGINT SIGTERM EXIT 00:16:55.434 22:54:46 -- target/tls.sh@200 -- # waitforlisten 293256 /var/tmp/bdevperf.sock 00:16:55.434 22:54:46 -- common/autotest_common.sh@819 -- # '[' -z 293256 ']' 00:16:55.434 22:54:46 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:16:55.434 22:54:46 -- common/autotest_common.sh@824 -- # local max_retries=100 00:16:55.434 22:54:46 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:16:55.434 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:16:55.434 22:54:46 -- common/autotest_common.sh@828 -- # xtrace_disable 00:16:55.434 22:54:46 -- common/autotest_common.sh@10 -- # set +x 00:16:55.434 [2024-04-16 22:54:46.553715] Starting SPDK v24.01.1-pre git sha1 4b134b4ab / DPDK 23.11.0 initialization... 00:16:55.434 [2024-04-16 22:54:46.553793] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x4 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid293256 ] 00:16:55.692 EAL: No free 2048 kB hugepages reported on node 1 00:16:55.692 [2024-04-16 22:54:46.612942] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:16:55.692 [2024-04-16 22:54:46.716221] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:16:56.624 22:54:47 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:16:56.624 22:54:47 -- common/autotest_common.sh@852 -- # return 0 00:16:56.624 22:54:47 -- target/tls.sh@201 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b TLSTEST -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -q nqn.2016-06.io.spdk:host1 --psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:16:56.624 [2024-04-16 22:54:47.705378] bdev_nvme_rpc.c: 477:rpc_bdev_nvme_attach_controller: *NOTICE*: TLS support is considered experimental 00:16:56.881 TLSTESTn1 00:16:56.881 22:54:47 -- target/tls.sh@205 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py save_config 00:16:57.138 22:54:48 -- target/tls.sh@205 -- # tgtconf='{ 00:16:57.138 "subsystems": [ 00:16:57.138 { 00:16:57.138 "subsystem": "iobuf", 00:16:57.138 "config": [ 00:16:57.138 { 00:16:57.138 "method": "iobuf_set_options", 00:16:57.138 "params": { 00:16:57.138 "small_pool_count": 8192, 00:16:57.138 "large_pool_count": 1024, 00:16:57.138 "small_bufsize": 8192, 00:16:57.138 "large_bufsize": 135168 00:16:57.138 } 00:16:57.138 } 00:16:57.138 ] 00:16:57.138 }, 00:16:57.138 { 00:16:57.138 "subsystem": "sock", 00:16:57.138 "config": [ 00:16:57.138 { 00:16:57.138 "method": "sock_impl_set_options", 00:16:57.138 "params": { 00:16:57.138 "impl_name": "posix", 00:16:57.138 "recv_buf_size": 2097152, 00:16:57.138 "send_buf_size": 2097152, 00:16:57.138 "enable_recv_pipe": true, 00:16:57.138 "enable_quickack": false, 00:16:57.138 "enable_placement_id": 0, 00:16:57.138 "enable_zerocopy_send_server": true, 00:16:57.138 "enable_zerocopy_send_client": false, 00:16:57.138 "zerocopy_threshold": 0, 00:16:57.138 "tls_version": 0, 00:16:57.138 "enable_ktls": false 00:16:57.138 } 00:16:57.138 }, 00:16:57.138 { 00:16:57.138 "method": "sock_impl_set_options", 00:16:57.138 "params": { 00:16:57.138 "impl_name": "ssl", 00:16:57.138 "recv_buf_size": 4096, 00:16:57.138 "send_buf_size": 4096, 00:16:57.138 "enable_recv_pipe": true, 00:16:57.138 "enable_quickack": false, 00:16:57.138 "enable_placement_id": 0, 00:16:57.138 "enable_zerocopy_send_server": true, 00:16:57.138 "enable_zerocopy_send_client": false, 00:16:57.138 "zerocopy_threshold": 0, 00:16:57.138 "tls_version": 0, 00:16:57.138 "enable_ktls": false 00:16:57.138 } 00:16:57.138 } 00:16:57.138 ] 00:16:57.138 }, 00:16:57.138 { 00:16:57.138 "subsystem": "vmd", 00:16:57.138 "config": [] 00:16:57.138 }, 00:16:57.138 { 00:16:57.138 "subsystem": "accel", 00:16:57.138 "config": [ 00:16:57.138 { 00:16:57.138 "method": "accel_set_options", 00:16:57.138 "params": { 00:16:57.138 "small_cache_size": 128, 00:16:57.138 "large_cache_size": 16, 00:16:57.138 "task_count": 2048, 00:16:57.138 "sequence_count": 2048, 00:16:57.138 "buf_count": 2048 00:16:57.138 } 00:16:57.138 } 00:16:57.138 ] 00:16:57.138 }, 00:16:57.138 { 00:16:57.138 "subsystem": "bdev", 00:16:57.138 "config": [ 00:16:57.138 { 00:16:57.138 "method": "bdev_set_options", 00:16:57.138 "params": { 00:16:57.138 "bdev_io_pool_size": 65535, 00:16:57.138 "bdev_io_cache_size": 256, 00:16:57.138 "bdev_auto_examine": true, 00:16:57.138 "iobuf_small_cache_size": 128, 00:16:57.138 "iobuf_large_cache_size": 16 00:16:57.138 } 00:16:57.138 }, 00:16:57.138 { 00:16:57.138 "method": "bdev_raid_set_options", 00:16:57.138 "params": { 00:16:57.138 "process_window_size_kb": 1024 00:16:57.138 } 00:16:57.138 }, 00:16:57.138 { 00:16:57.138 "method": "bdev_iscsi_set_options", 00:16:57.138 "params": { 00:16:57.138 "timeout_sec": 30 00:16:57.138 } 00:16:57.138 }, 00:16:57.138 { 00:16:57.138 "method": "bdev_nvme_set_options", 00:16:57.138 "params": { 00:16:57.138 "action_on_timeout": "none", 00:16:57.138 "timeout_us": 0, 00:16:57.138 "timeout_admin_us": 0, 00:16:57.138 "keep_alive_timeout_ms": 10000, 00:16:57.138 "transport_retry_count": 4, 00:16:57.138 "arbitration_burst": 0, 00:16:57.138 "low_priority_weight": 0, 00:16:57.138 "medium_priority_weight": 0, 00:16:57.138 "high_priority_weight": 0, 00:16:57.138 "nvme_adminq_poll_period_us": 10000, 00:16:57.138 "nvme_ioq_poll_period_us": 0, 00:16:57.138 "io_queue_requests": 0, 00:16:57.138 "delay_cmd_submit": true, 00:16:57.138 "bdev_retry_count": 3, 00:16:57.138 "transport_ack_timeout": 0, 00:16:57.138 "ctrlr_loss_timeout_sec": 0, 00:16:57.138 "reconnect_delay_sec": 0, 00:16:57.138 "fast_io_fail_timeout_sec": 0, 00:16:57.138 "generate_uuids": false, 00:16:57.138 "transport_tos": 0, 00:16:57.138 "io_path_stat": false, 00:16:57.138 "allow_accel_sequence": false 00:16:57.138 } 00:16:57.138 }, 00:16:57.138 { 00:16:57.138 "method": "bdev_nvme_set_hotplug", 00:16:57.138 "params": { 00:16:57.138 "period_us": 100000, 00:16:57.138 "enable": false 00:16:57.138 } 00:16:57.138 }, 00:16:57.138 { 00:16:57.138 "method": "bdev_malloc_create", 00:16:57.138 "params": { 00:16:57.138 "name": "malloc0", 00:16:57.138 "num_blocks": 8192, 00:16:57.138 "block_size": 4096, 00:16:57.138 "physical_block_size": 4096, 00:16:57.138 "uuid": "4735bee8-67ee-41a4-923a-b1b4ef0cf8ba", 00:16:57.138 "optimal_io_boundary": 0 00:16:57.138 } 00:16:57.138 }, 00:16:57.138 { 00:16:57.138 "method": "bdev_wait_for_examine" 00:16:57.138 } 00:16:57.138 ] 00:16:57.138 }, 00:16:57.138 { 00:16:57.138 "subsystem": "nbd", 00:16:57.138 "config": [] 00:16:57.138 }, 00:16:57.138 { 00:16:57.138 "subsystem": "scheduler", 00:16:57.138 "config": [ 00:16:57.138 { 00:16:57.138 "method": "framework_set_scheduler", 00:16:57.138 "params": { 00:16:57.138 "name": "static" 00:16:57.138 } 00:16:57.138 } 00:16:57.138 ] 00:16:57.138 }, 00:16:57.138 { 00:16:57.138 "subsystem": "nvmf", 00:16:57.138 "config": [ 00:16:57.138 { 00:16:57.138 "method": "nvmf_set_config", 00:16:57.138 "params": { 00:16:57.138 "discovery_filter": "match_any", 00:16:57.138 "admin_cmd_passthru": { 00:16:57.138 "identify_ctrlr": false 00:16:57.138 } 00:16:57.138 } 00:16:57.138 }, 00:16:57.138 { 00:16:57.138 "method": "nvmf_set_max_subsystems", 00:16:57.138 "params": { 00:16:57.138 "max_subsystems": 1024 00:16:57.138 } 00:16:57.138 }, 00:16:57.138 { 00:16:57.138 "method": "nvmf_set_crdt", 00:16:57.138 "params": { 00:16:57.138 "crdt1": 0, 00:16:57.138 "crdt2": 0, 00:16:57.138 "crdt3": 0 00:16:57.138 } 00:16:57.138 }, 00:16:57.138 { 00:16:57.138 "method": "nvmf_create_transport", 00:16:57.138 "params": { 00:16:57.138 "trtype": "TCP", 00:16:57.138 "max_queue_depth": 128, 00:16:57.138 "max_io_qpairs_per_ctrlr": 127, 00:16:57.138 "in_capsule_data_size": 4096, 00:16:57.138 "max_io_size": 131072, 00:16:57.138 "io_unit_size": 131072, 00:16:57.138 "max_aq_depth": 128, 00:16:57.138 "num_shared_buffers": 511, 00:16:57.138 "buf_cache_size": 4294967295, 00:16:57.138 "dif_insert_or_strip": false, 00:16:57.138 "zcopy": false, 00:16:57.138 "c2h_success": false, 00:16:57.139 "sock_priority": 0, 00:16:57.139 "abort_timeout_sec": 1 00:16:57.139 } 00:16:57.139 }, 00:16:57.139 { 00:16:57.139 "method": "nvmf_create_subsystem", 00:16:57.139 "params": { 00:16:57.139 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:16:57.139 "allow_any_host": false, 00:16:57.139 "serial_number": "SPDK00000000000001", 00:16:57.139 "model_number": "SPDK bdev Controller", 00:16:57.139 "max_namespaces": 10, 00:16:57.139 "min_cntlid": 1, 00:16:57.139 "max_cntlid": 65519, 00:16:57.139 "ana_reporting": false 00:16:57.139 } 00:16:57.139 }, 00:16:57.139 { 00:16:57.139 "method": "nvmf_subsystem_add_host", 00:16:57.139 "params": { 00:16:57.139 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:16:57.139 "host": "nqn.2016-06.io.spdk:host1", 00:16:57.139 "psk": "/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt" 00:16:57.139 } 00:16:57.139 }, 00:16:57.139 { 00:16:57.139 "method": "nvmf_subsystem_add_ns", 00:16:57.139 "params": { 00:16:57.139 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:16:57.139 "namespace": { 00:16:57.139 "nsid": 1, 00:16:57.139 "bdev_name": "malloc0", 00:16:57.139 "nguid": "4735BEE867EE41A4923AB1B4EF0CF8BA", 00:16:57.139 "uuid": "4735bee8-67ee-41a4-923a-b1b4ef0cf8ba" 00:16:57.139 } 00:16:57.139 } 00:16:57.139 }, 00:16:57.139 { 00:16:57.139 "method": "nvmf_subsystem_add_listener", 00:16:57.139 "params": { 00:16:57.139 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:16:57.139 "listen_address": { 00:16:57.139 "trtype": "TCP", 00:16:57.139 "adrfam": "IPv4", 00:16:57.139 "traddr": "10.0.0.2", 00:16:57.139 "trsvcid": "4420" 00:16:57.139 }, 00:16:57.139 "secure_channel": true 00:16:57.139 } 00:16:57.139 } 00:16:57.139 ] 00:16:57.139 } 00:16:57.139 ] 00:16:57.139 }' 00:16:57.139 22:54:48 -- target/tls.sh@206 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock save_config 00:16:57.396 22:54:48 -- target/tls.sh@206 -- # bdevperfconf='{ 00:16:57.396 "subsystems": [ 00:16:57.396 { 00:16:57.396 "subsystem": "iobuf", 00:16:57.396 "config": [ 00:16:57.396 { 00:16:57.396 "method": "iobuf_set_options", 00:16:57.396 "params": { 00:16:57.396 "small_pool_count": 8192, 00:16:57.396 "large_pool_count": 1024, 00:16:57.396 "small_bufsize": 8192, 00:16:57.396 "large_bufsize": 135168 00:16:57.396 } 00:16:57.396 } 00:16:57.396 ] 00:16:57.396 }, 00:16:57.396 { 00:16:57.396 "subsystem": "sock", 00:16:57.396 "config": [ 00:16:57.396 { 00:16:57.396 "method": "sock_impl_set_options", 00:16:57.396 "params": { 00:16:57.396 "impl_name": "posix", 00:16:57.396 "recv_buf_size": 2097152, 00:16:57.396 "send_buf_size": 2097152, 00:16:57.396 "enable_recv_pipe": true, 00:16:57.396 "enable_quickack": false, 00:16:57.396 "enable_placement_id": 0, 00:16:57.396 "enable_zerocopy_send_server": true, 00:16:57.396 "enable_zerocopy_send_client": false, 00:16:57.396 "zerocopy_threshold": 0, 00:16:57.396 "tls_version": 0, 00:16:57.396 "enable_ktls": false 00:16:57.396 } 00:16:57.396 }, 00:16:57.396 { 00:16:57.396 "method": "sock_impl_set_options", 00:16:57.396 "params": { 00:16:57.396 "impl_name": "ssl", 00:16:57.396 "recv_buf_size": 4096, 00:16:57.396 "send_buf_size": 4096, 00:16:57.396 "enable_recv_pipe": true, 00:16:57.396 "enable_quickack": false, 00:16:57.396 "enable_placement_id": 0, 00:16:57.396 "enable_zerocopy_send_server": true, 00:16:57.396 "enable_zerocopy_send_client": false, 00:16:57.396 "zerocopy_threshold": 0, 00:16:57.396 "tls_version": 0, 00:16:57.396 "enable_ktls": false 00:16:57.396 } 00:16:57.396 } 00:16:57.396 ] 00:16:57.396 }, 00:16:57.396 { 00:16:57.396 "subsystem": "vmd", 00:16:57.396 "config": [] 00:16:57.396 }, 00:16:57.396 { 00:16:57.396 "subsystem": "accel", 00:16:57.396 "config": [ 00:16:57.396 { 00:16:57.396 "method": "accel_set_options", 00:16:57.396 "params": { 00:16:57.396 "small_cache_size": 128, 00:16:57.396 "large_cache_size": 16, 00:16:57.396 "task_count": 2048, 00:16:57.396 "sequence_count": 2048, 00:16:57.396 "buf_count": 2048 00:16:57.396 } 00:16:57.396 } 00:16:57.396 ] 00:16:57.396 }, 00:16:57.396 { 00:16:57.396 "subsystem": "bdev", 00:16:57.396 "config": [ 00:16:57.396 { 00:16:57.396 "method": "bdev_set_options", 00:16:57.396 "params": { 00:16:57.396 "bdev_io_pool_size": 65535, 00:16:57.396 "bdev_io_cache_size": 256, 00:16:57.396 "bdev_auto_examine": true, 00:16:57.396 "iobuf_small_cache_size": 128, 00:16:57.396 "iobuf_large_cache_size": 16 00:16:57.396 } 00:16:57.396 }, 00:16:57.396 { 00:16:57.396 "method": "bdev_raid_set_options", 00:16:57.396 "params": { 00:16:57.396 "process_window_size_kb": 1024 00:16:57.396 } 00:16:57.396 }, 00:16:57.396 { 00:16:57.396 "method": "bdev_iscsi_set_options", 00:16:57.396 "params": { 00:16:57.396 "timeout_sec": 30 00:16:57.396 } 00:16:57.396 }, 00:16:57.396 { 00:16:57.396 "method": "bdev_nvme_set_options", 00:16:57.396 "params": { 00:16:57.396 "action_on_timeout": "none", 00:16:57.396 "timeout_us": 0, 00:16:57.396 "timeout_admin_us": 0, 00:16:57.396 "keep_alive_timeout_ms": 10000, 00:16:57.396 "transport_retry_count": 4, 00:16:57.396 "arbitration_burst": 0, 00:16:57.396 "low_priority_weight": 0, 00:16:57.396 "medium_priority_weight": 0, 00:16:57.396 "high_priority_weight": 0, 00:16:57.396 "nvme_adminq_poll_period_us": 10000, 00:16:57.396 "nvme_ioq_poll_period_us": 0, 00:16:57.396 "io_queue_requests": 512, 00:16:57.396 "delay_cmd_submit": true, 00:16:57.396 "bdev_retry_count": 3, 00:16:57.396 "transport_ack_timeout": 0, 00:16:57.396 "ctrlr_loss_timeout_sec": 0, 00:16:57.396 "reconnect_delay_sec": 0, 00:16:57.396 "fast_io_fail_timeout_sec": 0, 00:16:57.396 "generate_uuids": false, 00:16:57.396 "transport_tos": 0, 00:16:57.396 "io_path_stat": false, 00:16:57.396 "allow_accel_sequence": false 00:16:57.396 } 00:16:57.396 }, 00:16:57.396 { 00:16:57.396 "method": "bdev_nvme_attach_controller", 00:16:57.396 "params": { 00:16:57.396 "name": "TLSTEST", 00:16:57.396 "trtype": "TCP", 00:16:57.396 "adrfam": "IPv4", 00:16:57.396 "traddr": "10.0.0.2", 00:16:57.396 "trsvcid": "4420", 00:16:57.396 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:16:57.396 "prchk_reftag": false, 00:16:57.396 "prchk_guard": false, 00:16:57.396 "ctrlr_loss_timeout_sec": 0, 00:16:57.396 "reconnect_delay_sec": 0, 00:16:57.396 "fast_io_fail_timeout_sec": 0, 00:16:57.396 "psk": "/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt", 00:16:57.396 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:16:57.396 "hdgst": false, 00:16:57.396 "ddgst": false 00:16:57.396 } 00:16:57.396 }, 00:16:57.396 { 00:16:57.396 "method": "bdev_nvme_set_hotplug", 00:16:57.396 "params": { 00:16:57.396 "period_us": 100000, 00:16:57.396 "enable": false 00:16:57.396 } 00:16:57.396 }, 00:16:57.396 { 00:16:57.396 "method": "bdev_wait_for_examine" 00:16:57.396 } 00:16:57.396 ] 00:16:57.396 }, 00:16:57.396 { 00:16:57.396 "subsystem": "nbd", 00:16:57.396 "config": [] 00:16:57.396 } 00:16:57.396 ] 00:16:57.396 }' 00:16:57.396 22:54:48 -- target/tls.sh@208 -- # killprocess 293256 00:16:57.396 22:54:48 -- common/autotest_common.sh@926 -- # '[' -z 293256 ']' 00:16:57.396 22:54:48 -- common/autotest_common.sh@930 -- # kill -0 293256 00:16:57.396 22:54:48 -- common/autotest_common.sh@931 -- # uname 00:16:57.396 22:54:48 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:16:57.396 22:54:48 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 293256 00:16:57.396 22:54:48 -- common/autotest_common.sh@932 -- # process_name=reactor_2 00:16:57.396 22:54:48 -- common/autotest_common.sh@936 -- # '[' reactor_2 = sudo ']' 00:16:57.396 22:54:48 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 293256' 00:16:57.396 killing process with pid 293256 00:16:57.396 22:54:48 -- common/autotest_common.sh@945 -- # kill 293256 00:16:57.396 Received shutdown signal, test time was about 10.000000 seconds 00:16:57.396 00:16:57.396 Latency(us) 00:16:57.396 Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:16:57.396 =================================================================================================================== 00:16:57.396 Total : 0.00 0.00 0.00 0.00 0.00 18446744073709551616.00 0.00 00:16:57.396 22:54:48 -- common/autotest_common.sh@950 -- # wait 293256 00:16:57.653 22:54:48 -- target/tls.sh@209 -- # killprocess 292956 00:16:57.653 22:54:48 -- common/autotest_common.sh@926 -- # '[' -z 292956 ']' 00:16:57.653 22:54:48 -- common/autotest_common.sh@930 -- # kill -0 292956 00:16:57.653 22:54:48 -- common/autotest_common.sh@931 -- # uname 00:16:57.653 22:54:48 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:16:57.653 22:54:48 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 292956 00:16:57.653 22:54:48 -- common/autotest_common.sh@932 -- # process_name=reactor_1 00:16:57.653 22:54:48 -- common/autotest_common.sh@936 -- # '[' reactor_1 = sudo ']' 00:16:57.653 22:54:48 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 292956' 00:16:57.653 killing process with pid 292956 00:16:57.653 22:54:48 -- common/autotest_common.sh@945 -- # kill 292956 00:16:57.653 22:54:48 -- common/autotest_common.sh@950 -- # wait 292956 00:16:57.911 22:54:48 -- target/tls.sh@212 -- # nvmfappstart -m 0x2 -c /dev/fd/62 00:16:57.911 22:54:48 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:16:57.911 22:54:48 -- common/autotest_common.sh@712 -- # xtrace_disable 00:16:57.911 22:54:48 -- common/autotest_common.sh@10 -- # set +x 00:16:57.911 22:54:48 -- target/tls.sh@212 -- # echo '{ 00:16:57.911 "subsystems": [ 00:16:57.911 { 00:16:57.911 "subsystem": "iobuf", 00:16:57.911 "config": [ 00:16:57.911 { 00:16:57.911 "method": "iobuf_set_options", 00:16:57.911 "params": { 00:16:57.911 "small_pool_count": 8192, 00:16:57.911 "large_pool_count": 1024, 00:16:57.911 "small_bufsize": 8192, 00:16:57.911 "large_bufsize": 135168 00:16:57.911 } 00:16:57.911 } 00:16:57.911 ] 00:16:57.911 }, 00:16:57.911 { 00:16:57.911 "subsystem": "sock", 00:16:57.911 "config": [ 00:16:57.911 { 00:16:57.911 "method": "sock_impl_set_options", 00:16:57.911 "params": { 00:16:57.911 "impl_name": "posix", 00:16:57.911 "recv_buf_size": 2097152, 00:16:57.911 "send_buf_size": 2097152, 00:16:57.911 "enable_recv_pipe": true, 00:16:57.911 "enable_quickack": false, 00:16:57.911 "enable_placement_id": 0, 00:16:57.911 "enable_zerocopy_send_server": true, 00:16:57.911 "enable_zerocopy_send_client": false, 00:16:57.911 "zerocopy_threshold": 0, 00:16:57.911 "tls_version": 0, 00:16:57.911 "enable_ktls": false 00:16:57.911 } 00:16:57.911 }, 00:16:57.911 { 00:16:57.911 "method": "sock_impl_set_options", 00:16:57.911 "params": { 00:16:57.911 "impl_name": "ssl", 00:16:57.911 "recv_buf_size": 4096, 00:16:57.911 "send_buf_size": 4096, 00:16:57.911 "enable_recv_pipe": true, 00:16:57.911 "enable_quickack": false, 00:16:57.911 "enable_placement_id": 0, 00:16:57.911 "enable_zerocopy_send_server": true, 00:16:57.911 "enable_zerocopy_send_client": false, 00:16:57.911 "zerocopy_threshold": 0, 00:16:57.911 "tls_version": 0, 00:16:57.911 "enable_ktls": false 00:16:57.911 } 00:16:57.911 } 00:16:57.911 ] 00:16:57.911 }, 00:16:57.911 { 00:16:57.911 "subsystem": "vmd", 00:16:57.911 "config": [] 00:16:57.911 }, 00:16:57.911 { 00:16:57.911 "subsystem": "accel", 00:16:57.911 "config": [ 00:16:57.911 { 00:16:57.911 "method": "accel_set_options", 00:16:57.911 "params": { 00:16:57.911 "small_cache_size": 128, 00:16:57.911 "large_cache_size": 16, 00:16:57.911 "task_count": 2048, 00:16:57.911 "sequence_count": 2048, 00:16:57.911 "buf_count": 2048 00:16:57.911 } 00:16:57.911 } 00:16:57.911 ] 00:16:57.911 }, 00:16:57.911 { 00:16:57.911 "subsystem": "bdev", 00:16:57.911 "config": [ 00:16:57.911 { 00:16:57.911 "method": "bdev_set_options", 00:16:57.911 "params": { 00:16:57.911 "bdev_io_pool_size": 65535, 00:16:57.911 "bdev_io_cache_size": 256, 00:16:57.911 "bdev_auto_examine": true, 00:16:57.911 "iobuf_small_cache_size": 128, 00:16:57.911 "iobuf_large_cache_size": 16 00:16:57.911 } 00:16:57.911 }, 00:16:57.911 { 00:16:57.911 "method": "bdev_raid_set_options", 00:16:57.911 "params": { 00:16:57.911 "process_window_size_kb": 1024 00:16:57.911 } 00:16:57.911 }, 00:16:57.911 { 00:16:57.911 "method": "bdev_iscsi_set_options", 00:16:57.911 "params": { 00:16:57.911 "timeout_sec": 30 00:16:57.911 } 00:16:57.911 }, 00:16:57.911 { 00:16:57.911 "method": "bdev_nvme_set_options", 00:16:57.911 "params": { 00:16:57.911 "action_on_timeout": "none", 00:16:57.911 "timeout_us": 0, 00:16:57.911 "timeout_admin_us": 0, 00:16:57.911 "keep_alive_timeout_ms": 10000, 00:16:57.911 "transport_retry_count": 4, 00:16:57.911 "arbitration_burst": 0, 00:16:57.911 "low_priority_weight": 0, 00:16:57.911 "medium_priority_weight": 0, 00:16:57.911 "high_priority_weight": 0, 00:16:57.911 "nvme_adminq_poll_period_us": 10000, 00:16:57.911 "nvme_ioq_poll_period_us": 0, 00:16:57.911 "io_queue_requests": 0, 00:16:57.911 "delay_cmd_submit": true, 00:16:57.911 "bdev_retry_count": 3, 00:16:57.911 "transport_ack_timeout": 0, 00:16:57.911 "ctrlr_loss_timeout_sec": 0, 00:16:57.911 "reconnect_delay_sec": 0, 00:16:57.911 "fast_io_fail_timeout_sec": 0, 00:16:57.911 "generate_uuids": false, 00:16:57.911 "transport_tos": 0, 00:16:57.911 "io_path_stat": false, 00:16:57.911 "allow_accel_sequence": false 00:16:57.911 } 00:16:57.911 }, 00:16:57.912 { 00:16:57.912 "method": "bdev_nvme_set_hotplug", 00:16:57.912 "params": { 00:16:57.912 "period_us": 100000, 00:16:57.912 "enable": false 00:16:57.912 } 00:16:57.912 }, 00:16:57.912 { 00:16:57.912 "method": "bdev_malloc_create", 00:16:57.912 "params": { 00:16:57.912 "name": "malloc0", 00:16:57.912 "num_blocks": 8192, 00:16:57.912 "block_size": 4096, 00:16:57.912 "physical_block_size": 4096, 00:16:57.912 "uuid": "4735bee8-67ee-41a4-923a-b1b4ef0cf8ba", 00:16:57.912 "optimal_io_boundary": 0 00:16:57.912 } 00:16:57.912 }, 00:16:57.912 { 00:16:57.912 "method": "bdev_wait_for_examine" 00:16:57.912 } 00:16:57.912 ] 00:16:57.912 }, 00:16:57.912 { 00:16:57.912 "subsystem": "nbd", 00:16:57.912 "config": [] 00:16:57.912 }, 00:16:57.912 { 00:16:57.912 "subsystem": "scheduler", 00:16:57.912 "config": [ 00:16:57.912 { 00:16:57.912 "method": "framework_set_scheduler", 00:16:57.912 "params": { 00:16:57.912 "name": "static" 00:16:57.912 } 00:16:57.912 } 00:16:57.912 ] 00:16:57.912 }, 00:16:57.912 { 00:16:57.912 "subsystem": "nvmf", 00:16:57.912 "config": [ 00:16:57.912 { 00:16:57.912 "method": "nvmf_set_config", 00:16:57.912 "params": { 00:16:57.912 "discovery_filter": "match_any", 00:16:57.912 "admin_cmd_passthru": { 00:16:57.912 "identify_ctrlr": false 00:16:57.912 } 00:16:57.912 } 00:16:57.912 }, 00:16:57.912 { 00:16:57.912 "method": "nvmf_set_max_subsystems", 00:16:57.912 "params": { 00:16:57.912 "max_subsystems": 1024 00:16:57.912 } 00:16:57.912 }, 00:16:57.912 { 00:16:57.912 "method": "nvmf_set_crdt", 00:16:57.912 "params": { 00:16:57.912 "crdt1": 0, 00:16:57.912 "crdt2": 0, 00:16:57.912 "crdt3": 0 00:16:57.912 } 00:16:57.912 }, 00:16:57.912 { 00:16:57.912 "method": "nvmf_create_transport", 00:16:57.912 "params": { 00:16:57.912 "trtype": "TCP", 00:16:57.912 "max_queue_depth": 128, 00:16:57.912 "max_io_qpairs_per_ctrlr": 127, 00:16:57.912 "in_capsule_data_size": 4096, 00:16:57.912 "max_io_size": 131072, 00:16:57.912 "io_unit_size": 131072, 00:16:57.912 "max_aq_depth": 128, 00:16:57.912 "num_shared_buffers": 511, 00:16:57.912 "buf_cache_size": 4294967295, 00:16:57.912 "dif_insert_or_strip": false, 00:16:57.912 "zcopy": false, 00:16:57.912 "c2h_success": false, 00:16:57.912 "sock_priority": 0, 00:16:57.912 "abort_timeout_sec": 1 00:16:57.912 } 00:16:57.912 }, 00:16:57.912 { 00:16:57.912 "method": "nvmf_create_subsystem", 00:16:57.912 "params": { 00:16:57.912 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:16:57.912 "allow_any_host": false, 00:16:57.912 "serial_number": "SPDK00000000000001", 00:16:57.912 "model_number": "SPDK bdev Controller", 00:16:57.912 "max_namespaces": 10, 00:16:57.912 "min_cntlid": 1, 00:16:57.912 "max_cntlid": 65519, 00:16:57.912 "ana_reporting": false 00:16:57.912 } 00:16:57.912 }, 00:16:57.912 { 00:16:57.912 "method": "nvmf_subsystem_add_host", 00:16:57.912 "params": { 00:16:57.912 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:16:57.912 "host": "nqn.2016-06.io.spdk:host1", 00:16:57.912 "psk": "/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt" 00:16:57.912 } 00:16:57.912 }, 00:16:57.912 { 00:16:57.912 "method": "nvmf_subsystem_add_ns", 00:16:57.912 "params": { 00:16:57.912 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:16:57.912 "namespace": { 00:16:57.912 "nsid": 1, 00:16:57.912 "bdev_name": "malloc0", 00:16:57.912 "nguid": "4735BEE867EE41A4923AB1B4EF0CF8BA", 00:16:57.912 "uuid": "4735bee8-67ee-41a4-923a-b1b4ef0cf8ba" 00:16:57.912 } 00:16:57.912 } 00:16:57.912 }, 00:16:57.912 { 00:16:57.912 "method": "nvmf_subsystem_add_listener", 00:16:57.912 "params": { 00:16:57.912 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:16:57.912 "listen_address": { 00:16:57.912 "trtype": "TCP", 00:16:57.912 "adrfam": "IPv4", 00:16:57.912 "traddr": "10.0.0.2", 00:16:57.912 "trsvcid": "4420" 00:16:57.912 }, 00:16:57.912 "secure_channel": true 00:16:57.912 } 00:16:57.912 } 00:16:57.912 ] 00:16:57.912 } 00:16:57.912 ] 00:16:57.912 }' 00:16:57.912 22:54:48 -- nvmf/common.sh@469 -- # nvmfpid=293553 00:16:57.912 22:54:48 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x2 -c /dev/fd/62 00:16:57.912 22:54:48 -- nvmf/common.sh@470 -- # waitforlisten 293553 00:16:57.912 22:54:48 -- common/autotest_common.sh@819 -- # '[' -z 293553 ']' 00:16:57.912 22:54:48 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk.sock 00:16:57.912 22:54:48 -- common/autotest_common.sh@824 -- # local max_retries=100 00:16:57.912 22:54:48 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:16:57.912 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:16:57.912 22:54:48 -- common/autotest_common.sh@828 -- # xtrace_disable 00:16:57.912 22:54:48 -- common/autotest_common.sh@10 -- # set +x 00:16:57.912 [2024-04-16 22:54:49.033114] Starting SPDK v24.01.1-pre git sha1 4b134b4ab / DPDK 23.11.0 initialization... 00:16:57.912 [2024-04-16 22:54:49.033212] [ DPDK EAL parameters: nvmf -c 0x2 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:16:58.169 EAL: No free 2048 kB hugepages reported on node 1 00:16:58.169 [2024-04-16 22:54:49.097344] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:16:58.169 [2024-04-16 22:54:49.202407] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:16:58.169 [2024-04-16 22:54:49.202548] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:16:58.169 [2024-04-16 22:54:49.202563] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:16:58.169 [2024-04-16 22:54:49.202575] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:16:58.169 [2024-04-16 22:54:49.202600] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:16:58.427 [2024-04-16 22:54:49.434190] tcp.c: 659:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:16:58.427 [2024-04-16 22:54:49.466202] tcp.c: 912:nvmf_tcp_listen: *NOTICE*: TLS support is considered experimental 00:16:58.427 [2024-04-16 22:54:49.466430] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:16:58.993 22:54:49 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:16:58.993 22:54:49 -- common/autotest_common.sh@852 -- # return 0 00:16:58.993 22:54:49 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:16:58.993 22:54:49 -- common/autotest_common.sh@718 -- # xtrace_disable 00:16:58.993 22:54:49 -- common/autotest_common.sh@10 -- # set +x 00:16:58.993 22:54:50 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:16:58.993 22:54:50 -- target/tls.sh@216 -- # bdevperf_pid=293704 00:16:58.993 22:54:50 -- target/tls.sh@217 -- # waitforlisten 293704 /var/tmp/bdevperf.sock 00:16:58.993 22:54:50 -- common/autotest_common.sh@819 -- # '[' -z 293704 ']' 00:16:58.993 22:54:50 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:16:58.993 22:54:50 -- common/autotest_common.sh@824 -- # local max_retries=100 00:16:58.993 22:54:50 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:16:58.993 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:16:58.993 22:54:50 -- target/tls.sh@213 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 0x4 -z -r /var/tmp/bdevperf.sock -q 128 -o 4096 -w verify -t 10 -c /dev/fd/63 00:16:58.993 22:54:50 -- common/autotest_common.sh@828 -- # xtrace_disable 00:16:58.993 22:54:50 -- target/tls.sh@213 -- # echo '{ 00:16:58.993 "subsystems": [ 00:16:58.993 { 00:16:58.993 "subsystem": "iobuf", 00:16:58.993 "config": [ 00:16:58.993 { 00:16:58.993 "method": "iobuf_set_options", 00:16:58.993 "params": { 00:16:58.993 "small_pool_count": 8192, 00:16:58.993 "large_pool_count": 1024, 00:16:58.993 "small_bufsize": 8192, 00:16:58.993 "large_bufsize": 135168 00:16:58.993 } 00:16:58.993 } 00:16:58.993 ] 00:16:58.993 }, 00:16:58.993 { 00:16:58.993 "subsystem": "sock", 00:16:58.993 "config": [ 00:16:58.993 { 00:16:58.993 "method": "sock_impl_set_options", 00:16:58.993 "params": { 00:16:58.993 "impl_name": "posix", 00:16:58.993 "recv_buf_size": 2097152, 00:16:58.993 "send_buf_size": 2097152, 00:16:58.993 "enable_recv_pipe": true, 00:16:58.993 "enable_quickack": false, 00:16:58.993 "enable_placement_id": 0, 00:16:58.993 "enable_zerocopy_send_server": true, 00:16:58.993 "enable_zerocopy_send_client": false, 00:16:58.993 "zerocopy_threshold": 0, 00:16:58.993 "tls_version": 0, 00:16:58.993 "enable_ktls": false 00:16:58.993 } 00:16:58.993 }, 00:16:58.993 { 00:16:58.993 "method": "sock_impl_set_options", 00:16:58.993 "params": { 00:16:58.993 "impl_name": "ssl", 00:16:58.993 "recv_buf_size": 4096, 00:16:58.993 "send_buf_size": 4096, 00:16:58.993 "enable_recv_pipe": true, 00:16:58.993 "enable_quickack": false, 00:16:58.993 "enable_placement_id": 0, 00:16:58.993 "enable_zerocopy_send_server": true, 00:16:58.993 "enable_zerocopy_send_client": false, 00:16:58.993 "zerocopy_threshold": 0, 00:16:58.993 "tls_version": 0, 00:16:58.993 "enable_ktls": false 00:16:58.993 } 00:16:58.993 } 00:16:58.993 ] 00:16:58.993 }, 00:16:58.993 { 00:16:58.993 "subsystem": "vmd", 00:16:58.993 "config": [] 00:16:58.993 }, 00:16:58.993 { 00:16:58.993 "subsystem": "accel", 00:16:58.993 "config": [ 00:16:58.993 { 00:16:58.993 "method": "accel_set_options", 00:16:58.993 "params": { 00:16:58.993 "small_cache_size": 128, 00:16:58.993 "large_cache_size": 16, 00:16:58.993 "task_count": 2048, 00:16:58.993 "sequence_count": 2048, 00:16:58.993 "buf_count": 2048 00:16:58.993 } 00:16:58.993 } 00:16:58.993 ] 00:16:58.993 }, 00:16:58.993 { 00:16:58.993 "subsystem": "bdev", 00:16:58.993 "config": [ 00:16:58.993 { 00:16:58.993 "method": "bdev_set_options", 00:16:58.993 "params": { 00:16:58.993 "bdev_io_pool_size": 65535, 00:16:58.993 "bdev_io_cache_size": 256, 00:16:58.993 "bdev_auto_examine": true, 00:16:58.993 "iobuf_small_cache_size": 128, 00:16:58.993 "iobuf_large_cache_size": 16 00:16:58.993 } 00:16:58.993 }, 00:16:58.993 { 00:16:58.993 "method": "bdev_raid_set_options", 00:16:58.993 "params": { 00:16:58.993 "process_window_size_kb": 1024 00:16:58.993 } 00:16:58.993 }, 00:16:58.993 { 00:16:58.993 "method": "bdev_iscsi_set_options", 00:16:58.993 "params": { 00:16:58.993 "timeout_sec": 30 00:16:58.993 } 00:16:58.993 }, 00:16:58.993 { 00:16:58.993 "method": "bdev_nvme_set_options", 00:16:58.993 "params": { 00:16:58.993 "action_on_timeout": "none", 00:16:58.993 "timeout_us": 0, 00:16:58.993 "timeout_admin_us": 0, 00:16:58.993 "keep_alive_timeout_ms": 10000, 00:16:58.993 "transport_retry_count": 4, 00:16:58.993 "arbitration_burst": 0, 00:16:58.993 "low_priority_weight": 0, 00:16:58.993 "medium_priority_weight": 0, 00:16:58.993 "high_priority_weight": 0, 00:16:58.993 "nvme_adminq_poll_period_us": 10000, 00:16:58.993 "nvme_ioq_poll_period_us": 0, 00:16:58.993 "io_queue_requests": 512, 00:16:58.993 "delay_cmd_submit": true, 00:16:58.993 "bdev_retry_count": 3, 00:16:58.993 "transport_ack_timeout": 0, 00:16:58.993 "ctrlr_loss_timeout_sec": 0, 00:16:58.993 "reconnect_delay_sec": 0, 00:16:58.993 "fast_io_fail_timeout_sec": 0, 00:16:58.993 "generate_uuids": false, 00:16:58.993 "transport_tos": 0, 00:16:58.993 "io_path_stat": false, 00:16:58.993 "allow_accel_sequence": false 00:16:58.993 } 00:16:58.993 }, 00:16:58.993 { 00:16:58.993 "method": "bdev_nvme_attach_controller", 00:16:58.993 "params": { 00:16:58.993 "name": "TLSTEST", 00:16:58.993 "trtype": "TCP", 00:16:58.993 "adrfam": "IPv4", 00:16:58.993 "traddr": "10.0.0.2", 00:16:58.993 "trsvcid": "4420", 00:16:58.993 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:16:58.993 "prchk_reftag": false, 00:16:58.993 "prchk_guard": false, 00:16:58.993 "ctrlr_loss_timeout_sec": 0, 00:16:58.993 "reconnect_delay_sec": 0, 00:16:58.993 "fast_io_fail_timeout_sec": 0, 00:16:58.993 "psk": "/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt", 00:16:58.993 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:16:58.993 "hdgst": false, 00:16:58.993 "ddgst": false 00:16:58.993 } 00:16:58.993 }, 00:16:58.993 { 00:16:58.993 "method": "bdev_nvme_set_hotplug", 00:16:58.993 "params": { 00:16:58.993 "period_us": 100000, 00:16:58.993 "enable": false 00:16:58.993 } 00:16:58.993 }, 00:16:58.993 { 00:16:58.993 "method": "bdev_wait_for_examine" 00:16:58.993 } 00:16:58.993 ] 00:16:58.993 }, 00:16:58.993 { 00:16:58.993 "subsystem": "nbd", 00:16:58.993 "config": [] 00:16:58.993 } 00:16:58.993 ] 00:16:58.993 }' 00:16:58.993 22:54:50 -- common/autotest_common.sh@10 -- # set +x 00:16:58.993 [2024-04-16 22:54:50.041833] Starting SPDK v24.01.1-pre git sha1 4b134b4ab / DPDK 23.11.0 initialization... 00:16:58.993 [2024-04-16 22:54:50.041915] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x4 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid293704 ] 00:16:58.994 EAL: No free 2048 kB hugepages reported on node 1 00:16:58.994 [2024-04-16 22:54:50.102439] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:16:59.252 [2024-04-16 22:54:50.206545] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:16:59.252 [2024-04-16 22:54:50.361423] bdev_nvme_rpc.c: 477:rpc_bdev_nvme_attach_controller: *NOTICE*: TLS support is considered experimental 00:17:00.207 22:54:50 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:17:00.207 22:54:50 -- common/autotest_common.sh@852 -- # return 0 00:17:00.207 22:54:50 -- target/tls.sh@220 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -t 20 -s /var/tmp/bdevperf.sock perform_tests 00:17:00.207 Running I/O for 10 seconds... 00:17:10.174 00:17:10.174 Latency(us) 00:17:10.174 Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:17:10.174 Job: TLSTESTn1 (Core Mask 0x4, workload: verify, depth: 128, IO size: 4096) 00:17:10.174 Verification LBA range: start 0x0 length 0x2000 00:17:10.174 TLSTESTn1 : 10.02 3438.36 13.43 0.00 0.00 37179.50 5412.79 44661.57 00:17:10.174 =================================================================================================================== 00:17:10.174 Total : 3438.36 13.43 0.00 0.00 37179.50 5412.79 44661.57 00:17:10.174 0 00:17:10.174 22:55:01 -- target/tls.sh@222 -- # trap 'nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:17:10.174 22:55:01 -- target/tls.sh@223 -- # killprocess 293704 00:17:10.174 22:55:01 -- common/autotest_common.sh@926 -- # '[' -z 293704 ']' 00:17:10.174 22:55:01 -- common/autotest_common.sh@930 -- # kill -0 293704 00:17:10.174 22:55:01 -- common/autotest_common.sh@931 -- # uname 00:17:10.174 22:55:01 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:17:10.174 22:55:01 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 293704 00:17:10.174 22:55:01 -- common/autotest_common.sh@932 -- # process_name=reactor_2 00:17:10.174 22:55:01 -- common/autotest_common.sh@936 -- # '[' reactor_2 = sudo ']' 00:17:10.174 22:55:01 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 293704' 00:17:10.174 killing process with pid 293704 00:17:10.174 22:55:01 -- common/autotest_common.sh@945 -- # kill 293704 00:17:10.174 Received shutdown signal, test time was about 10.000000 seconds 00:17:10.174 00:17:10.174 Latency(us) 00:17:10.174 Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:17:10.174 =================================================================================================================== 00:17:10.174 Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:17:10.174 22:55:01 -- common/autotest_common.sh@950 -- # wait 293704 00:17:10.441 22:55:01 -- target/tls.sh@224 -- # killprocess 293553 00:17:10.441 22:55:01 -- common/autotest_common.sh@926 -- # '[' -z 293553 ']' 00:17:10.441 22:55:01 -- common/autotest_common.sh@930 -- # kill -0 293553 00:17:10.441 22:55:01 -- common/autotest_common.sh@931 -- # uname 00:17:10.441 22:55:01 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:17:10.441 22:55:01 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 293553 00:17:10.441 22:55:01 -- common/autotest_common.sh@932 -- # process_name=reactor_1 00:17:10.441 22:55:01 -- common/autotest_common.sh@936 -- # '[' reactor_1 = sudo ']' 00:17:10.441 22:55:01 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 293553' 00:17:10.441 killing process with pid 293553 00:17:10.441 22:55:01 -- common/autotest_common.sh@945 -- # kill 293553 00:17:10.441 22:55:01 -- common/autotest_common.sh@950 -- # wait 293553 00:17:10.739 22:55:01 -- target/tls.sh@226 -- # trap - SIGINT SIGTERM EXIT 00:17:10.739 22:55:01 -- target/tls.sh@227 -- # cleanup 00:17:10.739 22:55:01 -- target/tls.sh@15 -- # process_shm --id 0 00:17:10.739 22:55:01 -- common/autotest_common.sh@796 -- # type=--id 00:17:10.739 22:55:01 -- common/autotest_common.sh@797 -- # id=0 00:17:10.739 22:55:01 -- common/autotest_common.sh@798 -- # '[' --id = --pid ']' 00:17:10.739 22:55:01 -- common/autotest_common.sh@802 -- # find /dev/shm -name '*.0' -printf '%f\n' 00:17:10.739 22:55:01 -- common/autotest_common.sh@802 -- # shm_files=nvmf_trace.0 00:17:10.739 22:55:01 -- common/autotest_common.sh@804 -- # [[ -z nvmf_trace.0 ]] 00:17:10.739 22:55:01 -- common/autotest_common.sh@808 -- # for n in $shm_files 00:17:10.739 22:55:01 -- common/autotest_common.sh@809 -- # tar -C /dev/shm/ -cvzf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/nvmf_trace.0_shm.tar.gz nvmf_trace.0 00:17:10.739 nvmf_trace.0 00:17:10.739 22:55:01 -- common/autotest_common.sh@811 -- # return 0 00:17:10.739 22:55:01 -- target/tls.sh@16 -- # killprocess 293704 00:17:10.739 22:55:01 -- common/autotest_common.sh@926 -- # '[' -z 293704 ']' 00:17:10.739 22:55:01 -- common/autotest_common.sh@930 -- # kill -0 293704 00:17:10.739 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/autotest_common.sh: line 930: kill: (293704) - No such process 00:17:10.739 22:55:01 -- common/autotest_common.sh@953 -- # echo 'Process with pid 293704 is not found' 00:17:10.739 Process with pid 293704 is not found 00:17:10.739 22:55:01 -- target/tls.sh@17 -- # nvmftestfini 00:17:10.739 22:55:01 -- nvmf/common.sh@476 -- # nvmfcleanup 00:17:10.739 22:55:01 -- nvmf/common.sh@116 -- # sync 00:17:10.739 22:55:01 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:17:10.739 22:55:01 -- nvmf/common.sh@119 -- # set +e 00:17:10.739 22:55:01 -- nvmf/common.sh@120 -- # for i in {1..20} 00:17:10.739 22:55:01 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:17:10.739 rmmod nvme_tcp 00:17:10.739 rmmod nvme_fabrics 00:17:10.739 rmmod nvme_keyring 00:17:10.740 22:55:01 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:17:10.740 22:55:01 -- nvmf/common.sh@123 -- # set -e 00:17:10.740 22:55:01 -- nvmf/common.sh@124 -- # return 0 00:17:10.740 22:55:01 -- nvmf/common.sh@477 -- # '[' -n 293553 ']' 00:17:10.740 22:55:01 -- nvmf/common.sh@478 -- # killprocess 293553 00:17:10.740 22:55:01 -- common/autotest_common.sh@926 -- # '[' -z 293553 ']' 00:17:10.740 22:55:01 -- common/autotest_common.sh@930 -- # kill -0 293553 00:17:10.740 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/autotest_common.sh: line 930: kill: (293553) - No such process 00:17:10.740 22:55:01 -- common/autotest_common.sh@953 -- # echo 'Process with pid 293553 is not found' 00:17:10.740 Process with pid 293553 is not found 00:17:10.740 22:55:01 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:17:10.740 22:55:01 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:17:10.740 22:55:01 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:17:10.740 22:55:01 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:17:10.740 22:55:01 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:17:10.740 22:55:01 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:17:10.740 22:55:01 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:17:10.740 22:55:01 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:17:13.270 22:55:03 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:17:13.270 22:55:03 -- target/tls.sh@18 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key2.txt /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:17:13.270 00:17:13.270 real 1m14.275s 00:17:13.270 user 1m57.435s 00:17:13.270 sys 0m25.760s 00:17:13.270 22:55:03 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:17:13.270 22:55:03 -- common/autotest_common.sh@10 -- # set +x 00:17:13.270 ************************************ 00:17:13.270 END TEST nvmf_tls 00:17:13.270 ************************************ 00:17:13.270 22:55:03 -- nvmf/nvmf.sh@60 -- # run_test nvmf_fips /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/fips/fips.sh --transport=tcp 00:17:13.270 22:55:03 -- common/autotest_common.sh@1077 -- # '[' 3 -le 1 ']' 00:17:13.270 22:55:03 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:17:13.270 22:55:03 -- common/autotest_common.sh@10 -- # set +x 00:17:13.270 ************************************ 00:17:13.270 START TEST nvmf_fips 00:17:13.270 ************************************ 00:17:13.270 22:55:03 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/fips/fips.sh --transport=tcp 00:17:13.271 * Looking for test storage... 00:17:13.271 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/fips 00:17:13.271 22:55:03 -- fips/fips.sh@11 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:17:13.271 22:55:03 -- nvmf/common.sh@7 -- # uname -s 00:17:13.271 22:55:03 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:17:13.271 22:55:03 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:17:13.271 22:55:03 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:17:13.271 22:55:03 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:17:13.271 22:55:03 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:17:13.271 22:55:03 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:17:13.271 22:55:03 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:17:13.271 22:55:03 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:17:13.271 22:55:03 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:17:13.271 22:55:03 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:17:13.271 22:55:03 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:17:13.271 22:55:03 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:17:13.271 22:55:03 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:17:13.271 22:55:03 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:17:13.271 22:55:03 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:17:13.271 22:55:03 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:17:13.271 22:55:03 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:17:13.271 22:55:03 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:17:13.271 22:55:03 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:17:13.271 22:55:03 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:17:13.271 22:55:03 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:17:13.271 22:55:03 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:17:13.271 22:55:03 -- paths/export.sh@5 -- # export PATH 00:17:13.271 22:55:03 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:17:13.271 22:55:03 -- nvmf/common.sh@46 -- # : 0 00:17:13.271 22:55:03 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:17:13.271 22:55:03 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:17:13.271 22:55:03 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:17:13.271 22:55:03 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:17:13.271 22:55:03 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:17:13.271 22:55:03 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:17:13.271 22:55:03 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:17:13.271 22:55:03 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:17:13.271 22:55:03 -- fips/fips.sh@12 -- # rpc_py=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:17:13.271 22:55:03 -- fips/fips.sh@89 -- # check_openssl_version 00:17:13.271 22:55:03 -- fips/fips.sh@83 -- # local target=3.0.0 00:17:13.271 22:55:03 -- fips/fips.sh@85 -- # openssl version 00:17:13.271 22:55:03 -- fips/fips.sh@85 -- # awk '{print $2}' 00:17:13.271 22:55:03 -- fips/fips.sh@85 -- # ge 3.0.9 3.0.0 00:17:13.271 22:55:03 -- scripts/common.sh@375 -- # cmp_versions 3.0.9 '>=' 3.0.0 00:17:13.271 22:55:03 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:17:13.271 22:55:03 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:17:13.271 22:55:03 -- scripts/common.sh@335 -- # IFS=.-: 00:17:13.271 22:55:03 -- scripts/common.sh@335 -- # read -ra ver1 00:17:13.271 22:55:03 -- scripts/common.sh@336 -- # IFS=.-: 00:17:13.271 22:55:03 -- scripts/common.sh@336 -- # read -ra ver2 00:17:13.271 22:55:03 -- scripts/common.sh@337 -- # local 'op=>=' 00:17:13.271 22:55:03 -- scripts/common.sh@339 -- # ver1_l=3 00:17:13.271 22:55:03 -- scripts/common.sh@340 -- # ver2_l=3 00:17:13.271 22:55:03 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:17:13.271 22:55:03 -- scripts/common.sh@343 -- # case "$op" in 00:17:13.271 22:55:03 -- scripts/common.sh@347 -- # : 1 00:17:13.271 22:55:03 -- scripts/common.sh@363 -- # (( v = 0 )) 00:17:13.271 22:55:03 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:17:13.271 22:55:03 -- scripts/common.sh@364 -- # decimal 3 00:17:13.271 22:55:03 -- scripts/common.sh@352 -- # local d=3 00:17:13.271 22:55:03 -- scripts/common.sh@353 -- # [[ 3 =~ ^[0-9]+$ ]] 00:17:13.271 22:55:03 -- scripts/common.sh@354 -- # echo 3 00:17:13.271 22:55:03 -- scripts/common.sh@364 -- # ver1[v]=3 00:17:13.271 22:55:03 -- scripts/common.sh@365 -- # decimal 3 00:17:13.271 22:55:03 -- scripts/common.sh@352 -- # local d=3 00:17:13.271 22:55:03 -- scripts/common.sh@353 -- # [[ 3 =~ ^[0-9]+$ ]] 00:17:13.271 22:55:03 -- scripts/common.sh@354 -- # echo 3 00:17:13.271 22:55:03 -- scripts/common.sh@365 -- # ver2[v]=3 00:17:13.271 22:55:03 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:17:13.271 22:55:03 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:17:13.271 22:55:03 -- scripts/common.sh@363 -- # (( v++ )) 00:17:13.271 22:55:03 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:17:13.271 22:55:03 -- scripts/common.sh@364 -- # decimal 0 00:17:13.271 22:55:03 -- scripts/common.sh@352 -- # local d=0 00:17:13.271 22:55:03 -- scripts/common.sh@353 -- # [[ 0 =~ ^[0-9]+$ ]] 00:17:13.271 22:55:03 -- scripts/common.sh@354 -- # echo 0 00:17:13.271 22:55:03 -- scripts/common.sh@364 -- # ver1[v]=0 00:17:13.271 22:55:03 -- scripts/common.sh@365 -- # decimal 0 00:17:13.271 22:55:03 -- scripts/common.sh@352 -- # local d=0 00:17:13.271 22:55:03 -- scripts/common.sh@353 -- # [[ 0 =~ ^[0-9]+$ ]] 00:17:13.271 22:55:03 -- scripts/common.sh@354 -- # echo 0 00:17:13.271 22:55:03 -- scripts/common.sh@365 -- # ver2[v]=0 00:17:13.271 22:55:03 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:17:13.271 22:55:03 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:17:13.271 22:55:03 -- scripts/common.sh@363 -- # (( v++ )) 00:17:13.271 22:55:03 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:17:13.271 22:55:03 -- scripts/common.sh@364 -- # decimal 9 00:17:13.271 22:55:03 -- scripts/common.sh@352 -- # local d=9 00:17:13.271 22:55:03 -- scripts/common.sh@353 -- # [[ 9 =~ ^[0-9]+$ ]] 00:17:13.271 22:55:03 -- scripts/common.sh@354 -- # echo 9 00:17:13.271 22:55:03 -- scripts/common.sh@364 -- # ver1[v]=9 00:17:13.271 22:55:03 -- scripts/common.sh@365 -- # decimal 0 00:17:13.271 22:55:03 -- scripts/common.sh@352 -- # local d=0 00:17:13.271 22:55:03 -- scripts/common.sh@353 -- # [[ 0 =~ ^[0-9]+$ ]] 00:17:13.271 22:55:03 -- scripts/common.sh@354 -- # echo 0 00:17:13.271 22:55:03 -- scripts/common.sh@365 -- # ver2[v]=0 00:17:13.271 22:55:03 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:17:13.271 22:55:03 -- scripts/common.sh@366 -- # return 0 00:17:13.271 22:55:03 -- fips/fips.sh@95 -- # openssl info -modulesdir 00:17:13.271 22:55:03 -- fips/fips.sh@95 -- # [[ ! -f /usr/lib64/ossl-modules/fips.so ]] 00:17:13.271 22:55:03 -- fips/fips.sh@100 -- # openssl fipsinstall -help 00:17:13.271 22:55:03 -- fips/fips.sh@100 -- # warn='This command is not enabled in the Red Hat Enterprise Linux OpenSSL build, please consult Red Hat documentation to learn how to enable FIPS mode' 00:17:13.271 22:55:03 -- fips/fips.sh@101 -- # [[ This command is not enabled in the Red Hat Enterprise Linux OpenSSL build, please consult Red Hat documentation to learn how to enable FIPS mode == \T\h\i\s\ \c\o\m\m\a\n\d\ \i\s\ \n\o\t\ \e\n\a\b\l\e\d* ]] 00:17:13.271 22:55:03 -- fips/fips.sh@104 -- # export callback=build_openssl_config 00:17:13.271 22:55:03 -- fips/fips.sh@104 -- # callback=build_openssl_config 00:17:13.271 22:55:03 -- fips/fips.sh@105 -- # export OPENSSL_FORCE_FIPS_MODE=build_openssl_config 00:17:13.271 22:55:03 -- fips/fips.sh@105 -- # OPENSSL_FORCE_FIPS_MODE=build_openssl_config 00:17:13.271 22:55:03 -- fips/fips.sh@114 -- # build_openssl_config 00:17:13.271 22:55:03 -- fips/fips.sh@37 -- # cat 00:17:13.271 22:55:03 -- fips/fips.sh@57 -- # [[ ! -t 0 ]] 00:17:13.271 22:55:03 -- fips/fips.sh@58 -- # cat - 00:17:13.271 22:55:03 -- fips/fips.sh@115 -- # export OPENSSL_CONF=spdk_fips.conf 00:17:13.271 22:55:03 -- fips/fips.sh@115 -- # OPENSSL_CONF=spdk_fips.conf 00:17:13.271 22:55:03 -- fips/fips.sh@117 -- # mapfile -t providers 00:17:13.271 22:55:03 -- fips/fips.sh@117 -- # OPENSSL_CONF=spdk_fips.conf 00:17:13.271 22:55:03 -- fips/fips.sh@117 -- # openssl list -providers 00:17:13.271 22:55:03 -- fips/fips.sh@117 -- # grep name 00:17:13.271 22:55:04 -- fips/fips.sh@121 -- # (( 2 != 2 )) 00:17:13.271 22:55:04 -- fips/fips.sh@121 -- # [[ name: openssl base provider != *base* ]] 00:17:13.271 22:55:04 -- fips/fips.sh@121 -- # [[ name: red hat enterprise linux 9 - openssl fips provider != *fips* ]] 00:17:13.271 22:55:04 -- fips/fips.sh@128 -- # NOT openssl md5 /dev/fd/62 00:17:13.271 22:55:04 -- fips/fips.sh@128 -- # : 00:17:13.271 22:55:04 -- common/autotest_common.sh@640 -- # local es=0 00:17:13.271 22:55:04 -- common/autotest_common.sh@642 -- # valid_exec_arg openssl md5 /dev/fd/62 00:17:13.271 22:55:04 -- common/autotest_common.sh@628 -- # local arg=openssl 00:17:13.271 22:55:04 -- common/autotest_common.sh@632 -- # case "$(type -t "$arg")" in 00:17:13.271 22:55:04 -- common/autotest_common.sh@632 -- # type -t openssl 00:17:13.271 22:55:04 -- common/autotest_common.sh@632 -- # case "$(type -t "$arg")" in 00:17:13.271 22:55:04 -- common/autotest_common.sh@634 -- # type -P openssl 00:17:13.271 22:55:04 -- common/autotest_common.sh@632 -- # case "$(type -t "$arg")" in 00:17:13.271 22:55:04 -- common/autotest_common.sh@634 -- # arg=/usr/bin/openssl 00:17:13.271 22:55:04 -- common/autotest_common.sh@634 -- # [[ -x /usr/bin/openssl ]] 00:17:13.272 22:55:04 -- common/autotest_common.sh@643 -- # openssl md5 /dev/fd/62 00:17:13.272 Error setting digest 00:17:13.272 00829090167F0000:error:0308010C:digital envelope routines:inner_evp_generic_fetch:unsupported:crypto/evp/evp_fetch.c:373:Global default library context, Algorithm (MD5 : 97), Properties () 00:17:13.272 00829090167F0000:error:03000086:digital envelope routines:evp_md_init_internal:initialization error:crypto/evp/digest.c:254: 00:17:13.272 22:55:04 -- common/autotest_common.sh@643 -- # es=1 00:17:13.272 22:55:04 -- common/autotest_common.sh@651 -- # (( es > 128 )) 00:17:13.272 22:55:04 -- common/autotest_common.sh@662 -- # [[ -n '' ]] 00:17:13.272 22:55:04 -- common/autotest_common.sh@667 -- # (( !es == 0 )) 00:17:13.272 22:55:04 -- fips/fips.sh@131 -- # nvmftestinit 00:17:13.272 22:55:04 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:17:13.272 22:55:04 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:17:13.272 22:55:04 -- nvmf/common.sh@436 -- # prepare_net_devs 00:17:13.272 22:55:04 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:17:13.272 22:55:04 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:17:13.272 22:55:04 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:17:13.272 22:55:04 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:17:13.272 22:55:04 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:17:13.272 22:55:04 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:17:13.272 22:55:04 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:17:13.272 22:55:04 -- nvmf/common.sh@284 -- # xtrace_disable 00:17:13.272 22:55:04 -- common/autotest_common.sh@10 -- # set +x 00:17:15.173 22:55:05 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:17:15.173 22:55:05 -- nvmf/common.sh@290 -- # pci_devs=() 00:17:15.173 22:55:05 -- nvmf/common.sh@290 -- # local -a pci_devs 00:17:15.173 22:55:05 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:17:15.173 22:55:05 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:17:15.173 22:55:05 -- nvmf/common.sh@292 -- # pci_drivers=() 00:17:15.173 22:55:05 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:17:15.173 22:55:05 -- nvmf/common.sh@294 -- # net_devs=() 00:17:15.173 22:55:05 -- nvmf/common.sh@294 -- # local -ga net_devs 00:17:15.173 22:55:05 -- nvmf/common.sh@295 -- # e810=() 00:17:15.173 22:55:05 -- nvmf/common.sh@295 -- # local -ga e810 00:17:15.173 22:55:05 -- nvmf/common.sh@296 -- # x722=() 00:17:15.173 22:55:05 -- nvmf/common.sh@296 -- # local -ga x722 00:17:15.173 22:55:05 -- nvmf/common.sh@297 -- # mlx=() 00:17:15.173 22:55:05 -- nvmf/common.sh@297 -- # local -ga mlx 00:17:15.173 22:55:05 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:17:15.173 22:55:05 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:17:15.173 22:55:05 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:17:15.173 22:55:05 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:17:15.173 22:55:05 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:17:15.173 22:55:05 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:17:15.173 22:55:05 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:17:15.173 22:55:05 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:17:15.173 22:55:05 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:17:15.173 22:55:05 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:17:15.173 22:55:05 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:17:15.173 22:55:05 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:17:15.173 22:55:05 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:17:15.173 22:55:05 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:17:15.173 22:55:05 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:17:15.173 22:55:05 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:17:15.173 22:55:05 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:17:15.173 22:55:05 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:17:15.173 22:55:05 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:17:15.173 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:17:15.173 22:55:05 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:17:15.173 22:55:05 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:17:15.173 22:55:05 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:17:15.173 22:55:05 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:17:15.173 22:55:05 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:17:15.173 22:55:05 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:17:15.173 22:55:05 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:17:15.173 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:17:15.173 22:55:05 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:17:15.173 22:55:05 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:17:15.173 22:55:05 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:17:15.173 22:55:05 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:17:15.173 22:55:05 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:17:15.173 22:55:05 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:17:15.173 22:55:05 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:17:15.173 22:55:05 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:17:15.173 22:55:05 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:17:15.173 22:55:05 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:17:15.173 22:55:05 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:17:15.173 22:55:05 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:17:15.173 22:55:05 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:17:15.173 Found net devices under 0000:0a:00.0: cvl_0_0 00:17:15.173 22:55:05 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:17:15.173 22:55:05 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:17:15.173 22:55:05 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:17:15.173 22:55:05 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:17:15.173 22:55:05 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:17:15.173 22:55:05 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:17:15.173 Found net devices under 0000:0a:00.1: cvl_0_1 00:17:15.173 22:55:05 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:17:15.173 22:55:05 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:17:15.173 22:55:05 -- nvmf/common.sh@402 -- # is_hw=yes 00:17:15.173 22:55:05 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:17:15.173 22:55:05 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:17:15.173 22:55:05 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:17:15.173 22:55:05 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:17:15.173 22:55:05 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:17:15.173 22:55:05 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:17:15.173 22:55:05 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:17:15.173 22:55:05 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:17:15.173 22:55:05 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:17:15.173 22:55:05 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:17:15.173 22:55:05 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:17:15.173 22:55:05 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:17:15.173 22:55:05 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:17:15.173 22:55:05 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:17:15.173 22:55:05 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:17:15.173 22:55:05 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:17:15.173 22:55:06 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:17:15.173 22:55:06 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:17:15.173 22:55:06 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:17:15.174 22:55:06 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:17:15.174 22:55:06 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:17:15.174 22:55:06 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:17:15.174 22:55:06 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:17:15.174 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:17:15.174 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.148 ms 00:17:15.174 00:17:15.174 --- 10.0.0.2 ping statistics --- 00:17:15.174 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:17:15.174 rtt min/avg/max/mdev = 0.148/0.148/0.148/0.000 ms 00:17:15.174 22:55:06 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:17:15.174 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:17:15.174 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.154 ms 00:17:15.174 00:17:15.174 --- 10.0.0.1 ping statistics --- 00:17:15.174 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:17:15.174 rtt min/avg/max/mdev = 0.154/0.154/0.154/0.000 ms 00:17:15.174 22:55:06 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:17:15.174 22:55:06 -- nvmf/common.sh@410 -- # return 0 00:17:15.174 22:55:06 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:17:15.174 22:55:06 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:17:15.174 22:55:06 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:17:15.174 22:55:06 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:17:15.174 22:55:06 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:17:15.174 22:55:06 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:17:15.174 22:55:06 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:17:15.174 22:55:06 -- fips/fips.sh@132 -- # nvmfappstart -m 0x2 00:17:15.174 22:55:06 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:17:15.174 22:55:06 -- common/autotest_common.sh@712 -- # xtrace_disable 00:17:15.174 22:55:06 -- common/autotest_common.sh@10 -- # set +x 00:17:15.174 22:55:06 -- nvmf/common.sh@469 -- # nvmfpid=297045 00:17:15.174 22:55:06 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x2 00:17:15.174 22:55:06 -- nvmf/common.sh@470 -- # waitforlisten 297045 00:17:15.174 22:55:06 -- common/autotest_common.sh@819 -- # '[' -z 297045 ']' 00:17:15.174 22:55:06 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk.sock 00:17:15.174 22:55:06 -- common/autotest_common.sh@824 -- # local max_retries=100 00:17:15.174 22:55:06 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:17:15.174 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:17:15.174 22:55:06 -- common/autotest_common.sh@828 -- # xtrace_disable 00:17:15.174 22:55:06 -- common/autotest_common.sh@10 -- # set +x 00:17:15.174 [2024-04-16 22:55:06.197398] Starting SPDK v24.01.1-pre git sha1 4b134b4ab / DPDK 23.11.0 initialization... 00:17:15.174 [2024-04-16 22:55:06.197489] [ DPDK EAL parameters: nvmf -c 0x2 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:17:15.174 EAL: No free 2048 kB hugepages reported on node 1 00:17:15.174 [2024-04-16 22:55:06.266869] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:17:15.432 [2024-04-16 22:55:06.381501] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:17:15.432 [2024-04-16 22:55:06.381652] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:17:15.432 [2024-04-16 22:55:06.381671] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:17:15.432 [2024-04-16 22:55:06.381685] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:17:15.432 [2024-04-16 22:55:06.381721] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:17:15.998 22:55:07 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:17:15.998 22:55:07 -- common/autotest_common.sh@852 -- # return 0 00:17:15.998 22:55:07 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:17:15.998 22:55:07 -- common/autotest_common.sh@718 -- # xtrace_disable 00:17:15.998 22:55:07 -- common/autotest_common.sh@10 -- # set +x 00:17:16.256 22:55:07 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:17:16.256 22:55:07 -- fips/fips.sh@134 -- # trap cleanup EXIT 00:17:16.256 22:55:07 -- fips/fips.sh@137 -- # key=NVMeTLSkey-1:01:VRLbtnN9AQb2WXW3c9+wEf/DRLz0QuLdbYvEhwtdWwNf9LrZ: 00:17:16.256 22:55:07 -- fips/fips.sh@138 -- # key_path=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/fips/key.txt 00:17:16.256 22:55:07 -- fips/fips.sh@139 -- # echo -n NVMeTLSkey-1:01:VRLbtnN9AQb2WXW3c9+wEf/DRLz0QuLdbYvEhwtdWwNf9LrZ: 00:17:16.256 22:55:07 -- fips/fips.sh@140 -- # chmod 0600 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/fips/key.txt 00:17:16.256 22:55:07 -- fips/fips.sh@142 -- # setup_nvmf_tgt_conf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/fips/key.txt 00:17:16.256 22:55:07 -- fips/fips.sh@22 -- # local key=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/fips/key.txt 00:17:16.256 22:55:07 -- fips/fips.sh@24 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:17:16.256 [2024-04-16 22:55:07.362316] tcp.c: 659:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:17:16.256 [2024-04-16 22:55:07.378267] tcp.c: 912:nvmf_tcp_listen: *NOTICE*: TLS support is considered experimental 00:17:16.256 [2024-04-16 22:55:07.378490] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:17:16.514 malloc0 00:17:16.514 22:55:07 -- fips/fips.sh@145 -- # bdevperf_rpc_sock=/var/tmp/bdevperf.sock 00:17:16.514 22:55:07 -- fips/fips.sh@148 -- # bdevperf_pid=297330 00:17:16.514 22:55:07 -- fips/fips.sh@146 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 0x4 -z -r /var/tmp/bdevperf.sock -q 128 -o 4096 -w verify -t 10 00:17:16.514 22:55:07 -- fips/fips.sh@149 -- # waitforlisten 297330 /var/tmp/bdevperf.sock 00:17:16.514 22:55:07 -- common/autotest_common.sh@819 -- # '[' -z 297330 ']' 00:17:16.515 22:55:07 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:17:16.515 22:55:07 -- common/autotest_common.sh@824 -- # local max_retries=100 00:17:16.515 22:55:07 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:17:16.515 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:17:16.515 22:55:07 -- common/autotest_common.sh@828 -- # xtrace_disable 00:17:16.515 22:55:07 -- common/autotest_common.sh@10 -- # set +x 00:17:16.515 [2024-04-16 22:55:07.490572] Starting SPDK v24.01.1-pre git sha1 4b134b4ab / DPDK 23.11.0 initialization... 00:17:16.515 [2024-04-16 22:55:07.490664] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x4 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid297330 ] 00:17:16.515 EAL: No free 2048 kB hugepages reported on node 1 00:17:16.515 [2024-04-16 22:55:07.548937] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:17:16.772 [2024-04-16 22:55:07.658341] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:17:17.338 22:55:08 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:17:17.338 22:55:08 -- common/autotest_common.sh@852 -- # return 0 00:17:17.338 22:55:08 -- fips/fips.sh@151 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b TLSTEST -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -q nqn.2016-06.io.spdk:host1 --psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/fips/key.txt 00:17:17.595 [2024-04-16 22:55:08.674362] bdev_nvme_rpc.c: 477:rpc_bdev_nvme_attach_controller: *NOTICE*: TLS support is considered experimental 00:17:17.853 TLSTESTn1 00:17:17.853 22:55:08 -- fips/fips.sh@155 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bdevperf.sock perform_tests 00:17:17.853 Running I/O for 10 seconds... 00:17:27.817 00:17:27.817 Latency(us) 00:17:27.817 Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:17:27.817 Job: TLSTESTn1 (Core Mask 0x4, workload: verify, depth: 128, IO size: 4096) 00:17:27.817 Verification LBA range: start 0x0 length 0x2000 00:17:27.817 TLSTESTn1 : 10.03 2021.39 7.90 0.00 0.00 63215.17 9854.67 68739.98 00:17:27.817 =================================================================================================================== 00:17:27.817 Total : 2021.39 7.90 0.00 0.00 63215.17 9854.67 68739.98 00:17:27.817 0 00:17:27.817 22:55:18 -- fips/fips.sh@1 -- # cleanup 00:17:27.817 22:55:18 -- fips/fips.sh@15 -- # process_shm --id 0 00:17:27.817 22:55:18 -- common/autotest_common.sh@796 -- # type=--id 00:17:27.817 22:55:18 -- common/autotest_common.sh@797 -- # id=0 00:17:27.817 22:55:18 -- common/autotest_common.sh@798 -- # '[' --id = --pid ']' 00:17:27.817 22:55:18 -- common/autotest_common.sh@802 -- # find /dev/shm -name '*.0' -printf '%f\n' 00:17:27.817 22:55:18 -- common/autotest_common.sh@802 -- # shm_files=nvmf_trace.0 00:17:27.817 22:55:18 -- common/autotest_common.sh@804 -- # [[ -z nvmf_trace.0 ]] 00:17:27.817 22:55:18 -- common/autotest_common.sh@808 -- # for n in $shm_files 00:17:27.817 22:55:18 -- common/autotest_common.sh@809 -- # tar -C /dev/shm/ -cvzf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/nvmf_trace.0_shm.tar.gz nvmf_trace.0 00:17:27.817 nvmf_trace.0 00:17:28.075 22:55:18 -- common/autotest_common.sh@811 -- # return 0 00:17:28.075 22:55:18 -- fips/fips.sh@16 -- # killprocess 297330 00:17:28.075 22:55:18 -- common/autotest_common.sh@926 -- # '[' -z 297330 ']' 00:17:28.075 22:55:18 -- common/autotest_common.sh@930 -- # kill -0 297330 00:17:28.075 22:55:18 -- common/autotest_common.sh@931 -- # uname 00:17:28.075 22:55:18 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:17:28.075 22:55:18 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 297330 00:17:28.075 22:55:19 -- common/autotest_common.sh@932 -- # process_name=reactor_2 00:17:28.075 22:55:19 -- common/autotest_common.sh@936 -- # '[' reactor_2 = sudo ']' 00:17:28.075 22:55:19 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 297330' 00:17:28.075 killing process with pid 297330 00:17:28.075 22:55:19 -- common/autotest_common.sh@945 -- # kill 297330 00:17:28.075 Received shutdown signal, test time was about 10.000000 seconds 00:17:28.075 00:17:28.075 Latency(us) 00:17:28.075 Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:17:28.075 =================================================================================================================== 00:17:28.075 Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:17:28.075 22:55:19 -- common/autotest_common.sh@950 -- # wait 297330 00:17:28.333 22:55:19 -- fips/fips.sh@17 -- # nvmftestfini 00:17:28.333 22:55:19 -- nvmf/common.sh@476 -- # nvmfcleanup 00:17:28.333 22:55:19 -- nvmf/common.sh@116 -- # sync 00:17:28.333 22:55:19 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:17:28.333 22:55:19 -- nvmf/common.sh@119 -- # set +e 00:17:28.333 22:55:19 -- nvmf/common.sh@120 -- # for i in {1..20} 00:17:28.333 22:55:19 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:17:28.333 rmmod nvme_tcp 00:17:28.333 rmmod nvme_fabrics 00:17:28.333 rmmod nvme_keyring 00:17:28.333 22:55:19 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:17:28.333 22:55:19 -- nvmf/common.sh@123 -- # set -e 00:17:28.333 22:55:19 -- nvmf/common.sh@124 -- # return 0 00:17:28.333 22:55:19 -- nvmf/common.sh@477 -- # '[' -n 297045 ']' 00:17:28.333 22:55:19 -- nvmf/common.sh@478 -- # killprocess 297045 00:17:28.333 22:55:19 -- common/autotest_common.sh@926 -- # '[' -z 297045 ']' 00:17:28.333 22:55:19 -- common/autotest_common.sh@930 -- # kill -0 297045 00:17:28.333 22:55:19 -- common/autotest_common.sh@931 -- # uname 00:17:28.333 22:55:19 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:17:28.333 22:55:19 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 297045 00:17:28.333 22:55:19 -- common/autotest_common.sh@932 -- # process_name=reactor_1 00:17:28.333 22:55:19 -- common/autotest_common.sh@936 -- # '[' reactor_1 = sudo ']' 00:17:28.333 22:55:19 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 297045' 00:17:28.333 killing process with pid 297045 00:17:28.333 22:55:19 -- common/autotest_common.sh@945 -- # kill 297045 00:17:28.333 22:55:19 -- common/autotest_common.sh@950 -- # wait 297045 00:17:28.591 22:55:19 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:17:28.591 22:55:19 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:17:28.591 22:55:19 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:17:28.591 22:55:19 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:17:28.591 22:55:19 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:17:28.591 22:55:19 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:17:28.591 22:55:19 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:17:28.591 22:55:19 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:17:31.124 22:55:21 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:17:31.124 22:55:21 -- fips/fips.sh@18 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/fips/key.txt 00:17:31.124 00:17:31.124 real 0m17.832s 00:17:31.124 user 0m16.970s 00:17:31.124 sys 0m6.167s 00:17:31.124 22:55:21 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:17:31.124 22:55:21 -- common/autotest_common.sh@10 -- # set +x 00:17:31.124 ************************************ 00:17:31.124 END TEST nvmf_fips 00:17:31.124 ************************************ 00:17:31.124 22:55:21 -- nvmf/nvmf.sh@63 -- # '[' 1 -eq 1 ']' 00:17:31.124 22:55:21 -- nvmf/nvmf.sh@64 -- # run_test nvmf_fuzz /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/fabrics_fuzz.sh --transport=tcp 00:17:31.124 22:55:21 -- common/autotest_common.sh@1077 -- # '[' 3 -le 1 ']' 00:17:31.124 22:55:21 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:17:31.124 22:55:21 -- common/autotest_common.sh@10 -- # set +x 00:17:31.124 ************************************ 00:17:31.124 START TEST nvmf_fuzz 00:17:31.124 ************************************ 00:17:31.125 22:55:21 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/fabrics_fuzz.sh --transport=tcp 00:17:31.125 * Looking for test storage... 00:17:31.125 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:17:31.125 22:55:21 -- target/fabrics_fuzz.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:17:31.125 22:55:21 -- nvmf/common.sh@7 -- # uname -s 00:17:31.125 22:55:21 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:17:31.125 22:55:21 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:17:31.125 22:55:21 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:17:31.125 22:55:21 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:17:31.125 22:55:21 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:17:31.125 22:55:21 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:17:31.125 22:55:21 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:17:31.125 22:55:21 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:17:31.125 22:55:21 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:17:31.125 22:55:21 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:17:31.125 22:55:21 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:17:31.125 22:55:21 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:17:31.125 22:55:21 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:17:31.125 22:55:21 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:17:31.125 22:55:21 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:17:31.125 22:55:21 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:17:31.125 22:55:21 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:17:31.125 22:55:21 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:17:31.125 22:55:21 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:17:31.125 22:55:21 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:17:31.125 22:55:21 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:17:31.125 22:55:21 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:17:31.125 22:55:21 -- paths/export.sh@5 -- # export PATH 00:17:31.125 22:55:21 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:17:31.125 22:55:21 -- nvmf/common.sh@46 -- # : 0 00:17:31.125 22:55:21 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:17:31.125 22:55:21 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:17:31.125 22:55:21 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:17:31.125 22:55:21 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:17:31.125 22:55:21 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:17:31.125 22:55:21 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:17:31.125 22:55:21 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:17:31.125 22:55:21 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:17:31.125 22:55:21 -- target/fabrics_fuzz.sh@11 -- # nvmftestinit 00:17:31.125 22:55:21 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:17:31.125 22:55:21 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:17:31.125 22:55:21 -- nvmf/common.sh@436 -- # prepare_net_devs 00:17:31.125 22:55:21 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:17:31.125 22:55:21 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:17:31.125 22:55:21 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:17:31.125 22:55:21 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:17:31.125 22:55:21 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:17:31.125 22:55:21 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:17:31.125 22:55:21 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:17:31.125 22:55:21 -- nvmf/common.sh@284 -- # xtrace_disable 00:17:31.125 22:55:21 -- common/autotest_common.sh@10 -- # set +x 00:17:33.026 22:55:23 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:17:33.026 22:55:23 -- nvmf/common.sh@290 -- # pci_devs=() 00:17:33.026 22:55:23 -- nvmf/common.sh@290 -- # local -a pci_devs 00:17:33.026 22:55:23 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:17:33.026 22:55:23 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:17:33.026 22:55:23 -- nvmf/common.sh@292 -- # pci_drivers=() 00:17:33.026 22:55:23 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:17:33.026 22:55:23 -- nvmf/common.sh@294 -- # net_devs=() 00:17:33.026 22:55:23 -- nvmf/common.sh@294 -- # local -ga net_devs 00:17:33.026 22:55:23 -- nvmf/common.sh@295 -- # e810=() 00:17:33.026 22:55:23 -- nvmf/common.sh@295 -- # local -ga e810 00:17:33.026 22:55:23 -- nvmf/common.sh@296 -- # x722=() 00:17:33.026 22:55:23 -- nvmf/common.sh@296 -- # local -ga x722 00:17:33.026 22:55:23 -- nvmf/common.sh@297 -- # mlx=() 00:17:33.026 22:55:23 -- nvmf/common.sh@297 -- # local -ga mlx 00:17:33.026 22:55:23 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:17:33.026 22:55:23 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:17:33.026 22:55:23 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:17:33.026 22:55:23 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:17:33.026 22:55:23 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:17:33.026 22:55:23 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:17:33.026 22:55:23 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:17:33.026 22:55:23 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:17:33.026 22:55:23 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:17:33.026 22:55:23 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:17:33.026 22:55:23 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:17:33.026 22:55:23 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:17:33.026 22:55:23 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:17:33.026 22:55:23 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:17:33.026 22:55:23 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:17:33.026 22:55:23 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:17:33.026 22:55:23 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:17:33.026 22:55:23 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:17:33.026 22:55:23 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:17:33.026 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:17:33.026 22:55:23 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:17:33.026 22:55:23 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:17:33.026 22:55:23 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:17:33.026 22:55:23 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:17:33.026 22:55:23 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:17:33.026 22:55:23 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:17:33.026 22:55:23 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:17:33.027 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:17:33.027 22:55:23 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:17:33.027 22:55:23 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:17:33.027 22:55:23 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:17:33.027 22:55:23 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:17:33.027 22:55:23 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:17:33.027 22:55:23 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:17:33.027 22:55:23 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:17:33.027 22:55:23 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:17:33.027 22:55:23 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:17:33.027 22:55:23 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:17:33.027 22:55:23 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:17:33.027 22:55:23 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:17:33.027 22:55:23 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:17:33.027 Found net devices under 0000:0a:00.0: cvl_0_0 00:17:33.027 22:55:23 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:17:33.027 22:55:23 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:17:33.027 22:55:23 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:17:33.027 22:55:23 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:17:33.027 22:55:23 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:17:33.027 22:55:23 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:17:33.027 Found net devices under 0000:0a:00.1: cvl_0_1 00:17:33.027 22:55:23 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:17:33.027 22:55:23 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:17:33.027 22:55:23 -- nvmf/common.sh@402 -- # is_hw=yes 00:17:33.027 22:55:23 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:17:33.027 22:55:23 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:17:33.027 22:55:23 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:17:33.027 22:55:23 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:17:33.027 22:55:23 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:17:33.027 22:55:23 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:17:33.027 22:55:23 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:17:33.027 22:55:23 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:17:33.027 22:55:23 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:17:33.027 22:55:23 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:17:33.027 22:55:23 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:17:33.027 22:55:23 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:17:33.027 22:55:23 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:17:33.027 22:55:23 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:17:33.027 22:55:23 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:17:33.027 22:55:23 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:17:33.027 22:55:23 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:17:33.027 22:55:23 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:17:33.027 22:55:23 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:17:33.027 22:55:23 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:17:33.027 22:55:23 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:17:33.027 22:55:23 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:17:33.027 22:55:23 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:17:33.027 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:17:33.027 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.216 ms 00:17:33.027 00:17:33.027 --- 10.0.0.2 ping statistics --- 00:17:33.027 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:17:33.027 rtt min/avg/max/mdev = 0.216/0.216/0.216/0.000 ms 00:17:33.027 22:55:23 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:17:33.027 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:17:33.027 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.109 ms 00:17:33.027 00:17:33.027 --- 10.0.0.1 ping statistics --- 00:17:33.027 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:17:33.027 rtt min/avg/max/mdev = 0.109/0.109/0.109/0.000 ms 00:17:33.027 22:55:23 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:17:33.027 22:55:23 -- nvmf/common.sh@410 -- # return 0 00:17:33.027 22:55:23 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:17:33.027 22:55:23 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:17:33.027 22:55:23 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:17:33.027 22:55:23 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:17:33.027 22:55:23 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:17:33.027 22:55:23 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:17:33.027 22:55:23 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:17:33.027 22:55:23 -- target/fabrics_fuzz.sh@14 -- # nvmfpid=300643 00:17:33.027 22:55:23 -- target/fabrics_fuzz.sh@13 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x1 00:17:33.027 22:55:23 -- target/fabrics_fuzz.sh@16 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; killprocess $nvmfpid; nvmftestfini $1; exit 1' SIGINT SIGTERM EXIT 00:17:33.027 22:55:23 -- target/fabrics_fuzz.sh@18 -- # waitforlisten 300643 00:17:33.027 22:55:23 -- common/autotest_common.sh@819 -- # '[' -z 300643 ']' 00:17:33.027 22:55:23 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk.sock 00:17:33.027 22:55:23 -- common/autotest_common.sh@824 -- # local max_retries=100 00:17:33.027 22:55:23 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:17:33.027 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:17:33.027 22:55:23 -- common/autotest_common.sh@828 -- # xtrace_disable 00:17:33.027 22:55:23 -- common/autotest_common.sh@10 -- # set +x 00:17:33.974 22:55:24 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:17:33.974 22:55:24 -- common/autotest_common.sh@852 -- # return 0 00:17:33.974 22:55:24 -- target/fabrics_fuzz.sh@19 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:17:33.974 22:55:24 -- common/autotest_common.sh@551 -- # xtrace_disable 00:17:33.974 22:55:24 -- common/autotest_common.sh@10 -- # set +x 00:17:33.974 22:55:24 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:17:33.974 22:55:24 -- target/fabrics_fuzz.sh@21 -- # rpc_cmd bdev_malloc_create -b Malloc0 64 512 00:17:33.974 22:55:24 -- common/autotest_common.sh@551 -- # xtrace_disable 00:17:33.974 22:55:24 -- common/autotest_common.sh@10 -- # set +x 00:17:33.974 Malloc0 00:17:33.974 22:55:24 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:17:33.974 22:55:24 -- target/fabrics_fuzz.sh@23 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:17:33.974 22:55:24 -- common/autotest_common.sh@551 -- # xtrace_disable 00:17:33.974 22:55:24 -- common/autotest_common.sh@10 -- # set +x 00:17:33.974 22:55:24 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:17:33.974 22:55:24 -- target/fabrics_fuzz.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:17:33.974 22:55:24 -- common/autotest_common.sh@551 -- # xtrace_disable 00:17:33.974 22:55:24 -- common/autotest_common.sh@10 -- # set +x 00:17:33.974 22:55:24 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:17:33.974 22:55:24 -- target/fabrics_fuzz.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:17:33.974 22:55:24 -- common/autotest_common.sh@551 -- # xtrace_disable 00:17:33.974 22:55:24 -- common/autotest_common.sh@10 -- # set +x 00:17:33.974 22:55:24 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:17:33.974 22:55:24 -- target/fabrics_fuzz.sh@27 -- # trid='trtype:tcp adrfam:IPv4 subnqn:nqn.2016-06.io.spdk:cnode1 traddr:10.0.0.2 trsvcid:4420' 00:17:33.974 22:55:24 -- target/fabrics_fuzz.sh@30 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/app/fuzz/nvme_fuzz/nvme_fuzz -m 0x2 -r /var/tmp/nvme_fuzz -t 30 -S 123456 -F 'trtype:tcp adrfam:IPv4 subnqn:nqn.2016-06.io.spdk:cnode1 traddr:10.0.0.2 trsvcid:4420' -N -a 00:18:06.063 Fuzzing completed. Shutting down the fuzz application 00:18:06.063 00:18:06.063 Dumping successful admin opcodes: 00:18:06.063 8, 9, 10, 24, 00:18:06.063 Dumping successful io opcodes: 00:18:06.063 0, 9, 00:18:06.063 NS: 0x200003aeff00 I/O qp, Total commands completed: 482134, total successful commands: 2784, random_seed: 361102272 00:18:06.064 NS: 0x200003aeff00 admin qp, Total commands completed: 58432, total successful commands: 464, random_seed: 481500224 00:18:06.064 22:55:55 -- target/fabrics_fuzz.sh@32 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/app/fuzz/nvme_fuzz/nvme_fuzz -m 0x2 -r /var/tmp/nvme_fuzz -F 'trtype:tcp adrfam:IPv4 subnqn:nqn.2016-06.io.spdk:cnode1 traddr:10.0.0.2 trsvcid:4420' -j /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/app/fuzz/nvme_fuzz/example.json -a 00:18:06.064 Fuzzing completed. Shutting down the fuzz application 00:18:06.064 00:18:06.064 Dumping successful admin opcodes: 00:18:06.064 24, 00:18:06.064 Dumping successful io opcodes: 00:18:06.064 00:18:06.064 NS: 0x200003aeff00 I/O qp, Total commands completed: 0, total successful commands: 0, random_seed: 1799403535 00:18:06.064 NS: 0x200003aeff00 admin qp, Total commands completed: 16, total successful commands: 4, random_seed: 1799526466 00:18:06.064 22:55:57 -- target/fabrics_fuzz.sh@34 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:18:06.064 22:55:57 -- common/autotest_common.sh@551 -- # xtrace_disable 00:18:06.064 22:55:57 -- common/autotest_common.sh@10 -- # set +x 00:18:06.064 22:55:57 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:18:06.064 22:55:57 -- target/fabrics_fuzz.sh@36 -- # trap - SIGINT SIGTERM EXIT 00:18:06.064 22:55:57 -- target/fabrics_fuzz.sh@38 -- # nvmftestfini 00:18:06.064 22:55:57 -- nvmf/common.sh@476 -- # nvmfcleanup 00:18:06.064 22:55:57 -- nvmf/common.sh@116 -- # sync 00:18:06.064 22:55:57 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:18:06.064 22:55:57 -- nvmf/common.sh@119 -- # set +e 00:18:06.064 22:55:57 -- nvmf/common.sh@120 -- # for i in {1..20} 00:18:06.064 22:55:57 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:18:06.064 rmmod nvme_tcp 00:18:06.064 rmmod nvme_fabrics 00:18:06.064 rmmod nvme_keyring 00:18:06.064 22:55:57 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:18:06.064 22:55:57 -- nvmf/common.sh@123 -- # set -e 00:18:06.064 22:55:57 -- nvmf/common.sh@124 -- # return 0 00:18:06.064 22:55:57 -- nvmf/common.sh@477 -- # '[' -n 300643 ']' 00:18:06.064 22:55:57 -- nvmf/common.sh@478 -- # killprocess 300643 00:18:06.064 22:55:57 -- common/autotest_common.sh@926 -- # '[' -z 300643 ']' 00:18:06.064 22:55:57 -- common/autotest_common.sh@930 -- # kill -0 300643 00:18:06.064 22:55:57 -- common/autotest_common.sh@931 -- # uname 00:18:06.064 22:55:57 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:18:06.064 22:55:57 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 300643 00:18:06.064 22:55:57 -- common/autotest_common.sh@932 -- # process_name=reactor_0 00:18:06.064 22:55:57 -- common/autotest_common.sh@936 -- # '[' reactor_0 = sudo ']' 00:18:06.064 22:55:57 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 300643' 00:18:06.064 killing process with pid 300643 00:18:06.064 22:55:57 -- common/autotest_common.sh@945 -- # kill 300643 00:18:06.064 22:55:57 -- common/autotest_common.sh@950 -- # wait 300643 00:18:06.322 22:55:57 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:18:06.322 22:55:57 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:18:06.322 22:55:57 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:18:06.322 22:55:57 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:18:06.322 22:55:57 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:18:06.322 22:55:57 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:18:06.322 22:55:57 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:18:06.322 22:55:57 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:18:08.852 22:55:59 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:18:08.852 22:55:59 -- target/fabrics_fuzz.sh@39 -- # rm /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/nvmf_fuzz_logs1.txt /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/nvmf_fuzz_logs2.txt 00:18:08.852 00:18:08.852 real 0m37.717s 00:18:08.852 user 0m52.265s 00:18:08.852 sys 0m14.728s 00:18:08.852 22:55:59 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:18:08.852 22:55:59 -- common/autotest_common.sh@10 -- # set +x 00:18:08.852 ************************************ 00:18:08.852 END TEST nvmf_fuzz 00:18:08.852 ************************************ 00:18:08.852 22:55:59 -- nvmf/nvmf.sh@65 -- # run_test nvmf_multiconnection /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/multiconnection.sh --transport=tcp 00:18:08.852 22:55:59 -- common/autotest_common.sh@1077 -- # '[' 3 -le 1 ']' 00:18:08.852 22:55:59 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:18:08.852 22:55:59 -- common/autotest_common.sh@10 -- # set +x 00:18:08.852 ************************************ 00:18:08.852 START TEST nvmf_multiconnection 00:18:08.852 ************************************ 00:18:08.852 22:55:59 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/multiconnection.sh --transport=tcp 00:18:08.852 * Looking for test storage... 00:18:08.852 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:18:08.852 22:55:59 -- target/multiconnection.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:18:08.852 22:55:59 -- nvmf/common.sh@7 -- # uname -s 00:18:08.852 22:55:59 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:18:08.852 22:55:59 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:18:08.852 22:55:59 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:18:08.852 22:55:59 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:18:08.852 22:55:59 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:18:08.852 22:55:59 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:18:08.852 22:55:59 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:18:08.852 22:55:59 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:18:08.852 22:55:59 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:18:08.852 22:55:59 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:18:08.852 22:55:59 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:18:08.852 22:55:59 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:18:08.852 22:55:59 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:18:08.852 22:55:59 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:18:08.852 22:55:59 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:18:08.852 22:55:59 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:18:08.852 22:55:59 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:18:08.852 22:55:59 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:18:08.852 22:55:59 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:18:08.852 22:55:59 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:18:08.853 22:55:59 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:18:08.853 22:55:59 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:18:08.853 22:55:59 -- paths/export.sh@5 -- # export PATH 00:18:08.853 22:55:59 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:18:08.853 22:55:59 -- nvmf/common.sh@46 -- # : 0 00:18:08.853 22:55:59 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:18:08.853 22:55:59 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:18:08.853 22:55:59 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:18:08.853 22:55:59 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:18:08.853 22:55:59 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:18:08.853 22:55:59 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:18:08.853 22:55:59 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:18:08.853 22:55:59 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:18:08.853 22:55:59 -- target/multiconnection.sh@11 -- # MALLOC_BDEV_SIZE=64 00:18:08.853 22:55:59 -- target/multiconnection.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:18:08.853 22:55:59 -- target/multiconnection.sh@14 -- # NVMF_SUBSYS=11 00:18:08.853 22:55:59 -- target/multiconnection.sh@16 -- # nvmftestinit 00:18:08.853 22:55:59 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:18:08.853 22:55:59 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:18:08.853 22:55:59 -- nvmf/common.sh@436 -- # prepare_net_devs 00:18:08.853 22:55:59 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:18:08.853 22:55:59 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:18:08.853 22:55:59 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:18:08.853 22:55:59 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:18:08.853 22:55:59 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:18:08.853 22:55:59 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:18:08.853 22:55:59 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:18:08.853 22:55:59 -- nvmf/common.sh@284 -- # xtrace_disable 00:18:08.853 22:55:59 -- common/autotest_common.sh@10 -- # set +x 00:18:10.753 22:56:01 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:18:10.753 22:56:01 -- nvmf/common.sh@290 -- # pci_devs=() 00:18:10.753 22:56:01 -- nvmf/common.sh@290 -- # local -a pci_devs 00:18:10.753 22:56:01 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:18:10.753 22:56:01 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:18:10.753 22:56:01 -- nvmf/common.sh@292 -- # pci_drivers=() 00:18:10.753 22:56:01 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:18:10.753 22:56:01 -- nvmf/common.sh@294 -- # net_devs=() 00:18:10.753 22:56:01 -- nvmf/common.sh@294 -- # local -ga net_devs 00:18:10.753 22:56:01 -- nvmf/common.sh@295 -- # e810=() 00:18:10.753 22:56:01 -- nvmf/common.sh@295 -- # local -ga e810 00:18:10.753 22:56:01 -- nvmf/common.sh@296 -- # x722=() 00:18:10.753 22:56:01 -- nvmf/common.sh@296 -- # local -ga x722 00:18:10.753 22:56:01 -- nvmf/common.sh@297 -- # mlx=() 00:18:10.753 22:56:01 -- nvmf/common.sh@297 -- # local -ga mlx 00:18:10.753 22:56:01 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:18:10.753 22:56:01 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:18:10.753 22:56:01 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:18:10.753 22:56:01 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:18:10.753 22:56:01 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:18:10.753 22:56:01 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:18:10.753 22:56:01 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:18:10.753 22:56:01 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:18:10.753 22:56:01 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:18:10.753 22:56:01 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:18:10.753 22:56:01 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:18:10.753 22:56:01 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:18:10.753 22:56:01 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:18:10.753 22:56:01 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:18:10.753 22:56:01 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:18:10.753 22:56:01 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:18:10.753 22:56:01 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:18:10.753 22:56:01 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:18:10.753 22:56:01 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:18:10.753 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:18:10.753 22:56:01 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:18:10.753 22:56:01 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:18:10.753 22:56:01 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:18:10.753 22:56:01 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:18:10.753 22:56:01 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:18:10.753 22:56:01 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:18:10.753 22:56:01 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:18:10.753 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:18:10.753 22:56:01 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:18:10.753 22:56:01 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:18:10.753 22:56:01 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:18:10.753 22:56:01 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:18:10.753 22:56:01 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:18:10.753 22:56:01 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:18:10.753 22:56:01 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:18:10.753 22:56:01 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:18:10.753 22:56:01 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:18:10.753 22:56:01 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:18:10.753 22:56:01 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:18:10.753 22:56:01 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:18:10.753 22:56:01 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:18:10.753 Found net devices under 0000:0a:00.0: cvl_0_0 00:18:10.753 22:56:01 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:18:10.753 22:56:01 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:18:10.753 22:56:01 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:18:10.753 22:56:01 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:18:10.753 22:56:01 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:18:10.753 22:56:01 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:18:10.753 Found net devices under 0000:0a:00.1: cvl_0_1 00:18:10.753 22:56:01 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:18:10.753 22:56:01 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:18:10.753 22:56:01 -- nvmf/common.sh@402 -- # is_hw=yes 00:18:10.753 22:56:01 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:18:10.753 22:56:01 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:18:10.753 22:56:01 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:18:10.753 22:56:01 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:18:10.753 22:56:01 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:18:10.753 22:56:01 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:18:10.753 22:56:01 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:18:10.753 22:56:01 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:18:10.753 22:56:01 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:18:10.753 22:56:01 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:18:10.753 22:56:01 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:18:10.753 22:56:01 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:18:10.753 22:56:01 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:18:10.753 22:56:01 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:18:10.753 22:56:01 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:18:10.753 22:56:01 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:18:10.754 22:56:01 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:18:10.754 22:56:01 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:18:10.754 22:56:01 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:18:10.754 22:56:01 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:18:10.754 22:56:01 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:18:10.754 22:56:01 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:18:10.754 22:56:01 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:18:10.754 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:18:10.754 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.120 ms 00:18:10.754 00:18:10.754 --- 10.0.0.2 ping statistics --- 00:18:10.754 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:18:10.754 rtt min/avg/max/mdev = 0.120/0.120/0.120/0.000 ms 00:18:10.754 22:56:01 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:18:10.754 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:18:10.754 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.104 ms 00:18:10.754 00:18:10.754 --- 10.0.0.1 ping statistics --- 00:18:10.754 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:18:10.754 rtt min/avg/max/mdev = 0.104/0.104/0.104/0.000 ms 00:18:10.754 22:56:01 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:18:10.754 22:56:01 -- nvmf/common.sh@410 -- # return 0 00:18:10.754 22:56:01 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:18:10.754 22:56:01 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:18:10.754 22:56:01 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:18:10.754 22:56:01 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:18:10.754 22:56:01 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:18:10.754 22:56:01 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:18:10.754 22:56:01 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:18:10.754 22:56:01 -- target/multiconnection.sh@17 -- # nvmfappstart -m 0xF 00:18:10.754 22:56:01 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:18:10.754 22:56:01 -- common/autotest_common.sh@712 -- # xtrace_disable 00:18:10.754 22:56:01 -- common/autotest_common.sh@10 -- # set +x 00:18:10.754 22:56:01 -- nvmf/common.sh@469 -- # nvmfpid=306591 00:18:10.754 22:56:01 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:18:10.754 22:56:01 -- nvmf/common.sh@470 -- # waitforlisten 306591 00:18:10.754 22:56:01 -- common/autotest_common.sh@819 -- # '[' -z 306591 ']' 00:18:10.754 22:56:01 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk.sock 00:18:10.754 22:56:01 -- common/autotest_common.sh@824 -- # local max_retries=100 00:18:10.754 22:56:01 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:18:10.754 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:18:10.754 22:56:01 -- common/autotest_common.sh@828 -- # xtrace_disable 00:18:10.754 22:56:01 -- common/autotest_common.sh@10 -- # set +x 00:18:10.754 [2024-04-16 22:56:01.737302] Starting SPDK v24.01.1-pre git sha1 4b134b4ab / DPDK 23.11.0 initialization... 00:18:10.754 [2024-04-16 22:56:01.737382] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:18:10.754 EAL: No free 2048 kB hugepages reported on node 1 00:18:10.754 [2024-04-16 22:56:01.808339] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:18:11.012 [2024-04-16 22:56:01.925942] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:18:11.012 [2024-04-16 22:56:01.926092] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:18:11.012 [2024-04-16 22:56:01.926116] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:18:11.012 [2024-04-16 22:56:01.926130] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:18:11.012 [2024-04-16 22:56:01.926200] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:18:11.012 [2024-04-16 22:56:01.926278] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:18:11.012 [2024-04-16 22:56:01.926282] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:18:11.012 [2024-04-16 22:56:01.926255] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:18:11.945 22:56:02 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:18:11.945 22:56:02 -- common/autotest_common.sh@852 -- # return 0 00:18:11.945 22:56:02 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:18:11.945 22:56:02 -- common/autotest_common.sh@718 -- # xtrace_disable 00:18:11.945 22:56:02 -- common/autotest_common.sh@10 -- # set +x 00:18:11.945 22:56:02 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:18:11.945 22:56:02 -- target/multiconnection.sh@19 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:18:11.945 22:56:02 -- common/autotest_common.sh@551 -- # xtrace_disable 00:18:11.945 22:56:02 -- common/autotest_common.sh@10 -- # set +x 00:18:11.945 [2024-04-16 22:56:02.766832] tcp.c: 659:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:18:11.945 22:56:02 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:18:11.945 22:56:02 -- target/multiconnection.sh@21 -- # seq 1 11 00:18:11.945 22:56:02 -- target/multiconnection.sh@21 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:18:11.945 22:56:02 -- target/multiconnection.sh@22 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc1 00:18:11.945 22:56:02 -- common/autotest_common.sh@551 -- # xtrace_disable 00:18:11.945 22:56:02 -- common/autotest_common.sh@10 -- # set +x 00:18:11.945 Malloc1 00:18:11.945 22:56:02 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:18:11.945 22:56:02 -- target/multiconnection.sh@23 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK1 00:18:11.945 22:56:02 -- common/autotest_common.sh@551 -- # xtrace_disable 00:18:11.945 22:56:02 -- common/autotest_common.sh@10 -- # set +x 00:18:11.945 22:56:02 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:18:11.945 22:56:02 -- target/multiconnection.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:18:11.945 22:56:02 -- common/autotest_common.sh@551 -- # xtrace_disable 00:18:11.945 22:56:02 -- common/autotest_common.sh@10 -- # set +x 00:18:11.945 22:56:02 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:18:11.946 22:56:02 -- target/multiconnection.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:18:11.946 22:56:02 -- common/autotest_common.sh@551 -- # xtrace_disable 00:18:11.946 22:56:02 -- common/autotest_common.sh@10 -- # set +x 00:18:11.946 [2024-04-16 22:56:02.822333] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:18:11.946 22:56:02 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:18:11.946 22:56:02 -- target/multiconnection.sh@21 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:18:11.946 22:56:02 -- target/multiconnection.sh@22 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc2 00:18:11.946 22:56:02 -- common/autotest_common.sh@551 -- # xtrace_disable 00:18:11.946 22:56:02 -- common/autotest_common.sh@10 -- # set +x 00:18:11.946 Malloc2 00:18:11.946 22:56:02 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:18:11.946 22:56:02 -- target/multiconnection.sh@23 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode2 -a -s SPDK2 00:18:11.946 22:56:02 -- common/autotest_common.sh@551 -- # xtrace_disable 00:18:11.946 22:56:02 -- common/autotest_common.sh@10 -- # set +x 00:18:11.946 22:56:02 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:18:11.946 22:56:02 -- target/multiconnection.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode2 Malloc2 00:18:11.946 22:56:02 -- common/autotest_common.sh@551 -- # xtrace_disable 00:18:11.946 22:56:02 -- common/autotest_common.sh@10 -- # set +x 00:18:11.946 22:56:02 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:18:11.946 22:56:02 -- target/multiconnection.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode2 -t tcp -a 10.0.0.2 -s 4420 00:18:11.946 22:56:02 -- common/autotest_common.sh@551 -- # xtrace_disable 00:18:11.946 22:56:02 -- common/autotest_common.sh@10 -- # set +x 00:18:11.946 22:56:02 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:18:11.946 22:56:02 -- target/multiconnection.sh@21 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:18:11.946 22:56:02 -- target/multiconnection.sh@22 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc3 00:18:11.946 22:56:02 -- common/autotest_common.sh@551 -- # xtrace_disable 00:18:11.946 22:56:02 -- common/autotest_common.sh@10 -- # set +x 00:18:11.946 Malloc3 00:18:11.946 22:56:02 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:18:11.946 22:56:02 -- target/multiconnection.sh@23 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode3 -a -s SPDK3 00:18:11.946 22:56:02 -- common/autotest_common.sh@551 -- # xtrace_disable 00:18:11.946 22:56:02 -- common/autotest_common.sh@10 -- # set +x 00:18:11.946 22:56:02 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:18:11.946 22:56:02 -- target/multiconnection.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode3 Malloc3 00:18:11.946 22:56:02 -- common/autotest_common.sh@551 -- # xtrace_disable 00:18:11.946 22:56:02 -- common/autotest_common.sh@10 -- # set +x 00:18:11.946 22:56:02 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:18:11.946 22:56:02 -- target/multiconnection.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode3 -t tcp -a 10.0.0.2 -s 4420 00:18:11.946 22:56:02 -- common/autotest_common.sh@551 -- # xtrace_disable 00:18:11.946 22:56:02 -- common/autotest_common.sh@10 -- # set +x 00:18:11.946 22:56:02 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:18:11.946 22:56:02 -- target/multiconnection.sh@21 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:18:11.946 22:56:02 -- target/multiconnection.sh@22 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc4 00:18:11.946 22:56:02 -- common/autotest_common.sh@551 -- # xtrace_disable 00:18:11.946 22:56:02 -- common/autotest_common.sh@10 -- # set +x 00:18:11.946 Malloc4 00:18:11.946 22:56:02 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:18:11.946 22:56:02 -- target/multiconnection.sh@23 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode4 -a -s SPDK4 00:18:11.946 22:56:02 -- common/autotest_common.sh@551 -- # xtrace_disable 00:18:11.946 22:56:02 -- common/autotest_common.sh@10 -- # set +x 00:18:11.946 22:56:02 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:18:11.946 22:56:02 -- target/multiconnection.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode4 Malloc4 00:18:11.946 22:56:02 -- common/autotest_common.sh@551 -- # xtrace_disable 00:18:11.946 22:56:02 -- common/autotest_common.sh@10 -- # set +x 00:18:11.946 22:56:02 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:18:11.946 22:56:02 -- target/multiconnection.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode4 -t tcp -a 10.0.0.2 -s 4420 00:18:11.946 22:56:02 -- common/autotest_common.sh@551 -- # xtrace_disable 00:18:11.946 22:56:02 -- common/autotest_common.sh@10 -- # set +x 00:18:11.946 22:56:02 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:18:11.946 22:56:02 -- target/multiconnection.sh@21 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:18:11.946 22:56:02 -- target/multiconnection.sh@22 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc5 00:18:11.946 22:56:02 -- common/autotest_common.sh@551 -- # xtrace_disable 00:18:11.946 22:56:02 -- common/autotest_common.sh@10 -- # set +x 00:18:11.946 Malloc5 00:18:11.946 22:56:02 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:18:11.946 22:56:02 -- target/multiconnection.sh@23 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode5 -a -s SPDK5 00:18:11.946 22:56:02 -- common/autotest_common.sh@551 -- # xtrace_disable 00:18:11.946 22:56:02 -- common/autotest_common.sh@10 -- # set +x 00:18:11.946 22:56:02 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:18:11.946 22:56:03 -- target/multiconnection.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode5 Malloc5 00:18:11.946 22:56:03 -- common/autotest_common.sh@551 -- # xtrace_disable 00:18:11.946 22:56:03 -- common/autotest_common.sh@10 -- # set +x 00:18:11.946 22:56:03 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:18:11.946 22:56:03 -- target/multiconnection.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode5 -t tcp -a 10.0.0.2 -s 4420 00:18:11.946 22:56:03 -- common/autotest_common.sh@551 -- # xtrace_disable 00:18:11.946 22:56:03 -- common/autotest_common.sh@10 -- # set +x 00:18:11.946 22:56:03 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:18:11.946 22:56:03 -- target/multiconnection.sh@21 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:18:11.946 22:56:03 -- target/multiconnection.sh@22 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc6 00:18:11.946 22:56:03 -- common/autotest_common.sh@551 -- # xtrace_disable 00:18:11.946 22:56:03 -- common/autotest_common.sh@10 -- # set +x 00:18:11.946 Malloc6 00:18:11.946 22:56:03 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:18:11.946 22:56:03 -- target/multiconnection.sh@23 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode6 -a -s SPDK6 00:18:11.946 22:56:03 -- common/autotest_common.sh@551 -- # xtrace_disable 00:18:11.946 22:56:03 -- common/autotest_common.sh@10 -- # set +x 00:18:11.946 22:56:03 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:18:11.946 22:56:03 -- target/multiconnection.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode6 Malloc6 00:18:11.946 22:56:03 -- common/autotest_common.sh@551 -- # xtrace_disable 00:18:11.946 22:56:03 -- common/autotest_common.sh@10 -- # set +x 00:18:11.946 22:56:03 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:18:11.946 22:56:03 -- target/multiconnection.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode6 -t tcp -a 10.0.0.2 -s 4420 00:18:11.946 22:56:03 -- common/autotest_common.sh@551 -- # xtrace_disable 00:18:11.946 22:56:03 -- common/autotest_common.sh@10 -- # set +x 00:18:11.946 22:56:03 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:18:11.946 22:56:03 -- target/multiconnection.sh@21 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:18:11.946 22:56:03 -- target/multiconnection.sh@22 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc7 00:18:11.946 22:56:03 -- common/autotest_common.sh@551 -- # xtrace_disable 00:18:11.946 22:56:03 -- common/autotest_common.sh@10 -- # set +x 00:18:12.205 Malloc7 00:18:12.205 22:56:03 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:18:12.205 22:56:03 -- target/multiconnection.sh@23 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode7 -a -s SPDK7 00:18:12.205 22:56:03 -- common/autotest_common.sh@551 -- # xtrace_disable 00:18:12.205 22:56:03 -- common/autotest_common.sh@10 -- # set +x 00:18:12.205 22:56:03 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:18:12.205 22:56:03 -- target/multiconnection.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode7 Malloc7 00:18:12.205 22:56:03 -- common/autotest_common.sh@551 -- # xtrace_disable 00:18:12.205 22:56:03 -- common/autotest_common.sh@10 -- # set +x 00:18:12.205 22:56:03 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:18:12.205 22:56:03 -- target/multiconnection.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode7 -t tcp -a 10.0.0.2 -s 4420 00:18:12.205 22:56:03 -- common/autotest_common.sh@551 -- # xtrace_disable 00:18:12.205 22:56:03 -- common/autotest_common.sh@10 -- # set +x 00:18:12.205 22:56:03 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:18:12.205 22:56:03 -- target/multiconnection.sh@21 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:18:12.205 22:56:03 -- target/multiconnection.sh@22 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc8 00:18:12.205 22:56:03 -- common/autotest_common.sh@551 -- # xtrace_disable 00:18:12.205 22:56:03 -- common/autotest_common.sh@10 -- # set +x 00:18:12.205 Malloc8 00:18:12.205 22:56:03 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:18:12.205 22:56:03 -- target/multiconnection.sh@23 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode8 -a -s SPDK8 00:18:12.205 22:56:03 -- common/autotest_common.sh@551 -- # xtrace_disable 00:18:12.205 22:56:03 -- common/autotest_common.sh@10 -- # set +x 00:18:12.205 22:56:03 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:18:12.205 22:56:03 -- target/multiconnection.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode8 Malloc8 00:18:12.205 22:56:03 -- common/autotest_common.sh@551 -- # xtrace_disable 00:18:12.205 22:56:03 -- common/autotest_common.sh@10 -- # set +x 00:18:12.205 22:56:03 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:18:12.205 22:56:03 -- target/multiconnection.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode8 -t tcp -a 10.0.0.2 -s 4420 00:18:12.205 22:56:03 -- common/autotest_common.sh@551 -- # xtrace_disable 00:18:12.205 22:56:03 -- common/autotest_common.sh@10 -- # set +x 00:18:12.205 22:56:03 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:18:12.205 22:56:03 -- target/multiconnection.sh@21 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:18:12.205 22:56:03 -- target/multiconnection.sh@22 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc9 00:18:12.205 22:56:03 -- common/autotest_common.sh@551 -- # xtrace_disable 00:18:12.205 22:56:03 -- common/autotest_common.sh@10 -- # set +x 00:18:12.205 Malloc9 00:18:12.205 22:56:03 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:18:12.205 22:56:03 -- target/multiconnection.sh@23 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode9 -a -s SPDK9 00:18:12.205 22:56:03 -- common/autotest_common.sh@551 -- # xtrace_disable 00:18:12.205 22:56:03 -- common/autotest_common.sh@10 -- # set +x 00:18:12.205 22:56:03 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:18:12.205 22:56:03 -- target/multiconnection.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode9 Malloc9 00:18:12.205 22:56:03 -- common/autotest_common.sh@551 -- # xtrace_disable 00:18:12.205 22:56:03 -- common/autotest_common.sh@10 -- # set +x 00:18:12.205 22:56:03 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:18:12.205 22:56:03 -- target/multiconnection.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode9 -t tcp -a 10.0.0.2 -s 4420 00:18:12.205 22:56:03 -- common/autotest_common.sh@551 -- # xtrace_disable 00:18:12.205 22:56:03 -- common/autotest_common.sh@10 -- # set +x 00:18:12.205 22:56:03 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:18:12.205 22:56:03 -- target/multiconnection.sh@21 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:18:12.205 22:56:03 -- target/multiconnection.sh@22 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc10 00:18:12.205 22:56:03 -- common/autotest_common.sh@551 -- # xtrace_disable 00:18:12.205 22:56:03 -- common/autotest_common.sh@10 -- # set +x 00:18:12.205 Malloc10 00:18:12.205 22:56:03 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:18:12.205 22:56:03 -- target/multiconnection.sh@23 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode10 -a -s SPDK10 00:18:12.205 22:56:03 -- common/autotest_common.sh@551 -- # xtrace_disable 00:18:12.205 22:56:03 -- common/autotest_common.sh@10 -- # set +x 00:18:12.205 22:56:03 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:18:12.205 22:56:03 -- target/multiconnection.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode10 Malloc10 00:18:12.205 22:56:03 -- common/autotest_common.sh@551 -- # xtrace_disable 00:18:12.205 22:56:03 -- common/autotest_common.sh@10 -- # set +x 00:18:12.205 22:56:03 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:18:12.205 22:56:03 -- target/multiconnection.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode10 -t tcp -a 10.0.0.2 -s 4420 00:18:12.205 22:56:03 -- common/autotest_common.sh@551 -- # xtrace_disable 00:18:12.205 22:56:03 -- common/autotest_common.sh@10 -- # set +x 00:18:12.205 22:56:03 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:18:12.205 22:56:03 -- target/multiconnection.sh@21 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:18:12.205 22:56:03 -- target/multiconnection.sh@22 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc11 00:18:12.205 22:56:03 -- common/autotest_common.sh@551 -- # xtrace_disable 00:18:12.205 22:56:03 -- common/autotest_common.sh@10 -- # set +x 00:18:12.205 Malloc11 00:18:12.205 22:56:03 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:18:12.205 22:56:03 -- target/multiconnection.sh@23 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode11 -a -s SPDK11 00:18:12.205 22:56:03 -- common/autotest_common.sh@551 -- # xtrace_disable 00:18:12.205 22:56:03 -- common/autotest_common.sh@10 -- # set +x 00:18:12.205 22:56:03 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:18:12.205 22:56:03 -- target/multiconnection.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode11 Malloc11 00:18:12.205 22:56:03 -- common/autotest_common.sh@551 -- # xtrace_disable 00:18:12.205 22:56:03 -- common/autotest_common.sh@10 -- # set +x 00:18:12.205 22:56:03 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:18:12.205 22:56:03 -- target/multiconnection.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode11 -t tcp -a 10.0.0.2 -s 4420 00:18:12.205 22:56:03 -- common/autotest_common.sh@551 -- # xtrace_disable 00:18:12.205 22:56:03 -- common/autotest_common.sh@10 -- # set +x 00:18:12.205 22:56:03 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:18:12.205 22:56:03 -- target/multiconnection.sh@28 -- # seq 1 11 00:18:12.205 22:56:03 -- target/multiconnection.sh@28 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:18:12.205 22:56:03 -- target/multiconnection.sh@29 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:18:13.138 22:56:03 -- target/multiconnection.sh@30 -- # waitforserial SPDK1 00:18:13.138 22:56:03 -- common/autotest_common.sh@1177 -- # local i=0 00:18:13.138 22:56:03 -- common/autotest_common.sh@1178 -- # local nvme_device_counter=1 nvme_devices=0 00:18:13.138 22:56:03 -- common/autotest_common.sh@1179 -- # [[ -n '' ]] 00:18:13.138 22:56:03 -- common/autotest_common.sh@1184 -- # sleep 2 00:18:15.034 22:56:05 -- common/autotest_common.sh@1185 -- # (( i++ <= 15 )) 00:18:15.034 22:56:05 -- common/autotest_common.sh@1186 -- # lsblk -l -o NAME,SERIAL 00:18:15.034 22:56:05 -- common/autotest_common.sh@1186 -- # grep -c SPDK1 00:18:15.034 22:56:05 -- common/autotest_common.sh@1186 -- # nvme_devices=1 00:18:15.034 22:56:05 -- common/autotest_common.sh@1187 -- # (( nvme_devices == nvme_device_counter )) 00:18:15.034 22:56:05 -- common/autotest_common.sh@1187 -- # return 0 00:18:15.034 22:56:05 -- target/multiconnection.sh@28 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:18:15.034 22:56:05 -- target/multiconnection.sh@29 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode2 -a 10.0.0.2 -s 4420 00:18:15.599 22:56:06 -- target/multiconnection.sh@30 -- # waitforserial SPDK2 00:18:15.599 22:56:06 -- common/autotest_common.sh@1177 -- # local i=0 00:18:15.599 22:56:06 -- common/autotest_common.sh@1178 -- # local nvme_device_counter=1 nvme_devices=0 00:18:15.599 22:56:06 -- common/autotest_common.sh@1179 -- # [[ -n '' ]] 00:18:15.599 22:56:06 -- common/autotest_common.sh@1184 -- # sleep 2 00:18:17.494 22:56:08 -- common/autotest_common.sh@1185 -- # (( i++ <= 15 )) 00:18:17.494 22:56:08 -- common/autotest_common.sh@1186 -- # lsblk -l -o NAME,SERIAL 00:18:17.494 22:56:08 -- common/autotest_common.sh@1186 -- # grep -c SPDK2 00:18:17.494 22:56:08 -- common/autotest_common.sh@1186 -- # nvme_devices=1 00:18:17.494 22:56:08 -- common/autotest_common.sh@1187 -- # (( nvme_devices == nvme_device_counter )) 00:18:17.494 22:56:08 -- common/autotest_common.sh@1187 -- # return 0 00:18:17.494 22:56:08 -- target/multiconnection.sh@28 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:18:17.494 22:56:08 -- target/multiconnection.sh@29 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode3 -a 10.0.0.2 -s 4420 00:18:18.424 22:56:09 -- target/multiconnection.sh@30 -- # waitforserial SPDK3 00:18:18.424 22:56:09 -- common/autotest_common.sh@1177 -- # local i=0 00:18:18.424 22:56:09 -- common/autotest_common.sh@1178 -- # local nvme_device_counter=1 nvme_devices=0 00:18:18.424 22:56:09 -- common/autotest_common.sh@1179 -- # [[ -n '' ]] 00:18:18.425 22:56:09 -- common/autotest_common.sh@1184 -- # sleep 2 00:18:20.318 22:56:11 -- common/autotest_common.sh@1185 -- # (( i++ <= 15 )) 00:18:20.318 22:56:11 -- common/autotest_common.sh@1186 -- # lsblk -l -o NAME,SERIAL 00:18:20.318 22:56:11 -- common/autotest_common.sh@1186 -- # grep -c SPDK3 00:18:20.318 22:56:11 -- common/autotest_common.sh@1186 -- # nvme_devices=1 00:18:20.318 22:56:11 -- common/autotest_common.sh@1187 -- # (( nvme_devices == nvme_device_counter )) 00:18:20.318 22:56:11 -- common/autotest_common.sh@1187 -- # return 0 00:18:20.318 22:56:11 -- target/multiconnection.sh@28 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:18:20.318 22:56:11 -- target/multiconnection.sh@29 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode4 -a 10.0.0.2 -s 4420 00:18:21.248 22:56:12 -- target/multiconnection.sh@30 -- # waitforserial SPDK4 00:18:21.248 22:56:12 -- common/autotest_common.sh@1177 -- # local i=0 00:18:21.248 22:56:12 -- common/autotest_common.sh@1178 -- # local nvme_device_counter=1 nvme_devices=0 00:18:21.248 22:56:12 -- common/autotest_common.sh@1179 -- # [[ -n '' ]] 00:18:21.248 22:56:12 -- common/autotest_common.sh@1184 -- # sleep 2 00:18:23.172 22:56:14 -- common/autotest_common.sh@1185 -- # (( i++ <= 15 )) 00:18:23.172 22:56:14 -- common/autotest_common.sh@1186 -- # lsblk -l -o NAME,SERIAL 00:18:23.172 22:56:14 -- common/autotest_common.sh@1186 -- # grep -c SPDK4 00:18:23.172 22:56:14 -- common/autotest_common.sh@1186 -- # nvme_devices=1 00:18:23.172 22:56:14 -- common/autotest_common.sh@1187 -- # (( nvme_devices == nvme_device_counter )) 00:18:23.172 22:56:14 -- common/autotest_common.sh@1187 -- # return 0 00:18:23.172 22:56:14 -- target/multiconnection.sh@28 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:18:23.172 22:56:14 -- target/multiconnection.sh@29 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode5 -a 10.0.0.2 -s 4420 00:18:23.736 22:56:14 -- target/multiconnection.sh@30 -- # waitforserial SPDK5 00:18:23.736 22:56:14 -- common/autotest_common.sh@1177 -- # local i=0 00:18:23.736 22:56:14 -- common/autotest_common.sh@1178 -- # local nvme_device_counter=1 nvme_devices=0 00:18:23.736 22:56:14 -- common/autotest_common.sh@1179 -- # [[ -n '' ]] 00:18:23.736 22:56:14 -- common/autotest_common.sh@1184 -- # sleep 2 00:18:26.263 22:56:16 -- common/autotest_common.sh@1185 -- # (( i++ <= 15 )) 00:18:26.263 22:56:16 -- common/autotest_common.sh@1186 -- # lsblk -l -o NAME,SERIAL 00:18:26.263 22:56:16 -- common/autotest_common.sh@1186 -- # grep -c SPDK5 00:18:26.263 22:56:16 -- common/autotest_common.sh@1186 -- # nvme_devices=1 00:18:26.263 22:56:16 -- common/autotest_common.sh@1187 -- # (( nvme_devices == nvme_device_counter )) 00:18:26.263 22:56:16 -- common/autotest_common.sh@1187 -- # return 0 00:18:26.263 22:56:16 -- target/multiconnection.sh@28 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:18:26.263 22:56:16 -- target/multiconnection.sh@29 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode6 -a 10.0.0.2 -s 4420 00:18:26.521 22:56:17 -- target/multiconnection.sh@30 -- # waitforserial SPDK6 00:18:26.521 22:56:17 -- common/autotest_common.sh@1177 -- # local i=0 00:18:26.521 22:56:17 -- common/autotest_common.sh@1178 -- # local nvme_device_counter=1 nvme_devices=0 00:18:26.521 22:56:17 -- common/autotest_common.sh@1179 -- # [[ -n '' ]] 00:18:26.521 22:56:17 -- common/autotest_common.sh@1184 -- # sleep 2 00:18:28.419 22:56:19 -- common/autotest_common.sh@1185 -- # (( i++ <= 15 )) 00:18:28.419 22:56:19 -- common/autotest_common.sh@1186 -- # lsblk -l -o NAME,SERIAL 00:18:28.419 22:56:19 -- common/autotest_common.sh@1186 -- # grep -c SPDK6 00:18:28.419 22:56:19 -- common/autotest_common.sh@1186 -- # nvme_devices=1 00:18:28.419 22:56:19 -- common/autotest_common.sh@1187 -- # (( nvme_devices == nvme_device_counter )) 00:18:28.419 22:56:19 -- common/autotest_common.sh@1187 -- # return 0 00:18:28.419 22:56:19 -- target/multiconnection.sh@28 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:18:28.419 22:56:19 -- target/multiconnection.sh@29 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode7 -a 10.0.0.2 -s 4420 00:18:29.352 22:56:20 -- target/multiconnection.sh@30 -- # waitforserial SPDK7 00:18:29.352 22:56:20 -- common/autotest_common.sh@1177 -- # local i=0 00:18:29.352 22:56:20 -- common/autotest_common.sh@1178 -- # local nvme_device_counter=1 nvme_devices=0 00:18:29.352 22:56:20 -- common/autotest_common.sh@1179 -- # [[ -n '' ]] 00:18:29.352 22:56:20 -- common/autotest_common.sh@1184 -- # sleep 2 00:18:31.251 22:56:22 -- common/autotest_common.sh@1185 -- # (( i++ <= 15 )) 00:18:31.251 22:56:22 -- common/autotest_common.sh@1186 -- # lsblk -l -o NAME,SERIAL 00:18:31.251 22:56:22 -- common/autotest_common.sh@1186 -- # grep -c SPDK7 00:18:31.251 22:56:22 -- common/autotest_common.sh@1186 -- # nvme_devices=1 00:18:31.251 22:56:22 -- common/autotest_common.sh@1187 -- # (( nvme_devices == nvme_device_counter )) 00:18:31.251 22:56:22 -- common/autotest_common.sh@1187 -- # return 0 00:18:31.251 22:56:22 -- target/multiconnection.sh@28 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:18:31.251 22:56:22 -- target/multiconnection.sh@29 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode8 -a 10.0.0.2 -s 4420 00:18:32.184 22:56:22 -- target/multiconnection.sh@30 -- # waitforserial SPDK8 00:18:32.184 22:56:22 -- common/autotest_common.sh@1177 -- # local i=0 00:18:32.184 22:56:22 -- common/autotest_common.sh@1178 -- # local nvme_device_counter=1 nvme_devices=0 00:18:32.184 22:56:22 -- common/autotest_common.sh@1179 -- # [[ -n '' ]] 00:18:32.184 22:56:22 -- common/autotest_common.sh@1184 -- # sleep 2 00:18:34.080 22:56:24 -- common/autotest_common.sh@1185 -- # (( i++ <= 15 )) 00:18:34.080 22:56:24 -- common/autotest_common.sh@1186 -- # lsblk -l -o NAME,SERIAL 00:18:34.080 22:56:24 -- common/autotest_common.sh@1186 -- # grep -c SPDK8 00:18:34.080 22:56:25 -- common/autotest_common.sh@1186 -- # nvme_devices=1 00:18:34.080 22:56:25 -- common/autotest_common.sh@1187 -- # (( nvme_devices == nvme_device_counter )) 00:18:34.080 22:56:25 -- common/autotest_common.sh@1187 -- # return 0 00:18:34.080 22:56:25 -- target/multiconnection.sh@28 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:18:34.080 22:56:25 -- target/multiconnection.sh@29 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode9 -a 10.0.0.2 -s 4420 00:18:35.012 22:56:25 -- target/multiconnection.sh@30 -- # waitforserial SPDK9 00:18:35.012 22:56:25 -- common/autotest_common.sh@1177 -- # local i=0 00:18:35.012 22:56:25 -- common/autotest_common.sh@1178 -- # local nvme_device_counter=1 nvme_devices=0 00:18:35.012 22:56:25 -- common/autotest_common.sh@1179 -- # [[ -n '' ]] 00:18:35.012 22:56:25 -- common/autotest_common.sh@1184 -- # sleep 2 00:18:36.907 22:56:27 -- common/autotest_common.sh@1185 -- # (( i++ <= 15 )) 00:18:36.907 22:56:27 -- common/autotest_common.sh@1186 -- # lsblk -l -o NAME,SERIAL 00:18:36.907 22:56:27 -- common/autotest_common.sh@1186 -- # grep -c SPDK9 00:18:36.907 22:56:27 -- common/autotest_common.sh@1186 -- # nvme_devices=1 00:18:36.907 22:56:27 -- common/autotest_common.sh@1187 -- # (( nvme_devices == nvme_device_counter )) 00:18:36.907 22:56:27 -- common/autotest_common.sh@1187 -- # return 0 00:18:36.907 22:56:27 -- target/multiconnection.sh@28 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:18:36.907 22:56:27 -- target/multiconnection.sh@29 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode10 -a 10.0.0.2 -s 4420 00:18:37.840 22:56:28 -- target/multiconnection.sh@30 -- # waitforserial SPDK10 00:18:37.840 22:56:28 -- common/autotest_common.sh@1177 -- # local i=0 00:18:37.840 22:56:28 -- common/autotest_common.sh@1178 -- # local nvme_device_counter=1 nvme_devices=0 00:18:37.840 22:56:28 -- common/autotest_common.sh@1179 -- # [[ -n '' ]] 00:18:37.840 22:56:28 -- common/autotest_common.sh@1184 -- # sleep 2 00:18:39.739 22:56:30 -- common/autotest_common.sh@1185 -- # (( i++ <= 15 )) 00:18:39.739 22:56:30 -- common/autotest_common.sh@1186 -- # lsblk -l -o NAME,SERIAL 00:18:39.739 22:56:30 -- common/autotest_common.sh@1186 -- # grep -c SPDK10 00:18:39.739 22:56:30 -- common/autotest_common.sh@1186 -- # nvme_devices=1 00:18:39.739 22:56:30 -- common/autotest_common.sh@1187 -- # (( nvme_devices == nvme_device_counter )) 00:18:39.739 22:56:30 -- common/autotest_common.sh@1187 -- # return 0 00:18:39.739 22:56:30 -- target/multiconnection.sh@28 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:18:39.739 22:56:30 -- target/multiconnection.sh@29 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode11 -a 10.0.0.2 -s 4420 00:18:40.672 22:56:31 -- target/multiconnection.sh@30 -- # waitforserial SPDK11 00:18:40.672 22:56:31 -- common/autotest_common.sh@1177 -- # local i=0 00:18:40.672 22:56:31 -- common/autotest_common.sh@1178 -- # local nvme_device_counter=1 nvme_devices=0 00:18:40.672 22:56:31 -- common/autotest_common.sh@1179 -- # [[ -n '' ]] 00:18:40.672 22:56:31 -- common/autotest_common.sh@1184 -- # sleep 2 00:18:42.570 22:56:33 -- common/autotest_common.sh@1185 -- # (( i++ <= 15 )) 00:18:42.570 22:56:33 -- common/autotest_common.sh@1186 -- # lsblk -l -o NAME,SERIAL 00:18:42.570 22:56:33 -- common/autotest_common.sh@1186 -- # grep -c SPDK11 00:18:42.828 22:56:33 -- common/autotest_common.sh@1186 -- # nvme_devices=1 00:18:42.828 22:56:33 -- common/autotest_common.sh@1187 -- # (( nvme_devices == nvme_device_counter )) 00:18:42.828 22:56:33 -- common/autotest_common.sh@1187 -- # return 0 00:18:42.828 22:56:33 -- target/multiconnection.sh@33 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/fio-wrapper -p nvmf -i 262144 -d 64 -t read -r 10 00:18:42.828 [global] 00:18:42.828 thread=1 00:18:42.828 invalidate=1 00:18:42.828 rw=read 00:18:42.828 time_based=1 00:18:42.828 runtime=10 00:18:42.828 ioengine=libaio 00:18:42.828 direct=1 00:18:42.828 bs=262144 00:18:42.828 iodepth=64 00:18:42.828 norandommap=1 00:18:42.828 numjobs=1 00:18:42.828 00:18:42.828 [job0] 00:18:42.828 filename=/dev/nvme0n1 00:18:42.828 [job1] 00:18:42.828 filename=/dev/nvme10n1 00:18:42.828 [job2] 00:18:42.828 filename=/dev/nvme1n1 00:18:42.828 [job3] 00:18:42.828 filename=/dev/nvme2n1 00:18:42.828 [job4] 00:18:42.828 filename=/dev/nvme3n1 00:18:42.828 [job5] 00:18:42.828 filename=/dev/nvme4n1 00:18:42.828 [job6] 00:18:42.828 filename=/dev/nvme5n1 00:18:42.828 [job7] 00:18:42.828 filename=/dev/nvme6n1 00:18:42.828 [job8] 00:18:42.828 filename=/dev/nvme7n1 00:18:42.828 [job9] 00:18:42.828 filename=/dev/nvme8n1 00:18:42.828 [job10] 00:18:42.828 filename=/dev/nvme9n1 00:18:42.828 Could not set queue depth (nvme0n1) 00:18:42.828 Could not set queue depth (nvme10n1) 00:18:42.828 Could not set queue depth (nvme1n1) 00:18:42.828 Could not set queue depth (nvme2n1) 00:18:42.828 Could not set queue depth (nvme3n1) 00:18:42.828 Could not set queue depth (nvme4n1) 00:18:42.828 Could not set queue depth (nvme5n1) 00:18:42.828 Could not set queue depth (nvme6n1) 00:18:42.828 Could not set queue depth (nvme7n1) 00:18:42.828 Could not set queue depth (nvme8n1) 00:18:42.828 Could not set queue depth (nvme9n1) 00:18:43.086 job0: (g=0): rw=read, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:18:43.086 job1: (g=0): rw=read, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:18:43.086 job2: (g=0): rw=read, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:18:43.086 job3: (g=0): rw=read, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:18:43.086 job4: (g=0): rw=read, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:18:43.086 job5: (g=0): rw=read, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:18:43.086 job6: (g=0): rw=read, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:18:43.086 job7: (g=0): rw=read, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:18:43.086 job8: (g=0): rw=read, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:18:43.086 job9: (g=0): rw=read, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:18:43.086 job10: (g=0): rw=read, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:18:43.086 fio-3.35 00:18:43.086 Starting 11 threads 00:18:55.300 00:18:55.300 job0: (groupid=0, jobs=1): err= 0: pid=311024: Tue Apr 16 22:56:44 2024 00:18:55.300 read: IOPS=569, BW=142MiB/s (149MB/s)(1435MiB/10081msec) 00:18:55.300 slat (usec): min=14, max=267478, avg=1524.47, stdev=8278.15 00:18:55.300 clat (msec): min=5, max=705, avg=110.80, stdev=78.88 00:18:55.300 lat (msec): min=5, max=705, avg=112.33, stdev=80.39 00:18:55.300 clat percentiles (msec): 00:18:55.300 | 1.00th=[ 13], 5.00th=[ 29], 10.00th=[ 33], 20.00th=[ 65], 00:18:55.300 | 30.00th=[ 84], 40.00th=[ 92], 50.00th=[ 97], 60.00th=[ 105], 00:18:55.300 | 70.00th=[ 114], 80.00th=[ 127], 90.00th=[ 188], 95.00th=[ 245], 00:18:55.300 | 99.00th=[ 456], 99.50th=[ 460], 99.90th=[ 477], 99.95th=[ 481], 00:18:55.300 | 99.99th=[ 709] 00:18:55.300 bw ( KiB/s): min=31744, max=324096, per=7.28%, avg=145313.25, stdev=73053.56, samples=20 00:18:55.300 iops : min= 124, max= 1266, avg=567.60, stdev=285.35, samples=20 00:18:55.300 lat (msec) : 10=0.52%, 20=1.79%, 50=11.79%, 100=40.26%, 250=40.92% 00:18:55.300 lat (msec) : 500=4.67%, 750=0.03% 00:18:55.300 cpu : usr=0.49%, sys=1.86%, ctx=1294, majf=0, minf=4097 00:18:55.300 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.3%, 32=0.6%, >=64=98.9% 00:18:55.300 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:18:55.300 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:18:55.300 issued rwts: total=5740,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:18:55.300 latency : target=0, window=0, percentile=100.00%, depth=64 00:18:55.300 job1: (groupid=0, jobs=1): err= 0: pid=311025: Tue Apr 16 22:56:44 2024 00:18:55.300 read: IOPS=715, BW=179MiB/s (188MB/s)(1808MiB/10106msec) 00:18:55.300 slat (usec): min=11, max=111381, avg=1182.17, stdev=3901.47 00:18:55.300 clat (msec): min=2, max=246, avg=88.16, stdev=37.59 00:18:55.300 lat (msec): min=2, max=247, avg=89.34, stdev=38.09 00:18:55.300 clat percentiles (msec): 00:18:55.300 | 1.00th=[ 11], 5.00th=[ 28], 10.00th=[ 37], 20.00th=[ 55], 00:18:55.300 | 30.00th=[ 67], 40.00th=[ 82], 50.00th=[ 89], 60.00th=[ 97], 00:18:55.300 | 70.00th=[ 109], 80.00th=[ 122], 90.00th=[ 133], 95.00th=[ 142], 00:18:55.300 | 99.00th=[ 192], 99.50th=[ 207], 99.90th=[ 222], 99.95th=[ 224], 00:18:55.300 | 99.99th=[ 247] 00:18:55.300 bw ( KiB/s): min=92344, max=305664, per=9.19%, avg=183522.70, stdev=59717.77, samples=20 00:18:55.300 iops : min= 360, max= 1194, avg=716.90, stdev=233.46, samples=20 00:18:55.300 lat (msec) : 4=0.24%, 10=0.69%, 20=2.27%, 50=13.56%, 100=46.26% 00:18:55.300 lat (msec) : 250=36.98% 00:18:55.300 cpu : usr=0.48%, sys=2.38%, ctx=1683, majf=0, minf=4097 00:18:55.300 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.2%, 32=0.4%, >=64=99.1% 00:18:55.300 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:18:55.300 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:18:55.300 issued rwts: total=7233,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:18:55.300 latency : target=0, window=0, percentile=100.00%, depth=64 00:18:55.300 job2: (groupid=0, jobs=1): err= 0: pid=311026: Tue Apr 16 22:56:44 2024 00:18:55.300 read: IOPS=704, BW=176MiB/s (185MB/s)(1771MiB/10047msec) 00:18:55.300 slat (usec): min=10, max=281242, avg=989.58, stdev=6211.58 00:18:55.300 clat (msec): min=2, max=465, avg=89.74, stdev=72.99 00:18:55.300 lat (msec): min=2, max=703, avg=90.73, stdev=74.02 00:18:55.300 clat percentiles (msec): 00:18:55.300 | 1.00th=[ 8], 5.00th=[ 16], 10.00th=[ 26], 20.00th=[ 31], 00:18:55.300 | 30.00th=[ 42], 40.00th=[ 66], 50.00th=[ 79], 60.00th=[ 93], 00:18:55.300 | 70.00th=[ 109], 80.00th=[ 126], 90.00th=[ 161], 95.00th=[ 215], 00:18:55.300 | 99.00th=[ 426], 99.50th=[ 439], 99.90th=[ 451], 99.95th=[ 456], 00:18:55.300 | 99.99th=[ 468] 00:18:55.300 bw ( KiB/s): min=53248, max=505856, per=9.00%, avg=179669.35, stdev=107570.24, samples=20 00:18:55.300 iops : min= 208, max= 1976, avg=701.80, stdev=420.20, samples=20 00:18:55.300 lat (msec) : 4=0.32%, 10=1.10%, 20=5.82%, 50=26.62%, 100=30.85% 00:18:55.300 lat (msec) : 250=31.64%, 500=3.64% 00:18:55.300 cpu : usr=0.39%, sys=2.28%, ctx=1750, majf=0, minf=3722 00:18:55.300 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.2%, 32=0.5%, >=64=99.1% 00:18:55.300 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:18:55.300 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:18:55.300 issued rwts: total=7082,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:18:55.300 latency : target=0, window=0, percentile=100.00%, depth=64 00:18:55.300 job3: (groupid=0, jobs=1): err= 0: pid=311029: Tue Apr 16 22:56:44 2024 00:18:55.300 read: IOPS=939, BW=235MiB/s (246MB/s)(2373MiB/10101msec) 00:18:55.300 slat (usec): min=11, max=44392, avg=956.90, stdev=2858.66 00:18:55.300 clat (usec): min=1401, max=201603, avg=67096.98, stdev=33504.13 00:18:55.300 lat (usec): min=1426, max=201643, avg=68053.88, stdev=33996.59 00:18:55.300 clat percentiles (msec): 00:18:55.300 | 1.00th=[ 9], 5.00th=[ 27], 10.00th=[ 30], 20.00th=[ 34], 00:18:55.300 | 30.00th=[ 45], 40.00th=[ 53], 50.00th=[ 61], 60.00th=[ 75], 00:18:55.300 | 70.00th=[ 87], 80.00th=[ 99], 90.00th=[ 115], 95.00th=[ 128], 00:18:55.300 | 99.00th=[ 148], 99.50th=[ 157], 99.90th=[ 201], 99.95th=[ 203], 00:18:55.300 | 99.99th=[ 203] 00:18:55.300 bw ( KiB/s): min=123392, max=460288, per=12.09%, avg=241365.90, stdev=100284.20, samples=20 00:18:55.300 iops : min= 482, max= 1798, avg=942.80, stdev=391.76, samples=20 00:18:55.300 lat (msec) : 2=0.01%, 4=0.21%, 10=1.38%, 20=1.84%, 50=33.22% 00:18:55.300 lat (msec) : 100=45.11%, 250=18.23% 00:18:55.300 cpu : usr=0.58%, sys=3.03%, ctx=2005, majf=0, minf=4097 00:18:55.300 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.2%, 32=0.3%, >=64=99.3% 00:18:55.300 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:18:55.300 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:18:55.300 issued rwts: total=9492,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:18:55.300 latency : target=0, window=0, percentile=100.00%, depth=64 00:18:55.300 job4: (groupid=0, jobs=1): err= 0: pid=311032: Tue Apr 16 22:56:44 2024 00:18:55.300 read: IOPS=543, BW=136MiB/s (143MB/s)(1364MiB/10034msec) 00:18:55.300 slat (usec): min=13, max=193566, avg=1540.33, stdev=6786.20 00:18:55.300 clat (msec): min=3, max=611, avg=116.10, stdev=81.36 00:18:55.300 lat (msec): min=3, max=611, avg=117.64, stdev=82.76 00:18:55.300 clat percentiles (msec): 00:18:55.300 | 1.00th=[ 11], 5.00th=[ 22], 10.00th=[ 42], 20.00th=[ 63], 00:18:55.300 | 30.00th=[ 82], 40.00th=[ 92], 50.00th=[ 102], 60.00th=[ 111], 00:18:55.300 | 70.00th=[ 123], 80.00th=[ 140], 90.00th=[ 199], 95.00th=[ 275], 00:18:55.300 | 99.00th=[ 443], 99.50th=[ 464], 99.90th=[ 485], 99.95th=[ 575], 00:18:55.300 | 99.99th=[ 609] 00:18:55.300 bw ( KiB/s): min=33280, max=260096, per=6.91%, avg=138012.15, stdev=61703.84, samples=20 00:18:55.300 iops : min= 130, max= 1016, avg=539.10, stdev=241.01, samples=20 00:18:55.300 lat (msec) : 4=0.18%, 10=0.57%, 20=3.52%, 50=9.04%, 100=34.74% 00:18:55.300 lat (msec) : 250=45.88%, 500=5.99%, 750=0.07% 00:18:55.300 cpu : usr=0.38%, sys=1.89%, ctx=1330, majf=0, minf=4097 00:18:55.300 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.3%, 32=0.6%, >=64=98.8% 00:18:55.300 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:18:55.300 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:18:55.300 issued rwts: total=5455,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:18:55.300 latency : target=0, window=0, percentile=100.00%, depth=64 00:18:55.300 job5: (groupid=0, jobs=1): err= 0: pid=311033: Tue Apr 16 22:56:44 2024 00:18:55.300 read: IOPS=814, BW=204MiB/s (213MB/s)(2041MiB/10026msec) 00:18:55.300 slat (usec): min=10, max=115660, avg=1022.33, stdev=3576.63 00:18:55.300 clat (usec): min=866, max=350721, avg=77524.00, stdev=42629.00 00:18:55.300 lat (usec): min=910, max=350734, avg=78546.33, stdev=43187.10 00:18:55.300 clat percentiles (msec): 00:18:55.300 | 1.00th=[ 4], 5.00th=[ 15], 10.00th=[ 30], 20.00th=[ 48], 00:18:55.300 | 30.00th=[ 57], 40.00th=[ 65], 50.00th=[ 73], 60.00th=[ 81], 00:18:55.300 | 70.00th=[ 89], 80.00th=[ 105], 90.00th=[ 133], 95.00th=[ 150], 00:18:55.300 | 99.00th=[ 224], 99.50th=[ 271], 99.90th=[ 326], 99.95th=[ 342], 00:18:55.300 | 99.99th=[ 351] 00:18:55.300 bw ( KiB/s): min=140288, max=302080, per=10.39%, avg=207364.20, stdev=47901.56, samples=20 00:18:55.300 iops : min= 548, max= 1180, avg=810.00, stdev=187.11, samples=20 00:18:55.300 lat (usec) : 1000=0.04% 00:18:55.301 lat (msec) : 2=0.33%, 4=1.13%, 10=1.84%, 20=3.63%, 50=16.05% 00:18:55.301 lat (msec) : 100=55.34%, 250=21.08%, 500=0.58% 00:18:55.301 cpu : usr=0.46%, sys=2.75%, ctx=1916, majf=0, minf=4097 00:18:55.301 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.2%, 32=0.4%, >=64=99.2% 00:18:55.301 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:18:55.301 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:18:55.301 issued rwts: total=8164,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:18:55.301 latency : target=0, window=0, percentile=100.00%, depth=64 00:18:55.301 job6: (groupid=0, jobs=1): err= 0: pid=311034: Tue Apr 16 22:56:44 2024 00:18:55.301 read: IOPS=524, BW=131MiB/s (137MB/s)(1314MiB/10025msec) 00:18:55.301 slat (usec): min=10, max=208850, avg=1492.12, stdev=7580.23 00:18:55.301 clat (msec): min=2, max=669, avg=120.51, stdev=82.60 00:18:55.301 lat (msec): min=2, max=669, avg=122.01, stdev=83.88 00:18:55.301 clat percentiles (msec): 00:18:55.301 | 1.00th=[ 5], 5.00th=[ 17], 10.00th=[ 40], 20.00th=[ 66], 00:18:55.301 | 30.00th=[ 82], 40.00th=[ 94], 50.00th=[ 107], 60.00th=[ 121], 00:18:55.301 | 70.00th=[ 131], 80.00th=[ 153], 90.00th=[ 205], 95.00th=[ 300], 00:18:55.301 | 99.00th=[ 447], 99.50th=[ 456], 99.90th=[ 472], 99.95th=[ 550], 00:18:55.301 | 99.99th=[ 667] 00:18:55.301 bw ( KiB/s): min=43520, max=269796, per=6.65%, avg=132862.60, stdev=64408.81, samples=20 00:18:55.301 iops : min= 170, max= 1053, avg=518.95, stdev=251.50, samples=20 00:18:55.301 lat (msec) : 4=0.61%, 10=1.07%, 20=4.28%, 50=6.40%, 100=33.10% 00:18:55.301 lat (msec) : 250=47.74%, 500=6.72%, 750=0.10% 00:18:55.301 cpu : usr=0.21%, sys=1.94%, ctx=1420, majf=0, minf=4097 00:18:55.301 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.2%, 16=0.3%, 32=0.6%, >=64=98.8% 00:18:55.301 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:18:55.301 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:18:55.301 issued rwts: total=5254,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:18:55.301 latency : target=0, window=0, percentile=100.00%, depth=64 00:18:55.301 job7: (groupid=0, jobs=1): err= 0: pid=311035: Tue Apr 16 22:56:44 2024 00:18:55.301 read: IOPS=881, BW=220MiB/s (231MB/s)(2228MiB/10107msec) 00:18:55.301 slat (usec): min=10, max=99558, avg=797.82, stdev=3687.38 00:18:55.301 clat (usec): min=813, max=305226, avg=71757.85, stdev=50908.91 00:18:55.301 lat (usec): min=831, max=345952, avg=72555.66, stdev=51501.82 00:18:55.301 clat percentiles (msec): 00:18:55.301 | 1.00th=[ 4], 5.00th=[ 14], 10.00th=[ 21], 20.00th=[ 32], 00:18:55.301 | 30.00th=[ 34], 40.00th=[ 37], 50.00th=[ 54], 60.00th=[ 73], 00:18:55.301 | 70.00th=[ 103], 80.00th=[ 122], 90.00th=[ 144], 95.00th=[ 163], 00:18:55.301 | 99.00th=[ 213], 99.50th=[ 243], 99.90th=[ 292], 99.95th=[ 300], 00:18:55.301 | 99.99th=[ 305] 00:18:55.301 bw ( KiB/s): min=98816, max=504832, per=11.34%, avg=226440.50, stdev=117252.25, samples=20 00:18:55.301 iops : min= 386, max= 1972, avg=884.50, stdev=458.03, samples=20 00:18:55.301 lat (usec) : 1000=0.02% 00:18:55.301 lat (msec) : 2=0.24%, 4=1.10%, 10=2.48%, 20=5.84%, 50=37.93% 00:18:55.301 lat (msec) : 100=20.90%, 250=31.16%, 500=0.34% 00:18:55.301 cpu : usr=0.63%, sys=2.73%, ctx=2214, majf=0, minf=4097 00:18:55.301 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.2%, 32=0.4%, >=64=99.3% 00:18:55.301 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:18:55.301 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:18:55.301 issued rwts: total=8910,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:18:55.301 latency : target=0, window=0, percentile=100.00%, depth=64 00:18:55.301 job8: (groupid=0, jobs=1): err= 0: pid=311036: Tue Apr 16 22:56:44 2024 00:18:55.301 read: IOPS=500, BW=125MiB/s (131MB/s)(1266MiB/10104msec) 00:18:55.301 slat (usec): min=9, max=172779, avg=1420.87, stdev=6159.16 00:18:55.301 clat (msec): min=4, max=616, avg=126.22, stdev=79.73 00:18:55.301 lat (msec): min=4, max=617, avg=127.65, stdev=80.94 00:18:55.301 clat percentiles (msec): 00:18:55.301 | 1.00th=[ 19], 5.00th=[ 41], 10.00th=[ 57], 20.00th=[ 80], 00:18:55.301 | 30.00th=[ 90], 40.00th=[ 99], 50.00th=[ 111], 60.00th=[ 124], 00:18:55.301 | 70.00th=[ 138], 80.00th=[ 155], 90.00th=[ 190], 95.00th=[ 292], 00:18:55.301 | 99.00th=[ 451], 99.50th=[ 464], 99.90th=[ 485], 99.95th=[ 510], 00:18:55.301 | 99.99th=[ 617] 00:18:55.301 bw ( KiB/s): min=31744, max=248832, per=6.41%, avg=127960.75, stdev=58108.71, samples=20 00:18:55.301 iops : min= 124, max= 972, avg=499.80, stdev=226.98, samples=20 00:18:55.301 lat (msec) : 10=0.28%, 20=1.15%, 50=6.46%, 100=33.23%, 250=52.77% 00:18:55.301 lat (msec) : 500=6.05%, 750=0.08% 00:18:55.301 cpu : usr=0.31%, sys=1.60%, ctx=1362, majf=0, minf=4097 00:18:55.301 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.2%, 16=0.3%, 32=0.6%, >=64=98.8% 00:18:55.301 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:18:55.301 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:18:55.301 issued rwts: total=5062,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:18:55.301 latency : target=0, window=0, percentile=100.00%, depth=64 00:18:55.301 job9: (groupid=0, jobs=1): err= 0: pid=311037: Tue Apr 16 22:56:44 2024 00:18:55.301 read: IOPS=1119, BW=280MiB/s (293MB/s)(2812MiB/10049msec) 00:18:55.301 slat (usec): min=10, max=86301, avg=792.47, stdev=2483.73 00:18:55.301 clat (msec): min=3, max=172, avg=56.36, stdev=27.11 00:18:55.301 lat (msec): min=3, max=184, avg=57.15, stdev=27.44 00:18:55.301 clat percentiles (msec): 00:18:55.301 | 1.00th=[ 15], 5.00th=[ 27], 10.00th=[ 29], 20.00th=[ 32], 00:18:55.301 | 30.00th=[ 36], 40.00th=[ 46], 50.00th=[ 53], 60.00th=[ 58], 00:18:55.301 | 70.00th=[ 67], 80.00th=[ 81], 90.00th=[ 93], 95.00th=[ 107], 00:18:55.301 | 99.00th=[ 140], 99.50th=[ 155], 99.90th=[ 171], 99.95th=[ 174], 00:18:55.301 | 99.99th=[ 174] 00:18:55.301 bw ( KiB/s): min=163001, max=541184, per=14.34%, avg=286268.45, stdev=104831.67, samples=20 00:18:55.301 iops : min= 636, max= 2114, avg=1118.20, stdev=409.54, samples=20 00:18:55.301 lat (msec) : 4=0.09%, 10=0.33%, 20=1.92%, 50=44.50%, 100=46.30% 00:18:55.301 lat (msec) : 250=6.86% 00:18:55.301 cpu : usr=0.57%, sys=3.55%, ctx=2253, majf=0, minf=4097 00:18:55.301 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.1%, 32=0.3%, >=64=99.4% 00:18:55.301 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:18:55.301 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:18:55.301 issued rwts: total=11246,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:18:55.301 latency : target=0, window=0, percentile=100.00%, depth=64 00:18:55.301 job10: (groupid=0, jobs=1): err= 0: pid=311038: Tue Apr 16 22:56:44 2024 00:18:55.301 read: IOPS=518, BW=130MiB/s (136MB/s)(1310MiB/10113msec) 00:18:55.301 slat (usec): min=11, max=338473, avg=1609.35, stdev=8595.10 00:18:55.301 clat (usec): min=1250, max=784967, avg=121841.69, stdev=71368.86 00:18:55.301 lat (usec): min=1315, max=785007, avg=123451.04, stdev=72527.05 00:18:55.301 clat percentiles (msec): 00:18:55.301 | 1.00th=[ 12], 5.00th=[ 40], 10.00th=[ 63], 20.00th=[ 82], 00:18:55.301 | 30.00th=[ 93], 40.00th=[ 101], 50.00th=[ 110], 60.00th=[ 122], 00:18:55.301 | 70.00th=[ 129], 80.00th=[ 144], 90.00th=[ 184], 95.00th=[ 232], 00:18:55.301 | 99.00th=[ 464], 99.50th=[ 481], 99.90th=[ 510], 99.95th=[ 510], 00:18:55.301 | 99.99th=[ 785] 00:18:55.301 bw ( KiB/s): min=31744, max=212480, per=6.64%, avg=132486.50, stdev=42464.55, samples=20 00:18:55.301 iops : min= 124, max= 830, avg=517.50, stdev=165.84, samples=20 00:18:55.301 lat (msec) : 2=0.19%, 4=0.31%, 10=0.42%, 20=1.03%, 50=5.06% 00:18:55.301 lat (msec) : 100=32.65%, 250=56.28%, 500=3.87%, 750=0.17%, 1000=0.02% 00:18:55.301 cpu : usr=0.34%, sys=1.74%, ctx=1211, majf=0, minf=4097 00:18:55.301 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.2%, 16=0.3%, 32=0.6%, >=64=98.8% 00:18:55.301 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:18:55.301 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:18:55.301 issued rwts: total=5240,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:18:55.301 latency : target=0, window=0, percentile=100.00%, depth=64 00:18:55.301 00:18:55.301 Run status group 0 (all jobs): 00:18:55.301 READ: bw=1950MiB/s (2045MB/s), 125MiB/s-280MiB/s (131MB/s-293MB/s), io=19.3GiB (20.7GB), run=10025-10113msec 00:18:55.301 00:18:55.301 Disk stats (read/write): 00:18:55.301 nvme0n1: ios=11248/0, merge=0/0, ticks=1233159/0, in_queue=1233159, util=96.96% 00:18:55.301 nvme10n1: ios=14263/0, merge=0/0, ticks=1231827/0, in_queue=1231827, util=97.20% 00:18:55.301 nvme1n1: ios=13903/0, merge=0/0, ticks=1234714/0, in_queue=1234714, util=97.51% 00:18:55.301 nvme2n1: ios=18766/0, merge=0/0, ticks=1231308/0, in_queue=1231308, util=97.67% 00:18:55.301 nvme3n1: ios=10612/0, merge=0/0, ticks=1232880/0, in_queue=1232880, util=97.75% 00:18:55.301 nvme4n1: ios=16024/0, merge=0/0, ticks=1235590/0, in_queue=1235590, util=98.13% 00:18:55.301 nvme5n1: ios=10209/0, merge=0/0, ticks=1233588/0, in_queue=1233588, util=98.28% 00:18:55.301 nvme6n1: ios=17561/0, merge=0/0, ticks=1233423/0, in_queue=1233423, util=98.41% 00:18:55.301 nvme7n1: ios=9888/0, merge=0/0, ticks=1233097/0, in_queue=1233097, util=98.87% 00:18:55.301 nvme8n1: ios=22246/0, merge=0/0, ticks=1233143/0, in_queue=1233143, util=99.08% 00:18:55.301 nvme9n1: ios=10220/0, merge=0/0, ticks=1231899/0, in_queue=1231899, util=99.21% 00:18:55.301 22:56:44 -- target/multiconnection.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/fio-wrapper -p nvmf -i 262144 -d 64 -t randwrite -r 10 00:18:55.301 [global] 00:18:55.301 thread=1 00:18:55.301 invalidate=1 00:18:55.301 rw=randwrite 00:18:55.301 time_based=1 00:18:55.301 runtime=10 00:18:55.301 ioengine=libaio 00:18:55.301 direct=1 00:18:55.301 bs=262144 00:18:55.301 iodepth=64 00:18:55.301 norandommap=1 00:18:55.301 numjobs=1 00:18:55.301 00:18:55.301 [job0] 00:18:55.301 filename=/dev/nvme0n1 00:18:55.301 [job1] 00:18:55.301 filename=/dev/nvme10n1 00:18:55.301 [job2] 00:18:55.301 filename=/dev/nvme1n1 00:18:55.301 [job3] 00:18:55.301 filename=/dev/nvme2n1 00:18:55.301 [job4] 00:18:55.301 filename=/dev/nvme3n1 00:18:55.301 [job5] 00:18:55.301 filename=/dev/nvme4n1 00:18:55.301 [job6] 00:18:55.301 filename=/dev/nvme5n1 00:18:55.301 [job7] 00:18:55.301 filename=/dev/nvme6n1 00:18:55.301 [job8] 00:18:55.301 filename=/dev/nvme7n1 00:18:55.301 [job9] 00:18:55.301 filename=/dev/nvme8n1 00:18:55.301 [job10] 00:18:55.301 filename=/dev/nvme9n1 00:18:55.301 Could not set queue depth (nvme0n1) 00:18:55.301 Could not set queue depth (nvme10n1) 00:18:55.301 Could not set queue depth (nvme1n1) 00:18:55.301 Could not set queue depth (nvme2n1) 00:18:55.301 Could not set queue depth (nvme3n1) 00:18:55.301 Could not set queue depth (nvme4n1) 00:18:55.302 Could not set queue depth (nvme5n1) 00:18:55.302 Could not set queue depth (nvme6n1) 00:18:55.302 Could not set queue depth (nvme7n1) 00:18:55.302 Could not set queue depth (nvme8n1) 00:18:55.302 Could not set queue depth (nvme9n1) 00:18:55.302 job0: (g=0): rw=randwrite, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:18:55.302 job1: (g=0): rw=randwrite, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:18:55.302 job2: (g=0): rw=randwrite, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:18:55.302 job3: (g=0): rw=randwrite, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:18:55.302 job4: (g=0): rw=randwrite, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:18:55.302 job5: (g=0): rw=randwrite, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:18:55.302 job6: (g=0): rw=randwrite, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:18:55.302 job7: (g=0): rw=randwrite, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:18:55.302 job8: (g=0): rw=randwrite, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:18:55.302 job9: (g=0): rw=randwrite, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:18:55.302 job10: (g=0): rw=randwrite, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:18:55.302 fio-3.35 00:18:55.302 Starting 11 threads 00:19:05.283 00:19:05.283 job0: (groupid=0, jobs=1): err= 0: pid=312237: Tue Apr 16 22:56:55 2024 00:19:05.283 write: IOPS=477, BW=119MiB/s (125MB/s)(1212MiB/10147msec); 0 zone resets 00:19:05.283 slat (usec): min=17, max=148098, avg=1772.95, stdev=4346.95 00:19:05.283 clat (msec): min=2, max=329, avg=132.10, stdev=57.29 00:19:05.283 lat (msec): min=2, max=329, avg=133.88, stdev=58.00 00:19:05.283 clat percentiles (msec): 00:19:05.283 | 1.00th=[ 10], 5.00th=[ 37], 10.00th=[ 43], 20.00th=[ 73], 00:19:05.283 | 30.00th=[ 108], 40.00th=[ 138], 50.00th=[ 146], 60.00th=[ 148], 00:19:05.283 | 70.00th=[ 159], 80.00th=[ 178], 90.00th=[ 197], 95.00th=[ 220], 00:19:05.283 | 99.00th=[ 259], 99.50th=[ 279], 99.90th=[ 321], 99.95th=[ 321], 00:19:05.283 | 99.99th=[ 330] 00:19:05.283 bw ( KiB/s): min=73728, max=199168, per=8.81%, avg=122427.60, stdev=32774.91, samples=20 00:19:05.283 iops : min= 288, max= 778, avg=478.20, stdev=127.98, samples=20 00:19:05.283 lat (msec) : 4=0.27%, 10=0.97%, 20=1.73%, 50=9.68%, 100=15.89% 00:19:05.283 lat (msec) : 250=70.20%, 500=1.26% 00:19:05.283 cpu : usr=1.59%, sys=1.64%, ctx=1879, majf=0, minf=1 00:19:05.283 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.2%, 16=0.3%, 32=0.7%, >=64=98.7% 00:19:05.283 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:05.283 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:19:05.283 issued rwts: total=0,4846,0,0 short=0,0,0,0 dropped=0,0,0,0 00:19:05.283 latency : target=0, window=0, percentile=100.00%, depth=64 00:19:05.283 job1: (groupid=0, jobs=1): err= 0: pid=312249: Tue Apr 16 22:56:55 2024 00:19:05.283 write: IOPS=574, BW=144MiB/s (151MB/s)(1451MiB/10106msec); 0 zone resets 00:19:05.283 slat (usec): min=15, max=69666, avg=1097.70, stdev=3151.11 00:19:05.283 clat (usec): min=1244, max=308960, avg=110313.65, stdev=58727.62 00:19:05.283 lat (usec): min=1291, max=309046, avg=111411.35, stdev=59182.56 00:19:05.283 clat percentiles (msec): 00:19:05.283 | 1.00th=[ 6], 5.00th=[ 16], 10.00th=[ 31], 20.00th=[ 52], 00:19:05.283 | 30.00th=[ 81], 40.00th=[ 101], 50.00th=[ 106], 60.00th=[ 122], 00:19:05.283 | 70.00th=[ 144], 80.00th=[ 157], 90.00th=[ 182], 95.00th=[ 213], 00:19:05.283 | 99.00th=[ 259], 99.50th=[ 271], 99.90th=[ 305], 99.95th=[ 309], 00:19:05.283 | 99.99th=[ 309] 00:19:05.283 bw ( KiB/s): min=87040, max=292864, per=10.57%, avg=146926.60, stdev=47670.36, samples=20 00:19:05.283 iops : min= 340, max= 1144, avg=573.90, stdev=186.19, samples=20 00:19:05.283 lat (msec) : 2=0.12%, 4=0.45%, 10=2.02%, 20=3.88%, 50=13.13% 00:19:05.283 lat (msec) : 100=20.44%, 250=57.75%, 500=2.22% 00:19:05.283 cpu : usr=1.82%, sys=2.09%, ctx=3366, majf=0, minf=1 00:19:05.283 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.3%, 32=0.6%, >=64=98.9% 00:19:05.284 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:05.284 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:19:05.284 issued rwts: total=0,5803,0,0 short=0,0,0,0 dropped=0,0,0,0 00:19:05.284 latency : target=0, window=0, percentile=100.00%, depth=64 00:19:05.284 job2: (groupid=0, jobs=1): err= 0: pid=312250: Tue Apr 16 22:56:55 2024 00:19:05.284 write: IOPS=381, BW=95.3MiB/s (99.9MB/s)(965MiB/10131msec); 0 zone resets 00:19:05.284 slat (usec): min=16, max=70226, avg=2017.41, stdev=5036.09 00:19:05.284 clat (usec): min=1347, max=485439, avg=165873.81, stdev=78723.73 00:19:05.284 lat (usec): min=1402, max=485499, avg=167891.22, stdev=79838.36 00:19:05.284 clat percentiles (msec): 00:19:05.284 | 1.00th=[ 5], 5.00th=[ 20], 10.00th=[ 42], 20.00th=[ 111], 00:19:05.284 | 30.00th=[ 144], 40.00th=[ 165], 50.00th=[ 176], 60.00th=[ 190], 00:19:05.284 | 70.00th=[ 203], 80.00th=[ 218], 90.00th=[ 241], 95.00th=[ 268], 00:19:05.284 | 99.00th=[ 430], 99.50th=[ 451], 99.90th=[ 468], 99.95th=[ 485], 00:19:05.284 | 99.99th=[ 485] 00:19:05.284 bw ( KiB/s): min=44966, max=185344, per=7.00%, avg=97208.05, stdev=30490.43, samples=20 00:19:05.284 iops : min= 175, max= 724, avg=379.65, stdev=119.17, samples=20 00:19:05.284 lat (msec) : 2=0.10%, 4=0.52%, 10=2.10%, 20=2.51%, 50=6.89% 00:19:05.284 lat (msec) : 100=6.79%, 250=74.07%, 500=7.02% 00:19:05.284 cpu : usr=1.20%, sys=1.27%, ctx=2005, majf=0, minf=1 00:19:05.284 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.2%, 16=0.4%, 32=0.8%, >=64=98.4% 00:19:05.284 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:05.284 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:19:05.284 issued rwts: total=0,3860,0,0 short=0,0,0,0 dropped=0,0,0,0 00:19:05.284 latency : target=0, window=0, percentile=100.00%, depth=64 00:19:05.284 job3: (groupid=0, jobs=1): err= 0: pid=312251: Tue Apr 16 22:56:55 2024 00:19:05.284 write: IOPS=509, BW=127MiB/s (134MB/s)(1293MiB/10145msec); 0 zone resets 00:19:05.284 slat (usec): min=21, max=64369, avg=1630.88, stdev=4339.91 00:19:05.284 clat (usec): min=1506, max=487539, avg=123806.00, stdev=85181.27 00:19:05.284 lat (usec): min=1559, max=511456, avg=125436.87, stdev=86378.85 00:19:05.284 clat percentiles (msec): 00:19:05.284 | 1.00th=[ 8], 5.00th=[ 24], 10.00th=[ 37], 20.00th=[ 51], 00:19:05.284 | 30.00th=[ 56], 40.00th=[ 73], 50.00th=[ 111], 60.00th=[ 148], 00:19:05.284 | 70.00th=[ 157], 80.00th=[ 188], 90.00th=[ 247], 95.00th=[ 266], 00:19:05.284 | 99.00th=[ 414], 99.50th=[ 451], 99.90th=[ 485], 99.95th=[ 489], 00:19:05.284 | 99.99th=[ 489] 00:19:05.284 bw ( KiB/s): min=47616, max=325632, per=9.41%, avg=130790.40, stdev=84529.14, samples=20 00:19:05.284 iops : min= 186, max= 1272, avg=510.90, stdev=330.19, samples=20 00:19:05.284 lat (msec) : 2=0.04%, 4=0.31%, 10=1.18%, 20=2.18%, 50=16.09% 00:19:05.284 lat (msec) : 100=29.12%, 250=41.96%, 500=9.13% 00:19:05.284 cpu : usr=1.61%, sys=1.85%, ctx=2421, majf=0, minf=1 00:19:05.284 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.2%, 16=0.3%, 32=0.6%, >=64=98.8% 00:19:05.284 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:05.284 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:19:05.284 issued rwts: total=0,5172,0,0 short=0,0,0,0 dropped=0,0,0,0 00:19:05.284 latency : target=0, window=0, percentile=100.00%, depth=64 00:19:05.284 job4: (groupid=0, jobs=1): err= 0: pid=312252: Tue Apr 16 22:56:55 2024 00:19:05.284 write: IOPS=399, BW=100.0MiB/s (105MB/s)(1015MiB/10149msec); 0 zone resets 00:19:05.284 slat (usec): min=23, max=79708, avg=2079.06, stdev=4888.38 00:19:05.284 clat (msec): min=3, max=531, avg=157.90, stdev=75.95 00:19:05.284 lat (msec): min=3, max=531, avg=159.98, stdev=76.93 00:19:05.284 clat percentiles (msec): 00:19:05.284 | 1.00th=[ 11], 5.00th=[ 30], 10.00th=[ 48], 20.00th=[ 99], 00:19:05.284 | 30.00th=[ 134], 40.00th=[ 153], 50.00th=[ 171], 60.00th=[ 184], 00:19:05.284 | 70.00th=[ 194], 80.00th=[ 205], 90.00th=[ 220], 95.00th=[ 236], 00:19:05.284 | 99.00th=[ 481], 99.50th=[ 506], 99.90th=[ 531], 99.95th=[ 531], 00:19:05.284 | 99.99th=[ 531] 00:19:05.284 bw ( KiB/s): min=40878, max=217600, per=7.36%, avg=102267.90, stdev=37842.11, samples=20 00:19:05.284 iops : min= 159, max= 850, avg=399.45, stdev=147.88, samples=20 00:19:05.284 lat (msec) : 4=0.05%, 10=0.86%, 20=2.51%, 50=7.44%, 100=9.73% 00:19:05.284 lat (msec) : 250=75.75%, 500=2.96%, 750=0.69% 00:19:05.284 cpu : usr=1.36%, sys=1.46%, ctx=1791, majf=0, minf=1 00:19:05.284 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.2%, 16=0.4%, 32=0.8%, >=64=98.4% 00:19:05.284 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:05.284 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:19:05.284 issued rwts: total=0,4058,0,0 short=0,0,0,0 dropped=0,0,0,0 00:19:05.284 latency : target=0, window=0, percentile=100.00%, depth=64 00:19:05.284 job5: (groupid=0, jobs=1): err= 0: pid=312254: Tue Apr 16 22:56:55 2024 00:19:05.284 write: IOPS=512, BW=128MiB/s (134MB/s)(1299MiB/10136msec); 0 zone resets 00:19:05.284 slat (usec): min=20, max=47787, avg=1496.81, stdev=3820.26 00:19:05.284 clat (msec): min=2, max=495, avg=123.31, stdev=76.00 00:19:05.284 lat (msec): min=2, max=495, avg=124.81, stdev=76.98 00:19:05.284 clat percentiles (msec): 00:19:05.284 | 1.00th=[ 10], 5.00th=[ 22], 10.00th=[ 23], 20.00th=[ 49], 00:19:05.284 | 30.00th=[ 72], 40.00th=[ 91], 50.00th=[ 115], 60.00th=[ 140], 00:19:05.284 | 70.00th=[ 178], 80.00th=[ 199], 90.00th=[ 215], 95.00th=[ 236], 00:19:05.284 | 99.00th=[ 292], 99.50th=[ 368], 99.90th=[ 468], 99.95th=[ 485], 00:19:05.284 | 99.99th=[ 498] 00:19:05.284 bw ( KiB/s): min=63488, max=305152, per=9.46%, avg=131397.75, stdev=64487.41, samples=20 00:19:05.284 iops : min= 248, max= 1192, avg=513.25, stdev=251.88, samples=20 00:19:05.284 lat (msec) : 4=0.13%, 10=0.96%, 20=2.35%, 50=18.36%, 100=22.73% 00:19:05.284 lat (msec) : 250=51.53%, 500=3.93% 00:19:05.284 cpu : usr=1.47%, sys=2.01%, ctx=2803, majf=0, minf=1 00:19:05.284 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.2%, 16=0.3%, 32=0.6%, >=64=98.8% 00:19:05.284 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:05.284 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:19:05.284 issued rwts: total=0,5195,0,0 short=0,0,0,0 dropped=0,0,0,0 00:19:05.284 latency : target=0, window=0, percentile=100.00%, depth=64 00:19:05.284 job6: (groupid=0, jobs=1): err= 0: pid=312255: Tue Apr 16 22:56:55 2024 00:19:05.284 write: IOPS=592, BW=148MiB/s (155MB/s)(1497MiB/10102msec); 0 zone resets 00:19:05.284 slat (usec): min=14, max=174712, avg=1271.89, stdev=4830.21 00:19:05.284 clat (usec): min=1259, max=511947, avg=106626.39, stdev=79106.59 00:19:05.284 lat (usec): min=1296, max=511989, avg=107898.28, stdev=79882.43 00:19:05.284 clat percentiles (msec): 00:19:05.284 | 1.00th=[ 5], 5.00th=[ 16], 10.00th=[ 33], 20.00th=[ 49], 00:19:05.284 | 30.00th=[ 54], 40.00th=[ 67], 50.00th=[ 91], 60.00th=[ 103], 00:19:05.284 | 70.00th=[ 112], 80.00th=[ 176], 90.00th=[ 222], 95.00th=[ 257], 00:19:05.284 | 99.00th=[ 414], 99.50th=[ 447], 99.90th=[ 489], 99.95th=[ 502], 00:19:05.284 | 99.99th=[ 514] 00:19:05.284 bw ( KiB/s): min=67584, max=328704, per=10.92%, avg=151684.40, stdev=78627.48, samples=20 00:19:05.284 iops : min= 264, max= 1284, avg=592.50, stdev=307.14, samples=20 00:19:05.284 lat (msec) : 2=0.05%, 4=0.84%, 10=2.35%, 20=3.22%, 50=18.30% 00:19:05.284 lat (msec) : 100=31.16%, 250=37.98%, 500=6.05%, 750=0.05% 00:19:05.284 cpu : usr=1.89%, sys=2.05%, ctx=2906, majf=0, minf=1 00:19:05.284 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.3%, 32=0.5%, >=64=98.9% 00:19:05.284 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:05.284 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:19:05.284 issued rwts: total=0,5988,0,0 short=0,0,0,0 dropped=0,0,0,0 00:19:05.284 latency : target=0, window=0, percentile=100.00%, depth=64 00:19:05.284 job7: (groupid=0, jobs=1): err= 0: pid=312256: Tue Apr 16 22:56:55 2024 00:19:05.284 write: IOPS=512, BW=128MiB/s (134MB/s)(1300MiB/10135msec); 0 zone resets 00:19:05.284 slat (usec): min=24, max=141639, avg=1597.19, stdev=4172.85 00:19:05.284 clat (msec): min=4, max=315, avg=123.03, stdev=58.38 00:19:05.284 lat (msec): min=4, max=328, avg=124.62, stdev=59.12 00:19:05.284 clat percentiles (msec): 00:19:05.284 | 1.00th=[ 15], 5.00th=[ 35], 10.00th=[ 46], 20.00th=[ 58], 00:19:05.284 | 30.00th=[ 88], 40.00th=[ 111], 50.00th=[ 130], 60.00th=[ 142], 00:19:05.284 | 70.00th=[ 150], 80.00th=[ 180], 90.00th=[ 203], 95.00th=[ 215], 00:19:05.284 | 99.00th=[ 241], 99.50th=[ 259], 99.90th=[ 296], 99.95th=[ 317], 00:19:05.284 | 99.99th=[ 317] 00:19:05.284 bw ( KiB/s): min=75776, max=290304, per=9.46%, avg=131493.25, stdev=58038.88, samples=20 00:19:05.284 iops : min= 296, max= 1134, avg=513.60, stdev=226.73, samples=20 00:19:05.284 lat (msec) : 10=0.37%, 20=1.65%, 50=14.41%, 100=19.50%, 250=63.49% 00:19:05.284 lat (msec) : 500=0.58% 00:19:05.284 cpu : usr=1.83%, sys=1.89%, ctx=2146, majf=0, minf=1 00:19:05.284 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.2%, 16=0.3%, 32=0.6%, >=64=98.8% 00:19:05.284 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:05.284 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:19:05.284 issued rwts: total=0,5199,0,0 short=0,0,0,0 dropped=0,0,0,0 00:19:05.284 latency : target=0, window=0, percentile=100.00%, depth=64 00:19:05.284 job8: (groupid=0, jobs=1): err= 0: pid=312257: Tue Apr 16 22:56:55 2024 00:19:05.284 write: IOPS=447, BW=112MiB/s (117MB/s)(1129MiB/10100msec); 0 zone resets 00:19:05.284 slat (usec): min=21, max=71082, avg=1356.48, stdev=4107.18 00:19:05.284 clat (usec): min=1099, max=463414, avg=141726.88, stdev=81892.98 00:19:05.284 lat (usec): min=1160, max=469443, avg=143083.36, stdev=82863.56 00:19:05.284 clat percentiles (msec): 00:19:05.284 | 1.00th=[ 7], 5.00th=[ 17], 10.00th=[ 29], 20.00th=[ 57], 00:19:05.284 | 30.00th=[ 94], 40.00th=[ 138], 50.00th=[ 148], 60.00th=[ 165], 00:19:05.284 | 70.00th=[ 182], 80.00th=[ 205], 90.00th=[ 241], 95.00th=[ 264], 00:19:05.284 | 99.00th=[ 414], 99.50th=[ 435], 99.90th=[ 456], 99.95th=[ 460], 00:19:05.284 | 99.99th=[ 464] 00:19:05.284 bw ( KiB/s): min=42922, max=180224, per=8.20%, avg=113992.50, stdev=36554.52, samples=20 00:19:05.284 iops : min= 167, max= 704, avg=445.25, stdev=142.86, samples=20 00:19:05.284 lat (msec) : 2=0.13%, 4=0.18%, 10=1.77%, 20=4.83%, 50=11.16% 00:19:05.284 lat (msec) : 100=13.66%, 250=60.74%, 500=7.53% 00:19:05.284 cpu : usr=1.36%, sys=1.72%, ctx=2817, majf=0, minf=1 00:19:05.284 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.2%, 16=0.4%, 32=0.7%, >=64=98.6% 00:19:05.284 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:05.284 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:19:05.284 issued rwts: total=0,4516,0,0 short=0,0,0,0 dropped=0,0,0,0 00:19:05.284 latency : target=0, window=0, percentile=100.00%, depth=64 00:19:05.284 job9: (groupid=0, jobs=1): err= 0: pid=312258: Tue Apr 16 22:56:55 2024 00:19:05.284 write: IOPS=589, BW=147MiB/s (154MB/s)(1481MiB/10053msec); 0 zone resets 00:19:05.284 slat (usec): min=24, max=84786, avg=1329.14, stdev=3645.65 00:19:05.285 clat (usec): min=1129, max=501535, avg=107237.51, stdev=79460.17 00:19:05.285 lat (usec): min=1193, max=507712, avg=108566.65, stdev=80388.84 00:19:05.285 clat percentiles (msec): 00:19:05.285 | 1.00th=[ 6], 5.00th=[ 20], 10.00th=[ 36], 20.00th=[ 53], 00:19:05.285 | 30.00th=[ 55], 40.00th=[ 58], 50.00th=[ 73], 60.00th=[ 93], 00:19:05.285 | 70.00th=[ 146], 80.00th=[ 176], 90.00th=[ 215], 95.00th=[ 249], 00:19:05.285 | 99.00th=[ 401], 99.50th=[ 443], 99.90th=[ 493], 99.95th=[ 498], 00:19:05.285 | 99.99th=[ 502] 00:19:05.285 bw ( KiB/s): min=43008, max=290304, per=10.80%, avg=150053.30, stdev=77267.16, samples=20 00:19:05.285 iops : min= 168, max= 1134, avg=586.10, stdev=301.85, samples=20 00:19:05.285 lat (msec) : 2=0.07%, 4=0.47%, 10=1.49%, 20=3.27%, 50=9.86% 00:19:05.285 lat (msec) : 100=46.34%, 250=33.58%, 500=4.90%, 750=0.03% 00:19:05.285 cpu : usr=2.01%, sys=2.25%, ctx=2637, majf=0, minf=1 00:19:05.285 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.3%, 32=0.5%, >=64=98.9% 00:19:05.285 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:05.285 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:19:05.285 issued rwts: total=0,5924,0,0 short=0,0,0,0 dropped=0,0,0,0 00:19:05.285 latency : target=0, window=0, percentile=100.00%, depth=64 00:19:05.285 job10: (groupid=0, jobs=1): err= 0: pid=312259: Tue Apr 16 22:56:55 2024 00:19:05.285 write: IOPS=446, BW=112MiB/s (117MB/s)(1133MiB/10145msec); 0 zone resets 00:19:05.285 slat (usec): min=23, max=115921, avg=2052.76, stdev=4347.14 00:19:05.285 clat (msec): min=5, max=439, avg=141.14, stdev=55.70 00:19:05.285 lat (msec): min=7, max=439, avg=143.20, stdev=56.36 00:19:05.285 clat percentiles (msec): 00:19:05.285 | 1.00th=[ 22], 5.00th=[ 45], 10.00th=[ 57], 20.00th=[ 100], 00:19:05.285 | 30.00th=[ 117], 40.00th=[ 138], 50.00th=[ 148], 60.00th=[ 153], 00:19:05.285 | 70.00th=[ 169], 80.00th=[ 182], 90.00th=[ 199], 95.00th=[ 215], 00:19:05.285 | 99.00th=[ 326], 99.50th=[ 355], 99.90th=[ 414], 99.95th=[ 422], 00:19:05.285 | 99.99th=[ 439] 00:19:05.285 bw ( KiB/s): min=79872, max=195193, per=8.23%, avg=114386.85, stdev=32255.65, samples=20 00:19:05.285 iops : min= 312, max= 762, avg=446.80, stdev=125.94, samples=20 00:19:05.285 lat (msec) : 10=0.07%, 20=0.55%, 50=7.55%, 100=12.11%, 250=77.32% 00:19:05.285 lat (msec) : 500=2.41% 00:19:05.285 cpu : usr=1.55%, sys=1.35%, ctx=1567, majf=0, minf=1 00:19:05.285 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.2%, 16=0.4%, 32=0.7%, >=64=98.6% 00:19:05.285 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:05.285 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:19:05.285 issued rwts: total=0,4532,0,0 short=0,0,0,0 dropped=0,0,0,0 00:19:05.285 latency : target=0, window=0, percentile=100.00%, depth=64 00:19:05.285 00:19:05.285 Run status group 0 (all jobs): 00:19:05.285 WRITE: bw=1357MiB/s (1423MB/s), 95.3MiB/s-148MiB/s (99.9MB/s-155MB/s), io=13.5GiB (14.4GB), run=10053-10149msec 00:19:05.285 00:19:05.285 Disk stats (read/write): 00:19:05.285 nvme0n1: ios=47/9515, merge=0/0, ticks=2509/1200497, in_queue=1203006, util=99.87% 00:19:05.285 nvme10n1: ios=45/11391, merge=0/0, ticks=58/1224248, in_queue=1224306, util=97.57% 00:19:05.285 nvme1n1: ios=45/7543, merge=0/0, ticks=320/1211321, in_queue=1211641, util=100.00% 00:19:05.285 nvme2n1: ios=45/10172, merge=0/0, ticks=2631/1206783, in_queue=1209414, util=100.00% 00:19:05.285 nvme3n1: ios=0/7905, merge=0/0, ticks=0/1211590, in_queue=1211590, util=97.83% 00:19:05.285 nvme4n1: ios=0/10215, merge=0/0, ticks=0/1211879, in_queue=1211879, util=98.17% 00:19:05.285 nvme5n1: ios=43/11756, merge=0/0, ticks=2636/1178781, in_queue=1181417, util=100.00% 00:19:05.285 nvme6n1: ios=52/10217, merge=0/0, ticks=3054/1194560, in_queue=1197614, util=100.00% 00:19:05.285 nvme7n1: ios=0/8819, merge=0/0, ticks=0/1225832, in_queue=1225832, util=98.76% 00:19:05.285 nvme8n1: ios=0/11576, merge=0/0, ticks=0/1219227, in_queue=1219227, util=98.97% 00:19:05.285 nvme9n1: ios=0/8882, merge=0/0, ticks=0/1206165, in_queue=1206165, util=99.04% 00:19:05.285 22:56:55 -- target/multiconnection.sh@36 -- # sync 00:19:05.285 22:56:55 -- target/multiconnection.sh@37 -- # seq 1 11 00:19:05.285 22:56:55 -- target/multiconnection.sh@37 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:19:05.285 22:56:55 -- target/multiconnection.sh@38 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:19:05.285 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:19:05.285 22:56:55 -- target/multiconnection.sh@39 -- # waitforserial_disconnect SPDK1 00:19:05.285 22:56:55 -- common/autotest_common.sh@1198 -- # local i=0 00:19:05.285 22:56:55 -- common/autotest_common.sh@1199 -- # lsblk -o NAME,SERIAL 00:19:05.285 22:56:55 -- common/autotest_common.sh@1199 -- # grep -q -w SPDK1 00:19:05.285 22:56:55 -- common/autotest_common.sh@1206 -- # lsblk -l -o NAME,SERIAL 00:19:05.285 22:56:55 -- common/autotest_common.sh@1206 -- # grep -q -w SPDK1 00:19:05.285 22:56:55 -- common/autotest_common.sh@1210 -- # return 0 00:19:05.285 22:56:55 -- target/multiconnection.sh@40 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:19:05.285 22:56:55 -- common/autotest_common.sh@551 -- # xtrace_disable 00:19:05.285 22:56:55 -- common/autotest_common.sh@10 -- # set +x 00:19:05.285 22:56:55 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:19:05.285 22:56:55 -- target/multiconnection.sh@37 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:19:05.285 22:56:55 -- target/multiconnection.sh@38 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode2 00:19:05.285 NQN:nqn.2016-06.io.spdk:cnode2 disconnected 1 controller(s) 00:19:05.285 22:56:56 -- target/multiconnection.sh@39 -- # waitforserial_disconnect SPDK2 00:19:05.285 22:56:56 -- common/autotest_common.sh@1198 -- # local i=0 00:19:05.285 22:56:56 -- common/autotest_common.sh@1199 -- # lsblk -o NAME,SERIAL 00:19:05.285 22:56:56 -- common/autotest_common.sh@1199 -- # grep -q -w SPDK2 00:19:05.285 22:56:56 -- common/autotest_common.sh@1206 -- # lsblk -l -o NAME,SERIAL 00:19:05.285 22:56:56 -- common/autotest_common.sh@1206 -- # grep -q -w SPDK2 00:19:05.285 22:56:56 -- common/autotest_common.sh@1210 -- # return 0 00:19:05.285 22:56:56 -- target/multiconnection.sh@40 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode2 00:19:05.285 22:56:56 -- common/autotest_common.sh@551 -- # xtrace_disable 00:19:05.285 22:56:56 -- common/autotest_common.sh@10 -- # set +x 00:19:05.285 22:56:56 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:19:05.285 22:56:56 -- target/multiconnection.sh@37 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:19:05.285 22:56:56 -- target/multiconnection.sh@38 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode3 00:19:05.285 NQN:nqn.2016-06.io.spdk:cnode3 disconnected 1 controller(s) 00:19:05.285 22:56:56 -- target/multiconnection.sh@39 -- # waitforserial_disconnect SPDK3 00:19:05.285 22:56:56 -- common/autotest_common.sh@1198 -- # local i=0 00:19:05.285 22:56:56 -- common/autotest_common.sh@1199 -- # lsblk -o NAME,SERIAL 00:19:05.285 22:56:56 -- common/autotest_common.sh@1199 -- # grep -q -w SPDK3 00:19:05.285 22:56:56 -- common/autotest_common.sh@1206 -- # lsblk -l -o NAME,SERIAL 00:19:05.285 22:56:56 -- common/autotest_common.sh@1206 -- # grep -q -w SPDK3 00:19:05.285 22:56:56 -- common/autotest_common.sh@1210 -- # return 0 00:19:05.285 22:56:56 -- target/multiconnection.sh@40 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode3 00:19:05.285 22:56:56 -- common/autotest_common.sh@551 -- # xtrace_disable 00:19:05.285 22:56:56 -- common/autotest_common.sh@10 -- # set +x 00:19:05.285 22:56:56 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:19:05.285 22:56:56 -- target/multiconnection.sh@37 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:19:05.285 22:56:56 -- target/multiconnection.sh@38 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode4 00:19:05.545 NQN:nqn.2016-06.io.spdk:cnode4 disconnected 1 controller(s) 00:19:05.545 22:56:56 -- target/multiconnection.sh@39 -- # waitforserial_disconnect SPDK4 00:19:05.545 22:56:56 -- common/autotest_common.sh@1198 -- # local i=0 00:19:05.545 22:56:56 -- common/autotest_common.sh@1199 -- # lsblk -o NAME,SERIAL 00:19:05.545 22:56:56 -- common/autotest_common.sh@1199 -- # grep -q -w SPDK4 00:19:05.545 22:56:56 -- common/autotest_common.sh@1206 -- # lsblk -l -o NAME,SERIAL 00:19:05.545 22:56:56 -- common/autotest_common.sh@1206 -- # grep -q -w SPDK4 00:19:05.545 22:56:56 -- common/autotest_common.sh@1210 -- # return 0 00:19:05.545 22:56:56 -- target/multiconnection.sh@40 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode4 00:19:05.545 22:56:56 -- common/autotest_common.sh@551 -- # xtrace_disable 00:19:05.545 22:56:56 -- common/autotest_common.sh@10 -- # set +x 00:19:05.545 22:56:56 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:19:05.545 22:56:56 -- target/multiconnection.sh@37 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:19:05.545 22:56:56 -- target/multiconnection.sh@38 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode5 00:19:05.805 NQN:nqn.2016-06.io.spdk:cnode5 disconnected 1 controller(s) 00:19:05.805 22:56:56 -- target/multiconnection.sh@39 -- # waitforserial_disconnect SPDK5 00:19:05.805 22:56:56 -- common/autotest_common.sh@1198 -- # local i=0 00:19:05.805 22:56:56 -- common/autotest_common.sh@1199 -- # lsblk -o NAME,SERIAL 00:19:05.805 22:56:56 -- common/autotest_common.sh@1199 -- # grep -q -w SPDK5 00:19:05.805 22:56:56 -- common/autotest_common.sh@1206 -- # lsblk -l -o NAME,SERIAL 00:19:05.805 22:56:56 -- common/autotest_common.sh@1206 -- # grep -q -w SPDK5 00:19:05.805 22:56:56 -- common/autotest_common.sh@1210 -- # return 0 00:19:05.805 22:56:56 -- target/multiconnection.sh@40 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode5 00:19:05.805 22:56:56 -- common/autotest_common.sh@551 -- # xtrace_disable 00:19:05.805 22:56:56 -- common/autotest_common.sh@10 -- # set +x 00:19:05.805 22:56:56 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:19:05.805 22:56:56 -- target/multiconnection.sh@37 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:19:05.805 22:56:56 -- target/multiconnection.sh@38 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode6 00:19:06.065 NQN:nqn.2016-06.io.spdk:cnode6 disconnected 1 controller(s) 00:19:06.065 22:56:57 -- target/multiconnection.sh@39 -- # waitforserial_disconnect SPDK6 00:19:06.065 22:56:57 -- common/autotest_common.sh@1198 -- # local i=0 00:19:06.065 22:56:57 -- common/autotest_common.sh@1199 -- # lsblk -o NAME,SERIAL 00:19:06.065 22:56:57 -- common/autotest_common.sh@1199 -- # grep -q -w SPDK6 00:19:06.065 22:56:57 -- common/autotest_common.sh@1206 -- # lsblk -l -o NAME,SERIAL 00:19:06.065 22:56:57 -- common/autotest_common.sh@1206 -- # grep -q -w SPDK6 00:19:06.065 22:56:57 -- common/autotest_common.sh@1210 -- # return 0 00:19:06.065 22:56:57 -- target/multiconnection.sh@40 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode6 00:19:06.065 22:56:57 -- common/autotest_common.sh@551 -- # xtrace_disable 00:19:06.065 22:56:57 -- common/autotest_common.sh@10 -- # set +x 00:19:06.065 22:56:57 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:19:06.065 22:56:57 -- target/multiconnection.sh@37 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:19:06.065 22:56:57 -- target/multiconnection.sh@38 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode7 00:19:06.325 NQN:nqn.2016-06.io.spdk:cnode7 disconnected 1 controller(s) 00:19:06.325 22:56:57 -- target/multiconnection.sh@39 -- # waitforserial_disconnect SPDK7 00:19:06.325 22:56:57 -- common/autotest_common.sh@1198 -- # local i=0 00:19:06.325 22:56:57 -- common/autotest_common.sh@1199 -- # lsblk -o NAME,SERIAL 00:19:06.325 22:56:57 -- common/autotest_common.sh@1199 -- # grep -q -w SPDK7 00:19:06.325 22:56:57 -- common/autotest_common.sh@1206 -- # lsblk -l -o NAME,SERIAL 00:19:06.325 22:56:57 -- common/autotest_common.sh@1206 -- # grep -q -w SPDK7 00:19:06.325 22:56:57 -- common/autotest_common.sh@1210 -- # return 0 00:19:06.325 22:56:57 -- target/multiconnection.sh@40 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode7 00:19:06.325 22:56:57 -- common/autotest_common.sh@551 -- # xtrace_disable 00:19:06.325 22:56:57 -- common/autotest_common.sh@10 -- # set +x 00:19:06.325 22:56:57 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:19:06.325 22:56:57 -- target/multiconnection.sh@37 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:19:06.325 22:56:57 -- target/multiconnection.sh@38 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode8 00:19:06.325 NQN:nqn.2016-06.io.spdk:cnode8 disconnected 1 controller(s) 00:19:06.325 22:56:57 -- target/multiconnection.sh@39 -- # waitforserial_disconnect SPDK8 00:19:06.325 22:56:57 -- common/autotest_common.sh@1198 -- # local i=0 00:19:06.325 22:56:57 -- common/autotest_common.sh@1199 -- # lsblk -o NAME,SERIAL 00:19:06.325 22:56:57 -- common/autotest_common.sh@1199 -- # grep -q -w SPDK8 00:19:06.325 22:56:57 -- common/autotest_common.sh@1206 -- # lsblk -l -o NAME,SERIAL 00:19:06.325 22:56:57 -- common/autotest_common.sh@1206 -- # grep -q -w SPDK8 00:19:06.325 22:56:57 -- common/autotest_common.sh@1210 -- # return 0 00:19:06.325 22:56:57 -- target/multiconnection.sh@40 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode8 00:19:06.325 22:56:57 -- common/autotest_common.sh@551 -- # xtrace_disable 00:19:06.325 22:56:57 -- common/autotest_common.sh@10 -- # set +x 00:19:06.325 22:56:57 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:19:06.325 22:56:57 -- target/multiconnection.sh@37 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:19:06.325 22:56:57 -- target/multiconnection.sh@38 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode9 00:19:06.584 NQN:nqn.2016-06.io.spdk:cnode9 disconnected 1 controller(s) 00:19:06.584 22:56:57 -- target/multiconnection.sh@39 -- # waitforserial_disconnect SPDK9 00:19:06.584 22:56:57 -- common/autotest_common.sh@1198 -- # local i=0 00:19:06.584 22:56:57 -- common/autotest_common.sh@1199 -- # lsblk -o NAME,SERIAL 00:19:06.584 22:56:57 -- common/autotest_common.sh@1199 -- # grep -q -w SPDK9 00:19:06.584 22:56:57 -- common/autotest_common.sh@1206 -- # lsblk -l -o NAME,SERIAL 00:19:06.584 22:56:57 -- common/autotest_common.sh@1206 -- # grep -q -w SPDK9 00:19:06.584 22:56:57 -- common/autotest_common.sh@1210 -- # return 0 00:19:06.584 22:56:57 -- target/multiconnection.sh@40 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode9 00:19:06.584 22:56:57 -- common/autotest_common.sh@551 -- # xtrace_disable 00:19:06.584 22:56:57 -- common/autotest_common.sh@10 -- # set +x 00:19:06.584 22:56:57 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:19:06.584 22:56:57 -- target/multiconnection.sh@37 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:19:06.584 22:56:57 -- target/multiconnection.sh@38 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode10 00:19:06.584 NQN:nqn.2016-06.io.spdk:cnode10 disconnected 1 controller(s) 00:19:06.584 22:56:57 -- target/multiconnection.sh@39 -- # waitforserial_disconnect SPDK10 00:19:06.584 22:56:57 -- common/autotest_common.sh@1198 -- # local i=0 00:19:06.584 22:56:57 -- common/autotest_common.sh@1199 -- # lsblk -o NAME,SERIAL 00:19:06.584 22:56:57 -- common/autotest_common.sh@1199 -- # grep -q -w SPDK10 00:19:06.584 22:56:57 -- common/autotest_common.sh@1206 -- # lsblk -l -o NAME,SERIAL 00:19:06.584 22:56:57 -- common/autotest_common.sh@1206 -- # grep -q -w SPDK10 00:19:06.584 22:56:57 -- common/autotest_common.sh@1210 -- # return 0 00:19:06.584 22:56:57 -- target/multiconnection.sh@40 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode10 00:19:06.584 22:56:57 -- common/autotest_common.sh@551 -- # xtrace_disable 00:19:06.584 22:56:57 -- common/autotest_common.sh@10 -- # set +x 00:19:06.584 22:56:57 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:19:06.584 22:56:57 -- target/multiconnection.sh@37 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:19:06.584 22:56:57 -- target/multiconnection.sh@38 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode11 00:19:06.843 NQN:nqn.2016-06.io.spdk:cnode11 disconnected 1 controller(s) 00:19:06.843 22:56:57 -- target/multiconnection.sh@39 -- # waitforserial_disconnect SPDK11 00:19:06.843 22:56:57 -- common/autotest_common.sh@1198 -- # local i=0 00:19:06.843 22:56:57 -- common/autotest_common.sh@1199 -- # lsblk -o NAME,SERIAL 00:19:06.843 22:56:57 -- common/autotest_common.sh@1199 -- # grep -q -w SPDK11 00:19:06.843 22:56:57 -- common/autotest_common.sh@1206 -- # lsblk -l -o NAME,SERIAL 00:19:06.843 22:56:57 -- common/autotest_common.sh@1206 -- # grep -q -w SPDK11 00:19:06.843 22:56:57 -- common/autotest_common.sh@1210 -- # return 0 00:19:06.843 22:56:57 -- target/multiconnection.sh@40 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode11 00:19:06.843 22:56:57 -- common/autotest_common.sh@551 -- # xtrace_disable 00:19:06.843 22:56:57 -- common/autotest_common.sh@10 -- # set +x 00:19:06.843 22:56:57 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:19:06.843 22:56:57 -- target/multiconnection.sh@43 -- # rm -f ./local-job0-0-verify.state 00:19:06.843 22:56:57 -- target/multiconnection.sh@45 -- # trap - SIGINT SIGTERM EXIT 00:19:06.843 22:56:57 -- target/multiconnection.sh@47 -- # nvmftestfini 00:19:06.843 22:56:57 -- nvmf/common.sh@476 -- # nvmfcleanup 00:19:06.843 22:56:57 -- nvmf/common.sh@116 -- # sync 00:19:06.843 22:56:57 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:19:06.843 22:56:57 -- nvmf/common.sh@119 -- # set +e 00:19:06.843 22:56:57 -- nvmf/common.sh@120 -- # for i in {1..20} 00:19:06.843 22:56:57 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:19:06.843 rmmod nvme_tcp 00:19:06.843 rmmod nvme_fabrics 00:19:06.843 rmmod nvme_keyring 00:19:06.843 22:56:57 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:19:06.843 22:56:57 -- nvmf/common.sh@123 -- # set -e 00:19:06.843 22:56:57 -- nvmf/common.sh@124 -- # return 0 00:19:06.843 22:56:57 -- nvmf/common.sh@477 -- # '[' -n 306591 ']' 00:19:06.843 22:56:57 -- nvmf/common.sh@478 -- # killprocess 306591 00:19:06.843 22:56:57 -- common/autotest_common.sh@926 -- # '[' -z 306591 ']' 00:19:06.843 22:56:57 -- common/autotest_common.sh@930 -- # kill -0 306591 00:19:06.843 22:56:57 -- common/autotest_common.sh@931 -- # uname 00:19:06.843 22:56:57 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:19:06.843 22:56:57 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 306591 00:19:06.843 22:56:57 -- common/autotest_common.sh@932 -- # process_name=reactor_0 00:19:06.843 22:56:57 -- common/autotest_common.sh@936 -- # '[' reactor_0 = sudo ']' 00:19:06.843 22:56:57 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 306591' 00:19:06.843 killing process with pid 306591 00:19:06.843 22:56:57 -- common/autotest_common.sh@945 -- # kill 306591 00:19:06.843 22:56:57 -- common/autotest_common.sh@950 -- # wait 306591 00:19:07.413 22:56:58 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:19:07.413 22:56:58 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:19:07.413 22:56:58 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:19:07.413 22:56:58 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:19:07.413 22:56:58 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:19:07.413 22:56:58 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:19:07.413 22:56:58 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:19:07.413 22:56:58 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:19:09.317 22:57:00 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:19:09.317 00:19:09.317 real 1m0.951s 00:19:09.317 user 3m21.258s 00:19:09.317 sys 0m26.243s 00:19:09.317 22:57:00 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:19:09.317 22:57:00 -- common/autotest_common.sh@10 -- # set +x 00:19:09.317 ************************************ 00:19:09.317 END TEST nvmf_multiconnection 00:19:09.317 ************************************ 00:19:09.575 22:57:00 -- nvmf/nvmf.sh@66 -- # run_test nvmf_initiator_timeout /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/initiator_timeout.sh --transport=tcp 00:19:09.575 22:57:00 -- common/autotest_common.sh@1077 -- # '[' 3 -le 1 ']' 00:19:09.575 22:57:00 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:19:09.575 22:57:00 -- common/autotest_common.sh@10 -- # set +x 00:19:09.575 ************************************ 00:19:09.575 START TEST nvmf_initiator_timeout 00:19:09.575 ************************************ 00:19:09.575 22:57:00 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/initiator_timeout.sh --transport=tcp 00:19:09.575 * Looking for test storage... 00:19:09.575 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:19:09.575 22:57:00 -- target/initiator_timeout.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:19:09.575 22:57:00 -- nvmf/common.sh@7 -- # uname -s 00:19:09.575 22:57:00 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:19:09.575 22:57:00 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:19:09.575 22:57:00 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:19:09.575 22:57:00 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:19:09.575 22:57:00 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:19:09.575 22:57:00 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:19:09.575 22:57:00 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:19:09.575 22:57:00 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:19:09.575 22:57:00 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:19:09.575 22:57:00 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:19:09.575 22:57:00 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:19:09.575 22:57:00 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:19:09.575 22:57:00 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:19:09.575 22:57:00 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:19:09.575 22:57:00 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:19:09.575 22:57:00 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:19:09.575 22:57:00 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:19:09.575 22:57:00 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:19:09.575 22:57:00 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:19:09.575 22:57:00 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:19:09.576 22:57:00 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:19:09.576 22:57:00 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:19:09.576 22:57:00 -- paths/export.sh@5 -- # export PATH 00:19:09.576 22:57:00 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:19:09.576 22:57:00 -- nvmf/common.sh@46 -- # : 0 00:19:09.576 22:57:00 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:19:09.576 22:57:00 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:19:09.576 22:57:00 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:19:09.576 22:57:00 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:19:09.576 22:57:00 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:19:09.576 22:57:00 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:19:09.576 22:57:00 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:19:09.576 22:57:00 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:19:09.576 22:57:00 -- target/initiator_timeout.sh@11 -- # MALLOC_BDEV_SIZE=64 00:19:09.576 22:57:00 -- target/initiator_timeout.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:19:09.576 22:57:00 -- target/initiator_timeout.sh@14 -- # nvmftestinit 00:19:09.576 22:57:00 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:19:09.576 22:57:00 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:19:09.576 22:57:00 -- nvmf/common.sh@436 -- # prepare_net_devs 00:19:09.576 22:57:00 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:19:09.576 22:57:00 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:19:09.576 22:57:00 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:19:09.576 22:57:00 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:19:09.576 22:57:00 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:19:09.576 22:57:00 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:19:09.576 22:57:00 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:19:09.576 22:57:00 -- nvmf/common.sh@284 -- # xtrace_disable 00:19:09.576 22:57:00 -- common/autotest_common.sh@10 -- # set +x 00:19:11.478 22:57:02 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:19:11.478 22:57:02 -- nvmf/common.sh@290 -- # pci_devs=() 00:19:11.478 22:57:02 -- nvmf/common.sh@290 -- # local -a pci_devs 00:19:11.478 22:57:02 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:19:11.478 22:57:02 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:19:11.478 22:57:02 -- nvmf/common.sh@292 -- # pci_drivers=() 00:19:11.478 22:57:02 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:19:11.478 22:57:02 -- nvmf/common.sh@294 -- # net_devs=() 00:19:11.478 22:57:02 -- nvmf/common.sh@294 -- # local -ga net_devs 00:19:11.478 22:57:02 -- nvmf/common.sh@295 -- # e810=() 00:19:11.478 22:57:02 -- nvmf/common.sh@295 -- # local -ga e810 00:19:11.478 22:57:02 -- nvmf/common.sh@296 -- # x722=() 00:19:11.478 22:57:02 -- nvmf/common.sh@296 -- # local -ga x722 00:19:11.478 22:57:02 -- nvmf/common.sh@297 -- # mlx=() 00:19:11.478 22:57:02 -- nvmf/common.sh@297 -- # local -ga mlx 00:19:11.478 22:57:02 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:19:11.478 22:57:02 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:19:11.478 22:57:02 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:19:11.478 22:57:02 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:19:11.478 22:57:02 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:19:11.478 22:57:02 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:19:11.478 22:57:02 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:19:11.478 22:57:02 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:19:11.478 22:57:02 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:19:11.478 22:57:02 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:19:11.478 22:57:02 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:19:11.478 22:57:02 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:19:11.478 22:57:02 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:19:11.478 22:57:02 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:19:11.478 22:57:02 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:19:11.478 22:57:02 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:19:11.478 22:57:02 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:19:11.478 22:57:02 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:19:11.478 22:57:02 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:19:11.478 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:19:11.478 22:57:02 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:19:11.478 22:57:02 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:19:11.478 22:57:02 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:19:11.478 22:57:02 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:19:11.478 22:57:02 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:19:11.478 22:57:02 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:19:11.478 22:57:02 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:19:11.478 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:19:11.478 22:57:02 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:19:11.478 22:57:02 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:19:11.478 22:57:02 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:19:11.478 22:57:02 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:19:11.478 22:57:02 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:19:11.478 22:57:02 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:19:11.478 22:57:02 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:19:11.478 22:57:02 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:19:11.478 22:57:02 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:19:11.478 22:57:02 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:19:11.478 22:57:02 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:19:11.478 22:57:02 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:19:11.478 22:57:02 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:19:11.478 Found net devices under 0000:0a:00.0: cvl_0_0 00:19:11.478 22:57:02 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:19:11.478 22:57:02 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:19:11.478 22:57:02 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:19:11.478 22:57:02 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:19:11.478 22:57:02 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:19:11.478 22:57:02 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:19:11.478 Found net devices under 0000:0a:00.1: cvl_0_1 00:19:11.478 22:57:02 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:19:11.478 22:57:02 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:19:11.478 22:57:02 -- nvmf/common.sh@402 -- # is_hw=yes 00:19:11.478 22:57:02 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:19:11.478 22:57:02 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:19:11.478 22:57:02 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:19:11.478 22:57:02 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:19:11.478 22:57:02 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:19:11.478 22:57:02 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:19:11.478 22:57:02 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:19:11.478 22:57:02 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:19:11.478 22:57:02 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:19:11.478 22:57:02 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:19:11.478 22:57:02 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:19:11.478 22:57:02 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:19:11.478 22:57:02 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:19:11.478 22:57:02 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:19:11.478 22:57:02 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:19:11.478 22:57:02 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:19:11.478 22:57:02 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:19:11.478 22:57:02 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:19:11.478 22:57:02 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:19:11.478 22:57:02 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:19:11.478 22:57:02 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:19:11.478 22:57:02 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:19:11.478 22:57:02 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:19:11.478 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:19:11.478 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.112 ms 00:19:11.478 00:19:11.478 --- 10.0.0.2 ping statistics --- 00:19:11.478 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:19:11.478 rtt min/avg/max/mdev = 0.112/0.112/0.112/0.000 ms 00:19:11.478 22:57:02 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:19:11.478 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:19:11.478 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.069 ms 00:19:11.478 00:19:11.478 --- 10.0.0.1 ping statistics --- 00:19:11.478 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:19:11.478 rtt min/avg/max/mdev = 0.069/0.069/0.069/0.000 ms 00:19:11.478 22:57:02 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:19:11.478 22:57:02 -- nvmf/common.sh@410 -- # return 0 00:19:11.478 22:57:02 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:19:11.478 22:57:02 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:19:11.478 22:57:02 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:19:11.478 22:57:02 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:19:11.478 22:57:02 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:19:11.478 22:57:02 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:19:11.478 22:57:02 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:19:11.478 22:57:02 -- target/initiator_timeout.sh@15 -- # nvmfappstart -m 0xF 00:19:11.478 22:57:02 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:19:11.478 22:57:02 -- common/autotest_common.sh@712 -- # xtrace_disable 00:19:11.478 22:57:02 -- common/autotest_common.sh@10 -- # set +x 00:19:11.478 22:57:02 -- nvmf/common.sh@469 -- # nvmfpid=315743 00:19:11.478 22:57:02 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:19:11.478 22:57:02 -- nvmf/common.sh@470 -- # waitforlisten 315743 00:19:11.478 22:57:02 -- common/autotest_common.sh@819 -- # '[' -z 315743 ']' 00:19:11.478 22:57:02 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk.sock 00:19:11.478 22:57:02 -- common/autotest_common.sh@824 -- # local max_retries=100 00:19:11.478 22:57:02 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:19:11.478 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:19:11.478 22:57:02 -- common/autotest_common.sh@828 -- # xtrace_disable 00:19:11.478 22:57:02 -- common/autotest_common.sh@10 -- # set +x 00:19:11.478 [2024-04-16 22:57:02.508785] Starting SPDK v24.01.1-pre git sha1 4b134b4ab / DPDK 23.11.0 initialization... 00:19:11.479 [2024-04-16 22:57:02.508868] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:19:11.479 EAL: No free 2048 kB hugepages reported on node 1 00:19:11.479 [2024-04-16 22:57:02.571340] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:19:11.737 [2024-04-16 22:57:02.679094] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:19:11.737 [2024-04-16 22:57:02.679236] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:19:11.737 [2024-04-16 22:57:02.679255] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:19:11.737 [2024-04-16 22:57:02.679268] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:19:11.737 [2024-04-16 22:57:02.683209] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:19:11.737 [2024-04-16 22:57:02.683266] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:19:11.737 [2024-04-16 22:57:02.683333] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:19:11.737 [2024-04-16 22:57:02.683337] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:19:12.674 22:57:03 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:19:12.674 22:57:03 -- common/autotest_common.sh@852 -- # return 0 00:19:12.674 22:57:03 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:19:12.674 22:57:03 -- common/autotest_common.sh@718 -- # xtrace_disable 00:19:12.674 22:57:03 -- common/autotest_common.sh@10 -- # set +x 00:19:12.674 22:57:03 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:19:12.674 22:57:03 -- target/initiator_timeout.sh@17 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; killprocess $nvmfpid; nvmftestfini $1; exit 1' SIGINT SIGTERM EXIT 00:19:12.674 22:57:03 -- target/initiator_timeout.sh@19 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc0 00:19:12.674 22:57:03 -- common/autotest_common.sh@551 -- # xtrace_disable 00:19:12.674 22:57:03 -- common/autotest_common.sh@10 -- # set +x 00:19:12.674 Malloc0 00:19:12.674 22:57:03 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:19:12.674 22:57:03 -- target/initiator_timeout.sh@22 -- # rpc_cmd bdev_delay_create -b Malloc0 -d Delay0 -r 30 -t 30 -w 30 -n 30 00:19:12.674 22:57:03 -- common/autotest_common.sh@551 -- # xtrace_disable 00:19:12.674 22:57:03 -- common/autotest_common.sh@10 -- # set +x 00:19:12.674 Delay0 00:19:12.674 22:57:03 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:19:12.674 22:57:03 -- target/initiator_timeout.sh@24 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:19:12.674 22:57:03 -- common/autotest_common.sh@551 -- # xtrace_disable 00:19:12.674 22:57:03 -- common/autotest_common.sh@10 -- # set +x 00:19:12.674 [2024-04-16 22:57:03.550798] tcp.c: 659:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:19:12.674 22:57:03 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:19:12.674 22:57:03 -- target/initiator_timeout.sh@25 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDKISFASTANDAWESOME 00:19:12.674 22:57:03 -- common/autotest_common.sh@551 -- # xtrace_disable 00:19:12.674 22:57:03 -- common/autotest_common.sh@10 -- # set +x 00:19:12.674 22:57:03 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:19:12.674 22:57:03 -- target/initiator_timeout.sh@26 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:19:12.674 22:57:03 -- common/autotest_common.sh@551 -- # xtrace_disable 00:19:12.674 22:57:03 -- common/autotest_common.sh@10 -- # set +x 00:19:12.674 22:57:03 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:19:12.674 22:57:03 -- target/initiator_timeout.sh@27 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:19:12.674 22:57:03 -- common/autotest_common.sh@551 -- # xtrace_disable 00:19:12.674 22:57:03 -- common/autotest_common.sh@10 -- # set +x 00:19:12.674 [2024-04-16 22:57:03.579046] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:19:12.674 22:57:03 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:19:12.674 22:57:03 -- target/initiator_timeout.sh@29 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:19:13.239 22:57:04 -- target/initiator_timeout.sh@31 -- # waitforserial SPDKISFASTANDAWESOME 00:19:13.239 22:57:04 -- common/autotest_common.sh@1177 -- # local i=0 00:19:13.239 22:57:04 -- common/autotest_common.sh@1178 -- # local nvme_device_counter=1 nvme_devices=0 00:19:13.239 22:57:04 -- common/autotest_common.sh@1179 -- # [[ -n '' ]] 00:19:13.239 22:57:04 -- common/autotest_common.sh@1184 -- # sleep 2 00:19:15.140 22:57:06 -- common/autotest_common.sh@1185 -- # (( i++ <= 15 )) 00:19:15.140 22:57:06 -- common/autotest_common.sh@1186 -- # lsblk -l -o NAME,SERIAL 00:19:15.140 22:57:06 -- common/autotest_common.sh@1186 -- # grep -c SPDKISFASTANDAWESOME 00:19:15.140 22:57:06 -- common/autotest_common.sh@1186 -- # nvme_devices=1 00:19:15.140 22:57:06 -- common/autotest_common.sh@1187 -- # (( nvme_devices == nvme_device_counter )) 00:19:15.140 22:57:06 -- common/autotest_common.sh@1187 -- # return 0 00:19:15.140 22:57:06 -- target/initiator_timeout.sh@35 -- # fio_pid=316189 00:19:15.140 22:57:06 -- target/initiator_timeout.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/fio-wrapper -p nvmf -i 4096 -d 1 -t write -r 60 -v 00:19:15.140 22:57:06 -- target/initiator_timeout.sh@37 -- # sleep 3 00:19:15.140 [global] 00:19:15.140 thread=1 00:19:15.140 invalidate=1 00:19:15.140 rw=write 00:19:15.140 time_based=1 00:19:15.140 runtime=60 00:19:15.140 ioengine=libaio 00:19:15.140 direct=1 00:19:15.140 bs=4096 00:19:15.140 iodepth=1 00:19:15.140 norandommap=0 00:19:15.140 numjobs=1 00:19:15.140 00:19:15.140 verify_dump=1 00:19:15.140 verify_backlog=512 00:19:15.140 verify_state_save=0 00:19:15.140 do_verify=1 00:19:15.140 verify=crc32c-intel 00:19:15.140 [job0] 00:19:15.140 filename=/dev/nvme0n1 00:19:15.140 Could not set queue depth (nvme0n1) 00:19:15.399 job0: (g=0): rw=write, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:19:15.399 fio-3.35 00:19:15.399 Starting 1 thread 00:19:18.719 22:57:09 -- target/initiator_timeout.sh@40 -- # rpc_cmd bdev_delay_update_latency Delay0 avg_read 31000000 00:19:18.719 22:57:09 -- common/autotest_common.sh@551 -- # xtrace_disable 00:19:18.719 22:57:09 -- common/autotest_common.sh@10 -- # set +x 00:19:18.719 true 00:19:18.719 22:57:09 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:19:18.719 22:57:09 -- target/initiator_timeout.sh@41 -- # rpc_cmd bdev_delay_update_latency Delay0 avg_write 31000000 00:19:18.719 22:57:09 -- common/autotest_common.sh@551 -- # xtrace_disable 00:19:18.719 22:57:09 -- common/autotest_common.sh@10 -- # set +x 00:19:18.719 true 00:19:18.719 22:57:09 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:19:18.719 22:57:09 -- target/initiator_timeout.sh@42 -- # rpc_cmd bdev_delay_update_latency Delay0 p99_read 31000000 00:19:18.719 22:57:09 -- common/autotest_common.sh@551 -- # xtrace_disable 00:19:18.719 22:57:09 -- common/autotest_common.sh@10 -- # set +x 00:19:18.719 true 00:19:18.719 22:57:09 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:19:18.719 22:57:09 -- target/initiator_timeout.sh@43 -- # rpc_cmd bdev_delay_update_latency Delay0 p99_write 310000000 00:19:18.719 22:57:09 -- common/autotest_common.sh@551 -- # xtrace_disable 00:19:18.719 22:57:09 -- common/autotest_common.sh@10 -- # set +x 00:19:18.719 true 00:19:18.719 22:57:09 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:19:18.719 22:57:09 -- target/initiator_timeout.sh@45 -- # sleep 3 00:19:21.254 22:57:12 -- target/initiator_timeout.sh@48 -- # rpc_cmd bdev_delay_update_latency Delay0 avg_read 30 00:19:21.254 22:57:12 -- common/autotest_common.sh@551 -- # xtrace_disable 00:19:21.254 22:57:12 -- common/autotest_common.sh@10 -- # set +x 00:19:21.254 true 00:19:21.254 22:57:12 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:19:21.254 22:57:12 -- target/initiator_timeout.sh@49 -- # rpc_cmd bdev_delay_update_latency Delay0 avg_write 30 00:19:21.254 22:57:12 -- common/autotest_common.sh@551 -- # xtrace_disable 00:19:21.254 22:57:12 -- common/autotest_common.sh@10 -- # set +x 00:19:21.254 true 00:19:21.254 22:57:12 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:19:21.254 22:57:12 -- target/initiator_timeout.sh@50 -- # rpc_cmd bdev_delay_update_latency Delay0 p99_read 30 00:19:21.254 22:57:12 -- common/autotest_common.sh@551 -- # xtrace_disable 00:19:21.254 22:57:12 -- common/autotest_common.sh@10 -- # set +x 00:19:21.254 true 00:19:21.254 22:57:12 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:19:21.254 22:57:12 -- target/initiator_timeout.sh@51 -- # rpc_cmd bdev_delay_update_latency Delay0 p99_write 30 00:19:21.254 22:57:12 -- common/autotest_common.sh@551 -- # xtrace_disable 00:19:21.254 22:57:12 -- common/autotest_common.sh@10 -- # set +x 00:19:21.254 true 00:19:21.254 22:57:12 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:19:21.254 22:57:12 -- target/initiator_timeout.sh@53 -- # fio_status=0 00:19:21.254 22:57:12 -- target/initiator_timeout.sh@54 -- # wait 316189 00:20:17.492 00:20:17.492 job0: (groupid=0, jobs=1): err= 0: pid=316263: Tue Apr 16 22:58:06 2024 00:20:17.492 read: IOPS=17, BW=71.6KiB/s (73.3kB/s)(4296KiB/60037msec) 00:20:17.492 slat (usec): min=7, max=4903, avg=29.42, stdev=149.17 00:20:17.492 clat (usec): min=332, max=41211k, avg=55446.95, stdev=1257149.61 00:20:17.492 lat (usec): min=350, max=41211k, avg=55476.37, stdev=1257149.19 00:20:17.492 clat percentiles (usec): 00:20:17.492 | 1.00th=[ 379], 5.00th=[ 404], 10.00th=[ 416], 00:20:17.492 | 20.00th=[ 441], 30.00th=[ 453], 40.00th=[ 465], 00:20:17.492 | 50.00th=[ 486], 60.00th=[ 40633], 70.00th=[ 41157], 00:20:17.492 | 80.00th=[ 41157], 90.00th=[ 41681], 95.00th=[ 42206], 00:20:17.492 | 99.00th=[ 42206], 99.50th=[ 42206], 99.90th=[ 42730], 00:20:17.492 | 99.95th=[17112761], 99.99th=[17112761] 00:20:17.492 write: IOPS=25, BW=102KiB/s (105kB/s)(6144KiB/60037msec); 0 zone resets 00:20:17.492 slat (nsec): min=6379, max=73648, avg=20203.55, stdev=9264.64 00:20:17.492 clat (usec): min=199, max=504, avg=266.15, stdev=54.77 00:20:17.492 lat (usec): min=206, max=544, avg=286.35, stdev=60.08 00:20:17.492 clat percentiles (usec): 00:20:17.492 | 1.00th=[ 206], 5.00th=[ 212], 10.00th=[ 217], 20.00th=[ 223], 00:20:17.492 | 30.00th=[ 231], 40.00th=[ 241], 50.00th=[ 247], 60.00th=[ 253], 00:20:17.492 | 70.00th=[ 269], 80.00th=[ 314], 90.00th=[ 359], 95.00th=[ 388], 00:20:17.492 | 99.00th=[ 420], 99.50th=[ 437], 99.90th=[ 465], 99.95th=[ 506], 00:20:17.492 | 99.99th=[ 506] 00:20:17.492 bw ( KiB/s): min= 1248, max= 4096, per=100.00%, avg=3072.00, stdev=1350.84, samples=4 00:20:17.492 iops : min= 312, max= 1024, avg=768.00, stdev=337.71, samples=4 00:20:17.492 lat (usec) : 250=32.11%, 500=50.42%, 750=0.57%, 1000=0.08% 00:20:17.492 lat (msec) : 50=16.78%, >=2000=0.04% 00:20:17.492 cpu : usr=0.06%, sys=0.10%, ctx=2611, majf=0, minf=2 00:20:17.492 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:20:17.492 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:20:17.492 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:20:17.492 issued rwts: total=1074,1536,0,0 short=0,0,0,0 dropped=0,0,0,0 00:20:17.492 latency : target=0, window=0, percentile=100.00%, depth=1 00:20:17.492 00:20:17.492 Run status group 0 (all jobs): 00:20:17.492 READ: bw=71.6KiB/s (73.3kB/s), 71.6KiB/s-71.6KiB/s (73.3kB/s-73.3kB/s), io=4296KiB (4399kB), run=60037-60037msec 00:20:17.492 WRITE: bw=102KiB/s (105kB/s), 102KiB/s-102KiB/s (105kB/s-105kB/s), io=6144KiB (6291kB), run=60037-60037msec 00:20:17.492 00:20:17.492 Disk stats (read/write): 00:20:17.492 nvme0n1: ios=1169/1536, merge=0/0, ticks=18264/395, in_queue=18659, util=99.84% 00:20:17.492 22:58:06 -- target/initiator_timeout.sh@56 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:20:17.492 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:20:17.492 22:58:06 -- target/initiator_timeout.sh@57 -- # waitforserial_disconnect SPDKISFASTANDAWESOME 00:20:17.492 22:58:06 -- common/autotest_common.sh@1198 -- # local i=0 00:20:17.492 22:58:06 -- common/autotest_common.sh@1199 -- # lsblk -o NAME,SERIAL 00:20:17.492 22:58:06 -- common/autotest_common.sh@1199 -- # grep -q -w SPDKISFASTANDAWESOME 00:20:17.492 22:58:06 -- common/autotest_common.sh@1206 -- # lsblk -l -o NAME,SERIAL 00:20:17.492 22:58:06 -- common/autotest_common.sh@1206 -- # grep -q -w SPDKISFASTANDAWESOME 00:20:17.492 22:58:06 -- common/autotest_common.sh@1210 -- # return 0 00:20:17.492 22:58:06 -- target/initiator_timeout.sh@59 -- # '[' 0 -eq 0 ']' 00:20:17.492 22:58:06 -- target/initiator_timeout.sh@60 -- # echo 'nvmf hotplug test: fio successful as expected' 00:20:17.492 nvmf hotplug test: fio successful as expected 00:20:17.492 22:58:06 -- target/initiator_timeout.sh@67 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:20:17.492 22:58:06 -- common/autotest_common.sh@551 -- # xtrace_disable 00:20:17.492 22:58:06 -- common/autotest_common.sh@10 -- # set +x 00:20:17.493 22:58:06 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:20:17.493 22:58:06 -- target/initiator_timeout.sh@69 -- # rm -f ./local-job0-0-verify.state 00:20:17.493 22:58:06 -- target/initiator_timeout.sh@71 -- # trap - SIGINT SIGTERM EXIT 00:20:17.493 22:58:06 -- target/initiator_timeout.sh@73 -- # nvmftestfini 00:20:17.493 22:58:06 -- nvmf/common.sh@476 -- # nvmfcleanup 00:20:17.493 22:58:06 -- nvmf/common.sh@116 -- # sync 00:20:17.493 22:58:06 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:20:17.493 22:58:06 -- nvmf/common.sh@119 -- # set +e 00:20:17.493 22:58:06 -- nvmf/common.sh@120 -- # for i in {1..20} 00:20:17.493 22:58:06 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:20:17.493 rmmod nvme_tcp 00:20:17.493 rmmod nvme_fabrics 00:20:17.493 rmmod nvme_keyring 00:20:17.493 22:58:06 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:20:17.493 22:58:06 -- nvmf/common.sh@123 -- # set -e 00:20:17.493 22:58:06 -- nvmf/common.sh@124 -- # return 0 00:20:17.493 22:58:06 -- nvmf/common.sh@477 -- # '[' -n 315743 ']' 00:20:17.493 22:58:06 -- nvmf/common.sh@478 -- # killprocess 315743 00:20:17.493 22:58:06 -- common/autotest_common.sh@926 -- # '[' -z 315743 ']' 00:20:17.493 22:58:06 -- common/autotest_common.sh@930 -- # kill -0 315743 00:20:17.493 22:58:06 -- common/autotest_common.sh@931 -- # uname 00:20:17.493 22:58:06 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:20:17.493 22:58:06 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 315743 00:20:17.493 22:58:06 -- common/autotest_common.sh@932 -- # process_name=reactor_0 00:20:17.493 22:58:06 -- common/autotest_common.sh@936 -- # '[' reactor_0 = sudo ']' 00:20:17.493 22:58:06 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 315743' 00:20:17.493 killing process with pid 315743 00:20:17.493 22:58:06 -- common/autotest_common.sh@945 -- # kill 315743 00:20:17.493 22:58:06 -- common/autotest_common.sh@950 -- # wait 315743 00:20:17.493 22:58:06 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:20:17.493 22:58:06 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:20:17.493 22:58:06 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:20:17.493 22:58:06 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:20:17.493 22:58:06 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:20:17.493 22:58:06 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:20:17.493 22:58:06 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:20:17.493 22:58:06 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:20:18.058 22:58:09 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:20:18.058 00:20:18.058 real 1m8.553s 00:20:18.058 user 4m13.276s 00:20:18.058 sys 0m6.228s 00:20:18.058 22:58:09 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:20:18.058 22:58:09 -- common/autotest_common.sh@10 -- # set +x 00:20:18.058 ************************************ 00:20:18.058 END TEST nvmf_initiator_timeout 00:20:18.058 ************************************ 00:20:18.058 22:58:09 -- nvmf/nvmf.sh@69 -- # [[ phy == phy ]] 00:20:18.058 22:58:09 -- nvmf/nvmf.sh@70 -- # '[' tcp = tcp ']' 00:20:18.058 22:58:09 -- nvmf/nvmf.sh@71 -- # gather_supported_nvmf_pci_devs 00:20:18.058 22:58:09 -- nvmf/common.sh@284 -- # xtrace_disable 00:20:18.058 22:58:09 -- common/autotest_common.sh@10 -- # set +x 00:20:19.960 22:58:10 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:20:19.960 22:58:10 -- nvmf/common.sh@290 -- # pci_devs=() 00:20:19.960 22:58:10 -- nvmf/common.sh@290 -- # local -a pci_devs 00:20:19.960 22:58:10 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:20:19.960 22:58:10 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:20:19.960 22:58:10 -- nvmf/common.sh@292 -- # pci_drivers=() 00:20:19.960 22:58:10 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:20:19.960 22:58:10 -- nvmf/common.sh@294 -- # net_devs=() 00:20:19.960 22:58:10 -- nvmf/common.sh@294 -- # local -ga net_devs 00:20:19.960 22:58:10 -- nvmf/common.sh@295 -- # e810=() 00:20:19.960 22:58:10 -- nvmf/common.sh@295 -- # local -ga e810 00:20:19.960 22:58:10 -- nvmf/common.sh@296 -- # x722=() 00:20:19.960 22:58:10 -- nvmf/common.sh@296 -- # local -ga x722 00:20:19.960 22:58:10 -- nvmf/common.sh@297 -- # mlx=() 00:20:19.960 22:58:10 -- nvmf/common.sh@297 -- # local -ga mlx 00:20:19.960 22:58:10 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:20:19.960 22:58:10 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:20:19.960 22:58:10 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:20:19.960 22:58:10 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:20:19.960 22:58:10 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:20:19.960 22:58:10 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:20:19.960 22:58:10 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:20:19.960 22:58:10 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:20:19.960 22:58:10 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:20:19.960 22:58:10 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:20:19.960 22:58:10 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:20:19.960 22:58:10 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:20:19.960 22:58:10 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:20:19.960 22:58:10 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:20:19.960 22:58:10 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:20:19.960 22:58:10 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:20:19.960 22:58:10 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:20:19.960 22:58:10 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:20:19.960 22:58:10 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:20:19.960 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:20:19.960 22:58:10 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:20:19.960 22:58:10 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:20:19.960 22:58:10 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:20:19.960 22:58:10 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:20:19.960 22:58:10 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:20:19.960 22:58:10 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:20:19.960 22:58:10 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:20:19.960 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:20:19.960 22:58:10 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:20:19.960 22:58:10 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:20:19.960 22:58:10 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:20:19.960 22:58:10 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:20:19.960 22:58:10 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:20:19.960 22:58:10 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:20:19.960 22:58:10 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:20:19.960 22:58:10 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:20:19.960 22:58:10 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:20:19.960 22:58:10 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:20:19.960 22:58:10 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:20:19.960 22:58:10 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:20:19.960 22:58:10 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:20:19.960 Found net devices under 0000:0a:00.0: cvl_0_0 00:20:19.960 22:58:10 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:20:19.960 22:58:10 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:20:19.960 22:58:10 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:20:19.960 22:58:10 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:20:19.960 22:58:10 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:20:19.960 22:58:10 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:20:19.960 Found net devices under 0000:0a:00.1: cvl_0_1 00:20:19.960 22:58:10 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:20:19.960 22:58:10 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:20:19.960 22:58:10 -- nvmf/nvmf.sh@72 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:20:19.960 22:58:10 -- nvmf/nvmf.sh@73 -- # (( 2 > 0 )) 00:20:19.960 22:58:10 -- nvmf/nvmf.sh@74 -- # run_test nvmf_perf_adq /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/perf_adq.sh --transport=tcp 00:20:19.960 22:58:10 -- common/autotest_common.sh@1077 -- # '[' 3 -le 1 ']' 00:20:19.960 22:58:10 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:20:19.960 22:58:10 -- common/autotest_common.sh@10 -- # set +x 00:20:19.960 ************************************ 00:20:19.960 START TEST nvmf_perf_adq 00:20:19.960 ************************************ 00:20:19.960 22:58:10 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/perf_adq.sh --transport=tcp 00:20:19.960 * Looking for test storage... 00:20:19.960 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:20:19.960 22:58:11 -- target/perf_adq.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:20:19.960 22:58:11 -- nvmf/common.sh@7 -- # uname -s 00:20:19.960 22:58:11 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:20:19.960 22:58:11 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:20:19.960 22:58:11 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:20:19.960 22:58:11 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:20:19.960 22:58:11 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:20:19.960 22:58:11 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:20:19.960 22:58:11 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:20:19.960 22:58:11 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:20:19.960 22:58:11 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:20:19.960 22:58:11 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:20:19.961 22:58:11 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:20:19.961 22:58:11 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:20:19.961 22:58:11 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:20:19.961 22:58:11 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:20:19.961 22:58:11 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:20:19.961 22:58:11 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:20:19.961 22:58:11 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:20:19.961 22:58:11 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:20:19.961 22:58:11 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:20:19.961 22:58:11 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:20:19.961 22:58:11 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:20:19.961 22:58:11 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:20:19.961 22:58:11 -- paths/export.sh@5 -- # export PATH 00:20:19.961 22:58:11 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:20:19.961 22:58:11 -- nvmf/common.sh@46 -- # : 0 00:20:19.961 22:58:11 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:20:19.961 22:58:11 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:20:19.961 22:58:11 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:20:19.961 22:58:11 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:20:19.961 22:58:11 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:20:19.961 22:58:11 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:20:19.961 22:58:11 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:20:19.961 22:58:11 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:20:19.961 22:58:11 -- target/perf_adq.sh@11 -- # gather_supported_nvmf_pci_devs 00:20:19.961 22:58:11 -- nvmf/common.sh@284 -- # xtrace_disable 00:20:19.961 22:58:11 -- common/autotest_common.sh@10 -- # set +x 00:20:21.865 22:58:12 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:20:21.865 22:58:12 -- nvmf/common.sh@290 -- # pci_devs=() 00:20:21.865 22:58:12 -- nvmf/common.sh@290 -- # local -a pci_devs 00:20:21.865 22:58:12 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:20:21.865 22:58:12 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:20:21.865 22:58:12 -- nvmf/common.sh@292 -- # pci_drivers=() 00:20:21.865 22:58:12 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:20:21.865 22:58:12 -- nvmf/common.sh@294 -- # net_devs=() 00:20:21.865 22:58:12 -- nvmf/common.sh@294 -- # local -ga net_devs 00:20:21.865 22:58:12 -- nvmf/common.sh@295 -- # e810=() 00:20:21.865 22:58:12 -- nvmf/common.sh@295 -- # local -ga e810 00:20:21.865 22:58:12 -- nvmf/common.sh@296 -- # x722=() 00:20:21.865 22:58:12 -- nvmf/common.sh@296 -- # local -ga x722 00:20:21.865 22:58:12 -- nvmf/common.sh@297 -- # mlx=() 00:20:21.865 22:58:12 -- nvmf/common.sh@297 -- # local -ga mlx 00:20:21.865 22:58:12 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:20:21.865 22:58:12 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:20:21.865 22:58:12 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:20:21.865 22:58:12 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:20:21.865 22:58:12 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:20:21.865 22:58:12 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:20:21.865 22:58:12 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:20:21.865 22:58:12 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:20:21.865 22:58:12 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:20:21.865 22:58:12 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:20:21.865 22:58:12 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:20:21.865 22:58:12 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:20:21.865 22:58:12 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:20:21.865 22:58:12 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:20:21.865 22:58:12 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:20:21.865 22:58:12 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:20:21.865 22:58:12 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:20:21.865 22:58:12 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:20:21.865 22:58:12 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:20:21.865 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:20:21.865 22:58:12 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:20:21.865 22:58:12 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:20:21.865 22:58:12 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:20:21.865 22:58:12 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:20:21.865 22:58:12 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:20:21.865 22:58:12 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:20:21.865 22:58:12 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:20:21.865 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:20:21.865 22:58:12 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:20:21.865 22:58:12 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:20:21.865 22:58:12 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:20:21.865 22:58:12 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:20:21.865 22:58:12 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:20:21.865 22:58:12 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:20:21.865 22:58:12 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:20:21.865 22:58:12 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:20:21.865 22:58:12 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:20:21.865 22:58:12 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:20:21.865 22:58:12 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:20:21.865 22:58:12 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:20:21.865 22:58:12 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:20:21.865 Found net devices under 0000:0a:00.0: cvl_0_0 00:20:21.865 22:58:12 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:20:21.865 22:58:12 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:20:21.865 22:58:12 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:20:21.865 22:58:12 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:20:21.865 22:58:12 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:20:21.865 22:58:12 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:20:21.865 Found net devices under 0000:0a:00.1: cvl_0_1 00:20:21.865 22:58:12 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:20:21.865 22:58:12 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:20:21.865 22:58:12 -- target/perf_adq.sh@12 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:20:21.865 22:58:12 -- target/perf_adq.sh@13 -- # (( 2 == 0 )) 00:20:21.865 22:58:12 -- target/perf_adq.sh@18 -- # perf=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf 00:20:21.865 22:58:12 -- target/perf_adq.sh@59 -- # adq_reload_driver 00:20:21.865 22:58:12 -- target/perf_adq.sh@52 -- # rmmod ice 00:20:22.802 22:58:13 -- target/perf_adq.sh@53 -- # modprobe ice 00:20:24.184 22:58:15 -- target/perf_adq.sh@54 -- # sleep 5 00:20:29.488 22:58:20 -- target/perf_adq.sh@67 -- # nvmftestinit 00:20:29.488 22:58:20 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:20:29.488 22:58:20 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:20:29.488 22:58:20 -- nvmf/common.sh@436 -- # prepare_net_devs 00:20:29.488 22:58:20 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:20:29.488 22:58:20 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:20:29.488 22:58:20 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:20:29.488 22:58:20 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:20:29.488 22:58:20 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:20:29.488 22:58:20 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:20:29.488 22:58:20 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:20:29.488 22:58:20 -- nvmf/common.sh@284 -- # xtrace_disable 00:20:29.488 22:58:20 -- common/autotest_common.sh@10 -- # set +x 00:20:29.488 22:58:20 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:20:29.488 22:58:20 -- nvmf/common.sh@290 -- # pci_devs=() 00:20:29.488 22:58:20 -- nvmf/common.sh@290 -- # local -a pci_devs 00:20:29.488 22:58:20 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:20:29.488 22:58:20 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:20:29.488 22:58:20 -- nvmf/common.sh@292 -- # pci_drivers=() 00:20:29.488 22:58:20 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:20:29.488 22:58:20 -- nvmf/common.sh@294 -- # net_devs=() 00:20:29.488 22:58:20 -- nvmf/common.sh@294 -- # local -ga net_devs 00:20:29.488 22:58:20 -- nvmf/common.sh@295 -- # e810=() 00:20:29.488 22:58:20 -- nvmf/common.sh@295 -- # local -ga e810 00:20:29.488 22:58:20 -- nvmf/common.sh@296 -- # x722=() 00:20:29.488 22:58:20 -- nvmf/common.sh@296 -- # local -ga x722 00:20:29.488 22:58:20 -- nvmf/common.sh@297 -- # mlx=() 00:20:29.488 22:58:20 -- nvmf/common.sh@297 -- # local -ga mlx 00:20:29.488 22:58:20 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:20:29.488 22:58:20 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:20:29.488 22:58:20 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:20:29.488 22:58:20 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:20:29.488 22:58:20 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:20:29.488 22:58:20 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:20:29.488 22:58:20 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:20:29.488 22:58:20 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:20:29.488 22:58:20 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:20:29.488 22:58:20 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:20:29.488 22:58:20 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:20:29.488 22:58:20 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:20:29.488 22:58:20 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:20:29.488 22:58:20 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:20:29.488 22:58:20 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:20:29.488 22:58:20 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:20:29.488 22:58:20 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:20:29.488 22:58:20 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:20:29.488 22:58:20 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:20:29.488 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:20:29.488 22:58:20 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:20:29.488 22:58:20 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:20:29.488 22:58:20 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:20:29.488 22:58:20 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:20:29.488 22:58:20 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:20:29.488 22:58:20 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:20:29.488 22:58:20 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:20:29.488 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:20:29.488 22:58:20 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:20:29.488 22:58:20 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:20:29.488 22:58:20 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:20:29.488 22:58:20 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:20:29.488 22:58:20 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:20:29.488 22:58:20 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:20:29.488 22:58:20 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:20:29.488 22:58:20 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:20:29.488 22:58:20 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:20:29.488 22:58:20 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:20:29.488 22:58:20 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:20:29.488 22:58:20 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:20:29.488 22:58:20 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:20:29.488 Found net devices under 0000:0a:00.0: cvl_0_0 00:20:29.489 22:58:20 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:20:29.489 22:58:20 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:20:29.489 22:58:20 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:20:29.489 22:58:20 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:20:29.489 22:58:20 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:20:29.489 22:58:20 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:20:29.489 Found net devices under 0000:0a:00.1: cvl_0_1 00:20:29.489 22:58:20 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:20:29.489 22:58:20 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:20:29.489 22:58:20 -- nvmf/common.sh@402 -- # is_hw=yes 00:20:29.489 22:58:20 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:20:29.489 22:58:20 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:20:29.489 22:58:20 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:20:29.489 22:58:20 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:20:29.489 22:58:20 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:20:29.489 22:58:20 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:20:29.489 22:58:20 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:20:29.489 22:58:20 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:20:29.489 22:58:20 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:20:29.489 22:58:20 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:20:29.489 22:58:20 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:20:29.489 22:58:20 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:20:29.489 22:58:20 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:20:29.489 22:58:20 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:20:29.489 22:58:20 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:20:29.489 22:58:20 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:20:29.489 22:58:20 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:20:29.489 22:58:20 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:20:29.489 22:58:20 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:20:29.489 22:58:20 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:20:29.489 22:58:20 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:20:29.489 22:58:20 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:20:29.489 22:58:20 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:20:29.489 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:20:29.489 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.138 ms 00:20:29.489 00:20:29.489 --- 10.0.0.2 ping statistics --- 00:20:29.489 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:20:29.489 rtt min/avg/max/mdev = 0.138/0.138/0.138/0.000 ms 00:20:29.489 22:58:20 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:20:29.489 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:20:29.489 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.067 ms 00:20:29.489 00:20:29.489 --- 10.0.0.1 ping statistics --- 00:20:29.489 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:20:29.489 rtt min/avg/max/mdev = 0.067/0.067/0.067/0.000 ms 00:20:29.489 22:58:20 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:20:29.489 22:58:20 -- nvmf/common.sh@410 -- # return 0 00:20:29.489 22:58:20 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:20:29.489 22:58:20 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:20:29.489 22:58:20 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:20:29.489 22:58:20 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:20:29.489 22:58:20 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:20:29.489 22:58:20 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:20:29.489 22:58:20 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:20:29.489 22:58:20 -- target/perf_adq.sh@68 -- # nvmfappstart -m 0xF --wait-for-rpc 00:20:29.489 22:58:20 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:20:29.489 22:58:20 -- common/autotest_common.sh@712 -- # xtrace_disable 00:20:29.489 22:58:20 -- common/autotest_common.sh@10 -- # set +x 00:20:29.489 22:58:20 -- nvmf/common.sh@469 -- # nvmfpid=328567 00:20:29.489 22:58:20 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF --wait-for-rpc 00:20:29.489 22:58:20 -- nvmf/common.sh@470 -- # waitforlisten 328567 00:20:29.489 22:58:20 -- common/autotest_common.sh@819 -- # '[' -z 328567 ']' 00:20:29.489 22:58:20 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk.sock 00:20:29.489 22:58:20 -- common/autotest_common.sh@824 -- # local max_retries=100 00:20:29.489 22:58:20 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:20:29.489 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:20:29.489 22:58:20 -- common/autotest_common.sh@828 -- # xtrace_disable 00:20:29.489 22:58:20 -- common/autotest_common.sh@10 -- # set +x 00:20:29.489 [2024-04-16 22:58:20.306575] Starting SPDK v24.01.1-pre git sha1 4b134b4ab / DPDK 23.11.0 initialization... 00:20:29.489 [2024-04-16 22:58:20.306674] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:20:29.489 EAL: No free 2048 kB hugepages reported on node 1 00:20:29.489 [2024-04-16 22:58:20.373582] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:20:29.489 [2024-04-16 22:58:20.484875] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:20:29.489 [2024-04-16 22:58:20.485012] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:20:29.489 [2024-04-16 22:58:20.485029] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:20:29.489 [2024-04-16 22:58:20.485041] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:20:29.489 [2024-04-16 22:58:20.485103] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:20:29.489 [2024-04-16 22:58:20.485128] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:20:29.489 [2024-04-16 22:58:20.485147] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:20:29.489 [2024-04-16 22:58:20.485150] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:20:29.489 22:58:20 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:20:29.489 22:58:20 -- common/autotest_common.sh@852 -- # return 0 00:20:29.489 22:58:20 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:20:29.489 22:58:20 -- common/autotest_common.sh@718 -- # xtrace_disable 00:20:29.489 22:58:20 -- common/autotest_common.sh@10 -- # set +x 00:20:29.489 22:58:20 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:20:29.489 22:58:20 -- target/perf_adq.sh@69 -- # adq_configure_nvmf_target 0 00:20:29.489 22:58:20 -- target/perf_adq.sh@42 -- # rpc_cmd sock_impl_set_options --enable-placement-id 0 --enable-zerocopy-send-server -i posix 00:20:29.489 22:58:20 -- common/autotest_common.sh@551 -- # xtrace_disable 00:20:29.489 22:58:20 -- common/autotest_common.sh@10 -- # set +x 00:20:29.489 22:58:20 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:20:29.489 22:58:20 -- target/perf_adq.sh@43 -- # rpc_cmd framework_start_init 00:20:29.489 22:58:20 -- common/autotest_common.sh@551 -- # xtrace_disable 00:20:29.489 22:58:20 -- common/autotest_common.sh@10 -- # set +x 00:20:29.747 22:58:20 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:20:29.747 22:58:20 -- target/perf_adq.sh@44 -- # rpc_cmd nvmf_create_transport -t tcp -o --io-unit-size 8192 --sock-priority 0 00:20:29.747 22:58:20 -- common/autotest_common.sh@551 -- # xtrace_disable 00:20:29.747 22:58:20 -- common/autotest_common.sh@10 -- # set +x 00:20:29.747 [2024-04-16 22:58:20.661779] tcp.c: 659:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:20:29.747 22:58:20 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:20:29.747 22:58:20 -- target/perf_adq.sh@45 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc1 00:20:29.747 22:58:20 -- common/autotest_common.sh@551 -- # xtrace_disable 00:20:29.747 22:58:20 -- common/autotest_common.sh@10 -- # set +x 00:20:29.747 Malloc1 00:20:29.747 22:58:20 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:20:29.747 22:58:20 -- target/perf_adq.sh@46 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:20:29.747 22:58:20 -- common/autotest_common.sh@551 -- # xtrace_disable 00:20:29.747 22:58:20 -- common/autotest_common.sh@10 -- # set +x 00:20:29.747 22:58:20 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:20:29.747 22:58:20 -- target/perf_adq.sh@47 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:20:29.747 22:58:20 -- common/autotest_common.sh@551 -- # xtrace_disable 00:20:29.747 22:58:20 -- common/autotest_common.sh@10 -- # set +x 00:20:29.747 22:58:20 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:20:29.747 22:58:20 -- target/perf_adq.sh@48 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:20:29.747 22:58:20 -- common/autotest_common.sh@551 -- # xtrace_disable 00:20:29.747 22:58:20 -- common/autotest_common.sh@10 -- # set +x 00:20:29.747 [2024-04-16 22:58:20.712408] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:20:29.747 22:58:20 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:20:29.747 22:58:20 -- target/perf_adq.sh@73 -- # perfpid=328716 00:20:29.747 22:58:20 -- target/perf_adq.sh@70 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -q 64 -o 4096 -w randread -t 10 -c 0xF0 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1' 00:20:29.747 22:58:20 -- target/perf_adq.sh@74 -- # sleep 2 00:20:29.747 EAL: No free 2048 kB hugepages reported on node 1 00:20:31.650 22:58:22 -- target/perf_adq.sh@76 -- # rpc_cmd nvmf_get_stats 00:20:31.650 22:58:22 -- target/perf_adq.sh@76 -- # jq -r '.poll_groups[] | select(.current_io_qpairs == 1) | length' 00:20:31.650 22:58:22 -- common/autotest_common.sh@551 -- # xtrace_disable 00:20:31.650 22:58:22 -- target/perf_adq.sh@76 -- # wc -l 00:20:31.650 22:58:22 -- common/autotest_common.sh@10 -- # set +x 00:20:31.650 22:58:22 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:20:31.650 22:58:22 -- target/perf_adq.sh@76 -- # count=4 00:20:31.650 22:58:22 -- target/perf_adq.sh@77 -- # [[ 4 -ne 4 ]] 00:20:31.650 22:58:22 -- target/perf_adq.sh@81 -- # wait 328716 00:20:39.774 Initializing NVMe Controllers 00:20:39.774 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:20:39.774 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 4 00:20:39.774 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 5 00:20:39.774 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 6 00:20:39.774 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 7 00:20:39.774 Initialization complete. Launching workers. 00:20:39.774 ======================================================== 00:20:39.774 Latency(us) 00:20:39.774 Device Information : IOPS MiB/s Average min max 00:20:39.774 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 4: 10445.20 40.80 6128.91 1973.41 9563.31 00:20:39.774 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 5: 11591.60 45.28 5522.72 1285.85 9116.45 00:20:39.774 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 6: 11888.90 46.44 5383.94 1248.73 8747.41 00:20:39.774 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 7: 10506.30 41.04 6091.24 1453.66 9126.26 00:20:39.774 ======================================================== 00:20:39.774 Total : 44432.00 173.56 5762.52 1248.73 9563.31 00:20:39.774 00:20:39.774 22:58:30 -- target/perf_adq.sh@82 -- # nvmftestfini 00:20:39.774 22:58:30 -- nvmf/common.sh@476 -- # nvmfcleanup 00:20:39.774 22:58:30 -- nvmf/common.sh@116 -- # sync 00:20:39.774 22:58:30 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:20:39.774 22:58:30 -- nvmf/common.sh@119 -- # set +e 00:20:39.774 22:58:30 -- nvmf/common.sh@120 -- # for i in {1..20} 00:20:39.774 22:58:30 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:20:39.774 rmmod nvme_tcp 00:20:39.774 rmmod nvme_fabrics 00:20:39.774 rmmod nvme_keyring 00:20:39.774 22:58:30 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:20:39.774 22:58:30 -- nvmf/common.sh@123 -- # set -e 00:20:39.774 22:58:30 -- nvmf/common.sh@124 -- # return 0 00:20:39.774 22:58:30 -- nvmf/common.sh@477 -- # '[' -n 328567 ']' 00:20:39.774 22:58:30 -- nvmf/common.sh@478 -- # killprocess 328567 00:20:39.774 22:58:30 -- common/autotest_common.sh@926 -- # '[' -z 328567 ']' 00:20:39.774 22:58:30 -- common/autotest_common.sh@930 -- # kill -0 328567 00:20:39.774 22:58:30 -- common/autotest_common.sh@931 -- # uname 00:20:39.774 22:58:30 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:20:40.032 22:58:30 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 328567 00:20:40.032 22:58:30 -- common/autotest_common.sh@932 -- # process_name=reactor_0 00:20:40.032 22:58:30 -- common/autotest_common.sh@936 -- # '[' reactor_0 = sudo ']' 00:20:40.032 22:58:30 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 328567' 00:20:40.032 killing process with pid 328567 00:20:40.032 22:58:30 -- common/autotest_common.sh@945 -- # kill 328567 00:20:40.032 22:58:30 -- common/autotest_common.sh@950 -- # wait 328567 00:20:40.293 22:58:31 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:20:40.293 22:58:31 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:20:40.293 22:58:31 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:20:40.293 22:58:31 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:20:40.293 22:58:31 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:20:40.293 22:58:31 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:20:40.293 22:58:31 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:20:40.293 22:58:31 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:20:42.196 22:58:33 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:20:42.196 22:58:33 -- target/perf_adq.sh@84 -- # adq_reload_driver 00:20:42.196 22:58:33 -- target/perf_adq.sh@52 -- # rmmod ice 00:20:43.132 22:58:33 -- target/perf_adq.sh@53 -- # modprobe ice 00:20:44.512 22:58:35 -- target/perf_adq.sh@54 -- # sleep 5 00:20:49.802 22:58:40 -- target/perf_adq.sh@87 -- # nvmftestinit 00:20:49.802 22:58:40 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:20:49.802 22:58:40 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:20:49.802 22:58:40 -- nvmf/common.sh@436 -- # prepare_net_devs 00:20:49.802 22:58:40 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:20:49.802 22:58:40 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:20:49.802 22:58:40 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:20:49.802 22:58:40 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:20:49.802 22:58:40 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:20:49.802 22:58:40 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:20:49.802 22:58:40 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:20:49.802 22:58:40 -- nvmf/common.sh@284 -- # xtrace_disable 00:20:49.802 22:58:40 -- common/autotest_common.sh@10 -- # set +x 00:20:49.802 22:58:40 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:20:49.802 22:58:40 -- nvmf/common.sh@290 -- # pci_devs=() 00:20:49.802 22:58:40 -- nvmf/common.sh@290 -- # local -a pci_devs 00:20:49.802 22:58:40 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:20:49.802 22:58:40 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:20:49.802 22:58:40 -- nvmf/common.sh@292 -- # pci_drivers=() 00:20:49.802 22:58:40 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:20:49.802 22:58:40 -- nvmf/common.sh@294 -- # net_devs=() 00:20:49.802 22:58:40 -- nvmf/common.sh@294 -- # local -ga net_devs 00:20:49.802 22:58:40 -- nvmf/common.sh@295 -- # e810=() 00:20:49.802 22:58:40 -- nvmf/common.sh@295 -- # local -ga e810 00:20:49.802 22:58:40 -- nvmf/common.sh@296 -- # x722=() 00:20:49.802 22:58:40 -- nvmf/common.sh@296 -- # local -ga x722 00:20:49.802 22:58:40 -- nvmf/common.sh@297 -- # mlx=() 00:20:49.802 22:58:40 -- nvmf/common.sh@297 -- # local -ga mlx 00:20:49.802 22:58:40 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:20:49.802 22:58:40 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:20:49.802 22:58:40 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:20:49.802 22:58:40 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:20:49.802 22:58:40 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:20:49.802 22:58:40 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:20:49.802 22:58:40 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:20:49.802 22:58:40 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:20:49.802 22:58:40 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:20:49.802 22:58:40 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:20:49.802 22:58:40 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:20:49.802 22:58:40 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:20:49.802 22:58:40 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:20:49.802 22:58:40 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:20:49.802 22:58:40 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:20:49.802 22:58:40 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:20:49.802 22:58:40 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:20:49.802 22:58:40 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:20:49.802 22:58:40 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:20:49.802 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:20:49.802 22:58:40 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:20:49.802 22:58:40 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:20:49.802 22:58:40 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:20:49.802 22:58:40 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:20:49.802 22:58:40 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:20:49.802 22:58:40 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:20:49.802 22:58:40 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:20:49.802 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:20:49.802 22:58:40 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:20:49.802 22:58:40 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:20:49.802 22:58:40 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:20:49.802 22:58:40 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:20:49.802 22:58:40 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:20:49.802 22:58:40 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:20:49.802 22:58:40 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:20:49.802 22:58:40 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:20:49.802 22:58:40 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:20:49.802 22:58:40 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:20:49.802 22:58:40 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:20:49.802 22:58:40 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:20:49.802 22:58:40 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:20:49.802 Found net devices under 0000:0a:00.0: cvl_0_0 00:20:49.802 22:58:40 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:20:49.802 22:58:40 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:20:49.802 22:58:40 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:20:49.802 22:58:40 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:20:49.802 22:58:40 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:20:49.802 22:58:40 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:20:49.802 Found net devices under 0000:0a:00.1: cvl_0_1 00:20:49.803 22:58:40 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:20:49.803 22:58:40 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:20:49.803 22:58:40 -- nvmf/common.sh@402 -- # is_hw=yes 00:20:49.803 22:58:40 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:20:49.803 22:58:40 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:20:49.803 22:58:40 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:20:49.803 22:58:40 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:20:49.803 22:58:40 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:20:49.803 22:58:40 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:20:49.803 22:58:40 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:20:49.803 22:58:40 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:20:49.803 22:58:40 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:20:49.803 22:58:40 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:20:49.803 22:58:40 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:20:49.803 22:58:40 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:20:49.803 22:58:40 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:20:49.803 22:58:40 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:20:49.803 22:58:40 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:20:49.803 22:58:40 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:20:49.803 22:58:40 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:20:49.803 22:58:40 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:20:49.803 22:58:40 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:20:49.803 22:58:40 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:20:49.803 22:58:40 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:20:49.803 22:58:40 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:20:49.803 22:58:40 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:20:49.803 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:20:49.803 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.115 ms 00:20:49.803 00:20:49.803 --- 10.0.0.2 ping statistics --- 00:20:49.803 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:20:49.803 rtt min/avg/max/mdev = 0.115/0.115/0.115/0.000 ms 00:20:49.803 22:58:40 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:20:49.803 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:20:49.803 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.097 ms 00:20:49.803 00:20:49.803 --- 10.0.0.1 ping statistics --- 00:20:49.803 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:20:49.803 rtt min/avg/max/mdev = 0.097/0.097/0.097/0.000 ms 00:20:49.803 22:58:40 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:20:49.803 22:58:40 -- nvmf/common.sh@410 -- # return 0 00:20:49.803 22:58:40 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:20:49.803 22:58:40 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:20:49.803 22:58:40 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:20:49.803 22:58:40 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:20:49.803 22:58:40 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:20:49.803 22:58:40 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:20:49.803 22:58:40 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:20:49.803 22:58:40 -- target/perf_adq.sh@88 -- # adq_configure_driver 00:20:49.803 22:58:40 -- target/perf_adq.sh@22 -- # ip netns exec cvl_0_0_ns_spdk ethtool --offload cvl_0_0 hw-tc-offload on 00:20:49.803 22:58:40 -- target/perf_adq.sh@24 -- # ip netns exec cvl_0_0_ns_spdk ethtool --set-priv-flags cvl_0_0 channel-pkt-inspect-optimize off 00:20:49.803 22:58:40 -- target/perf_adq.sh@26 -- # sysctl -w net.core.busy_poll=1 00:20:49.803 net.core.busy_poll = 1 00:20:49.803 22:58:40 -- target/perf_adq.sh@27 -- # sysctl -w net.core.busy_read=1 00:20:49.803 net.core.busy_read = 1 00:20:49.803 22:58:40 -- target/perf_adq.sh@29 -- # tc=/usr/sbin/tc 00:20:49.803 22:58:40 -- target/perf_adq.sh@31 -- # ip netns exec cvl_0_0_ns_spdk /usr/sbin/tc qdisc add dev cvl_0_0 root mqprio num_tc 2 map 0 1 queues 2@0 2@2 hw 1 mode channel 00:20:49.803 22:58:40 -- target/perf_adq.sh@33 -- # ip netns exec cvl_0_0_ns_spdk /usr/sbin/tc qdisc add dev cvl_0_0 ingress 00:20:49.803 22:58:40 -- target/perf_adq.sh@35 -- # ip netns exec cvl_0_0_ns_spdk /usr/sbin/tc filter add dev cvl_0_0 protocol ip parent ffff: prio 1 flower dst_ip 10.0.0.2/32 ip_proto tcp dst_port 4420 skip_sw hw_tc 1 00:20:49.803 22:58:40 -- target/perf_adq.sh@38 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/perf/nvmf/set_xps_rxqs cvl_0_0 00:20:49.803 22:58:40 -- target/perf_adq.sh@89 -- # nvmfappstart -m 0xF --wait-for-rpc 00:20:49.803 22:58:40 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:20:49.803 22:58:40 -- common/autotest_common.sh@712 -- # xtrace_disable 00:20:49.803 22:58:40 -- common/autotest_common.sh@10 -- # set +x 00:20:49.803 22:58:40 -- nvmf/common.sh@469 -- # nvmfpid=331281 00:20:49.803 22:58:40 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF --wait-for-rpc 00:20:49.803 22:58:40 -- nvmf/common.sh@470 -- # waitforlisten 331281 00:20:49.803 22:58:40 -- common/autotest_common.sh@819 -- # '[' -z 331281 ']' 00:20:49.803 22:58:40 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk.sock 00:20:49.803 22:58:40 -- common/autotest_common.sh@824 -- # local max_retries=100 00:20:49.803 22:58:40 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:20:49.803 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:20:49.803 22:58:40 -- common/autotest_common.sh@828 -- # xtrace_disable 00:20:49.803 22:58:40 -- common/autotest_common.sh@10 -- # set +x 00:20:49.803 [2024-04-16 22:58:40.701377] Starting SPDK v24.01.1-pre git sha1 4b134b4ab / DPDK 23.11.0 initialization... 00:20:49.803 [2024-04-16 22:58:40.701476] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:20:49.803 EAL: No free 2048 kB hugepages reported on node 1 00:20:49.803 [2024-04-16 22:58:40.766355] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:20:49.803 [2024-04-16 22:58:40.875764] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:20:49.803 [2024-04-16 22:58:40.875915] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:20:49.803 [2024-04-16 22:58:40.875931] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:20:49.803 [2024-04-16 22:58:40.875944] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:20:49.803 [2024-04-16 22:58:40.875995] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:20:49.803 [2024-04-16 22:58:40.876055] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:20:49.803 [2024-04-16 22:58:40.876121] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:20:49.803 [2024-04-16 22:58:40.876123] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:20:49.803 22:58:40 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:20:49.803 22:58:40 -- common/autotest_common.sh@852 -- # return 0 00:20:49.803 22:58:40 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:20:49.803 22:58:40 -- common/autotest_common.sh@718 -- # xtrace_disable 00:20:49.803 22:58:40 -- common/autotest_common.sh@10 -- # set +x 00:20:49.803 22:58:40 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:20:49.803 22:58:40 -- target/perf_adq.sh@90 -- # adq_configure_nvmf_target 1 00:20:49.803 22:58:40 -- target/perf_adq.sh@42 -- # rpc_cmd sock_impl_set_options --enable-placement-id 1 --enable-zerocopy-send-server -i posix 00:20:49.803 22:58:40 -- common/autotest_common.sh@551 -- # xtrace_disable 00:20:49.803 22:58:40 -- common/autotest_common.sh@10 -- # set +x 00:20:50.064 22:58:40 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:20:50.064 22:58:40 -- target/perf_adq.sh@43 -- # rpc_cmd framework_start_init 00:20:50.064 22:58:40 -- common/autotest_common.sh@551 -- # xtrace_disable 00:20:50.064 22:58:40 -- common/autotest_common.sh@10 -- # set +x 00:20:50.064 22:58:41 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:20:50.064 22:58:41 -- target/perf_adq.sh@44 -- # rpc_cmd nvmf_create_transport -t tcp -o --io-unit-size 8192 --sock-priority 1 00:20:50.064 22:58:41 -- common/autotest_common.sh@551 -- # xtrace_disable 00:20:50.064 22:58:41 -- common/autotest_common.sh@10 -- # set +x 00:20:50.064 [2024-04-16 22:58:41.051912] tcp.c: 659:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:20:50.064 22:58:41 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:20:50.064 22:58:41 -- target/perf_adq.sh@45 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc1 00:20:50.064 22:58:41 -- common/autotest_common.sh@551 -- # xtrace_disable 00:20:50.064 22:58:41 -- common/autotest_common.sh@10 -- # set +x 00:20:50.064 Malloc1 00:20:50.064 22:58:41 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:20:50.064 22:58:41 -- target/perf_adq.sh@46 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:20:50.064 22:58:41 -- common/autotest_common.sh@551 -- # xtrace_disable 00:20:50.064 22:58:41 -- common/autotest_common.sh@10 -- # set +x 00:20:50.064 22:58:41 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:20:50.064 22:58:41 -- target/perf_adq.sh@47 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:20:50.064 22:58:41 -- common/autotest_common.sh@551 -- # xtrace_disable 00:20:50.064 22:58:41 -- common/autotest_common.sh@10 -- # set +x 00:20:50.064 22:58:41 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:20:50.064 22:58:41 -- target/perf_adq.sh@48 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:20:50.064 22:58:41 -- common/autotest_common.sh@551 -- # xtrace_disable 00:20:50.064 22:58:41 -- common/autotest_common.sh@10 -- # set +x 00:20:50.064 [2024-04-16 22:58:41.103517] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:20:50.064 22:58:41 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:20:50.064 22:58:41 -- target/perf_adq.sh@94 -- # perfpid=331394 00:20:50.064 22:58:41 -- target/perf_adq.sh@95 -- # sleep 2 00:20:50.064 22:58:41 -- target/perf_adq.sh@91 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -q 64 -o 4096 -w randread -t 10 -c 0xF0 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1' 00:20:50.064 EAL: No free 2048 kB hugepages reported on node 1 00:20:52.604 22:58:43 -- target/perf_adq.sh@97 -- # rpc_cmd nvmf_get_stats 00:20:52.604 22:58:43 -- target/perf_adq.sh@97 -- # jq -r '.poll_groups[] | select(.current_io_qpairs == 0) | length' 00:20:52.604 22:58:43 -- common/autotest_common.sh@551 -- # xtrace_disable 00:20:52.604 22:58:43 -- target/perf_adq.sh@97 -- # wc -l 00:20:52.604 22:58:43 -- common/autotest_common.sh@10 -- # set +x 00:20:52.604 22:58:43 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:20:52.604 22:58:43 -- target/perf_adq.sh@97 -- # count=3 00:20:52.604 22:58:43 -- target/perf_adq.sh@98 -- # [[ 3 -lt 2 ]] 00:20:52.604 22:58:43 -- target/perf_adq.sh@103 -- # wait 331394 00:21:00.728 Initializing NVMe Controllers 00:21:00.728 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:21:00.728 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 4 00:21:00.728 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 5 00:21:00.728 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 6 00:21:00.728 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 7 00:21:00.728 Initialization complete. Launching workers. 00:21:00.728 ======================================================== 00:21:00.728 Latency(us) 00:21:00.728 Device Information : IOPS MiB/s Average min max 00:21:00.728 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 4: 5405.60 21.12 11843.79 1430.09 58544.17 00:21:00.728 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 5: 5004.60 19.55 12819.96 1765.68 58139.84 00:21:00.728 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 6: 4846.70 18.93 13211.78 1745.64 59664.26 00:21:00.728 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 7: 4674.60 18.26 13739.56 2188.89 57752.64 00:21:00.728 ======================================================== 00:21:00.728 Total : 19931.49 77.86 12866.17 1430.09 59664.26 00:21:00.728 00:21:00.728 22:58:51 -- target/perf_adq.sh@104 -- # nvmftestfini 00:21:00.728 22:58:51 -- nvmf/common.sh@476 -- # nvmfcleanup 00:21:00.728 22:58:51 -- nvmf/common.sh@116 -- # sync 00:21:00.728 22:58:51 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:21:00.728 22:58:51 -- nvmf/common.sh@119 -- # set +e 00:21:00.728 22:58:51 -- nvmf/common.sh@120 -- # for i in {1..20} 00:21:00.728 22:58:51 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:21:00.728 rmmod nvme_tcp 00:21:00.728 rmmod nvme_fabrics 00:21:00.728 rmmod nvme_keyring 00:21:00.728 22:58:51 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:21:00.728 22:58:51 -- nvmf/common.sh@123 -- # set -e 00:21:00.728 22:58:51 -- nvmf/common.sh@124 -- # return 0 00:21:00.728 22:58:51 -- nvmf/common.sh@477 -- # '[' -n 331281 ']' 00:21:00.728 22:58:51 -- nvmf/common.sh@478 -- # killprocess 331281 00:21:00.728 22:58:51 -- common/autotest_common.sh@926 -- # '[' -z 331281 ']' 00:21:00.728 22:58:51 -- common/autotest_common.sh@930 -- # kill -0 331281 00:21:00.728 22:58:51 -- common/autotest_common.sh@931 -- # uname 00:21:00.728 22:58:51 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:21:00.728 22:58:51 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 331281 00:21:00.728 22:58:51 -- common/autotest_common.sh@932 -- # process_name=reactor_0 00:21:00.728 22:58:51 -- common/autotest_common.sh@936 -- # '[' reactor_0 = sudo ']' 00:21:00.728 22:58:51 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 331281' 00:21:00.728 killing process with pid 331281 00:21:00.728 22:58:51 -- common/autotest_common.sh@945 -- # kill 331281 00:21:00.728 22:58:51 -- common/autotest_common.sh@950 -- # wait 331281 00:21:00.728 22:58:51 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:21:00.728 22:58:51 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:21:00.728 22:58:51 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:21:00.728 22:58:51 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:21:00.728 22:58:51 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:21:00.728 22:58:51 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:21:00.728 22:58:51 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:21:00.728 22:58:51 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:21:04.018 22:58:54 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:21:04.018 22:58:54 -- target/perf_adq.sh@106 -- # trap - SIGINT SIGTERM EXIT 00:21:04.018 00:21:04.018 real 0m43.707s 00:21:04.018 user 2m33.363s 00:21:04.018 sys 0m11.886s 00:21:04.018 22:58:54 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:21:04.018 22:58:54 -- common/autotest_common.sh@10 -- # set +x 00:21:04.018 ************************************ 00:21:04.018 END TEST nvmf_perf_adq 00:21:04.018 ************************************ 00:21:04.019 22:58:54 -- nvmf/nvmf.sh@80 -- # run_test nvmf_shutdown /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/shutdown.sh --transport=tcp 00:21:04.019 22:58:54 -- common/autotest_common.sh@1077 -- # '[' 3 -le 1 ']' 00:21:04.019 22:58:54 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:21:04.019 22:58:54 -- common/autotest_common.sh@10 -- # set +x 00:21:04.019 ************************************ 00:21:04.019 START TEST nvmf_shutdown 00:21:04.019 ************************************ 00:21:04.019 22:58:54 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/shutdown.sh --transport=tcp 00:21:04.019 * Looking for test storage... 00:21:04.019 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:21:04.019 22:58:54 -- target/shutdown.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:21:04.019 22:58:54 -- nvmf/common.sh@7 -- # uname -s 00:21:04.019 22:58:54 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:21:04.019 22:58:54 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:21:04.019 22:58:54 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:21:04.019 22:58:54 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:21:04.019 22:58:54 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:21:04.019 22:58:54 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:21:04.019 22:58:54 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:21:04.019 22:58:54 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:21:04.019 22:58:54 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:21:04.019 22:58:54 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:21:04.019 22:58:54 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:21:04.019 22:58:54 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:21:04.019 22:58:54 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:21:04.019 22:58:54 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:21:04.019 22:58:54 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:21:04.019 22:58:54 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:21:04.019 22:58:54 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:21:04.019 22:58:54 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:21:04.019 22:58:54 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:21:04.019 22:58:54 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:21:04.019 22:58:54 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:21:04.019 22:58:54 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:21:04.019 22:58:54 -- paths/export.sh@5 -- # export PATH 00:21:04.019 22:58:54 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:21:04.019 22:58:54 -- nvmf/common.sh@46 -- # : 0 00:21:04.019 22:58:54 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:21:04.019 22:58:54 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:21:04.019 22:58:54 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:21:04.019 22:58:54 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:21:04.019 22:58:54 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:21:04.019 22:58:54 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:21:04.019 22:58:54 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:21:04.019 22:58:54 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:21:04.019 22:58:54 -- target/shutdown.sh@11 -- # MALLOC_BDEV_SIZE=64 00:21:04.019 22:58:54 -- target/shutdown.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:21:04.019 22:58:54 -- target/shutdown.sh@146 -- # run_test nvmf_shutdown_tc1 nvmf_shutdown_tc1 00:21:04.019 22:58:54 -- common/autotest_common.sh@1077 -- # '[' 2 -le 1 ']' 00:21:04.019 22:58:54 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:21:04.019 22:58:54 -- common/autotest_common.sh@10 -- # set +x 00:21:04.019 ************************************ 00:21:04.019 START TEST nvmf_shutdown_tc1 00:21:04.019 ************************************ 00:21:04.019 22:58:54 -- common/autotest_common.sh@1104 -- # nvmf_shutdown_tc1 00:21:04.019 22:58:54 -- target/shutdown.sh@74 -- # starttarget 00:21:04.019 22:58:54 -- target/shutdown.sh@15 -- # nvmftestinit 00:21:04.019 22:58:54 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:21:04.019 22:58:54 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:21:04.019 22:58:54 -- nvmf/common.sh@436 -- # prepare_net_devs 00:21:04.019 22:58:54 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:21:04.019 22:58:54 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:21:04.019 22:58:54 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:21:04.019 22:58:54 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:21:04.019 22:58:54 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:21:04.019 22:58:54 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:21:04.019 22:58:54 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:21:04.019 22:58:54 -- nvmf/common.sh@284 -- # xtrace_disable 00:21:04.019 22:58:54 -- common/autotest_common.sh@10 -- # set +x 00:21:05.924 22:58:56 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:21:05.924 22:58:56 -- nvmf/common.sh@290 -- # pci_devs=() 00:21:05.924 22:58:56 -- nvmf/common.sh@290 -- # local -a pci_devs 00:21:05.924 22:58:56 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:21:05.924 22:58:56 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:21:05.924 22:58:56 -- nvmf/common.sh@292 -- # pci_drivers=() 00:21:05.924 22:58:56 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:21:05.924 22:58:56 -- nvmf/common.sh@294 -- # net_devs=() 00:21:05.924 22:58:56 -- nvmf/common.sh@294 -- # local -ga net_devs 00:21:05.924 22:58:56 -- nvmf/common.sh@295 -- # e810=() 00:21:05.924 22:58:56 -- nvmf/common.sh@295 -- # local -ga e810 00:21:05.924 22:58:56 -- nvmf/common.sh@296 -- # x722=() 00:21:05.924 22:58:56 -- nvmf/common.sh@296 -- # local -ga x722 00:21:05.924 22:58:56 -- nvmf/common.sh@297 -- # mlx=() 00:21:05.924 22:58:56 -- nvmf/common.sh@297 -- # local -ga mlx 00:21:05.924 22:58:56 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:21:05.924 22:58:56 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:21:05.924 22:58:56 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:21:05.924 22:58:56 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:21:05.924 22:58:56 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:21:05.924 22:58:56 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:21:05.924 22:58:56 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:21:05.924 22:58:56 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:21:05.924 22:58:56 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:21:05.924 22:58:56 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:21:05.924 22:58:56 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:21:05.924 22:58:56 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:21:05.924 22:58:56 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:21:05.924 22:58:56 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:21:05.924 22:58:56 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:21:05.924 22:58:56 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:21:05.924 22:58:56 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:21:05.924 22:58:56 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:21:05.924 22:58:56 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:21:05.924 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:21:05.924 22:58:56 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:21:05.924 22:58:56 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:21:05.924 22:58:56 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:21:05.924 22:58:56 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:21:05.924 22:58:56 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:21:05.924 22:58:56 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:21:05.924 22:58:56 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:21:05.924 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:21:05.924 22:58:56 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:21:05.924 22:58:56 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:21:05.924 22:58:56 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:21:05.924 22:58:56 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:21:05.924 22:58:56 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:21:05.924 22:58:56 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:21:05.924 22:58:56 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:21:05.924 22:58:56 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:21:05.924 22:58:56 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:21:05.924 22:58:56 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:21:05.924 22:58:56 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:21:05.924 22:58:56 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:21:05.924 22:58:56 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:21:05.924 Found net devices under 0000:0a:00.0: cvl_0_0 00:21:05.924 22:58:56 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:21:05.924 22:58:56 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:21:05.924 22:58:56 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:21:05.924 22:58:56 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:21:05.924 22:58:56 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:21:05.924 22:58:56 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:21:05.924 Found net devices under 0000:0a:00.1: cvl_0_1 00:21:05.924 22:58:56 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:21:05.924 22:58:56 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:21:05.924 22:58:56 -- nvmf/common.sh@402 -- # is_hw=yes 00:21:05.924 22:58:56 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:21:05.924 22:58:56 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:21:05.924 22:58:56 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:21:05.924 22:58:56 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:21:05.924 22:58:56 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:21:05.924 22:58:56 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:21:05.924 22:58:56 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:21:05.924 22:58:56 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:21:05.924 22:58:56 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:21:05.924 22:58:56 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:21:05.924 22:58:56 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:21:05.924 22:58:56 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:21:05.924 22:58:56 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:21:05.924 22:58:56 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:21:05.924 22:58:56 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:21:05.924 22:58:56 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:21:05.924 22:58:56 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:21:05.924 22:58:56 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:21:05.924 22:58:56 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:21:05.924 22:58:56 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:21:05.924 22:58:56 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:21:05.924 22:58:56 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:21:05.924 22:58:56 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:21:05.924 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:21:05.924 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.258 ms 00:21:05.924 00:21:05.924 --- 10.0.0.2 ping statistics --- 00:21:05.924 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:21:05.924 rtt min/avg/max/mdev = 0.258/0.258/0.258/0.000 ms 00:21:05.924 22:58:56 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:21:05.924 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:21:05.924 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.148 ms 00:21:05.924 00:21:05.924 --- 10.0.0.1 ping statistics --- 00:21:05.924 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:21:05.924 rtt min/avg/max/mdev = 0.148/0.148/0.148/0.000 ms 00:21:05.924 22:58:56 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:21:05.924 22:58:56 -- nvmf/common.sh@410 -- # return 0 00:21:05.924 22:58:56 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:21:05.924 22:58:56 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:21:05.924 22:58:56 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:21:05.924 22:58:56 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:21:05.924 22:58:56 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:21:05.924 22:58:56 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:21:05.924 22:58:56 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:21:05.924 22:58:56 -- target/shutdown.sh@18 -- # nvmfappstart -m 0x1E 00:21:05.924 22:58:56 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:21:05.924 22:58:56 -- common/autotest_common.sh@712 -- # xtrace_disable 00:21:05.924 22:58:56 -- common/autotest_common.sh@10 -- # set +x 00:21:05.924 22:58:56 -- nvmf/common.sh@469 -- # nvmfpid=334651 00:21:05.924 22:58:56 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x1E 00:21:05.924 22:58:56 -- nvmf/common.sh@470 -- # waitforlisten 334651 00:21:05.924 22:58:56 -- common/autotest_common.sh@819 -- # '[' -z 334651 ']' 00:21:05.924 22:58:56 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk.sock 00:21:05.924 22:58:56 -- common/autotest_common.sh@824 -- # local max_retries=100 00:21:05.924 22:58:56 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:21:05.924 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:21:05.924 22:58:56 -- common/autotest_common.sh@828 -- # xtrace_disable 00:21:05.924 22:58:56 -- common/autotest_common.sh@10 -- # set +x 00:21:05.924 [2024-04-16 22:58:56.901706] Starting SPDK v24.01.1-pre git sha1 4b134b4ab / DPDK 23.11.0 initialization... 00:21:05.924 [2024-04-16 22:58:56.901776] [ DPDK EAL parameters: nvmf -c 0x1E --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:21:05.924 EAL: No free 2048 kB hugepages reported on node 1 00:21:05.924 [2024-04-16 22:58:56.972143] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:21:06.183 [2024-04-16 22:58:57.092806] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:21:06.183 [2024-04-16 22:58:57.092977] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:21:06.183 [2024-04-16 22:58:57.093007] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:21:06.183 [2024-04-16 22:58:57.093028] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:21:06.183 [2024-04-16 22:58:57.093144] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:21:06.183 [2024-04-16 22:58:57.093305] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:21:06.183 [2024-04-16 22:58:57.093379] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 4 00:21:06.183 [2024-04-16 22:58:57.093382] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:21:06.748 22:58:57 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:21:06.748 22:58:57 -- common/autotest_common.sh@852 -- # return 0 00:21:06.748 22:58:57 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:21:06.748 22:58:57 -- common/autotest_common.sh@718 -- # xtrace_disable 00:21:06.748 22:58:57 -- common/autotest_common.sh@10 -- # set +x 00:21:06.748 22:58:57 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:21:06.748 22:58:57 -- target/shutdown.sh@20 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:21:06.748 22:58:57 -- common/autotest_common.sh@551 -- # xtrace_disable 00:21:06.748 22:58:57 -- common/autotest_common.sh@10 -- # set +x 00:21:06.748 [2024-04-16 22:58:57.862568] tcp.c: 659:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:21:06.748 22:58:57 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:21:06.748 22:58:57 -- target/shutdown.sh@22 -- # num_subsystems=({1..10}) 00:21:06.748 22:58:57 -- target/shutdown.sh@24 -- # timing_enter create_subsystems 00:21:06.748 22:58:57 -- common/autotest_common.sh@712 -- # xtrace_disable 00:21:06.748 22:58:57 -- common/autotest_common.sh@10 -- # set +x 00:21:06.748 22:58:57 -- target/shutdown.sh@26 -- # rm -rf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/rpcs.txt 00:21:07.006 22:58:57 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:21:07.006 22:58:57 -- target/shutdown.sh@28 -- # cat 00:21:07.006 22:58:57 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:21:07.006 22:58:57 -- target/shutdown.sh@28 -- # cat 00:21:07.006 22:58:57 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:21:07.006 22:58:57 -- target/shutdown.sh@28 -- # cat 00:21:07.006 22:58:57 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:21:07.006 22:58:57 -- target/shutdown.sh@28 -- # cat 00:21:07.006 22:58:57 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:21:07.006 22:58:57 -- target/shutdown.sh@28 -- # cat 00:21:07.006 22:58:57 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:21:07.006 22:58:57 -- target/shutdown.sh@28 -- # cat 00:21:07.006 22:58:57 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:21:07.006 22:58:57 -- target/shutdown.sh@28 -- # cat 00:21:07.006 22:58:57 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:21:07.006 22:58:57 -- target/shutdown.sh@28 -- # cat 00:21:07.006 22:58:57 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:21:07.006 22:58:57 -- target/shutdown.sh@28 -- # cat 00:21:07.006 22:58:57 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:21:07.006 22:58:57 -- target/shutdown.sh@28 -- # cat 00:21:07.006 22:58:57 -- target/shutdown.sh@35 -- # rpc_cmd 00:21:07.006 22:58:57 -- common/autotest_common.sh@551 -- # xtrace_disable 00:21:07.006 22:58:57 -- common/autotest_common.sh@10 -- # set +x 00:21:07.006 Malloc1 00:21:07.007 [2024-04-16 22:58:57.950678] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:21:07.007 Malloc2 00:21:07.007 Malloc3 00:21:07.007 Malloc4 00:21:07.007 Malloc5 00:21:07.264 Malloc6 00:21:07.264 Malloc7 00:21:07.264 Malloc8 00:21:07.264 Malloc9 00:21:07.265 Malloc10 00:21:07.265 22:58:58 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:21:07.265 22:58:58 -- target/shutdown.sh@36 -- # timing_exit create_subsystems 00:21:07.265 22:58:58 -- common/autotest_common.sh@718 -- # xtrace_disable 00:21:07.265 22:58:58 -- common/autotest_common.sh@10 -- # set +x 00:21:07.523 22:58:58 -- target/shutdown.sh@78 -- # perfpid=334965 00:21:07.523 22:58:58 -- target/shutdown.sh@79 -- # waitforlisten 334965 /var/tmp/bdevperf.sock 00:21:07.523 22:58:58 -- common/autotest_common.sh@819 -- # '[' -z 334965 ']' 00:21:07.523 22:58:58 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:21:07.523 22:58:58 -- target/shutdown.sh@77 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/app/bdev_svc/bdev_svc -m 0x1 -i 1 -r /var/tmp/bdevperf.sock --json /dev/fd/63 00:21:07.523 22:58:58 -- target/shutdown.sh@77 -- # gen_nvmf_target_json 1 2 3 4 5 6 7 8 9 10 00:21:07.523 22:58:58 -- common/autotest_common.sh@824 -- # local max_retries=100 00:21:07.523 22:58:58 -- nvmf/common.sh@520 -- # config=() 00:21:07.523 22:58:58 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:21:07.523 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:21:07.523 22:58:58 -- nvmf/common.sh@520 -- # local subsystem config 00:21:07.523 22:58:58 -- common/autotest_common.sh@828 -- # xtrace_disable 00:21:07.523 22:58:58 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:21:07.523 22:58:58 -- common/autotest_common.sh@10 -- # set +x 00:21:07.523 22:58:58 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:21:07.523 { 00:21:07.523 "params": { 00:21:07.523 "name": "Nvme$subsystem", 00:21:07.523 "trtype": "$TEST_TRANSPORT", 00:21:07.523 "traddr": "$NVMF_FIRST_TARGET_IP", 00:21:07.523 "adrfam": "ipv4", 00:21:07.523 "trsvcid": "$NVMF_PORT", 00:21:07.523 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:21:07.523 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:21:07.523 "hdgst": ${hdgst:-false}, 00:21:07.523 "ddgst": ${ddgst:-false} 00:21:07.523 }, 00:21:07.523 "method": "bdev_nvme_attach_controller" 00:21:07.523 } 00:21:07.523 EOF 00:21:07.523 )") 00:21:07.523 22:58:58 -- nvmf/common.sh@542 -- # cat 00:21:07.523 22:58:58 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:21:07.523 22:58:58 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:21:07.523 { 00:21:07.523 "params": { 00:21:07.523 "name": "Nvme$subsystem", 00:21:07.523 "trtype": "$TEST_TRANSPORT", 00:21:07.523 "traddr": "$NVMF_FIRST_TARGET_IP", 00:21:07.523 "adrfam": "ipv4", 00:21:07.523 "trsvcid": "$NVMF_PORT", 00:21:07.523 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:21:07.523 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:21:07.523 "hdgst": ${hdgst:-false}, 00:21:07.523 "ddgst": ${ddgst:-false} 00:21:07.523 }, 00:21:07.523 "method": "bdev_nvme_attach_controller" 00:21:07.523 } 00:21:07.523 EOF 00:21:07.523 )") 00:21:07.523 22:58:58 -- nvmf/common.sh@542 -- # cat 00:21:07.523 22:58:58 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:21:07.523 22:58:58 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:21:07.523 { 00:21:07.523 "params": { 00:21:07.523 "name": "Nvme$subsystem", 00:21:07.523 "trtype": "$TEST_TRANSPORT", 00:21:07.524 "traddr": "$NVMF_FIRST_TARGET_IP", 00:21:07.524 "adrfam": "ipv4", 00:21:07.524 "trsvcid": "$NVMF_PORT", 00:21:07.524 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:21:07.524 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:21:07.524 "hdgst": ${hdgst:-false}, 00:21:07.524 "ddgst": ${ddgst:-false} 00:21:07.524 }, 00:21:07.524 "method": "bdev_nvme_attach_controller" 00:21:07.524 } 00:21:07.524 EOF 00:21:07.524 )") 00:21:07.524 22:58:58 -- nvmf/common.sh@542 -- # cat 00:21:07.524 22:58:58 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:21:07.524 22:58:58 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:21:07.524 { 00:21:07.524 "params": { 00:21:07.524 "name": "Nvme$subsystem", 00:21:07.524 "trtype": "$TEST_TRANSPORT", 00:21:07.524 "traddr": "$NVMF_FIRST_TARGET_IP", 00:21:07.524 "adrfam": "ipv4", 00:21:07.524 "trsvcid": "$NVMF_PORT", 00:21:07.524 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:21:07.524 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:21:07.524 "hdgst": ${hdgst:-false}, 00:21:07.524 "ddgst": ${ddgst:-false} 00:21:07.524 }, 00:21:07.524 "method": "bdev_nvme_attach_controller" 00:21:07.524 } 00:21:07.524 EOF 00:21:07.524 )") 00:21:07.524 22:58:58 -- nvmf/common.sh@542 -- # cat 00:21:07.524 22:58:58 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:21:07.524 22:58:58 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:21:07.524 { 00:21:07.524 "params": { 00:21:07.524 "name": "Nvme$subsystem", 00:21:07.524 "trtype": "$TEST_TRANSPORT", 00:21:07.524 "traddr": "$NVMF_FIRST_TARGET_IP", 00:21:07.524 "adrfam": "ipv4", 00:21:07.524 "trsvcid": "$NVMF_PORT", 00:21:07.524 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:21:07.524 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:21:07.524 "hdgst": ${hdgst:-false}, 00:21:07.524 "ddgst": ${ddgst:-false} 00:21:07.524 }, 00:21:07.524 "method": "bdev_nvme_attach_controller" 00:21:07.524 } 00:21:07.524 EOF 00:21:07.524 )") 00:21:07.524 22:58:58 -- nvmf/common.sh@542 -- # cat 00:21:07.524 22:58:58 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:21:07.524 22:58:58 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:21:07.524 { 00:21:07.524 "params": { 00:21:07.524 "name": "Nvme$subsystem", 00:21:07.524 "trtype": "$TEST_TRANSPORT", 00:21:07.524 "traddr": "$NVMF_FIRST_TARGET_IP", 00:21:07.524 "adrfam": "ipv4", 00:21:07.524 "trsvcid": "$NVMF_PORT", 00:21:07.524 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:21:07.524 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:21:07.524 "hdgst": ${hdgst:-false}, 00:21:07.524 "ddgst": ${ddgst:-false} 00:21:07.524 }, 00:21:07.524 "method": "bdev_nvme_attach_controller" 00:21:07.524 } 00:21:07.524 EOF 00:21:07.524 )") 00:21:07.524 22:58:58 -- nvmf/common.sh@542 -- # cat 00:21:07.524 22:58:58 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:21:07.524 22:58:58 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:21:07.524 { 00:21:07.524 "params": { 00:21:07.524 "name": "Nvme$subsystem", 00:21:07.524 "trtype": "$TEST_TRANSPORT", 00:21:07.524 "traddr": "$NVMF_FIRST_TARGET_IP", 00:21:07.524 "adrfam": "ipv4", 00:21:07.524 "trsvcid": "$NVMF_PORT", 00:21:07.524 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:21:07.524 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:21:07.524 "hdgst": ${hdgst:-false}, 00:21:07.524 "ddgst": ${ddgst:-false} 00:21:07.524 }, 00:21:07.524 "method": "bdev_nvme_attach_controller" 00:21:07.524 } 00:21:07.524 EOF 00:21:07.524 )") 00:21:07.524 22:58:58 -- nvmf/common.sh@542 -- # cat 00:21:07.524 22:58:58 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:21:07.524 22:58:58 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:21:07.524 { 00:21:07.524 "params": { 00:21:07.524 "name": "Nvme$subsystem", 00:21:07.524 "trtype": "$TEST_TRANSPORT", 00:21:07.524 "traddr": "$NVMF_FIRST_TARGET_IP", 00:21:07.524 "adrfam": "ipv4", 00:21:07.524 "trsvcid": "$NVMF_PORT", 00:21:07.524 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:21:07.524 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:21:07.524 "hdgst": ${hdgst:-false}, 00:21:07.524 "ddgst": ${ddgst:-false} 00:21:07.524 }, 00:21:07.524 "method": "bdev_nvme_attach_controller" 00:21:07.524 } 00:21:07.524 EOF 00:21:07.524 )") 00:21:07.524 22:58:58 -- nvmf/common.sh@542 -- # cat 00:21:07.524 22:58:58 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:21:07.524 22:58:58 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:21:07.524 { 00:21:07.524 "params": { 00:21:07.524 "name": "Nvme$subsystem", 00:21:07.524 "trtype": "$TEST_TRANSPORT", 00:21:07.524 "traddr": "$NVMF_FIRST_TARGET_IP", 00:21:07.524 "adrfam": "ipv4", 00:21:07.524 "trsvcid": "$NVMF_PORT", 00:21:07.524 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:21:07.524 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:21:07.524 "hdgst": ${hdgst:-false}, 00:21:07.524 "ddgst": ${ddgst:-false} 00:21:07.524 }, 00:21:07.524 "method": "bdev_nvme_attach_controller" 00:21:07.524 } 00:21:07.524 EOF 00:21:07.524 )") 00:21:07.524 22:58:58 -- nvmf/common.sh@542 -- # cat 00:21:07.524 22:58:58 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:21:07.524 22:58:58 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:21:07.524 { 00:21:07.524 "params": { 00:21:07.524 "name": "Nvme$subsystem", 00:21:07.524 "trtype": "$TEST_TRANSPORT", 00:21:07.524 "traddr": "$NVMF_FIRST_TARGET_IP", 00:21:07.524 "adrfam": "ipv4", 00:21:07.524 "trsvcid": "$NVMF_PORT", 00:21:07.524 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:21:07.524 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:21:07.524 "hdgst": ${hdgst:-false}, 00:21:07.524 "ddgst": ${ddgst:-false} 00:21:07.524 }, 00:21:07.524 "method": "bdev_nvme_attach_controller" 00:21:07.524 } 00:21:07.524 EOF 00:21:07.524 )") 00:21:07.524 22:58:58 -- nvmf/common.sh@542 -- # cat 00:21:07.524 22:58:58 -- nvmf/common.sh@544 -- # jq . 00:21:07.524 22:58:58 -- nvmf/common.sh@545 -- # IFS=, 00:21:07.524 22:58:58 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:21:07.524 "params": { 00:21:07.524 "name": "Nvme1", 00:21:07.524 "trtype": "tcp", 00:21:07.524 "traddr": "10.0.0.2", 00:21:07.524 "adrfam": "ipv4", 00:21:07.524 "trsvcid": "4420", 00:21:07.524 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:21:07.524 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:21:07.524 "hdgst": false, 00:21:07.524 "ddgst": false 00:21:07.524 }, 00:21:07.524 "method": "bdev_nvme_attach_controller" 00:21:07.524 },{ 00:21:07.524 "params": { 00:21:07.524 "name": "Nvme2", 00:21:07.524 "trtype": "tcp", 00:21:07.524 "traddr": "10.0.0.2", 00:21:07.524 "adrfam": "ipv4", 00:21:07.524 "trsvcid": "4420", 00:21:07.524 "subnqn": "nqn.2016-06.io.spdk:cnode2", 00:21:07.524 "hostnqn": "nqn.2016-06.io.spdk:host2", 00:21:07.524 "hdgst": false, 00:21:07.524 "ddgst": false 00:21:07.524 }, 00:21:07.524 "method": "bdev_nvme_attach_controller" 00:21:07.524 },{ 00:21:07.524 "params": { 00:21:07.524 "name": "Nvme3", 00:21:07.524 "trtype": "tcp", 00:21:07.524 "traddr": "10.0.0.2", 00:21:07.524 "adrfam": "ipv4", 00:21:07.524 "trsvcid": "4420", 00:21:07.524 "subnqn": "nqn.2016-06.io.spdk:cnode3", 00:21:07.524 "hostnqn": "nqn.2016-06.io.spdk:host3", 00:21:07.524 "hdgst": false, 00:21:07.524 "ddgst": false 00:21:07.524 }, 00:21:07.524 "method": "bdev_nvme_attach_controller" 00:21:07.524 },{ 00:21:07.524 "params": { 00:21:07.524 "name": "Nvme4", 00:21:07.524 "trtype": "tcp", 00:21:07.524 "traddr": "10.0.0.2", 00:21:07.524 "adrfam": "ipv4", 00:21:07.524 "trsvcid": "4420", 00:21:07.524 "subnqn": "nqn.2016-06.io.spdk:cnode4", 00:21:07.524 "hostnqn": "nqn.2016-06.io.spdk:host4", 00:21:07.524 "hdgst": false, 00:21:07.524 "ddgst": false 00:21:07.524 }, 00:21:07.524 "method": "bdev_nvme_attach_controller" 00:21:07.524 },{ 00:21:07.524 "params": { 00:21:07.524 "name": "Nvme5", 00:21:07.524 "trtype": "tcp", 00:21:07.524 "traddr": "10.0.0.2", 00:21:07.524 "adrfam": "ipv4", 00:21:07.524 "trsvcid": "4420", 00:21:07.524 "subnqn": "nqn.2016-06.io.spdk:cnode5", 00:21:07.524 "hostnqn": "nqn.2016-06.io.spdk:host5", 00:21:07.524 "hdgst": false, 00:21:07.524 "ddgst": false 00:21:07.524 }, 00:21:07.524 "method": "bdev_nvme_attach_controller" 00:21:07.524 },{ 00:21:07.524 "params": { 00:21:07.524 "name": "Nvme6", 00:21:07.524 "trtype": "tcp", 00:21:07.524 "traddr": "10.0.0.2", 00:21:07.524 "adrfam": "ipv4", 00:21:07.524 "trsvcid": "4420", 00:21:07.524 "subnqn": "nqn.2016-06.io.spdk:cnode6", 00:21:07.524 "hostnqn": "nqn.2016-06.io.spdk:host6", 00:21:07.524 "hdgst": false, 00:21:07.524 "ddgst": false 00:21:07.524 }, 00:21:07.524 "method": "bdev_nvme_attach_controller" 00:21:07.524 },{ 00:21:07.524 "params": { 00:21:07.524 "name": "Nvme7", 00:21:07.524 "trtype": "tcp", 00:21:07.524 "traddr": "10.0.0.2", 00:21:07.524 "adrfam": "ipv4", 00:21:07.524 "trsvcid": "4420", 00:21:07.524 "subnqn": "nqn.2016-06.io.spdk:cnode7", 00:21:07.524 "hostnqn": "nqn.2016-06.io.spdk:host7", 00:21:07.524 "hdgst": false, 00:21:07.524 "ddgst": false 00:21:07.524 }, 00:21:07.524 "method": "bdev_nvme_attach_controller" 00:21:07.524 },{ 00:21:07.525 "params": { 00:21:07.525 "name": "Nvme8", 00:21:07.525 "trtype": "tcp", 00:21:07.525 "traddr": "10.0.0.2", 00:21:07.525 "adrfam": "ipv4", 00:21:07.525 "trsvcid": "4420", 00:21:07.525 "subnqn": "nqn.2016-06.io.spdk:cnode8", 00:21:07.525 "hostnqn": "nqn.2016-06.io.spdk:host8", 00:21:07.525 "hdgst": false, 00:21:07.525 "ddgst": false 00:21:07.525 }, 00:21:07.525 "method": "bdev_nvme_attach_controller" 00:21:07.525 },{ 00:21:07.525 "params": { 00:21:07.525 "name": "Nvme9", 00:21:07.525 "trtype": "tcp", 00:21:07.525 "traddr": "10.0.0.2", 00:21:07.525 "adrfam": "ipv4", 00:21:07.525 "trsvcid": "4420", 00:21:07.525 "subnqn": "nqn.2016-06.io.spdk:cnode9", 00:21:07.525 "hostnqn": "nqn.2016-06.io.spdk:host9", 00:21:07.525 "hdgst": false, 00:21:07.525 "ddgst": false 00:21:07.525 }, 00:21:07.525 "method": "bdev_nvme_attach_controller" 00:21:07.525 },{ 00:21:07.525 "params": { 00:21:07.525 "name": "Nvme10", 00:21:07.525 "trtype": "tcp", 00:21:07.525 "traddr": "10.0.0.2", 00:21:07.525 "adrfam": "ipv4", 00:21:07.525 "trsvcid": "4420", 00:21:07.525 "subnqn": "nqn.2016-06.io.spdk:cnode10", 00:21:07.525 "hostnqn": "nqn.2016-06.io.spdk:host10", 00:21:07.525 "hdgst": false, 00:21:07.525 "ddgst": false 00:21:07.525 }, 00:21:07.525 "method": "bdev_nvme_attach_controller" 00:21:07.525 }' 00:21:07.525 [2024-04-16 22:58:58.439066] Starting SPDK v24.01.1-pre git sha1 4b134b4ab / DPDK 23.11.0 initialization... 00:21:07.525 [2024-04-16 22:58:58.439140] [ DPDK EAL parameters: bdev_svc -c 0x1 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk1 --proc-type=auto ] 00:21:07.525 EAL: No free 2048 kB hugepages reported on node 1 00:21:07.525 [2024-04-16 22:58:58.503662] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:21:07.525 [2024-04-16 22:58:58.611570] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:21:09.422 22:59:00 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:21:09.422 22:59:00 -- common/autotest_common.sh@852 -- # return 0 00:21:09.422 22:59:00 -- target/shutdown.sh@80 -- # rpc_cmd -s /var/tmp/bdevperf.sock framework_wait_init 00:21:09.422 22:59:00 -- common/autotest_common.sh@551 -- # xtrace_disable 00:21:09.422 22:59:00 -- common/autotest_common.sh@10 -- # set +x 00:21:09.422 22:59:00 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:21:09.422 22:59:00 -- target/shutdown.sh@83 -- # kill -9 334965 00:21:09.422 22:59:00 -- target/shutdown.sh@84 -- # rm -f /var/run/spdk_bdev1 00:21:09.422 22:59:00 -- target/shutdown.sh@87 -- # sleep 1 00:21:10.356 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/shutdown.sh: line 73: 334965 Killed $rootdir/test/app/bdev_svc/bdev_svc -m 0x1 -i 1 -r /var/tmp/bdevperf.sock --json <(gen_nvmf_target_json "${num_subsystems[@]}") 00:21:10.356 22:59:01 -- target/shutdown.sh@88 -- # kill -0 334651 00:21:10.356 22:59:01 -- target/shutdown.sh@91 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -r /var/tmp/bdevperf.sock --json /dev/fd/62 -q 64 -o 65536 -w verify -t 1 00:21:10.356 22:59:01 -- target/shutdown.sh@91 -- # gen_nvmf_target_json 1 2 3 4 5 6 7 8 9 10 00:21:10.356 22:59:01 -- nvmf/common.sh@520 -- # config=() 00:21:10.356 22:59:01 -- nvmf/common.sh@520 -- # local subsystem config 00:21:10.356 22:59:01 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:21:10.356 22:59:01 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:21:10.356 { 00:21:10.356 "params": { 00:21:10.356 "name": "Nvme$subsystem", 00:21:10.356 "trtype": "$TEST_TRANSPORT", 00:21:10.356 "traddr": "$NVMF_FIRST_TARGET_IP", 00:21:10.356 "adrfam": "ipv4", 00:21:10.356 "trsvcid": "$NVMF_PORT", 00:21:10.356 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:21:10.356 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:21:10.356 "hdgst": ${hdgst:-false}, 00:21:10.356 "ddgst": ${ddgst:-false} 00:21:10.356 }, 00:21:10.356 "method": "bdev_nvme_attach_controller" 00:21:10.356 } 00:21:10.356 EOF 00:21:10.356 )") 00:21:10.356 22:59:01 -- nvmf/common.sh@542 -- # cat 00:21:10.356 22:59:01 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:21:10.356 22:59:01 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:21:10.356 { 00:21:10.356 "params": { 00:21:10.356 "name": "Nvme$subsystem", 00:21:10.356 "trtype": "$TEST_TRANSPORT", 00:21:10.356 "traddr": "$NVMF_FIRST_TARGET_IP", 00:21:10.356 "adrfam": "ipv4", 00:21:10.356 "trsvcid": "$NVMF_PORT", 00:21:10.356 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:21:10.356 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:21:10.356 "hdgst": ${hdgst:-false}, 00:21:10.356 "ddgst": ${ddgst:-false} 00:21:10.356 }, 00:21:10.356 "method": "bdev_nvme_attach_controller" 00:21:10.356 } 00:21:10.356 EOF 00:21:10.356 )") 00:21:10.356 22:59:01 -- nvmf/common.sh@542 -- # cat 00:21:10.356 22:59:01 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:21:10.356 22:59:01 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:21:10.356 { 00:21:10.356 "params": { 00:21:10.356 "name": "Nvme$subsystem", 00:21:10.356 "trtype": "$TEST_TRANSPORT", 00:21:10.356 "traddr": "$NVMF_FIRST_TARGET_IP", 00:21:10.356 "adrfam": "ipv4", 00:21:10.356 "trsvcid": "$NVMF_PORT", 00:21:10.356 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:21:10.356 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:21:10.356 "hdgst": ${hdgst:-false}, 00:21:10.356 "ddgst": ${ddgst:-false} 00:21:10.356 }, 00:21:10.356 "method": "bdev_nvme_attach_controller" 00:21:10.356 } 00:21:10.356 EOF 00:21:10.356 )") 00:21:10.356 22:59:01 -- nvmf/common.sh@542 -- # cat 00:21:10.356 22:59:01 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:21:10.356 22:59:01 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:21:10.356 { 00:21:10.356 "params": { 00:21:10.356 "name": "Nvme$subsystem", 00:21:10.356 "trtype": "$TEST_TRANSPORT", 00:21:10.356 "traddr": "$NVMF_FIRST_TARGET_IP", 00:21:10.356 "adrfam": "ipv4", 00:21:10.356 "trsvcid": "$NVMF_PORT", 00:21:10.356 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:21:10.356 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:21:10.356 "hdgst": ${hdgst:-false}, 00:21:10.356 "ddgst": ${ddgst:-false} 00:21:10.356 }, 00:21:10.356 "method": "bdev_nvme_attach_controller" 00:21:10.356 } 00:21:10.356 EOF 00:21:10.356 )") 00:21:10.356 22:59:01 -- nvmf/common.sh@542 -- # cat 00:21:10.356 22:59:01 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:21:10.356 22:59:01 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:21:10.356 { 00:21:10.356 "params": { 00:21:10.356 "name": "Nvme$subsystem", 00:21:10.356 "trtype": "$TEST_TRANSPORT", 00:21:10.356 "traddr": "$NVMF_FIRST_TARGET_IP", 00:21:10.356 "adrfam": "ipv4", 00:21:10.356 "trsvcid": "$NVMF_PORT", 00:21:10.356 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:21:10.357 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:21:10.357 "hdgst": ${hdgst:-false}, 00:21:10.357 "ddgst": ${ddgst:-false} 00:21:10.357 }, 00:21:10.357 "method": "bdev_nvme_attach_controller" 00:21:10.357 } 00:21:10.357 EOF 00:21:10.357 )") 00:21:10.357 22:59:01 -- nvmf/common.sh@542 -- # cat 00:21:10.357 22:59:01 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:21:10.357 22:59:01 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:21:10.357 { 00:21:10.357 "params": { 00:21:10.357 "name": "Nvme$subsystem", 00:21:10.357 "trtype": "$TEST_TRANSPORT", 00:21:10.357 "traddr": "$NVMF_FIRST_TARGET_IP", 00:21:10.357 "adrfam": "ipv4", 00:21:10.357 "trsvcid": "$NVMF_PORT", 00:21:10.357 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:21:10.357 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:21:10.357 "hdgst": ${hdgst:-false}, 00:21:10.357 "ddgst": ${ddgst:-false} 00:21:10.357 }, 00:21:10.357 "method": "bdev_nvme_attach_controller" 00:21:10.357 } 00:21:10.357 EOF 00:21:10.357 )") 00:21:10.357 22:59:01 -- nvmf/common.sh@542 -- # cat 00:21:10.357 22:59:01 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:21:10.357 22:59:01 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:21:10.357 { 00:21:10.357 "params": { 00:21:10.357 "name": "Nvme$subsystem", 00:21:10.357 "trtype": "$TEST_TRANSPORT", 00:21:10.357 "traddr": "$NVMF_FIRST_TARGET_IP", 00:21:10.357 "adrfam": "ipv4", 00:21:10.357 "trsvcid": "$NVMF_PORT", 00:21:10.357 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:21:10.357 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:21:10.357 "hdgst": ${hdgst:-false}, 00:21:10.357 "ddgst": ${ddgst:-false} 00:21:10.357 }, 00:21:10.357 "method": "bdev_nvme_attach_controller" 00:21:10.357 } 00:21:10.357 EOF 00:21:10.357 )") 00:21:10.357 22:59:01 -- nvmf/common.sh@542 -- # cat 00:21:10.357 22:59:01 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:21:10.357 22:59:01 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:21:10.357 { 00:21:10.357 "params": { 00:21:10.357 "name": "Nvme$subsystem", 00:21:10.357 "trtype": "$TEST_TRANSPORT", 00:21:10.357 "traddr": "$NVMF_FIRST_TARGET_IP", 00:21:10.357 "adrfam": "ipv4", 00:21:10.357 "trsvcid": "$NVMF_PORT", 00:21:10.357 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:21:10.357 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:21:10.357 "hdgst": ${hdgst:-false}, 00:21:10.357 "ddgst": ${ddgst:-false} 00:21:10.357 }, 00:21:10.357 "method": "bdev_nvme_attach_controller" 00:21:10.357 } 00:21:10.357 EOF 00:21:10.357 )") 00:21:10.357 22:59:01 -- nvmf/common.sh@542 -- # cat 00:21:10.357 22:59:01 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:21:10.357 22:59:01 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:21:10.357 { 00:21:10.357 "params": { 00:21:10.357 "name": "Nvme$subsystem", 00:21:10.357 "trtype": "$TEST_TRANSPORT", 00:21:10.357 "traddr": "$NVMF_FIRST_TARGET_IP", 00:21:10.357 "adrfam": "ipv4", 00:21:10.357 "trsvcid": "$NVMF_PORT", 00:21:10.357 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:21:10.357 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:21:10.357 "hdgst": ${hdgst:-false}, 00:21:10.357 "ddgst": ${ddgst:-false} 00:21:10.357 }, 00:21:10.357 "method": "bdev_nvme_attach_controller" 00:21:10.357 } 00:21:10.357 EOF 00:21:10.357 )") 00:21:10.357 22:59:01 -- nvmf/common.sh@542 -- # cat 00:21:10.357 22:59:01 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:21:10.357 22:59:01 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:21:10.357 { 00:21:10.357 "params": { 00:21:10.357 "name": "Nvme$subsystem", 00:21:10.357 "trtype": "$TEST_TRANSPORT", 00:21:10.357 "traddr": "$NVMF_FIRST_TARGET_IP", 00:21:10.357 "adrfam": "ipv4", 00:21:10.357 "trsvcid": "$NVMF_PORT", 00:21:10.357 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:21:10.357 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:21:10.357 "hdgst": ${hdgst:-false}, 00:21:10.357 "ddgst": ${ddgst:-false} 00:21:10.357 }, 00:21:10.357 "method": "bdev_nvme_attach_controller" 00:21:10.357 } 00:21:10.357 EOF 00:21:10.357 )") 00:21:10.357 22:59:01 -- nvmf/common.sh@542 -- # cat 00:21:10.357 22:59:01 -- nvmf/common.sh@544 -- # jq . 00:21:10.357 22:59:01 -- nvmf/common.sh@545 -- # IFS=, 00:21:10.357 22:59:01 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:21:10.357 "params": { 00:21:10.357 "name": "Nvme1", 00:21:10.357 "trtype": "tcp", 00:21:10.357 "traddr": "10.0.0.2", 00:21:10.357 "adrfam": "ipv4", 00:21:10.357 "trsvcid": "4420", 00:21:10.357 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:21:10.357 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:21:10.357 "hdgst": false, 00:21:10.357 "ddgst": false 00:21:10.357 }, 00:21:10.357 "method": "bdev_nvme_attach_controller" 00:21:10.357 },{ 00:21:10.357 "params": { 00:21:10.357 "name": "Nvme2", 00:21:10.357 "trtype": "tcp", 00:21:10.357 "traddr": "10.0.0.2", 00:21:10.357 "adrfam": "ipv4", 00:21:10.357 "trsvcid": "4420", 00:21:10.357 "subnqn": "nqn.2016-06.io.spdk:cnode2", 00:21:10.357 "hostnqn": "nqn.2016-06.io.spdk:host2", 00:21:10.357 "hdgst": false, 00:21:10.357 "ddgst": false 00:21:10.357 }, 00:21:10.357 "method": "bdev_nvme_attach_controller" 00:21:10.357 },{ 00:21:10.357 "params": { 00:21:10.357 "name": "Nvme3", 00:21:10.357 "trtype": "tcp", 00:21:10.357 "traddr": "10.0.0.2", 00:21:10.357 "adrfam": "ipv4", 00:21:10.357 "trsvcid": "4420", 00:21:10.357 "subnqn": "nqn.2016-06.io.spdk:cnode3", 00:21:10.357 "hostnqn": "nqn.2016-06.io.spdk:host3", 00:21:10.357 "hdgst": false, 00:21:10.357 "ddgst": false 00:21:10.357 }, 00:21:10.357 "method": "bdev_nvme_attach_controller" 00:21:10.357 },{ 00:21:10.357 "params": { 00:21:10.357 "name": "Nvme4", 00:21:10.357 "trtype": "tcp", 00:21:10.357 "traddr": "10.0.0.2", 00:21:10.357 "adrfam": "ipv4", 00:21:10.357 "trsvcid": "4420", 00:21:10.357 "subnqn": "nqn.2016-06.io.spdk:cnode4", 00:21:10.357 "hostnqn": "nqn.2016-06.io.spdk:host4", 00:21:10.357 "hdgst": false, 00:21:10.357 "ddgst": false 00:21:10.357 }, 00:21:10.357 "method": "bdev_nvme_attach_controller" 00:21:10.357 },{ 00:21:10.357 "params": { 00:21:10.357 "name": "Nvme5", 00:21:10.357 "trtype": "tcp", 00:21:10.357 "traddr": "10.0.0.2", 00:21:10.357 "adrfam": "ipv4", 00:21:10.357 "trsvcid": "4420", 00:21:10.357 "subnqn": "nqn.2016-06.io.spdk:cnode5", 00:21:10.357 "hostnqn": "nqn.2016-06.io.spdk:host5", 00:21:10.357 "hdgst": false, 00:21:10.357 "ddgst": false 00:21:10.357 }, 00:21:10.357 "method": "bdev_nvme_attach_controller" 00:21:10.357 },{ 00:21:10.357 "params": { 00:21:10.357 "name": "Nvme6", 00:21:10.357 "trtype": "tcp", 00:21:10.357 "traddr": "10.0.0.2", 00:21:10.357 "adrfam": "ipv4", 00:21:10.357 "trsvcid": "4420", 00:21:10.357 "subnqn": "nqn.2016-06.io.spdk:cnode6", 00:21:10.357 "hostnqn": "nqn.2016-06.io.spdk:host6", 00:21:10.357 "hdgst": false, 00:21:10.357 "ddgst": false 00:21:10.357 }, 00:21:10.357 "method": "bdev_nvme_attach_controller" 00:21:10.357 },{ 00:21:10.357 "params": { 00:21:10.357 "name": "Nvme7", 00:21:10.357 "trtype": "tcp", 00:21:10.357 "traddr": "10.0.0.2", 00:21:10.357 "adrfam": "ipv4", 00:21:10.357 "trsvcid": "4420", 00:21:10.357 "subnqn": "nqn.2016-06.io.spdk:cnode7", 00:21:10.357 "hostnqn": "nqn.2016-06.io.spdk:host7", 00:21:10.357 "hdgst": false, 00:21:10.357 "ddgst": false 00:21:10.357 }, 00:21:10.357 "method": "bdev_nvme_attach_controller" 00:21:10.357 },{ 00:21:10.357 "params": { 00:21:10.357 "name": "Nvme8", 00:21:10.357 "trtype": "tcp", 00:21:10.357 "traddr": "10.0.0.2", 00:21:10.357 "adrfam": "ipv4", 00:21:10.357 "trsvcid": "4420", 00:21:10.357 "subnqn": "nqn.2016-06.io.spdk:cnode8", 00:21:10.357 "hostnqn": "nqn.2016-06.io.spdk:host8", 00:21:10.357 "hdgst": false, 00:21:10.357 "ddgst": false 00:21:10.357 }, 00:21:10.357 "method": "bdev_nvme_attach_controller" 00:21:10.357 },{ 00:21:10.357 "params": { 00:21:10.357 "name": "Nvme9", 00:21:10.357 "trtype": "tcp", 00:21:10.357 "traddr": "10.0.0.2", 00:21:10.357 "adrfam": "ipv4", 00:21:10.357 "trsvcid": "4420", 00:21:10.357 "subnqn": "nqn.2016-06.io.spdk:cnode9", 00:21:10.357 "hostnqn": "nqn.2016-06.io.spdk:host9", 00:21:10.357 "hdgst": false, 00:21:10.357 "ddgst": false 00:21:10.357 }, 00:21:10.357 "method": "bdev_nvme_attach_controller" 00:21:10.357 },{ 00:21:10.357 "params": { 00:21:10.357 "name": "Nvme10", 00:21:10.357 "trtype": "tcp", 00:21:10.357 "traddr": "10.0.0.2", 00:21:10.357 "adrfam": "ipv4", 00:21:10.357 "trsvcid": "4420", 00:21:10.357 "subnqn": "nqn.2016-06.io.spdk:cnode10", 00:21:10.357 "hostnqn": "nqn.2016-06.io.spdk:host10", 00:21:10.357 "hdgst": false, 00:21:10.357 "ddgst": false 00:21:10.357 }, 00:21:10.357 "method": "bdev_nvme_attach_controller" 00:21:10.357 }' 00:21:10.357 [2024-04-16 22:59:01.208110] Starting SPDK v24.01.1-pre git sha1 4b134b4ab / DPDK 23.11.0 initialization... 00:21:10.357 [2024-04-16 22:59:01.208221] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid335278 ] 00:21:10.357 EAL: No free 2048 kB hugepages reported on node 1 00:21:10.357 [2024-04-16 22:59:01.275524] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:21:10.358 [2024-04-16 22:59:01.384502] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:21:11.731 Running I/O for 1 seconds... 00:21:13.106 00:21:13.106 Latency(us) 00:21:13.106 Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:21:13.106 Job: Nvme1n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:21:13.106 Verification LBA range: start 0x0 length 0x400 00:21:13.106 Nvme1n1 : 1.09 327.08 20.44 0.00 0.00 187377.85 60972.75 139810.13 00:21:13.106 Job: Nvme2n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:21:13.106 Verification LBA range: start 0x0 length 0x400 00:21:13.106 Nvme2n1 : 1.09 326.66 20.42 0.00 0.00 186286.06 60972.75 135149.80 00:21:13.106 Job: Nvme3n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:21:13.106 Verification LBA range: start 0x0 length 0x400 00:21:13.106 Nvme3n1 : 1.09 326.01 20.38 0.00 0.00 185303.67 60972.75 135926.52 00:21:13.106 Job: Nvme4n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:21:13.106 Verification LBA range: start 0x0 length 0x400 00:21:13.106 Nvme4n1 : 1.09 324.83 20.30 0.00 0.00 186827.85 41554.68 164665.27 00:21:13.106 Job: Nvme5n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:21:13.106 Verification LBA range: start 0x0 length 0x400 00:21:13.106 Nvme5n1 : 1.15 345.08 21.57 0.00 0.00 172180.75 11505.21 134373.07 00:21:13.106 Job: Nvme6n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:21:13.106 Verification LBA range: start 0x0 length 0x400 00:21:13.106 Nvme6n1 : 1.10 327.34 20.46 0.00 0.00 182544.77 41748.86 147577.36 00:21:13.106 Job: Nvme7n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:21:13.106 Verification LBA range: start 0x0 length 0x400 00:21:13.106 Nvme7n1 : 1.11 357.07 22.32 0.00 0.00 169860.70 9175.04 134373.07 00:21:13.106 Job: Nvme8n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:21:13.106 Verification LBA range: start 0x0 length 0x400 00:21:13.106 Nvme8n1 : 1.10 323.18 20.20 0.00 0.00 182509.38 38641.97 142140.30 00:21:13.106 Job: Nvme9n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:21:13.106 Verification LBA range: start 0x0 length 0x400 00:21:13.106 Nvme9n1 : 1.16 343.59 21.47 0.00 0.00 168308.72 8932.31 143693.75 00:21:13.106 Job: Nvme10n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:21:13.106 Verification LBA range: start 0x0 length 0x400 00:21:13.106 Nvme10n1 : 1.10 321.72 20.11 0.00 0.00 182258.32 26020.22 144470.47 00:21:13.106 =================================================================================================================== 00:21:13.106 Total : 3322.54 207.66 0.00 0.00 179989.91 8932.31 164665.27 00:21:13.106 22:59:04 -- target/shutdown.sh@93 -- # stoptarget 00:21:13.106 22:59:04 -- target/shutdown.sh@41 -- # rm -f ./local-job0-0-verify.state 00:21:13.106 22:59:04 -- target/shutdown.sh@42 -- # rm -rf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/bdevperf.conf 00:21:13.106 22:59:04 -- target/shutdown.sh@43 -- # rm -rf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/rpcs.txt 00:21:13.106 22:59:04 -- target/shutdown.sh@45 -- # nvmftestfini 00:21:13.106 22:59:04 -- nvmf/common.sh@476 -- # nvmfcleanup 00:21:13.106 22:59:04 -- nvmf/common.sh@116 -- # sync 00:21:13.106 22:59:04 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:21:13.106 22:59:04 -- nvmf/common.sh@119 -- # set +e 00:21:13.106 22:59:04 -- nvmf/common.sh@120 -- # for i in {1..20} 00:21:13.106 22:59:04 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:21:13.106 rmmod nvme_tcp 00:21:13.106 rmmod nvme_fabrics 00:21:13.379 rmmod nvme_keyring 00:21:13.379 22:59:04 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:21:13.379 22:59:04 -- nvmf/common.sh@123 -- # set -e 00:21:13.379 22:59:04 -- nvmf/common.sh@124 -- # return 0 00:21:13.379 22:59:04 -- nvmf/common.sh@477 -- # '[' -n 334651 ']' 00:21:13.379 22:59:04 -- nvmf/common.sh@478 -- # killprocess 334651 00:21:13.379 22:59:04 -- common/autotest_common.sh@926 -- # '[' -z 334651 ']' 00:21:13.379 22:59:04 -- common/autotest_common.sh@930 -- # kill -0 334651 00:21:13.379 22:59:04 -- common/autotest_common.sh@931 -- # uname 00:21:13.379 22:59:04 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:21:13.379 22:59:04 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 334651 00:21:13.379 22:59:04 -- common/autotest_common.sh@932 -- # process_name=reactor_1 00:21:13.379 22:59:04 -- common/autotest_common.sh@936 -- # '[' reactor_1 = sudo ']' 00:21:13.379 22:59:04 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 334651' 00:21:13.379 killing process with pid 334651 00:21:13.379 22:59:04 -- common/autotest_common.sh@945 -- # kill 334651 00:21:13.379 22:59:04 -- common/autotest_common.sh@950 -- # wait 334651 00:21:13.946 22:59:04 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:21:13.946 22:59:04 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:21:13.946 22:59:04 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:21:13.946 22:59:04 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:21:13.946 22:59:04 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:21:13.946 22:59:04 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:21:13.946 22:59:04 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:21:13.946 22:59:04 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:21:15.847 22:59:06 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:21:15.847 00:21:15.847 real 0m12.065s 00:21:15.847 user 0m35.141s 00:21:15.847 sys 0m3.269s 00:21:15.847 22:59:06 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:21:15.847 22:59:06 -- common/autotest_common.sh@10 -- # set +x 00:21:15.847 ************************************ 00:21:15.847 END TEST nvmf_shutdown_tc1 00:21:15.847 ************************************ 00:21:15.847 22:59:06 -- target/shutdown.sh@147 -- # run_test nvmf_shutdown_tc2 nvmf_shutdown_tc2 00:21:15.847 22:59:06 -- common/autotest_common.sh@1077 -- # '[' 2 -le 1 ']' 00:21:15.847 22:59:06 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:21:15.847 22:59:06 -- common/autotest_common.sh@10 -- # set +x 00:21:15.847 ************************************ 00:21:15.847 START TEST nvmf_shutdown_tc2 00:21:15.847 ************************************ 00:21:15.847 22:59:06 -- common/autotest_common.sh@1104 -- # nvmf_shutdown_tc2 00:21:15.847 22:59:06 -- target/shutdown.sh@98 -- # starttarget 00:21:15.847 22:59:06 -- target/shutdown.sh@15 -- # nvmftestinit 00:21:15.847 22:59:06 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:21:15.847 22:59:06 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:21:15.847 22:59:06 -- nvmf/common.sh@436 -- # prepare_net_devs 00:21:15.847 22:59:06 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:21:15.847 22:59:06 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:21:15.847 22:59:06 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:21:15.847 22:59:06 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:21:15.847 22:59:06 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:21:15.847 22:59:06 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:21:15.847 22:59:06 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:21:15.847 22:59:06 -- nvmf/common.sh@284 -- # xtrace_disable 00:21:15.847 22:59:06 -- common/autotest_common.sh@10 -- # set +x 00:21:15.847 22:59:06 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:21:15.847 22:59:06 -- nvmf/common.sh@290 -- # pci_devs=() 00:21:15.847 22:59:06 -- nvmf/common.sh@290 -- # local -a pci_devs 00:21:15.847 22:59:06 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:21:15.847 22:59:06 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:21:15.847 22:59:06 -- nvmf/common.sh@292 -- # pci_drivers=() 00:21:15.847 22:59:06 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:21:15.847 22:59:06 -- nvmf/common.sh@294 -- # net_devs=() 00:21:15.847 22:59:06 -- nvmf/common.sh@294 -- # local -ga net_devs 00:21:15.847 22:59:06 -- nvmf/common.sh@295 -- # e810=() 00:21:15.847 22:59:06 -- nvmf/common.sh@295 -- # local -ga e810 00:21:15.847 22:59:06 -- nvmf/common.sh@296 -- # x722=() 00:21:15.847 22:59:06 -- nvmf/common.sh@296 -- # local -ga x722 00:21:15.847 22:59:06 -- nvmf/common.sh@297 -- # mlx=() 00:21:15.847 22:59:06 -- nvmf/common.sh@297 -- # local -ga mlx 00:21:15.847 22:59:06 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:21:15.847 22:59:06 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:21:15.847 22:59:06 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:21:15.847 22:59:06 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:21:15.847 22:59:06 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:21:15.847 22:59:06 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:21:15.847 22:59:06 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:21:15.847 22:59:06 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:21:15.847 22:59:06 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:21:15.847 22:59:06 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:21:15.847 22:59:06 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:21:15.847 22:59:06 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:21:15.847 22:59:06 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:21:15.847 22:59:06 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:21:15.847 22:59:06 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:21:15.847 22:59:06 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:21:15.847 22:59:06 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:21:15.847 22:59:06 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:21:15.847 22:59:06 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:21:15.847 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:21:15.847 22:59:06 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:21:15.847 22:59:06 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:21:15.847 22:59:06 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:21:15.847 22:59:06 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:21:15.847 22:59:06 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:21:15.847 22:59:06 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:21:15.847 22:59:06 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:21:15.847 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:21:15.847 22:59:06 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:21:15.847 22:59:06 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:21:15.847 22:59:06 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:21:15.847 22:59:06 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:21:15.847 22:59:06 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:21:15.847 22:59:06 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:21:15.847 22:59:06 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:21:15.847 22:59:06 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:21:15.847 22:59:06 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:21:15.847 22:59:06 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:21:15.847 22:59:06 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:21:15.847 22:59:06 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:21:15.847 22:59:06 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:21:15.847 Found net devices under 0000:0a:00.0: cvl_0_0 00:21:15.847 22:59:06 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:21:15.847 22:59:06 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:21:15.847 22:59:06 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:21:15.847 22:59:06 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:21:15.847 22:59:06 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:21:15.847 22:59:06 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:21:15.847 Found net devices under 0000:0a:00.1: cvl_0_1 00:21:15.847 22:59:06 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:21:15.847 22:59:06 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:21:15.847 22:59:06 -- nvmf/common.sh@402 -- # is_hw=yes 00:21:15.847 22:59:06 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:21:15.847 22:59:06 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:21:15.847 22:59:06 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:21:15.847 22:59:06 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:21:15.847 22:59:06 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:21:15.847 22:59:06 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:21:15.847 22:59:06 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:21:15.847 22:59:06 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:21:15.847 22:59:06 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:21:15.847 22:59:06 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:21:15.847 22:59:06 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:21:15.847 22:59:06 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:21:15.847 22:59:06 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:21:15.847 22:59:06 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:21:15.847 22:59:06 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:21:15.847 22:59:06 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:21:16.106 22:59:06 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:21:16.106 22:59:06 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:21:16.106 22:59:06 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:21:16.106 22:59:06 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:21:16.106 22:59:07 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:21:16.106 22:59:07 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:21:16.106 22:59:07 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:21:16.106 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:21:16.106 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.224 ms 00:21:16.106 00:21:16.106 --- 10.0.0.2 ping statistics --- 00:21:16.106 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:21:16.106 rtt min/avg/max/mdev = 0.224/0.224/0.224/0.000 ms 00:21:16.106 22:59:07 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:21:16.106 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:21:16.106 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.129 ms 00:21:16.106 00:21:16.106 --- 10.0.0.1 ping statistics --- 00:21:16.106 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:21:16.106 rtt min/avg/max/mdev = 0.129/0.129/0.129/0.000 ms 00:21:16.106 22:59:07 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:21:16.106 22:59:07 -- nvmf/common.sh@410 -- # return 0 00:21:16.106 22:59:07 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:21:16.106 22:59:07 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:21:16.106 22:59:07 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:21:16.106 22:59:07 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:21:16.106 22:59:07 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:21:16.106 22:59:07 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:21:16.106 22:59:07 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:21:16.106 22:59:07 -- target/shutdown.sh@18 -- # nvmfappstart -m 0x1E 00:21:16.106 22:59:07 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:21:16.106 22:59:07 -- common/autotest_common.sh@712 -- # xtrace_disable 00:21:16.106 22:59:07 -- common/autotest_common.sh@10 -- # set +x 00:21:16.106 22:59:07 -- nvmf/common.sh@469 -- # nvmfpid=336066 00:21:16.106 22:59:07 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x1E 00:21:16.106 22:59:07 -- nvmf/common.sh@470 -- # waitforlisten 336066 00:21:16.106 22:59:07 -- common/autotest_common.sh@819 -- # '[' -z 336066 ']' 00:21:16.106 22:59:07 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk.sock 00:21:16.106 22:59:07 -- common/autotest_common.sh@824 -- # local max_retries=100 00:21:16.106 22:59:07 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:21:16.106 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:21:16.106 22:59:07 -- common/autotest_common.sh@828 -- # xtrace_disable 00:21:16.106 22:59:07 -- common/autotest_common.sh@10 -- # set +x 00:21:16.106 [2024-04-16 22:59:07.111197] Starting SPDK v24.01.1-pre git sha1 4b134b4ab / DPDK 23.11.0 initialization... 00:21:16.106 [2024-04-16 22:59:07.111284] [ DPDK EAL parameters: nvmf -c 0x1E --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:21:16.106 EAL: No free 2048 kB hugepages reported on node 1 00:21:16.106 [2024-04-16 22:59:07.181353] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:21:16.364 [2024-04-16 22:59:07.298260] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:21:16.364 [2024-04-16 22:59:07.298436] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:21:16.364 [2024-04-16 22:59:07.298466] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:21:16.364 [2024-04-16 22:59:07.298496] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:21:16.364 [2024-04-16 22:59:07.298592] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:21:16.364 [2024-04-16 22:59:07.298704] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:21:16.364 [2024-04-16 22:59:07.298771] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 4 00:21:16.364 [2024-04-16 22:59:07.298775] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:21:16.929 22:59:08 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:21:16.929 22:59:08 -- common/autotest_common.sh@852 -- # return 0 00:21:16.929 22:59:08 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:21:16.929 22:59:08 -- common/autotest_common.sh@718 -- # xtrace_disable 00:21:16.929 22:59:08 -- common/autotest_common.sh@10 -- # set +x 00:21:17.188 22:59:08 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:21:17.188 22:59:08 -- target/shutdown.sh@20 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:21:17.188 22:59:08 -- common/autotest_common.sh@551 -- # xtrace_disable 00:21:17.188 22:59:08 -- common/autotest_common.sh@10 -- # set +x 00:21:17.188 [2024-04-16 22:59:08.076668] tcp.c: 659:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:21:17.188 22:59:08 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:21:17.188 22:59:08 -- target/shutdown.sh@22 -- # num_subsystems=({1..10}) 00:21:17.188 22:59:08 -- target/shutdown.sh@24 -- # timing_enter create_subsystems 00:21:17.188 22:59:08 -- common/autotest_common.sh@712 -- # xtrace_disable 00:21:17.188 22:59:08 -- common/autotest_common.sh@10 -- # set +x 00:21:17.188 22:59:08 -- target/shutdown.sh@26 -- # rm -rf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/rpcs.txt 00:21:17.188 22:59:08 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:21:17.188 22:59:08 -- target/shutdown.sh@28 -- # cat 00:21:17.188 22:59:08 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:21:17.188 22:59:08 -- target/shutdown.sh@28 -- # cat 00:21:17.188 22:59:08 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:21:17.188 22:59:08 -- target/shutdown.sh@28 -- # cat 00:21:17.188 22:59:08 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:21:17.188 22:59:08 -- target/shutdown.sh@28 -- # cat 00:21:17.188 22:59:08 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:21:17.188 22:59:08 -- target/shutdown.sh@28 -- # cat 00:21:17.188 22:59:08 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:21:17.188 22:59:08 -- target/shutdown.sh@28 -- # cat 00:21:17.188 22:59:08 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:21:17.188 22:59:08 -- target/shutdown.sh@28 -- # cat 00:21:17.188 22:59:08 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:21:17.188 22:59:08 -- target/shutdown.sh@28 -- # cat 00:21:17.188 22:59:08 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:21:17.188 22:59:08 -- target/shutdown.sh@28 -- # cat 00:21:17.188 22:59:08 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:21:17.188 22:59:08 -- target/shutdown.sh@28 -- # cat 00:21:17.188 22:59:08 -- target/shutdown.sh@35 -- # rpc_cmd 00:21:17.188 22:59:08 -- common/autotest_common.sh@551 -- # xtrace_disable 00:21:17.188 22:59:08 -- common/autotest_common.sh@10 -- # set +x 00:21:17.188 Malloc1 00:21:17.188 [2024-04-16 22:59:08.151829] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:21:17.188 Malloc2 00:21:17.188 Malloc3 00:21:17.188 Malloc4 00:21:17.446 Malloc5 00:21:17.446 Malloc6 00:21:17.446 Malloc7 00:21:17.446 Malloc8 00:21:17.446 Malloc9 00:21:17.446 Malloc10 00:21:17.705 22:59:08 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:21:17.705 22:59:08 -- target/shutdown.sh@36 -- # timing_exit create_subsystems 00:21:17.705 22:59:08 -- common/autotest_common.sh@718 -- # xtrace_disable 00:21:17.705 22:59:08 -- common/autotest_common.sh@10 -- # set +x 00:21:17.705 22:59:08 -- target/shutdown.sh@102 -- # perfpid=336373 00:21:17.705 22:59:08 -- target/shutdown.sh@103 -- # waitforlisten 336373 /var/tmp/bdevperf.sock 00:21:17.705 22:59:08 -- common/autotest_common.sh@819 -- # '[' -z 336373 ']' 00:21:17.705 22:59:08 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:21:17.705 22:59:08 -- target/shutdown.sh@101 -- # gen_nvmf_target_json 1 2 3 4 5 6 7 8 9 10 00:21:17.705 22:59:08 -- target/shutdown.sh@101 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -r /var/tmp/bdevperf.sock --json /dev/fd/63 -q 64 -o 65536 -w verify -t 10 00:21:17.705 22:59:08 -- common/autotest_common.sh@824 -- # local max_retries=100 00:21:17.705 22:59:08 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:21:17.705 22:59:08 -- nvmf/common.sh@520 -- # config=() 00:21:17.705 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:21:17.705 22:59:08 -- nvmf/common.sh@520 -- # local subsystem config 00:21:17.705 22:59:08 -- common/autotest_common.sh@828 -- # xtrace_disable 00:21:17.705 22:59:08 -- common/autotest_common.sh@10 -- # set +x 00:21:17.705 22:59:08 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:21:17.705 22:59:08 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:21:17.705 { 00:21:17.705 "params": { 00:21:17.705 "name": "Nvme$subsystem", 00:21:17.705 "trtype": "$TEST_TRANSPORT", 00:21:17.705 "traddr": "$NVMF_FIRST_TARGET_IP", 00:21:17.705 "adrfam": "ipv4", 00:21:17.705 "trsvcid": "$NVMF_PORT", 00:21:17.705 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:21:17.705 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:21:17.705 "hdgst": ${hdgst:-false}, 00:21:17.705 "ddgst": ${ddgst:-false} 00:21:17.705 }, 00:21:17.705 "method": "bdev_nvme_attach_controller" 00:21:17.705 } 00:21:17.705 EOF 00:21:17.705 )") 00:21:17.705 22:59:08 -- nvmf/common.sh@542 -- # cat 00:21:17.705 22:59:08 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:21:17.705 22:59:08 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:21:17.705 { 00:21:17.705 "params": { 00:21:17.705 "name": "Nvme$subsystem", 00:21:17.705 "trtype": "$TEST_TRANSPORT", 00:21:17.705 "traddr": "$NVMF_FIRST_TARGET_IP", 00:21:17.705 "adrfam": "ipv4", 00:21:17.705 "trsvcid": "$NVMF_PORT", 00:21:17.705 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:21:17.705 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:21:17.705 "hdgst": ${hdgst:-false}, 00:21:17.705 "ddgst": ${ddgst:-false} 00:21:17.705 }, 00:21:17.705 "method": "bdev_nvme_attach_controller" 00:21:17.705 } 00:21:17.705 EOF 00:21:17.705 )") 00:21:17.705 22:59:08 -- nvmf/common.sh@542 -- # cat 00:21:17.705 22:59:08 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:21:17.705 22:59:08 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:21:17.705 { 00:21:17.705 "params": { 00:21:17.705 "name": "Nvme$subsystem", 00:21:17.705 "trtype": "$TEST_TRANSPORT", 00:21:17.705 "traddr": "$NVMF_FIRST_TARGET_IP", 00:21:17.705 "adrfam": "ipv4", 00:21:17.705 "trsvcid": "$NVMF_PORT", 00:21:17.705 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:21:17.705 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:21:17.705 "hdgst": ${hdgst:-false}, 00:21:17.705 "ddgst": ${ddgst:-false} 00:21:17.705 }, 00:21:17.705 "method": "bdev_nvme_attach_controller" 00:21:17.705 } 00:21:17.705 EOF 00:21:17.705 )") 00:21:17.705 22:59:08 -- nvmf/common.sh@542 -- # cat 00:21:17.705 22:59:08 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:21:17.705 22:59:08 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:21:17.705 { 00:21:17.705 "params": { 00:21:17.705 "name": "Nvme$subsystem", 00:21:17.705 "trtype": "$TEST_TRANSPORT", 00:21:17.705 "traddr": "$NVMF_FIRST_TARGET_IP", 00:21:17.705 "adrfam": "ipv4", 00:21:17.705 "trsvcid": "$NVMF_PORT", 00:21:17.705 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:21:17.705 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:21:17.705 "hdgst": ${hdgst:-false}, 00:21:17.705 "ddgst": ${ddgst:-false} 00:21:17.705 }, 00:21:17.705 "method": "bdev_nvme_attach_controller" 00:21:17.705 } 00:21:17.705 EOF 00:21:17.705 )") 00:21:17.705 22:59:08 -- nvmf/common.sh@542 -- # cat 00:21:17.705 22:59:08 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:21:17.705 22:59:08 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:21:17.705 { 00:21:17.705 "params": { 00:21:17.705 "name": "Nvme$subsystem", 00:21:17.705 "trtype": "$TEST_TRANSPORT", 00:21:17.705 "traddr": "$NVMF_FIRST_TARGET_IP", 00:21:17.705 "adrfam": "ipv4", 00:21:17.705 "trsvcid": "$NVMF_PORT", 00:21:17.705 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:21:17.705 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:21:17.705 "hdgst": ${hdgst:-false}, 00:21:17.705 "ddgst": ${ddgst:-false} 00:21:17.705 }, 00:21:17.705 "method": "bdev_nvme_attach_controller" 00:21:17.705 } 00:21:17.705 EOF 00:21:17.705 )") 00:21:17.705 22:59:08 -- nvmf/common.sh@542 -- # cat 00:21:17.705 22:59:08 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:21:17.705 22:59:08 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:21:17.705 { 00:21:17.705 "params": { 00:21:17.705 "name": "Nvme$subsystem", 00:21:17.705 "trtype": "$TEST_TRANSPORT", 00:21:17.705 "traddr": "$NVMF_FIRST_TARGET_IP", 00:21:17.705 "adrfam": "ipv4", 00:21:17.705 "trsvcid": "$NVMF_PORT", 00:21:17.705 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:21:17.705 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:21:17.705 "hdgst": ${hdgst:-false}, 00:21:17.705 "ddgst": ${ddgst:-false} 00:21:17.705 }, 00:21:17.705 "method": "bdev_nvme_attach_controller" 00:21:17.705 } 00:21:17.705 EOF 00:21:17.705 )") 00:21:17.705 22:59:08 -- nvmf/common.sh@542 -- # cat 00:21:17.705 22:59:08 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:21:17.705 22:59:08 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:21:17.705 { 00:21:17.705 "params": { 00:21:17.705 "name": "Nvme$subsystem", 00:21:17.705 "trtype": "$TEST_TRANSPORT", 00:21:17.705 "traddr": "$NVMF_FIRST_TARGET_IP", 00:21:17.705 "adrfam": "ipv4", 00:21:17.705 "trsvcid": "$NVMF_PORT", 00:21:17.705 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:21:17.705 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:21:17.705 "hdgst": ${hdgst:-false}, 00:21:17.705 "ddgst": ${ddgst:-false} 00:21:17.705 }, 00:21:17.705 "method": "bdev_nvme_attach_controller" 00:21:17.705 } 00:21:17.705 EOF 00:21:17.705 )") 00:21:17.705 22:59:08 -- nvmf/common.sh@542 -- # cat 00:21:17.705 22:59:08 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:21:17.705 22:59:08 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:21:17.705 { 00:21:17.705 "params": { 00:21:17.705 "name": "Nvme$subsystem", 00:21:17.705 "trtype": "$TEST_TRANSPORT", 00:21:17.705 "traddr": "$NVMF_FIRST_TARGET_IP", 00:21:17.705 "adrfam": "ipv4", 00:21:17.705 "trsvcid": "$NVMF_PORT", 00:21:17.705 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:21:17.705 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:21:17.705 "hdgst": ${hdgst:-false}, 00:21:17.705 "ddgst": ${ddgst:-false} 00:21:17.705 }, 00:21:17.705 "method": "bdev_nvme_attach_controller" 00:21:17.705 } 00:21:17.705 EOF 00:21:17.705 )") 00:21:17.705 22:59:08 -- nvmf/common.sh@542 -- # cat 00:21:17.705 22:59:08 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:21:17.705 22:59:08 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:21:17.705 { 00:21:17.705 "params": { 00:21:17.705 "name": "Nvme$subsystem", 00:21:17.705 "trtype": "$TEST_TRANSPORT", 00:21:17.705 "traddr": "$NVMF_FIRST_TARGET_IP", 00:21:17.705 "adrfam": "ipv4", 00:21:17.705 "trsvcid": "$NVMF_PORT", 00:21:17.705 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:21:17.705 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:21:17.706 "hdgst": ${hdgst:-false}, 00:21:17.706 "ddgst": ${ddgst:-false} 00:21:17.706 }, 00:21:17.706 "method": "bdev_nvme_attach_controller" 00:21:17.706 } 00:21:17.706 EOF 00:21:17.706 )") 00:21:17.706 22:59:08 -- nvmf/common.sh@542 -- # cat 00:21:17.706 22:59:08 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:21:17.706 22:59:08 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:21:17.706 { 00:21:17.706 "params": { 00:21:17.706 "name": "Nvme$subsystem", 00:21:17.706 "trtype": "$TEST_TRANSPORT", 00:21:17.706 "traddr": "$NVMF_FIRST_TARGET_IP", 00:21:17.706 "adrfam": "ipv4", 00:21:17.706 "trsvcid": "$NVMF_PORT", 00:21:17.706 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:21:17.706 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:21:17.706 "hdgst": ${hdgst:-false}, 00:21:17.706 "ddgst": ${ddgst:-false} 00:21:17.706 }, 00:21:17.706 "method": "bdev_nvme_attach_controller" 00:21:17.706 } 00:21:17.706 EOF 00:21:17.706 )") 00:21:17.706 22:59:08 -- nvmf/common.sh@542 -- # cat 00:21:17.706 22:59:08 -- nvmf/common.sh@544 -- # jq . 00:21:17.706 22:59:08 -- nvmf/common.sh@545 -- # IFS=, 00:21:17.706 22:59:08 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:21:17.706 "params": { 00:21:17.706 "name": "Nvme1", 00:21:17.706 "trtype": "tcp", 00:21:17.706 "traddr": "10.0.0.2", 00:21:17.706 "adrfam": "ipv4", 00:21:17.706 "trsvcid": "4420", 00:21:17.706 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:21:17.706 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:21:17.706 "hdgst": false, 00:21:17.706 "ddgst": false 00:21:17.706 }, 00:21:17.706 "method": "bdev_nvme_attach_controller" 00:21:17.706 },{ 00:21:17.706 "params": { 00:21:17.706 "name": "Nvme2", 00:21:17.706 "trtype": "tcp", 00:21:17.706 "traddr": "10.0.0.2", 00:21:17.706 "adrfam": "ipv4", 00:21:17.706 "trsvcid": "4420", 00:21:17.706 "subnqn": "nqn.2016-06.io.spdk:cnode2", 00:21:17.706 "hostnqn": "nqn.2016-06.io.spdk:host2", 00:21:17.706 "hdgst": false, 00:21:17.706 "ddgst": false 00:21:17.706 }, 00:21:17.706 "method": "bdev_nvme_attach_controller" 00:21:17.706 },{ 00:21:17.706 "params": { 00:21:17.706 "name": "Nvme3", 00:21:17.706 "trtype": "tcp", 00:21:17.706 "traddr": "10.0.0.2", 00:21:17.706 "adrfam": "ipv4", 00:21:17.706 "trsvcid": "4420", 00:21:17.706 "subnqn": "nqn.2016-06.io.spdk:cnode3", 00:21:17.706 "hostnqn": "nqn.2016-06.io.spdk:host3", 00:21:17.706 "hdgst": false, 00:21:17.706 "ddgst": false 00:21:17.706 }, 00:21:17.706 "method": "bdev_nvme_attach_controller" 00:21:17.706 },{ 00:21:17.706 "params": { 00:21:17.706 "name": "Nvme4", 00:21:17.706 "trtype": "tcp", 00:21:17.706 "traddr": "10.0.0.2", 00:21:17.706 "adrfam": "ipv4", 00:21:17.706 "trsvcid": "4420", 00:21:17.706 "subnqn": "nqn.2016-06.io.spdk:cnode4", 00:21:17.706 "hostnqn": "nqn.2016-06.io.spdk:host4", 00:21:17.706 "hdgst": false, 00:21:17.706 "ddgst": false 00:21:17.706 }, 00:21:17.706 "method": "bdev_nvme_attach_controller" 00:21:17.706 },{ 00:21:17.706 "params": { 00:21:17.706 "name": "Nvme5", 00:21:17.706 "trtype": "tcp", 00:21:17.706 "traddr": "10.0.0.2", 00:21:17.706 "adrfam": "ipv4", 00:21:17.706 "trsvcid": "4420", 00:21:17.706 "subnqn": "nqn.2016-06.io.spdk:cnode5", 00:21:17.706 "hostnqn": "nqn.2016-06.io.spdk:host5", 00:21:17.706 "hdgst": false, 00:21:17.706 "ddgst": false 00:21:17.706 }, 00:21:17.706 "method": "bdev_nvme_attach_controller" 00:21:17.706 },{ 00:21:17.706 "params": { 00:21:17.706 "name": "Nvme6", 00:21:17.706 "trtype": "tcp", 00:21:17.706 "traddr": "10.0.0.2", 00:21:17.706 "adrfam": "ipv4", 00:21:17.706 "trsvcid": "4420", 00:21:17.706 "subnqn": "nqn.2016-06.io.spdk:cnode6", 00:21:17.706 "hostnqn": "nqn.2016-06.io.spdk:host6", 00:21:17.706 "hdgst": false, 00:21:17.706 "ddgst": false 00:21:17.706 }, 00:21:17.706 "method": "bdev_nvme_attach_controller" 00:21:17.706 },{ 00:21:17.706 "params": { 00:21:17.706 "name": "Nvme7", 00:21:17.706 "trtype": "tcp", 00:21:17.706 "traddr": "10.0.0.2", 00:21:17.706 "adrfam": "ipv4", 00:21:17.706 "trsvcid": "4420", 00:21:17.706 "subnqn": "nqn.2016-06.io.spdk:cnode7", 00:21:17.706 "hostnqn": "nqn.2016-06.io.spdk:host7", 00:21:17.706 "hdgst": false, 00:21:17.706 "ddgst": false 00:21:17.706 }, 00:21:17.706 "method": "bdev_nvme_attach_controller" 00:21:17.706 },{ 00:21:17.706 "params": { 00:21:17.706 "name": "Nvme8", 00:21:17.706 "trtype": "tcp", 00:21:17.706 "traddr": "10.0.0.2", 00:21:17.706 "adrfam": "ipv4", 00:21:17.706 "trsvcid": "4420", 00:21:17.706 "subnqn": "nqn.2016-06.io.spdk:cnode8", 00:21:17.706 "hostnqn": "nqn.2016-06.io.spdk:host8", 00:21:17.706 "hdgst": false, 00:21:17.706 "ddgst": false 00:21:17.706 }, 00:21:17.706 "method": "bdev_nvme_attach_controller" 00:21:17.706 },{ 00:21:17.706 "params": { 00:21:17.706 "name": "Nvme9", 00:21:17.706 "trtype": "tcp", 00:21:17.706 "traddr": "10.0.0.2", 00:21:17.706 "adrfam": "ipv4", 00:21:17.706 "trsvcid": "4420", 00:21:17.706 "subnqn": "nqn.2016-06.io.spdk:cnode9", 00:21:17.706 "hostnqn": "nqn.2016-06.io.spdk:host9", 00:21:17.706 "hdgst": false, 00:21:17.706 "ddgst": false 00:21:17.706 }, 00:21:17.706 "method": "bdev_nvme_attach_controller" 00:21:17.706 },{ 00:21:17.706 "params": { 00:21:17.706 "name": "Nvme10", 00:21:17.706 "trtype": "tcp", 00:21:17.706 "traddr": "10.0.0.2", 00:21:17.706 "adrfam": "ipv4", 00:21:17.706 "trsvcid": "4420", 00:21:17.706 "subnqn": "nqn.2016-06.io.spdk:cnode10", 00:21:17.706 "hostnqn": "nqn.2016-06.io.spdk:host10", 00:21:17.706 "hdgst": false, 00:21:17.706 "ddgst": false 00:21:17.706 }, 00:21:17.706 "method": "bdev_nvme_attach_controller" 00:21:17.706 }' 00:21:17.706 [2024-04-16 22:59:08.640117] Starting SPDK v24.01.1-pre git sha1 4b134b4ab / DPDK 23.11.0 initialization... 00:21:17.706 [2024-04-16 22:59:08.640233] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid336373 ] 00:21:17.706 EAL: No free 2048 kB hugepages reported on node 1 00:21:17.706 [2024-04-16 22:59:08.702670] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:21:17.706 [2024-04-16 22:59:08.810459] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:21:19.604 Running I/O for 10 seconds... 00:21:20.177 22:59:11 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:21:20.177 22:59:11 -- common/autotest_common.sh@852 -- # return 0 00:21:20.177 22:59:11 -- target/shutdown.sh@104 -- # rpc_cmd -s /var/tmp/bdevperf.sock framework_wait_init 00:21:20.177 22:59:11 -- common/autotest_common.sh@551 -- # xtrace_disable 00:21:20.177 22:59:11 -- common/autotest_common.sh@10 -- # set +x 00:21:20.177 22:59:11 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:21:20.177 22:59:11 -- target/shutdown.sh@106 -- # waitforio /var/tmp/bdevperf.sock Nvme1n1 00:21:20.177 22:59:11 -- target/shutdown.sh@50 -- # '[' -z /var/tmp/bdevperf.sock ']' 00:21:20.177 22:59:11 -- target/shutdown.sh@54 -- # '[' -z Nvme1n1 ']' 00:21:20.177 22:59:11 -- target/shutdown.sh@57 -- # local ret=1 00:21:20.177 22:59:11 -- target/shutdown.sh@58 -- # local i 00:21:20.177 22:59:11 -- target/shutdown.sh@59 -- # (( i = 10 )) 00:21:20.177 22:59:11 -- target/shutdown.sh@59 -- # (( i != 0 )) 00:21:20.177 22:59:11 -- target/shutdown.sh@60 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_get_iostat -b Nvme1n1 00:21:20.177 22:59:11 -- target/shutdown.sh@60 -- # jq -r '.bdevs[0].num_read_ops' 00:21:20.177 22:59:11 -- common/autotest_common.sh@551 -- # xtrace_disable 00:21:20.177 22:59:11 -- common/autotest_common.sh@10 -- # set +x 00:21:20.177 22:59:11 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:21:20.177 22:59:11 -- target/shutdown.sh@60 -- # read_io_count=211 00:21:20.177 22:59:11 -- target/shutdown.sh@63 -- # '[' 211 -ge 100 ']' 00:21:20.177 22:59:11 -- target/shutdown.sh@64 -- # ret=0 00:21:20.177 22:59:11 -- target/shutdown.sh@65 -- # break 00:21:20.177 22:59:11 -- target/shutdown.sh@69 -- # return 0 00:21:20.177 22:59:11 -- target/shutdown.sh@109 -- # killprocess 336373 00:21:20.177 22:59:11 -- common/autotest_common.sh@926 -- # '[' -z 336373 ']' 00:21:20.177 22:59:11 -- common/autotest_common.sh@930 -- # kill -0 336373 00:21:20.177 22:59:11 -- common/autotest_common.sh@931 -- # uname 00:21:20.177 22:59:11 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:21:20.177 22:59:11 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 336373 00:21:20.177 22:59:11 -- common/autotest_common.sh@932 -- # process_name=reactor_0 00:21:20.177 22:59:11 -- common/autotest_common.sh@936 -- # '[' reactor_0 = sudo ']' 00:21:20.177 22:59:11 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 336373' 00:21:20.177 killing process with pid 336373 00:21:20.177 22:59:11 -- common/autotest_common.sh@945 -- # kill 336373 00:21:20.177 22:59:11 -- common/autotest_common.sh@950 -- # wait 336373 00:21:20.177 Received shutdown signal, test time was about 0.758668 seconds 00:21:20.177 00:21:20.177 Latency(us) 00:21:20.177 Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:21:20.177 Job: Nvme1n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:21:20.177 Verification LBA range: start 0x0 length 0x400 00:21:20.177 Nvme1n1 : 0.75 421.21 26.33 0.00 0.00 147913.02 23301.69 118061.89 00:21:20.177 Job: Nvme2n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:21:20.177 Verification LBA range: start 0x0 length 0x400 00:21:20.177 Nvme2n1 : 0.73 373.38 23.34 0.00 0.00 164580.85 23981.32 151460.98 00:21:20.177 Job: Nvme3n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:21:20.177 Verification LBA range: start 0x0 length 0x400 00:21:20.177 Nvme3n1 : 0.75 419.56 26.22 0.00 0.00 145431.82 23981.32 129712.73 00:21:20.177 Job: Nvme4n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:21:20.177 Verification LBA range: start 0x0 length 0x400 00:21:20.177 Nvme4n1 : 0.75 422.11 26.38 0.00 0.00 142965.42 24078.41 114178.28 00:21:20.177 Job: Nvme5n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:21:20.177 Verification LBA range: start 0x0 length 0x400 00:21:20.177 Nvme5n1 : 0.75 418.26 26.14 0.00 0.00 143129.08 20971.52 115731.72 00:21:20.177 Job: Nvme6n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:21:20.177 Verification LBA range: start 0x0 length 0x400 00:21:20.177 Nvme6n1 : 0.74 369.08 23.07 0.00 0.00 158930.87 27962.03 132819.63 00:21:20.177 Job: Nvme7n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:21:20.177 Verification LBA range: start 0x0 length 0x400 00:21:20.177 Nvme7n1 : 0.76 417.09 26.07 0.00 0.00 140640.18 17282.09 117285.17 00:21:20.177 Job: Nvme8n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:21:20.177 Verification LBA range: start 0x0 length 0x400 00:21:20.177 Nvme8n1 : 0.76 415.65 25.98 0.00 0.00 140217.91 16311.18 120392.06 00:21:20.177 Job: Nvme9n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:21:20.177 Verification LBA range: start 0x0 length 0x400 00:21:20.177 Nvme9n1 : 0.72 377.67 23.60 0.00 0.00 151356.21 17767.54 118061.89 00:21:20.177 Job: Nvme10n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:21:20.177 Verification LBA range: start 0x0 length 0x400 00:21:20.178 Nvme10n1 : 0.74 378.04 23.63 0.00 0.00 148123.85 9903.22 121168.78 00:21:20.178 =================================================================================================================== 00:21:20.178 Total : 4012.05 250.75 0.00 0.00 147900.87 9903.22 151460.98 00:21:20.487 22:59:11 -- target/shutdown.sh@112 -- # sleep 1 00:21:21.420 22:59:12 -- target/shutdown.sh@113 -- # kill -0 336066 00:21:21.420 22:59:12 -- target/shutdown.sh@115 -- # stoptarget 00:21:21.420 22:59:12 -- target/shutdown.sh@41 -- # rm -f ./local-job0-0-verify.state 00:21:21.420 22:59:12 -- target/shutdown.sh@42 -- # rm -rf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/bdevperf.conf 00:21:21.420 22:59:12 -- target/shutdown.sh@43 -- # rm -rf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/rpcs.txt 00:21:21.420 22:59:12 -- target/shutdown.sh@45 -- # nvmftestfini 00:21:21.420 22:59:12 -- nvmf/common.sh@476 -- # nvmfcleanup 00:21:21.420 22:59:12 -- nvmf/common.sh@116 -- # sync 00:21:21.420 22:59:12 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:21:21.420 22:59:12 -- nvmf/common.sh@119 -- # set +e 00:21:21.420 22:59:12 -- nvmf/common.sh@120 -- # for i in {1..20} 00:21:21.420 22:59:12 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:21:21.420 rmmod nvme_tcp 00:21:21.420 rmmod nvme_fabrics 00:21:21.678 rmmod nvme_keyring 00:21:21.678 22:59:12 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:21:21.678 22:59:12 -- nvmf/common.sh@123 -- # set -e 00:21:21.678 22:59:12 -- nvmf/common.sh@124 -- # return 0 00:21:21.678 22:59:12 -- nvmf/common.sh@477 -- # '[' -n 336066 ']' 00:21:21.678 22:59:12 -- nvmf/common.sh@478 -- # killprocess 336066 00:21:21.678 22:59:12 -- common/autotest_common.sh@926 -- # '[' -z 336066 ']' 00:21:21.678 22:59:12 -- common/autotest_common.sh@930 -- # kill -0 336066 00:21:21.678 22:59:12 -- common/autotest_common.sh@931 -- # uname 00:21:21.678 22:59:12 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:21:21.678 22:59:12 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 336066 00:21:21.678 22:59:12 -- common/autotest_common.sh@932 -- # process_name=reactor_1 00:21:21.678 22:59:12 -- common/autotest_common.sh@936 -- # '[' reactor_1 = sudo ']' 00:21:21.678 22:59:12 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 336066' 00:21:21.678 killing process with pid 336066 00:21:21.678 22:59:12 -- common/autotest_common.sh@945 -- # kill 336066 00:21:21.678 22:59:12 -- common/autotest_common.sh@950 -- # wait 336066 00:21:22.246 22:59:13 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:21:22.246 22:59:13 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:21:22.246 22:59:13 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:21:22.246 22:59:13 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:21:22.246 22:59:13 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:21:22.246 22:59:13 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:21:22.246 22:59:13 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:21:22.246 22:59:13 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:21:24.155 22:59:15 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:21:24.155 00:21:24.155 real 0m8.272s 00:21:24.155 user 0m25.967s 00:21:24.155 sys 0m1.520s 00:21:24.155 22:59:15 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:21:24.155 22:59:15 -- common/autotest_common.sh@10 -- # set +x 00:21:24.155 ************************************ 00:21:24.155 END TEST nvmf_shutdown_tc2 00:21:24.155 ************************************ 00:21:24.155 22:59:15 -- target/shutdown.sh@148 -- # run_test nvmf_shutdown_tc3 nvmf_shutdown_tc3 00:21:24.155 22:59:15 -- common/autotest_common.sh@1077 -- # '[' 2 -le 1 ']' 00:21:24.155 22:59:15 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:21:24.155 22:59:15 -- common/autotest_common.sh@10 -- # set +x 00:21:24.155 ************************************ 00:21:24.155 START TEST nvmf_shutdown_tc3 00:21:24.155 ************************************ 00:21:24.155 22:59:15 -- common/autotest_common.sh@1104 -- # nvmf_shutdown_tc3 00:21:24.156 22:59:15 -- target/shutdown.sh@120 -- # starttarget 00:21:24.156 22:59:15 -- target/shutdown.sh@15 -- # nvmftestinit 00:21:24.156 22:59:15 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:21:24.156 22:59:15 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:21:24.156 22:59:15 -- nvmf/common.sh@436 -- # prepare_net_devs 00:21:24.156 22:59:15 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:21:24.156 22:59:15 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:21:24.156 22:59:15 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:21:24.156 22:59:15 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:21:24.156 22:59:15 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:21:24.156 22:59:15 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:21:24.156 22:59:15 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:21:24.156 22:59:15 -- nvmf/common.sh@284 -- # xtrace_disable 00:21:24.156 22:59:15 -- common/autotest_common.sh@10 -- # set +x 00:21:24.156 22:59:15 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:21:24.156 22:59:15 -- nvmf/common.sh@290 -- # pci_devs=() 00:21:24.156 22:59:15 -- nvmf/common.sh@290 -- # local -a pci_devs 00:21:24.156 22:59:15 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:21:24.156 22:59:15 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:21:24.156 22:59:15 -- nvmf/common.sh@292 -- # pci_drivers=() 00:21:24.156 22:59:15 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:21:24.156 22:59:15 -- nvmf/common.sh@294 -- # net_devs=() 00:21:24.156 22:59:15 -- nvmf/common.sh@294 -- # local -ga net_devs 00:21:24.156 22:59:15 -- nvmf/common.sh@295 -- # e810=() 00:21:24.156 22:59:15 -- nvmf/common.sh@295 -- # local -ga e810 00:21:24.156 22:59:15 -- nvmf/common.sh@296 -- # x722=() 00:21:24.156 22:59:15 -- nvmf/common.sh@296 -- # local -ga x722 00:21:24.156 22:59:15 -- nvmf/common.sh@297 -- # mlx=() 00:21:24.156 22:59:15 -- nvmf/common.sh@297 -- # local -ga mlx 00:21:24.156 22:59:15 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:21:24.156 22:59:15 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:21:24.156 22:59:15 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:21:24.156 22:59:15 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:21:24.156 22:59:15 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:21:24.156 22:59:15 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:21:24.156 22:59:15 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:21:24.156 22:59:15 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:21:24.156 22:59:15 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:21:24.156 22:59:15 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:21:24.156 22:59:15 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:21:24.156 22:59:15 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:21:24.156 22:59:15 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:21:24.156 22:59:15 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:21:24.156 22:59:15 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:21:24.156 22:59:15 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:21:24.156 22:59:15 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:21:24.156 22:59:15 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:21:24.156 22:59:15 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:21:24.156 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:21:24.156 22:59:15 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:21:24.156 22:59:15 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:21:24.156 22:59:15 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:21:24.156 22:59:15 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:21:24.156 22:59:15 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:21:24.156 22:59:15 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:21:24.156 22:59:15 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:21:24.156 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:21:24.156 22:59:15 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:21:24.156 22:59:15 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:21:24.156 22:59:15 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:21:24.156 22:59:15 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:21:24.156 22:59:15 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:21:24.156 22:59:15 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:21:24.156 22:59:15 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:21:24.156 22:59:15 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:21:24.156 22:59:15 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:21:24.156 22:59:15 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:21:24.156 22:59:15 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:21:24.156 22:59:15 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:21:24.156 22:59:15 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:21:24.156 Found net devices under 0000:0a:00.0: cvl_0_0 00:21:24.156 22:59:15 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:21:24.156 22:59:15 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:21:24.156 22:59:15 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:21:24.156 22:59:15 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:21:24.156 22:59:15 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:21:24.156 22:59:15 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:21:24.156 Found net devices under 0000:0a:00.1: cvl_0_1 00:21:24.156 22:59:15 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:21:24.156 22:59:15 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:21:24.156 22:59:15 -- nvmf/common.sh@402 -- # is_hw=yes 00:21:24.156 22:59:15 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:21:24.156 22:59:15 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:21:24.156 22:59:15 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:21:24.156 22:59:15 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:21:24.156 22:59:15 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:21:24.156 22:59:15 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:21:24.156 22:59:15 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:21:24.156 22:59:15 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:21:24.156 22:59:15 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:21:24.156 22:59:15 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:21:24.156 22:59:15 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:21:24.156 22:59:15 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:21:24.156 22:59:15 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:21:24.156 22:59:15 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:21:24.156 22:59:15 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:21:24.156 22:59:15 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:21:24.156 22:59:15 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:21:24.156 22:59:15 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:21:24.156 22:59:15 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:21:24.156 22:59:15 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:21:24.414 22:59:15 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:21:24.415 22:59:15 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:21:24.415 22:59:15 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:21:24.415 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:21:24.415 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.125 ms 00:21:24.415 00:21:24.415 --- 10.0.0.2 ping statistics --- 00:21:24.415 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:21:24.415 rtt min/avg/max/mdev = 0.125/0.125/0.125/0.000 ms 00:21:24.415 22:59:15 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:21:24.415 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:21:24.415 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.121 ms 00:21:24.415 00:21:24.415 --- 10.0.0.1 ping statistics --- 00:21:24.415 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:21:24.415 rtt min/avg/max/mdev = 0.121/0.121/0.121/0.000 ms 00:21:24.415 22:59:15 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:21:24.415 22:59:15 -- nvmf/common.sh@410 -- # return 0 00:21:24.415 22:59:15 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:21:24.415 22:59:15 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:21:24.415 22:59:15 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:21:24.415 22:59:15 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:21:24.415 22:59:15 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:21:24.415 22:59:15 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:21:24.415 22:59:15 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:21:24.415 22:59:15 -- target/shutdown.sh@18 -- # nvmfappstart -m 0x1E 00:21:24.415 22:59:15 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:21:24.415 22:59:15 -- common/autotest_common.sh@712 -- # xtrace_disable 00:21:24.415 22:59:15 -- common/autotest_common.sh@10 -- # set +x 00:21:24.415 22:59:15 -- nvmf/common.sh@469 -- # nvmfpid=337308 00:21:24.415 22:59:15 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk ip netns exec cvl_0_0_ns_spdk ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x1E 00:21:24.415 22:59:15 -- nvmf/common.sh@470 -- # waitforlisten 337308 00:21:24.415 22:59:15 -- common/autotest_common.sh@819 -- # '[' -z 337308 ']' 00:21:24.415 22:59:15 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk.sock 00:21:24.415 22:59:15 -- common/autotest_common.sh@824 -- # local max_retries=100 00:21:24.415 22:59:15 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:21:24.415 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:21:24.415 22:59:15 -- common/autotest_common.sh@828 -- # xtrace_disable 00:21:24.415 22:59:15 -- common/autotest_common.sh@10 -- # set +x 00:21:24.415 [2024-04-16 22:59:15.380498] Starting SPDK v24.01.1-pre git sha1 4b134b4ab / DPDK 23.11.0 initialization... 00:21:24.415 [2024-04-16 22:59:15.380591] [ DPDK EAL parameters: nvmf -c 0x1E --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:21:24.415 EAL: No free 2048 kB hugepages reported on node 1 00:21:24.415 [2024-04-16 22:59:15.445741] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:21:24.675 [2024-04-16 22:59:15.556852] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:21:24.675 [2024-04-16 22:59:15.557003] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:21:24.675 [2024-04-16 22:59:15.557030] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:21:24.675 [2024-04-16 22:59:15.557051] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:21:24.675 [2024-04-16 22:59:15.557120] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:21:24.675 [2024-04-16 22:59:15.557183] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:21:24.675 [2024-04-16 22:59:15.557242] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 4 00:21:24.675 [2024-04-16 22:59:15.557250] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:21:25.243 22:59:16 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:21:25.243 22:59:16 -- common/autotest_common.sh@852 -- # return 0 00:21:25.243 22:59:16 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:21:25.243 22:59:16 -- common/autotest_common.sh@718 -- # xtrace_disable 00:21:25.243 22:59:16 -- common/autotest_common.sh@10 -- # set +x 00:21:25.243 22:59:16 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:21:25.243 22:59:16 -- target/shutdown.sh@20 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:21:25.243 22:59:16 -- common/autotest_common.sh@551 -- # xtrace_disable 00:21:25.243 22:59:16 -- common/autotest_common.sh@10 -- # set +x 00:21:25.243 [2024-04-16 22:59:16.360656] tcp.c: 659:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:21:25.243 22:59:16 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:21:25.243 22:59:16 -- target/shutdown.sh@22 -- # num_subsystems=({1..10}) 00:21:25.243 22:59:16 -- target/shutdown.sh@24 -- # timing_enter create_subsystems 00:21:25.243 22:59:16 -- common/autotest_common.sh@712 -- # xtrace_disable 00:21:25.243 22:59:16 -- common/autotest_common.sh@10 -- # set +x 00:21:25.500 22:59:16 -- target/shutdown.sh@26 -- # rm -rf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/rpcs.txt 00:21:25.500 22:59:16 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:21:25.500 22:59:16 -- target/shutdown.sh@28 -- # cat 00:21:25.500 22:59:16 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:21:25.500 22:59:16 -- target/shutdown.sh@28 -- # cat 00:21:25.500 22:59:16 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:21:25.500 22:59:16 -- target/shutdown.sh@28 -- # cat 00:21:25.500 22:59:16 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:21:25.500 22:59:16 -- target/shutdown.sh@28 -- # cat 00:21:25.500 22:59:16 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:21:25.500 22:59:16 -- target/shutdown.sh@28 -- # cat 00:21:25.500 22:59:16 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:21:25.500 22:59:16 -- target/shutdown.sh@28 -- # cat 00:21:25.500 22:59:16 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:21:25.500 22:59:16 -- target/shutdown.sh@28 -- # cat 00:21:25.500 22:59:16 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:21:25.500 22:59:16 -- target/shutdown.sh@28 -- # cat 00:21:25.500 22:59:16 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:21:25.500 22:59:16 -- target/shutdown.sh@28 -- # cat 00:21:25.500 22:59:16 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:21:25.500 22:59:16 -- target/shutdown.sh@28 -- # cat 00:21:25.500 22:59:16 -- target/shutdown.sh@35 -- # rpc_cmd 00:21:25.500 22:59:16 -- common/autotest_common.sh@551 -- # xtrace_disable 00:21:25.500 22:59:16 -- common/autotest_common.sh@10 -- # set +x 00:21:25.500 Malloc1 00:21:25.500 [2024-04-16 22:59:16.435600] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:21:25.500 Malloc2 00:21:25.500 Malloc3 00:21:25.500 Malloc4 00:21:25.500 Malloc5 00:21:25.758 Malloc6 00:21:25.758 Malloc7 00:21:25.758 Malloc8 00:21:25.758 Malloc9 00:21:25.758 Malloc10 00:21:25.758 22:59:16 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:21:25.758 22:59:16 -- target/shutdown.sh@36 -- # timing_exit create_subsystems 00:21:25.758 22:59:16 -- common/autotest_common.sh@718 -- # xtrace_disable 00:21:25.758 22:59:16 -- common/autotest_common.sh@10 -- # set +x 00:21:26.018 22:59:16 -- target/shutdown.sh@124 -- # perfpid=337499 00:21:26.018 22:59:16 -- target/shutdown.sh@125 -- # waitforlisten 337499 /var/tmp/bdevperf.sock 00:21:26.018 22:59:16 -- common/autotest_common.sh@819 -- # '[' -z 337499 ']' 00:21:26.018 22:59:16 -- target/shutdown.sh@123 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -r /var/tmp/bdevperf.sock --json /dev/fd/63 -q 64 -o 65536 -w verify -t 10 00:21:26.019 22:59:16 -- target/shutdown.sh@123 -- # gen_nvmf_target_json 1 2 3 4 5 6 7 8 9 10 00:21:26.019 22:59:16 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:21:26.019 22:59:16 -- common/autotest_common.sh@824 -- # local max_retries=100 00:21:26.019 22:59:16 -- nvmf/common.sh@520 -- # config=() 00:21:26.019 22:59:16 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:21:26.019 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:21:26.019 22:59:16 -- nvmf/common.sh@520 -- # local subsystem config 00:21:26.019 22:59:16 -- common/autotest_common.sh@828 -- # xtrace_disable 00:21:26.019 22:59:16 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:21:26.019 22:59:16 -- common/autotest_common.sh@10 -- # set +x 00:21:26.019 22:59:16 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:21:26.019 { 00:21:26.019 "params": { 00:21:26.019 "name": "Nvme$subsystem", 00:21:26.019 "trtype": "$TEST_TRANSPORT", 00:21:26.019 "traddr": "$NVMF_FIRST_TARGET_IP", 00:21:26.019 "adrfam": "ipv4", 00:21:26.019 "trsvcid": "$NVMF_PORT", 00:21:26.019 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:21:26.019 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:21:26.019 "hdgst": ${hdgst:-false}, 00:21:26.019 "ddgst": ${ddgst:-false} 00:21:26.019 }, 00:21:26.019 "method": "bdev_nvme_attach_controller" 00:21:26.019 } 00:21:26.019 EOF 00:21:26.019 )") 00:21:26.019 22:59:16 -- nvmf/common.sh@542 -- # cat 00:21:26.019 22:59:16 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:21:26.019 22:59:16 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:21:26.019 { 00:21:26.019 "params": { 00:21:26.019 "name": "Nvme$subsystem", 00:21:26.019 "trtype": "$TEST_TRANSPORT", 00:21:26.019 "traddr": "$NVMF_FIRST_TARGET_IP", 00:21:26.019 "adrfam": "ipv4", 00:21:26.019 "trsvcid": "$NVMF_PORT", 00:21:26.019 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:21:26.019 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:21:26.019 "hdgst": ${hdgst:-false}, 00:21:26.019 "ddgst": ${ddgst:-false} 00:21:26.019 }, 00:21:26.019 "method": "bdev_nvme_attach_controller" 00:21:26.019 } 00:21:26.019 EOF 00:21:26.019 )") 00:21:26.019 22:59:16 -- nvmf/common.sh@542 -- # cat 00:21:26.019 22:59:16 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:21:26.019 22:59:16 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:21:26.019 { 00:21:26.019 "params": { 00:21:26.019 "name": "Nvme$subsystem", 00:21:26.019 "trtype": "$TEST_TRANSPORT", 00:21:26.019 "traddr": "$NVMF_FIRST_TARGET_IP", 00:21:26.019 "adrfam": "ipv4", 00:21:26.019 "trsvcid": "$NVMF_PORT", 00:21:26.019 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:21:26.019 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:21:26.019 "hdgst": ${hdgst:-false}, 00:21:26.019 "ddgst": ${ddgst:-false} 00:21:26.019 }, 00:21:26.019 "method": "bdev_nvme_attach_controller" 00:21:26.019 } 00:21:26.019 EOF 00:21:26.019 )") 00:21:26.019 22:59:16 -- nvmf/common.sh@542 -- # cat 00:21:26.019 22:59:16 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:21:26.019 22:59:16 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:21:26.019 { 00:21:26.019 "params": { 00:21:26.019 "name": "Nvme$subsystem", 00:21:26.019 "trtype": "$TEST_TRANSPORT", 00:21:26.019 "traddr": "$NVMF_FIRST_TARGET_IP", 00:21:26.019 "adrfam": "ipv4", 00:21:26.019 "trsvcid": "$NVMF_PORT", 00:21:26.019 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:21:26.019 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:21:26.019 "hdgst": ${hdgst:-false}, 00:21:26.019 "ddgst": ${ddgst:-false} 00:21:26.019 }, 00:21:26.019 "method": "bdev_nvme_attach_controller" 00:21:26.019 } 00:21:26.019 EOF 00:21:26.019 )") 00:21:26.019 22:59:16 -- nvmf/common.sh@542 -- # cat 00:21:26.019 22:59:16 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:21:26.019 22:59:16 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:21:26.019 { 00:21:26.019 "params": { 00:21:26.019 "name": "Nvme$subsystem", 00:21:26.019 "trtype": "$TEST_TRANSPORT", 00:21:26.019 "traddr": "$NVMF_FIRST_TARGET_IP", 00:21:26.019 "adrfam": "ipv4", 00:21:26.019 "trsvcid": "$NVMF_PORT", 00:21:26.019 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:21:26.019 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:21:26.019 "hdgst": ${hdgst:-false}, 00:21:26.019 "ddgst": ${ddgst:-false} 00:21:26.019 }, 00:21:26.019 "method": "bdev_nvme_attach_controller" 00:21:26.019 } 00:21:26.019 EOF 00:21:26.019 )") 00:21:26.019 22:59:16 -- nvmf/common.sh@542 -- # cat 00:21:26.019 22:59:16 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:21:26.019 22:59:16 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:21:26.019 { 00:21:26.019 "params": { 00:21:26.019 "name": "Nvme$subsystem", 00:21:26.019 "trtype": "$TEST_TRANSPORT", 00:21:26.019 "traddr": "$NVMF_FIRST_TARGET_IP", 00:21:26.019 "adrfam": "ipv4", 00:21:26.019 "trsvcid": "$NVMF_PORT", 00:21:26.019 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:21:26.019 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:21:26.019 "hdgst": ${hdgst:-false}, 00:21:26.019 "ddgst": ${ddgst:-false} 00:21:26.019 }, 00:21:26.019 "method": "bdev_nvme_attach_controller" 00:21:26.019 } 00:21:26.019 EOF 00:21:26.019 )") 00:21:26.019 22:59:16 -- nvmf/common.sh@542 -- # cat 00:21:26.019 22:59:16 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:21:26.019 22:59:16 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:21:26.019 { 00:21:26.019 "params": { 00:21:26.019 "name": "Nvme$subsystem", 00:21:26.019 "trtype": "$TEST_TRANSPORT", 00:21:26.019 "traddr": "$NVMF_FIRST_TARGET_IP", 00:21:26.019 "adrfam": "ipv4", 00:21:26.019 "trsvcid": "$NVMF_PORT", 00:21:26.019 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:21:26.019 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:21:26.019 "hdgst": ${hdgst:-false}, 00:21:26.019 "ddgst": ${ddgst:-false} 00:21:26.019 }, 00:21:26.019 "method": "bdev_nvme_attach_controller" 00:21:26.019 } 00:21:26.019 EOF 00:21:26.019 )") 00:21:26.019 22:59:16 -- nvmf/common.sh@542 -- # cat 00:21:26.019 22:59:16 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:21:26.019 22:59:16 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:21:26.019 { 00:21:26.019 "params": { 00:21:26.019 "name": "Nvme$subsystem", 00:21:26.019 "trtype": "$TEST_TRANSPORT", 00:21:26.019 "traddr": "$NVMF_FIRST_TARGET_IP", 00:21:26.019 "adrfam": "ipv4", 00:21:26.019 "trsvcid": "$NVMF_PORT", 00:21:26.019 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:21:26.019 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:21:26.019 "hdgst": ${hdgst:-false}, 00:21:26.019 "ddgst": ${ddgst:-false} 00:21:26.019 }, 00:21:26.019 "method": "bdev_nvme_attach_controller" 00:21:26.019 } 00:21:26.019 EOF 00:21:26.019 )") 00:21:26.019 22:59:16 -- nvmf/common.sh@542 -- # cat 00:21:26.019 22:59:16 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:21:26.019 22:59:16 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:21:26.019 { 00:21:26.019 "params": { 00:21:26.019 "name": "Nvme$subsystem", 00:21:26.019 "trtype": "$TEST_TRANSPORT", 00:21:26.019 "traddr": "$NVMF_FIRST_TARGET_IP", 00:21:26.019 "adrfam": "ipv4", 00:21:26.019 "trsvcid": "$NVMF_PORT", 00:21:26.019 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:21:26.019 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:21:26.019 "hdgst": ${hdgst:-false}, 00:21:26.019 "ddgst": ${ddgst:-false} 00:21:26.019 }, 00:21:26.019 "method": "bdev_nvme_attach_controller" 00:21:26.019 } 00:21:26.019 EOF 00:21:26.019 )") 00:21:26.019 22:59:16 -- nvmf/common.sh@542 -- # cat 00:21:26.019 22:59:16 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:21:26.019 22:59:16 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:21:26.019 { 00:21:26.019 "params": { 00:21:26.019 "name": "Nvme$subsystem", 00:21:26.019 "trtype": "$TEST_TRANSPORT", 00:21:26.019 "traddr": "$NVMF_FIRST_TARGET_IP", 00:21:26.019 "adrfam": "ipv4", 00:21:26.019 "trsvcid": "$NVMF_PORT", 00:21:26.019 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:21:26.019 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:21:26.019 "hdgst": ${hdgst:-false}, 00:21:26.019 "ddgst": ${ddgst:-false} 00:21:26.019 }, 00:21:26.019 "method": "bdev_nvme_attach_controller" 00:21:26.019 } 00:21:26.019 EOF 00:21:26.019 )") 00:21:26.019 22:59:16 -- nvmf/common.sh@542 -- # cat 00:21:26.019 22:59:16 -- nvmf/common.sh@544 -- # jq . 00:21:26.019 22:59:16 -- nvmf/common.sh@545 -- # IFS=, 00:21:26.019 22:59:16 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:21:26.019 "params": { 00:21:26.019 "name": "Nvme1", 00:21:26.019 "trtype": "tcp", 00:21:26.019 "traddr": "10.0.0.2", 00:21:26.019 "adrfam": "ipv4", 00:21:26.019 "trsvcid": "4420", 00:21:26.019 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:21:26.019 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:21:26.019 "hdgst": false, 00:21:26.019 "ddgst": false 00:21:26.019 }, 00:21:26.019 "method": "bdev_nvme_attach_controller" 00:21:26.019 },{ 00:21:26.019 "params": { 00:21:26.019 "name": "Nvme2", 00:21:26.019 "trtype": "tcp", 00:21:26.019 "traddr": "10.0.0.2", 00:21:26.019 "adrfam": "ipv4", 00:21:26.019 "trsvcid": "4420", 00:21:26.019 "subnqn": "nqn.2016-06.io.spdk:cnode2", 00:21:26.019 "hostnqn": "nqn.2016-06.io.spdk:host2", 00:21:26.019 "hdgst": false, 00:21:26.019 "ddgst": false 00:21:26.019 }, 00:21:26.019 "method": "bdev_nvme_attach_controller" 00:21:26.019 },{ 00:21:26.019 "params": { 00:21:26.019 "name": "Nvme3", 00:21:26.019 "trtype": "tcp", 00:21:26.019 "traddr": "10.0.0.2", 00:21:26.019 "adrfam": "ipv4", 00:21:26.019 "trsvcid": "4420", 00:21:26.020 "subnqn": "nqn.2016-06.io.spdk:cnode3", 00:21:26.020 "hostnqn": "nqn.2016-06.io.spdk:host3", 00:21:26.020 "hdgst": false, 00:21:26.020 "ddgst": false 00:21:26.020 }, 00:21:26.020 "method": "bdev_nvme_attach_controller" 00:21:26.020 },{ 00:21:26.020 "params": { 00:21:26.020 "name": "Nvme4", 00:21:26.020 "trtype": "tcp", 00:21:26.020 "traddr": "10.0.0.2", 00:21:26.020 "adrfam": "ipv4", 00:21:26.020 "trsvcid": "4420", 00:21:26.020 "subnqn": "nqn.2016-06.io.spdk:cnode4", 00:21:26.020 "hostnqn": "nqn.2016-06.io.spdk:host4", 00:21:26.020 "hdgst": false, 00:21:26.020 "ddgst": false 00:21:26.020 }, 00:21:26.020 "method": "bdev_nvme_attach_controller" 00:21:26.020 },{ 00:21:26.020 "params": { 00:21:26.020 "name": "Nvme5", 00:21:26.020 "trtype": "tcp", 00:21:26.020 "traddr": "10.0.0.2", 00:21:26.020 "adrfam": "ipv4", 00:21:26.020 "trsvcid": "4420", 00:21:26.020 "subnqn": "nqn.2016-06.io.spdk:cnode5", 00:21:26.020 "hostnqn": "nqn.2016-06.io.spdk:host5", 00:21:26.020 "hdgst": false, 00:21:26.020 "ddgst": false 00:21:26.020 }, 00:21:26.020 "method": "bdev_nvme_attach_controller" 00:21:26.020 },{ 00:21:26.020 "params": { 00:21:26.020 "name": "Nvme6", 00:21:26.020 "trtype": "tcp", 00:21:26.020 "traddr": "10.0.0.2", 00:21:26.020 "adrfam": "ipv4", 00:21:26.020 "trsvcid": "4420", 00:21:26.020 "subnqn": "nqn.2016-06.io.spdk:cnode6", 00:21:26.020 "hostnqn": "nqn.2016-06.io.spdk:host6", 00:21:26.020 "hdgst": false, 00:21:26.020 "ddgst": false 00:21:26.020 }, 00:21:26.020 "method": "bdev_nvme_attach_controller" 00:21:26.020 },{ 00:21:26.020 "params": { 00:21:26.020 "name": "Nvme7", 00:21:26.020 "trtype": "tcp", 00:21:26.020 "traddr": "10.0.0.2", 00:21:26.020 "adrfam": "ipv4", 00:21:26.020 "trsvcid": "4420", 00:21:26.020 "subnqn": "nqn.2016-06.io.spdk:cnode7", 00:21:26.020 "hostnqn": "nqn.2016-06.io.spdk:host7", 00:21:26.020 "hdgst": false, 00:21:26.020 "ddgst": false 00:21:26.020 }, 00:21:26.020 "method": "bdev_nvme_attach_controller" 00:21:26.020 },{ 00:21:26.020 "params": { 00:21:26.020 "name": "Nvme8", 00:21:26.020 "trtype": "tcp", 00:21:26.020 "traddr": "10.0.0.2", 00:21:26.020 "adrfam": "ipv4", 00:21:26.020 "trsvcid": "4420", 00:21:26.020 "subnqn": "nqn.2016-06.io.spdk:cnode8", 00:21:26.020 "hostnqn": "nqn.2016-06.io.spdk:host8", 00:21:26.020 "hdgst": false, 00:21:26.020 "ddgst": false 00:21:26.020 }, 00:21:26.020 "method": "bdev_nvme_attach_controller" 00:21:26.020 },{ 00:21:26.020 "params": { 00:21:26.020 "name": "Nvme9", 00:21:26.020 "trtype": "tcp", 00:21:26.020 "traddr": "10.0.0.2", 00:21:26.020 "adrfam": "ipv4", 00:21:26.020 "trsvcid": "4420", 00:21:26.020 "subnqn": "nqn.2016-06.io.spdk:cnode9", 00:21:26.020 "hostnqn": "nqn.2016-06.io.spdk:host9", 00:21:26.020 "hdgst": false, 00:21:26.020 "ddgst": false 00:21:26.020 }, 00:21:26.020 "method": "bdev_nvme_attach_controller" 00:21:26.020 },{ 00:21:26.020 "params": { 00:21:26.020 "name": "Nvme10", 00:21:26.020 "trtype": "tcp", 00:21:26.020 "traddr": "10.0.0.2", 00:21:26.020 "adrfam": "ipv4", 00:21:26.020 "trsvcid": "4420", 00:21:26.020 "subnqn": "nqn.2016-06.io.spdk:cnode10", 00:21:26.020 "hostnqn": "nqn.2016-06.io.spdk:host10", 00:21:26.020 "hdgst": false, 00:21:26.020 "ddgst": false 00:21:26.020 }, 00:21:26.020 "method": "bdev_nvme_attach_controller" 00:21:26.020 }' 00:21:26.020 [2024-04-16 22:59:16.928608] Starting SPDK v24.01.1-pre git sha1 4b134b4ab / DPDK 23.11.0 initialization... 00:21:26.020 [2024-04-16 22:59:16.928679] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid337499 ] 00:21:26.020 EAL: No free 2048 kB hugepages reported on node 1 00:21:26.020 [2024-04-16 22:59:16.991534] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:21:26.020 [2024-04-16 22:59:17.100185] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:21:27.922 Running I/O for 10 seconds... 00:21:28.505 22:59:19 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:21:28.505 22:59:19 -- common/autotest_common.sh@852 -- # return 0 00:21:28.505 22:59:19 -- target/shutdown.sh@126 -- # rpc_cmd -s /var/tmp/bdevperf.sock framework_wait_init 00:21:28.505 22:59:19 -- common/autotest_common.sh@551 -- # xtrace_disable 00:21:28.505 22:59:19 -- common/autotest_common.sh@10 -- # set +x 00:21:28.505 22:59:19 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:21:28.505 22:59:19 -- target/shutdown.sh@129 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; kill -9 $perfpid || true; nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:21:28.505 22:59:19 -- target/shutdown.sh@131 -- # waitforio /var/tmp/bdevperf.sock Nvme1n1 00:21:28.505 22:59:19 -- target/shutdown.sh@50 -- # '[' -z /var/tmp/bdevperf.sock ']' 00:21:28.505 22:59:19 -- target/shutdown.sh@54 -- # '[' -z Nvme1n1 ']' 00:21:28.505 22:59:19 -- target/shutdown.sh@57 -- # local ret=1 00:21:28.505 22:59:19 -- target/shutdown.sh@58 -- # local i 00:21:28.505 22:59:19 -- target/shutdown.sh@59 -- # (( i = 10 )) 00:21:28.505 22:59:19 -- target/shutdown.sh@59 -- # (( i != 0 )) 00:21:28.505 22:59:19 -- target/shutdown.sh@60 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_get_iostat -b Nvme1n1 00:21:28.505 22:59:19 -- common/autotest_common.sh@551 -- # xtrace_disable 00:21:28.505 22:59:19 -- target/shutdown.sh@60 -- # jq -r '.bdevs[0].num_read_ops' 00:21:28.505 22:59:19 -- common/autotest_common.sh@10 -- # set +x 00:21:28.505 22:59:19 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:21:28.505 22:59:19 -- target/shutdown.sh@60 -- # read_io_count=211 00:21:28.505 22:59:19 -- target/shutdown.sh@63 -- # '[' 211 -ge 100 ']' 00:21:28.505 22:59:19 -- target/shutdown.sh@64 -- # ret=0 00:21:28.505 22:59:19 -- target/shutdown.sh@65 -- # break 00:21:28.505 22:59:19 -- target/shutdown.sh@69 -- # return 0 00:21:28.505 22:59:19 -- target/shutdown.sh@134 -- # killprocess 337308 00:21:28.505 22:59:19 -- common/autotest_common.sh@926 -- # '[' -z 337308 ']' 00:21:28.505 22:59:19 -- common/autotest_common.sh@930 -- # kill -0 337308 00:21:28.505 22:59:19 -- common/autotest_common.sh@931 -- # uname 00:21:28.505 22:59:19 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:21:28.505 22:59:19 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 337308 00:21:28.505 22:59:19 -- common/autotest_common.sh@932 -- # process_name=reactor_1 00:21:28.505 22:59:19 -- common/autotest_common.sh@936 -- # '[' reactor_1 = sudo ']' 00:21:28.505 22:59:19 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 337308' 00:21:28.505 killing process with pid 337308 00:21:28.505 22:59:19 -- common/autotest_common.sh@945 -- # kill 337308 00:21:28.505 22:59:19 -- common/autotest_common.sh@950 -- # wait 337308 00:21:28.505 [2024-04-16 22:59:19.460689] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1acec60 is same with the state(5) to be set 00:21:28.505 [2024-04-16 22:59:19.460760] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1acec60 is same with the state(5) to be set 00:21:28.505 [2024-04-16 22:59:19.460775] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1acec60 is same with the state(5) to be set 00:21:28.505 [2024-04-16 22:59:19.460788] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1acec60 is same with the state(5) to be set 00:21:28.505 [2024-04-16 22:59:19.460800] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1acec60 is same with the state(5) to be set 00:21:28.505 [2024-04-16 22:59:19.460813] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1acec60 is same with the state(5) to be set 00:21:28.505 [2024-04-16 22:59:19.460835] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1acec60 is same with the state(5) to be set 00:21:28.505 [2024-04-16 22:59:19.460847] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1acec60 is same with the state(5) to be set 00:21:28.505 [2024-04-16 22:59:19.460859] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1acec60 is same with the state(5) to be set 00:21:28.505 [2024-04-16 22:59:19.460871] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1acec60 is same with the state(5) to be set 00:21:28.505 [2024-04-16 22:59:19.460882] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1acec60 is same with the state(5) to be set 00:21:28.505 [2024-04-16 22:59:19.460894] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1acec60 is same with the state(5) to be set 00:21:28.505 [2024-04-16 22:59:19.460906] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1acec60 is same with the state(5) to be set 00:21:28.505 [2024-04-16 22:59:19.460917] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1acec60 is same with the state(5) to be set 00:21:28.505 [2024-04-16 22:59:19.460929] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1acec60 is same with the state(5) to be set 00:21:28.505 [2024-04-16 22:59:19.460940] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1acec60 is same with the state(5) to be set 00:21:28.505 [2024-04-16 22:59:19.460952] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1acec60 is same with the state(5) to be set 00:21:28.505 [2024-04-16 22:59:19.460963] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1acec60 is same with the state(5) to be set 00:21:28.505 [2024-04-16 22:59:19.460975] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1acec60 is same with the state(5) to be set 00:21:28.505 [2024-04-16 22:59:19.460987] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1acec60 is same with the state(5) to be set 00:21:28.505 [2024-04-16 22:59:19.460999] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1acec60 is same with the state(5) to be set 00:21:28.505 [2024-04-16 22:59:19.461010] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1acec60 is same with the state(5) to be set 00:21:28.505 [2024-04-16 22:59:19.461022] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1acec60 is same with the state(5) to be set 00:21:28.505 [2024-04-16 22:59:19.461034] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1acec60 is same with the state(5) to be set 00:21:28.505 [2024-04-16 22:59:19.461045] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1acec60 is same with the state(5) to be set 00:21:28.505 [2024-04-16 22:59:19.461057] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1acec60 is same with the state(5) to be set 00:21:28.505 [2024-04-16 22:59:19.461069] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1acec60 is same with the state(5) to be set 00:21:28.505 [2024-04-16 22:59:19.461081] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1acec60 is same with the state(5) to be set 00:21:28.505 [2024-04-16 22:59:19.461092] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1acec60 is same with the state(5) to be set 00:21:28.505 [2024-04-16 22:59:19.461104] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1acec60 is same with the state(5) to be set 00:21:28.505 [2024-04-16 22:59:19.461115] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1acec60 is same with the state(5) to be set 00:21:28.505 [2024-04-16 22:59:19.461128] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1acec60 is same with the state(5) to be set 00:21:28.505 [2024-04-16 22:59:19.461140] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1acec60 is same with the state(5) to be set 00:21:28.505 [2024-04-16 22:59:19.461169] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1acec60 is same with the state(5) to be set 00:21:28.505 [2024-04-16 22:59:19.461192] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1acec60 is same with the state(5) to be set 00:21:28.505 [2024-04-16 22:59:19.461205] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1acec60 is same with the state(5) to be set 00:21:28.505 [2024-04-16 22:59:19.461218] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1acec60 is same with the state(5) to be set 00:21:28.505 [2024-04-16 22:59:19.461230] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1acec60 is same with the state(5) to be set 00:21:28.505 [2024-04-16 22:59:19.461243] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1acec60 is same with the state(5) to be set 00:21:28.505 [2024-04-16 22:59:19.461255] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1acec60 is same with the state(5) to be set 00:21:28.505 [2024-04-16 22:59:19.461268] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1acec60 is same with the state(5) to be set 00:21:28.505 [2024-04-16 22:59:19.461280] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1acec60 is same with the state(5) to be set 00:21:28.505 [2024-04-16 22:59:19.461292] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1acec60 is same with the state(5) to be set 00:21:28.505 [2024-04-16 22:59:19.461304] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1acec60 is same with the state(5) to be set 00:21:28.505 [2024-04-16 22:59:19.461317] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1acec60 is same with the state(5) to be set 00:21:28.505 [2024-04-16 22:59:19.461329] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1acec60 is same with the state(5) to be set 00:21:28.505 [2024-04-16 22:59:19.461341] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1acec60 is same with the state(5) to be set 00:21:28.505 [2024-04-16 22:59:19.461353] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1acec60 is same with the state(5) to be set 00:21:28.505 [2024-04-16 22:59:19.461365] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1acec60 is same with the state(5) to be set 00:21:28.505 [2024-04-16 22:59:19.461377] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1acec60 is same with the state(5) to be set 00:21:28.505 [2024-04-16 22:59:19.461389] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1acec60 is same with the state(5) to be set 00:21:28.506 [2024-04-16 22:59:19.461402] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1acec60 is same with the state(5) to be set 00:21:28.506 [2024-04-16 22:59:19.461414] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1acec60 is same with the state(5) to be set 00:21:28.506 [2024-04-16 22:59:19.461427] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1acec60 is same with the state(5) to be set 00:21:28.506 [2024-04-16 22:59:19.461439] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1acec60 is same with the state(5) to be set 00:21:28.506 [2024-04-16 22:59:19.461477] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1acec60 is same with the state(5) to be set 00:21:28.506 [2024-04-16 22:59:19.461489] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1acec60 is same with the state(5) to be set 00:21:28.506 [2024-04-16 22:59:19.461501] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1acec60 is same with the state(5) to be set 00:21:28.506 [2024-04-16 22:59:19.461513] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1acec60 is same with the state(5) to be set 00:21:28.506 [2024-04-16 22:59:19.461526] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1acec60 is same with the state(5) to be set 00:21:28.506 [2024-04-16 22:59:19.461541] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1acec60 is same with the state(5) to be set 00:21:28.506 [2024-04-16 22:59:19.461554] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1acec60 is same with the state(5) to be set 00:21:28.506 [2024-04-16 22:59:19.461565] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1acec60 is same with the state(5) to be set 00:21:28.506 [2024-04-16 22:59:19.462577] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ad14e0 is same with the state(5) to be set 00:21:28.506 [2024-04-16 22:59:19.462610] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ad14e0 is same with the state(5) to be set 00:21:28.506 [2024-04-16 22:59:19.462628] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ad14e0 is same with the state(5) to be set 00:21:28.506 [2024-04-16 22:59:19.462641] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ad14e0 is same with the state(5) to be set 00:21:28.506 [2024-04-16 22:59:19.462654] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ad14e0 is same with the state(5) to be set 00:21:28.506 [2024-04-16 22:59:19.462666] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ad14e0 is same with the state(5) to be set 00:21:28.506 [2024-04-16 22:59:19.462679] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ad14e0 is same with the state(5) to be set 00:21:28.506 [2024-04-16 22:59:19.462692] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ad14e0 is same with the state(5) to be set 00:21:28.506 [2024-04-16 22:59:19.462704] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ad14e0 is same with the state(5) to be set 00:21:28.506 [2024-04-16 22:59:19.462732] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ad14e0 is same with the state(5) to be set 00:21:28.506 [2024-04-16 22:59:19.462745] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ad14e0 is same with the state(5) to be set 00:21:28.506 [2024-04-16 22:59:19.462757] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ad14e0 is same with the state(5) to be set 00:21:28.506 [2024-04-16 22:59:19.462769] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ad14e0 is same with the state(5) to be set 00:21:28.506 [2024-04-16 22:59:19.462781] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ad14e0 is same with the state(5) to be set 00:21:28.506 [2024-04-16 22:59:19.462793] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ad14e0 is same with the state(5) to be set 00:21:28.506 [2024-04-16 22:59:19.462805] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ad14e0 is same with the state(5) to be set 00:21:28.506 [2024-04-16 22:59:19.462817] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ad14e0 is same with the state(5) to be set 00:21:28.506 [2024-04-16 22:59:19.462830] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ad14e0 is same with the state(5) to be set 00:21:28.506 [2024-04-16 22:59:19.462842] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ad14e0 is same with the state(5) to be set 00:21:28.506 [2024-04-16 22:59:19.462854] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ad14e0 is same with the state(5) to be set 00:21:28.506 [2024-04-16 22:59:19.462866] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ad14e0 is same with the state(5) to be set 00:21:28.506 [2024-04-16 22:59:19.462878] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ad14e0 is same with the state(5) to be set 00:21:28.506 [2024-04-16 22:59:19.462889] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ad14e0 is same with the state(5) to be set 00:21:28.506 [2024-04-16 22:59:19.462901] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ad14e0 is same with the state(5) to be set 00:21:28.506 [2024-04-16 22:59:19.462924] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ad14e0 is same with the state(5) to be set 00:21:28.506 [2024-04-16 22:59:19.462937] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ad14e0 is same with the state(5) to be set 00:21:28.506 [2024-04-16 22:59:19.462950] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ad14e0 is same with the state(5) to be set 00:21:28.506 [2024-04-16 22:59:19.462962] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ad14e0 is same with the state(5) to be set 00:21:28.506 [2024-04-16 22:59:19.462974] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ad14e0 is same with the state(5) to be set 00:21:28.506 [2024-04-16 22:59:19.462986] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ad14e0 is same with the state(5) to be set 00:21:28.506 [2024-04-16 22:59:19.462998] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ad14e0 is same with the state(5) to be set 00:21:28.506 [2024-04-16 22:59:19.463010] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ad14e0 is same with the state(5) to be set 00:21:28.506 [2024-04-16 22:59:19.463022] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ad14e0 is same with the state(5) to be set 00:21:28.506 [2024-04-16 22:59:19.463035] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ad14e0 is same with the state(5) to be set 00:21:28.506 [2024-04-16 22:59:19.463047] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ad14e0 is same with the state(5) to be set 00:21:28.506 [2024-04-16 22:59:19.463059] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ad14e0 is same with the state(5) to be set 00:21:28.506 [2024-04-16 22:59:19.463071] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ad14e0 is same with the state(5) to be set 00:21:28.506 [2024-04-16 22:59:19.463084] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ad14e0 is same with the state(5) to be set 00:21:28.506 [2024-04-16 22:59:19.463096] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ad14e0 is same with the state(5) to be set 00:21:28.506 [2024-04-16 22:59:19.463108] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ad14e0 is same with the state(5) to be set 00:21:28.506 [2024-04-16 22:59:19.463120] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ad14e0 is same with the state(5) to be set 00:21:28.506 [2024-04-16 22:59:19.463131] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ad14e0 is same with the state(5) to be set 00:21:28.506 [2024-04-16 22:59:19.463143] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ad14e0 is same with the state(5) to be set 00:21:28.506 [2024-04-16 22:59:19.463155] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ad14e0 is same with the state(5) to be set 00:21:28.506 [2024-04-16 22:59:19.463169] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ad14e0 is same with the state(5) to be set 00:21:28.506 [2024-04-16 22:59:19.463203] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ad14e0 is same with the state(5) to be set 00:21:28.506 [2024-04-16 22:59:19.463217] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ad14e0 is same with the state(5) to be set 00:21:28.506 [2024-04-16 22:59:19.463229] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ad14e0 is same with the state(5) to be set 00:21:28.506 [2024-04-16 22:59:19.463241] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ad14e0 is same with the state(5) to be set 00:21:28.506 [2024-04-16 22:59:19.463254] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ad14e0 is same with the state(5) to be set 00:21:28.506 [2024-04-16 22:59:19.463266] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ad14e0 is same with the state(5) to be set 00:21:28.506 [2024-04-16 22:59:19.463282] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ad14e0 is same with the state(5) to be set 00:21:28.506 [2024-04-16 22:59:19.463295] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ad14e0 is same with the state(5) to be set 00:21:28.506 [2024-04-16 22:59:19.463307] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ad14e0 is same with the state(5) to be set 00:21:28.506 [2024-04-16 22:59:19.463320] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ad14e0 is same with the state(5) to be set 00:21:28.506 [2024-04-16 22:59:19.463332] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ad14e0 is same with the state(5) to be set 00:21:28.506 [2024-04-16 22:59:19.463344] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ad14e0 is same with the state(5) to be set 00:21:28.506 [2024-04-16 22:59:19.463356] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ad14e0 is same with the state(5) to be set 00:21:28.507 [2024-04-16 22:59:19.463369] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ad14e0 is same with the state(5) to be set 00:21:28.507 [2024-04-16 22:59:19.463381] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ad14e0 is same with the state(5) to be set 00:21:28.507 [2024-04-16 22:59:19.463394] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ad14e0 is same with the state(5) to be set 00:21:28.507 [2024-04-16 22:59:19.463406] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ad14e0 is same with the state(5) to be set 00:21:28.507 [2024-04-16 22:59:19.463418] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ad14e0 is same with the state(5) to be set 00:21:28.507 [2024-04-16 22:59:19.463993] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:21:28.507 [2024-04-16 22:59:19.464031] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:21:28.507 [2024-04-16 22:59:19.464049] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:21:28.507 [2024-04-16 22:59:19.464062] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:21:28.507 [2024-04-16 22:59:19.464076] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:21:28.507 [2024-04-16 22:59:19.464090] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:21:28.507 [2024-04-16 22:59:19.464103] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:21:28.507 [2024-04-16 22:59:19.464116] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:21:28.507 [2024-04-16 22:59:19.464129] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xce2210 is same with the state(5) to be set 00:21:28.507 [2024-04-16 22:59:19.469079] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1acf5c0 is same with the state(5) to be set 00:21:28.507 [2024-04-16 22:59:19.469113] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1acf5c0 is same with the state(5) to be set 00:21:28.507 [2024-04-16 22:59:19.469129] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1acf5c0 is same with the state(5) to be set 00:21:28.507 [2024-04-16 22:59:19.469141] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1acf5c0 is same with the state(5) to be set 00:21:28.507 [2024-04-16 22:59:19.469154] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1acf5c0 is same with the state(5) to be set 00:21:28.507 [2024-04-16 22:59:19.469167] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1acf5c0 is same with the state(5) to be set 00:21:28.507 [2024-04-16 22:59:19.469200] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1acf5c0 is same with the state(5) to be set 00:21:28.507 [2024-04-16 22:59:19.469214] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1acf5c0 is same with the state(5) to be set 00:21:28.507 [2024-04-16 22:59:19.469226] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1acf5c0 is same with the state(5) to be set 00:21:28.507 [2024-04-16 22:59:19.469239] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1acf5c0 is same with the state(5) to be set 00:21:28.507 [2024-04-16 22:59:19.469251] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1acf5c0 is same with the state(5) to be set 00:21:28.507 [2024-04-16 22:59:19.469264] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1acf5c0 is same with the state(5) to be set 00:21:28.507 [2024-04-16 22:59:19.469276] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1acf5c0 is same with the state(5) to be set 00:21:28.507 [2024-04-16 22:59:19.469288] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1acf5c0 is same with the state(5) to be set 00:21:28.507 [2024-04-16 22:59:19.469300] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1acf5c0 is same with the state(5) to be set 00:21:28.507 [2024-04-16 22:59:19.469313] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1acf5c0 is same with the state(5) to be set 00:21:28.507 [2024-04-16 22:59:19.469325] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1acf5c0 is same with the state(5) to be set 00:21:28.507 [2024-04-16 22:59:19.469337] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1acf5c0 is same with the state(5) to be set 00:21:28.507 [2024-04-16 22:59:19.469349] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1acf5c0 is same with the state(5) to be set 00:21:28.507 [2024-04-16 22:59:19.469361] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1acf5c0 is same with the state(5) to be set 00:21:28.507 [2024-04-16 22:59:19.469373] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1acf5c0 is same with the state(5) to be set 00:21:28.507 [2024-04-16 22:59:19.469386] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1acf5c0 is same with the state(5) to be set 00:21:28.507 [2024-04-16 22:59:19.469398] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1acf5c0 is same with the state(5) to be set 00:21:28.507 [2024-04-16 22:59:19.469410] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1acf5c0 is same with the state(5) to be set 00:21:28.507 [2024-04-16 22:59:19.469423] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1acf5c0 is same with the state(5) to be set 00:21:28.507 [2024-04-16 22:59:19.469435] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1acf5c0 is same with the state(5) to be set 00:21:28.507 [2024-04-16 22:59:19.469447] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1acf5c0 is same with the state(5) to be set 00:21:28.507 [2024-04-16 22:59:19.469469] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1acf5c0 is same with the state(5) to be set 00:21:28.507 [2024-04-16 22:59:19.469496] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1acf5c0 is same with the state(5) to be set 00:21:28.507 [2024-04-16 22:59:19.469508] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1acf5c0 is same with the state(5) to be set 00:21:28.507 [2024-04-16 22:59:19.469519] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1acf5c0 is same with the state(5) to be set 00:21:28.507 [2024-04-16 22:59:19.469533] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1acf5c0 is same with the state(5) to be set 00:21:28.507 [2024-04-16 22:59:19.469545] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1acf5c0 is same with the state(5) to be set 00:21:28.507 [2024-04-16 22:59:19.469561] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1acf5c0 is same with the state(5) to be set 00:21:28.507 [2024-04-16 22:59:19.469574] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1acf5c0 is same with the state(5) to be set 00:21:28.507 [2024-04-16 22:59:19.469586] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1acf5c0 is same with the state(5) to be set 00:21:28.507 [2024-04-16 22:59:19.469598] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1acf5c0 is same with the state(5) to be set 00:21:28.507 [2024-04-16 22:59:19.469610] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1acf5c0 is same with the state(5) to be set 00:21:28.507 [2024-04-16 22:59:19.469621] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1acf5c0 is same with the state(5) to be set 00:21:28.507 [2024-04-16 22:59:19.469633] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1acf5c0 is same with the state(5) to be set 00:21:28.507 [2024-04-16 22:59:19.469646] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1acf5c0 is same with the state(5) to be set 00:21:28.507 [2024-04-16 22:59:19.469657] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1acf5c0 is same with the state(5) to be set 00:21:28.507 [2024-04-16 22:59:19.469669] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1acf5c0 is same with the state(5) to be set 00:21:28.507 [2024-04-16 22:59:19.469681] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1acf5c0 is same with the state(5) to be set 00:21:28.507 [2024-04-16 22:59:19.469694] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1acf5c0 is same with the state(5) to be set 00:21:28.507 [2024-04-16 22:59:19.469705] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1acf5c0 is same with the state(5) to be set 00:21:28.507 [2024-04-16 22:59:19.469718] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1acf5c0 is same with the state(5) to be set 00:21:28.507 [2024-04-16 22:59:19.469730] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1acf5c0 is same with the state(5) to be set 00:21:28.507 [2024-04-16 22:59:19.469742] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1acf5c0 is same with the state(5) to be set 00:21:28.507 [2024-04-16 22:59:19.469754] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1acf5c0 is same with the state(5) to be set 00:21:28.507 [2024-04-16 22:59:19.469765] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1acf5c0 is same with the state(5) to be set 00:21:28.507 [2024-04-16 22:59:19.469778] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1acf5c0 is same with the state(5) to be set 00:21:28.507 [2024-04-16 22:59:19.469789] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1acf5c0 is same with the state(5) to be set 00:21:28.507 [2024-04-16 22:59:19.469801] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1acf5c0 is same with the state(5) to be set 00:21:28.507 [2024-04-16 22:59:19.469813] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1acf5c0 is same with the state(5) to be set 00:21:28.507 [2024-04-16 22:59:19.469825] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1acf5c0 is same with the state(5) to be set 00:21:28.507 [2024-04-16 22:59:19.469837] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1acf5c0 is same with the state(5) to be set 00:21:28.507 [2024-04-16 22:59:19.469849] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1acf5c0 is same with the state(5) to be set 00:21:28.507 [2024-04-16 22:59:19.469860] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1acf5c0 is same with the state(5) to be set 00:21:28.507 [2024-04-16 22:59:19.469872] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1acf5c0 is same with the state(5) to be set 00:21:28.507 [2024-04-16 22:59:19.469887] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1acf5c0 is same with the state(5) to be set 00:21:28.508 [2024-04-16 22:59:19.469899] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1acf5c0 is same with the state(5) to be set 00:21:28.508 [2024-04-16 22:59:19.469911] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1acf5c0 is same with the state(5) to be set 00:21:28.508 [2024-04-16 22:59:19.470934] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1acfa50 is same with the state(5) to be set 00:21:28.508 [2024-04-16 22:59:19.470971] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1acfa50 is same with the state(5) to be set 00:21:28.508 [2024-04-16 22:59:19.470994] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1acfa50 is same with the state(5) to be set 00:21:28.508 [2024-04-16 22:59:19.471016] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1acfa50 is same with the state(5) to be set 00:21:28.508 [2024-04-16 22:59:19.471037] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1acfa50 is same with the state(5) to be set 00:21:28.508 [2024-04-16 22:59:19.471058] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1acfa50 is same with the state(5) to be set 00:21:28.508 [2024-04-16 22:59:19.471078] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1acfa50 is same with the state(5) to be set 00:21:28.508 [2024-04-16 22:59:19.471098] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1acfa50 is same with the state(5) to be set 00:21:28.508 [2024-04-16 22:59:19.471120] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1acfa50 is same with the state(5) to be set 00:21:28.508 [2024-04-16 22:59:19.471139] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1acfa50 is same with the state(5) to be set 00:21:28.508 [2024-04-16 22:59:19.471170] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1acfa50 is same with the state(5) to be set 00:21:28.508 [2024-04-16 22:59:19.471215] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1acfa50 is same with the state(5) to be set 00:21:28.508 [2024-04-16 22:59:19.471239] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1acfa50 is same with the state(5) to be set 00:21:28.508 [2024-04-16 22:59:19.471260] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1acfa50 is same with the state(5) to be set 00:21:28.508 [2024-04-16 22:59:19.471280] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1acfa50 is same with the state(5) to be set 00:21:28.508 [2024-04-16 22:59:19.471302] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1acfa50 is same with the state(5) to be set 00:21:28.508 [2024-04-16 22:59:19.471322] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1acfa50 is same with the state(5) to be set 00:21:28.508 [2024-04-16 22:59:19.471344] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1acfa50 is same with the state(5) to be set 00:21:28.508 [2024-04-16 22:59:19.471365] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1acfa50 is same with the state(5) to be set 00:21:28.508 [2024-04-16 22:59:19.471385] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1acfa50 is same with the state(5) to be set 00:21:28.508 [2024-04-16 22:59:19.471406] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1acfa50 is same with the state(5) to be set 00:21:28.508 [2024-04-16 22:59:19.471426] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1acfa50 is same with the state(5) to be set 00:21:28.508 [2024-04-16 22:59:19.471449] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1acfa50 is same with the state(5) to be set 00:21:28.508 [2024-04-16 22:59:19.471468] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1acfa50 is same with the state(5) to be set 00:21:28.508 [2024-04-16 22:59:19.471513] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1acfa50 is same with the state(5) to be set 00:21:28.508 [2024-04-16 22:59:19.471535] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1acfa50 is same with the state(5) to be set 00:21:28.508 [2024-04-16 22:59:19.471555] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1acfa50 is same with the state(5) to be set 00:21:28.508 [2024-04-16 22:59:19.471577] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1acfa50 is same with the state(5) to be set 00:21:28.508 [2024-04-16 22:59:19.471597] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1acfa50 is same with the state(5) to be set 00:21:28.508 [2024-04-16 22:59:19.471619] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1acfa50 is same with the state(5) to be set 00:21:28.508 [2024-04-16 22:59:19.471639] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1acfa50 is same with the state(5) to be set 00:21:28.508 [2024-04-16 22:59:19.471659] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1acfa50 is same with the state(5) to be set 00:21:28.508 [2024-04-16 22:59:19.471681] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1acfa50 is same with the state(5) to be set 00:21:28.508 [2024-04-16 22:59:19.471700] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1acfa50 is same with the state(5) to be set 00:21:28.508 [2024-04-16 22:59:19.471723] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1acfa50 is same with the state(5) to be set 00:21:28.508 [2024-04-16 22:59:19.471742] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1acfa50 is same with the state(5) to be set 00:21:28.508 [2024-04-16 22:59:19.471763] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1acfa50 is same with the state(5) to be set 00:21:28.508 [2024-04-16 22:59:19.471783] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1acfa50 is same with the state(5) to be set 00:21:28.508 [2024-04-16 22:59:19.471803] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1acfa50 is same with the state(5) to be set 00:21:28.508 [2024-04-16 22:59:19.471825] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1acfa50 is same with the state(5) to be set 00:21:28.508 [2024-04-16 22:59:19.471845] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1acfa50 is same with the state(5) to be set 00:21:28.508 [2024-04-16 22:59:19.471866] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1acfa50 is same with the state(5) to be set 00:21:28.508 [2024-04-16 22:59:19.471885] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1acfa50 is same with the state(5) to be set 00:21:28.508 [2024-04-16 22:59:19.471906] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1acfa50 is same with the state(5) to be set 00:21:28.508 [2024-04-16 22:59:19.471926] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1acfa50 is same with the state(5) to be set 00:21:28.508 [2024-04-16 22:59:19.471946] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1acfa50 is same with the state(5) to be set 00:21:28.508 [2024-04-16 22:59:19.471967] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1acfa50 is same with the state(5) to be set 00:21:28.508 [2024-04-16 22:59:19.471986] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1acfa50 is same with the state(5) to be set 00:21:28.508 [2024-04-16 22:59:19.472007] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1acfa50 is same with the state(5) to be set 00:21:28.508 [2024-04-16 22:59:19.472028] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1acfa50 is same with the state(5) to be set 00:21:28.508 [2024-04-16 22:59:19.472047] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1acfa50 is same with the state(5) to be set 00:21:28.508 [2024-04-16 22:59:19.472074] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1acfa50 is same with the state(5) to be set 00:21:28.508 [2024-04-16 22:59:19.472094] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1acfa50 is same with the state(5) to be set 00:21:28.508 [2024-04-16 22:59:19.472115] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1acfa50 is same with the state(5) to be set 00:21:28.508 [2024-04-16 22:59:19.472135] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1acfa50 is same with the state(5) to be set 00:21:28.508 [2024-04-16 22:59:19.472157] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1acfa50 is same with the state(5) to be set 00:21:28.508 [2024-04-16 22:59:19.472209] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1acfa50 is same with the state(5) to be set 00:21:28.508 [2024-04-16 22:59:19.472231] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1acfa50 is same with the state(5) to be set 00:21:28.508 [2024-04-16 22:59:19.472254] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1acfa50 is same with the state(5) to be set 00:21:28.508 [2024-04-16 22:59:19.472275] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1acfa50 is same with the state(5) to be set 00:21:28.508 [2024-04-16 22:59:19.472296] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1acfa50 is same with the state(5) to be set 00:21:28.508 [2024-04-16 22:59:19.472318] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1acfa50 is same with the state(5) to be set 00:21:28.508 [2024-04-16 22:59:19.472338] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1acfa50 is same with the state(5) to be set 00:21:28.508 [2024-04-16 22:59:19.473134] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1acff00 is same with the state(5) to be set 00:21:28.508 [2024-04-16 22:59:19.473170] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1acff00 is same with the state(5) to be set 00:21:28.508 [2024-04-16 22:59:19.473205] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1acff00 is same with the state(5) to be set 00:21:28.508 [2024-04-16 22:59:19.473218] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1acff00 is same with the state(5) to be set 00:21:28.508 [2024-04-16 22:59:19.473230] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1acff00 is same with the state(5) to be set 00:21:28.508 [2024-04-16 22:59:19.473242] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1acff00 is same with the state(5) to be set 00:21:28.508 [2024-04-16 22:59:19.473255] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1acff00 is same with the state(5) to be set 00:21:28.508 [2024-04-16 22:59:19.473267] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1acff00 is same with the state(5) to be set 00:21:28.508 [2024-04-16 22:59:19.473279] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1acff00 is same with the state(5) to be set 00:21:28.508 [2024-04-16 22:59:19.473290] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1acff00 is same with the state(5) to be set 00:21:28.508 [2024-04-16 22:59:19.473303] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1acff00 is same with the state(5) to be set 00:21:28.508 [2024-04-16 22:59:19.473315] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1acff00 is same with the state(5) to be set 00:21:28.508 [2024-04-16 22:59:19.473327] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1acff00 is same with the state(5) to be set 00:21:28.509 [2024-04-16 22:59:19.473339] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1acff00 is same with the state(5) to be set 00:21:28.509 [2024-04-16 22:59:19.473351] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1acff00 is same with the state(5) to be set 00:21:28.509 [2024-04-16 22:59:19.473362] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1acff00 is same with the state(5) to be set 00:21:28.509 [2024-04-16 22:59:19.473380] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1acff00 is same with the state(5) to be set 00:21:28.509 [2024-04-16 22:59:19.473392] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1acff00 is same with the state(5) to be set 00:21:28.509 [2024-04-16 22:59:19.473404] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1acff00 is same with the state(5) to be set 00:21:28.509 [2024-04-16 22:59:19.473416] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1acff00 is same with the state(5) to be set 00:21:28.509 [2024-04-16 22:59:19.473427] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1acff00 is same with the state(5) to be set 00:21:28.509 [2024-04-16 22:59:19.473439] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1acff00 is same with the state(5) to be set 00:21:28.509 [2024-04-16 22:59:19.473451] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1acff00 is same with the state(5) to be set 00:21:28.509 [2024-04-16 22:59:19.473463] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1acff00 is same with the state(5) to be set 00:21:28.509 [2024-04-16 22:59:19.473476] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1acff00 is same with the state(5) to be set 00:21:28.509 [2024-04-16 22:59:19.473503] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1acff00 is same with the state(5) to be set 00:21:28.509 [2024-04-16 22:59:19.473515] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1acff00 is same with the state(5) to be set 00:21:28.509 [2024-04-16 22:59:19.473526] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1acff00 is same with the state(5) to be set 00:21:28.509 [2024-04-16 22:59:19.473538] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1acff00 is same with the state(5) to be set 00:21:28.509 [2024-04-16 22:59:19.473549] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1acff00 is same with the state(5) to be set 00:21:28.509 [2024-04-16 22:59:19.473561] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1acff00 is same with the state(5) to be set 00:21:28.509 [2024-04-16 22:59:19.473573] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1acff00 is same with the state(5) to be set 00:21:28.509 [2024-04-16 22:59:19.473584] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1acff00 is same with the state(5) to be set 00:21:28.509 [2024-04-16 22:59:19.473597] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1acff00 is same with the state(5) to be set 00:21:28.509 [2024-04-16 22:59:19.473609] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1acff00 is same with the state(5) to be set 00:21:28.509 [2024-04-16 22:59:19.473621] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1acff00 is same with the state(5) to be set 00:21:28.509 [2024-04-16 22:59:19.473633] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1acff00 is same with the state(5) to be set 00:21:28.509 [2024-04-16 22:59:19.473645] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1acff00 is same with the state(5) to be set 00:21:28.509 [2024-04-16 22:59:19.473657] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1acff00 is same with the state(5) to be set 00:21:28.509 [2024-04-16 22:59:19.473668] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1acff00 is same with the state(5) to be set 00:21:28.509 [2024-04-16 22:59:19.473680] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1acff00 is same with the state(5) to be set 00:21:28.509 [2024-04-16 22:59:19.473692] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1acff00 is same with the state(5) to be set 00:21:28.509 [2024-04-16 22:59:19.473704] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1acff00 is same with the state(5) to be set 00:21:28.509 [2024-04-16 22:59:19.473719] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1acff00 is same with the state(5) to be set 00:21:28.509 [2024-04-16 22:59:19.473731] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1acff00 is same with the state(5) to be set 00:21:28.509 [2024-04-16 22:59:19.473743] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1acff00 is same with the state(5) to be set 00:21:28.509 [2024-04-16 22:59:19.473755] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1acff00 is same with the state(5) to be set 00:21:28.509 [2024-04-16 22:59:19.473767] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1acff00 is same with the state(5) to be set 00:21:28.509 [2024-04-16 22:59:19.473778] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1acff00 is same with the state(5) to be set 00:21:28.509 [2024-04-16 22:59:19.473790] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1acff00 is same with the state(5) to be set 00:21:28.509 [2024-04-16 22:59:19.473802] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1acff00 is same with the state(5) to be set 00:21:28.509 [2024-04-16 22:59:19.473814] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1acff00 is same with the state(5) to be set 00:21:28.509 [2024-04-16 22:59:19.473826] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1acff00 is same with the state(5) to be set 00:21:28.509 [2024-04-16 22:59:19.473838] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1acff00 is same with the state(5) to be set 00:21:28.509 [2024-04-16 22:59:19.473849] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1acff00 is same with the state(5) to be set 00:21:28.509 [2024-04-16 22:59:19.473861] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1acff00 is same with the state(5) to be set 00:21:28.509 [2024-04-16 22:59:19.473872] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1acff00 is same with the state(5) to be set 00:21:28.509 [2024-04-16 22:59:19.473884] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1acff00 is same with the state(5) to be set 00:21:28.509 [2024-04-16 22:59:19.473896] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1acff00 is same with the state(5) to be set 00:21:28.509 [2024-04-16 22:59:19.473908] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1acff00 is same with the state(5) to be set 00:21:28.509 [2024-04-16 22:59:19.473919] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1acff00 is same with the state(5) to be set 00:21:28.509 [2024-04-16 22:59:19.473931] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1acff00 is same with the state(5) to be set 00:21:28.509 [2024-04-16 22:59:19.473943] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1acff00 is same with the state(5) to be set 00:21:28.509 [2024-04-16 22:59:19.474855] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ad03b0 is same with the state(5) to be set 00:21:28.509 [2024-04-16 22:59:19.476435] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ad1030 is same with the state(5) to be set 00:21:28.509 [2024-04-16 22:59:19.476464] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ad1030 is same with the state(5) to be set 00:21:28.509 [2024-04-16 22:59:19.476479] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ad1030 is same with the state(5) to be set 00:21:28.509 [2024-04-16 22:59:19.476491] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ad1030 is same with the state(5) to be set 00:21:28.509 [2024-04-16 22:59:19.476504] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ad1030 is same with the state(5) to be set 00:21:28.509 [2024-04-16 22:59:19.476527] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ad1030 is same with the state(5) to be set 00:21:28.509 [2024-04-16 22:59:19.476544] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ad1030 is same with the state(5) to be set 00:21:28.509 [2024-04-16 22:59:19.476557] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ad1030 is same with the state(5) to be set 00:21:28.509 [2024-04-16 22:59:19.476569] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ad1030 is same with the state(5) to be set 00:21:28.509 [2024-04-16 22:59:19.476581] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ad1030 is same with the state(5) to be set 00:21:28.509 [2024-04-16 22:59:19.476594] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ad1030 is same with the state(5) to be set 00:21:28.509 [2024-04-16 22:59:19.476607] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ad1030 is same with the state(5) to be set 00:21:28.509 [2024-04-16 22:59:19.476619] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ad1030 is same with the state(5) to be set 00:21:28.509 [2024-04-16 22:59:19.476632] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ad1030 is same with the state(5) to be set 00:21:28.509 [2024-04-16 22:59:19.476644] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ad1030 is same with the state(5) to be set 00:21:28.509 [2024-04-16 22:59:19.476656] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ad1030 is same with the state(5) to be set 00:21:28.509 [2024-04-16 22:59:19.476668] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ad1030 is same with the state(5) to be set 00:21:28.509 [2024-04-16 22:59:19.476680] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ad1030 is same with the state(5) to be set 00:21:28.509 [2024-04-16 22:59:19.476693] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ad1030 is same with the state(5) to be set 00:21:28.509 [2024-04-16 22:59:19.476705] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ad1030 is same with the state(5) to be set 00:21:28.509 [2024-04-16 22:59:19.476717] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ad1030 is same with the state(5) to be set 00:21:28.509 [2024-04-16 22:59:19.476729] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ad1030 is same with the state(5) to be set 00:21:28.509 [2024-04-16 22:59:19.476741] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ad1030 is same with the state(5) to be set 00:21:28.509 [2024-04-16 22:59:19.476754] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ad1030 is same with the state(5) to be set 00:21:28.509 [2024-04-16 22:59:19.476781] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ad1030 is same with the state(5) to be set 00:21:28.510 [2024-04-16 22:59:19.476793] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ad1030 is same with the state(5) to be set 00:21:28.510 [2024-04-16 22:59:19.476805] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ad1030 is same with the state(5) to be set 00:21:28.510 [2024-04-16 22:59:19.476817] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ad1030 is same with the state(5) to be set 00:21:28.510 [2024-04-16 22:59:19.476829] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ad1030 is same with the state(5) to be set 00:21:28.510 [2024-04-16 22:59:19.476840] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ad1030 is same with the state(5) to be set 00:21:28.510 [2024-04-16 22:59:19.476852] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ad1030 is same with the state(5) to be set 00:21:28.510 [2024-04-16 22:59:19.476864] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ad1030 is same with the state(5) to be set 00:21:28.510 [2024-04-16 22:59:19.476876] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ad1030 is same with the state(5) to be set 00:21:28.510 [2024-04-16 22:59:19.476891] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ad1030 is same with the state(5) to be set 00:21:28.510 [2024-04-16 22:59:19.476905] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ad1030 is same with the state(5) to be set 00:21:28.510 [2024-04-16 22:59:19.476917] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ad1030 is same with the state(5) to be set 00:21:28.510 [2024-04-16 22:59:19.476928] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ad1030 is same with the state(5) to be set 00:21:28.510 [2024-04-16 22:59:19.476940] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ad1030 is same with the state(5) to be set 00:21:28.510 [2024-04-16 22:59:19.476952] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ad1030 is same with the state(5) to be set 00:21:28.510 [2024-04-16 22:59:19.476964] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ad1030 is same with the state(5) to be set 00:21:28.510 [2024-04-16 22:59:19.476976] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ad1030 is same with the state(5) to be set 00:21:28.510 [2024-04-16 22:59:19.476988] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ad1030 is same with the state(5) to be set 00:21:28.510 [2024-04-16 22:59:19.477000] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ad1030 is same with the state(5) to be set 00:21:28.510 [2024-04-16 22:59:19.477011] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ad1030 is same with the state(5) to be set 00:21:28.510 [2024-04-16 22:59:19.477023] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ad1030 is same with the state(5) to be set 00:21:28.510 [2024-04-16 22:59:19.477035] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ad1030 is same with the state(5) to be set 00:21:28.510 [2024-04-16 22:59:19.477046] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ad1030 is same with the state(5) to be set 00:21:28.510 [2024-04-16 22:59:19.477058] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ad1030 is same with the state(5) to be set 00:21:28.510 [2024-04-16 22:59:19.477069] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ad1030 is same with the state(5) to be set 00:21:28.510 [2024-04-16 22:59:19.477081] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ad1030 is same with the state(5) to be set 00:21:28.510 [2024-04-16 22:59:19.477093] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ad1030 is same with the state(5) to be set 00:21:28.510 [2024-04-16 22:59:19.477105] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ad1030 is same with the state(5) to be set 00:21:28.510 [2024-04-16 22:59:19.477116] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ad1030 is same with the state(5) to be set 00:21:28.510 [2024-04-16 22:59:19.477128] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ad1030 is same with the state(5) to be set 00:21:28.510 [2024-04-16 22:59:19.477140] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ad1030 is same with the state(5) to be set 00:21:28.510 [2024-04-16 22:59:19.477152] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ad1030 is same with the state(5) to be set 00:21:28.510 [2024-04-16 22:59:19.477166] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ad1030 is same with the state(5) to be set 00:21:28.510 [2024-04-16 22:59:19.477199] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ad1030 is same with the state(5) to be set 00:21:28.510 [2024-04-16 22:59:19.477229] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ad1030 is same with the state(5) to be set 00:21:28.510 [2024-04-16 22:59:19.477244] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ad1030 is same with the state(5) to be set 00:21:28.510 [2024-04-16 22:59:19.477260] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ad1030 is same with the state(5) to be set 00:21:28.510 [2024-04-16 22:59:19.477272] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ad1030 is same with the state(5) to be set 00:21:28.510 [2024-04-16 22:59:19.477284] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ad1030 is same with the state(5) to be set 00:21:28.510 [2024-04-16 22:59:19.483533] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:21:28.510 [2024-04-16 22:59:19.483581] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:21:28.510 [2024-04-16 22:59:19.483599] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:21:28.510 [2024-04-16 22:59:19.483613] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:21:28.510 [2024-04-16 22:59:19.483627] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:21:28.510 [2024-04-16 22:59:19.483640] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:21:28.510 [2024-04-16 22:59:19.483653] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:21:28.510 [2024-04-16 22:59:19.483666] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:21:28.510 [2024-04-16 22:59:19.483679] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe66830 is same with the state(5) to be set 00:21:28.510 [2024-04-16 22:59:19.483736] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:21:28.510 [2024-04-16 22:59:19.483756] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:21:28.510 [2024-04-16 22:59:19.483771] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:21:28.510 [2024-04-16 22:59:19.483784] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:21:28.510 [2024-04-16 22:59:19.483798] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:21:28.510 [2024-04-16 22:59:19.483810] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:21:28.510 [2024-04-16 22:59:19.483824] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:21:28.510 [2024-04-16 22:59:19.483837] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:21:28.510 [2024-04-16 22:59:19.483850] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd1d4f0 is same with the state(5) to be set 00:21:28.510 [2024-04-16 22:59:19.483898] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:21:28.511 [2024-04-16 22:59:19.483918] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:21:28.511 [2024-04-16 22:59:19.483933] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:21:28.511 [2024-04-16 22:59:19.483947] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:21:28.511 [2024-04-16 22:59:19.483961] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:21:28.511 [2024-04-16 22:59:19.483987] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:21:28.511 [2024-04-16 22:59:19.484002] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:21:28.511 [2024-04-16 22:59:19.484015] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:21:28.511 [2024-04-16 22:59:19.484027] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xcdba30 is same with the state(5) to be set 00:21:28.511 [2024-04-16 22:59:19.484059] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xce2210 (9): Bad file descriptor 00:21:28.511 [2024-04-16 22:59:19.484111] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:21:28.511 [2024-04-16 22:59:19.484131] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:21:28.511 [2024-04-16 22:59:19.484146] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:21:28.511 [2024-04-16 22:59:19.484168] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:21:28.511 [2024-04-16 22:59:19.484190] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:21:28.511 [2024-04-16 22:59:19.484204] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:21:28.511 [2024-04-16 22:59:19.484218] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:21:28.511 [2024-04-16 22:59:19.484231] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:21:28.511 [2024-04-16 22:59:19.484244] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xea8a60 is same with the state(5) to be set 00:21:28.511 [2024-04-16 22:59:19.484289] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:21:28.511 [2024-04-16 22:59:19.484314] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:21:28.511 [2024-04-16 22:59:19.484338] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:21:28.511 [2024-04-16 22:59:19.484361] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:21:28.511 [2024-04-16 22:59:19.484385] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:21:28.511 [2024-04-16 22:59:19.484398] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:21:28.511 [2024-04-16 22:59:19.484412] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:21:28.511 [2024-04-16 22:59:19.484425] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:21:28.511 [2024-04-16 22:59:19.484437] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xce4f70 is same with the state(5) to be set 00:21:28.511 [2024-04-16 22:59:19.484493] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:21:28.511 [2024-04-16 22:59:19.484513] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:21:28.511 [2024-04-16 22:59:19.484533] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:21:28.511 [2024-04-16 22:59:19.484547] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:21:28.511 [2024-04-16 22:59:19.484561] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:21:28.511 [2024-04-16 22:59:19.484574] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:21:28.511 [2024-04-16 22:59:19.484588] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:21:28.511 [2024-04-16 22:59:19.484601] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:21:28.511 [2024-04-16 22:59:19.484614] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc45a50 is same with the state(5) to be set 00:21:28.511 [2024-04-16 22:59:19.484658] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:21:28.511 [2024-04-16 22:59:19.484678] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:21:28.511 [2024-04-16 22:59:19.484693] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:21:28.511 [2024-04-16 22:59:19.484706] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:21:28.511 [2024-04-16 22:59:19.484720] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:21:28.511 [2024-04-16 22:59:19.484733] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:21:28.511 [2024-04-16 22:59:19.484746] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:21:28.511 [2024-04-16 22:59:19.484759] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:21:28.511 [2024-04-16 22:59:19.484772] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xcdbe60 is same with the state(5) to be set 00:21:28.511 [2024-04-16 22:59:19.484817] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:21:28.511 [2024-04-16 22:59:19.484837] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:21:28.511 [2024-04-16 22:59:19.484852] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:21:28.511 [2024-04-16 22:59:19.484865] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:21:28.511 [2024-04-16 22:59:19.484879] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:21:28.511 [2024-04-16 22:59:19.484892] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:21:28.511 [2024-04-16 22:59:19.484906] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:21:28.511 [2024-04-16 22:59:19.484919] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:21:28.511 [2024-04-16 22:59:19.484931] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xea3490 is same with the state(5) to be set 00:21:28.511 [2024-04-16 22:59:19.484975] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:21:28.511 [2024-04-16 22:59:19.485002] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:21:28.511 [2024-04-16 22:59:19.485017] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:21:28.511 [2024-04-16 22:59:19.485031] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:21:28.511 [2024-04-16 22:59:19.485044] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:21:28.511 [2024-04-16 22:59:19.485057] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:21:28.511 [2024-04-16 22:59:19.485070] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:21:28.511 [2024-04-16 22:59:19.485083] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:21:28.511 [2024-04-16 22:59:19.485095] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xea38c0 is same with the state(5) to be set 00:21:28.511 [2024-04-16 22:59:19.485191] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:34816 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:28.511 [2024-04-16 22:59:19.485219] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:21:28.511 [2024-04-16 22:59:19.485245] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:34944 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:28.511 [2024-04-16 22:59:19.485262] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:21:28.511 [2024-04-16 22:59:19.485279] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:35072 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:28.511 [2024-04-16 22:59:19.485293] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:21:28.511 [2024-04-16 22:59:19.485308] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:35200 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:28.511 [2024-04-16 22:59:19.485322] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:21:28.511 [2024-04-16 22:59:19.485337] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:6 nsid:1 lba:35328 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:28.511 [2024-04-16 22:59:19.485351] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:21:28.511 [2024-04-16 22:59:19.485367] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:16 nsid:1 lba:35456 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:28.511 [2024-04-16 22:59:19.485381] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:21:28.511 [2024-04-16 22:59:19.485396] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:29184 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:28.511 [2024-04-16 22:59:19.485410] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:21:28.511 [2024-04-16 22:59:19.485425] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:29440 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:28.511 [2024-04-16 22:59:19.485439] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:21:28.511 [2024-04-16 22:59:19.485465] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:29696 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:28.511 [2024-04-16 22:59:19.485483] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:21:28.512 [2024-04-16 22:59:19.485499] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:29824 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:28.512 [2024-04-16 22:59:19.485514] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:21:28.512 [2024-04-16 22:59:19.485529] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:29952 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:28.512 [2024-04-16 22:59:19.485543] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:21:28.512 [2024-04-16 22:59:19.485559] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:21 nsid:1 lba:30592 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:28.512 [2024-04-16 22:59:19.485572] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:21:28.512 [2024-04-16 22:59:19.485588] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:24 nsid:1 lba:30720 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:28.512 [2024-04-16 22:59:19.485602] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:21:28.512 [2024-04-16 22:59:19.485617] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:40 nsid:1 lba:31488 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:28.512 [2024-04-16 22:59:19.485630] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:21:28.512 [2024-04-16 22:59:19.485646] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:23 nsid:1 lba:35584 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:28.512 [2024-04-16 22:59:19.485660] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:21:28.512 [2024-04-16 22:59:19.485675] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:32 nsid:1 lba:35712 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:28.512 [2024-04-16 22:59:19.485688] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:21:28.512 [2024-04-16 22:59:19.485704] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:45 nsid:1 lba:35840 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:28.512 [2024-04-16 22:59:19.485718] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:21:28.512 [2024-04-16 22:59:19.485734] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:34 nsid:1 lba:35968 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:28.512 [2024-04-16 22:59:19.485747] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:21:28.512 [2024-04-16 22:59:19.485763] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:35 nsid:1 lba:36096 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:28.512 [2024-04-16 22:59:19.485776] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:21:28.512 [2024-04-16 22:59:19.485791] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:37 nsid:1 lba:36224 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:28.512 [2024-04-16 22:59:19.485805] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:21:28.512 [2024-04-16 22:59:19.485821] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:38 nsid:1 lba:36352 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:28.512 [2024-04-16 22:59:19.485834] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:21:28.512 [2024-04-16 22:59:19.485853] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:20 nsid:1 lba:36480 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:28.512 [2024-04-16 22:59:19.485867] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:21:28.512 [2024-04-16 22:59:19.485882] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:14 nsid:1 lba:36608 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:28.512 [2024-04-16 22:59:19.485896] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:21:28.512 [2024-04-16 22:59:19.485912] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:36736 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:28.512 [2024-04-16 22:59:19.485925] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:21:28.512 [2024-04-16 22:59:19.485941] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:33 nsid:1 lba:36864 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:28.512 [2024-04-16 22:59:19.485955] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:21:28.512 [2024-04-16 22:59:19.485970] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:25 nsid:1 lba:36992 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:28.512 [2024-04-16 22:59:19.485984] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:21:28.512 [2024-04-16 22:59:19.485999] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:17 nsid:1 lba:37120 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:28.512 [2024-04-16 22:59:19.486012] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:21:28.512 [2024-04-16 22:59:19.486028] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:19 nsid:1 lba:37248 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:28.512 [2024-04-16 22:59:19.486042] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:21:28.512 [2024-04-16 22:59:19.486058] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:46 nsid:1 lba:37376 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:28.512 [2024-04-16 22:59:19.486073] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:21:28.512 [2024-04-16 22:59:19.486089] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:29 nsid:1 lba:37504 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:28.512 [2024-04-16 22:59:19.486103] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:21:28.512 [2024-04-16 22:59:19.486119] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:31 nsid:1 lba:37632 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:28.512 [2024-04-16 22:59:19.486132] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:21:28.512 [2024-04-16 22:59:19.486148] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:49 nsid:1 lba:37760 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:28.512 [2024-04-16 22:59:19.486167] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:21:28.512 [2024-04-16 22:59:19.486198] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:51 nsid:1 lba:37888 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:28.512 [2024-04-16 22:59:19.486218] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:21:28.512 [2024-04-16 22:59:19.486236] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:59 nsid:1 lba:38016 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:28.512 [2024-04-16 22:59:19.486254] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:21:28.512 [2024-04-16 22:59:19.486271] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:26 nsid:1 lba:38144 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:28.512 [2024-04-16 22:59:19.486285] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:21:28.512 [2024-04-16 22:59:19.486301] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:38272 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:28.512 [2024-04-16 22:59:19.486315] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:21:28.512 [2024-04-16 22:59:19.486331] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:8 nsid:1 lba:38400 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:28.512 [2024-04-16 22:59:19.486345] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:21:28.512 [2024-04-16 22:59:19.486361] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:30 nsid:1 lba:38528 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:28.512 [2024-04-16 22:59:19.486374] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:21:28.512 [2024-04-16 22:59:19.486390] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:18 nsid:1 lba:38656 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:28.512 [2024-04-16 22:59:19.486404] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:21:28.512 [2024-04-16 22:59:19.486420] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:44 nsid:1 lba:38784 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:28.512 [2024-04-16 22:59:19.486434] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:21:28.512 [2024-04-16 22:59:19.486449] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:47 nsid:1 lba:38912 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:28.512 [2024-04-16 22:59:19.486472] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:21:28.512 [2024-04-16 22:59:19.486488] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:43 nsid:1 lba:39040 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:28.512 [2024-04-16 22:59:19.486501] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:21:28.512 [2024-04-16 22:59:19.486517] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:54 nsid:1 lba:39168 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:28.512 [2024-04-16 22:59:19.486530] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:21:28.512 [2024-04-16 22:59:19.486546] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:42 nsid:1 lba:39296 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:28.512 [2024-04-16 22:59:19.486559] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:21:28.512 [2024-04-16 22:59:19.486575] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:28 nsid:1 lba:31872 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:28.512 [2024-04-16 22:59:19.486589] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:21:28.513 [2024-04-16 22:59:19.486605] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:61 nsid:1 lba:32256 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:28.513 [2024-04-16 22:59:19.486619] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:21:28.513 [2024-04-16 22:59:19.486638] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:62 nsid:1 lba:32512 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:28.513 [2024-04-16 22:59:19.486663] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:21:28.513 [2024-04-16 22:59:19.486679] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:48 nsid:1 lba:32640 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:28.513 [2024-04-16 22:59:19.486693] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:21:28.513 [2024-04-16 22:59:19.486709] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:13 nsid:1 lba:39424 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:28.513 [2024-04-16 22:59:19.486723] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:21:28.513 [2024-04-16 22:59:19.486739] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:41 nsid:1 lba:39552 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:28.513 [2024-04-16 22:59:19.486753] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:21:28.513 [2024-04-16 22:59:19.486768] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:55 nsid:1 lba:32768 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:28.513 [2024-04-16 22:59:19.486782] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:21:28.513 [2024-04-16 22:59:19.486798] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:58 nsid:1 lba:32896 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:28.513 [2024-04-16 22:59:19.486823] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:21:28.513 [2024-04-16 22:59:19.486838] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:63 nsid:1 lba:33024 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:28.513 [2024-04-16 22:59:19.486852] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:21:28.513 [2024-04-16 22:59:19.486868] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:53 nsid:1 lba:33408 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:28.513 [2024-04-16 22:59:19.486882] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:21:28.513 [2024-04-16 22:59:19.486898] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:22 nsid:1 lba:39680 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:28.513 [2024-04-16 22:59:19.486911] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:21:28.513 [2024-04-16 22:59:19.486927] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:36 nsid:1 lba:39808 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:28.513 [2024-04-16 22:59:19.486940] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:21:28.513 [2024-04-16 22:59:19.486956] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:27 nsid:1 lba:33664 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:28.513 [2024-04-16 22:59:19.486971] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:21:28.513 [2024-04-16 22:59:19.486986] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:50 nsid:1 lba:33920 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:28.513 [2024-04-16 22:59:19.487000] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:21:28.513 [2024-04-16 22:59:19.487016] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:52 nsid:1 lba:34304 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:28.513 [2024-04-16 22:59:19.487033] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:21:28.513 [2024-04-16 22:59:19.487050] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:39 nsid:1 lba:34560 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:28.513 [2024-04-16 22:59:19.487064] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:21:28.513 [2024-04-16 22:59:19.487080] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:60 nsid:1 lba:34688 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:28.513 [2024-04-16 22:59:19.487102] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:21:28.513 [2024-04-16 22:59:19.487118] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:57 nsid:1 lba:39936 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:28.513 [2024-04-16 22:59:19.487132] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:21:28.513 [2024-04-16 22:59:19.487148] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:40064 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:28.513 [2024-04-16 22:59:19.487173] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:21:28.513 [2024-04-16 22:59:19.487197] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:56 nsid:1 lba:40192 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:28.513 [2024-04-16 22:59:19.487212] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:21:28.513 [2024-04-16 22:59:19.487333] bdev_nvme.c:1576:bdev_nvme_disconnected_qpair_cb: *NOTICE*: qpair 0xe59f40 was disconnected and freed. reset controller. 00:21:28.513 [2024-04-16 22:59:19.487403] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:34816 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:28.513 [2024-04-16 22:59:19.487425] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:21:28.513 [2024-04-16 22:59:19.487446] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:34944 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:28.513 [2024-04-16 22:59:19.487462] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:21:28.513 [2024-04-16 22:59:19.487483] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:35072 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:28.513 [2024-04-16 22:59:19.487498] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:21:28.513 [2024-04-16 22:59:19.487513] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:35200 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:28.513 [2024-04-16 22:59:19.487527] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:21:28.513 [2024-04-16 22:59:19.487548] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:29184 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:28.513 [2024-04-16 22:59:19.487562] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:21:28.513 [2024-04-16 22:59:19.487578] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:29440 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:28.513 [2024-04-16 22:59:19.487592] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:21:28.513 [2024-04-16 22:59:19.487608] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:29696 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:28.513 [2024-04-16 22:59:19.487627] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:21:28.513 [2024-04-16 22:59:19.487644] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:29824 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:28.513 [2024-04-16 22:59:19.487659] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:21:28.513 [2024-04-16 22:59:19.487675] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:29952 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:28.513 [2024-04-16 22:59:19.487689] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:21:28.513 [2024-04-16 22:59:19.487705] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:17 nsid:1 lba:30592 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:28.513 [2024-04-16 22:59:19.487722] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:21:28.513 [2024-04-16 22:59:19.487737] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:23 nsid:1 lba:30720 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:28.513 [2024-04-16 22:59:19.487751] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:21:28.513 [2024-04-16 22:59:19.487767] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:18 nsid:1 lba:31488 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:28.513 [2024-04-16 22:59:19.487782] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:21:28.513 [2024-04-16 22:59:19.487799] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:39 nsid:1 lba:31872 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:28.513 [2024-04-16 22:59:19.487813] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:21:28.513 [2024-04-16 22:59:19.487838] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:42 nsid:1 lba:32256 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:28.513 [2024-04-16 22:59:19.487852] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:21:28.513 [2024-04-16 22:59:19.487867] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:19 nsid:1 lba:32512 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:28.513 [2024-04-16 22:59:19.487882] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:21:28.513 [2024-04-16 22:59:19.487898] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:38 nsid:1 lba:32640 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:28.513 [2024-04-16 22:59:19.487914] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:21:28.513 [2024-04-16 22:59:19.487930] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:32 nsid:1 lba:32768 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:28.513 [2024-04-16 22:59:19.487945] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:21:28.513 [2024-04-16 22:59:19.487960] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:48 nsid:1 lba:32896 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:28.513 [2024-04-16 22:59:19.487974] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:21:28.513 [2024-04-16 22:59:19.487990] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:51 nsid:1 lba:33024 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:28.513 [2024-04-16 22:59:19.488004] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:21:28.513 [2024-04-16 22:59:19.488021] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:54 nsid:1 lba:33408 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:28.513 [2024-04-16 22:59:19.488038] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:21:28.513 [2024-04-16 22:59:19.488055] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:6 nsid:1 lba:35328 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:28.514 [2024-04-16 22:59:19.488069] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:21:28.514 [2024-04-16 22:59:19.488085] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:35456 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:28.514 [2024-04-16 22:59:19.488099] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:21:28.514 [2024-04-16 22:59:19.488115] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:35584 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:28.514 [2024-04-16 22:59:19.488130] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:21:28.514 [2024-04-16 22:59:19.488146] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:29 nsid:1 lba:35712 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:28.514 [2024-04-16 22:59:19.488170] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:21:28.514 [2024-04-16 22:59:19.488197] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:61 nsid:1 lba:33664 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:28.514 [2024-04-16 22:59:19.488224] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:21:28.514 [2024-04-16 22:59:19.488240] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:37 nsid:1 lba:35840 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:28.514 [2024-04-16 22:59:19.488254] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:21:28.514 [2024-04-16 22:59:19.488270] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:21 nsid:1 lba:35968 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:28.514 [2024-04-16 22:59:19.488289] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:21:28.514 [2024-04-16 22:59:19.488306] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:46 nsid:1 lba:33920 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:28.514 [2024-04-16 22:59:19.488321] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:21:28.514 [2024-04-16 22:59:19.488337] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:26 nsid:1 lba:36096 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:28.514 [2024-04-16 22:59:19.488351] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:21:28.514 [2024-04-16 22:59:19.488367] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:53 nsid:1 lba:34304 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:28.514 [2024-04-16 22:59:19.488381] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:21:28.514 [2024-04-16 22:59:19.488408] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:30 nsid:1 lba:36224 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:28.514 [2024-04-16 22:59:19.488422] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:21:28.514 [2024-04-16 22:59:19.488437] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:31 nsid:1 lba:36352 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:28.514 [2024-04-16 22:59:19.488452] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:21:28.514 [2024-04-16 22:59:19.488472] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:62 nsid:1 lba:34560 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:28.514 [2024-04-16 22:59:19.488487] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:21:28.514 [2024-04-16 22:59:19.488503] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:43 nsid:1 lba:36480 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:28.514 [2024-04-16 22:59:19.488517] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:21:28.514 [2024-04-16 22:59:19.488545] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:63 nsid:1 lba:34688 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:28.514 [2024-04-16 22:59:19.488559] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:21:28.514 [2024-04-16 22:59:19.488575] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:40 nsid:1 lba:36608 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:28.514 [2024-04-16 22:59:19.488589] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:21:28.514 [2024-04-16 22:59:19.488605] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:33 nsid:1 lba:36736 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:28.514 [2024-04-16 22:59:19.488619] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:21:28.514 [2024-04-16 22:59:19.488636] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:50 nsid:1 lba:36864 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:28.514 [2024-04-16 22:59:19.488652] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:21:28.514 [2024-04-16 22:59:19.488669] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:41 nsid:1 lba:36992 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:28.514 [2024-04-16 22:59:19.488683] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:21:28.514 [2024-04-16 22:59:19.488699] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:4 nsid:1 lba:37120 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:28.514 [2024-04-16 22:59:19.488724] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:21:28.514 [2024-04-16 22:59:19.488741] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:44 nsid:1 lba:37248 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:28.514 [2024-04-16 22:59:19.488755] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:21:28.514 [2024-04-16 22:59:19.488770] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:57 nsid:1 lba:37376 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:28.514 [2024-04-16 22:59:19.488784] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:21:28.514 [2024-04-16 22:59:19.488800] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:45 nsid:1 lba:37504 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:28.514 [2024-04-16 22:59:19.488814] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:21:28.514 [2024-04-16 22:59:19.488833] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:37632 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:28.514 [2024-04-16 22:59:19.488847] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:21:28.514 [2024-04-16 22:59:19.488864] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:9 nsid:1 lba:37760 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:28.514 [2024-04-16 22:59:19.488881] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:21:28.514 [2024-04-16 22:59:19.488898] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:47 nsid:1 lba:37888 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:28.514 [2024-04-16 22:59:19.488912] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:21:28.514 [2024-04-16 22:59:19.488930] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:22 nsid:1 lba:38016 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:28.514 [2024-04-16 22:59:19.488945] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:21:28.514 [2024-04-16 22:59:19.488961] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:25 nsid:1 lba:38144 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:28.514 [2024-04-16 22:59:19.488975] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:21:28.514 [2024-04-16 22:59:19.488991] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:27 nsid:1 lba:38272 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:28.514 [2024-04-16 22:59:19.489005] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:21:28.514 [2024-04-16 22:59:19.489020] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:20 nsid:1 lba:38400 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:28.514 [2024-04-16 22:59:19.489034] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:21:28.515 [2024-04-16 22:59:19.489050] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:24 nsid:1 lba:38528 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:28.515 [2024-04-16 22:59:19.489065] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:21:28.515 [2024-04-16 22:59:19.489081] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:16 nsid:1 lba:38656 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:28.515 [2024-04-16 22:59:19.489095] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:21:28.515 [2024-04-16 22:59:19.489111] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:36 nsid:1 lba:38784 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:28.515 [2024-04-16 22:59:19.489124] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:21:28.515 [2024-04-16 22:59:19.489141] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:28 nsid:1 lba:38912 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:28.515 [2024-04-16 22:59:19.489154] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:21:28.515 [2024-04-16 22:59:19.489171] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:34 nsid:1 lba:39040 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:28.515 [2024-04-16 22:59:19.489194] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:21:28.515 [2024-04-16 22:59:19.489211] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:35 nsid:1 lba:39168 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:28.515 [2024-04-16 22:59:19.489227] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:21:28.515 [2024-04-16 22:59:19.489244] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:39296 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:28.515 [2024-04-16 22:59:19.489258] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:21:28.515 [2024-04-16 22:59:19.489278] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:49 nsid:1 lba:39424 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:28.515 [2024-04-16 22:59:19.489293] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:21:28.515 [2024-04-16 22:59:19.489308] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:59 nsid:1 lba:39552 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:28.515 [2024-04-16 22:59:19.489322] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:21:28.515 [2024-04-16 22:59:19.489337] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:60 nsid:1 lba:39680 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:28.515 [2024-04-16 22:59:19.489351] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:21:28.515 [2024-04-16 22:59:19.489366] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:58 nsid:1 lba:39808 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:28.515 [2024-04-16 22:59:19.489380] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:21:28.515 [2024-04-16 22:59:19.489395] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:52 nsid:1 lba:39936 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:28.515 [2024-04-16 22:59:19.489409] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:21:28.515 [2024-04-16 22:59:19.489424] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:55 nsid:1 lba:40064 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:28.515 [2024-04-16 22:59:19.489437] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:21:28.515 [2024-04-16 22:59:19.489453] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:56 nsid:1 lba:40192 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:28.515 [2024-04-16 22:59:19.489476] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:21:28.515 [2024-04-16 22:59:19.489491] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xcd1e70 is same with the state(5) to be set 00:21:28.515 [2024-04-16 22:59:19.489574] bdev_nvme.c:1576:bdev_nvme_disconnected_qpair_cb: *NOTICE*: qpair 0xcd1e70 was disconnected and freed. reset controller. 00:21:28.515 [2024-04-16 22:59:19.489637] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:34816 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:28.515 [2024-04-16 22:59:19.489657] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:21:28.515 [2024-04-16 22:59:19.489677] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:4 nsid:1 lba:34944 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:28.515 [2024-04-16 22:59:19.489693] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:21:28.515 [2024-04-16 22:59:19.489709] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:35072 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:28.515 [2024-04-16 22:59:19.489725] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:21:28.515 [2024-04-16 22:59:19.489740] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:35200 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:28.515 [2024-04-16 22:59:19.489754] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:21:28.515 [2024-04-16 22:59:19.489771] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:6 nsid:1 lba:35328 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:28.515 [2024-04-16 22:59:19.489789] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:21:28.515 [2024-04-16 22:59:19.489820] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:29184 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:28.515 [2024-04-16 22:59:19.489836] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:21:28.515 [2024-04-16 22:59:19.489852] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:29440 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:28.515 [2024-04-16 22:59:19.489865] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:21:28.515 [2024-04-16 22:59:19.489881] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:29696 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:28.515 [2024-04-16 22:59:19.489895] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:21:28.515 [2024-04-16 22:59:19.489910] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:29824 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:28.515 [2024-04-16 22:59:19.489924] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:21:28.515 [2024-04-16 22:59:19.489939] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:17 nsid:1 lba:29952 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:28.515 [2024-04-16 22:59:19.489953] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:21:28.515 [2024-04-16 22:59:19.489968] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:39 nsid:1 lba:30592 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:28.515 [2024-04-16 22:59:19.489981] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:21:28.515 [2024-04-16 22:59:19.489997] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:43 nsid:1 lba:30720 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:28.515 [2024-04-16 22:59:19.490011] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:21:28.515 [2024-04-16 22:59:19.490026] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:31488 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:28.515 [2024-04-16 22:59:19.490040] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:21:28.515 [2024-04-16 22:59:19.490055] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:16 nsid:1 lba:35456 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:28.515 [2024-04-16 22:59:19.490069] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:21:28.515 [2024-04-16 22:59:19.490084] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:23 nsid:1 lba:35584 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:28.515 [2024-04-16 22:59:19.490098] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:21:28.515 [2024-04-16 22:59:19.490115] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:32 nsid:1 lba:35712 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:28.515 [2024-04-16 22:59:19.490129] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:21:28.515 [2024-04-16 22:59:19.490144] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:31 nsid:1 lba:35840 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:28.515 [2024-04-16 22:59:19.490158] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:21:28.515 [2024-04-16 22:59:19.490206] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:62 nsid:1 lba:35968 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:28.515 [2024-04-16 22:59:19.490225] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:21:28.515 [2024-04-16 22:59:19.490242] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:14 nsid:1 lba:36096 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:28.515 [2024-04-16 22:59:19.490256] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:21:28.515 [2024-04-16 22:59:19.490271] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:18 nsid:1 lba:36224 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:28.515 [2024-04-16 22:59:19.490285] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:21:28.515 [2024-04-16 22:59:19.490301] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:33 nsid:1 lba:36352 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:28.515 [2024-04-16 22:59:19.490314] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:21:28.515 [2024-04-16 22:59:19.490336] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:10 nsid:1 lba:36480 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:28.515 [2024-04-16 22:59:19.490350] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:21:28.515 [2024-04-16 22:59:19.490365] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:45 nsid:1 lba:36608 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:28.515 [2024-04-16 22:59:19.490379] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:21:28.515 [2024-04-16 22:59:19.490395] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:47 nsid:1 lba:36736 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:28.515 [2024-04-16 22:59:19.490408] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:21:28.515 [2024-04-16 22:59:19.490424] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:52 nsid:1 lba:36864 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:28.516 [2024-04-16 22:59:19.490437] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:21:28.516 [2024-04-16 22:59:19.490452] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:34 nsid:1 lba:36992 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:28.516 [2024-04-16 22:59:19.490466] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:21:28.516 [2024-04-16 22:59:19.490481] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:35 nsid:1 lba:37120 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:28.516 [2024-04-16 22:59:19.490495] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:21:28.516 [2024-04-16 22:59:19.490510] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:37 nsid:1 lba:37248 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:28.516 [2024-04-16 22:59:19.490531] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:21:28.516 [2024-04-16 22:59:19.490546] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:38 nsid:1 lba:37376 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:28.516 [2024-04-16 22:59:19.502574] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:21:28.516 [2024-04-16 22:59:19.502642] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:50 nsid:1 lba:37504 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:28.516 [2024-04-16 22:59:19.502669] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:21:28.516 [2024-04-16 22:59:19.502687] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:19 nsid:1 lba:37632 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:28.516 [2024-04-16 22:59:19.502702] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:21:28.516 [2024-04-16 22:59:19.502718] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:20 nsid:1 lba:37760 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:28.516 [2024-04-16 22:59:19.502732] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:21:28.516 [2024-04-16 22:59:19.502747] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:24 nsid:1 lba:37888 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:28.516 [2024-04-16 22:59:19.502760] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:21:28.516 [2024-04-16 22:59:19.502776] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:28 nsid:1 lba:38016 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:28.516 [2024-04-16 22:59:19.502789] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:21:28.516 [2024-04-16 22:59:19.502805] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:38144 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:28.516 [2024-04-16 22:59:19.502820] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:21:28.516 [2024-04-16 22:59:19.502837] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:54 nsid:1 lba:38272 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:28.516 [2024-04-16 22:59:19.502851] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:21:28.516 [2024-04-16 22:59:19.502867] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:12 nsid:1 lba:38400 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:28.516 [2024-04-16 22:59:19.502881] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:21:28.516 [2024-04-16 22:59:19.502898] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:59 nsid:1 lba:38528 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:28.516 [2024-04-16 22:59:19.502912] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:21:28.516 [2024-04-16 22:59:19.502927] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:61 nsid:1 lba:38656 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:28.516 [2024-04-16 22:59:19.502941] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:21:28.516 [2024-04-16 22:59:19.502956] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:40 nsid:1 lba:38784 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:28.516 [2024-04-16 22:59:19.502970] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:21:28.516 [2024-04-16 22:59:19.502985] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:25 nsid:1 lba:38912 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:28.516 [2024-04-16 22:59:19.502999] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:21:28.516 [2024-04-16 22:59:19.503014] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:56 nsid:1 lba:39040 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:28.516 [2024-04-16 22:59:19.503028] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:21:28.516 [2024-04-16 22:59:19.503047] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:29 nsid:1 lba:39168 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:28.516 [2024-04-16 22:59:19.503062] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:21:28.516 [2024-04-16 22:59:19.503078] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:48 nsid:1 lba:39296 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:28.516 [2024-04-16 22:59:19.503091] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:21:28.516 [2024-04-16 22:59:19.503109] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:46 nsid:1 lba:31872 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:28.516 [2024-04-16 22:59:19.503123] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:21:28.516 [2024-04-16 22:59:19.503139] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:42 nsid:1 lba:32256 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:28.516 [2024-04-16 22:59:19.503153] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:21:28.516 [2024-04-16 22:59:19.503188] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:55 nsid:1 lba:32512 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:28.516 [2024-04-16 22:59:19.503214] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:21:28.516 [2024-04-16 22:59:19.503234] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:58 nsid:1 lba:32640 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:28.516 [2024-04-16 22:59:19.503250] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:21:28.516 [2024-04-16 22:59:19.503266] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:63 nsid:1 lba:32768 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:28.516 [2024-04-16 22:59:19.503279] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:21:28.516 [2024-04-16 22:59:19.503297] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:26 nsid:1 lba:32896 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:28.516 [2024-04-16 22:59:19.503312] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:21:28.516 [2024-04-16 22:59:19.503328] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:30 nsid:1 lba:33024 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:28.516 [2024-04-16 22:59:19.503341] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:21:28.516 [2024-04-16 22:59:19.503357] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:49 nsid:1 lba:33408 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:28.516 [2024-04-16 22:59:19.503372] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:21:28.516 [2024-04-16 22:59:19.503389] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:41 nsid:1 lba:39424 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:28.516 [2024-04-16 22:59:19.503403] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:21:28.516 [2024-04-16 22:59:19.503418] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:21 nsid:1 lba:39552 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:28.516 [2024-04-16 22:59:19.503431] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:21:28.516 [2024-04-16 22:59:19.503446] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:60 nsid:1 lba:33664 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:28.516 [2024-04-16 22:59:19.503469] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:21:28.516 [2024-04-16 22:59:19.503495] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:44 nsid:1 lba:33920 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:28.516 [2024-04-16 22:59:19.503509] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:21:28.516 [2024-04-16 22:59:19.503524] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:22 nsid:1 lba:34304 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:28.516 [2024-04-16 22:59:19.503538] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:21:28.516 [2024-04-16 22:59:19.503554] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:36 nsid:1 lba:34560 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:28.516 [2024-04-16 22:59:19.503567] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:21:28.516 [2024-04-16 22:59:19.503583] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:57 nsid:1 lba:34688 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:28.516 [2024-04-16 22:59:19.503596] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:21:28.516 [2024-04-16 22:59:19.503615] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:51 nsid:1 lba:39680 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:28.516 [2024-04-16 22:59:19.503629] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:21:28.516 [2024-04-16 22:59:19.503644] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:39808 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:28.517 [2024-04-16 22:59:19.503658] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:21:28.517 [2024-04-16 22:59:19.503674] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:13 nsid:1 lba:39936 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:28.517 [2024-04-16 22:59:19.503687] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:21:28.517 [2024-04-16 22:59:19.503703] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:53 nsid:1 lba:40064 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:28.517 [2024-04-16 22:59:19.503717] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:21:28.517 [2024-04-16 22:59:19.503733] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:27 nsid:1 lba:40192 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:28.517 [2024-04-16 22:59:19.503747] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:21:28.517 [2024-04-16 22:59:19.503894] bdev_nvme.c:1576:bdev_nvme_disconnected_qpair_cb: *NOTICE*: qpair 0xe5a260 was disconnected and freed. reset controller. 00:21:28.517 [2024-04-16 22:59:19.504010] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:34816 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:28.517 [2024-04-16 22:59:19.504030] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:21:28.517 [2024-04-16 22:59:19.504053] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:4 nsid:1 lba:34944 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:28.517 [2024-04-16 22:59:19.504069] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:21:28.517 [2024-04-16 22:59:19.504084] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:35072 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:28.517 [2024-04-16 22:59:19.504103] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:21:28.517 [2024-04-16 22:59:19.504120] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:35200 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:28.517 [2024-04-16 22:59:19.504134] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:21:28.517 [2024-04-16 22:59:19.504149] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:6 nsid:1 lba:35328 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:28.517 [2024-04-16 22:59:19.504163] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:21:28.517 [2024-04-16 22:59:19.504189] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:16 nsid:1 lba:35456 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:28.517 [2024-04-16 22:59:19.504206] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:21:28.517 [2024-04-16 22:59:19.504221] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:29184 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:28.517 [2024-04-16 22:59:19.504235] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:21:28.517 [2024-04-16 22:59:19.504252] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:29440 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:28.517 [2024-04-16 22:59:19.504266] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:21:28.517 [2024-04-16 22:59:19.504282] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:29696 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:28.517 [2024-04-16 22:59:19.504295] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:21:28.517 [2024-04-16 22:59:19.504311] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:29824 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:28.517 [2024-04-16 22:59:19.504325] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:21:28.517 [2024-04-16 22:59:19.504341] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:17 nsid:1 lba:29952 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:28.517 [2024-04-16 22:59:19.504355] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:21:28.517 [2024-04-16 22:59:19.504371] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:28 nsid:1 lba:30592 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:28.517 [2024-04-16 22:59:19.504385] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:21:28.517 [2024-04-16 22:59:19.504401] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:39 nsid:1 lba:30720 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:28.517 [2024-04-16 22:59:19.504414] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:21:28.517 [2024-04-16 22:59:19.504430] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:31488 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:28.517 [2024-04-16 22:59:19.504443] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:21:28.517 [2024-04-16 22:59:19.504459] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:25 nsid:1 lba:31872 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:28.517 [2024-04-16 22:59:19.504473] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:21:28.517 [2024-04-16 22:59:19.504500] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:42 nsid:1 lba:32256 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:28.517 [2024-04-16 22:59:19.504514] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:21:28.517 [2024-04-16 22:59:19.504530] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:55 nsid:1 lba:32512 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:28.517 [2024-04-16 22:59:19.504543] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:21:28.517 [2024-04-16 22:59:19.504559] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:26 nsid:1 lba:32640 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:28.517 [2024-04-16 22:59:19.504572] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:21:28.517 [2024-04-16 22:59:19.504587] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:58 nsid:1 lba:32768 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:28.517 [2024-04-16 22:59:19.504601] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:21:28.517 [2024-04-16 22:59:19.504616] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:63 nsid:1 lba:32896 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:28.517 [2024-04-16 22:59:19.504632] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:21:28.517 [2024-04-16 22:59:19.504648] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:30 nsid:1 lba:33024 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:28.517 [2024-04-16 22:59:19.504662] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:21:28.517 [2024-04-16 22:59:19.504678] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:23 nsid:1 lba:35584 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:28.517 [2024-04-16 22:59:19.504691] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:21:28.517 [2024-04-16 22:59:19.504707] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:32 nsid:1 lba:35712 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:28.517 [2024-04-16 22:59:19.504722] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:21:28.517 [2024-04-16 22:59:19.504738] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:31 nsid:1 lba:35840 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:28.517 [2024-04-16 22:59:19.504751] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:21:28.517 [2024-04-16 22:59:19.504767] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:19 nsid:1 lba:35968 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:28.517 [2024-04-16 22:59:19.504781] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:21:28.517 [2024-04-16 22:59:19.504796] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:20 nsid:1 lba:36096 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:28.517 [2024-04-16 22:59:19.504809] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:21:28.517 [2024-04-16 22:59:19.504825] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:24 nsid:1 lba:36224 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:28.517 [2024-04-16 22:59:19.504839] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:21:28.517 [2024-04-16 22:59:19.504854] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:36352 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:28.517 [2024-04-16 22:59:19.504872] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:21:28.517 [2024-04-16 22:59:19.504888] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:43 nsid:1 lba:36480 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:28.517 [2024-04-16 22:59:19.504902] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:21:28.517 [2024-04-16 22:59:19.504920] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:49 nsid:1 lba:36608 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:28.517 [2024-04-16 22:59:19.504934] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:21:28.517 [2024-04-16 22:59:19.504950] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:54 nsid:1 lba:36736 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:28.517 [2024-04-16 22:59:19.504965] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:21:28.517 [2024-04-16 22:59:19.504981] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:59 nsid:1 lba:36864 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:28.517 [2024-04-16 22:59:19.504996] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:21:28.517 [2024-04-16 22:59:19.505013] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:61 nsid:1 lba:36992 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:28.517 [2024-04-16 22:59:19.505026] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:21:28.518 [2024-04-16 22:59:19.505042] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:40 nsid:1 lba:37120 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:28.518 [2024-04-16 22:59:19.505057] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:21:28.518 [2024-04-16 22:59:19.505073] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:46 nsid:1 lba:37248 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:28.518 [2024-04-16 22:59:19.505087] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:21:28.518 [2024-04-16 22:59:19.505103] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:56 nsid:1 lba:37376 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:28.518 [2024-04-16 22:59:19.505124] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:21:28.518 [2024-04-16 22:59:19.505139] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:29 nsid:1 lba:37504 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:28.518 [2024-04-16 22:59:19.505153] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:21:28.518 [2024-04-16 22:59:19.505168] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:48 nsid:1 lba:37632 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:28.518 [2024-04-16 22:59:19.505199] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:21:28.518 [2024-04-16 22:59:19.505217] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:10 nsid:1 lba:37760 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:28.518 [2024-04-16 22:59:19.505231] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:21:28.518 [2024-04-16 22:59:19.505247] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:21 nsid:1 lba:37888 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:28.518 [2024-04-16 22:59:19.505261] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:21:28.518 [2024-04-16 22:59:19.505280] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:51 nsid:1 lba:38016 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:28.518 [2024-04-16 22:59:19.505295] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:21:28.518 [2024-04-16 22:59:19.505310] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:62 nsid:1 lba:38144 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:28.518 [2024-04-16 22:59:19.505324] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:21:28.518 [2024-04-16 22:59:19.505340] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:38272 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:28.518 [2024-04-16 22:59:19.505355] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:21:28.518 [2024-04-16 22:59:19.505370] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:14 nsid:1 lba:38400 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:28.518 [2024-04-16 22:59:19.505384] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:21:28.518 [2024-04-16 22:59:19.505400] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:33408 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:28.518 [2024-04-16 22:59:19.505413] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:21:28.518 [2024-04-16 22:59:19.505429] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:60 nsid:1 lba:33664 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:28.518 [2024-04-16 22:59:19.505443] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:21:28.518 [2024-04-16 22:59:19.505459] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:41 nsid:1 lba:33920 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:28.518 [2024-04-16 22:59:19.505484] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:21:28.518 [2024-04-16 22:59:19.505500] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:18 nsid:1 lba:38528 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:28.518 [2024-04-16 22:59:19.505513] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:21:28.518 [2024-04-16 22:59:19.505529] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:34 nsid:1 lba:34304 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:28.518 [2024-04-16 22:59:19.505547] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:21:28.518 [2024-04-16 22:59:19.505565] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:36 nsid:1 lba:34560 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:28.518 [2024-04-16 22:59:19.505579] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:21:28.518 [2024-04-16 22:59:19.505595] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:33 nsid:1 lba:38656 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:28.518 [2024-04-16 22:59:19.505609] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:21:28.518 [2024-04-16 22:59:19.505624] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:57 nsid:1 lba:34688 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:28.518 [2024-04-16 22:59:19.505638] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:21:28.518 [2024-04-16 22:59:19.505653] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:13 nsid:1 lba:38784 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:28.518 [2024-04-16 22:59:19.505670] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:21:28.518 [2024-04-16 22:59:19.505686] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:45 nsid:1 lba:38912 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:28.518 [2024-04-16 22:59:19.505700] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:21:28.518 [2024-04-16 22:59:19.505715] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:22 nsid:1 lba:39040 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:28.518 [2024-04-16 22:59:19.505729] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:21:28.518 [2024-04-16 22:59:19.505744] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:27 nsid:1 lba:39168 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:28.518 [2024-04-16 22:59:19.505758] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:21:28.518 [2024-04-16 22:59:19.505774] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:44 nsid:1 lba:39296 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:28.518 [2024-04-16 22:59:19.505788] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:21:28.518 [2024-04-16 22:59:19.505803] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:53 nsid:1 lba:39424 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:28.518 [2024-04-16 22:59:19.505817] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:21:28.518 [2024-04-16 22:59:19.505832] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:52 nsid:1 lba:39552 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:28.518 [2024-04-16 22:59:19.505846] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:21:28.518 [2024-04-16 22:59:19.505861] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:35 nsid:1 lba:39680 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:28.518 [2024-04-16 22:59:19.505875] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:21:28.518 [2024-04-16 22:59:19.505891] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:37 nsid:1 lba:39808 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:28.518 [2024-04-16 22:59:19.505906] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:21:28.518 [2024-04-16 22:59:19.505921] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:38 nsid:1 lba:39936 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:28.518 [2024-04-16 22:59:19.505935] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:21:28.518 [2024-04-16 22:59:19.505950] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:50 nsid:1 lba:40064 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:28.518 [2024-04-16 22:59:19.505966] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:21:28.518 [2024-04-16 22:59:19.505982] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:47 nsid:1 lba:40192 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:28.518 [2024-04-16 22:59:19.505996] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:21:28.518 [2024-04-16 22:59:19.506103] bdev_nvme.c:1576:bdev_nvme_disconnected_qpair_cb: *NOTICE*: qpair 0xe5b820 was disconnected and freed. reset controller. 00:21:28.518 [2024-04-16 22:59:19.515043] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:34816 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:28.518 [2024-04-16 22:59:19.515122] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:21:28.518 [2024-04-16 22:59:19.515166] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:34944 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:28.518 [2024-04-16 22:59:19.515199] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:21:28.518 [2024-04-16 22:59:19.515226] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:35072 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:28.518 [2024-04-16 22:59:19.515242] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:21:28.518 [2024-04-16 22:59:19.515258] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:35200 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:28.518 [2024-04-16 22:59:19.515272] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:21:28.518 [2024-04-16 22:59:19.515288] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:29184 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:28.518 [2024-04-16 22:59:19.515302] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:21:28.518 [2024-04-16 22:59:19.515318] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:29440 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:28.518 [2024-04-16 22:59:19.515333] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:21:28.518 [2024-04-16 22:59:19.515348] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:29696 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:28.518 [2024-04-16 22:59:19.515362] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:21:28.518 [2024-04-16 22:59:19.515378] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:29824 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:28.518 [2024-04-16 22:59:19.515392] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:21:28.519 [2024-04-16 22:59:19.515410] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:29952 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:28.519 [2024-04-16 22:59:19.515424] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:21:28.519 [2024-04-16 22:59:19.515440] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:28 nsid:1 lba:30592 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:28.519 [2024-04-16 22:59:19.515454] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:21:28.519 [2024-04-16 22:59:19.515470] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:31 nsid:1 lba:30720 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:28.519 [2024-04-16 22:59:19.515483] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:21:28.519 [2024-04-16 22:59:19.515499] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:40 nsid:1 lba:31488 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:28.519 [2024-04-16 22:59:19.515512] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:21:28.519 [2024-04-16 22:59:19.515528] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:22 nsid:1 lba:31872 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:28.519 [2024-04-16 22:59:19.515542] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:21:28.519 [2024-04-16 22:59:19.515563] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:50 nsid:1 lba:32256 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:28.519 [2024-04-16 22:59:19.515577] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:21:28.519 [2024-04-16 22:59:19.515593] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:49 nsid:1 lba:32512 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:28.519 [2024-04-16 22:59:19.515607] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:21:28.519 [2024-04-16 22:59:19.515622] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:62 nsid:1 lba:32640 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:28.519 [2024-04-16 22:59:19.515636] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:21:28.519 [2024-04-16 22:59:19.515651] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:54 nsid:1 lba:32768 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:28.519 [2024-04-16 22:59:19.515665] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:21:28.519 [2024-04-16 22:59:19.515680] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:59 nsid:1 lba:32896 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:28.519 [2024-04-16 22:59:19.515694] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:21:28.519 [2024-04-16 22:59:19.515710] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:33024 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:28.519 [2024-04-16 22:59:19.515723] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:21:28.519 [2024-04-16 22:59:19.515739] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:33 nsid:1 lba:33408 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:28.519 [2024-04-16 22:59:19.515752] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:21:28.519 [2024-04-16 22:59:19.515768] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:6 nsid:1 lba:35328 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:28.519 [2024-04-16 22:59:19.515782] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:21:28.519 [2024-04-16 22:59:19.515797] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:16 nsid:1 lba:35456 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:28.519 [2024-04-16 22:59:19.515810] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:21:28.519 [2024-04-16 22:59:19.515826] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:23 nsid:1 lba:35584 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:28.519 [2024-04-16 22:59:19.515840] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:21:28.519 [2024-04-16 22:59:19.515855] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:56 nsid:1 lba:33664 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:28.519 [2024-04-16 22:59:19.515869] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:21:28.519 [2024-04-16 22:59:19.515895] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:42 nsid:1 lba:33920 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:28.519 [2024-04-16 22:59:19.515909] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:21:28.519 [2024-04-16 22:59:19.515926] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:55 nsid:1 lba:34304 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:28.519 [2024-04-16 22:59:19.515943] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:21:28.519 [2024-04-16 22:59:19.515960] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:63 nsid:1 lba:34560 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:28.519 [2024-04-16 22:59:19.515974] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:21:28.519 [2024-04-16 22:59:19.515989] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:52 nsid:1 lba:34688 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:28.519 [2024-04-16 22:59:19.516003] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:21:28.519 [2024-04-16 22:59:19.516018] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:10 nsid:1 lba:35712 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:28.519 [2024-04-16 22:59:19.516032] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:21:28.519 [2024-04-16 22:59:19.516048] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:45 nsid:1 lba:35840 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:28.519 [2024-04-16 22:59:19.516063] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:21:28.519 [2024-04-16 22:59:19.516078] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:34 nsid:1 lba:35968 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:28.519 [2024-04-16 22:59:19.516092] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:21:28.519 [2024-04-16 22:59:19.516108] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:35 nsid:1 lba:36096 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:28.519 [2024-04-16 22:59:19.516121] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:21:28.519 [2024-04-16 22:59:19.516141] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:37 nsid:1 lba:36224 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:28.519 [2024-04-16 22:59:19.516154] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:21:28.519 [2024-04-16 22:59:19.516170] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:38 nsid:1 lba:36352 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:28.519 [2024-04-16 22:59:19.516208] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:21:28.519 [2024-04-16 22:59:19.516231] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:21 nsid:1 lba:36480 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:28.519 [2024-04-16 22:59:19.516246] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:21:28.519 [2024-04-16 22:59:19.516261] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:36608 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:28.519 [2024-04-16 22:59:19.516275] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:21:28.519 [2024-04-16 22:59:19.516291] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:17 nsid:1 lba:36736 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:28.520 [2024-04-16 22:59:19.516305] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:21:28.520 [2024-04-16 22:59:19.516320] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:19 nsid:1 lba:36864 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:28.520 [2024-04-16 22:59:19.516334] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:21:28.520 [2024-04-16 22:59:19.516354] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:20 nsid:1 lba:36992 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:28.520 [2024-04-16 22:59:19.516369] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:21:28.520 [2024-04-16 22:59:19.516385] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:24 nsid:1 lba:37120 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:28.520 [2024-04-16 22:59:19.516398] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:21:28.520 [2024-04-16 22:59:19.516414] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:39 nsid:1 lba:37248 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:28.520 [2024-04-16 22:59:19.516427] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:21:28.520 [2024-04-16 22:59:19.516443] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:43 nsid:1 lba:37376 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:28.520 [2024-04-16 22:59:19.516457] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:21:28.520 [2024-04-16 22:59:19.516472] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:25 nsid:1 lba:37504 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:28.520 [2024-04-16 22:59:19.516486] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:21:28.520 [2024-04-16 22:59:19.516502] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:26 nsid:1 lba:37632 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:28.520 [2024-04-16 22:59:19.516518] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:21:28.520 [2024-04-16 22:59:19.516534] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:30 nsid:1 lba:37760 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:28.520 [2024-04-16 22:59:19.516547] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:21:28.520 [2024-04-16 22:59:19.516563] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:13 nsid:1 lba:37888 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:28.520 [2024-04-16 22:59:19.516583] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:21:28.520 [2024-04-16 22:59:19.516598] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:53 nsid:1 lba:38016 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:28.520 [2024-04-16 22:59:19.516612] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:21:28.520 [2024-04-16 22:59:19.516627] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:27 nsid:1 lba:38144 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:28.520 [2024-04-16 22:59:19.516641] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:21:28.520 [2024-04-16 22:59:19.516657] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:36 nsid:1 lba:38272 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:28.520 [2024-04-16 22:59:19.516671] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:21:28.520 [2024-04-16 22:59:19.516687] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:57 nsid:1 lba:38400 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:28.520 [2024-04-16 22:59:19.516700] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:21:28.520 [2024-04-16 22:59:19.516716] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:51 nsid:1 lba:38528 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:28.520 [2024-04-16 22:59:19.516732] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:21:28.520 [2024-04-16 22:59:19.516749] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:61 nsid:1 lba:38656 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:28.520 [2024-04-16 22:59:19.516763] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:21:28.520 [2024-04-16 22:59:19.516779] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:60 nsid:1 lba:38784 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:28.520 [2024-04-16 22:59:19.516792] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:21:28.520 [2024-04-16 22:59:19.516808] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:8 nsid:1 lba:38912 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:28.520 [2024-04-16 22:59:19.516822] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:21:28.520 [2024-04-16 22:59:19.516837] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:39040 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:28.520 [2024-04-16 22:59:19.516852] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:21:28.520 [2024-04-16 22:59:19.516869] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:18 nsid:1 lba:39168 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:28.520 [2024-04-16 22:59:19.516883] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:21:28.520 [2024-04-16 22:59:19.516898] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:41 nsid:1 lba:39296 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:28.520 [2024-04-16 22:59:19.516912] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:21:28.520 [2024-04-16 22:59:19.516939] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:44 nsid:1 lba:39424 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:28.520 [2024-04-16 22:59:19.516952] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:21:28.520 [2024-04-16 22:59:19.516967] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:47 nsid:1 lba:39552 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:28.520 [2024-04-16 22:59:19.516981] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:21:28.520 [2024-04-16 22:59:19.516997] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:46 nsid:1 lba:39680 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:28.520 [2024-04-16 22:59:19.517011] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:21:28.520 [2024-04-16 22:59:19.517026] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:29 nsid:1 lba:39808 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:28.520 [2024-04-16 22:59:19.517040] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:21:28.520 [2024-04-16 22:59:19.517055] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:48 nsid:1 lba:39936 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:28.520 [2024-04-16 22:59:19.517069] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:21:28.520 [2024-04-16 22:59:19.517085] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:32 nsid:1 lba:40064 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:28.520 [2024-04-16 22:59:19.517099] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:21:28.520 [2024-04-16 22:59:19.517119] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:58 nsid:1 lba:40192 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:28.520 [2024-04-16 22:59:19.517134] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:21:28.520 [2024-04-16 22:59:19.517149] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe247f0 is same with the state(5) to be set 00:21:28.520 [2024-04-16 22:59:19.517254] bdev_nvme.c:1576:bdev_nvme_disconnected_qpair_cb: *NOTICE*: qpair 0xe247f0 was disconnected and freed. reset controller. 00:21:28.520 [2024-04-16 22:59:19.517599] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xe66830 (9): Bad file descriptor 00:21:28.520 [2024-04-16 22:59:19.517645] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xd1d4f0 (9): Bad file descriptor 00:21:28.520 [2024-04-16 22:59:19.517669] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xcdba30 (9): Bad file descriptor 00:21:28.520 [2024-04-16 22:59:19.517692] bdev_nvme.c:2827:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:21:28.520 [2024-04-16 22:59:19.517713] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xea8a60 (9): Bad file descriptor 00:21:28.520 [2024-04-16 22:59:19.517736] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xce4f70 (9): Bad file descriptor 00:21:28.520 [2024-04-16 22:59:19.517758] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xc45a50 (9): Bad file descriptor 00:21:28.520 [2024-04-16 22:59:19.517779] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xcdbe60 (9): Bad file descriptor 00:21:28.520 [2024-04-16 22:59:19.517800] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xea3490 (9): Bad file descriptor 00:21:28.520 [2024-04-16 22:59:19.517822] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xea38c0 (9): Bad file descriptor 00:21:28.520 [2024-04-16 22:59:19.522399] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:34816 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:28.520 [2024-04-16 22:59:19.522436] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:21:28.520 [2024-04-16 22:59:19.522463] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:4 nsid:1 lba:34944 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:28.520 [2024-04-16 22:59:19.522482] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:21:28.520 [2024-04-16 22:59:19.522498] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:35072 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:28.520 [2024-04-16 22:59:19.522513] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:21:28.520 [2024-04-16 22:59:19.522529] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:35200 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:28.520 [2024-04-16 22:59:19.522543] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:21:28.520 [2024-04-16 22:59:19.522558] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:6 nsid:1 lba:35328 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:28.520 [2024-04-16 22:59:19.522572] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:21:28.520 [2024-04-16 22:59:19.522588] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:16 nsid:1 lba:35456 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:28.520 [2024-04-16 22:59:19.522602] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:21:28.520 [2024-04-16 22:59:19.522618] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:29184 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:28.521 [2024-04-16 22:59:19.522638] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:21:28.521 [2024-04-16 22:59:19.522656] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:29440 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:28.521 [2024-04-16 22:59:19.522670] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:21:28.521 [2024-04-16 22:59:19.522686] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:29696 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:28.521 [2024-04-16 22:59:19.522699] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:21:28.521 [2024-04-16 22:59:19.522714] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:29824 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:28.521 [2024-04-16 22:59:19.522728] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:21:28.521 [2024-04-16 22:59:19.522743] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:17 nsid:1 lba:29952 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:28.521 [2024-04-16 22:59:19.522761] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:21:28.521 [2024-04-16 22:59:19.522776] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:24 nsid:1 lba:30592 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:28.521 [2024-04-16 22:59:19.522790] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:21:28.521 [2024-04-16 22:59:19.522805] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:30720 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:28.521 [2024-04-16 22:59:19.522819] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:21:28.521 [2024-04-16 22:59:19.522845] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:54 nsid:1 lba:31488 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:28.521 [2024-04-16 22:59:19.522858] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:21:28.521 [2024-04-16 22:59:19.522873] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:23 nsid:1 lba:35584 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:28.521 [2024-04-16 22:59:19.522887] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:21:28.521 [2024-04-16 22:59:19.522903] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:13 nsid:1 lba:35712 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:28.521 [2024-04-16 22:59:19.522917] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:21:28.521 [2024-04-16 22:59:19.522932] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:28 nsid:1 lba:35840 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:28.521 [2024-04-16 22:59:19.522945] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:21:28.521 [2024-04-16 22:59:19.522961] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:62 nsid:1 lba:35968 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:28.521 [2024-04-16 22:59:19.522974] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:21:28.521 [2024-04-16 22:59:19.522990] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:14 nsid:1 lba:36096 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:28.521 [2024-04-16 22:59:19.523004] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:21:28.521 [2024-04-16 22:59:19.523023] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:18 nsid:1 lba:36224 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:28.521 [2024-04-16 22:59:19.523037] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:21:28.521 [2024-04-16 22:59:19.523053] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:30 nsid:1 lba:36352 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:28.521 [2024-04-16 22:59:19.523066] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:21:28.521 [2024-04-16 22:59:19.523082] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:41 nsid:1 lba:36480 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:28.521 [2024-04-16 22:59:19.523095] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:21:28.521 [2024-04-16 22:59:19.523111] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:45 nsid:1 lba:36608 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:28.521 [2024-04-16 22:59:19.523124] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:21:28.521 [2024-04-16 22:59:19.523140] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:36736 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:28.521 [2024-04-16 22:59:19.523153] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:21:28.521 [2024-04-16 22:59:19.523172] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:56 nsid:1 lba:36864 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:28.521 [2024-04-16 22:59:19.523202] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:21:28.521 [2024-04-16 22:59:19.523222] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:19 nsid:1 lba:36992 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:28.521 [2024-04-16 22:59:19.523237] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:21:28.521 [2024-04-16 22:59:19.523253] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:10 nsid:1 lba:37120 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:28.521 [2024-04-16 22:59:19.523267] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:21:28.521 [2024-04-16 22:59:19.523282] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:27 nsid:1 lba:37248 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:28.521 [2024-04-16 22:59:19.523296] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:21:28.521 [2024-04-16 22:59:19.523311] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:20 nsid:1 lba:37376 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:28.521 [2024-04-16 22:59:19.523325] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:21:28.521 [2024-04-16 22:59:19.523341] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:52 nsid:1 lba:37504 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:28.521 [2024-04-16 22:59:19.523354] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:21:28.521 [2024-04-16 22:59:19.523370] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:35 nsid:1 lba:37632 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:28.521 [2024-04-16 22:59:19.523383] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:21:28.521 [2024-04-16 22:59:19.523399] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:37 nsid:1 lba:37760 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:28.521 [2024-04-16 22:59:19.523421] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:21:28.521 [2024-04-16 22:59:19.523438] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:38 nsid:1 lba:37888 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:28.521 [2024-04-16 22:59:19.523452] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:21:28.521 [2024-04-16 22:59:19.523476] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:50 nsid:1 lba:38016 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:28.521 [2024-04-16 22:59:19.523490] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:21:28.521 [2024-04-16 22:59:19.523505] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:31 nsid:1 lba:38144 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:28.521 [2024-04-16 22:59:19.523519] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:21:28.521 [2024-04-16 22:59:19.523540] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:25 nsid:1 lba:38272 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:28.521 [2024-04-16 22:59:19.523554] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:21:28.521 [2024-04-16 22:59:19.523569] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:26 nsid:1 lba:38400 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:28.521 [2024-04-16 22:59:19.523583] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:21:28.521 [2024-04-16 22:59:19.523598] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:39 nsid:1 lba:38528 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:28.521 [2024-04-16 22:59:19.523612] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:21:28.521 [2024-04-16 22:59:19.523627] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:43 nsid:1 lba:38656 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:28.521 [2024-04-16 22:59:19.523640] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:21:28.521 [2024-04-16 22:59:19.523656] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:59 nsid:1 lba:38784 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:28.521 [2024-04-16 22:59:19.523670] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:21:28.521 [2024-04-16 22:59:19.523685] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:61 nsid:1 lba:38912 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:28.521 [2024-04-16 22:59:19.523699] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:21:28.521 [2024-04-16 22:59:19.523714] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:32 nsid:1 lba:39040 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:28.521 [2024-04-16 22:59:19.523728] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:21:28.521 [2024-04-16 22:59:19.523743] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:33 nsid:1 lba:39168 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:28.521 [2024-04-16 22:59:19.523757] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:21:28.522 [2024-04-16 22:59:19.523772] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:49 nsid:1 lba:39296 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:28.522 [2024-04-16 22:59:19.523786] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:21:28.522 [2024-04-16 22:59:19.523804] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:31872 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:28.522 [2024-04-16 22:59:19.523818] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:21:28.522 [2024-04-16 22:59:19.523834] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:21 nsid:1 lba:32256 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:28.522 [2024-04-16 22:59:19.523848] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:21:28.522 [2024-04-16 22:59:19.523864] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:46 nsid:1 lba:39424 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:28.522 [2024-04-16 22:59:19.523877] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:21:28.522 [2024-04-16 22:59:19.523892] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:22 nsid:1 lba:39552 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:28.522 [2024-04-16 22:59:19.523906] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:21:28.522 [2024-04-16 22:59:19.523922] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:51 nsid:1 lba:32512 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:28.522 [2024-04-16 22:59:19.523936] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:21:28.522 [2024-04-16 22:59:19.523951] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:60 nsid:1 lba:32640 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:28.522 [2024-04-16 22:59:19.523964] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:21:28.522 [2024-04-16 22:59:19.523987] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:32768 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:28.522 [2024-04-16 22:59:19.524000] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:21:28.522 [2024-04-16 22:59:19.524015] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:29 nsid:1 lba:39680 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:28.522 [2024-04-16 22:59:19.524029] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:21:28.522 [2024-04-16 22:59:19.524044] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:48 nsid:1 lba:39808 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:28.522 [2024-04-16 22:59:19.524060] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:21:28.522 [2024-04-16 22:59:19.524076] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:40 nsid:1 lba:32896 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:28.522 [2024-04-16 22:59:19.524090] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:21:28.522 [2024-04-16 22:59:19.524105] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:44 nsid:1 lba:33024 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:28.522 [2024-04-16 22:59:19.524119] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:21:28.522 [2024-04-16 22:59:19.524135] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:53 nsid:1 lba:33408 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:28.522 [2024-04-16 22:59:19.524149] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:21:28.522 [2024-04-16 22:59:19.524165] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:42 nsid:1 lba:33664 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:28.522 [2024-04-16 22:59:19.524200] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:21:28.522 [2024-04-16 22:59:19.524217] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:55 nsid:1 lba:33920 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:28.522 [2024-04-16 22:59:19.524231] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:21:28.522 [2024-04-16 22:59:19.524247] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:34 nsid:1 lba:34304 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:28.522 [2024-04-16 22:59:19.524261] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:21:28.522 [2024-04-16 22:59:19.524277] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:36 nsid:1 lba:34560 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:28.522 [2024-04-16 22:59:19.524290] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:21:28.522 [2024-04-16 22:59:19.524306] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:57 nsid:1 lba:34688 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:28.522 [2024-04-16 22:59:19.524320] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:21:28.522 [2024-04-16 22:59:19.524335] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:58 nsid:1 lba:39936 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:28.522 [2024-04-16 22:59:19.524349] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:21:28.522 [2024-04-16 22:59:19.524364] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:63 nsid:1 lba:40064 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:28.522 [2024-04-16 22:59:19.524379] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:21:28.522 [2024-04-16 22:59:19.524394] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:47 nsid:1 lba:40192 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:28.522 [2024-04-16 22:59:19.524408] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:21:28.522 [2024-04-16 22:59:19.524543] bdev_nvme.c:1576:bdev_nvme_disconnected_qpair_cb: *NOTICE*: qpair 0xe21c30 was disconnected and freed. reset controller. 00:21:28.522 [2024-04-16 22:59:19.524619] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:34816 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:28.522 [2024-04-16 22:59:19.524640] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:21:28.522 [2024-04-16 22:59:19.524661] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:34944 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:28.522 [2024-04-16 22:59:19.524677] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:21:28.522 [2024-04-16 22:59:19.524693] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:35072 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:28.522 [2024-04-16 22:59:19.524708] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:21:28.522 [2024-04-16 22:59:19.524724] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:8 nsid:1 lba:35200 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:28.522 [2024-04-16 22:59:19.524738] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:21:28.522 [2024-04-16 22:59:19.524755] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:29184 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:28.522 [2024-04-16 22:59:19.524773] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:21:28.522 [2024-04-16 22:59:19.524790] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:29440 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:28.522 [2024-04-16 22:59:19.524805] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:21:28.522 [2024-04-16 22:59:19.524821] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:29696 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:28.522 [2024-04-16 22:59:19.524846] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:21:28.522 [2024-04-16 22:59:19.524863] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:29824 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:28.522 [2024-04-16 22:59:19.524877] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:21:28.522 [2024-04-16 22:59:19.524893] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:29952 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:28.522 [2024-04-16 22:59:19.524907] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:21:28.522 [2024-04-16 22:59:19.524923] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:17 nsid:1 lba:30592 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:28.522 [2024-04-16 22:59:19.524937] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:21:28.522 [2024-04-16 22:59:19.524953] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:23 nsid:1 lba:30720 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:28.522 [2024-04-16 22:59:19.524977] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:21:28.522 [2024-04-16 22:59:19.524993] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:36 nsid:1 lba:31488 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:28.522 [2024-04-16 22:59:19.525007] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:21:28.522 [2024-04-16 22:59:19.525023] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:35328 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:28.522 [2024-04-16 22:59:19.525040] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:21:28.522 [2024-04-16 22:59:19.525056] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:35456 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:28.522 [2024-04-16 22:59:19.525070] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:21:28.522 [2024-04-16 22:59:19.525086] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:22 nsid:1 lba:35584 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:28.522 [2024-04-16 22:59:19.525100] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:21:28.522 [2024-04-16 22:59:19.525115] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:29 nsid:1 lba:35712 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:28.522 [2024-04-16 22:59:19.525129] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:21:28.522 [2024-04-16 22:59:19.525145] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:39 nsid:1 lba:31872 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:28.522 [2024-04-16 22:59:19.525169] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:21:28.522 [2024-04-16 22:59:19.525200] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:61 nsid:1 lba:32256 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:28.522 [2024-04-16 22:59:19.525216] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:21:28.523 [2024-04-16 22:59:19.525232] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:37 nsid:1 lba:35840 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:28.523 [2024-04-16 22:59:19.525246] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:21:28.523 [2024-04-16 22:59:19.525262] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:21 nsid:1 lba:35968 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:28.523 [2024-04-16 22:59:19.525276] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:21:28.523 [2024-04-16 22:59:19.525292] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:62 nsid:1 lba:32512 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:28.523 [2024-04-16 22:59:19.525306] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:21:28.523 [2024-04-16 22:59:19.525322] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:35 nsid:1 lba:36096 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:28.523 [2024-04-16 22:59:19.525336] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:21:28.523 [2024-04-16 22:59:19.525351] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:46 nsid:1 lba:32640 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:28.523 [2024-04-16 22:59:19.525366] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:21:28.523 [2024-04-16 22:59:19.525382] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:36224 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:28.523 [2024-04-16 22:59:19.525396] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:21:28.523 [2024-04-16 22:59:19.525412] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:52 nsid:1 lba:32768 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:28.523 [2024-04-16 22:59:19.525426] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:21:28.523 [2024-04-16 22:59:19.525442] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:34 nsid:1 lba:32896 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:28.523 [2024-04-16 22:59:19.525456] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:21:28.523 [2024-04-16 22:59:19.525479] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:38 nsid:1 lba:36352 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:28.523 [2024-04-16 22:59:19.525493] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:21:28.523 [2024-04-16 22:59:19.525510] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:31 nsid:1 lba:36480 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:28.523 [2024-04-16 22:59:19.525524] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:21:28.523 [2024-04-16 22:59:19.525540] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:9 nsid:1 lba:36608 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:28.523 [2024-04-16 22:59:19.525554] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:21:28.523 [2024-04-16 22:59:19.525570] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:26 nsid:1 lba:33024 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:28.523 [2024-04-16 22:59:19.525587] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:21:28.523 [2024-04-16 22:59:19.525603] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:19 nsid:1 lba:33408 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:28.523 [2024-04-16 22:59:19.525618] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:21:28.523 [2024-04-16 22:59:19.525633] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:36736 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:28.523 [2024-04-16 22:59:19.525647] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:21:28.523 [2024-04-16 22:59:19.525668] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:56 nsid:1 lba:33664 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:28.523 [2024-04-16 22:59:19.525681] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:21:28.523 [2024-04-16 22:59:19.525697] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:43 nsid:1 lba:36864 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:28.523 [2024-04-16 22:59:19.525711] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:21:28.523 [2024-04-16 22:59:19.525727] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:41 nsid:1 lba:36992 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:28.523 [2024-04-16 22:59:19.525741] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:21:28.523 [2024-04-16 22:59:19.525756] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:32 nsid:1 lba:33920 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:28.523 [2024-04-16 22:59:19.525770] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:21:28.523 [2024-04-16 22:59:19.525786] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:10 nsid:1 lba:37120 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:28.523 [2024-04-16 22:59:19.525800] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:21:28.523 [2024-04-16 22:59:19.525816] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:40 nsid:1 lba:34304 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:28.523 [2024-04-16 22:59:19.525829] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:21:28.523 [2024-04-16 22:59:19.525845] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:44 nsid:1 lba:34560 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:28.523 [2024-04-16 22:59:19.525860] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:21:28.523 [2024-04-16 22:59:19.525875] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:53 nsid:1 lba:34688 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:28.523 [2024-04-16 22:59:19.525889] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:21:28.523 [2024-04-16 22:59:19.525905] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:48 nsid:1 lba:37248 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:28.523 [2024-04-16 22:59:19.525919] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:21:28.523 [2024-04-16 22:59:19.525934] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:59 nsid:1 lba:37376 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:28.523 [2024-04-16 22:59:19.525948] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:21:28.523 [2024-04-16 22:59:19.525967] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:50 nsid:1 lba:37504 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:28.523 [2024-04-16 22:59:19.525982] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:21:28.523 [2024-04-16 22:59:19.525998] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:55 nsid:1 lba:37632 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:28.523 [2024-04-16 22:59:19.526012] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:21:28.523 [2024-04-16 22:59:19.526028] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:45 nsid:1 lba:37760 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:28.523 [2024-04-16 22:59:19.526042] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:21:28.523 [2024-04-16 22:59:19.526057] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:57 nsid:1 lba:37888 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:28.523 [2024-04-16 22:59:19.526071] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:21:28.523 [2024-04-16 22:59:19.526087] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:47 nsid:1 lba:38016 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:28.523 [2024-04-16 22:59:19.526102] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:21:28.523 [2024-04-16 22:59:19.526124] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:16 nsid:1 lba:38144 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:28.523 [2024-04-16 22:59:19.526138] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:21:28.523 [2024-04-16 22:59:19.526154] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:25 nsid:1 lba:38272 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:28.523 [2024-04-16 22:59:19.526180] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:21:28.523 [2024-04-16 22:59:19.526198] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:27 nsid:1 lba:38400 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:28.523 [2024-04-16 22:59:19.526213] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:21:28.523 [2024-04-16 22:59:19.526228] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:20 nsid:1 lba:38528 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:28.523 [2024-04-16 22:59:19.526242] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:21:28.523 [2024-04-16 22:59:19.526257] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:18 nsid:1 lba:38656 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:28.523 [2024-04-16 22:59:19.526271] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:21:28.523 [2024-04-16 22:59:19.526287] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:24 nsid:1 lba:38784 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:28.523 [2024-04-16 22:59:19.526301] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:21:28.523 [2024-04-16 22:59:19.526316] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:30 nsid:1 lba:38912 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:28.523 [2024-04-16 22:59:19.526330] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:21:28.523 [2024-04-16 22:59:19.526345] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:49 nsid:1 lba:39040 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:28.523 [2024-04-16 22:59:19.526363] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:21:28.524 [2024-04-16 22:59:19.526379] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:54 nsid:1 lba:39168 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:28.524 [2024-04-16 22:59:19.526393] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:21:28.524 [2024-04-16 22:59:19.526408] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:58 nsid:1 lba:39296 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:28.524 [2024-04-16 22:59:19.526422] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:21:28.524 [2024-04-16 22:59:19.526437] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:42 nsid:1 lba:39424 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:28.524 [2024-04-16 22:59:19.526451] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:21:28.524 [2024-04-16 22:59:19.526476] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:13 nsid:1 lba:39552 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:28.524 [2024-04-16 22:59:19.526490] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:21:28.524 [2024-04-16 22:59:19.526505] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:63 nsid:1 lba:39680 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:28.524 [2024-04-16 22:59:19.526519] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:21:28.524 [2024-04-16 22:59:19.526534] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:28 nsid:1 lba:39808 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:28.524 [2024-04-16 22:59:19.526548] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:21:28.524 [2024-04-16 22:59:19.526563] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:33 nsid:1 lba:39936 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:28.524 [2024-04-16 22:59:19.526576] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:21:28.524 [2024-04-16 22:59:19.526591] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:51 nsid:1 lba:40064 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:28.524 [2024-04-16 22:59:19.526605] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:21:28.524 [2024-04-16 22:59:19.526621] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:60 nsid:1 lba:40192 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:28.524 [2024-04-16 22:59:19.526635] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:21:28.524 [2024-04-16 22:59:19.526649] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe23210 is same with the state(5) to be set 00:21:28.524 [2024-04-16 22:59:19.526720] bdev_nvme.c:1576:bdev_nvme_disconnected_qpair_cb: *NOTICE*: qpair 0xe23210 was disconnected and freed. reset controller. 00:21:28.524 [2024-04-16 22:59:19.529027] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:21:28.524 [2024-04-16 22:59:19.529137] bdev_nvme.c:2827:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:21:28.524 [2024-04-16 22:59:19.529172] bdev_nvme.c:2827:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:21:28.524 [2024-04-16 22:59:19.529202] bdev_nvme.c:2827:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:21:28.524 [2024-04-16 22:59:19.529221] bdev_nvme.c:2827:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:21:28.524 [2024-04-16 22:59:19.529245] bdev_nvme.c:2827:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:21:28.524 [2024-04-16 22:59:19.529264] bdev_nvme.c:2827:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:21:28.524 [2024-04-16 22:59:19.531589] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:59 nsid:1 lba:34304 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:28.524 [2024-04-16 22:59:19.531615] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:21:28.524 [2024-04-16 22:59:19.531636] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:39 nsid:1 lba:34560 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:28.524 [2024-04-16 22:59:19.531652] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:21:28.524 [2024-04-16 22:59:19.531669] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:52 nsid:1 lba:34688 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:28.524 [2024-04-16 22:59:19.531683] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:21:28.524 [2024-04-16 22:59:19.531699] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:29184 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:28.524 [2024-04-16 22:59:19.531712] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:21:28.524 [2024-04-16 22:59:19.531727] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:29440 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:28.524 [2024-04-16 22:59:19.531741] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:21:28.524 [2024-04-16 22:59:19.531756] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:29696 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:28.524 [2024-04-16 22:59:19.531770] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:21:28.524 [2024-04-16 22:59:19.531785] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:29824 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:28.524 [2024-04-16 22:59:19.531799] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:21:28.524 [2024-04-16 22:59:19.531814] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:29952 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:28.524 [2024-04-16 22:59:19.531828] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:21:28.524 [2024-04-16 22:59:19.531843] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:25 nsid:1 lba:30592 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:28.524 [2024-04-16 22:59:19.531857] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:21:28.524 [2024-04-16 22:59:19.531872] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:30720 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:28.524 [2024-04-16 22:59:19.531886] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:21:28.524 [2024-04-16 22:59:19.531901] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:31488 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:28.524 [2024-04-16 22:59:19.531915] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:21:28.524 [2024-04-16 22:59:19.531929] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:40 nsid:1 lba:31872 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:28.524 [2024-04-16 22:59:19.531948] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:21:28.524 [2024-04-16 22:59:19.531964] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:28 nsid:1 lba:32256 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:28.524 [2024-04-16 22:59:19.531978] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:21:28.524 [2024-04-16 22:59:19.531993] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:47 nsid:1 lba:32512 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:28.524 [2024-04-16 22:59:19.532007] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:21:28.524 [2024-04-16 22:59:19.532022] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:31 nsid:1 lba:32640 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:28.524 [2024-04-16 22:59:19.532035] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:21:28.524 [2024-04-16 22:59:19.532051] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:54 nsid:1 lba:32768 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:28.524 [2024-04-16 22:59:19.532064] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:21:28.524 [2024-04-16 22:59:19.532079] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:57 nsid:1 lba:32896 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:28.524 [2024-04-16 22:59:19.532092] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:21:28.524 [2024-04-16 22:59:19.532107] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:62 nsid:1 lba:33024 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:28.525 [2024-04-16 22:59:19.532127] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:21:28.525 [2024-04-16 22:59:19.532143] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:55 nsid:1 lba:33408 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:28.525 [2024-04-16 22:59:19.532156] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:21:28.525 [2024-04-16 22:59:19.532181] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:26 nsid:1 lba:33664 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:28.525 [2024-04-16 22:59:19.532205] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:21:28.525 [2024-04-16 22:59:19.532225] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:49 nsid:1 lba:33920 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:28.525 [2024-04-16 22:59:19.532239] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:21:28.525 [2024-04-16 22:59:19.532328] bdev_nvme.c:1576:bdev_nvme_disconnected_qpair_cb: *NOTICE*: qpair 0xe25dd0 was disconnected and freed. reset controller. 00:21:28.525 [2024-04-16 22:59:19.532347] bdev_nvme.c:2827:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:21:28.525 [2024-04-16 22:59:19.533300] nvme_tcp.c:1159:nvme_tcp_pdu_ch_handle: *ERROR*: Unexpected PDU type 0x00 00:21:28.525 [2024-04-16 22:59:19.533332] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode2] resetting controller 00:21:28.525 [2024-04-16 22:59:19.533354] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode3] resetting controller 00:21:28.525 [2024-04-16 22:59:19.533372] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode4] resetting controller 00:21:28.525 [2024-04-16 22:59:19.533571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:28.525 [2024-04-16 22:59:19.533718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:28.525 [2024-04-16 22:59:19.533745] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xce2210 with addr=10.0.0.2, port=4420 00:21:28.525 [2024-04-16 22:59:19.533767] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xce2210 is same with the state(5) to be set 00:21:28.525 [2024-04-16 22:59:19.536256] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:44 nsid:1 lba:28800 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:28.525 [2024-04-16 22:59:19.536281] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:21:28.525 [2024-04-16 22:59:19.536307] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:21 nsid:1 lba:28928 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:28.525 [2024-04-16 22:59:19.536325] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:21:28.525 [2024-04-16 22:59:19.536346] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:29184 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:28.525 [2024-04-16 22:59:19.536362] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:21:28.525 [2024-04-16 22:59:19.536383] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:29440 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:28.525 [2024-04-16 22:59:19.536401] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:21:28.525 [2024-04-16 22:59:19.536421] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:29696 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:28.525 [2024-04-16 22:59:19.536437] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:21:28.525 [2024-04-16 22:59:19.536457] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:29824 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:28.525 [2024-04-16 22:59:19.536478] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:21:28.525 [2024-04-16 22:59:19.536499] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:29952 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:28.525 [2024-04-16 22:59:19.536515] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:21:28.525 [2024-04-16 22:59:19.536534] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:20 nsid:1 lba:30592 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:28.525 [2024-04-16 22:59:19.536551] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:21:28.525 [2024-04-16 22:59:19.536571] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:23 nsid:1 lba:30720 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:28.525 [2024-04-16 22:59:19.536587] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:21:28.525 [2024-04-16 22:59:19.536606] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:53 nsid:1 lba:31488 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:28.525 [2024-04-16 22:59:19.536622] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:21:28.525 [2024-04-16 22:59:19.536650] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:25 nsid:1 lba:31872 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:28.525 [2024-04-16 22:59:19.536667] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:21:28.525 [2024-04-16 22:59:19.536686] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:55 nsid:1 lba:32256 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:28.525 [2024-04-16 22:59:19.536702] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:21:28.525 [2024-04-16 22:59:19.536731] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:41 nsid:1 lba:32512 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:28.525 [2024-04-16 22:59:19.536748] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:21:28.525 [2024-04-16 22:59:19.536768] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:39 nsid:1 lba:32640 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:28.525 [2024-04-16 22:59:19.536784] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:21:28.525 [2024-04-16 22:59:19.536804] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:43 nsid:1 lba:32768 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:28.525 [2024-04-16 22:59:19.536820] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:21:28.525 [2024-04-16 22:59:19.536839] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:52 nsid:1 lba:32896 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:28.525 [2024-04-16 22:59:19.536855] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:21:28.525 [2024-04-16 22:59:19.536875] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:63 nsid:1 lba:33024 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:28.525 [2024-04-16 22:59:19.536891] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:21:28.525 [2024-04-16 22:59:19.536911] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:49 nsid:1 lba:33408 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:28.525 [2024-04-16 22:59:19.536927] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:21:28.525 [2024-04-16 22:59:19.536947] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:33664 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:28.525 [2024-04-16 22:59:19.536963] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:21:28.525 [2024-04-16 22:59:19.536983] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:59 nsid:1 lba:33920 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:28.525 [2024-04-16 22:59:19.536999] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:21:28.525 [2024-04-16 22:59:19.537019] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:47 nsid:1 lba:34304 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:28.525 [2024-04-16 22:59:19.537034] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:21:28.525 [2024-04-16 22:59:19.537054] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:57 nsid:1 lba:34560 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:28.525 [2024-04-16 22:59:19.537070] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:21:28.525 [2024-04-16 22:59:19.537090] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:62 nsid:1 lba:34688 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:28.525 [2024-04-16 22:59:19.537106] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:21:28.525 [2024-04-16 22:59:19.537947] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d4a1a0 is same with the state(5) to be set 00:21:28.525 [2024-04-16 22:59:19.538436] bdev_nvme.c:1576:bdev_nvme_disconnected_qpair_cb: *NOTICE*: qpair 0x1d4a1a0 was disconnected and freed. reset controller. 00:21:28.525 [2024-04-16 22:59:19.538464] bdev_nvme.c:2827:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:21:28.525 [2024-04-16 22:59:19.538547] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode7] resetting controller 00:21:28.525 [2024-04-16 22:59:19.538695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:28.525 [2024-04-16 22:59:19.538827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:28.525 [2024-04-16 22:59:19.538852] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xea8a60 with addr=10.0.0.2, port=4420 00:21:28.525 [2024-04-16 22:59:19.538868] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xea8a60 is same with the state(5) to be set 00:21:28.525 [2024-04-16 22:59:19.538973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:28.525 [2024-04-16 22:59:19.539085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:28.525 [2024-04-16 22:59:19.539109] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xce4f70 with addr=10.0.0.2, port=4420 00:21:28.525 [2024-04-16 22:59:19.539124] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xce4f70 is same with the state(5) to be set 00:21:28.525 [2024-04-16 22:59:19.539247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:28.525 [2024-04-16 22:59:19.539371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:28.525 [2024-04-16 22:59:19.539395] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xc45a50 with addr=10.0.0.2, port=4420 00:21:28.525 [2024-04-16 22:59:19.539411] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc45a50 is same with the state(5) to be set 00:21:28.525 [2024-04-16 22:59:19.539435] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xce2210 (9): Bad file descriptor 00:21:28.526 [2024-04-16 22:59:19.540142] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:10 nsid:1 lba:29184 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:28.526 [2024-04-16 22:59:19.540166] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:21:28.526 [2024-04-16 22:59:19.540213] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:29312 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:28.526 [2024-04-16 22:59:19.540235] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:21:28.526 [2024-04-16 22:59:19.540253] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:29440 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:28.526 [2024-04-16 22:59:19.540267] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:21:28.526 [2024-04-16 22:59:19.540283] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:29568 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:28.526 [2024-04-16 22:59:19.540297] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:21:28.526 [2024-04-16 22:59:19.540312] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:24320 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:28.526 [2024-04-16 22:59:19.540326] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:21:28.526 [2024-04-16 22:59:19.540341] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:13 nsid:1 lba:29696 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:28.526 [2024-04-16 22:59:19.540355] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:21:28.526 [2024-04-16 22:59:19.540370] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:29824 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:28.526 [2024-04-16 22:59:19.540384] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:21:28.526 [2024-04-16 22:59:19.540404] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:7 nsid:1 lba:29952 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:28.526 [2024-04-16 22:59:19.540419] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:21:28.526 [2024-04-16 22:59:19.540435] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:30080 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:28.526 [2024-04-16 22:59:19.540449] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:21:28.526 [2024-04-16 22:59:19.540465] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:24448 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:28.526 [2024-04-16 22:59:19.540479] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:21:28.526 [2024-04-16 22:59:19.540494] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:24576 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:28.526 [2024-04-16 22:59:19.540508] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:21:28.526 [2024-04-16 22:59:19.540525] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:17 nsid:1 lba:30208 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:28.526 [2024-04-16 22:59:19.540538] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:21:28.526 [2024-04-16 22:59:19.540554] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:30336 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:28.526 [2024-04-16 22:59:19.540567] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:21:28.526 [2024-04-16 22:59:19.540582] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:24960 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:28.526 [2024-04-16 22:59:19.540596] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:21:28.526 [2024-04-16 22:59:19.540611] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:28 nsid:1 lba:30464 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:28.526 [2024-04-16 22:59:19.540626] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:21:28.526 [2024-04-16 22:59:19.540642] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:26 nsid:1 lba:25088 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:28.526 [2024-04-16 22:59:19.540655] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:21:28.526 [2024-04-16 22:59:19.540671] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:22 nsid:1 lba:25600 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:28.526 [2024-04-16 22:59:19.540685] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:21:28.526 [2024-04-16 22:59:19.540700] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:18 nsid:1 lba:25984 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:28.526 [2024-04-16 22:59:19.540714] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:21:28.526 [2024-04-16 22:59:19.540729] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:24 nsid:1 lba:26496 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:28.526 [2024-04-16 22:59:19.540743] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:21:28.526 [2024-04-16 22:59:19.540758] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:6 nsid:1 lba:30592 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:28.526 [2024-04-16 22:59:19.540777] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:21:28.526 [2024-04-16 22:59:19.540794] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:11 nsid:1 lba:30720 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:28.526 [2024-04-16 22:59:19.540808] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:21:28.526 [2024-04-16 22:59:19.540834] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:49 nsid:1 lba:26624 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:28.526 [2024-04-16 22:59:19.540848] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:21:28.526 [2024-04-16 22:59:19.540864] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:43 nsid:1 lba:26880 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:28.526 [2024-04-16 22:59:19.540878] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:21:28.526 [2024-04-16 22:59:19.540893] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:33 nsid:1 lba:27008 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:28.526 [2024-04-16 22:59:19.540908] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:21:28.526 [2024-04-16 22:59:19.540924] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:34 nsid:1 lba:30848 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:28.526 [2024-04-16 22:59:19.540938] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:21:28.526 [2024-04-16 22:59:19.540954] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:30976 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:28.526 [2024-04-16 22:59:19.540968] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:21:28.526 [2024-04-16 22:59:19.540983] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:57 nsid:1 lba:27392 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:28.526 [2024-04-16 22:59:19.540997] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:21:28.526 [2024-04-16 22:59:19.541012] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:25 nsid:1 lba:31104 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:28.526 [2024-04-16 22:59:19.541027] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:21:28.526 [2024-04-16 22:59:19.541042] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:30 nsid:1 lba:27520 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:28.526 [2024-04-16 22:59:19.541055] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:21:28.526 [2024-04-16 22:59:19.541071] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:16 nsid:1 lba:31232 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:28.526 [2024-04-16 22:59:19.541085] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:21:28.526 [2024-04-16 22:59:19.541100] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:51 nsid:1 lba:27776 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:28.526 [2024-04-16 22:59:19.541114] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:21:28.526 [2024-04-16 22:59:19.541130] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:52 nsid:1 lba:27904 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:28.526 [2024-04-16 22:59:19.541143] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:21:28.526 [2024-04-16 22:59:19.541185] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:37 nsid:1 lba:31360 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:28.526 [2024-04-16 22:59:19.541202] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:21:28.526 [2024-04-16 22:59:19.541218] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:29 nsid:1 lba:28288 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:28.526 [2024-04-16 22:59:19.541233] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:21:28.526 [2024-04-16 22:59:19.541248] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:31 nsid:1 lba:28416 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:28.526 [2024-04-16 22:59:19.541262] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:21:28.526 [2024-04-16 22:59:19.541278] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:21 nsid:1 lba:31488 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:28.526 [2024-04-16 22:59:19.541292] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:21:28.526 [2024-04-16 22:59:19.541308] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:32 nsid:1 lba:28672 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:28.527 [2024-04-16 22:59:19.541322] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:21:28.527 [2024-04-16 22:59:19.541338] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:53 nsid:1 lba:28800 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:28.527 [2024-04-16 22:59:19.541353] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:21:28.527 [2024-04-16 22:59:19.541369] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:47 nsid:1 lba:31616 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:28.527 [2024-04-16 22:59:19.541382] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:21:28.527 [2024-04-16 22:59:19.541398] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:40 nsid:1 lba:28928 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:28.527 [2024-04-16 22:59:19.541412] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:21:28.527 [2024-04-16 22:59:19.541428] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:19 nsid:1 lba:31744 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:28.527 [2024-04-16 22:59:19.541442] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:21:28.527 [2024-04-16 22:59:19.541457] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:20 nsid:1 lba:31872 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:28.527 [2024-04-16 22:59:19.541471] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:21:28.527 [2024-04-16 22:59:19.541491] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:23 nsid:1 lba:32000 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:28.527 [2024-04-16 22:59:19.541504] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:21:28.527 [2024-04-16 22:59:19.541520] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:39 nsid:1 lba:32128 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:28.527 [2024-04-16 22:59:19.541533] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:21:28.527 [2024-04-16 22:59:19.541549] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:27 nsid:1 lba:32256 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:28.527 [2024-04-16 22:59:19.541566] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:21:28.527 [2024-04-16 22:59:19.541583] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:35 nsid:1 lba:32384 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:28.527 [2024-04-16 22:59:19.541603] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:21:28.527 [2024-04-16 22:59:19.541618] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:36 nsid:1 lba:32512 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:28.527 [2024-04-16 22:59:19.541632] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:21:28.527 [2024-04-16 22:59:19.541647] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:54 nsid:1 lba:32640 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:28.527 [2024-04-16 22:59:19.541668] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:21:28.527 [2024-04-16 22:59:19.541683] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:56 nsid:1 lba:32768 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:28.527 [2024-04-16 22:59:19.541697] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:21:28.527 [2024-04-16 22:59:19.541712] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:41 nsid:1 lba:32896 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:28.527 [2024-04-16 22:59:19.541735] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:21:28.527 [2024-04-16 22:59:19.541750] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:50 nsid:1 lba:33024 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:28.527 [2024-04-16 22:59:19.541763] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:21:28.527 [2024-04-16 22:59:19.541778] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:58 nsid:1 lba:33152 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:28.527 [2024-04-16 22:59:19.541800] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:21:28.527 [2024-04-16 22:59:19.541815] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:60 nsid:1 lba:33280 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:28.527 [2024-04-16 22:59:19.541828] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:21:28.527 [2024-04-16 22:59:19.541844] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:44 nsid:1 lba:33408 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:28.527 [2024-04-16 22:59:19.541857] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:21:28.527 [2024-04-16 22:59:19.541872] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:61 nsid:1 lba:33536 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:28.527 [2024-04-16 22:59:19.541886] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:21:28.527 [2024-04-16 22:59:19.541901] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:45 nsid:1 lba:33664 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:28.527 [2024-04-16 22:59:19.541915] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:21:28.527 [2024-04-16 22:59:19.541931] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:46 nsid:1 lba:33792 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:28.527 [2024-04-16 22:59:19.541944] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:21:28.527 [2024-04-16 22:59:19.541963] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:62 nsid:1 lba:33920 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:28.527 [2024-04-16 22:59:19.541977] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:21:28.527 [2024-04-16 22:59:19.541992] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:55 nsid:1 lba:34048 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:28.527 [2024-04-16 22:59:19.542006] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:21:28.527 [2024-04-16 22:59:19.542021] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:63 nsid:1 lba:34176 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:28.527 [2024-04-16 22:59:19.542035] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:21:28.527 [2024-04-16 22:59:19.542050] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:38 nsid:1 lba:34304 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:28.527 [2024-04-16 22:59:19.542064] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:21:28.527 [2024-04-16 22:59:19.542079] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:42 nsid:1 lba:34432 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:28.527 [2024-04-16 22:59:19.542092] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:21:28.527 [2024-04-16 22:59:19.542108] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:48 nsid:1 lba:34560 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:28.527 [2024-04-16 22:59:19.542121] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:21:28.527 [2024-04-16 22:59:19.542136] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:59 nsid:1 lba:34688 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:28.527 [2024-04-16 22:59:19.542151] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:21:28.527 [2024-04-16 22:59:19.542181] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1eecd70 is same with the state(5) to be set 00:21:28.527 [2024-04-16 22:59:19.543763] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode5] resetting controller 00:21:28.527 [2024-04-16 22:59:19.543793] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode6] resetting controller 00:21:28.527 [2024-04-16 22:59:19.543814] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode8] resetting controller 00:21:28.527 [2024-04-16 22:59:19.543842] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode9] resetting controller 00:21:28.527 task offset: 34816 on job bdev=Nvme1n1 fails 00:21:28.527 00:21:28.527 Latency(us) 00:21:28.527 Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:21:28.527 Job: Nvme1n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:21:28.527 Job: Nvme1n1 ended in about 0.79 seconds with error 00:21:28.527 Verification LBA range: start 0x0 length 0x400 00:21:28.527 Nvme1n1 : 0.79 318.01 19.88 81.09 0.00 159347.80 80390.83 128159.29 00:21:28.527 Job: Nvme2n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:21:28.527 Job: Nvme2n1 ended in about 0.79 seconds with error 00:21:28.527 Verification LBA range: start 0x0 length 0x400 00:21:28.527 Nvme2n1 : 0.79 317.56 19.85 80.97 0.00 157836.58 45049.93 139033.41 00:21:28.527 Job: Nvme3n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:21:28.527 Job: Nvme3n1 ended in about 0.79 seconds with error 00:21:28.527 Verification LBA range: start 0x0 length 0x400 00:21:28.527 Nvme3n1 : 0.79 317.11 19.82 80.86 0.00 156504.75 73400.32 125052.40 00:21:28.527 Job: Nvme4n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:21:28.527 Job: Nvme4n1 ended in about 0.79 seconds with error 00:21:28.527 Verification LBA range: start 0x0 length 0x400 00:21:28.527 Nvme4n1 : 0.79 316.66 19.79 80.74 0.00 155171.99 66021.45 125829.12 00:21:28.527 Job: Nvme5n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:21:28.527 Job: Nvme5n1 ended in about 0.80 seconds with error 00:21:28.527 Verification LBA range: start 0x0 length 0x400 00:21:28.527 Nvme5n1 : 0.80 313.48 19.59 79.93 0.00 155289.11 65633.09 127382.57 00:21:28.527 Job: Nvme6n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:21:28.527 Job: Nvme6n1 ended in about 0.80 seconds with error 00:21:28.527 Verification LBA range: start 0x0 length 0x400 00:21:28.527 Nvme6n1 : 0.80 313.05 19.57 79.82 0.00 153966.83 15825.73 146023.92 00:21:28.527 Job: Nvme7n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:21:28.527 Job: Nvme7n1 ended in about 0.80 seconds with error 00:21:28.527 Verification LBA range: start 0x0 length 0x400 00:21:28.527 Nvme7n1 : 0.80 314.48 19.66 80.19 0.00 151661.63 43690.67 129712.73 00:21:28.527 Job: Nvme8n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:21:28.527 Job: Nvme8n1 ended in about 0.81 seconds with error 00:21:28.527 Verification LBA range: start 0x0 length 0x400 00:21:28.527 Nvme8n1 : 0.81 311.26 19.45 26.04 0.00 174857.44 6747.78 156898.04 00:21:28.528 Job: Nvme9n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:21:28.528 Job: Nvme9n1 ended in about 0.81 seconds with error 00:21:28.528 Verification LBA range: start 0x0 length 0x400 00:21:28.528 Nvme9n1 : 0.81 308.09 19.26 28.46 0.00 173859.90 3762.25 152237.70 00:21:28.528 Job: Nvme10n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:21:28.528 Job: Nvme10n1 ended in about 0.81 seconds with error 00:21:28.528 Verification LBA range: start 0x0 length 0x400 00:21:28.528 Nvme10n1 : 0.81 255.67 15.98 78.67 0.00 174063.04 108741.21 140586.86 00:21:28.528 =================================================================================================================== 00:21:28.528 Total : 3085.39 192.84 696.77 0.00 160700.61 3762.25 156898.04 00:21:28.528 [2024-04-16 22:59:19.570224] app.c: 910:spdk_app_stop: *WARNING*: spdk_app_stop'd on non-zero 00:21:28.528 [2024-04-16 22:59:19.570305] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode10] resetting controller 00:21:28.528 [2024-04-16 22:59:19.570719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:28.528 [2024-04-16 22:59:19.570867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:28.528 [2024-04-16 22:59:19.570895] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xcdbe60 with addr=10.0.0.2, port=4420 00:21:28.528 [2024-04-16 22:59:19.570923] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xcdbe60 is same with the state(5) to be set 00:21:28.528 [2024-04-16 22:59:19.570950] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xea8a60 (9): Bad file descriptor 00:21:28.528 [2024-04-16 22:59:19.570983] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xce4f70 (9): Bad file descriptor 00:21:28.528 [2024-04-16 22:59:19.571001] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xc45a50 (9): Bad file descriptor 00:21:28.528 [2024-04-16 22:59:19.571018] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:21:28.528 [2024-04-16 22:59:19.571031] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:21:28.528 [2024-04-16 22:59:19.571047] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:21:28.528 [2024-04-16 22:59:19.571088] bdev_nvme.c:2827:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:21:28.528 [2024-04-16 22:59:19.571142] bdev_nvme.c:2827:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:21:28.528 [2024-04-16 22:59:19.571183] bdev_nvme.c:2827:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:21:28.528 [2024-04-16 22:59:19.571204] bdev_nvme.c:2827:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:21:28.528 [2024-04-16 22:59:19.571913] bdev_nvme.c:2024:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:21:28.528 [2024-04-16 22:59:19.572083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:28.528 [2024-04-16 22:59:19.572227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:28.528 [2024-04-16 22:59:19.572255] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xea38c0 with addr=10.0.0.2, port=4420 00:21:28.528 [2024-04-16 22:59:19.572272] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xea38c0 is same with the state(5) to be set 00:21:28.528 [2024-04-16 22:59:19.572390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:28.528 [2024-04-16 22:59:19.572502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:28.528 [2024-04-16 22:59:19.572528] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xea3490 with addr=10.0.0.2, port=4420 00:21:28.528 [2024-04-16 22:59:19.572543] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xea3490 is same with the state(5) to be set 00:21:28.528 [2024-04-16 22:59:19.572647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:28.528 [2024-04-16 22:59:19.572776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:28.528 [2024-04-16 22:59:19.572800] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xcdba30 with addr=10.0.0.2, port=4420 00:21:28.528 [2024-04-16 22:59:19.572815] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xcdba30 is same with the state(5) to be set 00:21:28.528 [2024-04-16 22:59:19.572924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:28.528 [2024-04-16 22:59:19.573040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:28.528 [2024-04-16 22:59:19.573065] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xe66830 with addr=10.0.0.2, port=4420 00:21:28.528 [2024-04-16 22:59:19.573081] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe66830 is same with the state(5) to be set 00:21:28.528 [2024-04-16 22:59:19.573186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:28.528 [2024-04-16 22:59:19.573303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:28.528 [2024-04-16 22:59:19.573330] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xd1d4f0 with addr=10.0.0.2, port=4420 00:21:28.528 [2024-04-16 22:59:19.573346] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd1d4f0 is same with the state(5) to be set 00:21:28.528 [2024-04-16 22:59:19.573365] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xcdbe60 (9): Bad file descriptor 00:21:28.528 [2024-04-16 22:59:19.573382] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode2] Ctrlr is in error state 00:21:28.528 [2024-04-16 22:59:19.573394] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode2] controller reinitialization failed 00:21:28.528 [2024-04-16 22:59:19.573407] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode2] in failed state. 00:21:28.528 [2024-04-16 22:59:19.573427] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode3] Ctrlr is in error state 00:21:28.528 [2024-04-16 22:59:19.573442] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode3] controller reinitialization failed 00:21:28.528 [2024-04-16 22:59:19.573455] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode3] in failed state. 00:21:28.528 [2024-04-16 22:59:19.573473] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode4] Ctrlr is in error state 00:21:28.528 [2024-04-16 22:59:19.573491] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode4] controller reinitialization failed 00:21:28.528 [2024-04-16 22:59:19.573504] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode4] in failed state. 00:21:28.528 [2024-04-16 22:59:19.573546] bdev_nvme.c:2827:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:21:28.528 [2024-04-16 22:59:19.573574] bdev_nvme.c:2827:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:21:28.528 [2024-04-16 22:59:19.573593] bdev_nvme.c:2827:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:21:28.528 [2024-04-16 22:59:19.573609] bdev_nvme.c:2827:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:21:28.528 [2024-04-16 22:59:19.573969] bdev_nvme.c:2024:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:21:28.528 [2024-04-16 22:59:19.573992] bdev_nvme.c:2024:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:21:28.528 [2024-04-16 22:59:19.574004] bdev_nvme.c:2024:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:21:28.528 [2024-04-16 22:59:19.574025] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xea38c0 (9): Bad file descriptor 00:21:28.528 [2024-04-16 22:59:19.574045] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xea3490 (9): Bad file descriptor 00:21:28.528 [2024-04-16 22:59:19.574062] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xcdba30 (9): Bad file descriptor 00:21:28.528 [2024-04-16 22:59:19.574079] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xe66830 (9): Bad file descriptor 00:21:28.528 [2024-04-16 22:59:19.574095] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xd1d4f0 (9): Bad file descriptor 00:21:28.528 [2024-04-16 22:59:19.574110] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode7] Ctrlr is in error state 00:21:28.528 [2024-04-16 22:59:19.574122] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode7] controller reinitialization failed 00:21:28.528 [2024-04-16 22:59:19.574134] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode7] in failed state. 00:21:28.528 [2024-04-16 22:59:19.574209] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:21:28.528 [2024-04-16 22:59:19.574233] bdev_nvme.c:2024:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:21:28.528 [2024-04-16 22:59:19.574256] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode5] Ctrlr is in error state 00:21:28.528 [2024-04-16 22:59:19.574271] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode5] controller reinitialization failed 00:21:28.528 [2024-04-16 22:59:19.574284] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode5] in failed state. 00:21:28.528 [2024-04-16 22:59:19.574300] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode6] Ctrlr is in error state 00:21:28.528 [2024-04-16 22:59:19.574313] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode6] controller reinitialization failed 00:21:28.528 [2024-04-16 22:59:19.574326] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode6] in failed state. 00:21:28.528 [2024-04-16 22:59:19.574341] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode8] Ctrlr is in error state 00:21:28.528 [2024-04-16 22:59:19.574355] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode8] controller reinitialization failed 00:21:28.528 [2024-04-16 22:59:19.574368] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode8] in failed state. 00:21:28.528 [2024-04-16 22:59:19.574383] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode9] Ctrlr is in error state 00:21:28.528 [2024-04-16 22:59:19.574397] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode9] controller reinitialization failed 00:21:28.528 [2024-04-16 22:59:19.574414] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode9] in failed state. 00:21:28.528 [2024-04-16 22:59:19.574430] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode10] Ctrlr is in error state 00:21:28.528 [2024-04-16 22:59:19.574444] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode10] controller reinitialization failed 00:21:28.529 [2024-04-16 22:59:19.574456] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode10] in failed state. 00:21:28.529 [2024-04-16 22:59:19.574503] bdev_nvme.c:2024:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:21:28.529 [2024-04-16 22:59:19.574522] bdev_nvme.c:2024:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:21:28.529 [2024-04-16 22:59:19.574534] bdev_nvme.c:2024:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:21:28.529 [2024-04-16 22:59:19.574544] bdev_nvme.c:2024:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:21:28.529 [2024-04-16 22:59:19.574555] bdev_nvme.c:2024:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:21:28.529 [2024-04-16 22:59:19.574682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:28.529 [2024-04-16 22:59:19.574802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:21:28.529 [2024-04-16 22:59:19.574826] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xce2210 with addr=10.0.0.2, port=4420 00:21:28.529 [2024-04-16 22:59:19.574841] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xce2210 is same with the state(5) to be set 00:21:28.529 [2024-04-16 22:59:19.574883] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xce2210 (9): Bad file descriptor 00:21:28.529 [2024-04-16 22:59:19.574925] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:21:28.529 [2024-04-16 22:59:19.574942] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:21:28.529 [2024-04-16 22:59:19.574955] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:21:28.529 [2024-04-16 22:59:19.575002] bdev_nvme.c:2024:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:21:29.105 22:59:20 -- target/shutdown.sh@135 -- # nvmfpid= 00:21:29.105 22:59:20 -- target/shutdown.sh@138 -- # sleep 1 00:21:30.046 22:59:21 -- target/shutdown.sh@141 -- # kill -9 337499 00:21:30.046 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/shutdown.sh: line 141: kill: (337499) - No such process 00:21:30.046 22:59:21 -- target/shutdown.sh@141 -- # true 00:21:30.046 22:59:21 -- target/shutdown.sh@143 -- # stoptarget 00:21:30.046 22:59:21 -- target/shutdown.sh@41 -- # rm -f ./local-job0-0-verify.state 00:21:30.046 22:59:21 -- target/shutdown.sh@42 -- # rm -rf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/bdevperf.conf 00:21:30.046 22:59:21 -- target/shutdown.sh@43 -- # rm -rf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/rpcs.txt 00:21:30.046 22:59:21 -- target/shutdown.sh@45 -- # nvmftestfini 00:21:30.046 22:59:21 -- nvmf/common.sh@476 -- # nvmfcleanup 00:21:30.046 22:59:21 -- nvmf/common.sh@116 -- # sync 00:21:30.046 22:59:21 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:21:30.046 22:59:21 -- nvmf/common.sh@119 -- # set +e 00:21:30.046 22:59:21 -- nvmf/common.sh@120 -- # for i in {1..20} 00:21:30.046 22:59:21 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:21:30.046 rmmod nvme_tcp 00:21:30.046 rmmod nvme_fabrics 00:21:30.046 rmmod nvme_keyring 00:21:30.046 22:59:21 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:21:30.046 22:59:21 -- nvmf/common.sh@123 -- # set -e 00:21:30.046 22:59:21 -- nvmf/common.sh@124 -- # return 0 00:21:30.046 22:59:21 -- nvmf/common.sh@477 -- # '[' -n '' ']' 00:21:30.046 22:59:21 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:21:30.046 22:59:21 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:21:30.046 22:59:21 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:21:30.046 22:59:21 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:21:30.046 22:59:21 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:21:30.046 22:59:21 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:21:30.046 22:59:21 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:21:30.046 22:59:21 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:21:32.580 22:59:23 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:21:32.580 00:21:32.580 real 0m7.940s 00:21:32.580 user 0m20.528s 00:21:32.580 sys 0m1.451s 00:21:32.580 22:59:23 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:21:32.580 22:59:23 -- common/autotest_common.sh@10 -- # set +x 00:21:32.580 ************************************ 00:21:32.580 END TEST nvmf_shutdown_tc3 00:21:32.580 ************************************ 00:21:32.580 22:59:23 -- target/shutdown.sh@150 -- # trap - SIGINT SIGTERM EXIT 00:21:32.580 00:21:32.580 real 0m28.422s 00:21:32.580 user 1m21.697s 00:21:32.580 sys 0m6.343s 00:21:32.580 22:59:23 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:21:32.580 22:59:23 -- common/autotest_common.sh@10 -- # set +x 00:21:32.580 ************************************ 00:21:32.580 END TEST nvmf_shutdown 00:21:32.580 ************************************ 00:21:32.580 22:59:23 -- nvmf/nvmf.sh@85 -- # timing_exit target 00:21:32.580 22:59:23 -- common/autotest_common.sh@718 -- # xtrace_disable 00:21:32.580 22:59:23 -- common/autotest_common.sh@10 -- # set +x 00:21:32.580 22:59:23 -- nvmf/nvmf.sh@87 -- # timing_enter host 00:21:32.580 22:59:23 -- common/autotest_common.sh@712 -- # xtrace_disable 00:21:32.580 22:59:23 -- common/autotest_common.sh@10 -- # set +x 00:21:32.580 22:59:23 -- nvmf/nvmf.sh@89 -- # [[ 0 -eq 0 ]] 00:21:32.580 22:59:23 -- nvmf/nvmf.sh@90 -- # run_test nvmf_multicontroller /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/multicontroller.sh --transport=tcp 00:21:32.580 22:59:23 -- common/autotest_common.sh@1077 -- # '[' 3 -le 1 ']' 00:21:32.580 22:59:23 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:21:32.580 22:59:23 -- common/autotest_common.sh@10 -- # set +x 00:21:32.580 ************************************ 00:21:32.580 START TEST nvmf_multicontroller 00:21:32.580 ************************************ 00:21:32.580 22:59:23 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/multicontroller.sh --transport=tcp 00:21:32.580 * Looking for test storage... 00:21:32.580 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host 00:21:32.580 22:59:23 -- host/multicontroller.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:21:32.581 22:59:23 -- nvmf/common.sh@7 -- # uname -s 00:21:32.581 22:59:23 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:21:32.581 22:59:23 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:21:32.581 22:59:23 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:21:32.581 22:59:23 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:21:32.581 22:59:23 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:21:32.581 22:59:23 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:21:32.581 22:59:23 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:21:32.581 22:59:23 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:21:32.581 22:59:23 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:21:32.581 22:59:23 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:21:32.581 22:59:23 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:21:32.581 22:59:23 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:21:32.581 22:59:23 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:21:32.581 22:59:23 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:21:32.581 22:59:23 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:21:32.581 22:59:23 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:21:32.581 22:59:23 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:21:32.581 22:59:23 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:21:32.581 22:59:23 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:21:32.581 22:59:23 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:21:32.581 22:59:23 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:21:32.581 22:59:23 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:21:32.581 22:59:23 -- paths/export.sh@5 -- # export PATH 00:21:32.581 22:59:23 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:21:32.581 22:59:23 -- nvmf/common.sh@46 -- # : 0 00:21:32.581 22:59:23 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:21:32.581 22:59:23 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:21:32.581 22:59:23 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:21:32.581 22:59:23 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:21:32.581 22:59:23 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:21:32.581 22:59:23 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:21:32.581 22:59:23 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:21:32.581 22:59:23 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:21:32.581 22:59:23 -- host/multicontroller.sh@11 -- # MALLOC_BDEV_SIZE=64 00:21:32.581 22:59:23 -- host/multicontroller.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:21:32.581 22:59:23 -- host/multicontroller.sh@13 -- # NVMF_HOST_FIRST_PORT=60000 00:21:32.581 22:59:23 -- host/multicontroller.sh@14 -- # NVMF_HOST_SECOND_PORT=60001 00:21:32.581 22:59:23 -- host/multicontroller.sh@16 -- # bdevperf_rpc_sock=/var/tmp/bdevperf.sock 00:21:32.581 22:59:23 -- host/multicontroller.sh@18 -- # '[' tcp == rdma ']' 00:21:32.581 22:59:23 -- host/multicontroller.sh@23 -- # nvmftestinit 00:21:32.581 22:59:23 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:21:32.581 22:59:23 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:21:32.581 22:59:23 -- nvmf/common.sh@436 -- # prepare_net_devs 00:21:32.581 22:59:23 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:21:32.581 22:59:23 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:21:32.581 22:59:23 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:21:32.581 22:59:23 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:21:32.581 22:59:23 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:21:32.581 22:59:23 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:21:32.581 22:59:23 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:21:32.581 22:59:23 -- nvmf/common.sh@284 -- # xtrace_disable 00:21:32.581 22:59:23 -- common/autotest_common.sh@10 -- # set +x 00:21:34.483 22:59:25 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:21:34.483 22:59:25 -- nvmf/common.sh@290 -- # pci_devs=() 00:21:34.483 22:59:25 -- nvmf/common.sh@290 -- # local -a pci_devs 00:21:34.483 22:59:25 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:21:34.483 22:59:25 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:21:34.483 22:59:25 -- nvmf/common.sh@292 -- # pci_drivers=() 00:21:34.483 22:59:25 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:21:34.483 22:59:25 -- nvmf/common.sh@294 -- # net_devs=() 00:21:34.483 22:59:25 -- nvmf/common.sh@294 -- # local -ga net_devs 00:21:34.483 22:59:25 -- nvmf/common.sh@295 -- # e810=() 00:21:34.483 22:59:25 -- nvmf/common.sh@295 -- # local -ga e810 00:21:34.483 22:59:25 -- nvmf/common.sh@296 -- # x722=() 00:21:34.483 22:59:25 -- nvmf/common.sh@296 -- # local -ga x722 00:21:34.483 22:59:25 -- nvmf/common.sh@297 -- # mlx=() 00:21:34.483 22:59:25 -- nvmf/common.sh@297 -- # local -ga mlx 00:21:34.483 22:59:25 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:21:34.483 22:59:25 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:21:34.483 22:59:25 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:21:34.483 22:59:25 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:21:34.483 22:59:25 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:21:34.483 22:59:25 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:21:34.483 22:59:25 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:21:34.483 22:59:25 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:21:34.483 22:59:25 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:21:34.483 22:59:25 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:21:34.483 22:59:25 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:21:34.483 22:59:25 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:21:34.483 22:59:25 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:21:34.483 22:59:25 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:21:34.483 22:59:25 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:21:34.483 22:59:25 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:21:34.483 22:59:25 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:21:34.483 22:59:25 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:21:34.483 22:59:25 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:21:34.483 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:21:34.483 22:59:25 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:21:34.483 22:59:25 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:21:34.483 22:59:25 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:21:34.483 22:59:25 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:21:34.483 22:59:25 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:21:34.483 22:59:25 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:21:34.483 22:59:25 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:21:34.483 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:21:34.483 22:59:25 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:21:34.483 22:59:25 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:21:34.483 22:59:25 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:21:34.483 22:59:25 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:21:34.483 22:59:25 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:21:34.483 22:59:25 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:21:34.483 22:59:25 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:21:34.483 22:59:25 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:21:34.483 22:59:25 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:21:34.483 22:59:25 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:21:34.483 22:59:25 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:21:34.483 22:59:25 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:21:34.483 22:59:25 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:21:34.483 Found net devices under 0000:0a:00.0: cvl_0_0 00:21:34.483 22:59:25 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:21:34.483 22:59:25 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:21:34.483 22:59:25 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:21:34.483 22:59:25 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:21:34.483 22:59:25 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:21:34.483 22:59:25 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:21:34.483 Found net devices under 0000:0a:00.1: cvl_0_1 00:21:34.483 22:59:25 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:21:34.483 22:59:25 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:21:34.483 22:59:25 -- nvmf/common.sh@402 -- # is_hw=yes 00:21:34.483 22:59:25 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:21:34.483 22:59:25 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:21:34.483 22:59:25 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:21:34.483 22:59:25 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:21:34.483 22:59:25 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:21:34.483 22:59:25 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:21:34.483 22:59:25 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:21:34.483 22:59:25 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:21:34.484 22:59:25 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:21:34.484 22:59:25 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:21:34.484 22:59:25 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:21:34.484 22:59:25 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:21:34.484 22:59:25 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:21:34.484 22:59:25 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:21:34.484 22:59:25 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:21:34.484 22:59:25 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:21:34.484 22:59:25 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:21:34.484 22:59:25 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:21:34.484 22:59:25 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:21:34.484 22:59:25 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:21:34.484 22:59:25 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:21:34.484 22:59:25 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:21:34.484 22:59:25 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:21:34.484 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:21:34.484 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.153 ms 00:21:34.484 00:21:34.484 --- 10.0.0.2 ping statistics --- 00:21:34.484 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:21:34.484 rtt min/avg/max/mdev = 0.153/0.153/0.153/0.000 ms 00:21:34.484 22:59:25 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:21:34.484 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:21:34.484 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.078 ms 00:21:34.484 00:21:34.484 --- 10.0.0.1 ping statistics --- 00:21:34.484 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:21:34.484 rtt min/avg/max/mdev = 0.078/0.078/0.078/0.000 ms 00:21:34.484 22:59:25 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:21:34.484 22:59:25 -- nvmf/common.sh@410 -- # return 0 00:21:34.484 22:59:25 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:21:34.484 22:59:25 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:21:34.484 22:59:25 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:21:34.484 22:59:25 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:21:34.484 22:59:25 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:21:34.484 22:59:25 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:21:34.484 22:59:25 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:21:34.484 22:59:25 -- host/multicontroller.sh@25 -- # nvmfappstart -m 0xE 00:21:34.484 22:59:25 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:21:34.484 22:59:25 -- common/autotest_common.sh@712 -- # xtrace_disable 00:21:34.484 22:59:25 -- common/autotest_common.sh@10 -- # set +x 00:21:34.484 22:59:25 -- nvmf/common.sh@469 -- # nvmfpid=340047 00:21:34.484 22:59:25 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xE 00:21:34.484 22:59:25 -- nvmf/common.sh@470 -- # waitforlisten 340047 00:21:34.484 22:59:25 -- common/autotest_common.sh@819 -- # '[' -z 340047 ']' 00:21:34.484 22:59:25 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk.sock 00:21:34.484 22:59:25 -- common/autotest_common.sh@824 -- # local max_retries=100 00:21:34.484 22:59:25 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:21:34.484 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:21:34.484 22:59:25 -- common/autotest_common.sh@828 -- # xtrace_disable 00:21:34.484 22:59:25 -- common/autotest_common.sh@10 -- # set +x 00:21:34.484 [2024-04-16 22:59:25.423453] Starting SPDK v24.01.1-pre git sha1 4b134b4ab / DPDK 23.11.0 initialization... 00:21:34.484 [2024-04-16 22:59:25.423552] [ DPDK EAL parameters: nvmf -c 0xE --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:21:34.484 EAL: No free 2048 kB hugepages reported on node 1 00:21:34.484 [2024-04-16 22:59:25.486966] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 3 00:21:34.484 [2024-04-16 22:59:25.595261] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:21:34.484 [2024-04-16 22:59:25.595414] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:21:34.484 [2024-04-16 22:59:25.595431] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:21:34.484 [2024-04-16 22:59:25.595442] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:21:34.484 [2024-04-16 22:59:25.595573] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:21:34.484 [2024-04-16 22:59:25.595632] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:21:34.484 [2024-04-16 22:59:25.595628] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:21:35.419 22:59:26 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:21:35.419 22:59:26 -- common/autotest_common.sh@852 -- # return 0 00:21:35.419 22:59:26 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:21:35.419 22:59:26 -- common/autotest_common.sh@718 -- # xtrace_disable 00:21:35.419 22:59:26 -- common/autotest_common.sh@10 -- # set +x 00:21:35.419 22:59:26 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:21:35.419 22:59:26 -- host/multicontroller.sh@27 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:21:35.419 22:59:26 -- common/autotest_common.sh@551 -- # xtrace_disable 00:21:35.419 22:59:26 -- common/autotest_common.sh@10 -- # set +x 00:21:35.419 [2024-04-16 22:59:26.409388] tcp.c: 659:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:21:35.419 22:59:26 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:21:35.419 22:59:26 -- host/multicontroller.sh@29 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc0 00:21:35.419 22:59:26 -- common/autotest_common.sh@551 -- # xtrace_disable 00:21:35.419 22:59:26 -- common/autotest_common.sh@10 -- # set +x 00:21:35.419 Malloc0 00:21:35.419 22:59:26 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:21:35.419 22:59:26 -- host/multicontroller.sh@30 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:21:35.419 22:59:26 -- common/autotest_common.sh@551 -- # xtrace_disable 00:21:35.419 22:59:26 -- common/autotest_common.sh@10 -- # set +x 00:21:35.419 22:59:26 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:21:35.419 22:59:26 -- host/multicontroller.sh@31 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:21:35.419 22:59:26 -- common/autotest_common.sh@551 -- # xtrace_disable 00:21:35.419 22:59:26 -- common/autotest_common.sh@10 -- # set +x 00:21:35.419 22:59:26 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:21:35.419 22:59:26 -- host/multicontroller.sh@33 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:21:35.419 22:59:26 -- common/autotest_common.sh@551 -- # xtrace_disable 00:21:35.419 22:59:26 -- common/autotest_common.sh@10 -- # set +x 00:21:35.419 [2024-04-16 22:59:26.475701] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:21:35.419 22:59:26 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:21:35.419 22:59:26 -- host/multicontroller.sh@34 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4421 00:21:35.419 22:59:26 -- common/autotest_common.sh@551 -- # xtrace_disable 00:21:35.419 22:59:26 -- common/autotest_common.sh@10 -- # set +x 00:21:35.419 [2024-04-16 22:59:26.483635] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4421 *** 00:21:35.419 22:59:26 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:21:35.419 22:59:26 -- host/multicontroller.sh@36 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc1 00:21:35.419 22:59:26 -- common/autotest_common.sh@551 -- # xtrace_disable 00:21:35.419 22:59:26 -- common/autotest_common.sh@10 -- # set +x 00:21:35.419 Malloc1 00:21:35.419 22:59:26 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:21:35.419 22:59:26 -- host/multicontroller.sh@37 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode2 -a -s SPDK00000000000002 00:21:35.419 22:59:26 -- common/autotest_common.sh@551 -- # xtrace_disable 00:21:35.419 22:59:26 -- common/autotest_common.sh@10 -- # set +x 00:21:35.419 22:59:26 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:21:35.419 22:59:26 -- host/multicontroller.sh@38 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode2 Malloc1 00:21:35.419 22:59:26 -- common/autotest_common.sh@551 -- # xtrace_disable 00:21:35.419 22:59:26 -- common/autotest_common.sh@10 -- # set +x 00:21:35.419 22:59:26 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:21:35.419 22:59:26 -- host/multicontroller.sh@40 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode2 -t tcp -a 10.0.0.2 -s 4420 00:21:35.419 22:59:26 -- common/autotest_common.sh@551 -- # xtrace_disable 00:21:35.419 22:59:26 -- common/autotest_common.sh@10 -- # set +x 00:21:35.419 22:59:26 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:21:35.419 22:59:26 -- host/multicontroller.sh@41 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode2 -t tcp -a 10.0.0.2 -s 4421 00:21:35.419 22:59:26 -- common/autotest_common.sh@551 -- # xtrace_disable 00:21:35.419 22:59:26 -- common/autotest_common.sh@10 -- # set +x 00:21:35.419 22:59:26 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:21:35.419 22:59:26 -- host/multicontroller.sh@44 -- # bdevperf_pid=340205 00:21:35.419 22:59:26 -- host/multicontroller.sh@43 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -z -r /var/tmp/bdevperf.sock -q 128 -o 4096 -w write -t 1 -f 00:21:35.419 22:59:26 -- host/multicontroller.sh@46 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; pap "$testdir/try.txt"; killprocess $bdevperf_pid; nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:21:35.419 22:59:26 -- host/multicontroller.sh@47 -- # waitforlisten 340205 /var/tmp/bdevperf.sock 00:21:35.419 22:59:26 -- common/autotest_common.sh@819 -- # '[' -z 340205 ']' 00:21:35.419 22:59:26 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:21:35.419 22:59:26 -- common/autotest_common.sh@824 -- # local max_retries=100 00:21:35.419 22:59:26 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:21:35.419 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:21:35.419 22:59:26 -- common/autotest_common.sh@828 -- # xtrace_disable 00:21:35.419 22:59:26 -- common/autotest_common.sh@10 -- # set +x 00:21:36.799 22:59:27 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:21:36.799 22:59:27 -- common/autotest_common.sh@852 -- # return 0 00:21:36.799 22:59:27 -- host/multicontroller.sh@50 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -i 10.0.0.2 -c 60000 00:21:36.799 22:59:27 -- common/autotest_common.sh@551 -- # xtrace_disable 00:21:36.799 22:59:27 -- common/autotest_common.sh@10 -- # set +x 00:21:36.799 NVMe0n1 00:21:36.799 22:59:27 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:21:36.799 22:59:27 -- host/multicontroller.sh@54 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_get_controllers 00:21:36.799 22:59:27 -- host/multicontroller.sh@54 -- # grep -c NVMe 00:21:36.799 22:59:27 -- common/autotest_common.sh@551 -- # xtrace_disable 00:21:36.799 22:59:27 -- common/autotest_common.sh@10 -- # set +x 00:21:36.799 22:59:27 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:21:36.799 1 00:21:36.799 22:59:27 -- host/multicontroller.sh@60 -- # NOT rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -i 10.0.0.2 -c 60000 -q nqn.2021-09-7.io.spdk:00001 00:21:36.799 22:59:27 -- common/autotest_common.sh@640 -- # local es=0 00:21:36.799 22:59:27 -- common/autotest_common.sh@642 -- # valid_exec_arg rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -i 10.0.0.2 -c 60000 -q nqn.2021-09-7.io.spdk:00001 00:21:36.799 22:59:27 -- common/autotest_common.sh@628 -- # local arg=rpc_cmd 00:21:36.799 22:59:27 -- common/autotest_common.sh@632 -- # case "$(type -t "$arg")" in 00:21:36.799 22:59:27 -- common/autotest_common.sh@632 -- # type -t rpc_cmd 00:21:36.799 22:59:27 -- common/autotest_common.sh@632 -- # case "$(type -t "$arg")" in 00:21:36.799 22:59:27 -- common/autotest_common.sh@643 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -i 10.0.0.2 -c 60000 -q nqn.2021-09-7.io.spdk:00001 00:21:36.799 22:59:27 -- common/autotest_common.sh@551 -- # xtrace_disable 00:21:36.799 22:59:27 -- common/autotest_common.sh@10 -- # set +x 00:21:36.799 request: 00:21:36.799 { 00:21:36.799 "name": "NVMe0", 00:21:36.799 "trtype": "tcp", 00:21:36.799 "traddr": "10.0.0.2", 00:21:36.799 "hostnqn": "nqn.2021-09-7.io.spdk:00001", 00:21:36.799 "hostaddr": "10.0.0.2", 00:21:36.799 "hostsvcid": "60000", 00:21:36.799 "adrfam": "ipv4", 00:21:36.799 "trsvcid": "4420", 00:21:36.799 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:21:36.799 "method": "bdev_nvme_attach_controller", 00:21:36.799 "req_id": 1 00:21:36.799 } 00:21:36.799 Got JSON-RPC error response 00:21:36.799 response: 00:21:36.799 { 00:21:36.799 "code": -114, 00:21:36.799 "message": "A controller named NVMe0 already exists with the specified network path\n" 00:21:36.799 } 00:21:36.799 22:59:27 -- common/autotest_common.sh@579 -- # [[ 1 == 0 ]] 00:21:36.799 22:59:27 -- common/autotest_common.sh@643 -- # es=1 00:21:36.799 22:59:27 -- common/autotest_common.sh@651 -- # (( es > 128 )) 00:21:36.799 22:59:27 -- common/autotest_common.sh@662 -- # [[ -n '' ]] 00:21:36.799 22:59:27 -- common/autotest_common.sh@667 -- # (( !es == 0 )) 00:21:36.799 22:59:27 -- host/multicontroller.sh@65 -- # NOT rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode2 -i 10.0.0.2 -c 60000 00:21:36.799 22:59:27 -- common/autotest_common.sh@640 -- # local es=0 00:21:36.799 22:59:27 -- common/autotest_common.sh@642 -- # valid_exec_arg rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode2 -i 10.0.0.2 -c 60000 00:21:36.799 22:59:27 -- common/autotest_common.sh@628 -- # local arg=rpc_cmd 00:21:36.799 22:59:27 -- common/autotest_common.sh@632 -- # case "$(type -t "$arg")" in 00:21:36.799 22:59:27 -- common/autotest_common.sh@632 -- # type -t rpc_cmd 00:21:36.799 22:59:27 -- common/autotest_common.sh@632 -- # case "$(type -t "$arg")" in 00:21:36.799 22:59:27 -- common/autotest_common.sh@643 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode2 -i 10.0.0.2 -c 60000 00:21:36.799 22:59:27 -- common/autotest_common.sh@551 -- # xtrace_disable 00:21:36.799 22:59:27 -- common/autotest_common.sh@10 -- # set +x 00:21:36.799 request: 00:21:36.799 { 00:21:36.799 "name": "NVMe0", 00:21:36.799 "trtype": "tcp", 00:21:36.799 "traddr": "10.0.0.2", 00:21:36.799 "hostaddr": "10.0.0.2", 00:21:36.799 "hostsvcid": "60000", 00:21:36.799 "adrfam": "ipv4", 00:21:36.799 "trsvcid": "4420", 00:21:36.799 "subnqn": "nqn.2016-06.io.spdk:cnode2", 00:21:36.799 "method": "bdev_nvme_attach_controller", 00:21:36.799 "req_id": 1 00:21:36.799 } 00:21:36.799 Got JSON-RPC error response 00:21:36.799 response: 00:21:36.799 { 00:21:36.799 "code": -114, 00:21:36.799 "message": "A controller named NVMe0 already exists with the specified network path\n" 00:21:36.799 } 00:21:36.799 22:59:27 -- common/autotest_common.sh@579 -- # [[ 1 == 0 ]] 00:21:36.799 22:59:27 -- common/autotest_common.sh@643 -- # es=1 00:21:36.799 22:59:27 -- common/autotest_common.sh@651 -- # (( es > 128 )) 00:21:36.799 22:59:27 -- common/autotest_common.sh@662 -- # [[ -n '' ]] 00:21:36.799 22:59:27 -- common/autotest_common.sh@667 -- # (( !es == 0 )) 00:21:36.799 22:59:27 -- host/multicontroller.sh@69 -- # NOT rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -i 10.0.0.2 -c 60000 -x disable 00:21:36.799 22:59:27 -- common/autotest_common.sh@640 -- # local es=0 00:21:36.800 22:59:27 -- common/autotest_common.sh@642 -- # valid_exec_arg rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -i 10.0.0.2 -c 60000 -x disable 00:21:36.800 22:59:27 -- common/autotest_common.sh@628 -- # local arg=rpc_cmd 00:21:36.800 22:59:27 -- common/autotest_common.sh@632 -- # case "$(type -t "$arg")" in 00:21:36.800 22:59:27 -- common/autotest_common.sh@632 -- # type -t rpc_cmd 00:21:36.800 22:59:27 -- common/autotest_common.sh@632 -- # case "$(type -t "$arg")" in 00:21:36.800 22:59:27 -- common/autotest_common.sh@643 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -i 10.0.0.2 -c 60000 -x disable 00:21:36.800 22:59:27 -- common/autotest_common.sh@551 -- # xtrace_disable 00:21:36.800 22:59:27 -- common/autotest_common.sh@10 -- # set +x 00:21:36.800 request: 00:21:36.800 { 00:21:36.800 "name": "NVMe0", 00:21:36.800 "trtype": "tcp", 00:21:36.800 "traddr": "10.0.0.2", 00:21:36.800 "hostaddr": "10.0.0.2", 00:21:36.800 "hostsvcid": "60000", 00:21:36.800 "adrfam": "ipv4", 00:21:36.800 "trsvcid": "4420", 00:21:36.800 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:21:36.800 "multipath": "disable", 00:21:36.800 "method": "bdev_nvme_attach_controller", 00:21:36.800 "req_id": 1 00:21:36.800 } 00:21:36.800 Got JSON-RPC error response 00:21:36.800 response: 00:21:36.800 { 00:21:36.800 "code": -114, 00:21:36.800 "message": "A controller named NVMe0 already exists and multipath is disabled\n" 00:21:36.800 } 00:21:36.800 22:59:27 -- common/autotest_common.sh@579 -- # [[ 1 == 0 ]] 00:21:36.800 22:59:27 -- common/autotest_common.sh@643 -- # es=1 00:21:36.800 22:59:27 -- common/autotest_common.sh@651 -- # (( es > 128 )) 00:21:36.800 22:59:27 -- common/autotest_common.sh@662 -- # [[ -n '' ]] 00:21:36.800 22:59:27 -- common/autotest_common.sh@667 -- # (( !es == 0 )) 00:21:36.800 22:59:27 -- host/multicontroller.sh@74 -- # NOT rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -i 10.0.0.2 -c 60000 -x failover 00:21:36.800 22:59:27 -- common/autotest_common.sh@640 -- # local es=0 00:21:36.800 22:59:27 -- common/autotest_common.sh@642 -- # valid_exec_arg rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -i 10.0.0.2 -c 60000 -x failover 00:21:36.800 22:59:27 -- common/autotest_common.sh@628 -- # local arg=rpc_cmd 00:21:36.800 22:59:27 -- common/autotest_common.sh@632 -- # case "$(type -t "$arg")" in 00:21:36.800 22:59:27 -- common/autotest_common.sh@632 -- # type -t rpc_cmd 00:21:36.800 22:59:27 -- common/autotest_common.sh@632 -- # case "$(type -t "$arg")" in 00:21:36.800 22:59:27 -- common/autotest_common.sh@643 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -i 10.0.0.2 -c 60000 -x failover 00:21:36.800 22:59:27 -- common/autotest_common.sh@551 -- # xtrace_disable 00:21:36.800 22:59:27 -- common/autotest_common.sh@10 -- # set +x 00:21:36.800 request: 00:21:36.800 { 00:21:36.800 "name": "NVMe0", 00:21:36.800 "trtype": "tcp", 00:21:36.800 "traddr": "10.0.0.2", 00:21:36.800 "hostaddr": "10.0.0.2", 00:21:36.800 "hostsvcid": "60000", 00:21:36.800 "adrfam": "ipv4", 00:21:36.800 "trsvcid": "4420", 00:21:36.800 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:21:36.800 "multipath": "failover", 00:21:36.800 "method": "bdev_nvme_attach_controller", 00:21:36.800 "req_id": 1 00:21:36.800 } 00:21:36.800 Got JSON-RPC error response 00:21:36.800 response: 00:21:36.800 { 00:21:36.800 "code": -114, 00:21:36.800 "message": "A controller named NVMe0 already exists with the specified network path\n" 00:21:36.800 } 00:21:36.800 22:59:27 -- common/autotest_common.sh@579 -- # [[ 1 == 0 ]] 00:21:36.800 22:59:27 -- common/autotest_common.sh@643 -- # es=1 00:21:36.800 22:59:27 -- common/autotest_common.sh@651 -- # (( es > 128 )) 00:21:36.800 22:59:27 -- common/autotest_common.sh@662 -- # [[ -n '' ]] 00:21:36.800 22:59:27 -- common/autotest_common.sh@667 -- # (( !es == 0 )) 00:21:36.800 22:59:27 -- host/multicontroller.sh@79 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4421 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 00:21:36.800 22:59:27 -- common/autotest_common.sh@551 -- # xtrace_disable 00:21:36.800 22:59:27 -- common/autotest_common.sh@10 -- # set +x 00:21:37.058 00:21:37.058 22:59:27 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:21:37.058 22:59:27 -- host/multicontroller.sh@83 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_detach_controller NVMe0 -t tcp -a 10.0.0.2 -s 4421 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 00:21:37.058 22:59:27 -- common/autotest_common.sh@551 -- # xtrace_disable 00:21:37.058 22:59:27 -- common/autotest_common.sh@10 -- # set +x 00:21:37.058 22:59:27 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:21:37.058 22:59:27 -- host/multicontroller.sh@87 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe1 -t tcp -a 10.0.0.2 -s 4421 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -i 10.0.0.2 -c 60000 00:21:37.058 22:59:27 -- common/autotest_common.sh@551 -- # xtrace_disable 00:21:37.058 22:59:27 -- common/autotest_common.sh@10 -- # set +x 00:21:37.058 00:21:37.058 22:59:28 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:21:37.058 22:59:28 -- host/multicontroller.sh@90 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_get_controllers 00:21:37.058 22:59:28 -- common/autotest_common.sh@551 -- # xtrace_disable 00:21:37.058 22:59:28 -- host/multicontroller.sh@90 -- # grep -c NVMe 00:21:37.058 22:59:28 -- common/autotest_common.sh@10 -- # set +x 00:21:37.058 22:59:28 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:21:37.058 22:59:28 -- host/multicontroller.sh@90 -- # '[' 2 '!=' 2 ']' 00:21:37.058 22:59:28 -- host/multicontroller.sh@95 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bdevperf.sock perform_tests 00:21:38.463 0 00:21:38.463 22:59:29 -- host/multicontroller.sh@98 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_detach_controller NVMe1 00:21:38.463 22:59:29 -- common/autotest_common.sh@551 -- # xtrace_disable 00:21:38.463 22:59:29 -- common/autotest_common.sh@10 -- # set +x 00:21:38.463 22:59:29 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:21:38.463 22:59:29 -- host/multicontroller.sh@100 -- # killprocess 340205 00:21:38.463 22:59:29 -- common/autotest_common.sh@926 -- # '[' -z 340205 ']' 00:21:38.463 22:59:29 -- common/autotest_common.sh@930 -- # kill -0 340205 00:21:38.463 22:59:29 -- common/autotest_common.sh@931 -- # uname 00:21:38.463 22:59:29 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:21:38.463 22:59:29 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 340205 00:21:38.463 22:59:29 -- common/autotest_common.sh@932 -- # process_name=reactor_0 00:21:38.463 22:59:29 -- common/autotest_common.sh@936 -- # '[' reactor_0 = sudo ']' 00:21:38.463 22:59:29 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 340205' 00:21:38.463 killing process with pid 340205 00:21:38.463 22:59:29 -- common/autotest_common.sh@945 -- # kill 340205 00:21:38.463 22:59:29 -- common/autotest_common.sh@950 -- # wait 340205 00:21:38.722 22:59:29 -- host/multicontroller.sh@102 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:21:38.722 22:59:29 -- common/autotest_common.sh@551 -- # xtrace_disable 00:21:38.722 22:59:29 -- common/autotest_common.sh@10 -- # set +x 00:21:38.722 22:59:29 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:21:38.722 22:59:29 -- host/multicontroller.sh@103 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode2 00:21:38.722 22:59:29 -- common/autotest_common.sh@551 -- # xtrace_disable 00:21:38.722 22:59:29 -- common/autotest_common.sh@10 -- # set +x 00:21:38.722 22:59:29 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:21:38.722 22:59:29 -- host/multicontroller.sh@105 -- # trap - SIGINT SIGTERM EXIT 00:21:38.722 22:59:29 -- host/multicontroller.sh@107 -- # pap /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/try.txt 00:21:38.722 22:59:29 -- common/autotest_common.sh@1597 -- # read -r file 00:21:38.722 22:59:29 -- common/autotest_common.sh@1596 -- # find /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/try.txt -type f 00:21:38.722 22:59:29 -- common/autotest_common.sh@1596 -- # sort -u 00:21:38.722 22:59:29 -- common/autotest_common.sh@1598 -- # cat 00:21:38.722 --- /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/try.txt --- 00:21:38.722 [2024-04-16 22:59:26.576257] Starting SPDK v24.01.1-pre git sha1 4b134b4ab / DPDK 23.11.0 initialization... 00:21:38.722 [2024-04-16 22:59:26.576342] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid340205 ] 00:21:38.722 EAL: No free 2048 kB hugepages reported on node 1 00:21:38.722 [2024-04-16 22:59:26.636384] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:21:38.722 [2024-04-16 22:59:26.743687] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:21:38.722 [2024-04-16 22:59:28.165109] bdev.c:4548:bdev_name_add: *ERROR*: Bdev name b6ff36a9-6e15-4467-9ed3-a746765a8fec already exists 00:21:38.722 [2024-04-16 22:59:28.165147] bdev.c:7598:bdev_register: *ERROR*: Unable to add uuid:b6ff36a9-6e15-4467-9ed3-a746765a8fec alias for bdev NVMe1n1 00:21:38.722 [2024-04-16 22:59:28.165187] bdev_nvme.c:4186:nvme_bdev_create: *ERROR*: spdk_bdev_register() failed 00:21:38.722 Running I/O for 1 seconds... 00:21:38.722 00:21:38.722 Latency(us) 00:21:38.722 Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:21:38.722 Job: NVMe0n1 (Core Mask 0x1, workload: write, depth: 128, IO size: 4096) 00:21:38.722 NVMe0n1 : 1.00 19787.64 77.30 0.00 0.00 6458.99 2026.76 11553.75 00:21:38.722 =================================================================================================================== 00:21:38.722 Total : 19787.64 77.30 0.00 0.00 6458.99 2026.76 11553.75 00:21:38.722 Received shutdown signal, test time was about 1.000000 seconds 00:21:38.722 00:21:38.722 Latency(us) 00:21:38.722 Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:21:38.722 =================================================================================================================== 00:21:38.722 Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:21:38.722 --- /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/try.txt --- 00:21:38.722 22:59:29 -- common/autotest_common.sh@1603 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/try.txt 00:21:38.722 22:59:29 -- common/autotest_common.sh@1597 -- # read -r file 00:21:38.722 22:59:29 -- host/multicontroller.sh@108 -- # nvmftestfini 00:21:38.722 22:59:29 -- nvmf/common.sh@476 -- # nvmfcleanup 00:21:38.722 22:59:29 -- nvmf/common.sh@116 -- # sync 00:21:38.722 22:59:29 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:21:38.722 22:59:29 -- nvmf/common.sh@119 -- # set +e 00:21:38.722 22:59:29 -- nvmf/common.sh@120 -- # for i in {1..20} 00:21:38.722 22:59:29 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:21:38.722 rmmod nvme_tcp 00:21:38.722 rmmod nvme_fabrics 00:21:38.722 rmmod nvme_keyring 00:21:38.722 22:59:29 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:21:38.722 22:59:29 -- nvmf/common.sh@123 -- # set -e 00:21:38.722 22:59:29 -- nvmf/common.sh@124 -- # return 0 00:21:38.722 22:59:29 -- nvmf/common.sh@477 -- # '[' -n 340047 ']' 00:21:38.722 22:59:29 -- nvmf/common.sh@478 -- # killprocess 340047 00:21:38.722 22:59:29 -- common/autotest_common.sh@926 -- # '[' -z 340047 ']' 00:21:38.722 22:59:29 -- common/autotest_common.sh@930 -- # kill -0 340047 00:21:38.722 22:59:29 -- common/autotest_common.sh@931 -- # uname 00:21:38.723 22:59:29 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:21:38.723 22:59:29 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 340047 00:21:38.723 22:59:29 -- common/autotest_common.sh@932 -- # process_name=reactor_1 00:21:38.723 22:59:29 -- common/autotest_common.sh@936 -- # '[' reactor_1 = sudo ']' 00:21:38.723 22:59:29 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 340047' 00:21:38.723 killing process with pid 340047 00:21:38.723 22:59:29 -- common/autotest_common.sh@945 -- # kill 340047 00:21:38.723 22:59:29 -- common/autotest_common.sh@950 -- # wait 340047 00:21:38.981 22:59:29 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:21:38.981 22:59:29 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:21:38.981 22:59:29 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:21:38.981 22:59:29 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:21:38.981 22:59:30 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:21:38.981 22:59:30 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:21:38.981 22:59:30 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:21:38.981 22:59:30 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:21:41.519 22:59:32 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:21:41.519 00:21:41.519 real 0m8.847s 00:21:41.519 user 0m17.140s 00:21:41.519 sys 0m2.359s 00:21:41.519 22:59:32 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:21:41.519 22:59:32 -- common/autotest_common.sh@10 -- # set +x 00:21:41.519 ************************************ 00:21:41.519 END TEST nvmf_multicontroller 00:21:41.519 ************************************ 00:21:41.519 22:59:32 -- nvmf/nvmf.sh@91 -- # run_test nvmf_aer /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/aer.sh --transport=tcp 00:21:41.519 22:59:32 -- common/autotest_common.sh@1077 -- # '[' 3 -le 1 ']' 00:21:41.519 22:59:32 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:21:41.519 22:59:32 -- common/autotest_common.sh@10 -- # set +x 00:21:41.519 ************************************ 00:21:41.519 START TEST nvmf_aer 00:21:41.519 ************************************ 00:21:41.519 22:59:32 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/aer.sh --transport=tcp 00:21:41.519 * Looking for test storage... 00:21:41.519 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host 00:21:41.519 22:59:32 -- host/aer.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:21:41.519 22:59:32 -- nvmf/common.sh@7 -- # uname -s 00:21:41.519 22:59:32 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:21:41.519 22:59:32 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:21:41.519 22:59:32 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:21:41.519 22:59:32 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:21:41.519 22:59:32 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:21:41.519 22:59:32 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:21:41.519 22:59:32 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:21:41.519 22:59:32 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:21:41.519 22:59:32 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:21:41.519 22:59:32 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:21:41.519 22:59:32 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:21:41.519 22:59:32 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:21:41.519 22:59:32 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:21:41.519 22:59:32 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:21:41.519 22:59:32 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:21:41.519 22:59:32 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:21:41.519 22:59:32 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:21:41.519 22:59:32 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:21:41.519 22:59:32 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:21:41.520 22:59:32 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:21:41.520 22:59:32 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:21:41.520 22:59:32 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:21:41.520 22:59:32 -- paths/export.sh@5 -- # export PATH 00:21:41.520 22:59:32 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:21:41.520 22:59:32 -- nvmf/common.sh@46 -- # : 0 00:21:41.520 22:59:32 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:21:41.520 22:59:32 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:21:41.520 22:59:32 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:21:41.520 22:59:32 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:21:41.520 22:59:32 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:21:41.520 22:59:32 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:21:41.520 22:59:32 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:21:41.520 22:59:32 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:21:41.520 22:59:32 -- host/aer.sh@11 -- # nvmftestinit 00:21:41.520 22:59:32 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:21:41.520 22:59:32 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:21:41.520 22:59:32 -- nvmf/common.sh@436 -- # prepare_net_devs 00:21:41.520 22:59:32 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:21:41.520 22:59:32 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:21:41.520 22:59:32 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:21:41.520 22:59:32 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:21:41.520 22:59:32 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:21:41.520 22:59:32 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:21:41.520 22:59:32 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:21:41.520 22:59:32 -- nvmf/common.sh@284 -- # xtrace_disable 00:21:41.520 22:59:32 -- common/autotest_common.sh@10 -- # set +x 00:21:43.427 22:59:34 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:21:43.427 22:59:34 -- nvmf/common.sh@290 -- # pci_devs=() 00:21:43.427 22:59:34 -- nvmf/common.sh@290 -- # local -a pci_devs 00:21:43.427 22:59:34 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:21:43.427 22:59:34 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:21:43.427 22:59:34 -- nvmf/common.sh@292 -- # pci_drivers=() 00:21:43.427 22:59:34 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:21:43.427 22:59:34 -- nvmf/common.sh@294 -- # net_devs=() 00:21:43.427 22:59:34 -- nvmf/common.sh@294 -- # local -ga net_devs 00:21:43.427 22:59:34 -- nvmf/common.sh@295 -- # e810=() 00:21:43.427 22:59:34 -- nvmf/common.sh@295 -- # local -ga e810 00:21:43.427 22:59:34 -- nvmf/common.sh@296 -- # x722=() 00:21:43.427 22:59:34 -- nvmf/common.sh@296 -- # local -ga x722 00:21:43.427 22:59:34 -- nvmf/common.sh@297 -- # mlx=() 00:21:43.427 22:59:34 -- nvmf/common.sh@297 -- # local -ga mlx 00:21:43.427 22:59:34 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:21:43.427 22:59:34 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:21:43.427 22:59:34 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:21:43.427 22:59:34 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:21:43.427 22:59:34 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:21:43.427 22:59:34 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:21:43.427 22:59:34 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:21:43.427 22:59:34 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:21:43.427 22:59:34 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:21:43.427 22:59:34 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:21:43.427 22:59:34 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:21:43.427 22:59:34 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:21:43.427 22:59:34 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:21:43.427 22:59:34 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:21:43.427 22:59:34 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:21:43.427 22:59:34 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:21:43.427 22:59:34 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:21:43.427 22:59:34 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:21:43.427 22:59:34 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:21:43.427 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:21:43.427 22:59:34 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:21:43.427 22:59:34 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:21:43.427 22:59:34 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:21:43.427 22:59:34 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:21:43.427 22:59:34 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:21:43.427 22:59:34 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:21:43.427 22:59:34 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:21:43.427 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:21:43.427 22:59:34 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:21:43.427 22:59:34 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:21:43.427 22:59:34 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:21:43.427 22:59:34 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:21:43.427 22:59:34 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:21:43.427 22:59:34 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:21:43.427 22:59:34 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:21:43.427 22:59:34 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:21:43.427 22:59:34 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:21:43.427 22:59:34 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:21:43.427 22:59:34 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:21:43.427 22:59:34 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:21:43.427 22:59:34 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:21:43.427 Found net devices under 0000:0a:00.0: cvl_0_0 00:21:43.427 22:59:34 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:21:43.427 22:59:34 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:21:43.427 22:59:34 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:21:43.427 22:59:34 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:21:43.427 22:59:34 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:21:43.427 22:59:34 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:21:43.427 Found net devices under 0000:0a:00.1: cvl_0_1 00:21:43.427 22:59:34 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:21:43.427 22:59:34 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:21:43.427 22:59:34 -- nvmf/common.sh@402 -- # is_hw=yes 00:21:43.427 22:59:34 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:21:43.427 22:59:34 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:21:43.427 22:59:34 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:21:43.427 22:59:34 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:21:43.427 22:59:34 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:21:43.427 22:59:34 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:21:43.427 22:59:34 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:21:43.427 22:59:34 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:21:43.427 22:59:34 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:21:43.427 22:59:34 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:21:43.427 22:59:34 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:21:43.427 22:59:34 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:21:43.427 22:59:34 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:21:43.427 22:59:34 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:21:43.427 22:59:34 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:21:43.427 22:59:34 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:21:43.427 22:59:34 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:21:43.427 22:59:34 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:21:43.427 22:59:34 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:21:43.427 22:59:34 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:21:43.427 22:59:34 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:21:43.427 22:59:34 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:21:43.427 22:59:34 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:21:43.427 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:21:43.427 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.140 ms 00:21:43.427 00:21:43.427 --- 10.0.0.2 ping statistics --- 00:21:43.427 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:21:43.427 rtt min/avg/max/mdev = 0.140/0.140/0.140/0.000 ms 00:21:43.427 22:59:34 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:21:43.427 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:21:43.427 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.139 ms 00:21:43.427 00:21:43.427 --- 10.0.0.1 ping statistics --- 00:21:43.427 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:21:43.427 rtt min/avg/max/mdev = 0.139/0.139/0.139/0.000 ms 00:21:43.427 22:59:34 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:21:43.427 22:59:34 -- nvmf/common.sh@410 -- # return 0 00:21:43.427 22:59:34 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:21:43.427 22:59:34 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:21:43.427 22:59:34 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:21:43.427 22:59:34 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:21:43.427 22:59:34 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:21:43.427 22:59:34 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:21:43.427 22:59:34 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:21:43.427 22:59:34 -- host/aer.sh@12 -- # nvmfappstart -m 0xF 00:21:43.427 22:59:34 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:21:43.427 22:59:34 -- common/autotest_common.sh@712 -- # xtrace_disable 00:21:43.427 22:59:34 -- common/autotest_common.sh@10 -- # set +x 00:21:43.427 22:59:34 -- nvmf/common.sh@469 -- # nvmfpid=342502 00:21:43.427 22:59:34 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:21:43.427 22:59:34 -- nvmf/common.sh@470 -- # waitforlisten 342502 00:21:43.427 22:59:34 -- common/autotest_common.sh@819 -- # '[' -z 342502 ']' 00:21:43.427 22:59:34 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk.sock 00:21:43.427 22:59:34 -- common/autotest_common.sh@824 -- # local max_retries=100 00:21:43.427 22:59:34 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:21:43.427 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:21:43.427 22:59:34 -- common/autotest_common.sh@828 -- # xtrace_disable 00:21:43.427 22:59:34 -- common/autotest_common.sh@10 -- # set +x 00:21:43.427 [2024-04-16 22:59:34.284602] Starting SPDK v24.01.1-pre git sha1 4b134b4ab / DPDK 23.11.0 initialization... 00:21:43.427 [2024-04-16 22:59:34.284675] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:21:43.427 EAL: No free 2048 kB hugepages reported on node 1 00:21:43.427 [2024-04-16 22:59:34.352961] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:21:43.427 [2024-04-16 22:59:34.469538] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:21:43.427 [2024-04-16 22:59:34.469671] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:21:43.427 [2024-04-16 22:59:34.469694] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:21:43.427 [2024-04-16 22:59:34.469710] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:21:43.427 [2024-04-16 22:59:34.469800] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:21:43.427 [2024-04-16 22:59:34.469861] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:21:43.427 [2024-04-16 22:59:34.469927] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:21:43.427 [2024-04-16 22:59:34.469930] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:21:44.366 22:59:35 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:21:44.366 22:59:35 -- common/autotest_common.sh@852 -- # return 0 00:21:44.366 22:59:35 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:21:44.366 22:59:35 -- common/autotest_common.sh@718 -- # xtrace_disable 00:21:44.366 22:59:35 -- common/autotest_common.sh@10 -- # set +x 00:21:44.366 22:59:35 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:21:44.366 22:59:35 -- host/aer.sh@14 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:21:44.366 22:59:35 -- common/autotest_common.sh@551 -- # xtrace_disable 00:21:44.366 22:59:35 -- common/autotest_common.sh@10 -- # set +x 00:21:44.366 [2024-04-16 22:59:35.287737] tcp.c: 659:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:21:44.366 22:59:35 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:21:44.366 22:59:35 -- host/aer.sh@16 -- # rpc_cmd bdev_malloc_create 64 512 --name Malloc0 00:21:44.366 22:59:35 -- common/autotest_common.sh@551 -- # xtrace_disable 00:21:44.366 22:59:35 -- common/autotest_common.sh@10 -- # set +x 00:21:44.366 Malloc0 00:21:44.366 22:59:35 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:21:44.366 22:59:35 -- host/aer.sh@17 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 -m 2 00:21:44.366 22:59:35 -- common/autotest_common.sh@551 -- # xtrace_disable 00:21:44.366 22:59:35 -- common/autotest_common.sh@10 -- # set +x 00:21:44.366 22:59:35 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:21:44.366 22:59:35 -- host/aer.sh@18 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:21:44.366 22:59:35 -- common/autotest_common.sh@551 -- # xtrace_disable 00:21:44.366 22:59:35 -- common/autotest_common.sh@10 -- # set +x 00:21:44.366 22:59:35 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:21:44.366 22:59:35 -- host/aer.sh@19 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:21:44.366 22:59:35 -- common/autotest_common.sh@551 -- # xtrace_disable 00:21:44.366 22:59:35 -- common/autotest_common.sh@10 -- # set +x 00:21:44.366 [2024-04-16 22:59:35.339739] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:21:44.366 22:59:35 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:21:44.366 22:59:35 -- host/aer.sh@21 -- # rpc_cmd nvmf_get_subsystems 00:21:44.366 22:59:35 -- common/autotest_common.sh@551 -- # xtrace_disable 00:21:44.366 22:59:35 -- common/autotest_common.sh@10 -- # set +x 00:21:44.366 [2024-04-16 22:59:35.347519] nvmf_rpc.c: 275:rpc_nvmf_get_subsystems: *WARNING*: rpc_nvmf_get_subsystems: deprecated feature listener.transport is deprecated in favor of trtype to be removed in v24.05 00:21:44.366 [ 00:21:44.366 { 00:21:44.366 "nqn": "nqn.2014-08.org.nvmexpress.discovery", 00:21:44.366 "subtype": "Discovery", 00:21:44.366 "listen_addresses": [], 00:21:44.366 "allow_any_host": true, 00:21:44.366 "hosts": [] 00:21:44.366 }, 00:21:44.366 { 00:21:44.366 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:21:44.366 "subtype": "NVMe", 00:21:44.366 "listen_addresses": [ 00:21:44.366 { 00:21:44.366 "transport": "TCP", 00:21:44.366 "trtype": "TCP", 00:21:44.366 "adrfam": "IPv4", 00:21:44.366 "traddr": "10.0.0.2", 00:21:44.366 "trsvcid": "4420" 00:21:44.366 } 00:21:44.366 ], 00:21:44.366 "allow_any_host": true, 00:21:44.366 "hosts": [], 00:21:44.366 "serial_number": "SPDK00000000000001", 00:21:44.366 "model_number": "SPDK bdev Controller", 00:21:44.366 "max_namespaces": 2, 00:21:44.366 "min_cntlid": 1, 00:21:44.366 "max_cntlid": 65519, 00:21:44.366 "namespaces": [ 00:21:44.366 { 00:21:44.366 "nsid": 1, 00:21:44.367 "bdev_name": "Malloc0", 00:21:44.367 "name": "Malloc0", 00:21:44.367 "nguid": "DF7B2E85101940A8A07DAF28FAAAE159", 00:21:44.367 "uuid": "df7b2e85-1019-40a8-a07d-af28faaae159" 00:21:44.367 } 00:21:44.367 ] 00:21:44.367 } 00:21:44.367 ] 00:21:44.367 22:59:35 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:21:44.367 22:59:35 -- host/aer.sh@23 -- # AER_TOUCH_FILE=/tmp/aer_touch_file 00:21:44.367 22:59:35 -- host/aer.sh@24 -- # rm -f /tmp/aer_touch_file 00:21:44.367 22:59:35 -- host/aer.sh@33 -- # aerpid=342657 00:21:44.367 22:59:35 -- host/aer.sh@36 -- # waitforfile /tmp/aer_touch_file 00:21:44.367 22:59:35 -- host/aer.sh@27 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvme/aer/aer -r ' trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1' -n 2 -t /tmp/aer_touch_file 00:21:44.367 22:59:35 -- common/autotest_common.sh@1244 -- # local i=0 00:21:44.367 22:59:35 -- common/autotest_common.sh@1245 -- # '[' '!' -e /tmp/aer_touch_file ']' 00:21:44.367 22:59:35 -- common/autotest_common.sh@1246 -- # '[' 0 -lt 200 ']' 00:21:44.367 22:59:35 -- common/autotest_common.sh@1247 -- # i=1 00:21:44.367 22:59:35 -- common/autotest_common.sh@1248 -- # sleep 0.1 00:21:44.367 EAL: No free 2048 kB hugepages reported on node 1 00:21:44.367 22:59:35 -- common/autotest_common.sh@1245 -- # '[' '!' -e /tmp/aer_touch_file ']' 00:21:44.367 22:59:35 -- common/autotest_common.sh@1246 -- # '[' 1 -lt 200 ']' 00:21:44.367 22:59:35 -- common/autotest_common.sh@1247 -- # i=2 00:21:44.367 22:59:35 -- common/autotest_common.sh@1248 -- # sleep 0.1 00:21:44.626 22:59:35 -- common/autotest_common.sh@1245 -- # '[' '!' -e /tmp/aer_touch_file ']' 00:21:44.626 22:59:35 -- common/autotest_common.sh@1251 -- # '[' '!' -e /tmp/aer_touch_file ']' 00:21:44.626 22:59:35 -- common/autotest_common.sh@1255 -- # return 0 00:21:44.626 22:59:35 -- host/aer.sh@39 -- # rpc_cmd bdev_malloc_create 64 4096 --name Malloc1 00:21:44.626 22:59:35 -- common/autotest_common.sh@551 -- # xtrace_disable 00:21:44.626 22:59:35 -- common/autotest_common.sh@10 -- # set +x 00:21:44.626 Malloc1 00:21:44.626 22:59:35 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:21:44.626 22:59:35 -- host/aer.sh@40 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 -n 2 00:21:44.626 22:59:35 -- common/autotest_common.sh@551 -- # xtrace_disable 00:21:44.626 22:59:35 -- common/autotest_common.sh@10 -- # set +x 00:21:44.626 22:59:35 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:21:44.626 22:59:35 -- host/aer.sh@41 -- # rpc_cmd nvmf_get_subsystems 00:21:44.626 22:59:35 -- common/autotest_common.sh@551 -- # xtrace_disable 00:21:44.626 22:59:35 -- common/autotest_common.sh@10 -- # set +x 00:21:44.626 [ 00:21:44.626 { 00:21:44.626 "nqn": "nqn.2014-08.org.nvmexpress.discovery", 00:21:44.626 "subtype": "Discovery", 00:21:44.626 "listen_addresses": [], 00:21:44.626 "allow_any_host": true, 00:21:44.626 "hosts": [] 00:21:44.626 }, 00:21:44.626 { 00:21:44.626 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:21:44.626 "subtype": "NVMe", 00:21:44.626 "listen_addresses": [ 00:21:44.626 { 00:21:44.626 "transport": "TCP", 00:21:44.626 "trtype": "TCP", 00:21:44.626 "adrfam": "IPv4", 00:21:44.626 "traddr": "10.0.0.2", 00:21:44.626 "trsvcid": "4420" 00:21:44.626 } 00:21:44.626 ], 00:21:44.626 "allow_any_host": true, 00:21:44.626 "hosts": [], 00:21:44.626 "serial_number": "SPDK00000000000001", 00:21:44.626 "model_number": "SPDK bdev Controller", 00:21:44.626 "max_namespaces": 2, 00:21:44.626 "min_cntlid": 1, 00:21:44.626 "max_cntlid": 65519, 00:21:44.626 "namespaces": [ 00:21:44.626 { 00:21:44.626 "nsid": 1, 00:21:44.626 "bdev_name": "Malloc0", 00:21:44.626 "name": "Malloc0", 00:21:44.626 "nguid": "DF7B2E85101940A8A07DAF28FAAAE159", 00:21:44.626 "uuid": "df7b2e85-1019-40a8-a07d-af28faaae159" 00:21:44.626 }, 00:21:44.626 { 00:21:44.626 "nsid": 2, 00:21:44.626 "bdev_name": "Malloc1", 00:21:44.626 "name": "Malloc1", 00:21:44.626 "nguid": "FF912E98352F4132A6965C5B6D7F1F5D", 00:21:44.626 "uuid": "ff912e98-352f-4132-a696-5c5b6d7f1f5d" 00:21:44.626 } 00:21:44.626 ] 00:21:44.626 } 00:21:44.626 ] 00:21:44.626 22:59:35 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:21:44.626 22:59:35 -- host/aer.sh@43 -- # wait 342657 00:21:44.626 Asynchronous Event Request test 00:21:44.626 Attaching to 10.0.0.2 00:21:44.626 Attached to 10.0.0.2 00:21:44.626 Registering asynchronous event callbacks... 00:21:44.626 Starting namespace attribute notice tests for all controllers... 00:21:44.626 10.0.0.2: aer_cb for log page 4, aen_event_type: 0x02, aen_event_info: 0x00 00:21:44.626 aer_cb - Changed Namespace 00:21:44.626 Cleaning up... 00:21:44.626 22:59:35 -- host/aer.sh@45 -- # rpc_cmd bdev_malloc_delete Malloc0 00:21:44.626 22:59:35 -- common/autotest_common.sh@551 -- # xtrace_disable 00:21:44.626 22:59:35 -- common/autotest_common.sh@10 -- # set +x 00:21:44.626 22:59:35 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:21:44.626 22:59:35 -- host/aer.sh@46 -- # rpc_cmd bdev_malloc_delete Malloc1 00:21:44.626 22:59:35 -- common/autotest_common.sh@551 -- # xtrace_disable 00:21:44.626 22:59:35 -- common/autotest_common.sh@10 -- # set +x 00:21:44.626 22:59:35 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:21:44.626 22:59:35 -- host/aer.sh@47 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:21:44.626 22:59:35 -- common/autotest_common.sh@551 -- # xtrace_disable 00:21:44.626 22:59:35 -- common/autotest_common.sh@10 -- # set +x 00:21:44.626 22:59:35 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:21:44.626 22:59:35 -- host/aer.sh@49 -- # trap - SIGINT SIGTERM EXIT 00:21:44.626 22:59:35 -- host/aer.sh@51 -- # nvmftestfini 00:21:44.626 22:59:35 -- nvmf/common.sh@476 -- # nvmfcleanup 00:21:44.626 22:59:35 -- nvmf/common.sh@116 -- # sync 00:21:44.626 22:59:35 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:21:44.626 22:59:35 -- nvmf/common.sh@119 -- # set +e 00:21:44.626 22:59:35 -- nvmf/common.sh@120 -- # for i in {1..20} 00:21:44.626 22:59:35 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:21:44.626 rmmod nvme_tcp 00:21:44.626 rmmod nvme_fabrics 00:21:44.886 rmmod nvme_keyring 00:21:44.886 22:59:35 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:21:44.886 22:59:35 -- nvmf/common.sh@123 -- # set -e 00:21:44.886 22:59:35 -- nvmf/common.sh@124 -- # return 0 00:21:44.886 22:59:35 -- nvmf/common.sh@477 -- # '[' -n 342502 ']' 00:21:44.886 22:59:35 -- nvmf/common.sh@478 -- # killprocess 342502 00:21:44.886 22:59:35 -- common/autotest_common.sh@926 -- # '[' -z 342502 ']' 00:21:44.886 22:59:35 -- common/autotest_common.sh@930 -- # kill -0 342502 00:21:44.886 22:59:35 -- common/autotest_common.sh@931 -- # uname 00:21:44.886 22:59:35 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:21:44.886 22:59:35 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 342502 00:21:44.886 22:59:35 -- common/autotest_common.sh@932 -- # process_name=reactor_0 00:21:44.886 22:59:35 -- common/autotest_common.sh@936 -- # '[' reactor_0 = sudo ']' 00:21:44.886 22:59:35 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 342502' 00:21:44.886 killing process with pid 342502 00:21:44.886 22:59:35 -- common/autotest_common.sh@945 -- # kill 342502 00:21:44.886 [2024-04-16 22:59:35.813886] app.c: 883:log_deprecation_hits: *WARNING*: rpc_nvmf_get_subsystems: deprecation 'listener.transport is deprecated in favor of trtype' scheduled for removal in v24.05 hit 1 times 00:21:44.886 22:59:35 -- common/autotest_common.sh@950 -- # wait 342502 00:21:45.145 22:59:36 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:21:45.145 22:59:36 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:21:45.145 22:59:36 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:21:45.145 22:59:36 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:21:45.145 22:59:36 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:21:45.145 22:59:36 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:21:45.145 22:59:36 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:21:45.145 22:59:36 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:21:47.051 22:59:38 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:21:47.051 00:21:47.051 real 0m6.072s 00:21:47.051 user 0m7.185s 00:21:47.051 sys 0m1.943s 00:21:47.051 22:59:38 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:21:47.051 22:59:38 -- common/autotest_common.sh@10 -- # set +x 00:21:47.051 ************************************ 00:21:47.051 END TEST nvmf_aer 00:21:47.051 ************************************ 00:21:47.051 22:59:38 -- nvmf/nvmf.sh@92 -- # run_test nvmf_async_init /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/async_init.sh --transport=tcp 00:21:47.051 22:59:38 -- common/autotest_common.sh@1077 -- # '[' 3 -le 1 ']' 00:21:47.051 22:59:38 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:21:47.051 22:59:38 -- common/autotest_common.sh@10 -- # set +x 00:21:47.051 ************************************ 00:21:47.051 START TEST nvmf_async_init 00:21:47.051 ************************************ 00:21:47.051 22:59:38 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/async_init.sh --transport=tcp 00:21:47.310 * Looking for test storage... 00:21:47.310 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host 00:21:47.310 22:59:38 -- host/async_init.sh@11 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:21:47.310 22:59:38 -- nvmf/common.sh@7 -- # uname -s 00:21:47.310 22:59:38 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:21:47.310 22:59:38 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:21:47.310 22:59:38 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:21:47.310 22:59:38 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:21:47.310 22:59:38 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:21:47.310 22:59:38 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:21:47.310 22:59:38 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:21:47.310 22:59:38 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:21:47.310 22:59:38 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:21:47.310 22:59:38 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:21:47.310 22:59:38 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:21:47.310 22:59:38 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:21:47.310 22:59:38 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:21:47.310 22:59:38 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:21:47.310 22:59:38 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:21:47.310 22:59:38 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:21:47.310 22:59:38 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:21:47.310 22:59:38 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:21:47.310 22:59:38 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:21:47.310 22:59:38 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:21:47.310 22:59:38 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:21:47.310 22:59:38 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:21:47.310 22:59:38 -- paths/export.sh@5 -- # export PATH 00:21:47.310 22:59:38 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:21:47.310 22:59:38 -- nvmf/common.sh@46 -- # : 0 00:21:47.310 22:59:38 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:21:47.310 22:59:38 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:21:47.310 22:59:38 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:21:47.310 22:59:38 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:21:47.310 22:59:38 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:21:47.310 22:59:38 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:21:47.310 22:59:38 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:21:47.310 22:59:38 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:21:47.310 22:59:38 -- host/async_init.sh@13 -- # null_bdev_size=1024 00:21:47.310 22:59:38 -- host/async_init.sh@14 -- # null_block_size=512 00:21:47.310 22:59:38 -- host/async_init.sh@15 -- # null_bdev=null0 00:21:47.310 22:59:38 -- host/async_init.sh@16 -- # nvme_bdev=nvme0 00:21:47.310 22:59:38 -- host/async_init.sh@20 -- # uuidgen 00:21:47.310 22:59:38 -- host/async_init.sh@20 -- # tr -d - 00:21:47.310 22:59:38 -- host/async_init.sh@20 -- # nguid=196beccd70eb4f4393c0879907c97dab 00:21:47.310 22:59:38 -- host/async_init.sh@22 -- # nvmftestinit 00:21:47.310 22:59:38 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:21:47.310 22:59:38 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:21:47.310 22:59:38 -- nvmf/common.sh@436 -- # prepare_net_devs 00:21:47.310 22:59:38 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:21:47.310 22:59:38 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:21:47.310 22:59:38 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:21:47.310 22:59:38 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:21:47.310 22:59:38 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:21:47.310 22:59:38 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:21:47.310 22:59:38 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:21:47.310 22:59:38 -- nvmf/common.sh@284 -- # xtrace_disable 00:21:47.310 22:59:38 -- common/autotest_common.sh@10 -- # set +x 00:21:49.218 22:59:40 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:21:49.218 22:59:40 -- nvmf/common.sh@290 -- # pci_devs=() 00:21:49.218 22:59:40 -- nvmf/common.sh@290 -- # local -a pci_devs 00:21:49.218 22:59:40 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:21:49.218 22:59:40 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:21:49.218 22:59:40 -- nvmf/common.sh@292 -- # pci_drivers=() 00:21:49.218 22:59:40 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:21:49.218 22:59:40 -- nvmf/common.sh@294 -- # net_devs=() 00:21:49.218 22:59:40 -- nvmf/common.sh@294 -- # local -ga net_devs 00:21:49.218 22:59:40 -- nvmf/common.sh@295 -- # e810=() 00:21:49.218 22:59:40 -- nvmf/common.sh@295 -- # local -ga e810 00:21:49.218 22:59:40 -- nvmf/common.sh@296 -- # x722=() 00:21:49.218 22:59:40 -- nvmf/common.sh@296 -- # local -ga x722 00:21:49.218 22:59:40 -- nvmf/common.sh@297 -- # mlx=() 00:21:49.218 22:59:40 -- nvmf/common.sh@297 -- # local -ga mlx 00:21:49.218 22:59:40 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:21:49.218 22:59:40 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:21:49.218 22:59:40 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:21:49.218 22:59:40 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:21:49.218 22:59:40 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:21:49.218 22:59:40 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:21:49.218 22:59:40 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:21:49.218 22:59:40 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:21:49.218 22:59:40 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:21:49.218 22:59:40 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:21:49.218 22:59:40 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:21:49.218 22:59:40 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:21:49.218 22:59:40 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:21:49.218 22:59:40 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:21:49.218 22:59:40 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:21:49.218 22:59:40 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:21:49.218 22:59:40 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:21:49.218 22:59:40 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:21:49.218 22:59:40 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:21:49.218 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:21:49.218 22:59:40 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:21:49.218 22:59:40 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:21:49.218 22:59:40 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:21:49.218 22:59:40 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:21:49.218 22:59:40 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:21:49.218 22:59:40 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:21:49.218 22:59:40 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:21:49.218 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:21:49.218 22:59:40 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:21:49.218 22:59:40 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:21:49.218 22:59:40 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:21:49.218 22:59:40 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:21:49.218 22:59:40 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:21:49.218 22:59:40 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:21:49.218 22:59:40 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:21:49.218 22:59:40 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:21:49.218 22:59:40 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:21:49.218 22:59:40 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:21:49.218 22:59:40 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:21:49.218 22:59:40 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:21:49.218 22:59:40 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:21:49.218 Found net devices under 0000:0a:00.0: cvl_0_0 00:21:49.218 22:59:40 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:21:49.218 22:59:40 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:21:49.218 22:59:40 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:21:49.218 22:59:40 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:21:49.218 22:59:40 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:21:49.218 22:59:40 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:21:49.218 Found net devices under 0000:0a:00.1: cvl_0_1 00:21:49.218 22:59:40 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:21:49.218 22:59:40 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:21:49.218 22:59:40 -- nvmf/common.sh@402 -- # is_hw=yes 00:21:49.218 22:59:40 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:21:49.218 22:59:40 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:21:49.218 22:59:40 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:21:49.218 22:59:40 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:21:49.218 22:59:40 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:21:49.218 22:59:40 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:21:49.218 22:59:40 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:21:49.218 22:59:40 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:21:49.218 22:59:40 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:21:49.218 22:59:40 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:21:49.218 22:59:40 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:21:49.218 22:59:40 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:21:49.218 22:59:40 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:21:49.218 22:59:40 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:21:49.218 22:59:40 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:21:49.218 22:59:40 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:21:49.218 22:59:40 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:21:49.218 22:59:40 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:21:49.218 22:59:40 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:21:49.218 22:59:40 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:21:49.218 22:59:40 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:21:49.218 22:59:40 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:21:49.218 22:59:40 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:21:49.218 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:21:49.218 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.254 ms 00:21:49.218 00:21:49.218 --- 10.0.0.2 ping statistics --- 00:21:49.218 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:21:49.218 rtt min/avg/max/mdev = 0.254/0.254/0.254/0.000 ms 00:21:49.218 22:59:40 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:21:49.219 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:21:49.219 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.133 ms 00:21:49.219 00:21:49.219 --- 10.0.0.1 ping statistics --- 00:21:49.219 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:21:49.219 rtt min/avg/max/mdev = 0.133/0.133/0.133/0.000 ms 00:21:49.219 22:59:40 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:21:49.219 22:59:40 -- nvmf/common.sh@410 -- # return 0 00:21:49.219 22:59:40 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:21:49.219 22:59:40 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:21:49.219 22:59:40 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:21:49.219 22:59:40 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:21:49.219 22:59:40 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:21:49.219 22:59:40 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:21:49.219 22:59:40 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:21:49.219 22:59:40 -- host/async_init.sh@23 -- # nvmfappstart -m 0x1 00:21:49.219 22:59:40 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:21:49.219 22:59:40 -- common/autotest_common.sh@712 -- # xtrace_disable 00:21:49.219 22:59:40 -- common/autotest_common.sh@10 -- # set +x 00:21:49.219 22:59:40 -- nvmf/common.sh@469 -- # nvmfpid=344676 00:21:49.219 22:59:40 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x1 00:21:49.219 22:59:40 -- nvmf/common.sh@470 -- # waitforlisten 344676 00:21:49.219 22:59:40 -- common/autotest_common.sh@819 -- # '[' -z 344676 ']' 00:21:49.219 22:59:40 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk.sock 00:21:49.219 22:59:40 -- common/autotest_common.sh@824 -- # local max_retries=100 00:21:49.219 22:59:40 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:21:49.219 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:21:49.219 22:59:40 -- common/autotest_common.sh@828 -- # xtrace_disable 00:21:49.219 22:59:40 -- common/autotest_common.sh@10 -- # set +x 00:21:49.219 [2024-04-16 22:59:40.220854] Starting SPDK v24.01.1-pre git sha1 4b134b4ab / DPDK 23.11.0 initialization... 00:21:49.219 [2024-04-16 22:59:40.220933] [ DPDK EAL parameters: nvmf -c 0x1 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:21:49.219 EAL: No free 2048 kB hugepages reported on node 1 00:21:49.219 [2024-04-16 22:59:40.287137] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:21:49.479 [2024-04-16 22:59:40.401737] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:21:49.479 [2024-04-16 22:59:40.401906] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:21:49.479 [2024-04-16 22:59:40.401938] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:21:49.479 [2024-04-16 22:59:40.401952] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:21:49.479 [2024-04-16 22:59:40.402016] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:21:50.415 22:59:41 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:21:50.415 22:59:41 -- common/autotest_common.sh@852 -- # return 0 00:21:50.415 22:59:41 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:21:50.415 22:59:41 -- common/autotest_common.sh@718 -- # xtrace_disable 00:21:50.415 22:59:41 -- common/autotest_common.sh@10 -- # set +x 00:21:50.415 22:59:41 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:21:50.415 22:59:41 -- host/async_init.sh@26 -- # rpc_cmd nvmf_create_transport -t tcp -o 00:21:50.415 22:59:41 -- common/autotest_common.sh@551 -- # xtrace_disable 00:21:50.415 22:59:41 -- common/autotest_common.sh@10 -- # set +x 00:21:50.415 [2024-04-16 22:59:41.231212] tcp.c: 659:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:21:50.415 22:59:41 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:21:50.415 22:59:41 -- host/async_init.sh@27 -- # rpc_cmd bdev_null_create null0 1024 512 00:21:50.415 22:59:41 -- common/autotest_common.sh@551 -- # xtrace_disable 00:21:50.415 22:59:41 -- common/autotest_common.sh@10 -- # set +x 00:21:50.415 null0 00:21:50.415 22:59:41 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:21:50.415 22:59:41 -- host/async_init.sh@28 -- # rpc_cmd bdev_wait_for_examine 00:21:50.415 22:59:41 -- common/autotest_common.sh@551 -- # xtrace_disable 00:21:50.415 22:59:41 -- common/autotest_common.sh@10 -- # set +x 00:21:50.415 22:59:41 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:21:50.416 22:59:41 -- host/async_init.sh@29 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode0 -a 00:21:50.416 22:59:41 -- common/autotest_common.sh@551 -- # xtrace_disable 00:21:50.416 22:59:41 -- common/autotest_common.sh@10 -- # set +x 00:21:50.416 22:59:41 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:21:50.416 22:59:41 -- host/async_init.sh@30 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode0 null0 -g 196beccd70eb4f4393c0879907c97dab 00:21:50.416 22:59:41 -- common/autotest_common.sh@551 -- # xtrace_disable 00:21:50.416 22:59:41 -- common/autotest_common.sh@10 -- # set +x 00:21:50.416 22:59:41 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:21:50.416 22:59:41 -- host/async_init.sh@31 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode0 -t tcp -a 10.0.0.2 -s 4420 00:21:50.416 22:59:41 -- common/autotest_common.sh@551 -- # xtrace_disable 00:21:50.416 22:59:41 -- common/autotest_common.sh@10 -- # set +x 00:21:50.416 [2024-04-16 22:59:41.271436] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:21:50.416 22:59:41 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:21:50.416 22:59:41 -- host/async_init.sh@37 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t tcp -a 10.0.0.2 -f ipv4 -s 4420 -n nqn.2016-06.io.spdk:cnode0 00:21:50.416 22:59:41 -- common/autotest_common.sh@551 -- # xtrace_disable 00:21:50.416 22:59:41 -- common/autotest_common.sh@10 -- # set +x 00:21:50.416 nvme0n1 00:21:50.416 22:59:41 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:21:50.416 22:59:41 -- host/async_init.sh@41 -- # rpc_cmd bdev_get_bdevs -b nvme0n1 00:21:50.416 22:59:41 -- common/autotest_common.sh@551 -- # xtrace_disable 00:21:50.416 22:59:41 -- common/autotest_common.sh@10 -- # set +x 00:21:50.416 [ 00:21:50.416 { 00:21:50.416 "name": "nvme0n1", 00:21:50.416 "aliases": [ 00:21:50.416 "196beccd-70eb-4f43-93c0-879907c97dab" 00:21:50.416 ], 00:21:50.416 "product_name": "NVMe disk", 00:21:50.416 "block_size": 512, 00:21:50.416 "num_blocks": 2097152, 00:21:50.416 "uuid": "196beccd-70eb-4f43-93c0-879907c97dab", 00:21:50.416 "assigned_rate_limits": { 00:21:50.416 "rw_ios_per_sec": 0, 00:21:50.416 "rw_mbytes_per_sec": 0, 00:21:50.416 "r_mbytes_per_sec": 0, 00:21:50.416 "w_mbytes_per_sec": 0 00:21:50.416 }, 00:21:50.416 "claimed": false, 00:21:50.416 "zoned": false, 00:21:50.416 "supported_io_types": { 00:21:50.416 "read": true, 00:21:50.416 "write": true, 00:21:50.416 "unmap": false, 00:21:50.416 "write_zeroes": true, 00:21:50.416 "flush": true, 00:21:50.416 "reset": true, 00:21:50.416 "compare": true, 00:21:50.416 "compare_and_write": true, 00:21:50.416 "abort": true, 00:21:50.416 "nvme_admin": true, 00:21:50.416 "nvme_io": true 00:21:50.416 }, 00:21:50.416 "driver_specific": { 00:21:50.416 "nvme": [ 00:21:50.416 { 00:21:50.416 "trid": { 00:21:50.416 "trtype": "TCP", 00:21:50.416 "adrfam": "IPv4", 00:21:50.416 "traddr": "10.0.0.2", 00:21:50.416 "trsvcid": "4420", 00:21:50.416 "subnqn": "nqn.2016-06.io.spdk:cnode0" 00:21:50.416 }, 00:21:50.416 "ctrlr_data": { 00:21:50.416 "cntlid": 1, 00:21:50.416 "vendor_id": "0x8086", 00:21:50.416 "model_number": "SPDK bdev Controller", 00:21:50.416 "serial_number": "00000000000000000000", 00:21:50.416 "firmware_revision": "24.01.1", 00:21:50.416 "subnqn": "nqn.2016-06.io.spdk:cnode0", 00:21:50.416 "oacs": { 00:21:50.416 "security": 0, 00:21:50.416 "format": 0, 00:21:50.416 "firmware": 0, 00:21:50.416 "ns_manage": 0 00:21:50.416 }, 00:21:50.416 "multi_ctrlr": true, 00:21:50.416 "ana_reporting": false 00:21:50.416 }, 00:21:50.416 "vs": { 00:21:50.416 "nvme_version": "1.3" 00:21:50.416 }, 00:21:50.416 "ns_data": { 00:21:50.416 "id": 1, 00:21:50.416 "can_share": true 00:21:50.416 } 00:21:50.416 } 00:21:50.416 ], 00:21:50.416 "mp_policy": "active_passive" 00:21:50.416 } 00:21:50.416 } 00:21:50.416 ] 00:21:50.416 22:59:41 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:21:50.416 22:59:41 -- host/async_init.sh@44 -- # rpc_cmd bdev_nvme_reset_controller nvme0 00:21:50.416 22:59:41 -- common/autotest_common.sh@551 -- # xtrace_disable 00:21:50.416 22:59:41 -- common/autotest_common.sh@10 -- # set +x 00:21:50.416 [2024-04-16 22:59:41.520028] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode0] resetting controller 00:21:50.416 [2024-04-16 22:59:41.520127] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xe189d0 (9): Bad file descriptor 00:21:50.674 [2024-04-16 22:59:41.652326] bdev_nvme.c:2026:_bdev_nvme_reset_ctrlr_complete: *NOTICE*: Resetting controller successful. 00:21:50.674 22:59:41 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:21:50.674 22:59:41 -- host/async_init.sh@47 -- # rpc_cmd bdev_get_bdevs -b nvme0n1 00:21:50.674 22:59:41 -- common/autotest_common.sh@551 -- # xtrace_disable 00:21:50.674 22:59:41 -- common/autotest_common.sh@10 -- # set +x 00:21:50.674 [ 00:21:50.674 { 00:21:50.674 "name": "nvme0n1", 00:21:50.674 "aliases": [ 00:21:50.674 "196beccd-70eb-4f43-93c0-879907c97dab" 00:21:50.674 ], 00:21:50.674 "product_name": "NVMe disk", 00:21:50.674 "block_size": 512, 00:21:50.674 "num_blocks": 2097152, 00:21:50.674 "uuid": "196beccd-70eb-4f43-93c0-879907c97dab", 00:21:50.674 "assigned_rate_limits": { 00:21:50.674 "rw_ios_per_sec": 0, 00:21:50.674 "rw_mbytes_per_sec": 0, 00:21:50.674 "r_mbytes_per_sec": 0, 00:21:50.674 "w_mbytes_per_sec": 0 00:21:50.674 }, 00:21:50.674 "claimed": false, 00:21:50.674 "zoned": false, 00:21:50.674 "supported_io_types": { 00:21:50.674 "read": true, 00:21:50.674 "write": true, 00:21:50.674 "unmap": false, 00:21:50.674 "write_zeroes": true, 00:21:50.674 "flush": true, 00:21:50.674 "reset": true, 00:21:50.674 "compare": true, 00:21:50.674 "compare_and_write": true, 00:21:50.674 "abort": true, 00:21:50.674 "nvme_admin": true, 00:21:50.674 "nvme_io": true 00:21:50.674 }, 00:21:50.674 "driver_specific": { 00:21:50.674 "nvme": [ 00:21:50.674 { 00:21:50.674 "trid": { 00:21:50.674 "trtype": "TCP", 00:21:50.674 "adrfam": "IPv4", 00:21:50.674 "traddr": "10.0.0.2", 00:21:50.674 "trsvcid": "4420", 00:21:50.674 "subnqn": "nqn.2016-06.io.spdk:cnode0" 00:21:50.674 }, 00:21:50.674 "ctrlr_data": { 00:21:50.674 "cntlid": 2, 00:21:50.674 "vendor_id": "0x8086", 00:21:50.674 "model_number": "SPDK bdev Controller", 00:21:50.674 "serial_number": "00000000000000000000", 00:21:50.674 "firmware_revision": "24.01.1", 00:21:50.674 "subnqn": "nqn.2016-06.io.spdk:cnode0", 00:21:50.674 "oacs": { 00:21:50.674 "security": 0, 00:21:50.674 "format": 0, 00:21:50.674 "firmware": 0, 00:21:50.674 "ns_manage": 0 00:21:50.674 }, 00:21:50.674 "multi_ctrlr": true, 00:21:50.674 "ana_reporting": false 00:21:50.674 }, 00:21:50.674 "vs": { 00:21:50.674 "nvme_version": "1.3" 00:21:50.674 }, 00:21:50.674 "ns_data": { 00:21:50.674 "id": 1, 00:21:50.674 "can_share": true 00:21:50.674 } 00:21:50.674 } 00:21:50.674 ], 00:21:50.674 "mp_policy": "active_passive" 00:21:50.674 } 00:21:50.674 } 00:21:50.674 ] 00:21:50.674 22:59:41 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:21:50.674 22:59:41 -- host/async_init.sh@50 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:21:50.674 22:59:41 -- common/autotest_common.sh@551 -- # xtrace_disable 00:21:50.674 22:59:41 -- common/autotest_common.sh@10 -- # set +x 00:21:50.674 22:59:41 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:21:50.674 22:59:41 -- host/async_init.sh@53 -- # mktemp 00:21:50.674 22:59:41 -- host/async_init.sh@53 -- # key_path=/tmp/tmp.yuZu9EcpQg 00:21:50.674 22:59:41 -- host/async_init.sh@54 -- # echo -n NVMeTLSkey-1:01:MDAxMTIyMzM0NDU1NjY3Nzg4OTlhYWJiY2NkZGVlZmZwJEiQ: 00:21:50.674 22:59:41 -- host/async_init.sh@55 -- # chmod 0600 /tmp/tmp.yuZu9EcpQg 00:21:50.674 22:59:41 -- host/async_init.sh@56 -- # rpc_cmd nvmf_subsystem_allow_any_host nqn.2016-06.io.spdk:cnode0 --disable 00:21:50.674 22:59:41 -- common/autotest_common.sh@551 -- # xtrace_disable 00:21:50.674 22:59:41 -- common/autotest_common.sh@10 -- # set +x 00:21:50.674 22:59:41 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:21:50.674 22:59:41 -- host/async_init.sh@57 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode0 -t tcp -a 10.0.0.2 -s 4421 --secure-channel 00:21:50.674 22:59:41 -- common/autotest_common.sh@551 -- # xtrace_disable 00:21:50.674 22:59:41 -- common/autotest_common.sh@10 -- # set +x 00:21:50.674 [2024-04-16 22:59:41.696625] tcp.c: 912:nvmf_tcp_listen: *NOTICE*: TLS support is considered experimental 00:21:50.674 [2024-04-16 22:59:41.696752] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4421 *** 00:21:50.674 22:59:41 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:21:50.674 22:59:41 -- host/async_init.sh@59 -- # rpc_cmd nvmf_subsystem_add_host nqn.2016-06.io.spdk:cnode0 nqn.2016-06.io.spdk:host1 --psk /tmp/tmp.yuZu9EcpQg 00:21:50.674 22:59:41 -- common/autotest_common.sh@551 -- # xtrace_disable 00:21:50.674 22:59:41 -- common/autotest_common.sh@10 -- # set +x 00:21:50.674 22:59:41 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:21:50.674 22:59:41 -- host/async_init.sh@65 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t tcp -a 10.0.0.2 -f ipv4 -s 4421 -n nqn.2016-06.io.spdk:cnode0 -q nqn.2016-06.io.spdk:host1 --psk /tmp/tmp.yuZu9EcpQg 00:21:50.674 22:59:41 -- common/autotest_common.sh@551 -- # xtrace_disable 00:21:50.674 22:59:41 -- common/autotest_common.sh@10 -- # set +x 00:21:50.674 [2024-04-16 22:59:41.712667] bdev_nvme_rpc.c: 477:rpc_bdev_nvme_attach_controller: *NOTICE*: TLS support is considered experimental 00:21:50.675 nvme0n1 00:21:50.675 22:59:41 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:21:50.675 22:59:41 -- host/async_init.sh@69 -- # rpc_cmd bdev_get_bdevs -b nvme0n1 00:21:50.675 22:59:41 -- common/autotest_common.sh@551 -- # xtrace_disable 00:21:50.675 22:59:41 -- common/autotest_common.sh@10 -- # set +x 00:21:50.675 [ 00:21:50.675 { 00:21:50.675 "name": "nvme0n1", 00:21:50.675 "aliases": [ 00:21:50.675 "196beccd-70eb-4f43-93c0-879907c97dab" 00:21:50.675 ], 00:21:50.675 "product_name": "NVMe disk", 00:21:50.675 "block_size": 512, 00:21:50.675 "num_blocks": 2097152, 00:21:50.675 "uuid": "196beccd-70eb-4f43-93c0-879907c97dab", 00:21:50.675 "assigned_rate_limits": { 00:21:50.675 "rw_ios_per_sec": 0, 00:21:50.675 "rw_mbytes_per_sec": 0, 00:21:50.675 "r_mbytes_per_sec": 0, 00:21:50.675 "w_mbytes_per_sec": 0 00:21:50.675 }, 00:21:50.675 "claimed": false, 00:21:50.675 "zoned": false, 00:21:50.675 "supported_io_types": { 00:21:50.675 "read": true, 00:21:50.675 "write": true, 00:21:50.675 "unmap": false, 00:21:50.675 "write_zeroes": true, 00:21:50.675 "flush": true, 00:21:50.675 "reset": true, 00:21:50.675 "compare": true, 00:21:50.675 "compare_and_write": true, 00:21:50.675 "abort": true, 00:21:50.675 "nvme_admin": true, 00:21:50.675 "nvme_io": true 00:21:50.675 }, 00:21:50.675 "driver_specific": { 00:21:50.675 "nvme": [ 00:21:50.675 { 00:21:50.675 "trid": { 00:21:50.675 "trtype": "TCP", 00:21:50.675 "adrfam": "IPv4", 00:21:50.675 "traddr": "10.0.0.2", 00:21:50.675 "trsvcid": "4421", 00:21:50.675 "subnqn": "nqn.2016-06.io.spdk:cnode0" 00:21:50.675 }, 00:21:50.675 "ctrlr_data": { 00:21:50.675 "cntlid": 3, 00:21:50.675 "vendor_id": "0x8086", 00:21:50.675 "model_number": "SPDK bdev Controller", 00:21:50.675 "serial_number": "00000000000000000000", 00:21:50.675 "firmware_revision": "24.01.1", 00:21:50.675 "subnqn": "nqn.2016-06.io.spdk:cnode0", 00:21:50.675 "oacs": { 00:21:50.675 "security": 0, 00:21:50.675 "format": 0, 00:21:50.675 "firmware": 0, 00:21:50.675 "ns_manage": 0 00:21:50.675 }, 00:21:50.675 "multi_ctrlr": true, 00:21:50.675 "ana_reporting": false 00:21:50.675 }, 00:21:50.675 "vs": { 00:21:50.675 "nvme_version": "1.3" 00:21:50.675 }, 00:21:50.675 "ns_data": { 00:21:50.675 "id": 1, 00:21:50.675 "can_share": true 00:21:50.675 } 00:21:50.675 } 00:21:50.675 ], 00:21:50.675 "mp_policy": "active_passive" 00:21:50.675 } 00:21:50.675 } 00:21:50.675 ] 00:21:50.675 22:59:41 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:21:50.675 22:59:41 -- host/async_init.sh@72 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:21:50.675 22:59:41 -- common/autotest_common.sh@551 -- # xtrace_disable 00:21:50.675 22:59:41 -- common/autotest_common.sh@10 -- # set +x 00:21:50.934 22:59:41 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:21:50.934 22:59:41 -- host/async_init.sh@75 -- # rm -f /tmp/tmp.yuZu9EcpQg 00:21:50.934 22:59:41 -- host/async_init.sh@77 -- # trap - SIGINT SIGTERM EXIT 00:21:50.934 22:59:41 -- host/async_init.sh@78 -- # nvmftestfini 00:21:50.934 22:59:41 -- nvmf/common.sh@476 -- # nvmfcleanup 00:21:50.934 22:59:41 -- nvmf/common.sh@116 -- # sync 00:21:50.934 22:59:41 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:21:50.934 22:59:41 -- nvmf/common.sh@119 -- # set +e 00:21:50.934 22:59:41 -- nvmf/common.sh@120 -- # for i in {1..20} 00:21:50.934 22:59:41 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:21:50.934 rmmod nvme_tcp 00:21:50.934 rmmod nvme_fabrics 00:21:50.934 rmmod nvme_keyring 00:21:50.934 22:59:41 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:21:50.934 22:59:41 -- nvmf/common.sh@123 -- # set -e 00:21:50.934 22:59:41 -- nvmf/common.sh@124 -- # return 0 00:21:50.934 22:59:41 -- nvmf/common.sh@477 -- # '[' -n 344676 ']' 00:21:50.934 22:59:41 -- nvmf/common.sh@478 -- # killprocess 344676 00:21:50.934 22:59:41 -- common/autotest_common.sh@926 -- # '[' -z 344676 ']' 00:21:50.935 22:59:41 -- common/autotest_common.sh@930 -- # kill -0 344676 00:21:50.935 22:59:41 -- common/autotest_common.sh@931 -- # uname 00:21:50.935 22:59:41 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:21:50.935 22:59:41 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 344676 00:21:50.935 22:59:41 -- common/autotest_common.sh@932 -- # process_name=reactor_0 00:21:50.935 22:59:41 -- common/autotest_common.sh@936 -- # '[' reactor_0 = sudo ']' 00:21:50.935 22:59:41 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 344676' 00:21:50.935 killing process with pid 344676 00:21:50.935 22:59:41 -- common/autotest_common.sh@945 -- # kill 344676 00:21:50.935 22:59:41 -- common/autotest_common.sh@950 -- # wait 344676 00:21:51.194 22:59:42 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:21:51.194 22:59:42 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:21:51.194 22:59:42 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:21:51.194 22:59:42 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:21:51.194 22:59:42 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:21:51.194 22:59:42 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:21:51.194 22:59:42 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:21:51.194 22:59:42 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:21:53.102 22:59:44 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:21:53.102 00:21:53.102 real 0m6.001s 00:21:53.102 user 0m2.890s 00:21:53.102 sys 0m1.732s 00:21:53.102 22:59:44 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:21:53.102 22:59:44 -- common/autotest_common.sh@10 -- # set +x 00:21:53.102 ************************************ 00:21:53.102 END TEST nvmf_async_init 00:21:53.102 ************************************ 00:21:53.102 22:59:44 -- nvmf/nvmf.sh@93 -- # run_test dma /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/dma.sh --transport=tcp 00:21:53.102 22:59:44 -- common/autotest_common.sh@1077 -- # '[' 3 -le 1 ']' 00:21:53.102 22:59:44 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:21:53.102 22:59:44 -- common/autotest_common.sh@10 -- # set +x 00:21:53.102 ************************************ 00:21:53.102 START TEST dma 00:21:53.102 ************************************ 00:21:53.102 22:59:44 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/dma.sh --transport=tcp 00:21:53.376 * Looking for test storage... 00:21:53.376 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host 00:21:53.376 22:59:44 -- host/dma.sh@10 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:21:53.377 22:59:44 -- nvmf/common.sh@7 -- # uname -s 00:21:53.377 22:59:44 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:21:53.377 22:59:44 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:21:53.377 22:59:44 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:21:53.377 22:59:44 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:21:53.377 22:59:44 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:21:53.377 22:59:44 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:21:53.377 22:59:44 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:21:53.377 22:59:44 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:21:53.377 22:59:44 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:21:53.377 22:59:44 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:21:53.377 22:59:44 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:21:53.377 22:59:44 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:21:53.377 22:59:44 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:21:53.377 22:59:44 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:21:53.377 22:59:44 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:21:53.377 22:59:44 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:21:53.377 22:59:44 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:21:53.377 22:59:44 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:21:53.377 22:59:44 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:21:53.377 22:59:44 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:21:53.377 22:59:44 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:21:53.377 22:59:44 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:21:53.377 22:59:44 -- paths/export.sh@5 -- # export PATH 00:21:53.377 22:59:44 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:21:53.377 22:59:44 -- nvmf/common.sh@46 -- # : 0 00:21:53.377 22:59:44 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:21:53.377 22:59:44 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:21:53.377 22:59:44 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:21:53.377 22:59:44 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:21:53.377 22:59:44 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:21:53.377 22:59:44 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:21:53.377 22:59:44 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:21:53.377 22:59:44 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:21:53.377 22:59:44 -- host/dma.sh@12 -- # '[' tcp '!=' rdma ']' 00:21:53.377 22:59:44 -- host/dma.sh@13 -- # exit 0 00:21:53.377 00:21:53.377 real 0m0.066s 00:21:53.377 user 0m0.023s 00:21:53.377 sys 0m0.048s 00:21:53.377 22:59:44 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:21:53.377 22:59:44 -- common/autotest_common.sh@10 -- # set +x 00:21:53.377 ************************************ 00:21:53.377 END TEST dma 00:21:53.377 ************************************ 00:21:53.377 22:59:44 -- nvmf/nvmf.sh@96 -- # run_test nvmf_identify /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/identify.sh --transport=tcp 00:21:53.377 22:59:44 -- common/autotest_common.sh@1077 -- # '[' 3 -le 1 ']' 00:21:53.377 22:59:44 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:21:53.377 22:59:44 -- common/autotest_common.sh@10 -- # set +x 00:21:53.377 ************************************ 00:21:53.377 START TEST nvmf_identify 00:21:53.377 ************************************ 00:21:53.377 22:59:44 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/identify.sh --transport=tcp 00:21:53.377 * Looking for test storage... 00:21:53.377 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host 00:21:53.377 22:59:44 -- host/identify.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:21:53.377 22:59:44 -- nvmf/common.sh@7 -- # uname -s 00:21:53.377 22:59:44 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:21:53.377 22:59:44 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:21:53.377 22:59:44 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:21:53.377 22:59:44 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:21:53.377 22:59:44 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:21:53.377 22:59:44 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:21:53.377 22:59:44 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:21:53.377 22:59:44 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:21:53.377 22:59:44 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:21:53.377 22:59:44 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:21:53.377 22:59:44 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:21:53.377 22:59:44 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:21:53.377 22:59:44 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:21:53.377 22:59:44 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:21:53.377 22:59:44 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:21:53.377 22:59:44 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:21:53.377 22:59:44 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:21:53.377 22:59:44 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:21:53.377 22:59:44 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:21:53.377 22:59:44 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:21:53.377 22:59:44 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:21:53.377 22:59:44 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:21:53.377 22:59:44 -- paths/export.sh@5 -- # export PATH 00:21:53.377 22:59:44 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:21:53.377 22:59:44 -- nvmf/common.sh@46 -- # : 0 00:21:53.377 22:59:44 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:21:53.377 22:59:44 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:21:53.377 22:59:44 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:21:53.377 22:59:44 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:21:53.377 22:59:44 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:21:53.377 22:59:44 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:21:53.377 22:59:44 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:21:53.377 22:59:44 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:21:53.377 22:59:44 -- host/identify.sh@11 -- # MALLOC_BDEV_SIZE=64 00:21:53.377 22:59:44 -- host/identify.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:21:53.377 22:59:44 -- host/identify.sh@14 -- # nvmftestinit 00:21:53.377 22:59:44 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:21:53.377 22:59:44 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:21:53.377 22:59:44 -- nvmf/common.sh@436 -- # prepare_net_devs 00:21:53.377 22:59:44 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:21:53.377 22:59:44 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:21:53.377 22:59:44 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:21:53.377 22:59:44 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:21:53.377 22:59:44 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:21:53.377 22:59:44 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:21:53.377 22:59:44 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:21:53.377 22:59:44 -- nvmf/common.sh@284 -- # xtrace_disable 00:21:53.377 22:59:44 -- common/autotest_common.sh@10 -- # set +x 00:21:55.282 22:59:46 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:21:55.282 22:59:46 -- nvmf/common.sh@290 -- # pci_devs=() 00:21:55.282 22:59:46 -- nvmf/common.sh@290 -- # local -a pci_devs 00:21:55.282 22:59:46 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:21:55.282 22:59:46 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:21:55.282 22:59:46 -- nvmf/common.sh@292 -- # pci_drivers=() 00:21:55.282 22:59:46 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:21:55.282 22:59:46 -- nvmf/common.sh@294 -- # net_devs=() 00:21:55.282 22:59:46 -- nvmf/common.sh@294 -- # local -ga net_devs 00:21:55.282 22:59:46 -- nvmf/common.sh@295 -- # e810=() 00:21:55.282 22:59:46 -- nvmf/common.sh@295 -- # local -ga e810 00:21:55.282 22:59:46 -- nvmf/common.sh@296 -- # x722=() 00:21:55.282 22:59:46 -- nvmf/common.sh@296 -- # local -ga x722 00:21:55.282 22:59:46 -- nvmf/common.sh@297 -- # mlx=() 00:21:55.282 22:59:46 -- nvmf/common.sh@297 -- # local -ga mlx 00:21:55.282 22:59:46 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:21:55.282 22:59:46 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:21:55.282 22:59:46 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:21:55.283 22:59:46 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:21:55.283 22:59:46 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:21:55.283 22:59:46 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:21:55.283 22:59:46 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:21:55.283 22:59:46 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:21:55.283 22:59:46 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:21:55.283 22:59:46 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:21:55.283 22:59:46 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:21:55.283 22:59:46 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:21:55.283 22:59:46 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:21:55.283 22:59:46 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:21:55.283 22:59:46 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:21:55.283 22:59:46 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:21:55.283 22:59:46 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:21:55.283 22:59:46 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:21:55.283 22:59:46 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:21:55.283 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:21:55.283 22:59:46 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:21:55.283 22:59:46 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:21:55.283 22:59:46 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:21:55.283 22:59:46 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:21:55.283 22:59:46 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:21:55.283 22:59:46 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:21:55.283 22:59:46 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:21:55.283 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:21:55.283 22:59:46 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:21:55.283 22:59:46 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:21:55.283 22:59:46 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:21:55.283 22:59:46 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:21:55.283 22:59:46 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:21:55.283 22:59:46 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:21:55.283 22:59:46 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:21:55.283 22:59:46 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:21:55.283 22:59:46 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:21:55.283 22:59:46 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:21:55.283 22:59:46 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:21:55.283 22:59:46 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:21:55.283 22:59:46 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:21:55.283 Found net devices under 0000:0a:00.0: cvl_0_0 00:21:55.283 22:59:46 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:21:55.283 22:59:46 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:21:55.283 22:59:46 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:21:55.283 22:59:46 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:21:55.283 22:59:46 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:21:55.283 22:59:46 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:21:55.283 Found net devices under 0000:0a:00.1: cvl_0_1 00:21:55.283 22:59:46 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:21:55.283 22:59:46 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:21:55.283 22:59:46 -- nvmf/common.sh@402 -- # is_hw=yes 00:21:55.283 22:59:46 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:21:55.283 22:59:46 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:21:55.283 22:59:46 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:21:55.283 22:59:46 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:21:55.283 22:59:46 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:21:55.283 22:59:46 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:21:55.283 22:59:46 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:21:55.283 22:59:46 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:21:55.283 22:59:46 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:21:55.283 22:59:46 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:21:55.283 22:59:46 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:21:55.283 22:59:46 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:21:55.283 22:59:46 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:21:55.283 22:59:46 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:21:55.283 22:59:46 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:21:55.283 22:59:46 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:21:55.283 22:59:46 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:21:55.283 22:59:46 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:21:55.283 22:59:46 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:21:55.283 22:59:46 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:21:55.283 22:59:46 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:21:55.283 22:59:46 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:21:55.542 22:59:46 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:21:55.542 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:21:55.542 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.189 ms 00:21:55.542 00:21:55.542 --- 10.0.0.2 ping statistics --- 00:21:55.542 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:21:55.542 rtt min/avg/max/mdev = 0.189/0.189/0.189/0.000 ms 00:21:55.542 22:59:46 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:21:55.542 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:21:55.542 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.096 ms 00:21:55.542 00:21:55.542 --- 10.0.0.1 ping statistics --- 00:21:55.542 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:21:55.542 rtt min/avg/max/mdev = 0.096/0.096/0.096/0.000 ms 00:21:55.542 22:59:46 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:21:55.542 22:59:46 -- nvmf/common.sh@410 -- # return 0 00:21:55.542 22:59:46 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:21:55.542 22:59:46 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:21:55.542 22:59:46 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:21:55.542 22:59:46 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:21:55.542 22:59:46 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:21:55.542 22:59:46 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:21:55.542 22:59:46 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:21:55.542 22:59:46 -- host/identify.sh@16 -- # timing_enter start_nvmf_tgt 00:21:55.542 22:59:46 -- common/autotest_common.sh@712 -- # xtrace_disable 00:21:55.542 22:59:46 -- common/autotest_common.sh@10 -- # set +x 00:21:55.542 22:59:46 -- host/identify.sh@19 -- # nvmfpid=346823 00:21:55.542 22:59:46 -- host/identify.sh@18 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:21:55.542 22:59:46 -- host/identify.sh@21 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:21:55.542 22:59:46 -- host/identify.sh@23 -- # waitforlisten 346823 00:21:55.542 22:59:46 -- common/autotest_common.sh@819 -- # '[' -z 346823 ']' 00:21:55.542 22:59:46 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk.sock 00:21:55.542 22:59:46 -- common/autotest_common.sh@824 -- # local max_retries=100 00:21:55.542 22:59:46 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:21:55.542 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:21:55.542 22:59:46 -- common/autotest_common.sh@828 -- # xtrace_disable 00:21:55.542 22:59:46 -- common/autotest_common.sh@10 -- # set +x 00:21:55.542 [2024-04-16 22:59:46.481554] Starting SPDK v24.01.1-pre git sha1 4b134b4ab / DPDK 23.11.0 initialization... 00:21:55.542 [2024-04-16 22:59:46.481638] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:21:55.542 EAL: No free 2048 kB hugepages reported on node 1 00:21:55.542 [2024-04-16 22:59:46.546053] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:21:55.542 [2024-04-16 22:59:46.654561] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:21:55.542 [2024-04-16 22:59:46.654720] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:21:55.542 [2024-04-16 22:59:46.654748] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:21:55.542 [2024-04-16 22:59:46.654761] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:21:55.542 [2024-04-16 22:59:46.654811] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:21:55.542 [2024-04-16 22:59:46.654873] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:21:55.542 [2024-04-16 22:59:46.654921] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:21:55.542 [2024-04-16 22:59:46.654923] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:21:56.481 22:59:47 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:21:56.481 22:59:47 -- common/autotest_common.sh@852 -- # return 0 00:21:56.481 22:59:47 -- host/identify.sh@24 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:21:56.481 22:59:47 -- common/autotest_common.sh@551 -- # xtrace_disable 00:21:56.481 22:59:47 -- common/autotest_common.sh@10 -- # set +x 00:21:56.481 [2024-04-16 22:59:47.452763] tcp.c: 659:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:21:56.481 22:59:47 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:21:56.481 22:59:47 -- host/identify.sh@25 -- # timing_exit start_nvmf_tgt 00:21:56.481 22:59:47 -- common/autotest_common.sh@718 -- # xtrace_disable 00:21:56.481 22:59:47 -- common/autotest_common.sh@10 -- # set +x 00:21:56.481 22:59:47 -- host/identify.sh@27 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc0 00:21:56.481 22:59:47 -- common/autotest_common.sh@551 -- # xtrace_disable 00:21:56.481 22:59:47 -- common/autotest_common.sh@10 -- # set +x 00:21:56.481 Malloc0 00:21:56.481 22:59:47 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:21:56.481 22:59:47 -- host/identify.sh@28 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:21:56.481 22:59:47 -- common/autotest_common.sh@551 -- # xtrace_disable 00:21:56.481 22:59:47 -- common/autotest_common.sh@10 -- # set +x 00:21:56.481 22:59:47 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:21:56.481 22:59:47 -- host/identify.sh@31 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 --nguid ABCDEF0123456789ABCDEF0123456789 --eui64 ABCDEF0123456789 00:21:56.481 22:59:47 -- common/autotest_common.sh@551 -- # xtrace_disable 00:21:56.481 22:59:47 -- common/autotest_common.sh@10 -- # set +x 00:21:56.481 22:59:47 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:21:56.482 22:59:47 -- host/identify.sh@34 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:21:56.482 22:59:47 -- common/autotest_common.sh@551 -- # xtrace_disable 00:21:56.482 22:59:47 -- common/autotest_common.sh@10 -- # set +x 00:21:56.482 [2024-04-16 22:59:47.530388] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:21:56.482 22:59:47 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:21:56.482 22:59:47 -- host/identify.sh@35 -- # rpc_cmd nvmf_subsystem_add_listener discovery -t tcp -a 10.0.0.2 -s 4420 00:21:56.482 22:59:47 -- common/autotest_common.sh@551 -- # xtrace_disable 00:21:56.482 22:59:47 -- common/autotest_common.sh@10 -- # set +x 00:21:56.482 22:59:47 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:21:56.482 22:59:47 -- host/identify.sh@37 -- # rpc_cmd nvmf_get_subsystems 00:21:56.482 22:59:47 -- common/autotest_common.sh@551 -- # xtrace_disable 00:21:56.482 22:59:47 -- common/autotest_common.sh@10 -- # set +x 00:21:56.482 [2024-04-16 22:59:47.546141] nvmf_rpc.c: 275:rpc_nvmf_get_subsystems: *WARNING*: rpc_nvmf_get_subsystems: deprecated feature listener.transport is deprecated in favor of trtype to be removed in v24.05 00:21:56.482 [ 00:21:56.482 { 00:21:56.482 "nqn": "nqn.2014-08.org.nvmexpress.discovery", 00:21:56.482 "subtype": "Discovery", 00:21:56.482 "listen_addresses": [ 00:21:56.482 { 00:21:56.482 "transport": "TCP", 00:21:56.482 "trtype": "TCP", 00:21:56.482 "adrfam": "IPv4", 00:21:56.482 "traddr": "10.0.0.2", 00:21:56.482 "trsvcid": "4420" 00:21:56.482 } 00:21:56.482 ], 00:21:56.482 "allow_any_host": true, 00:21:56.482 "hosts": [] 00:21:56.482 }, 00:21:56.482 { 00:21:56.482 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:21:56.482 "subtype": "NVMe", 00:21:56.482 "listen_addresses": [ 00:21:56.482 { 00:21:56.482 "transport": "TCP", 00:21:56.482 "trtype": "TCP", 00:21:56.482 "adrfam": "IPv4", 00:21:56.482 "traddr": "10.0.0.2", 00:21:56.482 "trsvcid": "4420" 00:21:56.482 } 00:21:56.482 ], 00:21:56.482 "allow_any_host": true, 00:21:56.482 "hosts": [], 00:21:56.482 "serial_number": "SPDK00000000000001", 00:21:56.482 "model_number": "SPDK bdev Controller", 00:21:56.482 "max_namespaces": 32, 00:21:56.482 "min_cntlid": 1, 00:21:56.482 "max_cntlid": 65519, 00:21:56.482 "namespaces": [ 00:21:56.482 { 00:21:56.482 "nsid": 1, 00:21:56.482 "bdev_name": "Malloc0", 00:21:56.482 "name": "Malloc0", 00:21:56.482 "nguid": "ABCDEF0123456789ABCDEF0123456789", 00:21:56.482 "eui64": "ABCDEF0123456789", 00:21:56.482 "uuid": "884647f0-359d-456b-a75c-9c016859fd04" 00:21:56.482 } 00:21:56.482 ] 00:21:56.482 } 00:21:56.482 ] 00:21:56.482 22:59:47 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:21:56.482 22:59:47 -- host/identify.sh@39 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_identify -r ' trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2014-08.org.nvmexpress.discovery' -L all 00:21:56.482 [2024-04-16 22:59:47.571156] Starting SPDK v24.01.1-pre git sha1 4b134b4ab / DPDK 23.11.0 initialization... 00:21:56.482 [2024-04-16 22:59:47.571225] [ DPDK EAL parameters: identify --no-shconf -c 0x1 -n 1 -m 0 --no-pci --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid346984 ] 00:21:56.482 EAL: No free 2048 kB hugepages reported on node 1 00:21:56.482 [2024-04-16 22:59:47.607727] nvme_ctrlr.c:1477:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to connect adminq (no timeout) 00:21:56.482 [2024-04-16 22:59:47.607787] nvme_tcp.c:2244:nvme_tcp_qpair_connect_sock: *DEBUG*: adrfam 1 ai_family 2 00:21:56.482 [2024-04-16 22:59:47.607797] nvme_tcp.c:2248:nvme_tcp_qpair_connect_sock: *DEBUG*: trsvcid is 4420 00:21:56.482 [2024-04-16 22:59:47.607813] nvme_tcp.c:2266:nvme_tcp_qpair_connect_sock: *DEBUG*: sock_impl_name is (null) 00:21:56.482 [2024-04-16 22:59:47.607826] sock.c: 334:spdk_sock_connect_ext: *DEBUG*: Creating a client socket using impl posix 00:21:56.482 [2024-04-16 22:59:47.608103] nvme_ctrlr.c:1477:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to wait for connect adminq (no timeout) 00:21:56.482 [2024-04-16 22:59:47.608156] nvme_tcp.c:1487:nvme_tcp_send_icreq_complete: *DEBUG*: Complete the icreq send for tqpair=0x1c23e10 0 00:21:56.748 [2024-04-16 22:59:47.614190] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 1 00:21:56.748 [2024-04-16 22:59:47.614212] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =1 00:21:56.748 [2024-04-16 22:59:47.614221] nvme_tcp.c:1533:nvme_tcp_icresp_handle: *DEBUG*: host_hdgst_enable: 0 00:21:56.748 [2024-04-16 22:59:47.614227] nvme_tcp.c:1534:nvme_tcp_icresp_handle: *DEBUG*: host_ddgst_enable: 0 00:21:56.748 [2024-04-16 22:59:47.614279] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:21:56.748 [2024-04-16 22:59:47.614292] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:21:56.748 [2024-04-16 22:59:47.614300] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x1c23e10) 00:21:56.748 [2024-04-16 22:59:47.614317] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC CONNECT qid:0 cid:0 SGL DATA BLOCK OFFSET 0x0 len:0x400 00:21:56.748 [2024-04-16 22:59:47.614344] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1ca3bf0, cid 0, qid 0 00:21:56.748 [2024-04-16 22:59:47.622191] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:21:56.748 [2024-04-16 22:59:47.622209] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:21:56.748 [2024-04-16 22:59:47.622216] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:21:56.748 [2024-04-16 22:59:47.622224] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x1ca3bf0) on tqpair=0x1c23e10 00:21:56.748 [2024-04-16 22:59:47.622240] nvme_fabric.c: 620:nvme_fabric_qpair_connect_poll: *DEBUG*: CNTLID 0x0001 00:21:56.748 [2024-04-16 22:59:47.622271] nvme_ctrlr.c:1477:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to read vs (no timeout) 00:21:56.748 [2024-04-16 22:59:47.622281] nvme_ctrlr.c:1477:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to read vs wait for vs (no timeout) 00:21:56.748 [2024-04-16 22:59:47.622304] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:21:56.748 [2024-04-16 22:59:47.622312] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:21:56.748 [2024-04-16 22:59:47.622319] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x1c23e10) 00:21:56.748 [2024-04-16 22:59:47.622330] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:0 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:56.748 [2024-04-16 22:59:47.622353] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1ca3bf0, cid 0, qid 0 00:21:56.748 [2024-04-16 22:59:47.622513] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:21:56.748 [2024-04-16 22:59:47.622529] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:21:56.748 [2024-04-16 22:59:47.622536] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:21:56.748 [2024-04-16 22:59:47.622543] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x1ca3bf0) on tqpair=0x1c23e10 00:21:56.748 [2024-04-16 22:59:47.622558] nvme_ctrlr.c:1477:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to read cap (no timeout) 00:21:56.749 [2024-04-16 22:59:47.622573] nvme_ctrlr.c:1477:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to read cap wait for cap (no timeout) 00:21:56.749 [2024-04-16 22:59:47.622585] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:21:56.749 [2024-04-16 22:59:47.622593] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:21:56.749 [2024-04-16 22:59:47.622599] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x1c23e10) 00:21:56.749 [2024-04-16 22:59:47.622610] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:0 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:56.749 [2024-04-16 22:59:47.622631] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1ca3bf0, cid 0, qid 0 00:21:56.749 [2024-04-16 22:59:47.622751] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:21:56.749 [2024-04-16 22:59:47.622763] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:21:56.749 [2024-04-16 22:59:47.622770] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:21:56.749 [2024-04-16 22:59:47.622777] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x1ca3bf0) on tqpair=0x1c23e10 00:21:56.749 [2024-04-16 22:59:47.622788] nvme_ctrlr.c:1477:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to check en (no timeout) 00:21:56.749 [2024-04-16 22:59:47.622801] nvme_ctrlr.c:1471:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to check en wait for cc (timeout 15000 ms) 00:21:56.749 [2024-04-16 22:59:47.622814] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:21:56.749 [2024-04-16 22:59:47.622821] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:21:56.749 [2024-04-16 22:59:47.622828] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x1c23e10) 00:21:56.749 [2024-04-16 22:59:47.622838] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:0 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:56.749 [2024-04-16 22:59:47.622857] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1ca3bf0, cid 0, qid 0 00:21:56.749 [2024-04-16 22:59:47.622976] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:21:56.749 [2024-04-16 22:59:47.622991] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:21:56.749 [2024-04-16 22:59:47.622998] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:21:56.749 [2024-04-16 22:59:47.623005] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x1ca3bf0) on tqpair=0x1c23e10 00:21:56.749 [2024-04-16 22:59:47.623015] nvme_ctrlr.c:1471:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to disable and wait for CSTS.RDY = 0 (timeout 15000 ms) 00:21:56.749 [2024-04-16 22:59:47.623036] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:21:56.749 [2024-04-16 22:59:47.623046] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:21:56.749 [2024-04-16 22:59:47.623052] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x1c23e10) 00:21:56.749 [2024-04-16 22:59:47.623063] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:0 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:56.749 [2024-04-16 22:59:47.623083] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1ca3bf0, cid 0, qid 0 00:21:56.749 [2024-04-16 22:59:47.623201] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:21:56.749 [2024-04-16 22:59:47.623214] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:21:56.749 [2024-04-16 22:59:47.623221] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:21:56.749 [2024-04-16 22:59:47.623228] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x1ca3bf0) on tqpair=0x1c23e10 00:21:56.749 [2024-04-16 22:59:47.623237] nvme_ctrlr.c:3736:nvme_ctrlr_process_init_wait_for_ready_0: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] CC.EN = 0 && CSTS.RDY = 0 00:21:56.749 [2024-04-16 22:59:47.623246] nvme_ctrlr.c:1471:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to controller is disabled (timeout 15000 ms) 00:21:56.749 [2024-04-16 22:59:47.623259] nvme_ctrlr.c:1471:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to enable controller by writing CC.EN = 1 (timeout 15000 ms) 00:21:56.749 [2024-04-16 22:59:47.623369] nvme_ctrlr.c:3929:nvme_ctrlr_process_init: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] Setting CC.EN = 1 00:21:56.749 [2024-04-16 22:59:47.623378] nvme_ctrlr.c:1471:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to enable controller by writing CC.EN = 1 reg (timeout 15000 ms) 00:21:56.749 [2024-04-16 22:59:47.623392] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:21:56.749 [2024-04-16 22:59:47.623400] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:21:56.749 [2024-04-16 22:59:47.623406] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x1c23e10) 00:21:56.749 [2024-04-16 22:59:47.623416] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY SET qid:0 cid:0 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:56.749 [2024-04-16 22:59:47.623437] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1ca3bf0, cid 0, qid 0 00:21:56.749 [2024-04-16 22:59:47.623588] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:21:56.749 [2024-04-16 22:59:47.623603] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:21:56.749 [2024-04-16 22:59:47.623610] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:21:56.749 [2024-04-16 22:59:47.623617] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x1ca3bf0) on tqpair=0x1c23e10 00:21:56.749 [2024-04-16 22:59:47.623627] nvme_ctrlr.c:1471:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to wait for CSTS.RDY = 1 (timeout 15000 ms) 00:21:56.749 [2024-04-16 22:59:47.623643] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:21:56.749 [2024-04-16 22:59:47.623652] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:21:56.749 [2024-04-16 22:59:47.623659] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x1c23e10) 00:21:56.749 [2024-04-16 22:59:47.623669] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:0 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:56.749 [2024-04-16 22:59:47.623689] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1ca3bf0, cid 0, qid 0 00:21:56.749 [2024-04-16 22:59:47.623803] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:21:56.749 [2024-04-16 22:59:47.623815] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:21:56.749 [2024-04-16 22:59:47.623822] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:21:56.749 [2024-04-16 22:59:47.623829] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x1ca3bf0) on tqpair=0x1c23e10 00:21:56.749 [2024-04-16 22:59:47.623843] nvme_ctrlr.c:3771:nvme_ctrlr_process_init_enable_wait_for_ready_1: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] CC.EN = 1 && CSTS.RDY = 1 - controller is ready 00:21:56.749 [2024-04-16 22:59:47.623852] nvme_ctrlr.c:1471:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to reset admin queue (timeout 30000 ms) 00:21:56.749 [2024-04-16 22:59:47.623866] nvme_ctrlr.c:1477:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to identify controller (no timeout) 00:21:56.749 [2024-04-16 22:59:47.623880] nvme_ctrlr.c:1471:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to wait for identify controller (timeout 30000 ms) 00:21:56.749 [2024-04-16 22:59:47.623895] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:21:56.749 [2024-04-16 22:59:47.623903] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:21:56.749 [2024-04-16 22:59:47.623909] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x1c23e10) 00:21:56.749 [2024-04-16 22:59:47.623919] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: IDENTIFY (06) qid:0 cid:0 nsid:0 cdw10:00000001 cdw11:00000000 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:56.749 [2024-04-16 22:59:47.623940] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1ca3bf0, cid 0, qid 0 00:21:56.749 [2024-04-16 22:59:47.624104] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 7 00:21:56.749 [2024-04-16 22:59:47.624116] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =7 00:21:56.749 [2024-04-16 22:59:47.624124] nvme_tcp.c:1650:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: enter 00:21:56.749 [2024-04-16 22:59:47.624131] nvme_tcp.c:1651:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: c2h_data info on tqpair(0x1c23e10): datao=0, datal=4096, cccid=0 00:21:56.749 [2024-04-16 22:59:47.624138] nvme_tcp.c:1662:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: tcp_req(0x1ca3bf0) on tqpair(0x1c23e10): expected_datao=0, payload_size=4096 00:21:56.749 [2024-04-16 22:59:47.624151] nvme_tcp.c:1453:nvme_tcp_pdu_payload_handle: *DEBUG*: enter 00:21:56.749 [2024-04-16 22:59:47.624160] nvme_tcp.c:1237:nvme_tcp_c2h_data_payload_handle: *DEBUG*: enter 00:21:56.749 [2024-04-16 22:59:47.624183] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:21:56.749 [2024-04-16 22:59:47.624195] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:21:56.749 [2024-04-16 22:59:47.624202] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:21:56.749 [2024-04-16 22:59:47.624209] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x1ca3bf0) on tqpair=0x1c23e10 00:21:56.749 [2024-04-16 22:59:47.624222] nvme_ctrlr.c:1971:nvme_ctrlr_identify_done: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] transport max_xfer_size 4294967295 00:21:56.749 [2024-04-16 22:59:47.624237] nvme_ctrlr.c:1975:nvme_ctrlr_identify_done: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] MDTS max_xfer_size 131072 00:21:56.749 [2024-04-16 22:59:47.624245] nvme_ctrlr.c:1978:nvme_ctrlr_identify_done: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] CNTLID 0x0001 00:21:56.749 [2024-04-16 22:59:47.624254] nvme_ctrlr.c:2002:nvme_ctrlr_identify_done: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] transport max_sges 16 00:21:56.749 [2024-04-16 22:59:47.624261] nvme_ctrlr.c:2017:nvme_ctrlr_identify_done: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] fuses compare and write: 1 00:21:56.749 [2024-04-16 22:59:47.624270] nvme_ctrlr.c:1471:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to configure AER (timeout 30000 ms) 00:21:56.749 [2024-04-16 22:59:47.624284] nvme_ctrlr.c:1471:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to wait for configure aer (timeout 30000 ms) 00:21:56.749 [2024-04-16 22:59:47.624297] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:21:56.749 [2024-04-16 22:59:47.624304] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:21:56.749 [2024-04-16 22:59:47.624311] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x1c23e10) 00:21:56.749 [2024-04-16 22:59:47.624321] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: SET FEATURES ASYNC EVENT CONFIGURATION cid:0 cdw10:0000000b SGL DATA BLOCK OFFSET 0x0 len:0x0 00:21:56.749 [2024-04-16 22:59:47.624347] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1ca3bf0, cid 0, qid 0 00:21:56.749 [2024-04-16 22:59:47.624467] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:21:56.749 [2024-04-16 22:59:47.624479] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:21:56.749 [2024-04-16 22:59:47.624486] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:21:56.749 [2024-04-16 22:59:47.624492] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x1ca3bf0) on tqpair=0x1c23e10 00:21:56.749 [2024-04-16 22:59:47.624506] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:21:56.749 [2024-04-16 22:59:47.624513] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:21:56.749 [2024-04-16 22:59:47.624520] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x1c23e10) 00:21:56.749 [2024-04-16 22:59:47.624530] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:21:56.749 [2024-04-16 22:59:47.624540] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:21:56.749 [2024-04-16 22:59:47.624546] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:21:56.750 [2024-04-16 22:59:47.624553] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=1 on tqpair(0x1c23e10) 00:21:56.750 [2024-04-16 22:59:47.624562] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:21:56.750 [2024-04-16 22:59:47.624571] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:21:56.750 [2024-04-16 22:59:47.624578] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:21:56.750 [2024-04-16 22:59:47.624584] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=2 on tqpair(0x1c23e10) 00:21:56.750 [2024-04-16 22:59:47.624593] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:21:56.750 [2024-04-16 22:59:47.624603] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:21:56.750 [2024-04-16 22:59:47.624609] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:21:56.750 [2024-04-16 22:59:47.624616] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x1c23e10) 00:21:56.750 [2024-04-16 22:59:47.624625] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:21:56.750 [2024-04-16 22:59:47.624633] nvme_ctrlr.c:1471:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to set keep alive timeout (timeout 30000 ms) 00:21:56.750 [2024-04-16 22:59:47.624653] nvme_ctrlr.c:1471:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to wait for set keep alive timeout (timeout 30000 ms) 00:21:56.750 [2024-04-16 22:59:47.624666] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:21:56.750 [2024-04-16 22:59:47.624673] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:21:56.750 [2024-04-16 22:59:47.624679] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=4 on tqpair(0x1c23e10) 00:21:56.750 [2024-04-16 22:59:47.624689] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: GET FEATURES KEEP ALIVE TIMER cid:4 cdw10:0000000f SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:56.750 [2024-04-16 22:59:47.624711] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1ca3bf0, cid 0, qid 0 00:21:56.750 [2024-04-16 22:59:47.624721] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1ca3d50, cid 1, qid 0 00:21:56.750 [2024-04-16 22:59:47.624729] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1ca3eb0, cid 2, qid 0 00:21:56.750 [2024-04-16 22:59:47.624737] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1ca4010, cid 3, qid 0 00:21:56.750 [2024-04-16 22:59:47.624744] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1ca4170, cid 4, qid 0 00:21:56.750 [2024-04-16 22:59:47.624917] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:21:56.750 [2024-04-16 22:59:47.624932] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:21:56.750 [2024-04-16 22:59:47.624943] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:21:56.750 [2024-04-16 22:59:47.624950] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x1ca4170) on tqpair=0x1c23e10 00:21:56.750 [2024-04-16 22:59:47.624960] nvme_ctrlr.c:2889:nvme_ctrlr_set_keep_alive_timeout_done: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] Sending keep alive every 5000000 us 00:21:56.750 [2024-04-16 22:59:47.624969] nvme_ctrlr.c:1477:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to ready (no timeout) 00:21:56.750 [2024-04-16 22:59:47.624987] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:21:56.750 [2024-04-16 22:59:47.624996] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:21:56.750 [2024-04-16 22:59:47.625003] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=4 on tqpair(0x1c23e10) 00:21:56.750 [2024-04-16 22:59:47.625013] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: IDENTIFY (06) qid:0 cid:4 nsid:0 cdw10:00000001 cdw11:00000000 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:56.750 [2024-04-16 22:59:47.625033] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1ca4170, cid 4, qid 0 00:21:56.750 [2024-04-16 22:59:47.625189] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 7 00:21:56.750 [2024-04-16 22:59:47.625203] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =7 00:21:56.750 [2024-04-16 22:59:47.625210] nvme_tcp.c:1650:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: enter 00:21:56.750 [2024-04-16 22:59:47.625217] nvme_tcp.c:1651:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: c2h_data info on tqpair(0x1c23e10): datao=0, datal=4096, cccid=4 00:21:56.750 [2024-04-16 22:59:47.625225] nvme_tcp.c:1662:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: tcp_req(0x1ca4170) on tqpair(0x1c23e10): expected_datao=0, payload_size=4096 00:21:56.750 [2024-04-16 22:59:47.625241] nvme_tcp.c:1453:nvme_tcp_pdu_payload_handle: *DEBUG*: enter 00:21:56.750 [2024-04-16 22:59:47.625250] nvme_tcp.c:1237:nvme_tcp_c2h_data_payload_handle: *DEBUG*: enter 00:21:56.750 [2024-04-16 22:59:47.667190] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:21:56.750 [2024-04-16 22:59:47.667209] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:21:56.750 [2024-04-16 22:59:47.667216] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:21:56.750 [2024-04-16 22:59:47.667223] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x1ca4170) on tqpair=0x1c23e10 00:21:56.750 [2024-04-16 22:59:47.667244] nvme_ctrlr.c:4023:nvme_ctrlr_process_init: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] Ctrlr already in ready state 00:21:56.750 [2024-04-16 22:59:47.667290] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:21:56.750 [2024-04-16 22:59:47.667300] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:21:56.750 [2024-04-16 22:59:47.667307] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=4 on tqpair(0x1c23e10) 00:21:56.750 [2024-04-16 22:59:47.667318] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: GET LOG PAGE (02) qid:0 cid:4 nsid:0 cdw10:00ff0070 cdw11:00000000 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:56.750 [2024-04-16 22:59:47.667330] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:21:56.750 [2024-04-16 22:59:47.667337] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:21:56.750 [2024-04-16 22:59:47.667343] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=5 on tqpair(0x1c23e10) 00:21:56.750 [2024-04-16 22:59:47.667352] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: KEEP ALIVE (18) qid:0 cid:5 nsid:0 cdw10:00000000 cdw11:00000000 00:21:56.750 [2024-04-16 22:59:47.667382] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1ca4170, cid 4, qid 0 00:21:56.750 [2024-04-16 22:59:47.667394] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1ca42d0, cid 5, qid 0 00:21:56.750 [2024-04-16 22:59:47.667620] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 7 00:21:56.750 [2024-04-16 22:59:47.667635] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =7 00:21:56.750 [2024-04-16 22:59:47.667643] nvme_tcp.c:1650:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: enter 00:21:56.750 [2024-04-16 22:59:47.667649] nvme_tcp.c:1651:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: c2h_data info on tqpair(0x1c23e10): datao=0, datal=1024, cccid=4 00:21:56.750 [2024-04-16 22:59:47.667664] nvme_tcp.c:1662:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: tcp_req(0x1ca4170) on tqpair(0x1c23e10): expected_datao=0, payload_size=1024 00:21:56.750 [2024-04-16 22:59:47.667676] nvme_tcp.c:1453:nvme_tcp_pdu_payload_handle: *DEBUG*: enter 00:21:56.750 [2024-04-16 22:59:47.667683] nvme_tcp.c:1237:nvme_tcp_c2h_data_payload_handle: *DEBUG*: enter 00:21:56.750 [2024-04-16 22:59:47.667692] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:21:56.750 [2024-04-16 22:59:47.667701] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:21:56.750 [2024-04-16 22:59:47.667708] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:21:56.750 [2024-04-16 22:59:47.667715] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x1ca42d0) on tqpair=0x1c23e10 00:21:56.750 [2024-04-16 22:59:47.708301] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:21:56.750 [2024-04-16 22:59:47.708319] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:21:56.750 [2024-04-16 22:59:47.708327] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:21:56.750 [2024-04-16 22:59:47.708334] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x1ca4170) on tqpair=0x1c23e10 00:21:56.750 [2024-04-16 22:59:47.708354] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:21:56.750 [2024-04-16 22:59:47.708363] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:21:56.750 [2024-04-16 22:59:47.708370] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=4 on tqpair(0x1c23e10) 00:21:56.750 [2024-04-16 22:59:47.708381] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: GET LOG PAGE (02) qid:0 cid:4 nsid:0 cdw10:02ff0070 cdw11:00000000 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:56.750 [2024-04-16 22:59:47.708410] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1ca4170, cid 4, qid 0 00:21:56.750 [2024-04-16 22:59:47.708552] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 7 00:21:56.750 [2024-04-16 22:59:47.708564] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =7 00:21:56.750 [2024-04-16 22:59:47.708571] nvme_tcp.c:1650:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: enter 00:21:56.750 [2024-04-16 22:59:47.708578] nvme_tcp.c:1651:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: c2h_data info on tqpair(0x1c23e10): datao=0, datal=3072, cccid=4 00:21:56.750 [2024-04-16 22:59:47.708586] nvme_tcp.c:1662:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: tcp_req(0x1ca4170) on tqpair(0x1c23e10): expected_datao=0, payload_size=3072 00:21:56.750 [2024-04-16 22:59:47.708597] nvme_tcp.c:1453:nvme_tcp_pdu_payload_handle: *DEBUG*: enter 00:21:56.750 [2024-04-16 22:59:47.708605] nvme_tcp.c:1237:nvme_tcp_c2h_data_payload_handle: *DEBUG*: enter 00:21:56.750 [2024-04-16 22:59:47.708623] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:21:56.750 [2024-04-16 22:59:47.708634] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:21:56.750 [2024-04-16 22:59:47.708641] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:21:56.750 [2024-04-16 22:59:47.708648] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x1ca4170) on tqpair=0x1c23e10 00:21:56.750 [2024-04-16 22:59:47.708664] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:21:56.750 [2024-04-16 22:59:47.708673] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:21:56.750 [2024-04-16 22:59:47.708679] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=4 on tqpair(0x1c23e10) 00:21:56.750 [2024-04-16 22:59:47.708690] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: GET LOG PAGE (02) qid:0 cid:4 nsid:0 cdw10:00010070 cdw11:00000000 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:56.750 [2024-04-16 22:59:47.708717] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1ca4170, cid 4, qid 0 00:21:56.750 [2024-04-16 22:59:47.708844] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 7 00:21:56.750 [2024-04-16 22:59:47.708856] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =7 00:21:56.750 [2024-04-16 22:59:47.708863] nvme_tcp.c:1650:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: enter 00:21:56.750 [2024-04-16 22:59:47.708870] nvme_tcp.c:1651:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: c2h_data info on tqpair(0x1c23e10): datao=0, datal=8, cccid=4 00:21:56.750 [2024-04-16 22:59:47.708882] nvme_tcp.c:1662:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: tcp_req(0x1ca4170) on tqpair(0x1c23e10): expected_datao=0, payload_size=8 00:21:56.750 [2024-04-16 22:59:47.708894] nvme_tcp.c:1453:nvme_tcp_pdu_payload_handle: *DEBUG*: enter 00:21:56.750 [2024-04-16 22:59:47.708901] nvme_tcp.c:1237:nvme_tcp_c2h_data_payload_handle: *DEBUG*: enter 00:21:56.750 [2024-04-16 22:59:47.749309] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:21:56.750 [2024-04-16 22:59:47.749329] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:21:56.751 [2024-04-16 22:59:47.749336] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:21:56.751 [2024-04-16 22:59:47.749343] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x1ca4170) on tqpair=0x1c23e10 00:21:56.751 ===================================================== 00:21:56.751 NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2014-08.org.nvmexpress.discovery 00:21:56.751 ===================================================== 00:21:56.751 Controller Capabilities/Features 00:21:56.751 ================================ 00:21:56.751 Vendor ID: 0000 00:21:56.751 Subsystem Vendor ID: 0000 00:21:56.751 Serial Number: .................... 00:21:56.751 Model Number: ........................................ 00:21:56.751 Firmware Version: 24.01.1 00:21:56.751 Recommended Arb Burst: 0 00:21:56.751 IEEE OUI Identifier: 00 00 00 00:21:56.751 Multi-path I/O 00:21:56.751 May have multiple subsystem ports: No 00:21:56.751 May have multiple controllers: No 00:21:56.751 Associated with SR-IOV VF: No 00:21:56.751 Max Data Transfer Size: 131072 00:21:56.751 Max Number of Namespaces: 0 00:21:56.751 Max Number of I/O Queues: 1024 00:21:56.751 NVMe Specification Version (VS): 1.3 00:21:56.751 NVMe Specification Version (Identify): 1.3 00:21:56.751 Maximum Queue Entries: 128 00:21:56.751 Contiguous Queues Required: Yes 00:21:56.751 Arbitration Mechanisms Supported 00:21:56.751 Weighted Round Robin: Not Supported 00:21:56.751 Vendor Specific: Not Supported 00:21:56.751 Reset Timeout: 15000 ms 00:21:56.751 Doorbell Stride: 4 bytes 00:21:56.751 NVM Subsystem Reset: Not Supported 00:21:56.751 Command Sets Supported 00:21:56.751 NVM Command Set: Supported 00:21:56.751 Boot Partition: Not Supported 00:21:56.751 Memory Page Size Minimum: 4096 bytes 00:21:56.751 Memory Page Size Maximum: 4096 bytes 00:21:56.751 Persistent Memory Region: Not Supported 00:21:56.751 Optional Asynchronous Events Supported 00:21:56.751 Namespace Attribute Notices: Not Supported 00:21:56.751 Firmware Activation Notices: Not Supported 00:21:56.751 ANA Change Notices: Not Supported 00:21:56.751 PLE Aggregate Log Change Notices: Not Supported 00:21:56.751 LBA Status Info Alert Notices: Not Supported 00:21:56.751 EGE Aggregate Log Change Notices: Not Supported 00:21:56.751 Normal NVM Subsystem Shutdown event: Not Supported 00:21:56.751 Zone Descriptor Change Notices: Not Supported 00:21:56.751 Discovery Log Change Notices: Supported 00:21:56.751 Controller Attributes 00:21:56.751 128-bit Host Identifier: Not Supported 00:21:56.751 Non-Operational Permissive Mode: Not Supported 00:21:56.751 NVM Sets: Not Supported 00:21:56.751 Read Recovery Levels: Not Supported 00:21:56.751 Endurance Groups: Not Supported 00:21:56.751 Predictable Latency Mode: Not Supported 00:21:56.751 Traffic Based Keep ALive: Not Supported 00:21:56.751 Namespace Granularity: Not Supported 00:21:56.751 SQ Associations: Not Supported 00:21:56.751 UUID List: Not Supported 00:21:56.751 Multi-Domain Subsystem: Not Supported 00:21:56.751 Fixed Capacity Management: Not Supported 00:21:56.751 Variable Capacity Management: Not Supported 00:21:56.751 Delete Endurance Group: Not Supported 00:21:56.751 Delete NVM Set: Not Supported 00:21:56.751 Extended LBA Formats Supported: Not Supported 00:21:56.751 Flexible Data Placement Supported: Not Supported 00:21:56.751 00:21:56.751 Controller Memory Buffer Support 00:21:56.751 ================================ 00:21:56.751 Supported: No 00:21:56.751 00:21:56.751 Persistent Memory Region Support 00:21:56.751 ================================ 00:21:56.751 Supported: No 00:21:56.751 00:21:56.751 Admin Command Set Attributes 00:21:56.751 ============================ 00:21:56.751 Security Send/Receive: Not Supported 00:21:56.751 Format NVM: Not Supported 00:21:56.751 Firmware Activate/Download: Not Supported 00:21:56.751 Namespace Management: Not Supported 00:21:56.751 Device Self-Test: Not Supported 00:21:56.751 Directives: Not Supported 00:21:56.751 NVMe-MI: Not Supported 00:21:56.751 Virtualization Management: Not Supported 00:21:56.751 Doorbell Buffer Config: Not Supported 00:21:56.751 Get LBA Status Capability: Not Supported 00:21:56.751 Command & Feature Lockdown Capability: Not Supported 00:21:56.751 Abort Command Limit: 1 00:21:56.751 Async Event Request Limit: 4 00:21:56.751 Number of Firmware Slots: N/A 00:21:56.751 Firmware Slot 1 Read-Only: N/A 00:21:56.751 Firmware Activation Without Reset: N/A 00:21:56.751 Multiple Update Detection Support: N/A 00:21:56.751 Firmware Update Granularity: No Information Provided 00:21:56.751 Per-Namespace SMART Log: No 00:21:56.751 Asymmetric Namespace Access Log Page: Not Supported 00:21:56.751 Subsystem NQN: nqn.2014-08.org.nvmexpress.discovery 00:21:56.751 Command Effects Log Page: Not Supported 00:21:56.751 Get Log Page Extended Data: Supported 00:21:56.751 Telemetry Log Pages: Not Supported 00:21:56.751 Persistent Event Log Pages: Not Supported 00:21:56.751 Supported Log Pages Log Page: May Support 00:21:56.751 Commands Supported & Effects Log Page: Not Supported 00:21:56.751 Feature Identifiers & Effects Log Page:May Support 00:21:56.751 NVMe-MI Commands & Effects Log Page: May Support 00:21:56.751 Data Area 4 for Telemetry Log: Not Supported 00:21:56.751 Error Log Page Entries Supported: 128 00:21:56.751 Keep Alive: Not Supported 00:21:56.751 00:21:56.751 NVM Command Set Attributes 00:21:56.751 ========================== 00:21:56.751 Submission Queue Entry Size 00:21:56.751 Max: 1 00:21:56.751 Min: 1 00:21:56.751 Completion Queue Entry Size 00:21:56.751 Max: 1 00:21:56.751 Min: 1 00:21:56.751 Number of Namespaces: 0 00:21:56.751 Compare Command: Not Supported 00:21:56.751 Write Uncorrectable Command: Not Supported 00:21:56.751 Dataset Management Command: Not Supported 00:21:56.751 Write Zeroes Command: Not Supported 00:21:56.751 Set Features Save Field: Not Supported 00:21:56.751 Reservations: Not Supported 00:21:56.751 Timestamp: Not Supported 00:21:56.751 Copy: Not Supported 00:21:56.751 Volatile Write Cache: Not Present 00:21:56.751 Atomic Write Unit (Normal): 1 00:21:56.751 Atomic Write Unit (PFail): 1 00:21:56.751 Atomic Compare & Write Unit: 1 00:21:56.751 Fused Compare & Write: Supported 00:21:56.751 Scatter-Gather List 00:21:56.751 SGL Command Set: Supported 00:21:56.751 SGL Keyed: Supported 00:21:56.751 SGL Bit Bucket Descriptor: Not Supported 00:21:56.751 SGL Metadata Pointer: Not Supported 00:21:56.751 Oversized SGL: Not Supported 00:21:56.751 SGL Metadata Address: Not Supported 00:21:56.751 SGL Offset: Supported 00:21:56.751 Transport SGL Data Block: Not Supported 00:21:56.751 Replay Protected Memory Block: Not Supported 00:21:56.751 00:21:56.751 Firmware Slot Information 00:21:56.751 ========================= 00:21:56.751 Active slot: 0 00:21:56.751 00:21:56.751 00:21:56.751 Error Log 00:21:56.751 ========= 00:21:56.751 00:21:56.751 Active Namespaces 00:21:56.751 ================= 00:21:56.751 Discovery Log Page 00:21:56.751 ================== 00:21:56.751 Generation Counter: 2 00:21:56.751 Number of Records: 2 00:21:56.751 Record Format: 0 00:21:56.751 00:21:56.751 Discovery Log Entry 0 00:21:56.751 ---------------------- 00:21:56.751 Transport Type: 3 (TCP) 00:21:56.751 Address Family: 1 (IPv4) 00:21:56.751 Subsystem Type: 3 (Current Discovery Subsystem) 00:21:56.751 Entry Flags: 00:21:56.751 Duplicate Returned Information: 1 00:21:56.751 Explicit Persistent Connection Support for Discovery: 1 00:21:56.751 Transport Requirements: 00:21:56.751 Secure Channel: Not Required 00:21:56.751 Port ID: 0 (0x0000) 00:21:56.751 Controller ID: 65535 (0xffff) 00:21:56.751 Admin Max SQ Size: 128 00:21:56.751 Transport Service Identifier: 4420 00:21:56.751 NVM Subsystem Qualified Name: nqn.2014-08.org.nvmexpress.discovery 00:21:56.751 Transport Address: 10.0.0.2 00:21:56.751 Discovery Log Entry 1 00:21:56.751 ---------------------- 00:21:56.751 Transport Type: 3 (TCP) 00:21:56.751 Address Family: 1 (IPv4) 00:21:56.751 Subsystem Type: 2 (NVM Subsystem) 00:21:56.751 Entry Flags: 00:21:56.751 Duplicate Returned Information: 0 00:21:56.751 Explicit Persistent Connection Support for Discovery: 0 00:21:56.751 Transport Requirements: 00:21:56.751 Secure Channel: Not Required 00:21:56.751 Port ID: 0 (0x0000) 00:21:56.751 Controller ID: 65535 (0xffff) 00:21:56.751 Admin Max SQ Size: 128 00:21:56.751 Transport Service Identifier: 4420 00:21:56.751 NVM Subsystem Qualified Name: nqn.2016-06.io.spdk:cnode1 00:21:56.751 Transport Address: 10.0.0.2 [2024-04-16 22:59:47.749462] nvme_ctrlr.c:4206:nvme_ctrlr_destruct_async: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] Prepare to destruct SSD 00:21:56.751 [2024-04-16 22:59:47.749486] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:21:56.752 [2024-04-16 22:59:47.749499] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:21:56.752 [2024-04-16 22:59:47.749509] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:21:56.752 [2024-04-16 22:59:47.749518] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:21:56.752 [2024-04-16 22:59:47.749536] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:21:56.752 [2024-04-16 22:59:47.749545] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:21:56.752 [2024-04-16 22:59:47.749551] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x1c23e10) 00:21:56.752 [2024-04-16 22:59:47.749562] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:56.752 [2024-04-16 22:59:47.749602] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1ca4010, cid 3, qid 0 00:21:56.752 [2024-04-16 22:59:47.749790] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:21:56.752 [2024-04-16 22:59:47.749807] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:21:56.752 [2024-04-16 22:59:47.749814] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:21:56.752 [2024-04-16 22:59:47.749821] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x1ca4010) on tqpair=0x1c23e10 00:21:56.752 [2024-04-16 22:59:47.749834] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:21:56.752 [2024-04-16 22:59:47.749842] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:21:56.752 [2024-04-16 22:59:47.749848] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x1c23e10) 00:21:56.752 [2024-04-16 22:59:47.749859] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY SET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:56.752 [2024-04-16 22:59:47.749886] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1ca4010, cid 3, qid 0 00:21:56.752 [2024-04-16 22:59:47.750037] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:21:56.752 [2024-04-16 22:59:47.750052] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:21:56.752 [2024-04-16 22:59:47.750059] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:21:56.752 [2024-04-16 22:59:47.750066] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x1ca4010) on tqpair=0x1c23e10 00:21:56.752 [2024-04-16 22:59:47.750076] nvme_ctrlr.c:1069:nvme_ctrlr_shutdown_set_cc_done: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] RTD3E = 0 us 00:21:56.752 [2024-04-16 22:59:47.750084] nvme_ctrlr.c:1072:nvme_ctrlr_shutdown_set_cc_done: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] shutdown timeout = 10000 ms 00:21:56.752 [2024-04-16 22:59:47.750100] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:21:56.752 [2024-04-16 22:59:47.750109] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:21:56.752 [2024-04-16 22:59:47.750115] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x1c23e10) 00:21:56.752 [2024-04-16 22:59:47.750129] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:56.752 [2024-04-16 22:59:47.750151] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1ca4010, cid 3, qid 0 00:21:56.752 [2024-04-16 22:59:47.750307] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:21:56.752 [2024-04-16 22:59:47.750323] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:21:56.752 [2024-04-16 22:59:47.750330] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:21:56.752 [2024-04-16 22:59:47.750337] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x1ca4010) on tqpair=0x1c23e10 00:21:56.752 [2024-04-16 22:59:47.750355] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:21:56.752 [2024-04-16 22:59:47.750364] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:21:56.752 [2024-04-16 22:59:47.750371] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x1c23e10) 00:21:56.752 [2024-04-16 22:59:47.750381] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:56.752 [2024-04-16 22:59:47.750402] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1ca4010, cid 3, qid 0 00:21:56.752 [2024-04-16 22:59:47.750526] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:21:56.752 [2024-04-16 22:59:47.750538] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:21:56.752 [2024-04-16 22:59:47.750544] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:21:56.752 [2024-04-16 22:59:47.750551] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x1ca4010) on tqpair=0x1c23e10 00:21:56.752 [2024-04-16 22:59:47.750569] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:21:56.752 [2024-04-16 22:59:47.750578] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:21:56.752 [2024-04-16 22:59:47.750584] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x1c23e10) 00:21:56.752 [2024-04-16 22:59:47.750594] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:56.752 [2024-04-16 22:59:47.750615] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1ca4010, cid 3, qid 0 00:21:56.752 [2024-04-16 22:59:47.750726] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:21:56.752 [2024-04-16 22:59:47.750742] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:21:56.752 [2024-04-16 22:59:47.750749] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:21:56.752 [2024-04-16 22:59:47.750757] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x1ca4010) on tqpair=0x1c23e10 00:21:56.752 [2024-04-16 22:59:47.750775] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:21:56.752 [2024-04-16 22:59:47.750784] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:21:56.752 [2024-04-16 22:59:47.750790] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x1c23e10) 00:21:56.752 [2024-04-16 22:59:47.750801] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:56.752 [2024-04-16 22:59:47.750821] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1ca4010, cid 3, qid 0 00:21:56.752 [2024-04-16 22:59:47.750925] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:21:56.752 [2024-04-16 22:59:47.750938] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:21:56.752 [2024-04-16 22:59:47.750945] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:21:56.752 [2024-04-16 22:59:47.750952] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x1ca4010) on tqpair=0x1c23e10 00:21:56.752 [2024-04-16 22:59:47.750969] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:21:56.752 [2024-04-16 22:59:47.750978] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:21:56.752 [2024-04-16 22:59:47.750985] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x1c23e10) 00:21:56.752 [2024-04-16 22:59:47.751000] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:56.752 [2024-04-16 22:59:47.751021] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1ca4010, cid 3, qid 0 00:21:56.752 [2024-04-16 22:59:47.751146] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:21:56.752 [2024-04-16 22:59:47.751161] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:21:56.752 [2024-04-16 22:59:47.751168] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:21:56.752 [2024-04-16 22:59:47.751183] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x1ca4010) on tqpair=0x1c23e10 00:21:56.752 [2024-04-16 22:59:47.751203] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:21:56.752 [2024-04-16 22:59:47.751222] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:21:56.752 [2024-04-16 22:59:47.751228] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x1c23e10) 00:21:56.752 [2024-04-16 22:59:47.751239] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:56.752 [2024-04-16 22:59:47.751260] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1ca4010, cid 3, qid 0 00:21:56.752 [2024-04-16 22:59:47.751382] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:21:56.752 [2024-04-16 22:59:47.751394] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:21:56.752 [2024-04-16 22:59:47.751401] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:21:56.752 [2024-04-16 22:59:47.751407] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x1ca4010) on tqpair=0x1c23e10 00:21:56.752 [2024-04-16 22:59:47.751425] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:21:56.752 [2024-04-16 22:59:47.751434] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:21:56.752 [2024-04-16 22:59:47.751441] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x1c23e10) 00:21:56.752 [2024-04-16 22:59:47.751451] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:56.752 [2024-04-16 22:59:47.751470] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1ca4010, cid 3, qid 0 00:21:56.752 [2024-04-16 22:59:47.751581] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:21:56.752 [2024-04-16 22:59:47.751597] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:21:56.752 [2024-04-16 22:59:47.751604] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:21:56.752 [2024-04-16 22:59:47.751611] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x1ca4010) on tqpair=0x1c23e10 00:21:56.752 [2024-04-16 22:59:47.751629] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:21:56.752 [2024-04-16 22:59:47.751639] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:21:56.752 [2024-04-16 22:59:47.751646] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x1c23e10) 00:21:56.752 [2024-04-16 22:59:47.751657] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:56.752 [2024-04-16 22:59:47.751679] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1ca4010, cid 3, qid 0 00:21:56.752 [2024-04-16 22:59:47.751804] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:21:56.752 [2024-04-16 22:59:47.751816] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:21:56.752 [2024-04-16 22:59:47.751823] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:21:56.752 [2024-04-16 22:59:47.751830] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x1ca4010) on tqpair=0x1c23e10 00:21:56.752 [2024-04-16 22:59:47.751850] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:21:56.752 [2024-04-16 22:59:47.751859] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:21:56.752 [2024-04-16 22:59:47.751866] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x1c23e10) 00:21:56.752 [2024-04-16 22:59:47.751876] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:56.752 [2024-04-16 22:59:47.751900] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1ca4010, cid 3, qid 0 00:21:56.752 [2024-04-16 22:59:47.752023] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:21:56.752 [2024-04-16 22:59:47.752036] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:21:56.752 [2024-04-16 22:59:47.752043] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:21:56.752 [2024-04-16 22:59:47.752050] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x1ca4010) on tqpair=0x1c23e10 00:21:56.752 [2024-04-16 22:59:47.752067] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:21:56.753 [2024-04-16 22:59:47.752076] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:21:56.753 [2024-04-16 22:59:47.752083] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x1c23e10) 00:21:56.753 [2024-04-16 22:59:47.752093] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:56.753 [2024-04-16 22:59:47.752112] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1ca4010, cid 3, qid 0 00:21:56.753 [2024-04-16 22:59:47.756203] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:21:56.753 [2024-04-16 22:59:47.756225] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:21:56.753 [2024-04-16 22:59:47.756232] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:21:56.753 [2024-04-16 22:59:47.756238] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x1ca4010) on tqpair=0x1c23e10 00:21:56.753 [2024-04-16 22:59:47.756257] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:21:56.753 [2024-04-16 22:59:47.756281] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:21:56.753 [2024-04-16 22:59:47.756288] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x1c23e10) 00:21:56.753 [2024-04-16 22:59:47.756299] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:56.753 [2024-04-16 22:59:47.756321] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1ca4010, cid 3, qid 0 00:21:56.753 [2024-04-16 22:59:47.756470] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:21:56.753 [2024-04-16 22:59:47.756485] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:21:56.753 [2024-04-16 22:59:47.756492] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:21:56.753 [2024-04-16 22:59:47.756499] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x1ca4010) on tqpair=0x1c23e10 00:21:56.753 [2024-04-16 22:59:47.756514] nvme_ctrlr.c:1191:nvme_ctrlr_shutdown_poll_async: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] shutdown complete in 6 milliseconds 00:21:56.753 00:21:56.753 22:59:47 -- host/identify.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_identify -r ' trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1' -L all 00:21:56.753 [2024-04-16 22:59:47.790808] Starting SPDK v24.01.1-pre git sha1 4b134b4ab / DPDK 23.11.0 initialization... 00:21:56.753 [2024-04-16 22:59:47.790859] [ DPDK EAL parameters: identify --no-shconf -c 0x1 -n 1 -m 0 --no-pci --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid347022 ] 00:21:56.753 EAL: No free 2048 kB hugepages reported on node 1 00:21:56.753 [2024-04-16 22:59:47.826029] nvme_ctrlr.c:1477:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to connect adminq (no timeout) 00:21:56.753 [2024-04-16 22:59:47.826079] nvme_tcp.c:2244:nvme_tcp_qpair_connect_sock: *DEBUG*: adrfam 1 ai_family 2 00:21:56.753 [2024-04-16 22:59:47.826089] nvme_tcp.c:2248:nvme_tcp_qpair_connect_sock: *DEBUG*: trsvcid is 4420 00:21:56.753 [2024-04-16 22:59:47.826102] nvme_tcp.c:2266:nvme_tcp_qpair_connect_sock: *DEBUG*: sock_impl_name is (null) 00:21:56.753 [2024-04-16 22:59:47.826116] sock.c: 334:spdk_sock_connect_ext: *DEBUG*: Creating a client socket using impl posix 00:21:56.753 [2024-04-16 22:59:47.829210] nvme_ctrlr.c:1477:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to wait for connect adminq (no timeout) 00:21:56.753 [2024-04-16 22:59:47.829264] nvme_tcp.c:1487:nvme_tcp_send_icreq_complete: *DEBUG*: Complete the icreq send for tqpair=0x190de10 0 00:21:56.753 [2024-04-16 22:59:47.837188] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 1 00:21:56.753 [2024-04-16 22:59:47.837207] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =1 00:21:56.753 [2024-04-16 22:59:47.837214] nvme_tcp.c:1533:nvme_tcp_icresp_handle: *DEBUG*: host_hdgst_enable: 0 00:21:56.753 [2024-04-16 22:59:47.837235] nvme_tcp.c:1534:nvme_tcp_icresp_handle: *DEBUG*: host_ddgst_enable: 0 00:21:56.753 [2024-04-16 22:59:47.837275] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:21:56.753 [2024-04-16 22:59:47.837287] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:21:56.753 [2024-04-16 22:59:47.837294] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x190de10) 00:21:56.753 [2024-04-16 22:59:47.837307] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC CONNECT qid:0 cid:0 SGL DATA BLOCK OFFSET 0x0 len:0x400 00:21:56.753 [2024-04-16 22:59:47.837333] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x198dbf0, cid 0, qid 0 00:21:56.753 [2024-04-16 22:59:47.845188] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:21:56.753 [2024-04-16 22:59:47.845206] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:21:56.753 [2024-04-16 22:59:47.845212] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:21:56.753 [2024-04-16 22:59:47.845234] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x198dbf0) on tqpair=0x190de10 00:21:56.753 [2024-04-16 22:59:47.845254] nvme_fabric.c: 620:nvme_fabric_qpair_connect_poll: *DEBUG*: CNTLID 0x0001 00:21:56.753 [2024-04-16 22:59:47.845265] nvme_ctrlr.c:1477:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to read vs (no timeout) 00:21:56.753 [2024-04-16 22:59:47.845275] nvme_ctrlr.c:1477:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to read vs wait for vs (no timeout) 00:21:56.753 [2024-04-16 22:59:47.845294] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:21:56.753 [2024-04-16 22:59:47.845303] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:21:56.753 [2024-04-16 22:59:47.845309] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x190de10) 00:21:56.753 [2024-04-16 22:59:47.845321] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:0 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:56.753 [2024-04-16 22:59:47.845343] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x198dbf0, cid 0, qid 0 00:21:56.753 [2024-04-16 22:59:47.845500] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:21:56.753 [2024-04-16 22:59:47.845512] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:21:56.753 [2024-04-16 22:59:47.845519] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:21:56.753 [2024-04-16 22:59:47.845526] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x198dbf0) on tqpair=0x190de10 00:21:56.753 [2024-04-16 22:59:47.845539] nvme_ctrlr.c:1477:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to read cap (no timeout) 00:21:56.753 [2024-04-16 22:59:47.845554] nvme_ctrlr.c:1477:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to read cap wait for cap (no timeout) 00:21:56.753 [2024-04-16 22:59:47.845566] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:21:56.753 [2024-04-16 22:59:47.845573] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:21:56.753 [2024-04-16 22:59:47.845580] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x190de10) 00:21:56.753 [2024-04-16 22:59:47.845590] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:0 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:56.753 [2024-04-16 22:59:47.845620] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x198dbf0, cid 0, qid 0 00:21:56.753 [2024-04-16 22:59:47.845751] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:21:56.753 [2024-04-16 22:59:47.845766] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:21:56.753 [2024-04-16 22:59:47.845773] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:21:56.753 [2024-04-16 22:59:47.845780] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x198dbf0) on tqpair=0x190de10 00:21:56.753 [2024-04-16 22:59:47.845790] nvme_ctrlr.c:1477:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to check en (no timeout) 00:21:56.753 [2024-04-16 22:59:47.845804] nvme_ctrlr.c:1471:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to check en wait for cc (timeout 15000 ms) 00:21:56.753 [2024-04-16 22:59:47.845817] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:21:56.753 [2024-04-16 22:59:47.845835] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:21:56.753 [2024-04-16 22:59:47.845841] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x190de10) 00:21:56.753 [2024-04-16 22:59:47.845851] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:0 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:56.753 [2024-04-16 22:59:47.845871] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x198dbf0, cid 0, qid 0 00:21:56.753 [2024-04-16 22:59:47.845998] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:21:56.753 [2024-04-16 22:59:47.846013] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:21:56.753 [2024-04-16 22:59:47.846020] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:21:56.753 [2024-04-16 22:59:47.846026] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x198dbf0) on tqpair=0x190de10 00:21:56.754 [2024-04-16 22:59:47.846036] nvme_ctrlr.c:1471:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to disable and wait for CSTS.RDY = 0 (timeout 15000 ms) 00:21:56.754 [2024-04-16 22:59:47.846053] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:21:56.754 [2024-04-16 22:59:47.846062] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:21:56.754 [2024-04-16 22:59:47.846069] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x190de10) 00:21:56.754 [2024-04-16 22:59:47.846079] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:0 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:56.754 [2024-04-16 22:59:47.846100] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x198dbf0, cid 0, qid 0 00:21:56.754 [2024-04-16 22:59:47.846216] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:21:56.754 [2024-04-16 22:59:47.846231] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:21:56.754 [2024-04-16 22:59:47.846238] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:21:56.754 [2024-04-16 22:59:47.846244] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x198dbf0) on tqpair=0x190de10 00:21:56.754 [2024-04-16 22:59:47.846253] nvme_ctrlr.c:3736:nvme_ctrlr_process_init_wait_for_ready_0: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] CC.EN = 0 && CSTS.RDY = 0 00:21:56.754 [2024-04-16 22:59:47.846262] nvme_ctrlr.c:1471:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to controller is disabled (timeout 15000 ms) 00:21:56.754 [2024-04-16 22:59:47.846276] nvme_ctrlr.c:1471:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to enable controller by writing CC.EN = 1 (timeout 15000 ms) 00:21:56.754 [2024-04-16 22:59:47.846386] nvme_ctrlr.c:3929:nvme_ctrlr_process_init: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] Setting CC.EN = 1 00:21:56.754 [2024-04-16 22:59:47.846393] nvme_ctrlr.c:1471:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to enable controller by writing CC.EN = 1 reg (timeout 15000 ms) 00:21:56.754 [2024-04-16 22:59:47.846405] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:21:56.754 [2024-04-16 22:59:47.846412] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:21:56.754 [2024-04-16 22:59:47.846418] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x190de10) 00:21:56.754 [2024-04-16 22:59:47.846453] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY SET qid:0 cid:0 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:56.754 [2024-04-16 22:59:47.846476] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x198dbf0, cid 0, qid 0 00:21:56.754 [2024-04-16 22:59:47.846647] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:21:56.754 [2024-04-16 22:59:47.846663] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:21:56.754 [2024-04-16 22:59:47.846670] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:21:56.754 [2024-04-16 22:59:47.846676] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x198dbf0) on tqpair=0x190de10 00:21:56.754 [2024-04-16 22:59:47.846686] nvme_ctrlr.c:1471:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to wait for CSTS.RDY = 1 (timeout 15000 ms) 00:21:56.754 [2024-04-16 22:59:47.846703] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:21:56.754 [2024-04-16 22:59:47.846712] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:21:56.754 [2024-04-16 22:59:47.846718] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x190de10) 00:21:56.754 [2024-04-16 22:59:47.846729] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:0 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:56.754 [2024-04-16 22:59:47.846749] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x198dbf0, cid 0, qid 0 00:21:56.754 [2024-04-16 22:59:47.846875] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:21:56.754 [2024-04-16 22:59:47.846890] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:21:56.754 [2024-04-16 22:59:47.846897] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:21:56.754 [2024-04-16 22:59:47.846903] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x198dbf0) on tqpair=0x190de10 00:21:56.754 [2024-04-16 22:59:47.846912] nvme_ctrlr.c:3771:nvme_ctrlr_process_init_enable_wait_for_ready_1: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] CC.EN = 1 && CSTS.RDY = 1 - controller is ready 00:21:56.754 [2024-04-16 22:59:47.846921] nvme_ctrlr.c:1471:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to reset admin queue (timeout 30000 ms) 00:21:56.754 [2024-04-16 22:59:47.846934] nvme_ctrlr.c:1477:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to identify controller (no timeout) 00:21:56.754 [2024-04-16 22:59:47.846948] nvme_ctrlr.c:1471:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to wait for identify controller (timeout 30000 ms) 00:21:56.754 [2024-04-16 22:59:47.846961] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:21:56.754 [2024-04-16 22:59:47.846969] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:21:56.754 [2024-04-16 22:59:47.846975] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x190de10) 00:21:56.754 [2024-04-16 22:59:47.846986] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: IDENTIFY (06) qid:0 cid:0 nsid:0 cdw10:00000001 cdw11:00000000 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:56.754 [2024-04-16 22:59:47.847007] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x198dbf0, cid 0, qid 0 00:21:56.754 [2024-04-16 22:59:47.847235] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 7 00:21:56.754 [2024-04-16 22:59:47.847250] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =7 00:21:56.754 [2024-04-16 22:59:47.847257] nvme_tcp.c:1650:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: enter 00:21:56.754 [2024-04-16 22:59:47.847264] nvme_tcp.c:1651:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: c2h_data info on tqpair(0x190de10): datao=0, datal=4096, cccid=0 00:21:56.754 [2024-04-16 22:59:47.847271] nvme_tcp.c:1662:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: tcp_req(0x198dbf0) on tqpair(0x190de10): expected_datao=0, payload_size=4096 00:21:56.754 [2024-04-16 22:59:47.847282] nvme_tcp.c:1453:nvme_tcp_pdu_payload_handle: *DEBUG*: enter 00:21:56.754 [2024-04-16 22:59:47.847290] nvme_tcp.c:1237:nvme_tcp_c2h_data_payload_handle: *DEBUG*: enter 00:21:56.754 [2024-04-16 22:59:47.847307] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:21:56.754 [2024-04-16 22:59:47.847318] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:21:56.754 [2024-04-16 22:59:47.847328] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:21:56.754 [2024-04-16 22:59:47.847335] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x198dbf0) on tqpair=0x190de10 00:21:56.754 [2024-04-16 22:59:47.847348] nvme_ctrlr.c:1971:nvme_ctrlr_identify_done: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] transport max_xfer_size 4294967295 00:21:56.754 [2024-04-16 22:59:47.847360] nvme_ctrlr.c:1975:nvme_ctrlr_identify_done: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] MDTS max_xfer_size 131072 00:21:56.754 [2024-04-16 22:59:47.847368] nvme_ctrlr.c:1978:nvme_ctrlr_identify_done: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] CNTLID 0x0001 00:21:56.754 [2024-04-16 22:59:47.847375] nvme_ctrlr.c:2002:nvme_ctrlr_identify_done: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] transport max_sges 16 00:21:56.754 [2024-04-16 22:59:47.847382] nvme_ctrlr.c:2017:nvme_ctrlr_identify_done: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] fuses compare and write: 1 00:21:56.754 [2024-04-16 22:59:47.847390] nvme_ctrlr.c:1471:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to configure AER (timeout 30000 ms) 00:21:56.754 [2024-04-16 22:59:47.847404] nvme_ctrlr.c:1471:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to wait for configure aer (timeout 30000 ms) 00:21:56.754 [2024-04-16 22:59:47.847416] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:21:56.754 [2024-04-16 22:59:47.847423] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:21:56.754 [2024-04-16 22:59:47.847429] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x190de10) 00:21:56.754 [2024-04-16 22:59:47.847440] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: SET FEATURES ASYNC EVENT CONFIGURATION cid:0 cdw10:0000000b SGL DATA BLOCK OFFSET 0x0 len:0x0 00:21:56.754 [2024-04-16 22:59:47.847461] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x198dbf0, cid 0, qid 0 00:21:56.754 [2024-04-16 22:59:47.847585] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:21:56.754 [2024-04-16 22:59:47.847597] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:21:56.754 [2024-04-16 22:59:47.847603] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:21:56.754 [2024-04-16 22:59:47.847610] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x198dbf0) on tqpair=0x190de10 00:21:56.754 [2024-04-16 22:59:47.847621] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:21:56.754 [2024-04-16 22:59:47.847628] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:21:56.754 [2024-04-16 22:59:47.847635] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x190de10) 00:21:56.754 [2024-04-16 22:59:47.847644] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:21:56.754 [2024-04-16 22:59:47.847654] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:21:56.754 [2024-04-16 22:59:47.847661] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:21:56.754 [2024-04-16 22:59:47.847667] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=1 on tqpair(0x190de10) 00:21:56.754 [2024-04-16 22:59:47.847675] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:21:56.754 [2024-04-16 22:59:47.847685] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:21:56.754 [2024-04-16 22:59:47.847691] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:21:56.754 [2024-04-16 22:59:47.847697] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=2 on tqpair(0x190de10) 00:21:56.754 [2024-04-16 22:59:47.847706] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:21:56.754 [2024-04-16 22:59:47.847715] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:21:56.754 [2024-04-16 22:59:47.847722] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:21:56.754 [2024-04-16 22:59:47.847728] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x190de10) 00:21:56.754 [2024-04-16 22:59:47.847736] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:21:56.754 [2024-04-16 22:59:47.847749] nvme_ctrlr.c:1471:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to set keep alive timeout (timeout 30000 ms) 00:21:56.754 [2024-04-16 22:59:47.847768] nvme_ctrlr.c:1471:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to wait for set keep alive timeout (timeout 30000 ms) 00:21:56.754 [2024-04-16 22:59:47.847782] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:21:56.754 [2024-04-16 22:59:47.847789] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:21:56.754 [2024-04-16 22:59:47.847795] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=4 on tqpair(0x190de10) 00:21:56.754 [2024-04-16 22:59:47.847805] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: GET FEATURES KEEP ALIVE TIMER cid:4 cdw10:0000000f SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:56.754 [2024-04-16 22:59:47.847847] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x198dbf0, cid 0, qid 0 00:21:56.754 [2024-04-16 22:59:47.847858] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x198dd50, cid 1, qid 0 00:21:56.754 [2024-04-16 22:59:47.847865] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x198deb0, cid 2, qid 0 00:21:56.754 [2024-04-16 22:59:47.847872] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x198e010, cid 3, qid 0 00:21:56.754 [2024-04-16 22:59:47.847880] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x198e170, cid 4, qid 0 00:21:56.754 [2024-04-16 22:59:47.848100] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:21:56.754 [2024-04-16 22:59:47.848116] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:21:56.755 [2024-04-16 22:59:47.848123] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:21:56.755 [2024-04-16 22:59:47.848129] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x198e170) on tqpair=0x190de10 00:21:56.755 [2024-04-16 22:59:47.848139] nvme_ctrlr.c:2889:nvme_ctrlr_set_keep_alive_timeout_done: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] Sending keep alive every 5000000 us 00:21:56.755 [2024-04-16 22:59:47.848148] nvme_ctrlr.c:1471:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to identify controller iocs specific (timeout 30000 ms) 00:21:56.755 [2024-04-16 22:59:47.848162] nvme_ctrlr.c:1471:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to set number of queues (timeout 30000 ms) 00:21:56.755 [2024-04-16 22:59:47.848173] nvme_ctrlr.c:1471:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to wait for set number of queues (timeout 30000 ms) 00:21:56.755 [2024-04-16 22:59:47.848191] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:21:56.755 [2024-04-16 22:59:47.848199] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:21:56.755 [2024-04-16 22:59:47.848206] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=4 on tqpair(0x190de10) 00:21:56.755 [2024-04-16 22:59:47.848216] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: SET FEATURES NUMBER OF QUEUES cid:4 cdw10:00000007 SGL DATA BLOCK OFFSET 0x0 len:0x0 00:21:56.755 [2024-04-16 22:59:47.848236] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x198e170, cid 4, qid 0 00:21:56.755 [2024-04-16 22:59:47.848386] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:21:56.755 [2024-04-16 22:59:47.848401] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:21:56.755 [2024-04-16 22:59:47.848408] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:21:56.755 [2024-04-16 22:59:47.848414] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x198e170) on tqpair=0x190de10 00:21:56.755 [2024-04-16 22:59:47.848468] nvme_ctrlr.c:1471:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to identify active ns (timeout 30000 ms) 00:21:56.755 [2024-04-16 22:59:47.848487] nvme_ctrlr.c:1471:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to wait for identify active ns (timeout 30000 ms) 00:21:56.755 [2024-04-16 22:59:47.848501] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:21:56.755 [2024-04-16 22:59:47.848509] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:21:56.755 [2024-04-16 22:59:47.848519] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=4 on tqpair(0x190de10) 00:21:56.755 [2024-04-16 22:59:47.848530] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: IDENTIFY (06) qid:0 cid:4 nsid:0 cdw10:00000002 cdw11:00000000 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:56.755 [2024-04-16 22:59:47.848550] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x198e170, cid 4, qid 0 00:21:56.755 [2024-04-16 22:59:47.848732] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 7 00:21:56.755 [2024-04-16 22:59:47.848744] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =7 00:21:56.755 [2024-04-16 22:59:47.848751] nvme_tcp.c:1650:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: enter 00:21:56.755 [2024-04-16 22:59:47.848757] nvme_tcp.c:1651:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: c2h_data info on tqpair(0x190de10): datao=0, datal=4096, cccid=4 00:21:56.755 [2024-04-16 22:59:47.848765] nvme_tcp.c:1662:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: tcp_req(0x198e170) on tqpair(0x190de10): expected_datao=0, payload_size=4096 00:21:56.755 [2024-04-16 22:59:47.848776] nvme_tcp.c:1453:nvme_tcp_pdu_payload_handle: *DEBUG*: enter 00:21:56.755 [2024-04-16 22:59:47.848783] nvme_tcp.c:1237:nvme_tcp_c2h_data_payload_handle: *DEBUG*: enter 00:21:56.755 [2024-04-16 22:59:47.848818] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:21:56.755 [2024-04-16 22:59:47.848829] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:21:56.755 [2024-04-16 22:59:47.848835] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:21:56.755 [2024-04-16 22:59:47.848842] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x198e170) on tqpair=0x190de10 00:21:56.755 [2024-04-16 22:59:47.848858] nvme_ctrlr.c:4542:spdk_nvme_ctrlr_get_ns: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] Namespace 1 was added 00:21:56.755 [2024-04-16 22:59:47.848877] nvme_ctrlr.c:1471:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to identify ns (timeout 30000 ms) 00:21:56.755 [2024-04-16 22:59:47.848895] nvme_ctrlr.c:1471:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to wait for identify ns (timeout 30000 ms) 00:21:56.755 [2024-04-16 22:59:47.848908] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:21:56.755 [2024-04-16 22:59:47.848916] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:21:56.755 [2024-04-16 22:59:47.848922] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=4 on tqpair(0x190de10) 00:21:56.755 [2024-04-16 22:59:47.848932] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: IDENTIFY (06) qid:0 cid:4 nsid:1 cdw10:00000000 cdw11:00000000 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:56.755 [2024-04-16 22:59:47.848953] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x198e170, cid 4, qid 0 00:21:56.755 [2024-04-16 22:59:47.849082] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 7 00:21:56.755 [2024-04-16 22:59:47.849094] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =7 00:21:56.755 [2024-04-16 22:59:47.849101] nvme_tcp.c:1650:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: enter 00:21:56.755 [2024-04-16 22:59:47.849107] nvme_tcp.c:1651:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: c2h_data info on tqpair(0x190de10): datao=0, datal=4096, cccid=4 00:21:56.755 [2024-04-16 22:59:47.849114] nvme_tcp.c:1662:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: tcp_req(0x198e170) on tqpair(0x190de10): expected_datao=0, payload_size=4096 00:21:56.755 [2024-04-16 22:59:47.849131] nvme_tcp.c:1453:nvme_tcp_pdu_payload_handle: *DEBUG*: enter 00:21:56.755 [2024-04-16 22:59:47.849140] nvme_tcp.c:1237:nvme_tcp_c2h_data_payload_handle: *DEBUG*: enter 00:21:56.755 [2024-04-16 22:59:47.853204] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:21:56.755 [2024-04-16 22:59:47.853229] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:21:56.755 [2024-04-16 22:59:47.853235] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:21:56.755 [2024-04-16 22:59:47.853242] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x198e170) on tqpair=0x190de10 00:21:56.755 [2024-04-16 22:59:47.853262] nvme_ctrlr.c:1471:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to identify namespace id descriptors (timeout 30000 ms) 00:21:56.755 [2024-04-16 22:59:47.853284] nvme_ctrlr.c:1471:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to wait for identify namespace id descriptors (timeout 30000 ms) 00:21:56.755 [2024-04-16 22:59:47.853299] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:21:56.755 [2024-04-16 22:59:47.853306] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:21:56.755 [2024-04-16 22:59:47.853312] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=4 on tqpair(0x190de10) 00:21:56.755 [2024-04-16 22:59:47.853323] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: IDENTIFY (06) qid:0 cid:4 nsid:1 cdw10:00000003 cdw11:00000000 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:56.755 [2024-04-16 22:59:47.853344] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x198e170, cid 4, qid 0 00:21:56.755 [2024-04-16 22:59:47.853505] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 7 00:21:56.755 [2024-04-16 22:59:47.853517] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =7 00:21:56.755 [2024-04-16 22:59:47.853524] nvme_tcp.c:1650:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: enter 00:21:56.755 [2024-04-16 22:59:47.853530] nvme_tcp.c:1651:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: c2h_data info on tqpair(0x190de10): datao=0, datal=4096, cccid=4 00:21:56.755 [2024-04-16 22:59:47.853538] nvme_tcp.c:1662:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: tcp_req(0x198e170) on tqpair(0x190de10): expected_datao=0, payload_size=4096 00:21:56.755 [2024-04-16 22:59:47.853554] nvme_tcp.c:1453:nvme_tcp_pdu_payload_handle: *DEBUG*: enter 00:21:56.755 [2024-04-16 22:59:47.853563] nvme_tcp.c:1237:nvme_tcp_c2h_data_payload_handle: *DEBUG*: enter 00:21:56.755 [2024-04-16 22:59:47.853631] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:21:56.755 [2024-04-16 22:59:47.853646] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:21:56.755 [2024-04-16 22:59:47.853652] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:21:56.755 [2024-04-16 22:59:47.853659] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x198e170) on tqpair=0x190de10 00:21:56.755 [2024-04-16 22:59:47.853674] nvme_ctrlr.c:1471:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to identify ns iocs specific (timeout 30000 ms) 00:21:56.755 [2024-04-16 22:59:47.853689] nvme_ctrlr.c:1471:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to set supported log pages (timeout 30000 ms) 00:21:56.755 [2024-04-16 22:59:47.853704] nvme_ctrlr.c:1471:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to set supported features (timeout 30000 ms) 00:21:56.755 [2024-04-16 22:59:47.853715] nvme_ctrlr.c:1471:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to set doorbell buffer config (timeout 30000 ms) 00:21:56.755 [2024-04-16 22:59:47.853723] nvme_ctrlr.c:1471:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to set host ID (timeout 30000 ms) 00:21:56.755 [2024-04-16 22:59:47.853731] nvme_ctrlr.c:2977:nvme_ctrlr_set_host_id: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] NVMe-oF transport - not sending Set Features - Host ID 00:21:56.755 [2024-04-16 22:59:47.853739] nvme_ctrlr.c:1471:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to transport ready (timeout 30000 ms) 00:21:56.755 [2024-04-16 22:59:47.853747] nvme_ctrlr.c:1477:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to ready (no timeout) 00:21:56.755 [2024-04-16 22:59:47.853765] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:21:56.755 [2024-04-16 22:59:47.853774] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:21:56.755 [2024-04-16 22:59:47.853780] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=4 on tqpair(0x190de10) 00:21:56.755 [2024-04-16 22:59:47.853790] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: GET FEATURES ARBITRATION cid:4 cdw10:00000001 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:56.755 [2024-04-16 22:59:47.853801] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:21:56.755 [2024-04-16 22:59:47.853808] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:21:56.755 [2024-04-16 22:59:47.853814] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=5 on tqpair(0x190de10) 00:21:56.755 [2024-04-16 22:59:47.853826] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: KEEP ALIVE (18) qid:0 cid:5 nsid:0 cdw10:00000000 cdw11:00000000 00:21:56.755 [2024-04-16 22:59:47.853851] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x198e170, cid 4, qid 0 00:21:56.755 [2024-04-16 22:59:47.853878] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x198e2d0, cid 5, qid 0 00:21:56.755 [2024-04-16 22:59:47.854082] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:21:56.755 [2024-04-16 22:59:47.854095] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:21:56.755 [2024-04-16 22:59:47.854102] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:21:56.755 [2024-04-16 22:59:47.854108] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x198e170) on tqpair=0x190de10 00:21:56.755 [2024-04-16 22:59:47.854120] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:21:56.755 [2024-04-16 22:59:47.854129] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:21:56.755 [2024-04-16 22:59:47.854135] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:21:56.755 [2024-04-16 22:59:47.854142] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x198e2d0) on tqpair=0x190de10 00:21:56.755 [2024-04-16 22:59:47.854158] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:21:56.755 [2024-04-16 22:59:47.854167] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:21:56.755 [2024-04-16 22:59:47.854173] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=5 on tqpair(0x190de10) 00:21:56.755 [2024-04-16 22:59:47.854192] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: GET FEATURES POWER MANAGEMENT cid:5 cdw10:00000002 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:56.756 [2024-04-16 22:59:47.854213] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x198e2d0, cid 5, qid 0 00:21:56.756 [2024-04-16 22:59:47.854366] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:21:56.756 [2024-04-16 22:59:47.854378] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:21:56.756 [2024-04-16 22:59:47.854384] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:21:56.756 [2024-04-16 22:59:47.854391] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x198e2d0) on tqpair=0x190de10 00:21:56.756 [2024-04-16 22:59:47.854408] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:21:56.756 [2024-04-16 22:59:47.854417] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:21:56.756 [2024-04-16 22:59:47.854423] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=5 on tqpair(0x190de10) 00:21:56.756 [2024-04-16 22:59:47.854433] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: GET FEATURES TEMPERATURE THRESHOLD cid:5 cdw10:00000004 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:56.756 [2024-04-16 22:59:47.854452] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x198e2d0, cid 5, qid 0 00:21:56.756 [2024-04-16 22:59:47.854581] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:21:56.756 [2024-04-16 22:59:47.854594] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:21:56.756 [2024-04-16 22:59:47.854601] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:21:56.756 [2024-04-16 22:59:47.854607] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x198e2d0) on tqpair=0x190de10 00:21:56.756 [2024-04-16 22:59:47.854624] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:21:56.756 [2024-04-16 22:59:47.854633] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:21:56.756 [2024-04-16 22:59:47.854639] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=5 on tqpair(0x190de10) 00:21:56.756 [2024-04-16 22:59:47.854649] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: GET FEATURES NUMBER OF QUEUES cid:5 cdw10:00000007 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:56.756 [2024-04-16 22:59:47.854668] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x198e2d0, cid 5, qid 0 00:21:56.756 [2024-04-16 22:59:47.854781] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:21:56.756 [2024-04-16 22:59:47.854796] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:21:56.756 [2024-04-16 22:59:47.854803] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:21:56.756 [2024-04-16 22:59:47.854813] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x198e2d0) on tqpair=0x190de10 00:21:56.756 [2024-04-16 22:59:47.854834] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:21:56.756 [2024-04-16 22:59:47.854844] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:21:56.756 [2024-04-16 22:59:47.854851] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=5 on tqpair(0x190de10) 00:21:56.756 [2024-04-16 22:59:47.854861] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: GET LOG PAGE (02) qid:0 cid:5 nsid:ffffffff cdw10:07ff0001 cdw11:00000000 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:56.756 [2024-04-16 22:59:47.854873] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:21:56.756 [2024-04-16 22:59:47.854880] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:21:56.756 [2024-04-16 22:59:47.854886] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=4 on tqpair(0x190de10) 00:21:56.756 [2024-04-16 22:59:47.854895] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: GET LOG PAGE (02) qid:0 cid:4 nsid:ffffffff cdw10:007f0002 cdw11:00000000 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:56.756 [2024-04-16 22:59:47.854905] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:21:56.756 [2024-04-16 22:59:47.854912] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:21:56.756 [2024-04-16 22:59:47.854919] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=6 on tqpair(0x190de10) 00:21:56.756 [2024-04-16 22:59:47.854927] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: GET LOG PAGE (02) qid:0 cid:6 nsid:ffffffff cdw10:007f0003 cdw11:00000000 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:56.756 [2024-04-16 22:59:47.854939] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:21:56.756 [2024-04-16 22:59:47.854946] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:21:56.756 [2024-04-16 22:59:47.854952] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=7 on tqpair(0x190de10) 00:21:56.756 [2024-04-16 22:59:47.854961] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: GET LOG PAGE (02) qid:0 cid:7 nsid:ffffffff cdw10:03ff0005 cdw11:00000000 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:56.756 [2024-04-16 22:59:47.854982] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x198e2d0, cid 5, qid 0 00:21:56.756 [2024-04-16 22:59:47.854992] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x198e170, cid 4, qid 0 00:21:56.756 [2024-04-16 22:59:47.855000] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x198e430, cid 6, qid 0 00:21:56.756 [2024-04-16 22:59:47.855007] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x198e590, cid 7, qid 0 00:21:56.756 [2024-04-16 22:59:47.855241] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 7 00:21:56.756 [2024-04-16 22:59:47.855255] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =7 00:21:56.756 [2024-04-16 22:59:47.855262] nvme_tcp.c:1650:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: enter 00:21:56.756 [2024-04-16 22:59:47.855268] nvme_tcp.c:1651:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: c2h_data info on tqpair(0x190de10): datao=0, datal=8192, cccid=5 00:21:56.756 [2024-04-16 22:59:47.855276] nvme_tcp.c:1662:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: tcp_req(0x198e2d0) on tqpair(0x190de10): expected_datao=0, payload_size=8192 00:21:56.756 [2024-04-16 22:59:47.855316] nvme_tcp.c:1453:nvme_tcp_pdu_payload_handle: *DEBUG*: enter 00:21:56.756 [2024-04-16 22:59:47.855325] nvme_tcp.c:1237:nvme_tcp_c2h_data_payload_handle: *DEBUG*: enter 00:21:56.756 [2024-04-16 22:59:47.855334] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 7 00:21:56.756 [2024-04-16 22:59:47.855343] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =7 00:21:56.756 [2024-04-16 22:59:47.855349] nvme_tcp.c:1650:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: enter 00:21:56.756 [2024-04-16 22:59:47.855356] nvme_tcp.c:1651:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: c2h_data info on tqpair(0x190de10): datao=0, datal=512, cccid=4 00:21:56.756 [2024-04-16 22:59:47.855363] nvme_tcp.c:1662:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: tcp_req(0x198e170) on tqpair(0x190de10): expected_datao=0, payload_size=512 00:21:56.756 [2024-04-16 22:59:47.855377] nvme_tcp.c:1453:nvme_tcp_pdu_payload_handle: *DEBUG*: enter 00:21:56.756 [2024-04-16 22:59:47.855384] nvme_tcp.c:1237:nvme_tcp_c2h_data_payload_handle: *DEBUG*: enter 00:21:56.756 [2024-04-16 22:59:47.855393] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 7 00:21:56.756 [2024-04-16 22:59:47.855402] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =7 00:21:56.756 [2024-04-16 22:59:47.855408] nvme_tcp.c:1650:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: enter 00:21:56.756 [2024-04-16 22:59:47.855414] nvme_tcp.c:1651:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: c2h_data info on tqpair(0x190de10): datao=0, datal=512, cccid=6 00:21:56.756 [2024-04-16 22:59:47.855421] nvme_tcp.c:1662:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: tcp_req(0x198e430) on tqpair(0x190de10): expected_datao=0, payload_size=512 00:21:56.756 [2024-04-16 22:59:47.855432] nvme_tcp.c:1453:nvme_tcp_pdu_payload_handle: *DEBUG*: enter 00:21:56.756 [2024-04-16 22:59:47.855438] nvme_tcp.c:1237:nvme_tcp_c2h_data_payload_handle: *DEBUG*: enter 00:21:56.756 [2024-04-16 22:59:47.855446] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 7 00:21:56.756 [2024-04-16 22:59:47.855455] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =7 00:21:56.756 [2024-04-16 22:59:47.855461] nvme_tcp.c:1650:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: enter 00:21:56.756 [2024-04-16 22:59:47.855467] nvme_tcp.c:1651:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: c2h_data info on tqpair(0x190de10): datao=0, datal=4096, cccid=7 00:21:56.756 [2024-04-16 22:59:47.855475] nvme_tcp.c:1662:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: tcp_req(0x198e590) on tqpair(0x190de10): expected_datao=0, payload_size=4096 00:21:56.756 [2024-04-16 22:59:47.855485] nvme_tcp.c:1453:nvme_tcp_pdu_payload_handle: *DEBUG*: enter 00:21:56.756 [2024-04-16 22:59:47.855492] nvme_tcp.c:1237:nvme_tcp_c2h_data_payload_handle: *DEBUG*: enter 00:21:56.756 [2024-04-16 22:59:47.855504] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:21:56.756 [2024-04-16 22:59:47.855513] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:21:56.756 [2024-04-16 22:59:47.855519] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:21:56.756 [2024-04-16 22:59:47.855526] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x198e2d0) on tqpair=0x190de10 00:21:56.756 [2024-04-16 22:59:47.855547] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:21:56.756 [2024-04-16 22:59:47.855558] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:21:56.756 [2024-04-16 22:59:47.855564] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:21:56.756 [2024-04-16 22:59:47.855570] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x198e170) on tqpair=0x190de10 00:21:56.756 [2024-04-16 22:59:47.855585] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:21:56.756 [2024-04-16 22:59:47.855596] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:21:56.756 [2024-04-16 22:59:47.855602] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:21:56.756 [2024-04-16 22:59:47.855608] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x198e430) on tqpair=0x190de10 00:21:56.756 [2024-04-16 22:59:47.855620] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:21:56.756 [2024-04-16 22:59:47.855645] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:21:56.756 [2024-04-16 22:59:47.855652] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:21:56.756 [2024-04-16 22:59:47.855658] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x198e590) on tqpair=0x190de10 00:21:56.756 ===================================================== 00:21:56.756 NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:21:56.756 ===================================================== 00:21:56.756 Controller Capabilities/Features 00:21:56.756 ================================ 00:21:56.756 Vendor ID: 8086 00:21:56.756 Subsystem Vendor ID: 8086 00:21:56.756 Serial Number: SPDK00000000000001 00:21:56.756 Model Number: SPDK bdev Controller 00:21:56.756 Firmware Version: 24.01.1 00:21:56.756 Recommended Arb Burst: 6 00:21:56.756 IEEE OUI Identifier: e4 d2 5c 00:21:56.756 Multi-path I/O 00:21:56.756 May have multiple subsystem ports: Yes 00:21:56.756 May have multiple controllers: Yes 00:21:56.756 Associated with SR-IOV VF: No 00:21:56.756 Max Data Transfer Size: 131072 00:21:56.756 Max Number of Namespaces: 32 00:21:56.756 Max Number of I/O Queues: 127 00:21:56.756 NVMe Specification Version (VS): 1.3 00:21:56.756 NVMe Specification Version (Identify): 1.3 00:21:56.756 Maximum Queue Entries: 128 00:21:56.756 Contiguous Queues Required: Yes 00:21:56.756 Arbitration Mechanisms Supported 00:21:56.756 Weighted Round Robin: Not Supported 00:21:56.756 Vendor Specific: Not Supported 00:21:56.756 Reset Timeout: 15000 ms 00:21:56.756 Doorbell Stride: 4 bytes 00:21:56.756 NVM Subsystem Reset: Not Supported 00:21:56.756 Command Sets Supported 00:21:56.756 NVM Command Set: Supported 00:21:56.757 Boot Partition: Not Supported 00:21:56.757 Memory Page Size Minimum: 4096 bytes 00:21:56.757 Memory Page Size Maximum: 4096 bytes 00:21:56.757 Persistent Memory Region: Not Supported 00:21:56.757 Optional Asynchronous Events Supported 00:21:56.757 Namespace Attribute Notices: Supported 00:21:56.757 Firmware Activation Notices: Not Supported 00:21:56.757 ANA Change Notices: Not Supported 00:21:56.757 PLE Aggregate Log Change Notices: Not Supported 00:21:56.757 LBA Status Info Alert Notices: Not Supported 00:21:56.757 EGE Aggregate Log Change Notices: Not Supported 00:21:56.757 Normal NVM Subsystem Shutdown event: Not Supported 00:21:56.757 Zone Descriptor Change Notices: Not Supported 00:21:56.757 Discovery Log Change Notices: Not Supported 00:21:56.757 Controller Attributes 00:21:56.757 128-bit Host Identifier: Supported 00:21:56.757 Non-Operational Permissive Mode: Not Supported 00:21:56.757 NVM Sets: Not Supported 00:21:56.757 Read Recovery Levels: Not Supported 00:21:56.757 Endurance Groups: Not Supported 00:21:56.757 Predictable Latency Mode: Not Supported 00:21:56.757 Traffic Based Keep ALive: Not Supported 00:21:56.757 Namespace Granularity: Not Supported 00:21:56.757 SQ Associations: Not Supported 00:21:56.757 UUID List: Not Supported 00:21:56.757 Multi-Domain Subsystem: Not Supported 00:21:56.757 Fixed Capacity Management: Not Supported 00:21:56.757 Variable Capacity Management: Not Supported 00:21:56.757 Delete Endurance Group: Not Supported 00:21:56.757 Delete NVM Set: Not Supported 00:21:56.757 Extended LBA Formats Supported: Not Supported 00:21:56.757 Flexible Data Placement Supported: Not Supported 00:21:56.757 00:21:56.757 Controller Memory Buffer Support 00:21:56.757 ================================ 00:21:56.757 Supported: No 00:21:56.757 00:21:56.757 Persistent Memory Region Support 00:21:56.757 ================================ 00:21:56.757 Supported: No 00:21:56.757 00:21:56.757 Admin Command Set Attributes 00:21:56.757 ============================ 00:21:56.757 Security Send/Receive: Not Supported 00:21:56.757 Format NVM: Not Supported 00:21:56.757 Firmware Activate/Download: Not Supported 00:21:56.757 Namespace Management: Not Supported 00:21:56.757 Device Self-Test: Not Supported 00:21:56.757 Directives: Not Supported 00:21:56.757 NVMe-MI: Not Supported 00:21:56.757 Virtualization Management: Not Supported 00:21:56.757 Doorbell Buffer Config: Not Supported 00:21:56.757 Get LBA Status Capability: Not Supported 00:21:56.757 Command & Feature Lockdown Capability: Not Supported 00:21:56.757 Abort Command Limit: 4 00:21:56.757 Async Event Request Limit: 4 00:21:56.757 Number of Firmware Slots: N/A 00:21:56.757 Firmware Slot 1 Read-Only: N/A 00:21:56.757 Firmware Activation Without Reset: N/A 00:21:56.757 Multiple Update Detection Support: N/A 00:21:56.757 Firmware Update Granularity: No Information Provided 00:21:56.757 Per-Namespace SMART Log: No 00:21:56.757 Asymmetric Namespace Access Log Page: Not Supported 00:21:56.757 Subsystem NQN: nqn.2016-06.io.spdk:cnode1 00:21:56.757 Command Effects Log Page: Supported 00:21:56.757 Get Log Page Extended Data: Supported 00:21:56.757 Telemetry Log Pages: Not Supported 00:21:56.757 Persistent Event Log Pages: Not Supported 00:21:56.757 Supported Log Pages Log Page: May Support 00:21:56.757 Commands Supported & Effects Log Page: Not Supported 00:21:56.757 Feature Identifiers & Effects Log Page:May Support 00:21:56.757 NVMe-MI Commands & Effects Log Page: May Support 00:21:56.757 Data Area 4 for Telemetry Log: Not Supported 00:21:56.757 Error Log Page Entries Supported: 128 00:21:56.757 Keep Alive: Supported 00:21:56.757 Keep Alive Granularity: 10000 ms 00:21:56.757 00:21:56.757 NVM Command Set Attributes 00:21:56.757 ========================== 00:21:56.757 Submission Queue Entry Size 00:21:56.757 Max: 64 00:21:56.757 Min: 64 00:21:56.757 Completion Queue Entry Size 00:21:56.757 Max: 16 00:21:56.757 Min: 16 00:21:56.757 Number of Namespaces: 32 00:21:56.757 Compare Command: Supported 00:21:56.757 Write Uncorrectable Command: Not Supported 00:21:56.757 Dataset Management Command: Supported 00:21:56.757 Write Zeroes Command: Supported 00:21:56.757 Set Features Save Field: Not Supported 00:21:56.757 Reservations: Supported 00:21:56.757 Timestamp: Not Supported 00:21:56.757 Copy: Supported 00:21:56.757 Volatile Write Cache: Present 00:21:56.757 Atomic Write Unit (Normal): 1 00:21:56.757 Atomic Write Unit (PFail): 1 00:21:56.757 Atomic Compare & Write Unit: 1 00:21:56.757 Fused Compare & Write: Supported 00:21:56.757 Scatter-Gather List 00:21:56.757 SGL Command Set: Supported 00:21:56.757 SGL Keyed: Supported 00:21:56.757 SGL Bit Bucket Descriptor: Not Supported 00:21:56.757 SGL Metadata Pointer: Not Supported 00:21:56.757 Oversized SGL: Not Supported 00:21:56.757 SGL Metadata Address: Not Supported 00:21:56.757 SGL Offset: Supported 00:21:56.757 Transport SGL Data Block: Not Supported 00:21:56.757 Replay Protected Memory Block: Not Supported 00:21:56.757 00:21:56.757 Firmware Slot Information 00:21:56.757 ========================= 00:21:56.757 Active slot: 1 00:21:56.757 Slot 1 Firmware Revision: 24.01.1 00:21:56.757 00:21:56.757 00:21:56.757 Commands Supported and Effects 00:21:56.757 ============================== 00:21:56.757 Admin Commands 00:21:56.757 -------------- 00:21:56.757 Get Log Page (02h): Supported 00:21:56.757 Identify (06h): Supported 00:21:56.757 Abort (08h): Supported 00:21:56.757 Set Features (09h): Supported 00:21:56.757 Get Features (0Ah): Supported 00:21:56.757 Asynchronous Event Request (0Ch): Supported 00:21:56.757 Keep Alive (18h): Supported 00:21:56.757 I/O Commands 00:21:56.757 ------------ 00:21:56.757 Flush (00h): Supported LBA-Change 00:21:56.757 Write (01h): Supported LBA-Change 00:21:56.757 Read (02h): Supported 00:21:56.757 Compare (05h): Supported 00:21:56.757 Write Zeroes (08h): Supported LBA-Change 00:21:56.757 Dataset Management (09h): Supported LBA-Change 00:21:56.757 Copy (19h): Supported LBA-Change 00:21:56.757 Unknown (79h): Supported LBA-Change 00:21:56.757 Unknown (7Ah): Supported 00:21:56.757 00:21:56.757 Error Log 00:21:56.757 ========= 00:21:56.757 00:21:56.757 Arbitration 00:21:56.757 =========== 00:21:56.757 Arbitration Burst: 1 00:21:56.757 00:21:56.757 Power Management 00:21:56.757 ================ 00:21:56.757 Number of Power States: 1 00:21:56.757 Current Power State: Power State #0 00:21:56.757 Power State #0: 00:21:56.757 Max Power: 0.00 W 00:21:56.757 Non-Operational State: Operational 00:21:56.757 Entry Latency: Not Reported 00:21:56.757 Exit Latency: Not Reported 00:21:56.757 Relative Read Throughput: 0 00:21:56.757 Relative Read Latency: 0 00:21:56.757 Relative Write Throughput: 0 00:21:56.757 Relative Write Latency: 0 00:21:56.757 Idle Power: Not Reported 00:21:56.757 Active Power: Not Reported 00:21:56.757 Non-Operational Permissive Mode: Not Supported 00:21:56.757 00:21:56.757 Health Information 00:21:56.757 ================== 00:21:56.757 Critical Warnings: 00:21:56.757 Available Spare Space: OK 00:21:56.757 Temperature: OK 00:21:56.757 Device Reliability: OK 00:21:56.757 Read Only: No 00:21:56.757 Volatile Memory Backup: OK 00:21:56.757 Current Temperature: 0 Kelvin (-273 Celsius) 00:21:56.757 Temperature Threshold: [2024-04-16 22:59:47.855775] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:21:56.757 [2024-04-16 22:59:47.855786] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:21:56.757 [2024-04-16 22:59:47.855793] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=7 on tqpair(0x190de10) 00:21:56.757 [2024-04-16 22:59:47.855802] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: GET FEATURES ERROR_RECOVERY cid:7 cdw10:00000005 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:56.757 [2024-04-16 22:59:47.855824] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x198e590, cid 7, qid 0 00:21:56.757 [2024-04-16 22:59:47.855985] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:21:56.757 [2024-04-16 22:59:47.856001] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:21:56.757 [2024-04-16 22:59:47.856011] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:21:56.757 [2024-04-16 22:59:47.856018] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x198e590) on tqpair=0x190de10 00:21:56.757 [2024-04-16 22:59:47.856061] nvme_ctrlr.c:4206:nvme_ctrlr_destruct_async: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] Prepare to destruct SSD 00:21:56.757 [2024-04-16 22:59:47.856084] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:21:56.757 [2024-04-16 22:59:47.856097] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:21:56.758 [2024-04-16 22:59:47.856107] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:21:56.758 [2024-04-16 22:59:47.856117] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:21:56.758 [2024-04-16 22:59:47.856130] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:21:56.758 [2024-04-16 22:59:47.856137] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:21:56.758 [2024-04-16 22:59:47.856144] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x190de10) 00:21:56.758 [2024-04-16 22:59:47.856155] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:56.758 [2024-04-16 22:59:47.856183] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x198e010, cid 3, qid 0 00:21:56.758 [2024-04-16 22:59:47.856323] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:21:56.758 [2024-04-16 22:59:47.856338] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:21:56.758 [2024-04-16 22:59:47.856345] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:21:56.758 [2024-04-16 22:59:47.856351] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x198e010) on tqpair=0x190de10 00:21:56.758 [2024-04-16 22:59:47.856364] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:21:56.758 [2024-04-16 22:59:47.856372] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:21:56.758 [2024-04-16 22:59:47.856378] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x190de10) 00:21:56.758 [2024-04-16 22:59:47.856388] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY SET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:56.758 [2024-04-16 22:59:47.856415] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x198e010, cid 3, qid 0 00:21:56.758 [2024-04-16 22:59:47.856541] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:21:56.758 [2024-04-16 22:59:47.856557] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:21:56.758 [2024-04-16 22:59:47.856564] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:21:56.758 [2024-04-16 22:59:47.856571] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x198e010) on tqpair=0x190de10 00:21:56.758 [2024-04-16 22:59:47.856581] nvme_ctrlr.c:1069:nvme_ctrlr_shutdown_set_cc_done: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] RTD3E = 0 us 00:21:56.758 [2024-04-16 22:59:47.856589] nvme_ctrlr.c:1072:nvme_ctrlr_shutdown_set_cc_done: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] shutdown timeout = 10000 ms 00:21:56.758 [2024-04-16 22:59:47.856605] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:21:56.758 [2024-04-16 22:59:47.856614] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:21:56.758 [2024-04-16 22:59:47.856621] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x190de10) 00:21:56.758 [2024-04-16 22:59:47.856632] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:56.758 [2024-04-16 22:59:47.856652] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x198e010, cid 3, qid 0 00:21:56.758 [2024-04-16 22:59:47.856759] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:21:56.758 [2024-04-16 22:59:47.856774] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:21:56.758 [2024-04-16 22:59:47.856784] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:21:56.758 [2024-04-16 22:59:47.856791] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x198e010) on tqpair=0x190de10 00:21:56.758 [2024-04-16 22:59:47.856810] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:21:56.758 [2024-04-16 22:59:47.856819] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:21:56.758 [2024-04-16 22:59:47.856826] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x190de10) 00:21:56.758 [2024-04-16 22:59:47.856836] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:56.758 [2024-04-16 22:59:47.856855] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x198e010, cid 3, qid 0 00:21:56.758 [2024-04-16 22:59:47.856964] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:21:56.758 [2024-04-16 22:59:47.856979] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:21:56.758 [2024-04-16 22:59:47.856985] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:21:56.758 [2024-04-16 22:59:47.856992] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x198e010) on tqpair=0x190de10 00:21:56.758 [2024-04-16 22:59:47.857010] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:21:56.758 [2024-04-16 22:59:47.857020] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:21:56.758 [2024-04-16 22:59:47.857026] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x190de10) 00:21:56.758 [2024-04-16 22:59:47.857036] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:56.758 [2024-04-16 22:59:47.857056] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x198e010, cid 3, qid 0 00:21:56.758 [2024-04-16 22:59:47.857161] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:21:56.758 [2024-04-16 22:59:47.861199] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:21:56.758 [2024-04-16 22:59:47.861213] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:21:56.758 [2024-04-16 22:59:47.861220] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x198e010) on tqpair=0x190de10 00:21:56.758 [2024-04-16 22:59:47.861239] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:21:56.758 [2024-04-16 22:59:47.861249] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:21:56.758 [2024-04-16 22:59:47.861255] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x190de10) 00:21:56.758 [2024-04-16 22:59:47.861265] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:56.758 [2024-04-16 22:59:47.861286] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x198e010, cid 3, qid 0 00:21:56.758 [2024-04-16 22:59:47.861450] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:21:56.758 [2024-04-16 22:59:47.861465] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:21:56.758 [2024-04-16 22:59:47.861472] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:21:56.758 [2024-04-16 22:59:47.861479] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x198e010) on tqpair=0x190de10 00:21:56.758 [2024-04-16 22:59:47.861494] nvme_ctrlr.c:1191:nvme_ctrlr_shutdown_poll_async: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] shutdown complete in 4 milliseconds 00:21:57.017 0 Kelvin (-273 Celsius) 00:21:57.017 Available Spare: 0% 00:21:57.017 Available Spare Threshold: 0% 00:21:57.017 Life Percentage Used: 0% 00:21:57.017 Data Units Read: 0 00:21:57.017 Data Units Written: 0 00:21:57.017 Host Read Commands: 0 00:21:57.017 Host Write Commands: 0 00:21:57.017 Controller Busy Time: 0 minutes 00:21:57.017 Power Cycles: 0 00:21:57.017 Power On Hours: 0 hours 00:21:57.017 Unsafe Shutdowns: 0 00:21:57.017 Unrecoverable Media Errors: 0 00:21:57.017 Lifetime Error Log Entries: 0 00:21:57.017 Warning Temperature Time: 0 minutes 00:21:57.017 Critical Temperature Time: 0 minutes 00:21:57.017 00:21:57.017 Number of Queues 00:21:57.017 ================ 00:21:57.017 Number of I/O Submission Queues: 127 00:21:57.017 Number of I/O Completion Queues: 127 00:21:57.017 00:21:57.017 Active Namespaces 00:21:57.017 ================= 00:21:57.017 Namespace ID:1 00:21:57.017 Error Recovery Timeout: Unlimited 00:21:57.017 Command Set Identifier: NVM (00h) 00:21:57.017 Deallocate: Supported 00:21:57.017 Deallocated/Unwritten Error: Not Supported 00:21:57.017 Deallocated Read Value: Unknown 00:21:57.017 Deallocate in Write Zeroes: Not Supported 00:21:57.017 Deallocated Guard Field: 0xFFFF 00:21:57.017 Flush: Supported 00:21:57.017 Reservation: Supported 00:21:57.017 Namespace Sharing Capabilities: Multiple Controllers 00:21:57.017 Size (in LBAs): 131072 (0GiB) 00:21:57.017 Capacity (in LBAs): 131072 (0GiB) 00:21:57.017 Utilization (in LBAs): 131072 (0GiB) 00:21:57.017 NGUID: ABCDEF0123456789ABCDEF0123456789 00:21:57.017 EUI64: ABCDEF0123456789 00:21:57.017 UUID: 884647f0-359d-456b-a75c-9c016859fd04 00:21:57.017 Thin Provisioning: Not Supported 00:21:57.017 Per-NS Atomic Units: Yes 00:21:57.017 Atomic Boundary Size (Normal): 0 00:21:57.017 Atomic Boundary Size (PFail): 0 00:21:57.017 Atomic Boundary Offset: 0 00:21:57.017 Maximum Single Source Range Length: 65535 00:21:57.017 Maximum Copy Length: 65535 00:21:57.017 Maximum Source Range Count: 1 00:21:57.017 NGUID/EUI64 Never Reused: No 00:21:57.017 Namespace Write Protected: No 00:21:57.017 Number of LBA Formats: 1 00:21:57.017 Current LBA Format: LBA Format #00 00:21:57.017 LBA Format #00: Data Size: 512 Metadata Size: 0 00:21:57.017 00:21:57.017 22:59:47 -- host/identify.sh@51 -- # sync 00:21:57.018 22:59:47 -- host/identify.sh@52 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:21:57.018 22:59:47 -- common/autotest_common.sh@551 -- # xtrace_disable 00:21:57.018 22:59:47 -- common/autotest_common.sh@10 -- # set +x 00:21:57.018 22:59:47 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:21:57.018 22:59:47 -- host/identify.sh@54 -- # trap - SIGINT SIGTERM EXIT 00:21:57.018 22:59:47 -- host/identify.sh@56 -- # nvmftestfini 00:21:57.018 22:59:47 -- nvmf/common.sh@476 -- # nvmfcleanup 00:21:57.018 22:59:47 -- nvmf/common.sh@116 -- # sync 00:21:57.018 22:59:47 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:21:57.018 22:59:47 -- nvmf/common.sh@119 -- # set +e 00:21:57.018 22:59:47 -- nvmf/common.sh@120 -- # for i in {1..20} 00:21:57.018 22:59:47 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:21:57.018 rmmod nvme_tcp 00:21:57.018 rmmod nvme_fabrics 00:21:57.018 rmmod nvme_keyring 00:21:57.018 22:59:47 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:21:57.018 22:59:47 -- nvmf/common.sh@123 -- # set -e 00:21:57.018 22:59:47 -- nvmf/common.sh@124 -- # return 0 00:21:57.018 22:59:47 -- nvmf/common.sh@477 -- # '[' -n 346823 ']' 00:21:57.018 22:59:47 -- nvmf/common.sh@478 -- # killprocess 346823 00:21:57.018 22:59:47 -- common/autotest_common.sh@926 -- # '[' -z 346823 ']' 00:21:57.018 22:59:47 -- common/autotest_common.sh@930 -- # kill -0 346823 00:21:57.018 22:59:47 -- common/autotest_common.sh@931 -- # uname 00:21:57.018 22:59:47 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:21:57.018 22:59:47 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 346823 00:21:57.018 22:59:47 -- common/autotest_common.sh@932 -- # process_name=reactor_0 00:21:57.018 22:59:47 -- common/autotest_common.sh@936 -- # '[' reactor_0 = sudo ']' 00:21:57.018 22:59:47 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 346823' 00:21:57.018 killing process with pid 346823 00:21:57.018 22:59:47 -- common/autotest_common.sh@945 -- # kill 346823 00:21:57.018 [2024-04-16 22:59:47.948571] app.c: 883:log_deprecation_hits: *WARNING*: rpc_nvmf_get_subsystems: deprecation 'listener.transport is deprecated in favor of trtype' scheduled for removal in v24.05 hit 1 times 00:21:57.018 22:59:47 -- common/autotest_common.sh@950 -- # wait 346823 00:21:57.276 22:59:48 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:21:57.276 22:59:48 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:21:57.276 22:59:48 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:21:57.276 22:59:48 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:21:57.276 22:59:48 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:21:57.276 22:59:48 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:21:57.276 22:59:48 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:21:57.276 22:59:48 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:21:59.217 22:59:50 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:21:59.217 00:21:59.217 real 0m5.977s 00:21:59.217 user 0m7.002s 00:21:59.217 sys 0m1.873s 00:21:59.217 22:59:50 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:21:59.217 22:59:50 -- common/autotest_common.sh@10 -- # set +x 00:21:59.217 ************************************ 00:21:59.217 END TEST nvmf_identify 00:21:59.217 ************************************ 00:21:59.217 22:59:50 -- nvmf/nvmf.sh@97 -- # run_test nvmf_perf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/perf.sh --transport=tcp 00:21:59.217 22:59:50 -- common/autotest_common.sh@1077 -- # '[' 3 -le 1 ']' 00:21:59.217 22:59:50 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:21:59.217 22:59:50 -- common/autotest_common.sh@10 -- # set +x 00:21:59.217 ************************************ 00:21:59.217 START TEST nvmf_perf 00:21:59.217 ************************************ 00:21:59.217 22:59:50 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/perf.sh --transport=tcp 00:21:59.217 * Looking for test storage... 00:21:59.477 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host 00:21:59.477 22:59:50 -- host/perf.sh@10 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:21:59.477 22:59:50 -- nvmf/common.sh@7 -- # uname -s 00:21:59.477 22:59:50 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:21:59.477 22:59:50 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:21:59.477 22:59:50 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:21:59.477 22:59:50 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:21:59.477 22:59:50 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:21:59.477 22:59:50 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:21:59.477 22:59:50 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:21:59.478 22:59:50 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:21:59.478 22:59:50 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:21:59.478 22:59:50 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:21:59.478 22:59:50 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:21:59.478 22:59:50 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:21:59.478 22:59:50 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:21:59.478 22:59:50 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:21:59.478 22:59:50 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:21:59.478 22:59:50 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:21:59.478 22:59:50 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:21:59.478 22:59:50 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:21:59.478 22:59:50 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:21:59.478 22:59:50 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:21:59.478 22:59:50 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:21:59.478 22:59:50 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:21:59.478 22:59:50 -- paths/export.sh@5 -- # export PATH 00:21:59.478 22:59:50 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:21:59.478 22:59:50 -- nvmf/common.sh@46 -- # : 0 00:21:59.478 22:59:50 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:21:59.478 22:59:50 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:21:59.478 22:59:50 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:21:59.478 22:59:50 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:21:59.478 22:59:50 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:21:59.478 22:59:50 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:21:59.478 22:59:50 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:21:59.478 22:59:50 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:21:59.478 22:59:50 -- host/perf.sh@12 -- # MALLOC_BDEV_SIZE=64 00:21:59.478 22:59:50 -- host/perf.sh@13 -- # MALLOC_BLOCK_SIZE=512 00:21:59.478 22:59:50 -- host/perf.sh@15 -- # rpc_py=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:21:59.478 22:59:50 -- host/perf.sh@17 -- # nvmftestinit 00:21:59.478 22:59:50 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:21:59.478 22:59:50 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:21:59.478 22:59:50 -- nvmf/common.sh@436 -- # prepare_net_devs 00:21:59.478 22:59:50 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:21:59.478 22:59:50 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:21:59.478 22:59:50 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:21:59.478 22:59:50 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:21:59.478 22:59:50 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:21:59.478 22:59:50 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:21:59.478 22:59:50 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:21:59.478 22:59:50 -- nvmf/common.sh@284 -- # xtrace_disable 00:21:59.478 22:59:50 -- common/autotest_common.sh@10 -- # set +x 00:22:01.383 22:59:52 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:22:01.383 22:59:52 -- nvmf/common.sh@290 -- # pci_devs=() 00:22:01.383 22:59:52 -- nvmf/common.sh@290 -- # local -a pci_devs 00:22:01.383 22:59:52 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:22:01.383 22:59:52 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:22:01.383 22:59:52 -- nvmf/common.sh@292 -- # pci_drivers=() 00:22:01.383 22:59:52 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:22:01.383 22:59:52 -- nvmf/common.sh@294 -- # net_devs=() 00:22:01.383 22:59:52 -- nvmf/common.sh@294 -- # local -ga net_devs 00:22:01.383 22:59:52 -- nvmf/common.sh@295 -- # e810=() 00:22:01.383 22:59:52 -- nvmf/common.sh@295 -- # local -ga e810 00:22:01.383 22:59:52 -- nvmf/common.sh@296 -- # x722=() 00:22:01.383 22:59:52 -- nvmf/common.sh@296 -- # local -ga x722 00:22:01.383 22:59:52 -- nvmf/common.sh@297 -- # mlx=() 00:22:01.383 22:59:52 -- nvmf/common.sh@297 -- # local -ga mlx 00:22:01.383 22:59:52 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:22:01.383 22:59:52 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:22:01.383 22:59:52 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:22:01.383 22:59:52 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:22:01.383 22:59:52 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:22:01.383 22:59:52 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:22:01.383 22:59:52 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:22:01.383 22:59:52 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:22:01.383 22:59:52 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:22:01.383 22:59:52 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:22:01.383 22:59:52 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:22:01.383 22:59:52 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:22:01.383 22:59:52 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:22:01.383 22:59:52 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:22:01.383 22:59:52 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:22:01.383 22:59:52 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:22:01.383 22:59:52 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:22:01.383 22:59:52 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:22:01.383 22:59:52 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:22:01.383 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:22:01.383 22:59:52 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:22:01.383 22:59:52 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:22:01.383 22:59:52 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:22:01.383 22:59:52 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:22:01.383 22:59:52 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:22:01.383 22:59:52 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:22:01.383 22:59:52 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:22:01.383 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:22:01.383 22:59:52 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:22:01.383 22:59:52 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:22:01.383 22:59:52 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:22:01.383 22:59:52 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:22:01.383 22:59:52 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:22:01.383 22:59:52 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:22:01.383 22:59:52 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:22:01.383 22:59:52 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:22:01.383 22:59:52 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:22:01.383 22:59:52 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:22:01.383 22:59:52 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:22:01.383 22:59:52 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:22:01.383 22:59:52 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:22:01.383 Found net devices under 0000:0a:00.0: cvl_0_0 00:22:01.383 22:59:52 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:22:01.383 22:59:52 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:22:01.383 22:59:52 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:22:01.383 22:59:52 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:22:01.383 22:59:52 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:22:01.383 22:59:52 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:22:01.383 Found net devices under 0000:0a:00.1: cvl_0_1 00:22:01.383 22:59:52 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:22:01.383 22:59:52 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:22:01.383 22:59:52 -- nvmf/common.sh@402 -- # is_hw=yes 00:22:01.383 22:59:52 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:22:01.383 22:59:52 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:22:01.383 22:59:52 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:22:01.383 22:59:52 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:22:01.383 22:59:52 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:22:01.383 22:59:52 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:22:01.383 22:59:52 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:22:01.383 22:59:52 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:22:01.383 22:59:52 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:22:01.383 22:59:52 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:22:01.383 22:59:52 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:22:01.383 22:59:52 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:22:01.383 22:59:52 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:22:01.383 22:59:52 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:22:01.383 22:59:52 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:22:01.383 22:59:52 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:22:01.383 22:59:52 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:22:01.383 22:59:52 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:22:01.383 22:59:52 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:22:01.383 22:59:52 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:22:01.383 22:59:52 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:22:01.383 22:59:52 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:22:01.383 22:59:52 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:22:01.383 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:22:01.383 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.184 ms 00:22:01.383 00:22:01.383 --- 10.0.0.2 ping statistics --- 00:22:01.383 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:22:01.383 rtt min/avg/max/mdev = 0.184/0.184/0.184/0.000 ms 00:22:01.384 22:59:52 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:22:01.384 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:22:01.384 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.101 ms 00:22:01.384 00:22:01.384 --- 10.0.0.1 ping statistics --- 00:22:01.384 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:22:01.384 rtt min/avg/max/mdev = 0.101/0.101/0.101/0.000 ms 00:22:01.384 22:59:52 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:22:01.384 22:59:52 -- nvmf/common.sh@410 -- # return 0 00:22:01.384 22:59:52 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:22:01.384 22:59:52 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:22:01.384 22:59:52 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:22:01.384 22:59:52 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:22:01.384 22:59:52 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:22:01.384 22:59:52 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:22:01.384 22:59:52 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:22:01.384 22:59:52 -- host/perf.sh@18 -- # nvmfappstart -m 0xF 00:22:01.384 22:59:52 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:22:01.384 22:59:52 -- common/autotest_common.sh@712 -- # xtrace_disable 00:22:01.384 22:59:52 -- common/autotest_common.sh@10 -- # set +x 00:22:01.384 22:59:52 -- nvmf/common.sh@469 -- # nvmfpid=349042 00:22:01.384 22:59:52 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:22:01.384 22:59:52 -- nvmf/common.sh@470 -- # waitforlisten 349042 00:22:01.384 22:59:52 -- common/autotest_common.sh@819 -- # '[' -z 349042 ']' 00:22:01.384 22:59:52 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk.sock 00:22:01.384 22:59:52 -- common/autotest_common.sh@824 -- # local max_retries=100 00:22:01.384 22:59:52 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:22:01.384 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:22:01.384 22:59:52 -- common/autotest_common.sh@828 -- # xtrace_disable 00:22:01.384 22:59:52 -- common/autotest_common.sh@10 -- # set +x 00:22:01.384 [2024-04-16 22:59:52.436119] Starting SPDK v24.01.1-pre git sha1 4b134b4ab / DPDK 23.11.0 initialization... 00:22:01.384 [2024-04-16 22:59:52.436219] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:22:01.384 EAL: No free 2048 kB hugepages reported on node 1 00:22:01.384 [2024-04-16 22:59:52.500795] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:22:01.644 [2024-04-16 22:59:52.611286] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:22:01.644 [2024-04-16 22:59:52.611434] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:22:01.644 [2024-04-16 22:59:52.611450] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:22:01.644 [2024-04-16 22:59:52.611463] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:22:01.644 [2024-04-16 22:59:52.611519] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:22:01.644 [2024-04-16 22:59:52.611589] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:22:01.644 [2024-04-16 22:59:52.611652] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:22:01.644 [2024-04-16 22:59:52.611655] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:22:02.578 22:59:53 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:22:02.578 22:59:53 -- common/autotest_common.sh@852 -- # return 0 00:22:02.578 22:59:53 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:22:02.578 22:59:53 -- common/autotest_common.sh@718 -- # xtrace_disable 00:22:02.578 22:59:53 -- common/autotest_common.sh@10 -- # set +x 00:22:02.578 22:59:53 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:22:02.578 22:59:53 -- host/perf.sh@28 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/gen_nvme.sh 00:22:02.578 22:59:53 -- host/perf.sh@28 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py load_subsystem_config 00:22:05.870 22:59:56 -- host/perf.sh@30 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py framework_get_config bdev 00:22:05.870 22:59:56 -- host/perf.sh@30 -- # jq -r '.[].params | select(.name=="Nvme0").traddr' 00:22:05.870 22:59:56 -- host/perf.sh@30 -- # local_nvme_trid=0000:88:00.0 00:22:05.870 22:59:56 -- host/perf.sh@31 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 00:22:05.870 22:59:56 -- host/perf.sh@31 -- # bdevs=' Malloc0' 00:22:05.870 22:59:56 -- host/perf.sh@33 -- # '[' -n 0000:88:00.0 ']' 00:22:05.870 22:59:56 -- host/perf.sh@34 -- # bdevs=' Malloc0 Nvme0n1' 00:22:05.870 22:59:56 -- host/perf.sh@37 -- # '[' tcp == rdma ']' 00:22:05.870 22:59:56 -- host/perf.sh@42 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_transport -t tcp -o 00:22:06.129 [2024-04-16 22:59:57.210419] tcp.c: 659:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:22:06.129 22:59:57 -- host/perf.sh@44 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:22:06.387 22:59:57 -- host/perf.sh@45 -- # for bdev in $bdevs 00:22:06.387 22:59:57 -- host/perf.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:22:06.646 22:59:57 -- host/perf.sh@45 -- # for bdev in $bdevs 00:22:06.646 22:59:57 -- host/perf.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Nvme0n1 00:22:06.905 22:59:58 -- host/perf.sh@48 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:22:07.163 [2024-04-16 22:59:58.218163] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:22:07.163 22:59:58 -- host/perf.sh@49 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener discovery -t tcp -a 10.0.0.2 -s 4420 00:22:07.423 22:59:58 -- host/perf.sh@52 -- # '[' -n 0000:88:00.0 ']' 00:22:07.423 22:59:58 -- host/perf.sh@53 -- # perf_app -i 0 -q 32 -o 4096 -w randrw -M 50 -t 1 -r 'trtype:PCIe traddr:0000:88:00.0' 00:22:07.423 22:59:58 -- host/perf.sh@21 -- # '[' 0 -eq 1 ']' 00:22:07.423 22:59:58 -- host/perf.sh@24 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -i 0 -q 32 -o 4096 -w randrw -M 50 -t 1 -r 'trtype:PCIe traddr:0000:88:00.0' 00:22:08.801 Initializing NVMe Controllers 00:22:08.801 Attached to NVMe Controller at 0000:88:00.0 [8086:0a54] 00:22:08.801 Associating PCIE (0000:88:00.0) NSID 1 with lcore 0 00:22:08.801 Initialization complete. Launching workers. 00:22:08.801 ======================================================== 00:22:08.801 Latency(us) 00:22:08.801 Device Information : IOPS MiB/s Average min max 00:22:08.801 PCIE (0000:88:00.0) NSID 1 from core 0: 86523.92 337.98 369.08 40.03 8289.63 00:22:08.802 ======================================================== 00:22:08.802 Total : 86523.92 337.98 369.08 40.03 8289.63 00:22:08.802 00:22:08.802 22:59:59 -- host/perf.sh@56 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -q 1 -o 4096 -w randrw -M 50 -t 1 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' 00:22:08.802 EAL: No free 2048 kB hugepages reported on node 1 00:22:10.180 Initializing NVMe Controllers 00:22:10.180 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:22:10.180 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 0 00:22:10.180 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 2 with lcore 0 00:22:10.180 Initialization complete. Launching workers. 00:22:10.180 ======================================================== 00:22:10.180 Latency(us) 00:22:10.180 Device Information : IOPS MiB/s Average min max 00:22:10.180 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 0: 126.56 0.49 8106.55 218.76 45114.55 00:22:10.180 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 2 from core 0: 59.79 0.23 17256.51 7003.68 47901.80 00:22:10.180 ======================================================== 00:22:10.180 Total : 186.35 0.73 11042.36 218.76 47901.80 00:22:10.180 00:22:10.180 23:00:01 -- host/perf.sh@57 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -q 32 -o 4096 -w randrw -M 50 -t 1 -HI -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' 00:22:10.180 EAL: No free 2048 kB hugepages reported on node 1 00:22:11.557 Initializing NVMe Controllers 00:22:11.557 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:22:11.557 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 0 00:22:11.557 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 2 with lcore 0 00:22:11.557 Initialization complete. Launching workers. 00:22:11.557 ======================================================== 00:22:11.557 Latency(us) 00:22:11.557 Device Information : IOPS MiB/s Average min max 00:22:11.558 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 0: 8523.37 33.29 3761.09 441.20 10523.83 00:22:11.558 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 2 from core 0: 3916.30 15.30 8182.46 4753.56 18138.44 00:22:11.558 ======================================================== 00:22:11.558 Total : 12439.67 48.59 5153.04 441.20 18138.44 00:22:11.558 00:22:11.558 23:00:02 -- host/perf.sh@59 -- # [[ e810 == \e\8\1\0 ]] 00:22:11.558 23:00:02 -- host/perf.sh@59 -- # [[ tcp == \r\d\m\a ]] 00:22:11.558 23:00:02 -- host/perf.sh@60 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -q 128 -o 262144 -O 16384 -w randrw -M 50 -t 2 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' 00:22:11.558 EAL: No free 2048 kB hugepages reported on node 1 00:22:14.100 Initializing NVMe Controllers 00:22:14.100 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:22:14.100 Controller IO queue size 128, less than required. 00:22:14.100 Consider using lower queue depth or smaller IO size, because IO requests may be queued at the NVMe driver. 00:22:14.100 Controller IO queue size 128, less than required. 00:22:14.100 Consider using lower queue depth or smaller IO size, because IO requests may be queued at the NVMe driver. 00:22:14.100 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 0 00:22:14.100 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 2 with lcore 0 00:22:14.100 Initialization complete. Launching workers. 00:22:14.100 ======================================================== 00:22:14.101 Latency(us) 00:22:14.101 Device Information : IOPS MiB/s Average min max 00:22:14.101 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 0: 856.99 214.25 153189.82 90218.05 229130.04 00:22:14.101 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 2 from core 0: 553.99 138.50 243693.34 134223.78 377998.47 00:22:14.101 ======================================================== 00:22:14.101 Total : 1410.98 352.75 188724.16 90218.05 377998.47 00:22:14.101 00:22:14.101 23:00:04 -- host/perf.sh@64 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -q 128 -o 36964 -O 4096 -w randrw -M 50 -t 5 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' -c 0xf -P 4 00:22:14.101 EAL: No free 2048 kB hugepages reported on node 1 00:22:14.101 No valid NVMe controllers or AIO or URING devices found 00:22:14.101 Initializing NVMe Controllers 00:22:14.101 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:22:14.101 Controller IO queue size 128, less than required. 00:22:14.101 Consider using lower queue depth or smaller IO size, because IO requests may be queued at the NVMe driver. 00:22:14.101 WARNING: IO size 36964 (-o) is not a multiple of nsid 1 sector size 512. Removing this ns from test 00:22:14.101 Controller IO queue size 128, less than required. 00:22:14.101 Consider using lower queue depth or smaller IO size, because IO requests may be queued at the NVMe driver. 00:22:14.101 WARNING: IO size 36964 (-o) is not a multiple of nsid 2 sector size 512. Removing this ns from test 00:22:14.101 WARNING: Some requested NVMe devices were skipped 00:22:14.101 23:00:05 -- host/perf.sh@65 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -q 128 -o 262144 -w randrw -M 50 -t 2 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' --transport-stat 00:22:14.101 EAL: No free 2048 kB hugepages reported on node 1 00:22:17.384 Initializing NVMe Controllers 00:22:17.384 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:22:17.384 Controller IO queue size 128, less than required. 00:22:17.384 Consider using lower queue depth or smaller IO size, because IO requests may be queued at the NVMe driver. 00:22:17.384 Controller IO queue size 128, less than required. 00:22:17.384 Consider using lower queue depth or smaller IO size, because IO requests may be queued at the NVMe driver. 00:22:17.384 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 0 00:22:17.384 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 2 with lcore 0 00:22:17.384 Initialization complete. Launching workers. 00:22:17.384 00:22:17.384 ==================== 00:22:17.384 lcore 0, ns TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 statistics: 00:22:17.384 TCP transport: 00:22:17.384 polls: 25101 00:22:17.384 idle_polls: 9823 00:22:17.384 sock_completions: 15278 00:22:17.384 nvme_completions: 5314 00:22:17.384 submitted_requests: 8130 00:22:17.384 queued_requests: 1 00:22:17.384 00:22:17.384 ==================== 00:22:17.384 lcore 0, ns TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 2 statistics: 00:22:17.384 TCP transport: 00:22:17.384 polls: 22590 00:22:17.384 idle_polls: 11752 00:22:17.384 sock_completions: 10838 00:22:17.384 nvme_completions: 2609 00:22:17.384 submitted_requests: 4043 00:22:17.384 queued_requests: 1 00:22:17.384 ======================================================== 00:22:17.384 Latency(us) 00:22:17.384 Device Information : IOPS MiB/s Average min max 00:22:17.384 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 0: 1391.89 347.97 94748.23 54587.87 162934.22 00:22:17.384 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 2 from core 0: 715.45 178.86 184318.40 68821.41 255179.78 00:22:17.384 ======================================================== 00:22:17.384 Total : 2107.34 526.83 125157.46 54587.87 255179.78 00:22:17.384 00:22:17.384 23:00:07 -- host/perf.sh@66 -- # sync 00:22:17.384 23:00:07 -- host/perf.sh@67 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:22:17.384 23:00:08 -- host/perf.sh@69 -- # '[' 1 -eq 1 ']' 00:22:17.384 23:00:08 -- host/perf.sh@71 -- # '[' -n 0000:88:00.0 ']' 00:22:17.384 23:00:08 -- host/perf.sh@72 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_create_lvstore Nvme0n1 lvs_0 00:22:20.694 23:00:11 -- host/perf.sh@72 -- # ls_guid=6236cfce-8a33-47cf-aa1c-557db765b522 00:22:20.695 23:00:11 -- host/perf.sh@73 -- # get_lvs_free_mb 6236cfce-8a33-47cf-aa1c-557db765b522 00:22:20.695 23:00:11 -- common/autotest_common.sh@1343 -- # local lvs_uuid=6236cfce-8a33-47cf-aa1c-557db765b522 00:22:20.695 23:00:11 -- common/autotest_common.sh@1344 -- # local lvs_info 00:22:20.695 23:00:11 -- common/autotest_common.sh@1345 -- # local fc 00:22:20.695 23:00:11 -- common/autotest_common.sh@1346 -- # local cs 00:22:20.695 23:00:11 -- common/autotest_common.sh@1347 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores 00:22:20.695 23:00:11 -- common/autotest_common.sh@1347 -- # lvs_info='[ 00:22:20.695 { 00:22:20.695 "uuid": "6236cfce-8a33-47cf-aa1c-557db765b522", 00:22:20.695 "name": "lvs_0", 00:22:20.695 "base_bdev": "Nvme0n1", 00:22:20.695 "total_data_clusters": 238234, 00:22:20.695 "free_clusters": 238234, 00:22:20.695 "block_size": 512, 00:22:20.695 "cluster_size": 4194304 00:22:20.695 } 00:22:20.695 ]' 00:22:20.695 23:00:11 -- common/autotest_common.sh@1348 -- # jq '.[] | select(.uuid=="6236cfce-8a33-47cf-aa1c-557db765b522") .free_clusters' 00:22:20.695 23:00:11 -- common/autotest_common.sh@1348 -- # fc=238234 00:22:20.695 23:00:11 -- common/autotest_common.sh@1349 -- # jq '.[] | select(.uuid=="6236cfce-8a33-47cf-aa1c-557db765b522") .cluster_size' 00:22:20.695 23:00:11 -- common/autotest_common.sh@1349 -- # cs=4194304 00:22:20.695 23:00:11 -- common/autotest_common.sh@1352 -- # free_mb=952936 00:22:20.695 23:00:11 -- common/autotest_common.sh@1353 -- # echo 952936 00:22:20.695 952936 00:22:20.695 23:00:11 -- host/perf.sh@77 -- # '[' 952936 -gt 20480 ']' 00:22:20.695 23:00:11 -- host/perf.sh@78 -- # free_mb=20480 00:22:20.695 23:00:11 -- host/perf.sh@80 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_create -u 6236cfce-8a33-47cf-aa1c-557db765b522 lbd_0 20480 00:22:21.263 23:00:12 -- host/perf.sh@80 -- # lb_guid=4dd6bcd0-7ec6-42d1-843c-f385f58c6cd0 00:22:21.263 23:00:12 -- host/perf.sh@83 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_create_lvstore 4dd6bcd0-7ec6-42d1-843c-f385f58c6cd0 lvs_n_0 00:22:22.195 23:00:12 -- host/perf.sh@83 -- # ls_nested_guid=ed95a2ad-bc71-4a58-b5fa-6f285978e2da 00:22:22.195 23:00:12 -- host/perf.sh@84 -- # get_lvs_free_mb ed95a2ad-bc71-4a58-b5fa-6f285978e2da 00:22:22.195 23:00:12 -- common/autotest_common.sh@1343 -- # local lvs_uuid=ed95a2ad-bc71-4a58-b5fa-6f285978e2da 00:22:22.195 23:00:12 -- common/autotest_common.sh@1344 -- # local lvs_info 00:22:22.195 23:00:12 -- common/autotest_common.sh@1345 -- # local fc 00:22:22.195 23:00:12 -- common/autotest_common.sh@1346 -- # local cs 00:22:22.195 23:00:12 -- common/autotest_common.sh@1347 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores 00:22:22.195 23:00:13 -- common/autotest_common.sh@1347 -- # lvs_info='[ 00:22:22.195 { 00:22:22.195 "uuid": "6236cfce-8a33-47cf-aa1c-557db765b522", 00:22:22.195 "name": "lvs_0", 00:22:22.195 "base_bdev": "Nvme0n1", 00:22:22.195 "total_data_clusters": 238234, 00:22:22.195 "free_clusters": 233114, 00:22:22.195 "block_size": 512, 00:22:22.195 "cluster_size": 4194304 00:22:22.195 }, 00:22:22.195 { 00:22:22.195 "uuid": "ed95a2ad-bc71-4a58-b5fa-6f285978e2da", 00:22:22.195 "name": "lvs_n_0", 00:22:22.195 "base_bdev": "4dd6bcd0-7ec6-42d1-843c-f385f58c6cd0", 00:22:22.195 "total_data_clusters": 5114, 00:22:22.195 "free_clusters": 5114, 00:22:22.195 "block_size": 512, 00:22:22.195 "cluster_size": 4194304 00:22:22.195 } 00:22:22.195 ]' 00:22:22.195 23:00:13 -- common/autotest_common.sh@1348 -- # jq '.[] | select(.uuid=="ed95a2ad-bc71-4a58-b5fa-6f285978e2da") .free_clusters' 00:22:22.195 23:00:13 -- common/autotest_common.sh@1348 -- # fc=5114 00:22:22.195 23:00:13 -- common/autotest_common.sh@1349 -- # jq '.[] | select(.uuid=="ed95a2ad-bc71-4a58-b5fa-6f285978e2da") .cluster_size' 00:22:22.195 23:00:13 -- common/autotest_common.sh@1349 -- # cs=4194304 00:22:22.195 23:00:13 -- common/autotest_common.sh@1352 -- # free_mb=20456 00:22:22.195 23:00:13 -- common/autotest_common.sh@1353 -- # echo 20456 00:22:22.195 20456 00:22:22.195 23:00:13 -- host/perf.sh@85 -- # '[' 20456 -gt 20480 ']' 00:22:22.195 23:00:13 -- host/perf.sh@88 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_create -u ed95a2ad-bc71-4a58-b5fa-6f285978e2da lbd_nest_0 20456 00:22:22.453 23:00:13 -- host/perf.sh@88 -- # lb_nested_guid=ad9e41b9-021c-4107-94e8-88ad1d06162a 00:22:22.453 23:00:13 -- host/perf.sh@89 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:22:22.711 23:00:13 -- host/perf.sh@90 -- # for bdev in $lb_nested_guid 00:22:22.711 23:00:13 -- host/perf.sh@91 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 ad9e41b9-021c-4107-94e8-88ad1d06162a 00:22:22.969 23:00:13 -- host/perf.sh@93 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:22:23.229 23:00:14 -- host/perf.sh@95 -- # qd_depth=("1" "32" "128") 00:22:23.229 23:00:14 -- host/perf.sh@96 -- # io_size=("512" "131072") 00:22:23.229 23:00:14 -- host/perf.sh@97 -- # for qd in "${qd_depth[@]}" 00:22:23.229 23:00:14 -- host/perf.sh@98 -- # for o in "${io_size[@]}" 00:22:23.229 23:00:14 -- host/perf.sh@99 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -q 1 -o 512 -w randrw -M 50 -t 10 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' 00:22:23.229 EAL: No free 2048 kB hugepages reported on node 1 00:22:35.434 Initializing NVMe Controllers 00:22:35.434 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:22:35.434 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 0 00:22:35.434 Initialization complete. Launching workers. 00:22:35.434 ======================================================== 00:22:35.434 Latency(us) 00:22:35.434 Device Information : IOPS MiB/s Average min max 00:22:35.434 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 0: 48.09 0.02 20861.39 200.22 48340.91 00:22:35.434 ======================================================== 00:22:35.434 Total : 48.09 0.02 20861.39 200.22 48340.91 00:22:35.434 00:22:35.434 23:00:24 -- host/perf.sh@98 -- # for o in "${io_size[@]}" 00:22:35.434 23:00:24 -- host/perf.sh@99 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -q 1 -o 131072 -w randrw -M 50 -t 10 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' 00:22:35.434 EAL: No free 2048 kB hugepages reported on node 1 00:22:45.411 Initializing NVMe Controllers 00:22:45.411 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:22:45.411 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 0 00:22:45.411 Initialization complete. Launching workers. 00:22:45.411 ======================================================== 00:22:45.411 Latency(us) 00:22:45.411 Device Information : IOPS MiB/s Average min max 00:22:45.411 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 0: 80.67 10.08 12405.27 4973.15 48874.58 00:22:45.411 ======================================================== 00:22:45.411 Total : 80.67 10.08 12405.27 4973.15 48874.58 00:22:45.411 00:22:45.411 23:00:34 -- host/perf.sh@97 -- # for qd in "${qd_depth[@]}" 00:22:45.411 23:00:34 -- host/perf.sh@98 -- # for o in "${io_size[@]}" 00:22:45.411 23:00:34 -- host/perf.sh@99 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -q 32 -o 512 -w randrw -M 50 -t 10 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' 00:22:45.411 EAL: No free 2048 kB hugepages reported on node 1 00:22:55.387 Initializing NVMe Controllers 00:22:55.387 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:22:55.387 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 0 00:22:55.387 Initialization complete. Launching workers. 00:22:55.387 ======================================================== 00:22:55.387 Latency(us) 00:22:55.387 Device Information : IOPS MiB/s Average min max 00:22:55.387 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 0: 7649.14 3.73 4183.16 283.55 10349.40 00:22:55.387 ======================================================== 00:22:55.387 Total : 7649.14 3.73 4183.16 283.55 10349.40 00:22:55.387 00:22:55.387 23:00:45 -- host/perf.sh@98 -- # for o in "${io_size[@]}" 00:22:55.387 23:00:45 -- host/perf.sh@99 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -q 32 -o 131072 -w randrw -M 50 -t 10 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' 00:22:55.387 EAL: No free 2048 kB hugepages reported on node 1 00:23:05.370 Initializing NVMe Controllers 00:23:05.370 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:23:05.371 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 0 00:23:05.371 Initialization complete. Launching workers. 00:23:05.371 ======================================================== 00:23:05.371 Latency(us) 00:23:05.371 Device Information : IOPS MiB/s Average min max 00:23:05.371 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 0: 2640.52 330.07 12120.12 839.94 53256.68 00:23:05.371 ======================================================== 00:23:05.371 Total : 2640.52 330.07 12120.12 839.94 53256.68 00:23:05.371 00:23:05.371 23:00:55 -- host/perf.sh@97 -- # for qd in "${qd_depth[@]}" 00:23:05.371 23:00:55 -- host/perf.sh@98 -- # for o in "${io_size[@]}" 00:23:05.371 23:00:55 -- host/perf.sh@99 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -q 128 -o 512 -w randrw -M 50 -t 10 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' 00:23:05.371 EAL: No free 2048 kB hugepages reported on node 1 00:23:15.391 Initializing NVMe Controllers 00:23:15.391 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:23:15.391 Controller IO queue size 128, less than required. 00:23:15.391 Consider using lower queue depth or smaller IO size, because IO requests may be queued at the NVMe driver. 00:23:15.391 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 0 00:23:15.391 Initialization complete. Launching workers. 00:23:15.391 ======================================================== 00:23:15.391 Latency(us) 00:23:15.391 Device Information : IOPS MiB/s Average min max 00:23:15.391 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 0: 11897.15 5.81 10761.38 1812.56 53938.62 00:23:15.391 ======================================================== 00:23:15.391 Total : 11897.15 5.81 10761.38 1812.56 53938.62 00:23:15.391 00:23:15.391 23:01:06 -- host/perf.sh@98 -- # for o in "${io_size[@]}" 00:23:15.391 23:01:06 -- host/perf.sh@99 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -q 128 -o 131072 -w randrw -M 50 -t 10 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' 00:23:15.391 EAL: No free 2048 kB hugepages reported on node 1 00:23:25.371 Initializing NVMe Controllers 00:23:25.371 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:23:25.371 Controller IO queue size 128, less than required. 00:23:25.371 Consider using lower queue depth or smaller IO size, because IO requests may be queued at the NVMe driver. 00:23:25.371 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 0 00:23:25.371 Initialization complete. Launching workers. 00:23:25.371 ======================================================== 00:23:25.371 Latency(us) 00:23:25.371 Device Information : IOPS MiB/s Average min max 00:23:25.371 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 0: 1209.60 151.20 106734.30 16093.69 221570.03 00:23:25.371 ======================================================== 00:23:25.371 Total : 1209.60 151.20 106734.30 16093.69 221570.03 00:23:25.371 00:23:25.371 23:01:16 -- host/perf.sh@104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:23:25.629 23:01:16 -- host/perf.sh@105 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_delete ad9e41b9-021c-4107-94e8-88ad1d06162a 00:23:26.563 23:01:17 -- host/perf.sh@106 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_delete_lvstore -l lvs_n_0 00:23:26.563 23:01:17 -- host/perf.sh@107 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_delete 4dd6bcd0-7ec6-42d1-843c-f385f58c6cd0 00:23:27.131 23:01:17 -- host/perf.sh@108 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_delete_lvstore -l lvs_0 00:23:27.131 23:01:18 -- host/perf.sh@112 -- # trap - SIGINT SIGTERM EXIT 00:23:27.132 23:01:18 -- host/perf.sh@114 -- # nvmftestfini 00:23:27.132 23:01:18 -- nvmf/common.sh@476 -- # nvmfcleanup 00:23:27.132 23:01:18 -- nvmf/common.sh@116 -- # sync 00:23:27.132 23:01:18 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:23:27.132 23:01:18 -- nvmf/common.sh@119 -- # set +e 00:23:27.132 23:01:18 -- nvmf/common.sh@120 -- # for i in {1..20} 00:23:27.132 23:01:18 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:23:27.132 rmmod nvme_tcp 00:23:27.132 rmmod nvme_fabrics 00:23:27.132 rmmod nvme_keyring 00:23:27.390 23:01:18 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:23:27.390 23:01:18 -- nvmf/common.sh@123 -- # set -e 00:23:27.390 23:01:18 -- nvmf/common.sh@124 -- # return 0 00:23:27.390 23:01:18 -- nvmf/common.sh@477 -- # '[' -n 349042 ']' 00:23:27.390 23:01:18 -- nvmf/common.sh@478 -- # killprocess 349042 00:23:27.390 23:01:18 -- common/autotest_common.sh@926 -- # '[' -z 349042 ']' 00:23:27.390 23:01:18 -- common/autotest_common.sh@930 -- # kill -0 349042 00:23:27.390 23:01:18 -- common/autotest_common.sh@931 -- # uname 00:23:27.390 23:01:18 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:23:27.390 23:01:18 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 349042 00:23:27.390 23:01:18 -- common/autotest_common.sh@932 -- # process_name=reactor_0 00:23:27.390 23:01:18 -- common/autotest_common.sh@936 -- # '[' reactor_0 = sudo ']' 00:23:27.390 23:01:18 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 349042' 00:23:27.390 killing process with pid 349042 00:23:27.390 23:01:18 -- common/autotest_common.sh@945 -- # kill 349042 00:23:27.390 23:01:18 -- common/autotest_common.sh@950 -- # wait 349042 00:23:29.295 23:01:19 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:23:29.295 23:01:19 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:23:29.295 23:01:19 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:23:29.295 23:01:19 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:23:29.295 23:01:19 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:23:29.295 23:01:19 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:23:29.295 23:01:19 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:23:29.295 23:01:19 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:23:31.204 23:01:21 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:23:31.204 00:23:31.204 real 1m31.691s 00:23:31.204 user 5m33.571s 00:23:31.204 sys 0m15.299s 00:23:31.204 23:01:21 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:23:31.204 23:01:21 -- common/autotest_common.sh@10 -- # set +x 00:23:31.204 ************************************ 00:23:31.204 END TEST nvmf_perf 00:23:31.204 ************************************ 00:23:31.204 23:01:22 -- nvmf/nvmf.sh@98 -- # run_test nvmf_fio_host /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/fio.sh --transport=tcp 00:23:31.204 23:01:22 -- common/autotest_common.sh@1077 -- # '[' 3 -le 1 ']' 00:23:31.204 23:01:22 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:23:31.204 23:01:22 -- common/autotest_common.sh@10 -- # set +x 00:23:31.204 ************************************ 00:23:31.204 START TEST nvmf_fio_host 00:23:31.204 ************************************ 00:23:31.204 23:01:22 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/fio.sh --transport=tcp 00:23:31.204 * Looking for test storage... 00:23:31.204 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host 00:23:31.204 23:01:22 -- host/fio.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:23:31.204 23:01:22 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:23:31.204 23:01:22 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:23:31.204 23:01:22 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:23:31.204 23:01:22 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:23:31.204 23:01:22 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:23:31.204 23:01:22 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:23:31.204 23:01:22 -- paths/export.sh@5 -- # export PATH 00:23:31.204 23:01:22 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:23:31.204 23:01:22 -- host/fio.sh@10 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:23:31.204 23:01:22 -- nvmf/common.sh@7 -- # uname -s 00:23:31.204 23:01:22 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:23:31.204 23:01:22 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:23:31.204 23:01:22 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:23:31.204 23:01:22 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:23:31.204 23:01:22 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:23:31.204 23:01:22 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:23:31.204 23:01:22 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:23:31.204 23:01:22 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:23:31.204 23:01:22 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:23:31.204 23:01:22 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:23:31.204 23:01:22 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:23:31.204 23:01:22 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:23:31.204 23:01:22 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:23:31.204 23:01:22 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:23:31.204 23:01:22 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:23:31.204 23:01:22 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:23:31.204 23:01:22 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:23:31.204 23:01:22 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:23:31.204 23:01:22 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:23:31.204 23:01:22 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:23:31.204 23:01:22 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:23:31.204 23:01:22 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:23:31.204 23:01:22 -- paths/export.sh@5 -- # export PATH 00:23:31.204 23:01:22 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:23:31.204 23:01:22 -- nvmf/common.sh@46 -- # : 0 00:23:31.204 23:01:22 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:23:31.204 23:01:22 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:23:31.204 23:01:22 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:23:31.204 23:01:22 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:23:31.204 23:01:22 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:23:31.204 23:01:22 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:23:31.204 23:01:22 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:23:31.204 23:01:22 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:23:31.204 23:01:22 -- host/fio.sh@12 -- # nvmftestinit 00:23:31.204 23:01:22 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:23:31.204 23:01:22 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:23:31.204 23:01:22 -- nvmf/common.sh@436 -- # prepare_net_devs 00:23:31.204 23:01:22 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:23:31.204 23:01:22 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:23:31.204 23:01:22 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:23:31.204 23:01:22 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:23:31.204 23:01:22 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:23:31.204 23:01:22 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:23:31.204 23:01:22 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:23:31.204 23:01:22 -- nvmf/common.sh@284 -- # xtrace_disable 00:23:31.204 23:01:22 -- common/autotest_common.sh@10 -- # set +x 00:23:33.108 23:01:23 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:23:33.108 23:01:23 -- nvmf/common.sh@290 -- # pci_devs=() 00:23:33.108 23:01:23 -- nvmf/common.sh@290 -- # local -a pci_devs 00:23:33.108 23:01:23 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:23:33.108 23:01:23 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:23:33.108 23:01:23 -- nvmf/common.sh@292 -- # pci_drivers=() 00:23:33.108 23:01:23 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:23:33.108 23:01:23 -- nvmf/common.sh@294 -- # net_devs=() 00:23:33.108 23:01:23 -- nvmf/common.sh@294 -- # local -ga net_devs 00:23:33.108 23:01:23 -- nvmf/common.sh@295 -- # e810=() 00:23:33.108 23:01:23 -- nvmf/common.sh@295 -- # local -ga e810 00:23:33.108 23:01:23 -- nvmf/common.sh@296 -- # x722=() 00:23:33.108 23:01:23 -- nvmf/common.sh@296 -- # local -ga x722 00:23:33.108 23:01:23 -- nvmf/common.sh@297 -- # mlx=() 00:23:33.108 23:01:23 -- nvmf/common.sh@297 -- # local -ga mlx 00:23:33.108 23:01:23 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:23:33.108 23:01:23 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:23:33.108 23:01:23 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:23:33.108 23:01:23 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:23:33.108 23:01:23 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:23:33.108 23:01:23 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:23:33.108 23:01:23 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:23:33.108 23:01:23 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:23:33.108 23:01:23 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:23:33.108 23:01:23 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:23:33.108 23:01:23 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:23:33.108 23:01:23 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:23:33.108 23:01:23 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:23:33.108 23:01:23 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:23:33.108 23:01:23 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:23:33.108 23:01:23 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:23:33.108 23:01:23 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:23:33.108 23:01:23 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:23:33.108 23:01:23 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:23:33.108 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:23:33.108 23:01:23 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:23:33.108 23:01:23 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:23:33.108 23:01:23 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:23:33.108 23:01:23 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:23:33.108 23:01:23 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:23:33.108 23:01:23 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:23:33.108 23:01:23 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:23:33.108 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:23:33.108 23:01:23 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:23:33.108 23:01:23 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:23:33.108 23:01:23 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:23:33.108 23:01:23 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:23:33.108 23:01:23 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:23:33.108 23:01:23 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:23:33.108 23:01:23 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:23:33.108 23:01:23 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:23:33.108 23:01:23 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:23:33.108 23:01:23 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:23:33.108 23:01:23 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:23:33.108 23:01:23 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:23:33.108 23:01:23 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:23:33.108 Found net devices under 0000:0a:00.0: cvl_0_0 00:23:33.108 23:01:23 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:23:33.108 23:01:23 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:23:33.108 23:01:23 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:23:33.108 23:01:23 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:23:33.108 23:01:23 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:23:33.108 23:01:23 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:23:33.108 Found net devices under 0000:0a:00.1: cvl_0_1 00:23:33.108 23:01:23 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:23:33.108 23:01:23 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:23:33.108 23:01:23 -- nvmf/common.sh@402 -- # is_hw=yes 00:23:33.108 23:01:23 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:23:33.108 23:01:23 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:23:33.108 23:01:23 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:23:33.108 23:01:23 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:23:33.108 23:01:23 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:23:33.108 23:01:23 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:23:33.108 23:01:23 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:23:33.108 23:01:23 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:23:33.108 23:01:23 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:23:33.108 23:01:23 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:23:33.108 23:01:23 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:23:33.108 23:01:23 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:23:33.108 23:01:23 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:23:33.108 23:01:23 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:23:33.108 23:01:23 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:23:33.108 23:01:23 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:23:33.108 23:01:24 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:23:33.108 23:01:24 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:23:33.108 23:01:24 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:23:33.108 23:01:24 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:23:33.108 23:01:24 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:23:33.108 23:01:24 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:23:33.108 23:01:24 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:23:33.108 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:23:33.108 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.172 ms 00:23:33.108 00:23:33.108 --- 10.0.0.2 ping statistics --- 00:23:33.108 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:23:33.108 rtt min/avg/max/mdev = 0.172/0.172/0.172/0.000 ms 00:23:33.108 23:01:24 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:23:33.108 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:23:33.108 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.097 ms 00:23:33.108 00:23:33.108 --- 10.0.0.1 ping statistics --- 00:23:33.108 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:23:33.108 rtt min/avg/max/mdev = 0.097/0.097/0.097/0.000 ms 00:23:33.108 23:01:24 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:23:33.108 23:01:24 -- nvmf/common.sh@410 -- # return 0 00:23:33.108 23:01:24 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:23:33.108 23:01:24 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:23:33.108 23:01:24 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:23:33.109 23:01:24 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:23:33.109 23:01:24 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:23:33.109 23:01:24 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:23:33.109 23:01:24 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:23:33.109 23:01:24 -- host/fio.sh@14 -- # [[ y != y ]] 00:23:33.109 23:01:24 -- host/fio.sh@19 -- # timing_enter start_nvmf_tgt 00:23:33.109 23:01:24 -- common/autotest_common.sh@712 -- # xtrace_disable 00:23:33.109 23:01:24 -- common/autotest_common.sh@10 -- # set +x 00:23:33.109 23:01:24 -- host/fio.sh@22 -- # nvmfpid=362133 00:23:33.109 23:01:24 -- host/fio.sh@21 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:23:33.109 23:01:24 -- host/fio.sh@24 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:23:33.109 23:01:24 -- host/fio.sh@26 -- # waitforlisten 362133 00:23:33.109 23:01:24 -- common/autotest_common.sh@819 -- # '[' -z 362133 ']' 00:23:33.109 23:01:24 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk.sock 00:23:33.109 23:01:24 -- common/autotest_common.sh@824 -- # local max_retries=100 00:23:33.109 23:01:24 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:23:33.109 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:23:33.109 23:01:24 -- common/autotest_common.sh@828 -- # xtrace_disable 00:23:33.109 23:01:24 -- common/autotest_common.sh@10 -- # set +x 00:23:33.109 [2024-04-16 23:01:24.134978] Starting SPDK v24.01.1-pre git sha1 4b134b4ab / DPDK 23.11.0 initialization... 00:23:33.109 [2024-04-16 23:01:24.135044] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:23:33.109 EAL: No free 2048 kB hugepages reported on node 1 00:23:33.109 [2024-04-16 23:01:24.196922] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:23:33.367 [2024-04-16 23:01:24.302644] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:23:33.367 [2024-04-16 23:01:24.302785] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:23:33.367 [2024-04-16 23:01:24.302801] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:23:33.367 [2024-04-16 23:01:24.302813] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:23:33.367 [2024-04-16 23:01:24.302874] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:23:33.367 [2024-04-16 23:01:24.302926] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:23:33.367 [2024-04-16 23:01:24.302990] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:23:33.367 [2024-04-16 23:01:24.302993] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:23:34.303 23:01:25 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:23:34.303 23:01:25 -- common/autotest_common.sh@852 -- # return 0 00:23:34.303 23:01:25 -- host/fio.sh@27 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:23:34.303 23:01:25 -- common/autotest_common.sh@551 -- # xtrace_disable 00:23:34.303 23:01:25 -- common/autotest_common.sh@10 -- # set +x 00:23:34.303 [2024-04-16 23:01:25.116747] tcp.c: 659:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:23:34.303 23:01:25 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:23:34.303 23:01:25 -- host/fio.sh@28 -- # timing_exit start_nvmf_tgt 00:23:34.303 23:01:25 -- common/autotest_common.sh@718 -- # xtrace_disable 00:23:34.303 23:01:25 -- common/autotest_common.sh@10 -- # set +x 00:23:34.303 23:01:25 -- host/fio.sh@30 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc1 00:23:34.303 23:01:25 -- common/autotest_common.sh@551 -- # xtrace_disable 00:23:34.303 23:01:25 -- common/autotest_common.sh@10 -- # set +x 00:23:34.303 Malloc1 00:23:34.303 23:01:25 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:23:34.303 23:01:25 -- host/fio.sh@31 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:23:34.303 23:01:25 -- common/autotest_common.sh@551 -- # xtrace_disable 00:23:34.303 23:01:25 -- common/autotest_common.sh@10 -- # set +x 00:23:34.303 23:01:25 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:23:34.303 23:01:25 -- host/fio.sh@32 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:23:34.303 23:01:25 -- common/autotest_common.sh@551 -- # xtrace_disable 00:23:34.303 23:01:25 -- common/autotest_common.sh@10 -- # set +x 00:23:34.303 23:01:25 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:23:34.303 23:01:25 -- host/fio.sh@33 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:23:34.303 23:01:25 -- common/autotest_common.sh@551 -- # xtrace_disable 00:23:34.303 23:01:25 -- common/autotest_common.sh@10 -- # set +x 00:23:34.304 [2024-04-16 23:01:25.194188] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:23:34.304 23:01:25 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:23:34.304 23:01:25 -- host/fio.sh@34 -- # rpc_cmd nvmf_subsystem_add_listener discovery -t tcp -a 10.0.0.2 -s 4420 00:23:34.304 23:01:25 -- common/autotest_common.sh@551 -- # xtrace_disable 00:23:34.304 23:01:25 -- common/autotest_common.sh@10 -- # set +x 00:23:34.304 23:01:25 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:23:34.304 23:01:25 -- host/fio.sh@36 -- # PLUGIN_DIR=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/app/fio/nvme 00:23:34.304 23:01:25 -- host/fio.sh@39 -- # fio_nvme /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/app/fio/nvme/example_config.fio '--filename=trtype=tcp adrfam=IPv4 traddr=10.0.0.2 trsvcid=4420 ns=1' --bs=4096 00:23:34.304 23:01:25 -- common/autotest_common.sh@1339 -- # fio_plugin /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/app/fio/nvme/example_config.fio '--filename=trtype=tcp adrfam=IPv4 traddr=10.0.0.2 trsvcid=4420 ns=1' --bs=4096 00:23:34.304 23:01:25 -- common/autotest_common.sh@1316 -- # local fio_dir=/usr/src/fio 00:23:34.304 23:01:25 -- common/autotest_common.sh@1318 -- # sanitizers=('libasan' 'libclang_rt.asan') 00:23:34.304 23:01:25 -- common/autotest_common.sh@1318 -- # local sanitizers 00:23:34.304 23:01:25 -- common/autotest_common.sh@1319 -- # local plugin=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme 00:23:34.304 23:01:25 -- common/autotest_common.sh@1320 -- # shift 00:23:34.304 23:01:25 -- common/autotest_common.sh@1322 -- # local asan_lib= 00:23:34.304 23:01:25 -- common/autotest_common.sh@1323 -- # for sanitizer in "${sanitizers[@]}" 00:23:34.304 23:01:25 -- common/autotest_common.sh@1324 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme 00:23:34.304 23:01:25 -- common/autotest_common.sh@1324 -- # grep libasan 00:23:34.304 23:01:25 -- common/autotest_common.sh@1324 -- # awk '{print $3}' 00:23:34.304 23:01:25 -- common/autotest_common.sh@1324 -- # asan_lib= 00:23:34.304 23:01:25 -- common/autotest_common.sh@1325 -- # [[ -n '' ]] 00:23:34.304 23:01:25 -- common/autotest_common.sh@1323 -- # for sanitizer in "${sanitizers[@]}" 00:23:34.304 23:01:25 -- common/autotest_common.sh@1324 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme 00:23:34.304 23:01:25 -- common/autotest_common.sh@1324 -- # grep libclang_rt.asan 00:23:34.304 23:01:25 -- common/autotest_common.sh@1324 -- # awk '{print $3}' 00:23:34.304 23:01:25 -- common/autotest_common.sh@1324 -- # asan_lib= 00:23:34.304 23:01:25 -- common/autotest_common.sh@1325 -- # [[ -n '' ]] 00:23:34.304 23:01:25 -- common/autotest_common.sh@1331 -- # LD_PRELOAD=' /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme' 00:23:34.304 23:01:25 -- common/autotest_common.sh@1331 -- # /usr/src/fio/fio /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/app/fio/nvme/example_config.fio '--filename=trtype=tcp adrfam=IPv4 traddr=10.0.0.2 trsvcid=4420 ns=1' --bs=4096 00:23:34.304 test: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=spdk, iodepth=128 00:23:34.304 fio-3.35 00:23:34.304 Starting 1 thread 00:23:34.562 EAL: No free 2048 kB hugepages reported on node 1 00:23:37.092 00:23:37.092 test: (groupid=0, jobs=1): err= 0: pid=362369: Tue Apr 16 23:01:27 2024 00:23:37.092 read: IOPS=9682, BW=37.8MiB/s (39.7MB/s)(75.9MiB/2006msec) 00:23:37.092 slat (nsec): min=1905, max=137376, avg=2479.12, stdev=1669.83 00:23:37.092 clat (usec): min=2401, max=13616, avg=7309.67, stdev=545.72 00:23:37.092 lat (usec): min=2424, max=13618, avg=7312.15, stdev=545.64 00:23:37.092 clat percentiles (usec): 00:23:37.092 | 1.00th=[ 6128], 5.00th=[ 6521], 10.00th=[ 6652], 20.00th=[ 6915], 00:23:37.092 | 30.00th=[ 7046], 40.00th=[ 7177], 50.00th=[ 7308], 60.00th=[ 7439], 00:23:37.092 | 70.00th=[ 7570], 80.00th=[ 7701], 90.00th=[ 7963], 95.00th=[ 8160], 00:23:37.092 | 99.00th=[ 8455], 99.50th=[ 8717], 99.90th=[11469], 99.95th=[12256], 00:23:37.092 | 99.99th=[13435] 00:23:37.092 bw ( KiB/s): min=37936, max=39312, per=99.94%, avg=38710.00, stdev=604.25, samples=4 00:23:37.092 iops : min= 9484, max= 9828, avg=9677.50, stdev=151.06, samples=4 00:23:37.092 write: IOPS=9693, BW=37.9MiB/s (39.7MB/s)(76.0MiB/2006msec); 0 zone resets 00:23:37.092 slat (usec): min=2, max=100, avg= 2.56, stdev= 1.36 00:23:37.092 clat (usec): min=1124, max=10927, avg=5865.39, stdev=476.66 00:23:37.092 lat (usec): min=1130, max=10930, avg=5867.95, stdev=476.62 00:23:37.092 clat percentiles (usec): 00:23:37.093 | 1.00th=[ 4817], 5.00th=[ 5145], 10.00th=[ 5342], 20.00th=[ 5538], 00:23:37.093 | 30.00th=[ 5669], 40.00th=[ 5735], 50.00th=[ 5866], 60.00th=[ 5997], 00:23:37.093 | 70.00th=[ 6063], 80.00th=[ 6194], 90.00th=[ 6390], 95.00th=[ 6587], 00:23:37.093 | 99.00th=[ 6915], 99.50th=[ 7046], 99.90th=[ 9372], 99.95th=[10421], 00:23:37.093 | 99.99th=[10945] 00:23:37.093 bw ( KiB/s): min=38528, max=39168, per=100.00%, avg=38774.00, stdev=278.16, samples=4 00:23:37.093 iops : min= 9632, max= 9792, avg=9693.50, stdev=69.54, samples=4 00:23:37.093 lat (msec) : 2=0.03%, 4=0.11%, 10=99.72%, 20=0.14% 00:23:37.093 cpu : usr=58.10%, sys=36.96%, ctx=66, majf=0, minf=6 00:23:37.093 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.1%, 32=0.1%, >=64=99.8% 00:23:37.093 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:23:37.093 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:23:37.093 issued rwts: total=19424,19445,0,0 short=0,0,0,0 dropped=0,0,0,0 00:23:37.093 latency : target=0, window=0, percentile=100.00%, depth=128 00:23:37.093 00:23:37.093 Run status group 0 (all jobs): 00:23:37.093 READ: bw=37.8MiB/s (39.7MB/s), 37.8MiB/s-37.8MiB/s (39.7MB/s-39.7MB/s), io=75.9MiB (79.6MB), run=2006-2006msec 00:23:37.093 WRITE: bw=37.9MiB/s (39.7MB/s), 37.9MiB/s-37.9MiB/s (39.7MB/s-39.7MB/s), io=76.0MiB (79.6MB), run=2006-2006msec 00:23:37.093 23:01:27 -- host/fio.sh@43 -- # fio_nvme /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/app/fio/nvme/mock_sgl_config.fio '--filename=trtype=tcp adrfam=IPv4 traddr=10.0.0.2 trsvcid=4420 ns=1' 00:23:37.093 23:01:27 -- common/autotest_common.sh@1339 -- # fio_plugin /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/app/fio/nvme/mock_sgl_config.fio '--filename=trtype=tcp adrfam=IPv4 traddr=10.0.0.2 trsvcid=4420 ns=1' 00:23:37.093 23:01:27 -- common/autotest_common.sh@1316 -- # local fio_dir=/usr/src/fio 00:23:37.093 23:01:27 -- common/autotest_common.sh@1318 -- # sanitizers=('libasan' 'libclang_rt.asan') 00:23:37.093 23:01:27 -- common/autotest_common.sh@1318 -- # local sanitizers 00:23:37.093 23:01:27 -- common/autotest_common.sh@1319 -- # local plugin=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme 00:23:37.093 23:01:27 -- common/autotest_common.sh@1320 -- # shift 00:23:37.093 23:01:27 -- common/autotest_common.sh@1322 -- # local asan_lib= 00:23:37.093 23:01:27 -- common/autotest_common.sh@1323 -- # for sanitizer in "${sanitizers[@]}" 00:23:37.093 23:01:27 -- common/autotest_common.sh@1324 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme 00:23:37.093 23:01:27 -- common/autotest_common.sh@1324 -- # grep libasan 00:23:37.093 23:01:27 -- common/autotest_common.sh@1324 -- # awk '{print $3}' 00:23:37.093 23:01:27 -- common/autotest_common.sh@1324 -- # asan_lib= 00:23:37.093 23:01:27 -- common/autotest_common.sh@1325 -- # [[ -n '' ]] 00:23:37.093 23:01:27 -- common/autotest_common.sh@1323 -- # for sanitizer in "${sanitizers[@]}" 00:23:37.093 23:01:27 -- common/autotest_common.sh@1324 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme 00:23:37.093 23:01:27 -- common/autotest_common.sh@1324 -- # grep libclang_rt.asan 00:23:37.093 23:01:27 -- common/autotest_common.sh@1324 -- # awk '{print $3}' 00:23:37.093 23:01:27 -- common/autotest_common.sh@1324 -- # asan_lib= 00:23:37.093 23:01:27 -- common/autotest_common.sh@1325 -- # [[ -n '' ]] 00:23:37.093 23:01:27 -- common/autotest_common.sh@1331 -- # LD_PRELOAD=' /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme' 00:23:37.093 23:01:27 -- common/autotest_common.sh@1331 -- # /usr/src/fio/fio /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/app/fio/nvme/mock_sgl_config.fio '--filename=trtype=tcp adrfam=IPv4 traddr=10.0.0.2 trsvcid=4420 ns=1' 00:23:37.093 test: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=spdk, iodepth=128 00:23:37.093 fio-3.35 00:23:37.093 Starting 1 thread 00:23:37.093 EAL: No free 2048 kB hugepages reported on node 1 00:23:39.670 00:23:39.670 test: (groupid=0, jobs=1): err= 0: pid=362711: Tue Apr 16 23:01:30 2024 00:23:39.670 read: IOPS=8894, BW=139MiB/s (146MB/s)(279MiB/2004msec) 00:23:39.670 slat (usec): min=2, max=102, avg= 3.70, stdev= 1.88 00:23:39.670 clat (usec): min=413, max=16800, avg=8561.06, stdev=2094.73 00:23:39.670 lat (usec): min=424, max=16803, avg=8564.76, stdev=2094.82 00:23:39.670 clat percentiles (usec): 00:23:39.670 | 1.00th=[ 4424], 5.00th=[ 5342], 10.00th=[ 5932], 20.00th=[ 6783], 00:23:39.670 | 30.00th=[ 7308], 40.00th=[ 7963], 50.00th=[ 8455], 60.00th=[ 9110], 00:23:39.670 | 70.00th=[ 9503], 80.00th=[10159], 90.00th=[11207], 95.00th=[12125], 00:23:39.670 | 99.00th=[14353], 99.50th=[15533], 99.90th=[16450], 99.95th=[16581], 00:23:39.670 | 99.99th=[16712] 00:23:39.670 bw ( KiB/s): min=64320, max=78656, per=49.14%, avg=69928.00, stdev=6123.60, samples=4 00:23:39.670 iops : min= 4020, max= 4916, avg=4370.50, stdev=382.72, samples=4 00:23:39.670 write: IOPS=5026, BW=78.5MiB/s (82.4MB/s)(142MiB/1807msec); 0 zone resets 00:23:39.670 slat (usec): min=30, max=219, avg=34.38, stdev= 6.65 00:23:39.670 clat (usec): min=2152, max=16566, avg=10372.85, stdev=1899.82 00:23:39.670 lat (usec): min=2183, max=16597, avg=10407.23, stdev=1900.65 00:23:39.670 clat percentiles (usec): 00:23:39.670 | 1.00th=[ 6718], 5.00th=[ 7767], 10.00th=[ 8291], 20.00th=[ 8848], 00:23:39.670 | 30.00th=[ 9241], 40.00th=[ 9634], 50.00th=[10028], 60.00th=[10552], 00:23:39.670 | 70.00th=[11076], 80.00th=[11994], 90.00th=[13173], 95.00th=[13960], 00:23:39.670 | 99.00th=[15533], 99.50th=[15926], 99.90th=[16450], 99.95th=[16450], 00:23:39.670 | 99.99th=[16581] 00:23:39.670 bw ( KiB/s): min=67936, max=80928, per=90.35%, avg=72664.00, stdev=5685.83, samples=4 00:23:39.670 iops : min= 4246, max= 5058, avg=4541.50, stdev=355.36, samples=4 00:23:39.670 lat (usec) : 500=0.01% 00:23:39.670 lat (msec) : 2=0.03%, 4=0.35%, 10=68.28%, 20=31.34% 00:23:39.670 cpu : usr=76.64%, sys=20.67%, ctx=36, majf=0, minf=2 00:23:39.670 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.2%, 16=0.4%, 32=0.7%, >=64=98.6% 00:23:39.670 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:23:39.671 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:23:39.671 issued rwts: total=17825,9083,0,0 short=0,0,0,0 dropped=0,0,0,0 00:23:39.671 latency : target=0, window=0, percentile=100.00%, depth=128 00:23:39.671 00:23:39.671 Run status group 0 (all jobs): 00:23:39.671 READ: bw=139MiB/s (146MB/s), 139MiB/s-139MiB/s (146MB/s-146MB/s), io=279MiB (292MB), run=2004-2004msec 00:23:39.671 WRITE: bw=78.5MiB/s (82.4MB/s), 78.5MiB/s-78.5MiB/s (82.4MB/s-82.4MB/s), io=142MiB (149MB), run=1807-1807msec 00:23:39.671 23:01:30 -- host/fio.sh@45 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:23:39.671 23:01:30 -- common/autotest_common.sh@551 -- # xtrace_disable 00:23:39.671 23:01:30 -- common/autotest_common.sh@10 -- # set +x 00:23:39.671 23:01:30 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:23:39.671 23:01:30 -- host/fio.sh@47 -- # '[' 1 -eq 1 ']' 00:23:39.671 23:01:30 -- host/fio.sh@49 -- # bdfs=($(get_nvme_bdfs)) 00:23:39.671 23:01:30 -- host/fio.sh@49 -- # get_nvme_bdfs 00:23:39.671 23:01:30 -- common/autotest_common.sh@1498 -- # bdfs=() 00:23:39.671 23:01:30 -- common/autotest_common.sh@1498 -- # local bdfs 00:23:39.671 23:01:30 -- common/autotest_common.sh@1499 -- # bdfs=($("$rootdir/scripts/gen_nvme.sh" | jq -r '.config[].params.traddr')) 00:23:39.671 23:01:30 -- common/autotest_common.sh@1499 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/gen_nvme.sh 00:23:39.671 23:01:30 -- common/autotest_common.sh@1499 -- # jq -r '.config[].params.traddr' 00:23:39.671 23:01:30 -- common/autotest_common.sh@1500 -- # (( 1 == 0 )) 00:23:39.671 23:01:30 -- common/autotest_common.sh@1504 -- # printf '%s\n' 0000:88:00.0 00:23:39.671 23:01:30 -- host/fio.sh@50 -- # rpc_cmd bdev_nvme_attach_controller -b Nvme0 -t PCIe -a 0000:88:00.0 -i 10.0.0.2 00:23:39.671 23:01:30 -- common/autotest_common.sh@551 -- # xtrace_disable 00:23:39.671 23:01:30 -- common/autotest_common.sh@10 -- # set +x 00:23:42.203 Nvme0n1 00:23:42.203 23:01:33 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:23:42.203 23:01:33 -- host/fio.sh@51 -- # rpc_cmd bdev_lvol_create_lvstore -c 1073741824 Nvme0n1 lvs_0 00:23:42.203 23:01:33 -- common/autotest_common.sh@551 -- # xtrace_disable 00:23:42.203 23:01:33 -- common/autotest_common.sh@10 -- # set +x 00:23:44.738 23:01:35 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:23:44.738 23:01:35 -- host/fio.sh@51 -- # ls_guid=c71fadb5-d349-4418-a0aa-eeaece71db30 00:23:44.738 23:01:35 -- host/fio.sh@52 -- # get_lvs_free_mb c71fadb5-d349-4418-a0aa-eeaece71db30 00:23:44.738 23:01:35 -- common/autotest_common.sh@1343 -- # local lvs_uuid=c71fadb5-d349-4418-a0aa-eeaece71db30 00:23:44.738 23:01:35 -- common/autotest_common.sh@1344 -- # local lvs_info 00:23:44.738 23:01:35 -- common/autotest_common.sh@1345 -- # local fc 00:23:44.738 23:01:35 -- common/autotest_common.sh@1346 -- # local cs 00:23:44.738 23:01:35 -- common/autotest_common.sh@1347 -- # rpc_cmd bdev_lvol_get_lvstores 00:23:44.738 23:01:35 -- common/autotest_common.sh@551 -- # xtrace_disable 00:23:44.738 23:01:35 -- common/autotest_common.sh@10 -- # set +x 00:23:44.738 23:01:35 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:23:44.738 23:01:35 -- common/autotest_common.sh@1347 -- # lvs_info='[ 00:23:44.738 { 00:23:44.738 "uuid": "c71fadb5-d349-4418-a0aa-eeaece71db30", 00:23:44.738 "name": "lvs_0", 00:23:44.738 "base_bdev": "Nvme0n1", 00:23:44.738 "total_data_clusters": 930, 00:23:44.738 "free_clusters": 930, 00:23:44.738 "block_size": 512, 00:23:44.738 "cluster_size": 1073741824 00:23:44.738 } 00:23:44.738 ]' 00:23:44.738 23:01:35 -- common/autotest_common.sh@1348 -- # jq '.[] | select(.uuid=="c71fadb5-d349-4418-a0aa-eeaece71db30") .free_clusters' 00:23:44.995 23:01:35 -- common/autotest_common.sh@1348 -- # fc=930 00:23:44.995 23:01:35 -- common/autotest_common.sh@1349 -- # jq '.[] | select(.uuid=="c71fadb5-d349-4418-a0aa-eeaece71db30") .cluster_size' 00:23:44.995 23:01:35 -- common/autotest_common.sh@1349 -- # cs=1073741824 00:23:44.995 23:01:35 -- common/autotest_common.sh@1352 -- # free_mb=952320 00:23:44.995 23:01:35 -- common/autotest_common.sh@1353 -- # echo 952320 00:23:44.995 952320 00:23:44.995 23:01:35 -- host/fio.sh@53 -- # rpc_cmd bdev_lvol_create -l lvs_0 lbd_0 952320 00:23:44.995 23:01:35 -- common/autotest_common.sh@551 -- # xtrace_disable 00:23:44.995 23:01:35 -- common/autotest_common.sh@10 -- # set +x 00:23:44.995 5384fcb4-b2cf-44d1-a273-593785c90b43 00:23:44.995 23:01:36 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:23:44.995 23:01:36 -- host/fio.sh@54 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode2 -a -s SPDK00000000000001 00:23:44.995 23:01:36 -- common/autotest_common.sh@551 -- # xtrace_disable 00:23:44.995 23:01:36 -- common/autotest_common.sh@10 -- # set +x 00:23:44.995 23:01:36 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:23:44.995 23:01:36 -- host/fio.sh@55 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode2 lvs_0/lbd_0 00:23:44.995 23:01:36 -- common/autotest_common.sh@551 -- # xtrace_disable 00:23:44.995 23:01:36 -- common/autotest_common.sh@10 -- # set +x 00:23:44.995 23:01:36 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:23:44.996 23:01:36 -- host/fio.sh@56 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode2 -t tcp -a 10.0.0.2 -s 4420 00:23:44.996 23:01:36 -- common/autotest_common.sh@551 -- # xtrace_disable 00:23:44.996 23:01:36 -- common/autotest_common.sh@10 -- # set +x 00:23:44.996 23:01:36 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:23:44.996 23:01:36 -- host/fio.sh@57 -- # fio_nvme /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/app/fio/nvme/example_config.fio '--filename=trtype=tcp adrfam=IPv4 traddr=10.0.0.2 trsvcid=4420 ns=1' --bs=4096 00:23:45.254 23:01:36 -- common/autotest_common.sh@1339 -- # fio_plugin /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/app/fio/nvme/example_config.fio '--filename=trtype=tcp adrfam=IPv4 traddr=10.0.0.2 trsvcid=4420 ns=1' --bs=4096 00:23:45.254 23:01:36 -- common/autotest_common.sh@1316 -- # local fio_dir=/usr/src/fio 00:23:45.254 23:01:36 -- common/autotest_common.sh@1318 -- # sanitizers=('libasan' 'libclang_rt.asan') 00:23:45.254 23:01:36 -- common/autotest_common.sh@1318 -- # local sanitizers 00:23:45.255 23:01:36 -- common/autotest_common.sh@1319 -- # local plugin=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme 00:23:45.255 23:01:36 -- common/autotest_common.sh@1320 -- # shift 00:23:45.255 23:01:36 -- common/autotest_common.sh@1322 -- # local asan_lib= 00:23:45.255 23:01:36 -- common/autotest_common.sh@1323 -- # for sanitizer in "${sanitizers[@]}" 00:23:45.255 23:01:36 -- common/autotest_common.sh@1324 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme 00:23:45.255 23:01:36 -- common/autotest_common.sh@1324 -- # grep libasan 00:23:45.255 23:01:36 -- common/autotest_common.sh@1324 -- # awk '{print $3}' 00:23:45.255 23:01:36 -- common/autotest_common.sh@1324 -- # asan_lib= 00:23:45.255 23:01:36 -- common/autotest_common.sh@1325 -- # [[ -n '' ]] 00:23:45.255 23:01:36 -- common/autotest_common.sh@1323 -- # for sanitizer in "${sanitizers[@]}" 00:23:45.255 23:01:36 -- common/autotest_common.sh@1324 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme 00:23:45.255 23:01:36 -- common/autotest_common.sh@1324 -- # grep libclang_rt.asan 00:23:45.255 23:01:36 -- common/autotest_common.sh@1324 -- # awk '{print $3}' 00:23:45.255 23:01:36 -- common/autotest_common.sh@1324 -- # asan_lib= 00:23:45.255 23:01:36 -- common/autotest_common.sh@1325 -- # [[ -n '' ]] 00:23:45.255 23:01:36 -- common/autotest_common.sh@1331 -- # LD_PRELOAD=' /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme' 00:23:45.255 23:01:36 -- common/autotest_common.sh@1331 -- # /usr/src/fio/fio /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/app/fio/nvme/example_config.fio '--filename=trtype=tcp adrfam=IPv4 traddr=10.0.0.2 trsvcid=4420 ns=1' --bs=4096 00:23:45.255 test: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=spdk, iodepth=128 00:23:45.255 fio-3.35 00:23:45.255 Starting 1 thread 00:23:45.255 EAL: No free 2048 kB hugepages reported on node 1 00:23:47.789 00:23:47.789 test: (groupid=0, jobs=1): err= 0: pid=363873: Tue Apr 16 23:01:38 2024 00:23:47.789 read: IOPS=6251, BW=24.4MiB/s (25.6MB/s)(49.0MiB/2007msec) 00:23:47.789 slat (nsec): min=1921, max=185927, avg=2601.97, stdev=2620.18 00:23:47.789 clat (usec): min=886, max=171303, avg=11277.43, stdev=11441.19 00:23:47.789 lat (usec): min=889, max=171342, avg=11280.03, stdev=11441.59 00:23:47.789 clat percentiles (msec): 00:23:47.789 | 1.00th=[ 9], 5.00th=[ 10], 10.00th=[ 10], 20.00th=[ 10], 00:23:47.789 | 30.00th=[ 11], 40.00th=[ 11], 50.00th=[ 11], 60.00th=[ 11], 00:23:47.789 | 70.00th=[ 11], 80.00th=[ 12], 90.00th=[ 12], 95.00th=[ 12], 00:23:47.789 | 99.00th=[ 13], 99.50th=[ 157], 99.90th=[ 171], 99.95th=[ 171], 00:23:47.789 | 99.99th=[ 171] 00:23:47.789 bw ( KiB/s): min=17504, max=27584, per=99.77%, avg=24946.00, stdev=4963.25, samples=4 00:23:47.789 iops : min= 4376, max= 6896, avg=6236.50, stdev=1240.81, samples=4 00:23:47.789 write: IOPS=6243, BW=24.4MiB/s (25.6MB/s)(48.9MiB/2007msec); 0 zone resets 00:23:47.789 slat (usec): min=2, max=130, avg= 2.69, stdev= 1.80 00:23:47.789 clat (usec): min=314, max=169036, avg=9023.51, stdev=10725.33 00:23:47.789 lat (usec): min=317, max=169044, avg=9026.20, stdev=10725.70 00:23:47.789 clat percentiles (msec): 00:23:47.789 | 1.00th=[ 7], 5.00th=[ 8], 10.00th=[ 8], 20.00th=[ 8], 00:23:47.789 | 30.00th=[ 8], 40.00th=[ 9], 50.00th=[ 9], 60.00th=[ 9], 00:23:47.789 | 70.00th=[ 9], 80.00th=[ 9], 90.00th=[ 10], 95.00th=[ 10], 00:23:47.789 | 99.00th=[ 11], 99.50th=[ 16], 99.90th=[ 169], 99.95th=[ 169], 00:23:47.789 | 99.99th=[ 169] 00:23:47.789 bw ( KiB/s): min=18440, max=27328, per=99.92%, avg=24954.00, stdev=4345.99, samples=4 00:23:47.789 iops : min= 4610, max= 6832, avg=6238.50, stdev=1086.50, samples=4 00:23:47.789 lat (usec) : 500=0.01%, 750=0.01%, 1000=0.01% 00:23:47.789 lat (msec) : 2=0.03%, 4=0.18%, 10=63.40%, 20=35.87%, 250=0.51% 00:23:47.789 cpu : usr=56.73%, sys=39.78%, ctx=101, majf=0, minf=6 00:23:47.789 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.1%, 32=0.1%, >=64=99.7% 00:23:47.789 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:23:47.789 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:23:47.789 issued rwts: total=12546,12531,0,0 short=0,0,0,0 dropped=0,0,0,0 00:23:47.789 latency : target=0, window=0, percentile=100.00%, depth=128 00:23:47.789 00:23:47.789 Run status group 0 (all jobs): 00:23:47.789 READ: bw=24.4MiB/s (25.6MB/s), 24.4MiB/s-24.4MiB/s (25.6MB/s-25.6MB/s), io=49.0MiB (51.4MB), run=2007-2007msec 00:23:47.789 WRITE: bw=24.4MiB/s (25.6MB/s), 24.4MiB/s-24.4MiB/s (25.6MB/s-25.6MB/s), io=48.9MiB (51.3MB), run=2007-2007msec 00:23:47.789 23:01:38 -- host/fio.sh@59 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode2 00:23:47.789 23:01:38 -- common/autotest_common.sh@551 -- # xtrace_disable 00:23:47.789 23:01:38 -- common/autotest_common.sh@10 -- # set +x 00:23:47.789 23:01:38 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:23:47.789 23:01:38 -- host/fio.sh@62 -- # rpc_cmd bdev_lvol_create_lvstore --clear-method none lvs_0/lbd_0 lvs_n_0 00:23:47.789 23:01:38 -- common/autotest_common.sh@551 -- # xtrace_disable 00:23:47.789 23:01:38 -- common/autotest_common.sh@10 -- # set +x 00:23:48.725 23:01:39 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:23:48.725 23:01:39 -- host/fio.sh@62 -- # ls_nested_guid=f690a5fe-3202-4676-a71d-132cd74da8ee 00:23:48.725 23:01:39 -- host/fio.sh@63 -- # get_lvs_free_mb f690a5fe-3202-4676-a71d-132cd74da8ee 00:23:48.725 23:01:39 -- common/autotest_common.sh@1343 -- # local lvs_uuid=f690a5fe-3202-4676-a71d-132cd74da8ee 00:23:48.725 23:01:39 -- common/autotest_common.sh@1344 -- # local lvs_info 00:23:48.725 23:01:39 -- common/autotest_common.sh@1345 -- # local fc 00:23:48.725 23:01:39 -- common/autotest_common.sh@1346 -- # local cs 00:23:48.725 23:01:39 -- common/autotest_common.sh@1347 -- # rpc_cmd bdev_lvol_get_lvstores 00:23:48.725 23:01:39 -- common/autotest_common.sh@551 -- # xtrace_disable 00:23:48.726 23:01:39 -- common/autotest_common.sh@10 -- # set +x 00:23:48.726 23:01:39 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:23:48.726 23:01:39 -- common/autotest_common.sh@1347 -- # lvs_info='[ 00:23:48.726 { 00:23:48.726 "uuid": "c71fadb5-d349-4418-a0aa-eeaece71db30", 00:23:48.726 "name": "lvs_0", 00:23:48.726 "base_bdev": "Nvme0n1", 00:23:48.726 "total_data_clusters": 930, 00:23:48.726 "free_clusters": 0, 00:23:48.726 "block_size": 512, 00:23:48.726 "cluster_size": 1073741824 00:23:48.726 }, 00:23:48.726 { 00:23:48.726 "uuid": "f690a5fe-3202-4676-a71d-132cd74da8ee", 00:23:48.726 "name": "lvs_n_0", 00:23:48.726 "base_bdev": "5384fcb4-b2cf-44d1-a273-593785c90b43", 00:23:48.726 "total_data_clusters": 237847, 00:23:48.726 "free_clusters": 237847, 00:23:48.726 "block_size": 512, 00:23:48.726 "cluster_size": 4194304 00:23:48.726 } 00:23:48.726 ]' 00:23:48.726 23:01:39 -- common/autotest_common.sh@1348 -- # jq '.[] | select(.uuid=="f690a5fe-3202-4676-a71d-132cd74da8ee") .free_clusters' 00:23:48.726 23:01:39 -- common/autotest_common.sh@1348 -- # fc=237847 00:23:48.726 23:01:39 -- common/autotest_common.sh@1349 -- # jq '.[] | select(.uuid=="f690a5fe-3202-4676-a71d-132cd74da8ee") .cluster_size' 00:23:48.726 23:01:39 -- common/autotest_common.sh@1349 -- # cs=4194304 00:23:48.726 23:01:39 -- common/autotest_common.sh@1352 -- # free_mb=951388 00:23:48.726 23:01:39 -- common/autotest_common.sh@1353 -- # echo 951388 00:23:48.726 951388 00:23:48.726 23:01:39 -- host/fio.sh@64 -- # rpc_cmd bdev_lvol_create -l lvs_n_0 lbd_nest_0 951388 00:23:48.726 23:01:39 -- common/autotest_common.sh@551 -- # xtrace_disable 00:23:48.726 23:01:39 -- common/autotest_common.sh@10 -- # set +x 00:23:49.294 7a13b59a-3638-4ef2-a217-507997bbe543 00:23:49.294 23:01:40 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:23:49.294 23:01:40 -- host/fio.sh@65 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode3 -a -s SPDK00000000000001 00:23:49.294 23:01:40 -- common/autotest_common.sh@551 -- # xtrace_disable 00:23:49.294 23:01:40 -- common/autotest_common.sh@10 -- # set +x 00:23:49.294 23:01:40 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:23:49.294 23:01:40 -- host/fio.sh@66 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode3 lvs_n_0/lbd_nest_0 00:23:49.294 23:01:40 -- common/autotest_common.sh@551 -- # xtrace_disable 00:23:49.294 23:01:40 -- common/autotest_common.sh@10 -- # set +x 00:23:49.294 23:01:40 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:23:49.294 23:01:40 -- host/fio.sh@67 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode3 -t tcp -a 10.0.0.2 -s 4420 00:23:49.294 23:01:40 -- common/autotest_common.sh@551 -- # xtrace_disable 00:23:49.294 23:01:40 -- common/autotest_common.sh@10 -- # set +x 00:23:49.294 23:01:40 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:23:49.295 23:01:40 -- host/fio.sh@68 -- # fio_nvme /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/app/fio/nvme/example_config.fio '--filename=trtype=tcp adrfam=IPv4 traddr=10.0.0.2 trsvcid=4420 ns=1' --bs=4096 00:23:49.295 23:01:40 -- common/autotest_common.sh@1339 -- # fio_plugin /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/app/fio/nvme/example_config.fio '--filename=trtype=tcp adrfam=IPv4 traddr=10.0.0.2 trsvcid=4420 ns=1' --bs=4096 00:23:49.295 23:01:40 -- common/autotest_common.sh@1316 -- # local fio_dir=/usr/src/fio 00:23:49.295 23:01:40 -- common/autotest_common.sh@1318 -- # sanitizers=('libasan' 'libclang_rt.asan') 00:23:49.295 23:01:40 -- common/autotest_common.sh@1318 -- # local sanitizers 00:23:49.295 23:01:40 -- common/autotest_common.sh@1319 -- # local plugin=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme 00:23:49.295 23:01:40 -- common/autotest_common.sh@1320 -- # shift 00:23:49.295 23:01:40 -- common/autotest_common.sh@1322 -- # local asan_lib= 00:23:49.295 23:01:40 -- common/autotest_common.sh@1323 -- # for sanitizer in "${sanitizers[@]}" 00:23:49.295 23:01:40 -- common/autotest_common.sh@1324 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme 00:23:49.295 23:01:40 -- common/autotest_common.sh@1324 -- # grep libasan 00:23:49.295 23:01:40 -- common/autotest_common.sh@1324 -- # awk '{print $3}' 00:23:49.295 23:01:40 -- common/autotest_common.sh@1324 -- # asan_lib= 00:23:49.295 23:01:40 -- common/autotest_common.sh@1325 -- # [[ -n '' ]] 00:23:49.295 23:01:40 -- common/autotest_common.sh@1323 -- # for sanitizer in "${sanitizers[@]}" 00:23:49.295 23:01:40 -- common/autotest_common.sh@1324 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme 00:23:49.295 23:01:40 -- common/autotest_common.sh@1324 -- # grep libclang_rt.asan 00:23:49.295 23:01:40 -- common/autotest_common.sh@1324 -- # awk '{print $3}' 00:23:49.295 23:01:40 -- common/autotest_common.sh@1324 -- # asan_lib= 00:23:49.295 23:01:40 -- common/autotest_common.sh@1325 -- # [[ -n '' ]] 00:23:49.295 23:01:40 -- common/autotest_common.sh@1331 -- # LD_PRELOAD=' /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme' 00:23:49.295 23:01:40 -- common/autotest_common.sh@1331 -- # /usr/src/fio/fio /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/app/fio/nvme/example_config.fio '--filename=trtype=tcp adrfam=IPv4 traddr=10.0.0.2 trsvcid=4420 ns=1' --bs=4096 00:23:49.552 test: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=spdk, iodepth=128 00:23:49.552 fio-3.35 00:23:49.552 Starting 1 thread 00:23:49.552 EAL: No free 2048 kB hugepages reported on node 1 00:23:52.078 00:23:52.078 test: (groupid=0, jobs=1): err= 0: pid=364388: Tue Apr 16 23:01:42 2024 00:23:52.078 read: IOPS=6104, BW=23.8MiB/s (25.0MB/s)(47.9MiB/2008msec) 00:23:52.078 slat (usec): min=2, max=129, avg= 2.56, stdev= 2.02 00:23:52.078 clat (usec): min=4386, max=18294, avg=11605.97, stdev=939.23 00:23:52.078 lat (usec): min=4414, max=18296, avg=11608.54, stdev=939.16 00:23:52.078 clat percentiles (usec): 00:23:52.078 | 1.00th=[ 9503], 5.00th=[10159], 10.00th=[10421], 20.00th=[10814], 00:23:52.078 | 30.00th=[11207], 40.00th=[11338], 50.00th=[11600], 60.00th=[11863], 00:23:52.078 | 70.00th=[12125], 80.00th=[12387], 90.00th=[12780], 95.00th=[13042], 00:23:52.078 | 99.00th=[13698], 99.50th=[13960], 99.90th=[16581], 99.95th=[16909], 00:23:52.078 | 99.99th=[18220] 00:23:52.078 bw ( KiB/s): min=23200, max=24792, per=99.81%, avg=24372.00, stdev=781.94, samples=4 00:23:52.078 iops : min= 5800, max= 6198, avg=6093.00, stdev=195.49, samples=4 00:23:52.078 write: IOPS=6081, BW=23.8MiB/s (24.9MB/s)(47.7MiB/2008msec); 0 zone resets 00:23:52.078 slat (usec): min=2, max=104, avg= 2.66, stdev= 1.62 00:23:52.078 clat (usec): min=2105, max=16803, avg=9240.09, stdev=839.94 00:23:52.078 lat (usec): min=2111, max=16806, avg=9242.74, stdev=839.92 00:23:52.078 clat percentiles (usec): 00:23:52.078 | 1.00th=[ 7308], 5.00th=[ 7963], 10.00th=[ 8291], 20.00th=[ 8586], 00:23:52.078 | 30.00th=[ 8848], 40.00th=[ 9110], 50.00th=[ 9241], 60.00th=[ 9372], 00:23:52.078 | 70.00th=[ 9634], 80.00th=[ 9896], 90.00th=[10290], 95.00th=[10552], 00:23:52.078 | 99.00th=[11076], 99.50th=[11338], 99.90th=[13566], 99.95th=[15401], 00:23:52.078 | 99.99th=[16712] 00:23:52.078 bw ( KiB/s): min=24216, max=24448, per=99.95%, avg=24312.00, stdev=100.13, samples=4 00:23:52.078 iops : min= 6054, max= 6112, avg=6078.00, stdev=25.03, samples=4 00:23:52.078 lat (msec) : 4=0.04%, 10=43.52%, 20=56.43% 00:23:52.078 cpu : usr=53.36%, sys=43.30%, ctx=92, majf=0, minf=6 00:23:52.078 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.1%, 32=0.1%, >=64=99.7% 00:23:52.078 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:23:52.078 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:23:52.078 issued rwts: total=12258,12211,0,0 short=0,0,0,0 dropped=0,0,0,0 00:23:52.078 latency : target=0, window=0, percentile=100.00%, depth=128 00:23:52.078 00:23:52.078 Run status group 0 (all jobs): 00:23:52.078 READ: bw=23.8MiB/s (25.0MB/s), 23.8MiB/s-23.8MiB/s (25.0MB/s-25.0MB/s), io=47.9MiB (50.2MB), run=2008-2008msec 00:23:52.078 WRITE: bw=23.8MiB/s (24.9MB/s), 23.8MiB/s-23.8MiB/s (24.9MB/s-24.9MB/s), io=47.7MiB (50.0MB), run=2008-2008msec 00:23:52.078 23:01:42 -- host/fio.sh@70 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode3 00:23:52.078 23:01:42 -- common/autotest_common.sh@551 -- # xtrace_disable 00:23:52.078 23:01:42 -- common/autotest_common.sh@10 -- # set +x 00:23:52.078 23:01:42 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:23:52.078 23:01:42 -- host/fio.sh@72 -- # sync 00:23:52.078 23:01:42 -- host/fio.sh@74 -- # rpc_cmd bdev_lvol_delete lvs_n_0/lbd_nest_0 00:23:52.078 23:01:42 -- common/autotest_common.sh@551 -- # xtrace_disable 00:23:52.078 23:01:42 -- common/autotest_common.sh@10 -- # set +x 00:23:55.359 23:01:46 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:23:55.359 23:01:46 -- host/fio.sh@75 -- # rpc_cmd bdev_lvol_delete_lvstore -l lvs_n_0 00:23:55.359 23:01:46 -- common/autotest_common.sh@551 -- # xtrace_disable 00:23:55.359 23:01:46 -- common/autotest_common.sh@10 -- # set +x 00:23:55.359 23:01:46 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:23:55.359 23:01:46 -- host/fio.sh@76 -- # rpc_cmd bdev_lvol_delete lvs_0/lbd_0 00:23:55.359 23:01:46 -- common/autotest_common.sh@551 -- # xtrace_disable 00:23:55.359 23:01:46 -- common/autotest_common.sh@10 -- # set +x 00:23:58.644 23:01:49 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:23:58.644 23:01:49 -- host/fio.sh@77 -- # rpc_cmd bdev_lvol_delete_lvstore -l lvs_0 00:23:58.644 23:01:49 -- common/autotest_common.sh@551 -- # xtrace_disable 00:23:58.644 23:01:49 -- common/autotest_common.sh@10 -- # set +x 00:23:58.644 23:01:49 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:23:58.644 23:01:49 -- host/fio.sh@78 -- # rpc_cmd bdev_nvme_detach_controller Nvme0 00:23:58.644 23:01:49 -- common/autotest_common.sh@551 -- # xtrace_disable 00:23:58.644 23:01:49 -- common/autotest_common.sh@10 -- # set +x 00:24:00.024 23:01:50 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:24:00.024 23:01:50 -- host/fio.sh@81 -- # trap - SIGINT SIGTERM EXIT 00:24:00.024 23:01:50 -- host/fio.sh@83 -- # rm -f ./local-test-0-verify.state 00:24:00.024 23:01:50 -- host/fio.sh@84 -- # nvmftestfini 00:24:00.024 23:01:50 -- nvmf/common.sh@476 -- # nvmfcleanup 00:24:00.024 23:01:50 -- nvmf/common.sh@116 -- # sync 00:24:00.024 23:01:50 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:24:00.024 23:01:50 -- nvmf/common.sh@119 -- # set +e 00:24:00.024 23:01:50 -- nvmf/common.sh@120 -- # for i in {1..20} 00:24:00.024 23:01:50 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:24:00.025 rmmod nvme_tcp 00:24:00.025 rmmod nvme_fabrics 00:24:00.025 rmmod nvme_keyring 00:24:00.025 23:01:50 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:24:00.025 23:01:50 -- nvmf/common.sh@123 -- # set -e 00:24:00.025 23:01:50 -- nvmf/common.sh@124 -- # return 0 00:24:00.025 23:01:50 -- nvmf/common.sh@477 -- # '[' -n 362133 ']' 00:24:00.025 23:01:50 -- nvmf/common.sh@478 -- # killprocess 362133 00:24:00.025 23:01:50 -- common/autotest_common.sh@926 -- # '[' -z 362133 ']' 00:24:00.025 23:01:50 -- common/autotest_common.sh@930 -- # kill -0 362133 00:24:00.025 23:01:50 -- common/autotest_common.sh@931 -- # uname 00:24:00.025 23:01:50 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:24:00.025 23:01:50 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 362133 00:24:00.025 23:01:50 -- common/autotest_common.sh@932 -- # process_name=reactor_0 00:24:00.025 23:01:50 -- common/autotest_common.sh@936 -- # '[' reactor_0 = sudo ']' 00:24:00.025 23:01:50 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 362133' 00:24:00.025 killing process with pid 362133 00:24:00.025 23:01:50 -- common/autotest_common.sh@945 -- # kill 362133 00:24:00.025 23:01:50 -- common/autotest_common.sh@950 -- # wait 362133 00:24:00.025 23:01:51 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:24:00.025 23:01:51 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:24:00.025 23:01:51 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:24:00.025 23:01:51 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:24:00.025 23:01:51 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:24:00.025 23:01:51 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:24:00.025 23:01:51 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:24:00.025 23:01:51 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:24:02.595 23:01:53 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:24:02.595 00:24:02.595 real 0m31.126s 00:24:02.595 user 1m53.223s 00:24:02.595 sys 0m6.053s 00:24:02.595 23:01:53 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:24:02.595 23:01:53 -- common/autotest_common.sh@10 -- # set +x 00:24:02.595 ************************************ 00:24:02.595 END TEST nvmf_fio_host 00:24:02.595 ************************************ 00:24:02.595 23:01:53 -- nvmf/nvmf.sh@99 -- # run_test nvmf_failover /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/failover.sh --transport=tcp 00:24:02.595 23:01:53 -- common/autotest_common.sh@1077 -- # '[' 3 -le 1 ']' 00:24:02.595 23:01:53 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:24:02.595 23:01:53 -- common/autotest_common.sh@10 -- # set +x 00:24:02.595 ************************************ 00:24:02.595 START TEST nvmf_failover 00:24:02.595 ************************************ 00:24:02.595 23:01:53 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/failover.sh --transport=tcp 00:24:02.595 * Looking for test storage... 00:24:02.595 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host 00:24:02.595 23:01:53 -- host/failover.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:24:02.595 23:01:53 -- nvmf/common.sh@7 -- # uname -s 00:24:02.595 23:01:53 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:24:02.595 23:01:53 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:24:02.595 23:01:53 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:24:02.595 23:01:53 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:24:02.595 23:01:53 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:24:02.595 23:01:53 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:24:02.595 23:01:53 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:24:02.595 23:01:53 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:24:02.595 23:01:53 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:24:02.595 23:01:53 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:24:02.595 23:01:53 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:24:02.595 23:01:53 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:24:02.595 23:01:53 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:24:02.595 23:01:53 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:24:02.595 23:01:53 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:24:02.595 23:01:53 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:24:02.595 23:01:53 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:24:02.595 23:01:53 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:24:02.595 23:01:53 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:24:02.595 23:01:53 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:24:02.595 23:01:53 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:24:02.595 23:01:53 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:24:02.595 23:01:53 -- paths/export.sh@5 -- # export PATH 00:24:02.595 23:01:53 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:24:02.595 23:01:53 -- nvmf/common.sh@46 -- # : 0 00:24:02.595 23:01:53 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:24:02.595 23:01:53 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:24:02.595 23:01:53 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:24:02.595 23:01:53 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:24:02.595 23:01:53 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:24:02.595 23:01:53 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:24:02.595 23:01:53 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:24:02.595 23:01:53 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:24:02.595 23:01:53 -- host/failover.sh@11 -- # MALLOC_BDEV_SIZE=64 00:24:02.595 23:01:53 -- host/failover.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:24:02.595 23:01:53 -- host/failover.sh@14 -- # rpc_py=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:24:02.595 23:01:53 -- host/failover.sh@16 -- # bdevperf_rpc_sock=/var/tmp/bdevperf.sock 00:24:02.595 23:01:53 -- host/failover.sh@18 -- # nvmftestinit 00:24:02.595 23:01:53 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:24:02.595 23:01:53 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:24:02.595 23:01:53 -- nvmf/common.sh@436 -- # prepare_net_devs 00:24:02.595 23:01:53 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:24:02.595 23:01:53 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:24:02.595 23:01:53 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:24:02.595 23:01:53 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:24:02.595 23:01:53 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:24:02.595 23:01:53 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:24:02.595 23:01:53 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:24:02.595 23:01:53 -- nvmf/common.sh@284 -- # xtrace_disable 00:24:02.595 23:01:53 -- common/autotest_common.sh@10 -- # set +x 00:24:04.500 23:01:55 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:24:04.500 23:01:55 -- nvmf/common.sh@290 -- # pci_devs=() 00:24:04.500 23:01:55 -- nvmf/common.sh@290 -- # local -a pci_devs 00:24:04.500 23:01:55 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:24:04.500 23:01:55 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:24:04.500 23:01:55 -- nvmf/common.sh@292 -- # pci_drivers=() 00:24:04.500 23:01:55 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:24:04.500 23:01:55 -- nvmf/common.sh@294 -- # net_devs=() 00:24:04.500 23:01:55 -- nvmf/common.sh@294 -- # local -ga net_devs 00:24:04.500 23:01:55 -- nvmf/common.sh@295 -- # e810=() 00:24:04.500 23:01:55 -- nvmf/common.sh@295 -- # local -ga e810 00:24:04.500 23:01:55 -- nvmf/common.sh@296 -- # x722=() 00:24:04.500 23:01:55 -- nvmf/common.sh@296 -- # local -ga x722 00:24:04.500 23:01:55 -- nvmf/common.sh@297 -- # mlx=() 00:24:04.500 23:01:55 -- nvmf/common.sh@297 -- # local -ga mlx 00:24:04.500 23:01:55 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:24:04.500 23:01:55 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:24:04.500 23:01:55 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:24:04.500 23:01:55 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:24:04.500 23:01:55 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:24:04.500 23:01:55 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:24:04.500 23:01:55 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:24:04.500 23:01:55 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:24:04.500 23:01:55 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:24:04.500 23:01:55 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:24:04.500 23:01:55 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:24:04.500 23:01:55 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:24:04.500 23:01:55 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:24:04.500 23:01:55 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:24:04.500 23:01:55 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:24:04.500 23:01:55 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:24:04.500 23:01:55 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:24:04.500 23:01:55 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:24:04.500 23:01:55 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:24:04.500 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:24:04.500 23:01:55 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:24:04.500 23:01:55 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:24:04.500 23:01:55 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:24:04.500 23:01:55 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:24:04.500 23:01:55 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:24:04.500 23:01:55 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:24:04.500 23:01:55 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:24:04.500 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:24:04.500 23:01:55 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:24:04.500 23:01:55 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:24:04.500 23:01:55 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:24:04.500 23:01:55 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:24:04.500 23:01:55 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:24:04.500 23:01:55 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:24:04.500 23:01:55 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:24:04.500 23:01:55 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:24:04.500 23:01:55 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:24:04.500 23:01:55 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:24:04.500 23:01:55 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:24:04.500 23:01:55 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:24:04.500 23:01:55 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:24:04.500 Found net devices under 0000:0a:00.0: cvl_0_0 00:24:04.500 23:01:55 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:24:04.500 23:01:55 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:24:04.500 23:01:55 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:24:04.500 23:01:55 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:24:04.500 23:01:55 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:24:04.500 23:01:55 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:24:04.500 Found net devices under 0000:0a:00.1: cvl_0_1 00:24:04.500 23:01:55 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:24:04.500 23:01:55 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:24:04.500 23:01:55 -- nvmf/common.sh@402 -- # is_hw=yes 00:24:04.500 23:01:55 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:24:04.500 23:01:55 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:24:04.500 23:01:55 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:24:04.500 23:01:55 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:24:04.500 23:01:55 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:24:04.500 23:01:55 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:24:04.500 23:01:55 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:24:04.500 23:01:55 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:24:04.500 23:01:55 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:24:04.500 23:01:55 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:24:04.500 23:01:55 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:24:04.500 23:01:55 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:24:04.500 23:01:55 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:24:04.500 23:01:55 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:24:04.500 23:01:55 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:24:04.500 23:01:55 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:24:04.500 23:01:55 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:24:04.500 23:01:55 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:24:04.500 23:01:55 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:24:04.500 23:01:55 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:24:04.500 23:01:55 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:24:04.500 23:01:55 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:24:04.500 23:01:55 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:24:04.500 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:24:04.500 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.135 ms 00:24:04.500 00:24:04.500 --- 10.0.0.2 ping statistics --- 00:24:04.500 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:24:04.500 rtt min/avg/max/mdev = 0.135/0.135/0.135/0.000 ms 00:24:04.500 23:01:55 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:24:04.500 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:24:04.500 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.116 ms 00:24:04.500 00:24:04.500 --- 10.0.0.1 ping statistics --- 00:24:04.500 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:24:04.500 rtt min/avg/max/mdev = 0.116/0.116/0.116/0.000 ms 00:24:04.500 23:01:55 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:24:04.500 23:01:55 -- nvmf/common.sh@410 -- # return 0 00:24:04.500 23:01:55 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:24:04.500 23:01:55 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:24:04.500 23:01:55 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:24:04.500 23:01:55 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:24:04.500 23:01:55 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:24:04.500 23:01:55 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:24:04.500 23:01:55 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:24:04.500 23:01:55 -- host/failover.sh@20 -- # nvmfappstart -m 0xE 00:24:04.500 23:01:55 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:24:04.500 23:01:55 -- common/autotest_common.sh@712 -- # xtrace_disable 00:24:04.500 23:01:55 -- common/autotest_common.sh@10 -- # set +x 00:24:04.500 23:01:55 -- nvmf/common.sh@469 -- # nvmfpid=367585 00:24:04.500 23:01:55 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xE 00:24:04.500 23:01:55 -- nvmf/common.sh@470 -- # waitforlisten 367585 00:24:04.500 23:01:55 -- common/autotest_common.sh@819 -- # '[' -z 367585 ']' 00:24:04.500 23:01:55 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk.sock 00:24:04.500 23:01:55 -- common/autotest_common.sh@824 -- # local max_retries=100 00:24:04.500 23:01:55 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:24:04.500 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:24:04.500 23:01:55 -- common/autotest_common.sh@828 -- # xtrace_disable 00:24:04.500 23:01:55 -- common/autotest_common.sh@10 -- # set +x 00:24:04.500 [2024-04-16 23:01:55.384921] Starting SPDK v24.01.1-pre git sha1 4b134b4ab / DPDK 23.11.0 initialization... 00:24:04.500 [2024-04-16 23:01:55.385013] [ DPDK EAL parameters: nvmf -c 0xE --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:24:04.500 EAL: No free 2048 kB hugepages reported on node 1 00:24:04.500 [2024-04-16 23:01:55.454861] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 3 00:24:04.500 [2024-04-16 23:01:55.570231] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:24:04.500 [2024-04-16 23:01:55.570395] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:24:04.500 [2024-04-16 23:01:55.570415] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:24:04.500 [2024-04-16 23:01:55.570431] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:24:04.500 [2024-04-16 23:01:55.570537] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:24:04.500 [2024-04-16 23:01:55.570634] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:24:04.500 [2024-04-16 23:01:55.570637] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:24:05.436 23:01:56 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:24:05.436 23:01:56 -- common/autotest_common.sh@852 -- # return 0 00:24:05.436 23:01:56 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:24:05.436 23:01:56 -- common/autotest_common.sh@718 -- # xtrace_disable 00:24:05.436 23:01:56 -- common/autotest_common.sh@10 -- # set +x 00:24:05.436 23:01:56 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:24:05.436 23:01:56 -- host/failover.sh@22 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_transport -t tcp -o -u 8192 00:24:05.436 [2024-04-16 23:01:56.562702] tcp.c: 659:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:24:05.696 23:01:56 -- host/failover.sh@23 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 -b Malloc0 00:24:05.957 Malloc0 00:24:05.957 23:01:56 -- host/failover.sh@24 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:24:06.215 23:01:57 -- host/failover.sh@25 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:24:06.215 23:01:57 -- host/failover.sh@26 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:24:06.473 [2024-04-16 23:01:57.550141] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:24:06.473 23:01:57 -- host/failover.sh@27 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4421 00:24:06.731 [2024-04-16 23:01:57.794913] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4421 *** 00:24:06.731 23:01:57 -- host/failover.sh@28 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4422 00:24:06.989 [2024-04-16 23:01:58.031824] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4422 *** 00:24:06.989 23:01:58 -- host/failover.sh@31 -- # bdevperf_pid=367955 00:24:06.989 23:01:58 -- host/failover.sh@30 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -z -r /var/tmp/bdevperf.sock -q 128 -o 4096 -w verify -t 15 -f 00:24:06.989 23:01:58 -- host/failover.sh@33 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; cat $testdir/try.txt; rm -f $testdir/try.txt; killprocess $bdevperf_pid; nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:24:06.990 23:01:58 -- host/failover.sh@34 -- # waitforlisten 367955 /var/tmp/bdevperf.sock 00:24:06.990 23:01:58 -- common/autotest_common.sh@819 -- # '[' -z 367955 ']' 00:24:06.990 23:01:58 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:24:06.990 23:01:58 -- common/autotest_common.sh@824 -- # local max_retries=100 00:24:06.990 23:01:58 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:24:06.990 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:24:06.990 23:01:58 -- common/autotest_common.sh@828 -- # xtrace_disable 00:24:06.990 23:01:58 -- common/autotest_common.sh@10 -- # set +x 00:24:07.925 23:01:59 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:24:07.925 23:01:59 -- common/autotest_common.sh@852 -- # return 0 00:24:07.925 23:01:59 -- host/failover.sh@35 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 00:24:08.493 NVMe0n1 00:24:08.493 23:01:59 -- host/failover.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4421 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 00:24:08.751 00:24:08.751 23:01:59 -- host/failover.sh@39 -- # run_test_pid=368121 00:24:08.751 23:01:59 -- host/failover.sh@38 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bdevperf.sock perform_tests 00:24:08.751 23:01:59 -- host/failover.sh@41 -- # sleep 1 00:24:10.128 23:02:00 -- host/failover.sh@43 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:24:10.128 [2024-04-16 23:02:01.084379] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b5d1d0 is same with the state(5) to be set 00:24:10.128 [2024-04-16 23:02:01.084483] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b5d1d0 is same with the state(5) to be set 00:24:10.128 [2024-04-16 23:02:01.084498] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b5d1d0 is same with the state(5) to be set 00:24:10.128 [2024-04-16 23:02:01.084511] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b5d1d0 is same with the state(5) to be set 00:24:10.128 [2024-04-16 23:02:01.084524] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b5d1d0 is same with the state(5) to be set 00:24:10.128 [2024-04-16 23:02:01.084536] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b5d1d0 is same with the state(5) to be set 00:24:10.128 [2024-04-16 23:02:01.084547] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b5d1d0 is same with the state(5) to be set 00:24:10.128 [2024-04-16 23:02:01.084571] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b5d1d0 is same with the state(5) to be set 00:24:10.128 [2024-04-16 23:02:01.084583] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b5d1d0 is same with the state(5) to be set 00:24:10.128 [2024-04-16 23:02:01.084595] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b5d1d0 is same with the state(5) to be set 00:24:10.128 [2024-04-16 23:02:01.084606] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b5d1d0 is same with the state(5) to be set 00:24:10.128 [2024-04-16 23:02:01.084618] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b5d1d0 is same with the state(5) to be set 00:24:10.128 [2024-04-16 23:02:01.084630] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b5d1d0 is same with the state(5) to be set 00:24:10.128 [2024-04-16 23:02:01.084642] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b5d1d0 is same with the state(5) to be set 00:24:10.128 [2024-04-16 23:02:01.084654] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b5d1d0 is same with the state(5) to be set 00:24:10.128 [2024-04-16 23:02:01.084665] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b5d1d0 is same with the state(5) to be set 00:24:10.128 [2024-04-16 23:02:01.084677] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b5d1d0 is same with the state(5) to be set 00:24:10.128 [2024-04-16 23:02:01.084689] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b5d1d0 is same with the state(5) to be set 00:24:10.128 [2024-04-16 23:02:01.084701] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b5d1d0 is same with the state(5) to be set 00:24:10.128 [2024-04-16 23:02:01.084713] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b5d1d0 is same with the state(5) to be set 00:24:10.128 [2024-04-16 23:02:01.084724] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b5d1d0 is same with the state(5) to be set 00:24:10.128 [2024-04-16 23:02:01.084736] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b5d1d0 is same with the state(5) to be set 00:24:10.128 [2024-04-16 23:02:01.084748] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b5d1d0 is same with the state(5) to be set 00:24:10.128 [2024-04-16 23:02:01.084761] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b5d1d0 is same with the state(5) to be set 00:24:10.128 [2024-04-16 23:02:01.084772] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b5d1d0 is same with the state(5) to be set 00:24:10.128 [2024-04-16 23:02:01.084785] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b5d1d0 is same with the state(5) to be set 00:24:10.128 [2024-04-16 23:02:01.084797] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b5d1d0 is same with the state(5) to be set 00:24:10.128 [2024-04-16 23:02:01.084808] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b5d1d0 is same with the state(5) to be set 00:24:10.128 [2024-04-16 23:02:01.084820] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b5d1d0 is same with the state(5) to be set 00:24:10.128 [2024-04-16 23:02:01.084831] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b5d1d0 is same with the state(5) to be set 00:24:10.128 [2024-04-16 23:02:01.084843] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b5d1d0 is same with the state(5) to be set 00:24:10.128 [2024-04-16 23:02:01.084869] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b5d1d0 is same with the state(5) to be set 00:24:10.128 [2024-04-16 23:02:01.084880] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b5d1d0 is same with the state(5) to be set 00:24:10.128 [2024-04-16 23:02:01.084891] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b5d1d0 is same with the state(5) to be set 00:24:10.128 [2024-04-16 23:02:01.084906] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b5d1d0 is same with the state(5) to be set 00:24:10.128 [2024-04-16 23:02:01.084918] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b5d1d0 is same with the state(5) to be set 00:24:10.128 [2024-04-16 23:02:01.084929] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b5d1d0 is same with the state(5) to be set 00:24:10.128 [2024-04-16 23:02:01.084940] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b5d1d0 is same with the state(5) to be set 00:24:10.128 [2024-04-16 23:02:01.084951] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b5d1d0 is same with the state(5) to be set 00:24:10.128 [2024-04-16 23:02:01.084962] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b5d1d0 is same with the state(5) to be set 00:24:10.128 [2024-04-16 23:02:01.084973] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b5d1d0 is same with the state(5) to be set 00:24:10.128 [2024-04-16 23:02:01.084985] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b5d1d0 is same with the state(5) to be set 00:24:10.128 [2024-04-16 23:02:01.084996] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b5d1d0 is same with the state(5) to be set 00:24:10.128 [2024-04-16 23:02:01.085008] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b5d1d0 is same with the state(5) to be set 00:24:10.128 [2024-04-16 23:02:01.085019] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b5d1d0 is same with the state(5) to be set 00:24:10.128 [2024-04-16 23:02:01.085030] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b5d1d0 is same with the state(5) to be set 00:24:10.128 [2024-04-16 23:02:01.085042] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b5d1d0 is same with the state(5) to be set 00:24:10.128 [2024-04-16 23:02:01.085053] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b5d1d0 is same with the state(5) to be set 00:24:10.128 [2024-04-16 23:02:01.085064] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b5d1d0 is same with the state(5) to be set 00:24:10.128 [2024-04-16 23:02:01.085076] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b5d1d0 is same with the state(5) to be set 00:24:10.128 [2024-04-16 23:02:01.085087] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b5d1d0 is same with the state(5) to be set 00:24:10.128 [2024-04-16 23:02:01.085098] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b5d1d0 is same with the state(5) to be set 00:24:10.128 [2024-04-16 23:02:01.085110] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b5d1d0 is same with the state(5) to be set 00:24:10.128 [2024-04-16 23:02:01.085121] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b5d1d0 is same with the state(5) to be set 00:24:10.128 [2024-04-16 23:02:01.085132] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b5d1d0 is same with the state(5) to be set 00:24:10.128 [2024-04-16 23:02:01.085144] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b5d1d0 is same with the state(5) to be set 00:24:10.128 [2024-04-16 23:02:01.085156] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b5d1d0 is same with the state(5) to be set 00:24:10.128 [2024-04-16 23:02:01.085167] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b5d1d0 is same with the state(5) to be set 00:24:10.128 [2024-04-16 23:02:01.085203] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b5d1d0 is same with the state(5) to be set 00:24:10.128 23:02:01 -- host/failover.sh@45 -- # sleep 3 00:24:13.413 23:02:04 -- host/failover.sh@47 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4422 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 00:24:13.413 00:24:13.413 23:02:04 -- host/failover.sh@48 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4421 00:24:13.674 [2024-04-16 23:02:04.702356] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b5e720 is same with the state(5) to be set 00:24:13.674 [2024-04-16 23:02:04.702425] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b5e720 is same with the state(5) to be set 00:24:13.674 [2024-04-16 23:02:04.702440] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b5e720 is same with the state(5) to be set 00:24:13.674 [2024-04-16 23:02:04.702452] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b5e720 is same with the state(5) to be set 00:24:13.674 [2024-04-16 23:02:04.702464] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b5e720 is same with the state(5) to be set 00:24:13.674 [2024-04-16 23:02:04.702476] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b5e720 is same with the state(5) to be set 00:24:13.674 [2024-04-16 23:02:04.702503] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b5e720 is same with the state(5) to be set 00:24:13.674 [2024-04-16 23:02:04.702514] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b5e720 is same with the state(5) to be set 00:24:13.674 [2024-04-16 23:02:04.702526] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b5e720 is same with the state(5) to be set 00:24:13.674 [2024-04-16 23:02:04.702537] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b5e720 is same with the state(5) to be set 00:24:13.674 [2024-04-16 23:02:04.702549] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b5e720 is same with the state(5) to be set 00:24:13.674 [2024-04-16 23:02:04.702561] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b5e720 is same with the state(5) to be set 00:24:13.674 [2024-04-16 23:02:04.702573] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b5e720 is same with the state(5) to be set 00:24:13.674 [2024-04-16 23:02:04.702585] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b5e720 is same with the state(5) to be set 00:24:13.674 [2024-04-16 23:02:04.702597] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b5e720 is same with the state(5) to be set 00:24:13.674 [2024-04-16 23:02:04.702610] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b5e720 is same with the state(5) to be set 00:24:13.674 [2024-04-16 23:02:04.702623] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b5e720 is same with the state(5) to be set 00:24:13.674 [2024-04-16 23:02:04.702635] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b5e720 is same with the state(5) to be set 00:24:13.674 [2024-04-16 23:02:04.702648] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b5e720 is same with the state(5) to be set 00:24:13.674 [2024-04-16 23:02:04.702661] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b5e720 is same with the state(5) to be set 00:24:13.674 [2024-04-16 23:02:04.702674] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b5e720 is same with the state(5) to be set 00:24:13.674 [2024-04-16 23:02:04.702686] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b5e720 is same with the state(5) to be set 00:24:13.674 [2024-04-16 23:02:04.702698] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b5e720 is same with the state(5) to be set 00:24:13.674 [2024-04-16 23:02:04.702709] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b5e720 is same with the state(5) to be set 00:24:13.674 [2024-04-16 23:02:04.702720] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b5e720 is same with the state(5) to be set 00:24:13.674 [2024-04-16 23:02:04.702732] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b5e720 is same with the state(5) to be set 00:24:13.674 [2024-04-16 23:02:04.702753] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b5e720 is same with the state(5) to be set 00:24:13.674 [2024-04-16 23:02:04.702765] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b5e720 is same with the state(5) to be set 00:24:13.674 [2024-04-16 23:02:04.702777] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b5e720 is same with the state(5) to be set 00:24:13.674 [2024-04-16 23:02:04.702788] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b5e720 is same with the state(5) to be set 00:24:13.674 [2024-04-16 23:02:04.702799] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b5e720 is same with the state(5) to be set 00:24:13.674 [2024-04-16 23:02:04.702810] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b5e720 is same with the state(5) to be set 00:24:13.674 [2024-04-16 23:02:04.702821] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b5e720 is same with the state(5) to be set 00:24:13.674 [2024-04-16 23:02:04.702832] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b5e720 is same with the state(5) to be set 00:24:13.674 [2024-04-16 23:02:04.702844] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b5e720 is same with the state(5) to be set 00:24:13.674 [2024-04-16 23:02:04.702855] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b5e720 is same with the state(5) to be set 00:24:13.674 [2024-04-16 23:02:04.702867] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b5e720 is same with the state(5) to be set 00:24:13.674 [2024-04-16 23:02:04.702878] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b5e720 is same with the state(5) to be set 00:24:13.674 [2024-04-16 23:02:04.702889] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b5e720 is same with the state(5) to be set 00:24:13.674 [2024-04-16 23:02:04.702901] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b5e720 is same with the state(5) to be set 00:24:13.674 [2024-04-16 23:02:04.702912] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b5e720 is same with the state(5) to be set 00:24:13.674 [2024-04-16 23:02:04.702923] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b5e720 is same with the state(5) to be set 00:24:13.674 [2024-04-16 23:02:04.702935] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b5e720 is same with the state(5) to be set 00:24:13.674 [2024-04-16 23:02:04.702946] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b5e720 is same with the state(5) to be set 00:24:13.674 [2024-04-16 23:02:04.702957] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b5e720 is same with the state(5) to be set 00:24:13.674 [2024-04-16 23:02:04.702968] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b5e720 is same with the state(5) to be set 00:24:13.674 [2024-04-16 23:02:04.702980] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b5e720 is same with the state(5) to be set 00:24:13.674 23:02:04 -- host/failover.sh@50 -- # sleep 3 00:24:16.956 23:02:07 -- host/failover.sh@53 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:24:16.956 [2024-04-16 23:02:07.951247] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:24:16.956 23:02:07 -- host/failover.sh@55 -- # sleep 1 00:24:17.892 23:02:08 -- host/failover.sh@57 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4422 00:24:18.152 [2024-04-16 23:02:09.202400] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b5ee00 is same with the state(5) to be set 00:24:18.152 [2024-04-16 23:02:09.202439] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b5ee00 is same with the state(5) to be set 00:24:18.152 [2024-04-16 23:02:09.202479] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b5ee00 is same with the state(5) to be set 00:24:18.152 [2024-04-16 23:02:09.202492] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b5ee00 is same with the state(5) to be set 00:24:18.152 [2024-04-16 23:02:09.202504] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b5ee00 is same with the state(5) to be set 00:24:18.153 [2024-04-16 23:02:09.202515] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b5ee00 is same with the state(5) to be set 00:24:18.153 [2024-04-16 23:02:09.202526] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b5ee00 is same with the state(5) to be set 00:24:18.153 [2024-04-16 23:02:09.202538] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b5ee00 is same with the state(5) to be set 00:24:18.153 [2024-04-16 23:02:09.202549] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b5ee00 is same with the state(5) to be set 00:24:18.153 [2024-04-16 23:02:09.202576] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b5ee00 is same with the state(5) to be set 00:24:18.153 [2024-04-16 23:02:09.202588] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b5ee00 is same with the state(5) to be set 00:24:18.153 [2024-04-16 23:02:09.202599] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b5ee00 is same with the state(5) to be set 00:24:18.153 [2024-04-16 23:02:09.202611] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b5ee00 is same with the state(5) to be set 00:24:18.153 [2024-04-16 23:02:09.202634] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b5ee00 is same with the state(5) to be set 00:24:18.153 [2024-04-16 23:02:09.202646] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b5ee00 is same with the state(5) to be set 00:24:18.153 [2024-04-16 23:02:09.202657] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b5ee00 is same with the state(5) to be set 00:24:18.153 [2024-04-16 23:02:09.202669] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b5ee00 is same with the state(5) to be set 00:24:18.153 [2024-04-16 23:02:09.202681] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b5ee00 is same with the state(5) to be set 00:24:18.153 [2024-04-16 23:02:09.202693] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b5ee00 is same with the state(5) to be set 00:24:18.153 [2024-04-16 23:02:09.202704] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b5ee00 is same with the state(5) to be set 00:24:18.153 [2024-04-16 23:02:09.202716] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b5ee00 is same with the state(5) to be set 00:24:18.153 [2024-04-16 23:02:09.202728] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b5ee00 is same with the state(5) to be set 00:24:18.153 [2024-04-16 23:02:09.202739] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b5ee00 is same with the state(5) to be set 00:24:18.153 [2024-04-16 23:02:09.202751] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b5ee00 is same with the state(5) to be set 00:24:18.153 [2024-04-16 23:02:09.202763] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b5ee00 is same with the state(5) to be set 00:24:18.153 [2024-04-16 23:02:09.202774] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b5ee00 is same with the state(5) to be set 00:24:18.153 [2024-04-16 23:02:09.202785] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b5ee00 is same with the state(5) to be set 00:24:18.153 [2024-04-16 23:02:09.202797] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b5ee00 is same with the state(5) to be set 00:24:18.153 [2024-04-16 23:02:09.202808] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b5ee00 is same with the state(5) to be set 00:24:18.153 [2024-04-16 23:02:09.202824] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b5ee00 is same with the state(5) to be set 00:24:18.153 [2024-04-16 23:02:09.202836] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b5ee00 is same with the state(5) to be set 00:24:18.153 [2024-04-16 23:02:09.202848] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b5ee00 is same with the state(5) to be set 00:24:18.153 [2024-04-16 23:02:09.202860] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b5ee00 is same with the state(5) to be set 00:24:18.153 [2024-04-16 23:02:09.202872] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b5ee00 is same with the state(5) to be set 00:24:18.153 [2024-04-16 23:02:09.202884] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b5ee00 is same with the state(5) to be set 00:24:18.153 [2024-04-16 23:02:09.202896] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b5ee00 is same with the state(5) to be set 00:24:18.153 [2024-04-16 23:02:09.202923] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b5ee00 is same with the state(5) to be set 00:24:18.153 [2024-04-16 23:02:09.202935] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b5ee00 is same with the state(5) to be set 00:24:18.153 [2024-04-16 23:02:09.202947] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b5ee00 is same with the state(5) to be set 00:24:18.153 [2024-04-16 23:02:09.202958] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b5ee00 is same with the state(5) to be set 00:24:18.153 [2024-04-16 23:02:09.202985] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b5ee00 is same with the state(5) to be set 00:24:18.153 [2024-04-16 23:02:09.202996] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b5ee00 is same with the state(5) to be set 00:24:18.153 [2024-04-16 23:02:09.203008] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b5ee00 is same with the state(5) to be set 00:24:18.153 [2024-04-16 23:02:09.203020] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b5ee00 is same with the state(5) to be set 00:24:18.153 [2024-04-16 23:02:09.203031] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b5ee00 is same with the state(5) to be set 00:24:18.153 [2024-04-16 23:02:09.203043] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b5ee00 is same with the state(5) to be set 00:24:18.153 [2024-04-16 23:02:09.203055] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b5ee00 is same with the state(5) to be set 00:24:18.153 [2024-04-16 23:02:09.203068] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b5ee00 is same with the state(5) to be set 00:24:18.153 [2024-04-16 23:02:09.203079] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b5ee00 is same with the state(5) to be set 00:24:18.153 [2024-04-16 23:02:09.203092] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b5ee00 is same with the state(5) to be set 00:24:18.153 [2024-04-16 23:02:09.203103] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b5ee00 is same with the state(5) to be set 00:24:18.153 [2024-04-16 23:02:09.203114] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b5ee00 is same with the state(5) to be set 00:24:18.153 [2024-04-16 23:02:09.203125] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b5ee00 is same with the state(5) to be set 00:24:18.153 [2024-04-16 23:02:09.203136] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b5ee00 is same with the state(5) to be set 00:24:18.153 [2024-04-16 23:02:09.203147] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b5ee00 is same with the state(5) to be set 00:24:18.153 [2024-04-16 23:02:09.203173] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b5ee00 is same with the state(5) to be set 00:24:18.153 [2024-04-16 23:02:09.203199] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b5ee00 is same with the state(5) to be set 00:24:18.153 [2024-04-16 23:02:09.203212] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b5ee00 is same with the state(5) to be set 00:24:18.153 [2024-04-16 23:02:09.203223] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b5ee00 is same with the state(5) to be set 00:24:18.153 [2024-04-16 23:02:09.203236] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b5ee00 is same with the state(5) to be set 00:24:18.153 [2024-04-16 23:02:09.203247] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b5ee00 is same with the state(5) to be set 00:24:18.153 [2024-04-16 23:02:09.203259] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b5ee00 is same with the state(5) to be set 00:24:18.153 [2024-04-16 23:02:09.203270] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b5ee00 is same with the state(5) to be set 00:24:18.153 [2024-04-16 23:02:09.203281] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b5ee00 is same with the state(5) to be set 00:24:18.153 [2024-04-16 23:02:09.203293] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b5ee00 is same with the state(5) to be set 00:24:18.153 [2024-04-16 23:02:09.203305] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b5ee00 is same with the state(5) to be set 00:24:18.153 [2024-04-16 23:02:09.203317] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b5ee00 is same with the state(5) to be set 00:24:18.153 [2024-04-16 23:02:09.203329] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b5ee00 is same with the state(5) to be set 00:24:18.153 [2024-04-16 23:02:09.203340] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b5ee00 is same with the state(5) to be set 00:24:18.153 [2024-04-16 23:02:09.203351] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b5ee00 is same with the state(5) to be set 00:24:18.153 [2024-04-16 23:02:09.203363] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b5ee00 is same with the state(5) to be set 00:24:18.153 [2024-04-16 23:02:09.203375] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b5ee00 is same with the state(5) to be set 00:24:18.153 [2024-04-16 23:02:09.203386] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b5ee00 is same with the state(5) to be set 00:24:18.153 [2024-04-16 23:02:09.203397] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b5ee00 is same with the state(5) to be set 00:24:18.153 [2024-04-16 23:02:09.203409] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b5ee00 is same with the state(5) to be set 00:24:18.153 [2024-04-16 23:02:09.203436] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b5ee00 is same with the state(5) to be set 00:24:18.153 [2024-04-16 23:02:09.203459] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b5ee00 is same with the state(5) to be set 00:24:18.153 [2024-04-16 23:02:09.203471] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b5ee00 is same with the state(5) to be set 00:24:18.153 [2024-04-16 23:02:09.203482] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b5ee00 is same with the state(5) to be set 00:24:18.153 23:02:09 -- host/failover.sh@59 -- # wait 368121 00:24:24.728 0 00:24:24.728 23:02:14 -- host/failover.sh@61 -- # killprocess 367955 00:24:24.728 23:02:14 -- common/autotest_common.sh@926 -- # '[' -z 367955 ']' 00:24:24.728 23:02:14 -- common/autotest_common.sh@930 -- # kill -0 367955 00:24:24.728 23:02:14 -- common/autotest_common.sh@931 -- # uname 00:24:24.728 23:02:14 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:24:24.728 23:02:14 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 367955 00:24:24.728 23:02:15 -- common/autotest_common.sh@932 -- # process_name=reactor_0 00:24:24.728 23:02:15 -- common/autotest_common.sh@936 -- # '[' reactor_0 = sudo ']' 00:24:24.728 23:02:15 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 367955' 00:24:24.728 killing process with pid 367955 00:24:24.728 23:02:15 -- common/autotest_common.sh@945 -- # kill 367955 00:24:24.728 23:02:15 -- common/autotest_common.sh@950 -- # wait 367955 00:24:24.728 23:02:15 -- host/failover.sh@63 -- # cat /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/try.txt 00:24:24.728 [2024-04-16 23:01:58.091602] Starting SPDK v24.01.1-pre git sha1 4b134b4ab / DPDK 23.11.0 initialization... 00:24:24.728 [2024-04-16 23:01:58.091681] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid367955 ] 00:24:24.728 EAL: No free 2048 kB hugepages reported on node 1 00:24:24.728 [2024-04-16 23:01:58.162162] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:24:24.728 [2024-04-16 23:01:58.294490] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:24:24.728 Running I/O for 15 seconds... 00:24:24.728 [2024-04-16 23:02:01.085537] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:104 nsid:1 lba:118688 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:24.728 [2024-04-16 23:02:01.085578] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:24.728 [2024-04-16 23:02:01.085607] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:125 nsid:1 lba:118704 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:24.728 [2024-04-16 23:02:01.085625] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:24.728 [2024-04-16 23:02:01.085641] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:22 nsid:1 lba:118712 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:24.728 [2024-04-16 23:02:01.085656] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:24.728 [2024-04-16 23:02:01.085671] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:118744 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:24.728 [2024-04-16 23:02:01.085685] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:24.728 [2024-04-16 23:02:01.085700] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:109 nsid:1 lba:118752 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:24.729 [2024-04-16 23:02:01.085715] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:24.729 [2024-04-16 23:02:01.085730] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:67 nsid:1 lba:118760 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:24.729 [2024-04-16 23:02:01.085744] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:24.729 [2024-04-16 23:02:01.085759] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:116 nsid:1 lba:118144 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:24.729 [2024-04-16 23:02:01.085774] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:24.729 [2024-04-16 23:02:01.085805] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:118152 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:24.729 [2024-04-16 23:02:01.085818] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:24.729 [2024-04-16 23:02:01.085833] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:89 nsid:1 lba:118168 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:24.729 [2024-04-16 23:02:01.085846] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:24.729 [2024-04-16 23:02:01.085877] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:91 nsid:1 lba:118184 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:24.729 [2024-04-16 23:02:01.085891] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:24.729 [2024-04-16 23:02:01.085906] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:66 nsid:1 lba:118192 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:24.729 [2024-04-16 23:02:01.085920] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:24.729 [2024-04-16 23:02:01.085942] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:60 nsid:1 lba:118200 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:24.729 [2024-04-16 23:02:01.085957] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:24.729 [2024-04-16 23:02:01.085986] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:126 nsid:1 lba:118216 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:24.729 [2024-04-16 23:02:01.085999] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:24.729 [2024-04-16 23:02:01.086014] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:18 nsid:1 lba:118240 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:24.729 [2024-04-16 23:02:01.086028] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:24.729 [2024-04-16 23:02:01.086042] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:114 nsid:1 lba:118768 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:24.729 [2024-04-16 23:02:01.086055] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:24.729 [2024-04-16 23:02:01.086069] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:108 nsid:1 lba:118776 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:24.729 [2024-04-16 23:02:01.086082] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:24.729 [2024-04-16 23:02:01.086097] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:20 nsid:1 lba:118784 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:24.729 [2024-04-16 23:02:01.086111] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:24.729 [2024-04-16 23:02:01.086125] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:81 nsid:1 lba:118792 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:24.729 [2024-04-16 23:02:01.086138] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:24.729 [2024-04-16 23:02:01.086153] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:118832 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:24.729 [2024-04-16 23:02:01.086166] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:24.729 [2024-04-16 23:02:01.086204] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:118848 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:24.729 [2024-04-16 23:02:01.086220] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:24.729 [2024-04-16 23:02:01.086235] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:118864 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:24.729 [2024-04-16 23:02:01.086249] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:24.729 [2024-04-16 23:02:01.086264] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:53 nsid:1 lba:118872 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:24.729 [2024-04-16 23:02:01.086277] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:24.729 [2024-04-16 23:02:01.086292] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:80 nsid:1 lba:118896 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:24.729 [2024-04-16 23:02:01.086306] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:24.729 [2024-04-16 23:02:01.086321] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:29 nsid:1 lba:118904 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:24.729 [2024-04-16 23:02:01.086339] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:24.729 [2024-04-16 23:02:01.086355] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:118248 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:24.729 [2024-04-16 23:02:01.086369] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:24.729 [2024-04-16 23:02:01.086384] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:97 nsid:1 lba:118256 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:24.729 [2024-04-16 23:02:01.086397] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:24.729 [2024-04-16 23:02:01.086412] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:36 nsid:1 lba:118264 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:24.729 [2024-04-16 23:02:01.086426] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:24.729 [2024-04-16 23:02:01.086441] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:30 nsid:1 lba:118272 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:24.729 [2024-04-16 23:02:01.086455] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:24.729 [2024-04-16 23:02:01.086470] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:102 nsid:1 lba:118288 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:24.729 [2024-04-16 23:02:01.086497] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:24.729 [2024-04-16 23:02:01.086512] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:50 nsid:1 lba:118304 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:24.729 [2024-04-16 23:02:01.086525] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:24.729 [2024-04-16 23:02:01.086540] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:119 nsid:1 lba:118312 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:24.729 [2024-04-16 23:02:01.086553] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:24.729 [2024-04-16 23:02:01.086567] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:118328 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:24.729 [2024-04-16 23:02:01.086580] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:24.729 [2024-04-16 23:02:01.086595] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:45 nsid:1 lba:118920 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:24.729 [2024-04-16 23:02:01.086610] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:24.729 [2024-04-16 23:02:01.086625] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:72 nsid:1 lba:118928 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:24.729 [2024-04-16 23:02:01.086638] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:24.729 [2024-04-16 23:02:01.086653] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:27 nsid:1 lba:118944 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:24.729 [2024-04-16 23:02:01.086666] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:24.729 [2024-04-16 23:02:01.086680] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:118344 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:24.729 [2024-04-16 23:02:01.086693] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:24.729 [2024-04-16 23:02:01.086712] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:57 nsid:1 lba:118368 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:24.729 [2024-04-16 23:02:01.086726] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:24.729 [2024-04-16 23:02:01.086741] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:69 nsid:1 lba:118376 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:24.729 [2024-04-16 23:02:01.086753] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:24.729 [2024-04-16 23:02:01.086768] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:70 nsid:1 lba:118384 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:24.729 [2024-04-16 23:02:01.086781] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:24.729 [2024-04-16 23:02:01.086795] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:58 nsid:1 lba:118400 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:24.729 [2024-04-16 23:02:01.086809] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:24.729 [2024-04-16 23:02:01.086823] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:118408 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:24.729 [2024-04-16 23:02:01.086836] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:24.729 [2024-04-16 23:02:01.086851] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:62 nsid:1 lba:118416 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:24.729 [2024-04-16 23:02:01.086863] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:24.729 [2024-04-16 23:02:01.086878] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:56 nsid:1 lba:118424 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:24.729 [2024-04-16 23:02:01.086891] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:24.729 [2024-04-16 23:02:01.086906] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:90 nsid:1 lba:118952 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:24.729 [2024-04-16 23:02:01.086919] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:24.729 [2024-04-16 23:02:01.086934] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:40 nsid:1 lba:118960 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:24.730 [2024-04-16 23:02:01.086947] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:24.730 [2024-04-16 23:02:01.086962] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:79 nsid:1 lba:118968 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:24.730 [2024-04-16 23:02:01.086976] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:24.730 [2024-04-16 23:02:01.086992] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:47 nsid:1 lba:118976 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:24.730 [2024-04-16 23:02:01.087006] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:24.730 [2024-04-16 23:02:01.087021] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:19 nsid:1 lba:118984 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:24.730 [2024-04-16 23:02:01.087035] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:24.730 [2024-04-16 23:02:01.087051] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:100 nsid:1 lba:118992 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:24.730 [2024-04-16 23:02:01.087073] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:24.730 [2024-04-16 23:02:01.087090] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:124 nsid:1 lba:119000 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:24.730 [2024-04-16 23:02:01.087104] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:24.730 [2024-04-16 23:02:01.087118] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:86 nsid:1 lba:119008 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:24.730 [2024-04-16 23:02:01.087131] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:24.730 [2024-04-16 23:02:01.087145] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:65 nsid:1 lba:119016 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:24.730 [2024-04-16 23:02:01.087158] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:24.730 [2024-04-16 23:02:01.087172] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:44 nsid:1 lba:119024 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:24.730 [2024-04-16 23:02:01.087211] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:24.730 [2024-04-16 23:02:01.087227] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:37 nsid:1 lba:119032 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:24.730 [2024-04-16 23:02:01.087241] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:24.730 [2024-04-16 23:02:01.087257] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:111 nsid:1 lba:119040 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:24.730 [2024-04-16 23:02:01.087270] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:24.730 [2024-04-16 23:02:01.087285] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:78 nsid:1 lba:118432 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:24.730 [2024-04-16 23:02:01.087299] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:24.730 [2024-04-16 23:02:01.087314] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:94 nsid:1 lba:118440 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:24.730 [2024-04-16 23:02:01.087328] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:24.730 [2024-04-16 23:02:01.087342] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:76 nsid:1 lba:118448 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:24.730 [2024-04-16 23:02:01.087356] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:24.730 [2024-04-16 23:02:01.087371] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:118456 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:24.730 [2024-04-16 23:02:01.087385] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:24.730 [2024-04-16 23:02:01.087400] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:84 nsid:1 lba:118488 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:24.730 [2024-04-16 23:02:01.087413] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:24.730 [2024-04-16 23:02:01.087428] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:41 nsid:1 lba:118496 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:24.730 [2024-04-16 23:02:01.087441] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:24.730 [2024-04-16 23:02:01.087460] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:51 nsid:1 lba:118504 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:24.730 [2024-04-16 23:02:01.087475] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:24.730 [2024-04-16 23:02:01.087504] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:101 nsid:1 lba:118520 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:24.730 [2024-04-16 23:02:01.087518] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:24.730 [2024-04-16 23:02:01.087533] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:96 nsid:1 lba:119048 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:24.730 [2024-04-16 23:02:01.087546] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:24.730 [2024-04-16 23:02:01.087560] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:7 nsid:1 lba:119056 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:24.730 [2024-04-16 23:02:01.087574] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:24.730 [2024-04-16 23:02:01.087590] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:8 nsid:1 lba:119064 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:24.730 [2024-04-16 23:02:01.087603] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:24.730 [2024-04-16 23:02:01.087617] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:98 nsid:1 lba:118528 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:24.730 [2024-04-16 23:02:01.087630] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:24.730 [2024-04-16 23:02:01.087644] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:118552 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:24.730 [2024-04-16 23:02:01.087657] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:24.730 [2024-04-16 23:02:01.087672] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:25 nsid:1 lba:118568 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:24.730 [2024-04-16 23:02:01.087684] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:24.730 [2024-04-16 23:02:01.087699] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:42 nsid:1 lba:118584 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:24.730 [2024-04-16 23:02:01.087712] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:24.730 [2024-04-16 23:02:01.087727] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:113 nsid:1 lba:118624 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:24.730 [2024-04-16 23:02:01.087740] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:24.730 [2024-04-16 23:02:01.087754] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:103 nsid:1 lba:118632 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:24.730 [2024-04-16 23:02:01.087768] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:24.730 [2024-04-16 23:02:01.087782] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:26 nsid:1 lba:118640 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:24.730 [2024-04-16 23:02:01.087796] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:24.730 [2024-04-16 23:02:01.087811] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:74 nsid:1 lba:118648 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:24.730 [2024-04-16 23:02:01.087827] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:24.730 [2024-04-16 23:02:01.087843] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:75 nsid:1 lba:119072 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:24.730 [2024-04-16 23:02:01.087856] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:24.730 [2024-04-16 23:02:01.087870] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:24 nsid:1 lba:119080 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:24.730 [2024-04-16 23:02:01.087883] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:24.730 [2024-04-16 23:02:01.087898] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:63 nsid:1 lba:119088 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:24.730 [2024-04-16 23:02:01.087911] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:24.730 [2024-04-16 23:02:01.087925] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:88 nsid:1 lba:119096 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:24.730 [2024-04-16 23:02:01.087939] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:24.730 [2024-04-16 23:02:01.087953] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:92 nsid:1 lba:119104 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:24.730 [2024-04-16 23:02:01.087971] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:24.730 [2024-04-16 23:02:01.087986] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:82 nsid:1 lba:119112 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:24.730 [2024-04-16 23:02:01.088000] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:24.730 [2024-04-16 23:02:01.088014] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:83 nsid:1 lba:119120 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:24.730 [2024-04-16 23:02:01.088028] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:24.730 [2024-04-16 23:02:01.088042] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:31 nsid:1 lba:119128 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:24.730 [2024-04-16 23:02:01.088055] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:24.730 [2024-04-16 23:02:01.088070] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:77 nsid:1 lba:119136 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:24.730 [2024-04-16 23:02:01.088083] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:24.730 [2024-04-16 23:02:01.088098] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:120 nsid:1 lba:119144 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:24.730 [2024-04-16 23:02:01.088111] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:24.730 [2024-04-16 23:02:01.088125] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:54 nsid:1 lba:119152 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:24.731 [2024-04-16 23:02:01.088138] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:24.731 [2024-04-16 23:02:01.088153] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:85 nsid:1 lba:119160 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:24.731 [2024-04-16 23:02:01.088166] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:24.731 [2024-04-16 23:02:01.088203] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:46 nsid:1 lba:119168 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:24.731 [2024-04-16 23:02:01.088223] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:24.731 [2024-04-16 23:02:01.088239] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:21 nsid:1 lba:119176 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:24.731 [2024-04-16 23:02:01.088253] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:24.731 [2024-04-16 23:02:01.088268] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:112 nsid:1 lba:119184 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:24.731 [2024-04-16 23:02:01.088281] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:24.731 [2024-04-16 23:02:01.088296] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:64 nsid:1 lba:119192 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:24.731 [2024-04-16 23:02:01.088310] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:24.731 [2024-04-16 23:02:01.088325] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:61 nsid:1 lba:119200 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:24.731 [2024-04-16 23:02:01.088339] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:24.731 [2024-04-16 23:02:01.088354] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:49 nsid:1 lba:119208 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:24.731 [2024-04-16 23:02:01.088367] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:24.731 [2024-04-16 23:02:01.088381] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:59 nsid:1 lba:119216 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:24.731 [2024-04-16 23:02:01.088394] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:24.731 [2024-04-16 23:02:01.088409] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:105 nsid:1 lba:119224 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:24.731 [2024-04-16 23:02:01.088426] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:24.731 [2024-04-16 23:02:01.088441] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:48 nsid:1 lba:118672 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:24.731 [2024-04-16 23:02:01.088461] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:24.731 [2024-04-16 23:02:01.088476] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:118 nsid:1 lba:118680 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:24.731 [2024-04-16 23:02:01.088505] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:24.731 [2024-04-16 23:02:01.088520] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:16 nsid:1 lba:118696 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:24.731 [2024-04-16 23:02:01.088534] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:24.731 [2024-04-16 23:02:01.088549] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:118720 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:24.731 [2024-04-16 23:02:01.088562] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:24.731 [2024-04-16 23:02:01.088576] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:52 nsid:1 lba:118728 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:24.731 [2024-04-16 23:02:01.088590] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:24.731 [2024-04-16 23:02:01.088609] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:122 nsid:1 lba:118736 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:24.731 [2024-04-16 23:02:01.088624] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:24.731 [2024-04-16 23:02:01.088638] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:43 nsid:1 lba:118800 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:24.731 [2024-04-16 23:02:01.088651] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:24.731 [2024-04-16 23:02:01.088666] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:117 nsid:1 lba:118808 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:24.731 [2024-04-16 23:02:01.088680] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:24.731 [2024-04-16 23:02:01.088694] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:28 nsid:1 lba:119232 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:24.731 [2024-04-16 23:02:01.088707] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:24.731 [2024-04-16 23:02:01.088721] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:68 nsid:1 lba:119240 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:24.731 [2024-04-16 23:02:01.088735] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:24.731 [2024-04-16 23:02:01.088749] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:39 nsid:1 lba:119248 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:24.731 [2024-04-16 23:02:01.088762] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:24.731 [2024-04-16 23:02:01.088777] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:32 nsid:1 lba:119256 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:24.731 [2024-04-16 23:02:01.088789] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:24.731 [2024-04-16 23:02:01.088803] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:106 nsid:1 lba:119264 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:24.731 [2024-04-16 23:02:01.088817] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:24.731 [2024-04-16 23:02:01.088831] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:110 nsid:1 lba:119272 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:24.731 [2024-04-16 23:02:01.088844] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:24.731 [2024-04-16 23:02:01.088858] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:107 nsid:1 lba:119280 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:24.731 [2024-04-16 23:02:01.088871] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:24.731 [2024-04-16 23:02:01.088886] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:23 nsid:1 lba:119288 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:24.731 [2024-04-16 23:02:01.088900] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:24.731 [2024-04-16 23:02:01.088914] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:99 nsid:1 lba:119296 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:24.731 [2024-04-16 23:02:01.088935] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:24.731 [2024-04-16 23:02:01.088950] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:115 nsid:1 lba:119304 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:24.731 [2024-04-16 23:02:01.088967] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:24.731 [2024-04-16 23:02:01.088982] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:35 nsid:1 lba:119312 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:24.731 [2024-04-16 23:02:01.088997] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:24.731 [2024-04-16 23:02:01.089012] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:55 nsid:1 lba:119320 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:24.731 [2024-04-16 23:02:01.089025] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:24.731 [2024-04-16 23:02:01.089040] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:71 nsid:1 lba:119328 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:24.731 [2024-04-16 23:02:01.089054] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:24.731 [2024-04-16 23:02:01.089069] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:121 nsid:1 lba:119336 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:24.731 [2024-04-16 23:02:01.089082] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:24.731 [2024-04-16 23:02:01.089098] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:33 nsid:1 lba:119344 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:24.731 [2024-04-16 23:02:01.089111] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:24.731 [2024-04-16 23:02:01.089126] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:38 nsid:1 lba:119352 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:24.731 [2024-04-16 23:02:01.089139] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:24.731 [2024-04-16 23:02:01.089154] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:34 nsid:1 lba:119360 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:24.731 [2024-04-16 23:02:01.089168] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:24.731 [2024-04-16 23:02:01.089204] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:119368 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:24.731 [2024-04-16 23:02:01.089220] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:24.731 [2024-04-16 23:02:01.089236] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:93 nsid:1 lba:118816 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:24.731 [2024-04-16 23:02:01.089250] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:24.731 [2024-04-16 23:02:01.089265] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:87 nsid:1 lba:118824 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:24.731 [2024-04-16 23:02:01.089279] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:24.731 [2024-04-16 23:02:01.089295] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:95 nsid:1 lba:118840 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:24.731 [2024-04-16 23:02:01.089308] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:24.731 [2024-04-16 23:02:01.089323] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:118856 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:24.731 [2024-04-16 23:02:01.089337] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:24.732 [2024-04-16 23:02:01.089357] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:73 nsid:1 lba:118880 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:24.732 [2024-04-16 23:02:01.089371] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:24.732 [2024-04-16 23:02:01.089386] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:17 nsid:1 lba:118888 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:24.732 [2024-04-16 23:02:01.089400] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:24.732 [2024-04-16 23:02:01.089416] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:123 nsid:1 lba:118912 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:24.732 [2024-04-16 23:02:01.089435] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:24.732 [2024-04-16 23:02:01.089451] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x8e9600 is same with the state(5) to be set 00:24:24.732 [2024-04-16 23:02:01.089468] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:24:24.732 [2024-04-16 23:02:01.089480] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:24:24.732 [2024-04-16 23:02:01.089508] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:118936 len:8 PRP1 0x0 PRP2 0x0 00:24:24.732 [2024-04-16 23:02:01.089520] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:24.732 [2024-04-16 23:02:01.089582] bdev_nvme.c:1576:bdev_nvme_disconnected_qpair_cb: *NOTICE*: qpair 0x8e9600 was disconnected and freed. reset controller. 00:24:24.732 [2024-04-16 23:02:01.089601] bdev_nvme.c:1829:bdev_nvme_failover_trid: *NOTICE*: Start failover from 10.0.0.2:4420 to 10.0.0.2:4421 00:24:24.732 [2024-04-16 23:02:01.089632] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:24:24.732 [2024-04-16 23:02:01.089665] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:24.732 [2024-04-16 23:02:01.089681] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:24:24.732 [2024-04-16 23:02:01.089695] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:24.732 [2024-04-16 23:02:01.089708] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:24:24.732 [2024-04-16 23:02:01.089721] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:24.732 [2024-04-16 23:02:01.089734] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:24:24.732 [2024-04-16 23:02:01.089747] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:24.732 [2024-04-16 23:02:01.089760] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:24.732 [2024-04-16 23:02:01.089801] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x8cabd0 (9): Bad file descriptor 00:24:24.732 [2024-04-16 23:02:01.092014] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:24.732 [2024-04-16 23:02:01.119561] bdev_nvme.c:2026:_bdev_nvme_reset_ctrlr_complete: *NOTICE*: Resetting controller successful. 00:24:24.732 [2024-04-16 23:02:04.703135] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:38 nsid:1 lba:111640 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:24.732 [2024-04-16 23:02:04.703197] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:24.732 [2024-04-16 23:02:04.703237] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:60 nsid:1 lba:111656 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:24.732 [2024-04-16 23:02:04.703255] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:24.732 [2024-04-16 23:02:04.703271] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:59 nsid:1 lba:111664 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:24.732 [2024-04-16 23:02:04.703285] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:24.732 [2024-04-16 23:02:04.703301] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:56 nsid:1 lba:111680 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:24.732 [2024-04-16 23:02:04.703314] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:24.732 [2024-04-16 23:02:04.703329] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:111704 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:24.732 [2024-04-16 23:02:04.703342] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:24.732 [2024-04-16 23:02:04.703357] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:28 nsid:1 lba:111712 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:24.732 [2024-04-16 23:02:04.703370] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:24.732 [2024-04-16 23:02:04.703400] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:42 nsid:1 lba:111736 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:24.732 [2024-04-16 23:02:04.703413] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:24.732 [2024-04-16 23:02:04.703428] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:121 nsid:1 lba:111760 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:24.732 [2024-04-16 23:02:04.703442] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:24.732 [2024-04-16 23:02:04.703456] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:34 nsid:1 lba:111768 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:24.732 [2024-04-16 23:02:04.703484] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:24.732 [2024-04-16 23:02:04.703499] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:62 nsid:1 lba:111800 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:24.732 [2024-04-16 23:02:04.703512] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:24.732 [2024-04-16 23:02:04.703527] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:45 nsid:1 lba:111808 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:24.732 [2024-04-16 23:02:04.703540] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:24.732 [2024-04-16 23:02:04.703554] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:52 nsid:1 lba:111048 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:24.732 [2024-04-16 23:02:04.703566] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:24.732 [2024-04-16 23:02:04.703581] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:102 nsid:1 lba:111056 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:24.732 [2024-04-16 23:02:04.703593] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:24.732 [2024-04-16 23:02:04.703607] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:124 nsid:1 lba:111064 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:24.732 [2024-04-16 23:02:04.703624] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:24.732 [2024-04-16 23:02:04.703638] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:63 nsid:1 lba:111072 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:24.732 [2024-04-16 23:02:04.703651] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:24.732 [2024-04-16 23:02:04.703665] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:61 nsid:1 lba:111080 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:24.732 [2024-04-16 23:02:04.703678] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:24.732 [2024-04-16 23:02:04.703692] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:30 nsid:1 lba:111104 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:24.732 [2024-04-16 23:02:04.703704] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:24.732 [2024-04-16 23:02:04.703719] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:111120 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:24.732 [2024-04-16 23:02:04.703732] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:24.732 [2024-04-16 23:02:04.703746] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:77 nsid:1 lba:111160 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:24.732 [2024-04-16 23:02:04.703758] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:24.732 [2024-04-16 23:02:04.703772] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:116 nsid:1 lba:111168 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:24.732 [2024-04-16 23:02:04.703785] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:24.732 [2024-04-16 23:02:04.703799] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:100 nsid:1 lba:111176 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:24.732 [2024-04-16 23:02:04.703811] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:24.732 [2024-04-16 23:02:04.703826] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:98 nsid:1 lba:111192 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:24.732 [2024-04-16 23:02:04.703838] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:24.732 [2024-04-16 23:02:04.703852] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:111200 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:24.732 [2024-04-16 23:02:04.703865] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:24.732 [2024-04-16 23:02:04.703879] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:112 nsid:1 lba:111216 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:24.732 [2024-04-16 23:02:04.703891] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:24.732 [2024-04-16 23:02:04.703905] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:111232 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:24.732 [2024-04-16 23:02:04.703918] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:24.732 [2024-04-16 23:02:04.703932] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:105 nsid:1 lba:111248 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:24.732 [2024-04-16 23:02:04.703944] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:24.732 [2024-04-16 23:02:04.703961] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:16 nsid:1 lba:111280 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:24.732 [2024-04-16 23:02:04.703975] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:24.732 [2024-04-16 23:02:04.703989] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:18 nsid:1 lba:111816 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:24.732 [2024-04-16 23:02:04.704002] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:24.733 [2024-04-16 23:02:04.704016] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:108 nsid:1 lba:111840 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:24.733 [2024-04-16 23:02:04.704029] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:24.733 [2024-04-16 23:02:04.704043] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:78 nsid:1 lba:111848 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:24.733 [2024-04-16 23:02:04.704056] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:24.733 [2024-04-16 23:02:04.704070] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:85 nsid:1 lba:111856 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:24.733 [2024-04-16 23:02:04.704083] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:24.733 [2024-04-16 23:02:04.704097] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:96 nsid:1 lba:111864 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:24.733 [2024-04-16 23:02:04.704109] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:24.733 [2024-04-16 23:02:04.704124] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:97 nsid:1 lba:111880 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:24.733 [2024-04-16 23:02:04.704137] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:24.733 [2024-04-16 23:02:04.704152] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:74 nsid:1 lba:111888 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:24.733 [2024-04-16 23:02:04.704167] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:24.733 [2024-04-16 23:02:04.704206] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:53 nsid:1 lba:111904 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:24.733 [2024-04-16 23:02:04.704223] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:24.733 [2024-04-16 23:02:04.704239] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:111912 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:24.733 [2024-04-16 23:02:04.704253] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:24.733 [2024-04-16 23:02:04.704270] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:113 nsid:1 lba:111920 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:24.733 [2024-04-16 23:02:04.704283] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:24.733 [2024-04-16 23:02:04.704297] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:36 nsid:1 lba:111928 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:24.733 [2024-04-16 23:02:04.704310] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:24.733 [2024-04-16 23:02:04.704325] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:40 nsid:1 lba:111288 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:24.733 [2024-04-16 23:02:04.704341] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:24.733 [2024-04-16 23:02:04.704356] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:115 nsid:1 lba:111296 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:24.733 [2024-04-16 23:02:04.704370] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:24.733 [2024-04-16 23:02:04.704384] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:70 nsid:1 lba:111304 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:24.733 [2024-04-16 23:02:04.704397] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:24.733 [2024-04-16 23:02:04.704412] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:24 nsid:1 lba:111328 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:24.733 [2024-04-16 23:02:04.704426] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:24.733 [2024-04-16 23:02:04.704440] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:33 nsid:1 lba:111336 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:24.733 [2024-04-16 23:02:04.704456] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:24.733 [2024-04-16 23:02:04.704471] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:67 nsid:1 lba:111344 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:24.733 [2024-04-16 23:02:04.704499] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:24.733 [2024-04-16 23:02:04.704515] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:35 nsid:1 lba:111352 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:24.733 [2024-04-16 23:02:04.704527] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:24.733 [2024-04-16 23:02:04.704541] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:118 nsid:1 lba:111368 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:24.733 [2024-04-16 23:02:04.704554] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:24.733 [2024-04-16 23:02:04.704568] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:65 nsid:1 lba:111936 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:24.733 [2024-04-16 23:02:04.704581] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:24.733 [2024-04-16 23:02:04.704596] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:89 nsid:1 lba:111944 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:24.733 [2024-04-16 23:02:04.704608] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:24.733 [2024-04-16 23:02:04.704622] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:99 nsid:1 lba:111952 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:24.733 [2024-04-16 23:02:04.704637] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:24.733 [2024-04-16 23:02:04.704651] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:26 nsid:1 lba:111960 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:24.733 [2024-04-16 23:02:04.704664] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:24.733 [2024-04-16 23:02:04.704678] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:55 nsid:1 lba:111968 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:24.733 [2024-04-16 23:02:04.704691] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:24.733 [2024-04-16 23:02:04.704705] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:111976 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:24.733 [2024-04-16 23:02:04.704722] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:24.733 [2024-04-16 23:02:04.704736] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:25 nsid:1 lba:111984 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:24.733 [2024-04-16 23:02:04.704749] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:24.733 [2024-04-16 23:02:04.704763] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:47 nsid:1 lba:111992 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:24.733 [2024-04-16 23:02:04.704776] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:24.733 [2024-04-16 23:02:04.704790] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:20 nsid:1 lba:112000 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:24.733 [2024-04-16 23:02:04.704803] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:24.733 [2024-04-16 23:02:04.704823] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:46 nsid:1 lba:112008 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:24.733 [2024-04-16 23:02:04.704836] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:24.733 [2024-04-16 23:02:04.704850] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:88 nsid:1 lba:112016 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:24.733 [2024-04-16 23:02:04.704863] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:24.733 [2024-04-16 23:02:04.704877] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:32 nsid:1 lba:112024 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:24.733 [2024-04-16 23:02:04.704890] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:24.733 [2024-04-16 23:02:04.704904] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:64 nsid:1 lba:112032 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:24.733 [2024-04-16 23:02:04.704917] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:24.733 [2024-04-16 23:02:04.704931] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:117 nsid:1 lba:112040 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:24.733 [2024-04-16 23:02:04.704944] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:24.734 [2024-04-16 23:02:04.704957] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:57 nsid:1 lba:112048 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:24.734 [2024-04-16 23:02:04.704970] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:24.734 [2024-04-16 23:02:04.704984] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:68 nsid:1 lba:111376 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:24.734 [2024-04-16 23:02:04.704997] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:24.734 [2024-04-16 23:02:04.705010] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:120 nsid:1 lba:111408 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:24.734 [2024-04-16 23:02:04.705023] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:24.734 [2024-04-16 23:02:04.705038] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:111424 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:24.734 [2024-04-16 23:02:04.705050] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:24.734 [2024-04-16 23:02:04.705068] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:109 nsid:1 lba:111432 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:24.734 [2024-04-16 23:02:04.705082] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:24.734 [2024-04-16 23:02:04.705096] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:50 nsid:1 lba:111448 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:24.734 [2024-04-16 23:02:04.705110] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:24.734 [2024-04-16 23:02:04.705125] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:106 nsid:1 lba:111480 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:24.734 [2024-04-16 23:02:04.705138] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:24.734 [2024-04-16 23:02:04.705151] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:122 nsid:1 lba:111488 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:24.734 [2024-04-16 23:02:04.705164] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:24.734 [2024-04-16 23:02:04.705199] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:82 nsid:1 lba:111496 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:24.734 [2024-04-16 23:02:04.705216] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:24.734 [2024-04-16 23:02:04.705231] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:114 nsid:1 lba:112056 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:24.734 [2024-04-16 23:02:04.705244] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:24.734 [2024-04-16 23:02:04.705259] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:112064 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:24.734 [2024-04-16 23:02:04.705272] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:24.734 [2024-04-16 23:02:04.705293] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:107 nsid:1 lba:112072 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:24.734 [2024-04-16 23:02:04.705308] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:24.734 [2024-04-16 23:02:04.705322] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:104 nsid:1 lba:112080 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:24.734 [2024-04-16 23:02:04.705336] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:24.734 [2024-04-16 23:02:04.705350] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:21 nsid:1 lba:112088 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:24.734 [2024-04-16 23:02:04.705363] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:24.734 [2024-04-16 23:02:04.705378] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:79 nsid:1 lba:112096 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:24.734 [2024-04-16 23:02:04.705390] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:24.734 [2024-04-16 23:02:04.705405] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:126 nsid:1 lba:112104 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:24.734 [2024-04-16 23:02:04.705418] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:24.734 [2024-04-16 23:02:04.705432] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:87 nsid:1 lba:112112 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:24.734 [2024-04-16 23:02:04.705449] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:24.734 [2024-04-16 23:02:04.705464] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:101 nsid:1 lba:112120 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:24.734 [2024-04-16 23:02:04.705477] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:24.734 [2024-04-16 23:02:04.705506] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:110 nsid:1 lba:112128 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:24.734 [2024-04-16 23:02:04.705520] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:24.734 [2024-04-16 23:02:04.705533] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:111 nsid:1 lba:112136 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:24.734 [2024-04-16 23:02:04.705546] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:24.734 [2024-04-16 23:02:04.705560] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:71 nsid:1 lba:111520 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:24.734 [2024-04-16 23:02:04.705573] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:24.734 [2024-04-16 23:02:04.705588] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:111536 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:24.734 [2024-04-16 23:02:04.705600] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:24.734 [2024-04-16 23:02:04.705614] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:86 nsid:1 lba:111552 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:24.734 [2024-04-16 23:02:04.705627] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:24.734 [2024-04-16 23:02:04.705642] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:49 nsid:1 lba:111560 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:24.734 [2024-04-16 23:02:04.705655] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:24.734 [2024-04-16 23:02:04.705668] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:58 nsid:1 lba:111568 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:24.734 [2024-04-16 23:02:04.705681] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:24.734 [2024-04-16 23:02:04.705695] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:75 nsid:1 lba:111584 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:24.734 [2024-04-16 23:02:04.705707] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:24.734 [2024-04-16 23:02:04.705721] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:95 nsid:1 lba:111592 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:24.734 [2024-04-16 23:02:04.705734] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:24.734 [2024-04-16 23:02:04.705749] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:73 nsid:1 lba:111608 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:24.734 [2024-04-16 23:02:04.705762] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:24.734 [2024-04-16 23:02:04.705776] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:41 nsid:1 lba:112144 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:24.734 [2024-04-16 23:02:04.705788] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:24.734 [2024-04-16 23:02:04.705806] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:84 nsid:1 lba:112152 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:24.734 [2024-04-16 23:02:04.705820] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:24.734 [2024-04-16 23:02:04.705834] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:27 nsid:1 lba:112160 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:24.734 [2024-04-16 23:02:04.705846] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:24.734 [2024-04-16 23:02:04.705862] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:3 nsid:1 lba:112168 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:24.734 [2024-04-16 23:02:04.705875] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:24.734 [2024-04-16 23:02:04.705889] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:39 nsid:1 lba:112176 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:24.734 [2024-04-16 23:02:04.705901] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:24.734 [2024-04-16 23:02:04.705915] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:51 nsid:1 lba:112184 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:24.734 [2024-04-16 23:02:04.705928] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:24.734 [2024-04-16 23:02:04.705942] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:92 nsid:1 lba:112192 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:24.734 [2024-04-16 23:02:04.705955] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:24.734 [2024-04-16 23:02:04.705969] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:44 nsid:1 lba:112200 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:24.734 [2024-04-16 23:02:04.705981] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:24.734 [2024-04-16 23:02:04.705995] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:54 nsid:1 lba:112208 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:24.734 [2024-04-16 23:02:04.706008] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:24.734 [2024-04-16 23:02:04.706022] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:22 nsid:1 lba:112216 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:24.734 [2024-04-16 23:02:04.706035] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:24.734 [2024-04-16 23:02:04.706048] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:93 nsid:1 lba:112224 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:24.734 [2024-04-16 23:02:04.706061] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:24.734 [2024-04-16 23:02:04.706075] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:66 nsid:1 lba:112232 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:24.735 [2024-04-16 23:02:04.706088] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:24.735 [2024-04-16 23:02:04.706103] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:103 nsid:1 lba:112240 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:24.735 [2024-04-16 23:02:04.706116] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:24.735 [2024-04-16 23:02:04.706130] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:7 nsid:1 lba:112248 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:24.735 [2024-04-16 23:02:04.706147] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:24.735 [2024-04-16 23:02:04.706182] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:112256 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:24.735 [2024-04-16 23:02:04.706197] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:24.735 [2024-04-16 23:02:04.706212] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:90 nsid:1 lba:112264 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:24.735 [2024-04-16 23:02:04.706242] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:24.735 [2024-04-16 23:02:04.706258] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:123 nsid:1 lba:112272 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:24.735 [2024-04-16 23:02:04.706272] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:24.735 [2024-04-16 23:02:04.706287] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:112280 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:24.735 [2024-04-16 23:02:04.706300] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:24.735 [2024-04-16 23:02:04.706315] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:29 nsid:1 lba:112288 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:24.735 [2024-04-16 23:02:04.706329] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:24.735 [2024-04-16 23:02:04.706344] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:14 nsid:1 lba:112296 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:24.735 [2024-04-16 23:02:04.706357] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:24.735 [2024-04-16 23:02:04.706372] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:91 nsid:1 lba:112304 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:24.735 [2024-04-16 23:02:04.706391] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:24.735 [2024-04-16 23:02:04.706407] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:119 nsid:1 lba:112312 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:24.735 [2024-04-16 23:02:04.706421] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:24.735 [2024-04-16 23:02:04.706436] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:19 nsid:1 lba:112320 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:24.735 [2024-04-16 23:02:04.706450] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:24.735 [2024-04-16 23:02:04.706465] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:112328 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:24.735 [2024-04-16 23:02:04.706478] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:24.735 [2024-04-16 23:02:04.706493] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:17 nsid:1 lba:111632 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:24.735 [2024-04-16 23:02:04.706508] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:24.735 [2024-04-16 23:02:04.706539] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:111648 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:24.735 [2024-04-16 23:02:04.706553] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:24.735 [2024-04-16 23:02:04.706572] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:76 nsid:1 lba:111672 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:24.735 [2024-04-16 23:02:04.706586] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:24.735 [2024-04-16 23:02:04.706601] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:80 nsid:1 lba:111688 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:24.735 [2024-04-16 23:02:04.706615] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:24.735 [2024-04-16 23:02:04.706630] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:48 nsid:1 lba:111696 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:24.735 [2024-04-16 23:02:04.706643] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:24.735 [2024-04-16 23:02:04.706658] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:69 nsid:1 lba:111720 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:24.735 [2024-04-16 23:02:04.706671] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:24.735 [2024-04-16 23:02:04.706686] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:81 nsid:1 lba:111728 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:24.735 [2024-04-16 23:02:04.706700] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:24.735 [2024-04-16 23:02:04.706715] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:37 nsid:1 lba:111744 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:24.735 [2024-04-16 23:02:04.706728] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:24.735 [2024-04-16 23:02:04.706743] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:72 nsid:1 lba:111752 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:24.735 [2024-04-16 23:02:04.706756] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:24.735 [2024-04-16 23:02:04.706771] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:94 nsid:1 lba:111776 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:24.735 [2024-04-16 23:02:04.706785] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:24.735 [2024-04-16 23:02:04.706799] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:43 nsid:1 lba:111784 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:24.735 [2024-04-16 23:02:04.706812] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:24.735 [2024-04-16 23:02:04.706827] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:23 nsid:1 lba:111792 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:24.735 [2024-04-16 23:02:04.706841] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:24.735 [2024-04-16 23:02:04.706856] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:125 nsid:1 lba:111824 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:24.735 [2024-04-16 23:02:04.706875] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:24.735 [2024-04-16 23:02:04.706891] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:83 nsid:1 lba:111832 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:24.735 [2024-04-16 23:02:04.706905] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:24.735 [2024-04-16 23:02:04.706920] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:31 nsid:1 lba:111872 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:24.735 [2024-04-16 23:02:04.706938] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:24.735 [2024-04-16 23:02:04.706953] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x8d7050 is same with the state(5) to be set 00:24:24.735 [2024-04-16 23:02:04.706969] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:24:24.735 [2024-04-16 23:02:04.706981] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:24:24.735 [2024-04-16 23:02:04.706999] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:111896 len:8 PRP1 0x0 PRP2 0x0 00:24:24.735 [2024-04-16 23:02:04.707012] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:24.735 [2024-04-16 23:02:04.707076] bdev_nvme.c:1576:bdev_nvme_disconnected_qpair_cb: *NOTICE*: qpair 0x8d7050 was disconnected and freed. reset controller. 00:24:24.735 [2024-04-16 23:02:04.707094] bdev_nvme.c:1829:bdev_nvme_failover_trid: *NOTICE*: Start failover from 10.0.0.2:4421 to 10.0.0.2:4422 00:24:24.735 [2024-04-16 23:02:04.707138] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:24:24.735 [2024-04-16 23:02:04.707157] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:24.735 [2024-04-16 23:02:04.707172] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:24:24.735 [2024-04-16 23:02:04.707193] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:24.735 [2024-04-16 23:02:04.707206] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:24:24.735 [2024-04-16 23:02:04.707220] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:24.735 [2024-04-16 23:02:04.707233] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:24:24.735 [2024-04-16 23:02:04.707247] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:24.735 [2024-04-16 23:02:04.707259] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:24.735 [2024-04-16 23:02:04.707312] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x8cabd0 (9): Bad file descriptor 00:24:24.735 [2024-04-16 23:02:04.709447] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:24.735 [2024-04-16 23:02:04.864839] bdev_nvme.c:2026:_bdev_nvme_reset_ctrlr_complete: *NOTICE*: Resetting controller successful. 00:24:24.735 [2024-04-16 23:02:09.202283] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:24:24.735 [2024-04-16 23:02:09.202357] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:24.735 [2024-04-16 23:02:09.202384] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:24:24.735 [2024-04-16 23:02:09.202399] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:24.735 [2024-04-16 23:02:09.202414] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:24:24.735 [2024-04-16 23:02:09.202427] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:24.735 [2024-04-16 23:02:09.202441] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:24:24.735 [2024-04-16 23:02:09.202470] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:24.736 [2024-04-16 23:02:09.202489] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x8cabd0 is same with the state(5) to be set 00:24:24.736 [2024-04-16 23:02:09.203641] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:117320 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:24.736 [2024-04-16 23:02:09.203667] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:24.736 [2024-04-16 23:02:09.203692] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:55 nsid:1 lba:117344 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:24.736 [2024-04-16 23:02:09.203708] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:24.736 [2024-04-16 23:02:09.203724] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:36 nsid:1 lba:117352 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:24.736 [2024-04-16 23:02:09.203739] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:24.736 [2024-04-16 23:02:09.203754] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:116 nsid:1 lba:117360 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:24.736 [2024-04-16 23:02:09.203768] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:24.736 [2024-04-16 23:02:09.203784] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:125 nsid:1 lba:117376 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:24.736 [2024-04-16 23:02:09.203798] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:24.736 [2024-04-16 23:02:09.203813] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:87 nsid:1 lba:117896 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:24.736 [2024-04-16 23:02:09.203827] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:24.736 [2024-04-16 23:02:09.203843] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:28 nsid:1 lba:117904 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:24.736 [2024-04-16 23:02:09.203856] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:24.736 [2024-04-16 23:02:09.203872] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:76 nsid:1 lba:117912 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:24.736 [2024-04-16 23:02:09.203885] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:24.736 [2024-04-16 23:02:09.203916] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:117 nsid:1 lba:117920 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:24.736 [2024-04-16 23:02:09.203929] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:24.736 [2024-04-16 23:02:09.203944] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:102 nsid:1 lba:117928 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:24.736 [2024-04-16 23:02:09.203957] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:24.736 [2024-04-16 23:02:09.203986] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:37 nsid:1 lba:117936 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:24.736 [2024-04-16 23:02:09.203999] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:24.736 [2024-04-16 23:02:09.204013] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:95 nsid:1 lba:117960 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:24.736 [2024-04-16 23:02:09.204026] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:24.736 [2024-04-16 23:02:09.204045] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:31 nsid:1 lba:117384 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:24.736 [2024-04-16 23:02:09.204058] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:24.736 [2024-04-16 23:02:09.204072] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:38 nsid:1 lba:117416 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:24.736 [2024-04-16 23:02:09.204085] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:24.736 [2024-04-16 23:02:09.204099] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:98 nsid:1 lba:117448 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:24.736 [2024-04-16 23:02:09.204111] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:24.736 [2024-04-16 23:02:09.204125] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:58 nsid:1 lba:117456 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:24.736 [2024-04-16 23:02:09.204138] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:24.736 [2024-04-16 23:02:09.204152] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:34 nsid:1 lba:117464 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:24.736 [2024-04-16 23:02:09.204208] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:24.736 [2024-04-16 23:02:09.204227] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:79 nsid:1 lba:117480 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:24.736 [2024-04-16 23:02:09.204255] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:24.736 [2024-04-16 23:02:09.204271] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:59 nsid:1 lba:117512 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:24.736 [2024-04-16 23:02:09.204285] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:24.736 [2024-04-16 23:02:09.204300] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:100 nsid:1 lba:117520 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:24.736 [2024-04-16 23:02:09.204313] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:24.736 [2024-04-16 23:02:09.204328] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:27 nsid:1 lba:117984 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:24.736 [2024-04-16 23:02:09.204342] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:24.736 [2024-04-16 23:02:09.204357] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:48 nsid:1 lba:118000 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:24.736 [2024-04-16 23:02:09.204370] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:24.736 [2024-04-16 23:02:09.204385] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:117552 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:24.736 [2024-04-16 23:02:09.204399] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:24.736 [2024-04-16 23:02:09.204413] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:81 nsid:1 lba:117560 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:24.736 [2024-04-16 23:02:09.204427] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:24.736 [2024-04-16 23:02:09.204441] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:32 nsid:1 lba:117568 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:24.736 [2024-04-16 23:02:09.204475] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:24.736 [2024-04-16 23:02:09.204491] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:74 nsid:1 lba:117576 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:24.736 [2024-04-16 23:02:09.204505] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:24.736 [2024-04-16 23:02:09.204520] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:117592 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:24.736 [2024-04-16 23:02:09.204533] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:24.736 [2024-04-16 23:02:09.204548] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:50 nsid:1 lba:117600 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:24.736 [2024-04-16 23:02:09.204561] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:24.736 [2024-04-16 23:02:09.204589] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:20 nsid:1 lba:117608 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:24.736 [2024-04-16 23:02:09.204603] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:24.736 [2024-04-16 23:02:09.204617] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:115 nsid:1 lba:117616 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:24.736 [2024-04-16 23:02:09.204630] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:24.736 [2024-04-16 23:02:09.204644] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:29 nsid:1 lba:118032 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:24.736 [2024-04-16 23:02:09.204657] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:24.736 [2024-04-16 23:02:09.204671] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:70 nsid:1 lba:118064 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:24.736 [2024-04-16 23:02:09.204683] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:24.736 [2024-04-16 23:02:09.204698] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:23 nsid:1 lba:118072 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:24.736 [2024-04-16 23:02:09.204716] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:24.736 [2024-04-16 23:02:09.204731] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:40 nsid:1 lba:118080 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:24.736 [2024-04-16 23:02:09.204744] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:24.736 [2024-04-16 23:02:09.204758] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:101 nsid:1 lba:118088 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:24.736 [2024-04-16 23:02:09.204771] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:24.736 [2024-04-16 23:02:09.204786] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:97 nsid:1 lba:118096 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:24.736 [2024-04-16 23:02:09.204798] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:24.736 [2024-04-16 23:02:09.204812] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:84 nsid:1 lba:118104 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:24.736 [2024-04-16 23:02:09.204825] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:24.736 [2024-04-16 23:02:09.204842] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:118112 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:24.736 [2024-04-16 23:02:09.204855] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:24.736 [2024-04-16 23:02:09.204869] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:41 nsid:1 lba:118120 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:24.736 [2024-04-16 23:02:09.204882] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:24.737 [2024-04-16 23:02:09.204896] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:122 nsid:1 lba:118128 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:24.737 [2024-04-16 23:02:09.204909] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:24.737 [2024-04-16 23:02:09.204923] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:62 nsid:1 lba:118136 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:24.737 [2024-04-16 23:02:09.204935] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:24.737 [2024-04-16 23:02:09.204949] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:64 nsid:1 lba:118144 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:24.737 [2024-04-16 23:02:09.204962] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:24.737 [2024-04-16 23:02:09.204976] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:123 nsid:1 lba:118152 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:24.737 [2024-04-16 23:02:09.204988] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:24.737 [2024-04-16 23:02:09.205002] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:66 nsid:1 lba:118160 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:24.737 [2024-04-16 23:02:09.205015] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:24.737 [2024-04-16 23:02:09.205029] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:46 nsid:1 lba:118168 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:24.737 [2024-04-16 23:02:09.205042] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:24.737 [2024-04-16 23:02:09.205063] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:86 nsid:1 lba:118176 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:24.737 [2024-04-16 23:02:09.205075] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:24.737 [2024-04-16 23:02:09.205089] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:52 nsid:1 lba:118184 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:24.737 [2024-04-16 23:02:09.205102] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:24.737 [2024-04-16 23:02:09.205115] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:61 nsid:1 lba:118192 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:24.737 [2024-04-16 23:02:09.205128] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:24.737 [2024-04-16 23:02:09.205142] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:118200 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:24.737 [2024-04-16 23:02:09.205191] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:24.737 [2024-04-16 23:02:09.205209] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:121 nsid:1 lba:118208 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:24.737 [2024-04-16 23:02:09.205241] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:24.737 [2024-04-16 23:02:09.205257] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:12 nsid:1 lba:118216 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:24.737 [2024-04-16 23:02:09.205271] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:24.737 [2024-04-16 23:02:09.205285] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:21 nsid:1 lba:118224 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:24.737 [2024-04-16 23:02:09.205298] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:24.737 [2024-04-16 23:02:09.205313] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:49 nsid:1 lba:118232 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:24.737 [2024-04-16 23:02:09.205326] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:24.737 [2024-04-16 23:02:09.205340] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:63 nsid:1 lba:118240 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:24.737 [2024-04-16 23:02:09.205354] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:24.737 [2024-04-16 23:02:09.205369] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:118248 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:24.737 [2024-04-16 23:02:09.205382] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:24.737 [2024-04-16 23:02:09.205396] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:93 nsid:1 lba:117632 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:24.737 [2024-04-16 23:02:09.205410] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:24.737 [2024-04-16 23:02:09.205424] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:51 nsid:1 lba:117640 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:24.737 [2024-04-16 23:02:09.205437] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:24.737 [2024-04-16 23:02:09.205452] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:117648 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:24.737 [2024-04-16 23:02:09.205480] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:24.737 [2024-04-16 23:02:09.205502] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:42 nsid:1 lba:117656 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:24.737 [2024-04-16 23:02:09.205515] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:24.737 [2024-04-16 23:02:09.205530] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:80 nsid:1 lba:117672 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:24.737 [2024-04-16 23:02:09.205543] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:24.737 [2024-04-16 23:02:09.205556] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:113 nsid:1 lba:117688 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:24.737 [2024-04-16 23:02:09.205569] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:24.737 [2024-04-16 23:02:09.205583] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:117696 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:24.737 [2024-04-16 23:02:09.205597] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:24.737 [2024-04-16 23:02:09.205614] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:26 nsid:1 lba:117720 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:24.737 [2024-04-16 23:02:09.205628] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:24.737 [2024-04-16 23:02:09.205642] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:90 nsid:1 lba:118256 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:24.737 [2024-04-16 23:02:09.205655] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:24.737 [2024-04-16 23:02:09.205670] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:60 nsid:1 lba:118264 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:24.737 [2024-04-16 23:02:09.205688] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:24.737 [2024-04-16 23:02:09.205702] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:111 nsid:1 lba:118272 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:24.737 [2024-04-16 23:02:09.205715] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:24.737 [2024-04-16 23:02:09.205729] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:47 nsid:1 lba:118280 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:24.737 [2024-04-16 23:02:09.205742] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:24.737 [2024-04-16 23:02:09.205756] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:85 nsid:1 lba:118288 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:24.737 [2024-04-16 23:02:09.205769] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:24.737 [2024-04-16 23:02:09.205782] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:114 nsid:1 lba:118296 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:24.737 [2024-04-16 23:02:09.205802] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:24.737 [2024-04-16 23:02:09.205816] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:17 nsid:1 lba:118304 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:24.737 [2024-04-16 23:02:09.205828] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:24.737 [2024-04-16 23:02:09.205842] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:25 nsid:1 lba:118312 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:24.737 [2024-04-16 23:02:09.205854] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:24.737 [2024-04-16 23:02:09.205868] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:126 nsid:1 lba:118320 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:24.737 [2024-04-16 23:02:09.205881] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:24.737 [2024-04-16 23:02:09.205895] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:43 nsid:1 lba:118328 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:24.737 [2024-04-16 23:02:09.205908] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:24.737 [2024-04-16 23:02:09.205921] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:24 nsid:1 lba:117752 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:24.738 [2024-04-16 23:02:09.205934] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:24.738 [2024-04-16 23:02:09.205947] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:57 nsid:1 lba:117760 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:24.738 [2024-04-16 23:02:09.205960] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:24.738 [2024-04-16 23:02:09.205979] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:69 nsid:1 lba:117784 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:24.738 [2024-04-16 23:02:09.206004] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:24.738 [2024-04-16 23:02:09.206019] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:53 nsid:1 lba:117792 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:24.738 [2024-04-16 23:02:09.206033] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:24.738 [2024-04-16 23:02:09.206048] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:35 nsid:1 lba:117832 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:24.738 [2024-04-16 23:02:09.206061] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:24.738 [2024-04-16 23:02:09.206081] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:94 nsid:1 lba:117944 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:24.738 [2024-04-16 23:02:09.206094] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:24.738 [2024-04-16 23:02:09.206109] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:112 nsid:1 lba:117952 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:24.738 [2024-04-16 23:02:09.206122] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:24.738 [2024-04-16 23:02:09.206136] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:105 nsid:1 lba:117968 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:24.738 [2024-04-16 23:02:09.206186] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:24.738 [2024-04-16 23:02:09.206204] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:22 nsid:1 lba:118336 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:24.738 [2024-04-16 23:02:09.206218] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:24.738 [2024-04-16 23:02:09.206232] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:99 nsid:1 lba:118344 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:24.738 [2024-04-16 23:02:09.206246] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:24.738 [2024-04-16 23:02:09.206261] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:118352 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:24.738 [2024-04-16 23:02:09.206273] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:24.738 [2024-04-16 23:02:09.206289] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:120 nsid:1 lba:118360 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:24.738 [2024-04-16 23:02:09.206303] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:24.738 [2024-04-16 23:02:09.206318] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:118368 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:24.738 [2024-04-16 23:02:09.206332] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:24.738 [2024-04-16 23:02:09.206346] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:67 nsid:1 lba:118376 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:24.738 [2024-04-16 23:02:09.206360] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:24.738 [2024-04-16 23:02:09.206374] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:118384 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:24.738 [2024-04-16 23:02:09.206391] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:24.738 [2024-04-16 23:02:09.206406] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:54 nsid:1 lba:118392 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:24.738 [2024-04-16 23:02:09.206420] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:24.738 [2024-04-16 23:02:09.206434] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:124 nsid:1 lba:118400 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:24.738 [2024-04-16 23:02:09.206448] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:24.738 [2024-04-16 23:02:09.206463] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:104 nsid:1 lba:118408 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:24.738 [2024-04-16 23:02:09.206477] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:24.738 [2024-04-16 23:02:09.206492] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:44 nsid:1 lba:118416 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:24.738 [2024-04-16 23:02:09.206505] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:24.738 [2024-04-16 23:02:09.206519] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:107 nsid:1 lba:118424 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:24.738 [2024-04-16 23:02:09.206532] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:24.738 [2024-04-16 23:02:09.206547] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:118 nsid:1 lba:118432 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:24.738 [2024-04-16 23:02:09.206560] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:24.738 [2024-04-16 23:02:09.206581] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:92 nsid:1 lba:118440 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:24.738 [2024-04-16 23:02:09.206596] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:24.738 [2024-04-16 23:02:09.206611] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:91 nsid:1 lba:118448 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:24.738 [2024-04-16 23:02:09.206625] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:24.738 [2024-04-16 23:02:09.206639] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:110 nsid:1 lba:118456 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:24.738 [2024-04-16 23:02:09.206657] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:24.738 [2024-04-16 23:02:09.206672] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:119 nsid:1 lba:118464 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:24.738 [2024-04-16 23:02:09.206685] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:24.738 [2024-04-16 23:02:09.206699] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:82 nsid:1 lba:118472 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:24.738 [2024-04-16 23:02:09.206713] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:24.738 [2024-04-16 23:02:09.206727] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:77 nsid:1 lba:118480 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:24.738 [2024-04-16 23:02:09.206740] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:24.738 [2024-04-16 23:02:09.206758] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:96 nsid:1 lba:118488 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:24.738 [2024-04-16 23:02:09.206772] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:24.738 [2024-04-16 23:02:09.206786] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:33 nsid:1 lba:118496 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:24.738 [2024-04-16 23:02:09.206799] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:24.738 [2024-04-16 23:02:09.206813] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:71 nsid:1 lba:118504 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:24.738 [2024-04-16 23:02:09.206826] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:24.738 [2024-04-16 23:02:09.206841] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:73 nsid:1 lba:118512 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:24.738 [2024-04-16 23:02:09.206854] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:24.738 [2024-04-16 23:02:09.206868] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:88 nsid:1 lba:118520 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:24.738 [2024-04-16 23:02:09.206881] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:24.738 [2024-04-16 23:02:09.206896] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:18 nsid:1 lba:118528 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:24.738 [2024-04-16 23:02:09.206910] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:24.738 [2024-04-16 23:02:09.206925] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:118536 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:24.738 [2024-04-16 23:02:09.206938] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:24.738 [2024-04-16 23:02:09.206953] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:72 nsid:1 lba:118544 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:24.738 [2024-04-16 23:02:09.206966] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:24.738 [2024-04-16 23:02:09.206981] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:56 nsid:1 lba:118552 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:24.738 [2024-04-16 23:02:09.206994] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:24.738 [2024-04-16 23:02:09.207010] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:108 nsid:1 lba:118560 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:24.738 [2024-04-16 23:02:09.207024] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:24.738 [2024-04-16 23:02:09.207044] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:45 nsid:1 lba:118568 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:24.738 [2024-04-16 23:02:09.207058] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:24.738 [2024-04-16 23:02:09.207074] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:16 nsid:1 lba:118576 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:24.738 [2024-04-16 23:02:09.207088] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:24.738 [2024-04-16 23:02:09.207103] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:78 nsid:1 lba:118584 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:24.738 [2024-04-16 23:02:09.207124] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:24.738 [2024-04-16 23:02:09.207140] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:68 nsid:1 lba:118592 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:24.739 [2024-04-16 23:02:09.207154] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:24.739 [2024-04-16 23:02:09.207203] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:106 nsid:1 lba:118600 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:24.739 [2024-04-16 23:02:09.207219] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:24.739 [2024-04-16 23:02:09.207234] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:89 nsid:1 lba:118608 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:24.739 [2024-04-16 23:02:09.207248] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:24.739 [2024-04-16 23:02:09.207263] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:13 nsid:1 lba:118616 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:24.739 [2024-04-16 23:02:09.207276] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:24.739 [2024-04-16 23:02:09.207291] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:4 nsid:1 lba:118624 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:24.739 [2024-04-16 23:02:09.207306] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:24.739 [2024-04-16 23:02:09.207321] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:75 nsid:1 lba:118632 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:24.739 [2024-04-16 23:02:09.207335] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:24.739 [2024-04-16 23:02:09.207351] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:83 nsid:1 lba:118640 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:24.739 [2024-04-16 23:02:09.207364] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:24.739 [2024-04-16 23:02:09.207379] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:65 nsid:1 lba:117976 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:24.739 [2024-04-16 23:02:09.207392] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:24.739 [2024-04-16 23:02:09.207407] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:103 nsid:1 lba:117992 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:24.739 [2024-04-16 23:02:09.207420] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:24.739 [2024-04-16 23:02:09.207435] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:39 nsid:1 lba:118008 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:24.739 [2024-04-16 23:02:09.207449] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:24.739 [2024-04-16 23:02:09.207463] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:118016 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:24.739 [2024-04-16 23:02:09.207485] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:24.739 [2024-04-16 23:02:09.207515] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:19 nsid:1 lba:118024 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:24.739 [2024-04-16 23:02:09.207528] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:24.739 [2024-04-16 23:02:09.207546] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:30 nsid:1 lba:118040 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:24.739 [2024-04-16 23:02:09.207569] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:24.739 [2024-04-16 23:02:09.207585] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:109 nsid:1 lba:118048 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:24.739 [2024-04-16 23:02:09.207598] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:24.739 [2024-04-16 23:02:09.207612] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x8f7540 is same with the state(5) to be set 00:24:24.739 [2024-04-16 23:02:09.207628] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:24:24.739 [2024-04-16 23:02:09.207639] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:24:24.739 [2024-04-16 23:02:09.207651] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:118056 len:8 PRP1 0x0 PRP2 0x0 00:24:24.739 [2024-04-16 23:02:09.207664] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:24.739 [2024-04-16 23:02:09.207721] bdev_nvme.c:1576:bdev_nvme_disconnected_qpair_cb: *NOTICE*: qpair 0x8f7540 was disconnected and freed. reset controller. 00:24:24.739 [2024-04-16 23:02:09.207739] bdev_nvme.c:1829:bdev_nvme_failover_trid: *NOTICE*: Start failover from 10.0.0.2:4422 to 10.0.0.2:4420 00:24:24.739 [2024-04-16 23:02:09.207752] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:24.739 [2024-04-16 23:02:09.209875] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:24.739 [2024-04-16 23:02:09.209915] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x8cabd0 (9): Bad file descriptor 00:24:24.739 [2024-04-16 23:02:09.365659] bdev_nvme.c:2026:_bdev_nvme_reset_ctrlr_complete: *NOTICE*: Resetting controller successful. 00:24:24.739 00:24:24.739 Latency(us) 00:24:24.739 Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:24:24.739 Job: NVMe0n1 (Core Mask 0x1, workload: verify, depth: 128, IO size: 4096) 00:24:24.739 Verification LBA range: start 0x0 length 0x4000 00:24:24.739 NVMe0n1 : 15.01 12798.43 49.99 1314.95 0.00 9052.93 670.53 16408.27 00:24:24.739 =================================================================================================================== 00:24:24.739 Total : 12798.43 49.99 1314.95 0.00 9052.93 670.53 16408.27 00:24:24.739 Received shutdown signal, test time was about 15.000000 seconds 00:24:24.739 00:24:24.739 Latency(us) 00:24:24.739 Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:24:24.739 =================================================================================================================== 00:24:24.739 Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:24:24.739 23:02:15 -- host/failover.sh@65 -- # grep -c 'Resetting controller successful' 00:24:24.739 23:02:15 -- host/failover.sh@65 -- # count=3 00:24:24.739 23:02:15 -- host/failover.sh@67 -- # (( count != 3 )) 00:24:24.739 23:02:15 -- host/failover.sh@73 -- # bdevperf_pid=369998 00:24:24.739 23:02:15 -- host/failover.sh@72 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -z -r /var/tmp/bdevperf.sock -q 128 -o 4096 -w verify -t 1 -f 00:24:24.739 23:02:15 -- host/failover.sh@75 -- # waitforlisten 369998 /var/tmp/bdevperf.sock 00:24:24.739 23:02:15 -- common/autotest_common.sh@819 -- # '[' -z 369998 ']' 00:24:24.739 23:02:15 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:24:24.739 23:02:15 -- common/autotest_common.sh@824 -- # local max_retries=100 00:24:24.739 23:02:15 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:24:24.739 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:24:24.739 23:02:15 -- common/autotest_common.sh@828 -- # xtrace_disable 00:24:24.739 23:02:15 -- common/autotest_common.sh@10 -- # set +x 00:24:25.330 23:02:16 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:24:25.330 23:02:16 -- common/autotest_common.sh@852 -- # return 0 00:24:25.330 23:02:16 -- host/failover.sh@76 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4421 00:24:25.589 [2024-04-16 23:02:16.466378] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4421 *** 00:24:25.589 23:02:16 -- host/failover.sh@77 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4422 00:24:25.589 [2024-04-16 23:02:16.703034] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4422 *** 00:24:25.849 23:02:16 -- host/failover.sh@78 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 00:24:26.108 NVMe0n1 00:24:26.108 23:02:17 -- host/failover.sh@79 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4421 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 00:24:26.676 00:24:26.676 23:02:17 -- host/failover.sh@80 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4422 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 00:24:26.676 00:24:26.936 23:02:17 -- host/failover.sh@82 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_get_controllers 00:24:26.936 23:02:17 -- host/failover.sh@82 -- # grep -q NVMe0 00:24:27.194 23:02:18 -- host/failover.sh@84 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_detach_controller NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 00:24:27.194 23:02:18 -- host/failover.sh@87 -- # sleep 3 00:24:30.484 23:02:21 -- host/failover.sh@88 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_get_controllers 00:24:30.484 23:02:21 -- host/failover.sh@88 -- # grep -q NVMe0 00:24:30.484 23:02:21 -- host/failover.sh@90 -- # run_test_pid=370815 00:24:30.484 23:02:21 -- host/failover.sh@89 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bdevperf.sock perform_tests 00:24:30.484 23:02:21 -- host/failover.sh@92 -- # wait 370815 00:24:31.863 0 00:24:31.863 23:02:22 -- host/failover.sh@94 -- # cat /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/try.txt 00:24:31.863 [2024-04-16 23:02:15.314440] Starting SPDK v24.01.1-pre git sha1 4b134b4ab / DPDK 23.11.0 initialization... 00:24:31.863 [2024-04-16 23:02:15.314547] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid369998 ] 00:24:31.863 EAL: No free 2048 kB hugepages reported on node 1 00:24:31.863 [2024-04-16 23:02:15.373974] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:24:31.863 [2024-04-16 23:02:15.480502] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:24:31.863 [2024-04-16 23:02:18.285809] bdev_nvme.c:1829:bdev_nvme_failover_trid: *NOTICE*: Start failover from 10.0.0.2:4420 to 10.0.0.2:4421 00:24:31.863 [2024-04-16 23:02:18.285887] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:24:31.864 [2024-04-16 23:02:18.285909] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:31.864 [2024-04-16 23:02:18.285925] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:24:31.864 [2024-04-16 23:02:18.285938] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:31.864 [2024-04-16 23:02:18.285953] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:24:31.864 [2024-04-16 23:02:18.285967] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:31.864 [2024-04-16 23:02:18.285982] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:24:31.864 [2024-04-16 23:02:18.285995] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:31.864 [2024-04-16 23:02:18.286008] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:31.864 [2024-04-16 23:02:18.286056] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:31.864 [2024-04-16 23:02:18.286088] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x13a5bd0 (9): Bad file descriptor 00:24:31.864 [2024-04-16 23:02:18.298548] bdev_nvme.c:2026:_bdev_nvme_reset_ctrlr_complete: *NOTICE*: Resetting controller successful. 00:24:31.864 Running I/O for 1 seconds... 00:24:31.864 00:24:31.864 Latency(us) 00:24:31.864 Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:24:31.864 Job: NVMe0n1 (Core Mask 0x1, workload: verify, depth: 128, IO size: 4096) 00:24:31.864 Verification LBA range: start 0x0 length 0x4000 00:24:31.864 NVMe0n1 : 1.01 12976.77 50.69 0.00 0.00 9817.61 1407.81 11408.12 00:24:31.864 =================================================================================================================== 00:24:31.864 Total : 12976.77 50.69 0.00 0.00 9817.61 1407.81 11408.12 00:24:31.864 23:02:22 -- host/failover.sh@95 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_get_controllers 00:24:31.864 23:02:22 -- host/failover.sh@95 -- # grep -q NVMe0 00:24:31.864 23:02:22 -- host/failover.sh@98 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_detach_controller NVMe0 -t tcp -a 10.0.0.2 -s 4422 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 00:24:32.122 23:02:23 -- host/failover.sh@99 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_get_controllers 00:24:32.122 23:02:23 -- host/failover.sh@99 -- # grep -q NVMe0 00:24:32.381 23:02:23 -- host/failover.sh@100 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_detach_controller NVMe0 -t tcp -a 10.0.0.2 -s 4421 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 00:24:32.641 23:02:23 -- host/failover.sh@101 -- # sleep 3 00:24:35.926 23:02:26 -- host/failover.sh@103 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_get_controllers 00:24:35.926 23:02:26 -- host/failover.sh@103 -- # grep -q NVMe0 00:24:35.926 23:02:26 -- host/failover.sh@108 -- # killprocess 369998 00:24:35.926 23:02:26 -- common/autotest_common.sh@926 -- # '[' -z 369998 ']' 00:24:35.926 23:02:26 -- common/autotest_common.sh@930 -- # kill -0 369998 00:24:35.926 23:02:26 -- common/autotest_common.sh@931 -- # uname 00:24:35.926 23:02:26 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:24:35.926 23:02:26 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 369998 00:24:35.926 23:02:26 -- common/autotest_common.sh@932 -- # process_name=reactor_0 00:24:35.926 23:02:26 -- common/autotest_common.sh@936 -- # '[' reactor_0 = sudo ']' 00:24:35.926 23:02:26 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 369998' 00:24:35.926 killing process with pid 369998 00:24:35.926 23:02:26 -- common/autotest_common.sh@945 -- # kill 369998 00:24:35.926 23:02:26 -- common/autotest_common.sh@950 -- # wait 369998 00:24:36.185 23:02:27 -- host/failover.sh@110 -- # sync 00:24:36.185 23:02:27 -- host/failover.sh@111 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:24:36.443 23:02:27 -- host/failover.sh@113 -- # trap - SIGINT SIGTERM EXIT 00:24:36.443 23:02:27 -- host/failover.sh@115 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/try.txt 00:24:36.443 23:02:27 -- host/failover.sh@116 -- # nvmftestfini 00:24:36.443 23:02:27 -- nvmf/common.sh@476 -- # nvmfcleanup 00:24:36.443 23:02:27 -- nvmf/common.sh@116 -- # sync 00:24:36.443 23:02:27 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:24:36.443 23:02:27 -- nvmf/common.sh@119 -- # set +e 00:24:36.443 23:02:27 -- nvmf/common.sh@120 -- # for i in {1..20} 00:24:36.443 23:02:27 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:24:36.443 rmmod nvme_tcp 00:24:36.443 rmmod nvme_fabrics 00:24:36.443 rmmod nvme_keyring 00:24:36.443 23:02:27 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:24:36.443 23:02:27 -- nvmf/common.sh@123 -- # set -e 00:24:36.443 23:02:27 -- nvmf/common.sh@124 -- # return 0 00:24:36.443 23:02:27 -- nvmf/common.sh@477 -- # '[' -n 367585 ']' 00:24:36.443 23:02:27 -- nvmf/common.sh@478 -- # killprocess 367585 00:24:36.443 23:02:27 -- common/autotest_common.sh@926 -- # '[' -z 367585 ']' 00:24:36.443 23:02:27 -- common/autotest_common.sh@930 -- # kill -0 367585 00:24:36.443 23:02:27 -- common/autotest_common.sh@931 -- # uname 00:24:36.443 23:02:27 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:24:36.443 23:02:27 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 367585 00:24:36.701 23:02:27 -- common/autotest_common.sh@932 -- # process_name=reactor_1 00:24:36.701 23:02:27 -- common/autotest_common.sh@936 -- # '[' reactor_1 = sudo ']' 00:24:36.701 23:02:27 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 367585' 00:24:36.701 killing process with pid 367585 00:24:36.701 23:02:27 -- common/autotest_common.sh@945 -- # kill 367585 00:24:36.701 23:02:27 -- common/autotest_common.sh@950 -- # wait 367585 00:24:36.959 23:02:27 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:24:36.959 23:02:27 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:24:36.959 23:02:27 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:24:36.959 23:02:27 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:24:36.959 23:02:27 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:24:36.959 23:02:27 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:24:36.959 23:02:27 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:24:36.960 23:02:27 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:24:38.866 23:02:29 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:24:38.866 00:24:38.866 real 0m36.725s 00:24:38.866 user 2m9.672s 00:24:38.866 sys 0m6.109s 00:24:38.866 23:02:29 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:24:38.866 23:02:29 -- common/autotest_common.sh@10 -- # set +x 00:24:38.866 ************************************ 00:24:38.866 END TEST nvmf_failover 00:24:38.866 ************************************ 00:24:38.866 23:02:29 -- nvmf/nvmf.sh@100 -- # run_test nvmf_discovery /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/discovery.sh --transport=tcp 00:24:38.866 23:02:29 -- common/autotest_common.sh@1077 -- # '[' 3 -le 1 ']' 00:24:38.866 23:02:29 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:24:38.866 23:02:29 -- common/autotest_common.sh@10 -- # set +x 00:24:38.866 ************************************ 00:24:38.866 START TEST nvmf_discovery 00:24:38.866 ************************************ 00:24:38.866 23:02:29 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/discovery.sh --transport=tcp 00:24:38.866 * Looking for test storage... 00:24:38.866 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host 00:24:38.866 23:02:29 -- host/discovery.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:24:38.866 23:02:29 -- nvmf/common.sh@7 -- # uname -s 00:24:38.866 23:02:29 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:24:38.866 23:02:29 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:24:38.866 23:02:29 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:24:38.866 23:02:29 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:24:38.866 23:02:29 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:24:38.866 23:02:29 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:24:38.866 23:02:29 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:24:38.866 23:02:29 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:24:38.866 23:02:29 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:24:38.866 23:02:29 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:24:38.866 23:02:29 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:24:38.866 23:02:29 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:24:38.866 23:02:29 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:24:38.866 23:02:29 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:24:38.866 23:02:29 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:24:38.866 23:02:29 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:24:38.866 23:02:29 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:24:38.866 23:02:29 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:24:38.866 23:02:29 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:24:38.866 23:02:29 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:24:38.866 23:02:29 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:24:38.866 23:02:29 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:24:38.866 23:02:29 -- paths/export.sh@5 -- # export PATH 00:24:38.866 23:02:29 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:24:38.866 23:02:29 -- nvmf/common.sh@46 -- # : 0 00:24:38.866 23:02:29 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:24:38.866 23:02:29 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:24:38.866 23:02:29 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:24:38.866 23:02:29 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:24:38.866 23:02:29 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:24:38.866 23:02:29 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:24:38.866 23:02:29 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:24:38.866 23:02:29 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:24:38.866 23:02:29 -- host/discovery.sh@11 -- # '[' tcp == rdma ']' 00:24:38.866 23:02:29 -- host/discovery.sh@16 -- # DISCOVERY_PORT=8009 00:24:38.866 23:02:29 -- host/discovery.sh@17 -- # DISCOVERY_NQN=nqn.2014-08.org.nvmexpress.discovery 00:24:38.866 23:02:29 -- host/discovery.sh@20 -- # NQN=nqn.2016-06.io.spdk:cnode 00:24:38.866 23:02:29 -- host/discovery.sh@22 -- # HOST_NQN=nqn.2021-12.io.spdk:test 00:24:38.866 23:02:29 -- host/discovery.sh@23 -- # HOST_SOCK=/tmp/host.sock 00:24:38.866 23:02:29 -- host/discovery.sh@25 -- # nvmftestinit 00:24:38.866 23:02:29 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:24:38.866 23:02:29 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:24:38.866 23:02:29 -- nvmf/common.sh@436 -- # prepare_net_devs 00:24:38.866 23:02:29 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:24:38.866 23:02:29 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:24:38.866 23:02:29 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:24:38.866 23:02:29 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:24:38.866 23:02:29 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:24:38.866 23:02:29 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:24:38.866 23:02:29 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:24:38.866 23:02:29 -- nvmf/common.sh@284 -- # xtrace_disable 00:24:38.866 23:02:29 -- common/autotest_common.sh@10 -- # set +x 00:24:41.396 23:02:31 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:24:41.396 23:02:31 -- nvmf/common.sh@290 -- # pci_devs=() 00:24:41.396 23:02:31 -- nvmf/common.sh@290 -- # local -a pci_devs 00:24:41.396 23:02:31 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:24:41.396 23:02:31 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:24:41.396 23:02:31 -- nvmf/common.sh@292 -- # pci_drivers=() 00:24:41.397 23:02:31 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:24:41.397 23:02:31 -- nvmf/common.sh@294 -- # net_devs=() 00:24:41.397 23:02:31 -- nvmf/common.sh@294 -- # local -ga net_devs 00:24:41.397 23:02:31 -- nvmf/common.sh@295 -- # e810=() 00:24:41.397 23:02:31 -- nvmf/common.sh@295 -- # local -ga e810 00:24:41.397 23:02:31 -- nvmf/common.sh@296 -- # x722=() 00:24:41.397 23:02:31 -- nvmf/common.sh@296 -- # local -ga x722 00:24:41.397 23:02:31 -- nvmf/common.sh@297 -- # mlx=() 00:24:41.397 23:02:31 -- nvmf/common.sh@297 -- # local -ga mlx 00:24:41.397 23:02:31 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:24:41.397 23:02:31 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:24:41.397 23:02:31 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:24:41.397 23:02:31 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:24:41.397 23:02:31 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:24:41.397 23:02:31 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:24:41.397 23:02:31 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:24:41.397 23:02:31 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:24:41.397 23:02:31 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:24:41.397 23:02:31 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:24:41.397 23:02:31 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:24:41.397 23:02:31 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:24:41.397 23:02:31 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:24:41.397 23:02:31 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:24:41.397 23:02:31 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:24:41.397 23:02:31 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:24:41.397 23:02:31 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:24:41.397 23:02:31 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:24:41.397 23:02:31 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:24:41.397 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:24:41.397 23:02:31 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:24:41.397 23:02:31 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:24:41.397 23:02:31 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:24:41.397 23:02:31 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:24:41.397 23:02:31 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:24:41.397 23:02:31 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:24:41.397 23:02:31 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:24:41.397 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:24:41.397 23:02:31 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:24:41.397 23:02:31 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:24:41.397 23:02:31 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:24:41.397 23:02:31 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:24:41.397 23:02:31 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:24:41.397 23:02:31 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:24:41.397 23:02:32 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:24:41.397 23:02:32 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:24:41.397 23:02:32 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:24:41.397 23:02:32 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:24:41.397 23:02:32 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:24:41.397 23:02:32 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:24:41.397 23:02:32 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:24:41.397 Found net devices under 0000:0a:00.0: cvl_0_0 00:24:41.397 23:02:32 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:24:41.397 23:02:32 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:24:41.397 23:02:32 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:24:41.397 23:02:32 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:24:41.397 23:02:32 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:24:41.397 23:02:32 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:24:41.397 Found net devices under 0000:0a:00.1: cvl_0_1 00:24:41.397 23:02:32 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:24:41.397 23:02:32 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:24:41.397 23:02:32 -- nvmf/common.sh@402 -- # is_hw=yes 00:24:41.397 23:02:32 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:24:41.397 23:02:32 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:24:41.397 23:02:32 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:24:41.397 23:02:32 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:24:41.397 23:02:32 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:24:41.397 23:02:32 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:24:41.397 23:02:32 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:24:41.397 23:02:32 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:24:41.397 23:02:32 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:24:41.397 23:02:32 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:24:41.397 23:02:32 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:24:41.397 23:02:32 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:24:41.397 23:02:32 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:24:41.397 23:02:32 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:24:41.397 23:02:32 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:24:41.397 23:02:32 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:24:41.397 23:02:32 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:24:41.397 23:02:32 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:24:41.397 23:02:32 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:24:41.397 23:02:32 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:24:41.397 23:02:32 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:24:41.397 23:02:32 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:24:41.397 23:02:32 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:24:41.397 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:24:41.397 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.168 ms 00:24:41.397 00:24:41.397 --- 10.0.0.2 ping statistics --- 00:24:41.397 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:24:41.397 rtt min/avg/max/mdev = 0.168/0.168/0.168/0.000 ms 00:24:41.397 23:02:32 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:24:41.397 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:24:41.397 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.097 ms 00:24:41.397 00:24:41.397 --- 10.0.0.1 ping statistics --- 00:24:41.397 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:24:41.397 rtt min/avg/max/mdev = 0.097/0.097/0.097/0.000 ms 00:24:41.397 23:02:32 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:24:41.397 23:02:32 -- nvmf/common.sh@410 -- # return 0 00:24:41.397 23:02:32 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:24:41.397 23:02:32 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:24:41.397 23:02:32 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:24:41.397 23:02:32 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:24:41.397 23:02:32 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:24:41.397 23:02:32 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:24:41.397 23:02:32 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:24:41.397 23:02:32 -- host/discovery.sh@30 -- # nvmfappstart -m 0x2 00:24:41.397 23:02:32 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:24:41.397 23:02:32 -- common/autotest_common.sh@712 -- # xtrace_disable 00:24:41.397 23:02:32 -- common/autotest_common.sh@10 -- # set +x 00:24:41.397 23:02:32 -- nvmf/common.sh@469 -- # nvmfpid=373451 00:24:41.397 23:02:32 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x2 00:24:41.397 23:02:32 -- nvmf/common.sh@470 -- # waitforlisten 373451 00:24:41.397 23:02:32 -- common/autotest_common.sh@819 -- # '[' -z 373451 ']' 00:24:41.397 23:02:32 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk.sock 00:24:41.397 23:02:32 -- common/autotest_common.sh@824 -- # local max_retries=100 00:24:41.397 23:02:32 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:24:41.397 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:24:41.397 23:02:32 -- common/autotest_common.sh@828 -- # xtrace_disable 00:24:41.397 23:02:32 -- common/autotest_common.sh@10 -- # set +x 00:24:41.397 [2024-04-16 23:02:32.192046] Starting SPDK v24.01.1-pre git sha1 4b134b4ab / DPDK 23.11.0 initialization... 00:24:41.397 [2024-04-16 23:02:32.192117] [ DPDK EAL parameters: nvmf -c 0x2 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:24:41.397 EAL: No free 2048 kB hugepages reported on node 1 00:24:41.397 [2024-04-16 23:02:32.255054] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:24:41.397 [2024-04-16 23:02:32.364576] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:24:41.397 [2024-04-16 23:02:32.364724] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:24:41.397 [2024-04-16 23:02:32.364741] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:24:41.397 [2024-04-16 23:02:32.364752] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:24:41.397 [2024-04-16 23:02:32.364790] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:24:42.333 23:02:33 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:24:42.333 23:02:33 -- common/autotest_common.sh@852 -- # return 0 00:24:42.333 23:02:33 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:24:42.333 23:02:33 -- common/autotest_common.sh@718 -- # xtrace_disable 00:24:42.333 23:02:33 -- common/autotest_common.sh@10 -- # set +x 00:24:42.333 23:02:33 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:24:42.333 23:02:33 -- host/discovery.sh@32 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:24:42.333 23:02:33 -- common/autotest_common.sh@551 -- # xtrace_disable 00:24:42.333 23:02:33 -- common/autotest_common.sh@10 -- # set +x 00:24:42.333 [2024-04-16 23:02:33.159959] tcp.c: 659:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:24:42.333 23:02:33 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:24:42.333 23:02:33 -- host/discovery.sh@33 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2014-08.org.nvmexpress.discovery -t tcp -a 10.0.0.2 -s 8009 00:24:42.333 23:02:33 -- common/autotest_common.sh@551 -- # xtrace_disable 00:24:42.333 23:02:33 -- common/autotest_common.sh@10 -- # set +x 00:24:42.333 [2024-04-16 23:02:33.168094] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 8009 *** 00:24:42.333 23:02:33 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:24:42.333 23:02:33 -- host/discovery.sh@35 -- # rpc_cmd bdev_null_create null0 1000 512 00:24:42.333 23:02:33 -- common/autotest_common.sh@551 -- # xtrace_disable 00:24:42.333 23:02:33 -- common/autotest_common.sh@10 -- # set +x 00:24:42.333 null0 00:24:42.333 23:02:33 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:24:42.333 23:02:33 -- host/discovery.sh@36 -- # rpc_cmd bdev_null_create null1 1000 512 00:24:42.333 23:02:33 -- common/autotest_common.sh@551 -- # xtrace_disable 00:24:42.333 23:02:33 -- common/autotest_common.sh@10 -- # set +x 00:24:42.333 null1 00:24:42.333 23:02:33 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:24:42.333 23:02:33 -- host/discovery.sh@37 -- # rpc_cmd bdev_wait_for_examine 00:24:42.333 23:02:33 -- common/autotest_common.sh@551 -- # xtrace_disable 00:24:42.333 23:02:33 -- common/autotest_common.sh@10 -- # set +x 00:24:42.333 23:02:33 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:24:42.333 23:02:33 -- host/discovery.sh@45 -- # hostpid=373605 00:24:42.333 23:02:33 -- host/discovery.sh@44 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -m 0x1 -r /tmp/host.sock 00:24:42.333 23:02:33 -- host/discovery.sh@46 -- # waitforlisten 373605 /tmp/host.sock 00:24:42.333 23:02:33 -- common/autotest_common.sh@819 -- # '[' -z 373605 ']' 00:24:42.333 23:02:33 -- common/autotest_common.sh@823 -- # local rpc_addr=/tmp/host.sock 00:24:42.333 23:02:33 -- common/autotest_common.sh@824 -- # local max_retries=100 00:24:42.333 23:02:33 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /tmp/host.sock...' 00:24:42.333 Waiting for process to start up and listen on UNIX domain socket /tmp/host.sock... 00:24:42.333 23:02:33 -- common/autotest_common.sh@828 -- # xtrace_disable 00:24:42.333 23:02:33 -- common/autotest_common.sh@10 -- # set +x 00:24:42.333 [2024-04-16 23:02:33.234633] Starting SPDK v24.01.1-pre git sha1 4b134b4ab / DPDK 23.11.0 initialization... 00:24:42.333 [2024-04-16 23:02:33.234695] [ DPDK EAL parameters: nvmf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid373605 ] 00:24:42.333 EAL: No free 2048 kB hugepages reported on node 1 00:24:42.333 [2024-04-16 23:02:33.296854] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:24:42.333 [2024-04-16 23:02:33.412454] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:24:42.333 [2024-04-16 23:02:33.412627] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:24:43.267 23:02:34 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:24:43.267 23:02:34 -- common/autotest_common.sh@852 -- # return 0 00:24:43.267 23:02:34 -- host/discovery.sh@48 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; kill $hostpid; nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:24:43.267 23:02:34 -- host/discovery.sh@50 -- # rpc_cmd -s /tmp/host.sock log_set_flag bdev_nvme 00:24:43.267 23:02:34 -- common/autotest_common.sh@551 -- # xtrace_disable 00:24:43.267 23:02:34 -- common/autotest_common.sh@10 -- # set +x 00:24:43.267 23:02:34 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:24:43.267 23:02:34 -- host/discovery.sh@51 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_start_discovery -b nvme -t tcp -a 10.0.0.2 -s 8009 -f ipv4 -q nqn.2021-12.io.spdk:test 00:24:43.267 23:02:34 -- common/autotest_common.sh@551 -- # xtrace_disable 00:24:43.267 23:02:34 -- common/autotest_common.sh@10 -- # set +x 00:24:43.267 23:02:34 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:24:43.267 23:02:34 -- host/discovery.sh@72 -- # notify_id=0 00:24:43.267 23:02:34 -- host/discovery.sh@78 -- # get_subsystem_names 00:24:43.267 23:02:34 -- host/discovery.sh@59 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_get_controllers 00:24:43.267 23:02:34 -- host/discovery.sh@59 -- # jq -r '.[].name' 00:24:43.267 23:02:34 -- common/autotest_common.sh@551 -- # xtrace_disable 00:24:43.267 23:02:34 -- common/autotest_common.sh@10 -- # set +x 00:24:43.267 23:02:34 -- host/discovery.sh@59 -- # sort 00:24:43.267 23:02:34 -- host/discovery.sh@59 -- # xargs 00:24:43.267 23:02:34 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:24:43.267 23:02:34 -- host/discovery.sh@78 -- # [[ '' == '' ]] 00:24:43.267 23:02:34 -- host/discovery.sh@79 -- # get_bdev_list 00:24:43.267 23:02:34 -- host/discovery.sh@55 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:24:43.267 23:02:34 -- host/discovery.sh@55 -- # jq -r '.[].name' 00:24:43.267 23:02:34 -- common/autotest_common.sh@551 -- # xtrace_disable 00:24:43.267 23:02:34 -- common/autotest_common.sh@10 -- # set +x 00:24:43.267 23:02:34 -- host/discovery.sh@55 -- # sort 00:24:43.267 23:02:34 -- host/discovery.sh@55 -- # xargs 00:24:43.267 23:02:34 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:24:43.267 23:02:34 -- host/discovery.sh@79 -- # [[ '' == '' ]] 00:24:43.267 23:02:34 -- host/discovery.sh@81 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode0 00:24:43.267 23:02:34 -- common/autotest_common.sh@551 -- # xtrace_disable 00:24:43.267 23:02:34 -- common/autotest_common.sh@10 -- # set +x 00:24:43.267 23:02:34 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:24:43.268 23:02:34 -- host/discovery.sh@82 -- # get_subsystem_names 00:24:43.268 23:02:34 -- host/discovery.sh@59 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_get_controllers 00:24:43.268 23:02:34 -- host/discovery.sh@59 -- # jq -r '.[].name' 00:24:43.268 23:02:34 -- common/autotest_common.sh@551 -- # xtrace_disable 00:24:43.268 23:02:34 -- common/autotest_common.sh@10 -- # set +x 00:24:43.268 23:02:34 -- host/discovery.sh@59 -- # sort 00:24:43.268 23:02:34 -- host/discovery.sh@59 -- # xargs 00:24:43.268 23:02:34 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:24:43.268 23:02:34 -- host/discovery.sh@82 -- # [[ '' == '' ]] 00:24:43.268 23:02:34 -- host/discovery.sh@83 -- # get_bdev_list 00:24:43.268 23:02:34 -- host/discovery.sh@55 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:24:43.268 23:02:34 -- common/autotest_common.sh@551 -- # xtrace_disable 00:24:43.268 23:02:34 -- common/autotest_common.sh@10 -- # set +x 00:24:43.268 23:02:34 -- host/discovery.sh@55 -- # jq -r '.[].name' 00:24:43.268 23:02:34 -- host/discovery.sh@55 -- # sort 00:24:43.268 23:02:34 -- host/discovery.sh@55 -- # xargs 00:24:43.268 23:02:34 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:24:43.526 23:02:34 -- host/discovery.sh@83 -- # [[ '' == '' ]] 00:24:43.526 23:02:34 -- host/discovery.sh@85 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode0 null0 00:24:43.526 23:02:34 -- common/autotest_common.sh@551 -- # xtrace_disable 00:24:43.526 23:02:34 -- common/autotest_common.sh@10 -- # set +x 00:24:43.526 23:02:34 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:24:43.526 23:02:34 -- host/discovery.sh@86 -- # get_subsystem_names 00:24:43.526 23:02:34 -- host/discovery.sh@59 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_get_controllers 00:24:43.526 23:02:34 -- common/autotest_common.sh@551 -- # xtrace_disable 00:24:43.526 23:02:34 -- host/discovery.sh@59 -- # jq -r '.[].name' 00:24:43.526 23:02:34 -- common/autotest_common.sh@10 -- # set +x 00:24:43.526 23:02:34 -- host/discovery.sh@59 -- # sort 00:24:43.526 23:02:34 -- host/discovery.sh@59 -- # xargs 00:24:43.526 23:02:34 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:24:43.526 23:02:34 -- host/discovery.sh@86 -- # [[ '' == '' ]] 00:24:43.526 23:02:34 -- host/discovery.sh@87 -- # get_bdev_list 00:24:43.526 23:02:34 -- host/discovery.sh@55 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:24:43.526 23:02:34 -- host/discovery.sh@55 -- # jq -r '.[].name' 00:24:43.526 23:02:34 -- common/autotest_common.sh@551 -- # xtrace_disable 00:24:43.526 23:02:34 -- common/autotest_common.sh@10 -- # set +x 00:24:43.526 23:02:34 -- host/discovery.sh@55 -- # sort 00:24:43.526 23:02:34 -- host/discovery.sh@55 -- # xargs 00:24:43.526 23:02:34 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:24:43.526 23:02:34 -- host/discovery.sh@87 -- # [[ '' == '' ]] 00:24:43.526 23:02:34 -- host/discovery.sh@91 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode0 -t tcp -a 10.0.0.2 -s 4420 00:24:43.526 23:02:34 -- common/autotest_common.sh@551 -- # xtrace_disable 00:24:43.526 23:02:34 -- common/autotest_common.sh@10 -- # set +x 00:24:43.526 [2024-04-16 23:02:34.503807] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:24:43.526 23:02:34 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:24:43.526 23:02:34 -- host/discovery.sh@92 -- # get_subsystem_names 00:24:43.526 23:02:34 -- host/discovery.sh@59 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_get_controllers 00:24:43.526 23:02:34 -- host/discovery.sh@59 -- # jq -r '.[].name' 00:24:43.526 23:02:34 -- common/autotest_common.sh@551 -- # xtrace_disable 00:24:43.526 23:02:34 -- common/autotest_common.sh@10 -- # set +x 00:24:43.526 23:02:34 -- host/discovery.sh@59 -- # sort 00:24:43.526 23:02:34 -- host/discovery.sh@59 -- # xargs 00:24:43.526 23:02:34 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:24:43.526 23:02:34 -- host/discovery.sh@92 -- # [[ '' == '' ]] 00:24:43.526 23:02:34 -- host/discovery.sh@93 -- # get_bdev_list 00:24:43.526 23:02:34 -- host/discovery.sh@55 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:24:43.526 23:02:34 -- host/discovery.sh@55 -- # jq -r '.[].name' 00:24:43.526 23:02:34 -- common/autotest_common.sh@551 -- # xtrace_disable 00:24:43.526 23:02:34 -- host/discovery.sh@55 -- # sort 00:24:43.526 23:02:34 -- common/autotest_common.sh@10 -- # set +x 00:24:43.526 23:02:34 -- host/discovery.sh@55 -- # xargs 00:24:43.526 23:02:34 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:24:43.527 23:02:34 -- host/discovery.sh@93 -- # [[ '' == '' ]] 00:24:43.527 23:02:34 -- host/discovery.sh@94 -- # get_notification_count 00:24:43.527 23:02:34 -- host/discovery.sh@74 -- # rpc_cmd -s /tmp/host.sock notify_get_notifications -i 0 00:24:43.527 23:02:34 -- common/autotest_common.sh@551 -- # xtrace_disable 00:24:43.527 23:02:34 -- host/discovery.sh@74 -- # jq '. | length' 00:24:43.527 23:02:34 -- common/autotest_common.sh@10 -- # set +x 00:24:43.527 23:02:34 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:24:43.527 23:02:34 -- host/discovery.sh@74 -- # notification_count=0 00:24:43.527 23:02:34 -- host/discovery.sh@75 -- # notify_id=0 00:24:43.527 23:02:34 -- host/discovery.sh@95 -- # [[ 0 == 0 ]] 00:24:43.527 23:02:34 -- host/discovery.sh@99 -- # rpc_cmd nvmf_subsystem_add_host nqn.2016-06.io.spdk:cnode0 nqn.2021-12.io.spdk:test 00:24:43.527 23:02:34 -- common/autotest_common.sh@551 -- # xtrace_disable 00:24:43.527 23:02:34 -- common/autotest_common.sh@10 -- # set +x 00:24:43.527 23:02:34 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:24:43.527 23:02:34 -- host/discovery.sh@100 -- # sleep 1 00:24:44.464 [2024-04-16 23:02:35.279377] bdev_nvme.c:6703:discovery_attach_cb: *INFO*: Discovery[10.0.0.2:8009] discovery ctrlr attached 00:24:44.464 [2024-04-16 23:02:35.279412] bdev_nvme.c:6783:discovery_poller: *INFO*: Discovery[10.0.0.2:8009] discovery ctrlr connected 00:24:44.464 [2024-04-16 23:02:35.279434] bdev_nvme.c:6666:get_discovery_log_page: *INFO*: Discovery[10.0.0.2:8009] sent discovery log page command 00:24:44.464 [2024-04-16 23:02:35.365732] bdev_nvme.c:6632:discovery_log_page_cb: *INFO*: Discovery[10.0.0.2:8009] NVM nqn.2016-06.io.spdk:cnode0:10.0.0.2:4420 new subsystem nvme0 00:24:44.464 [2024-04-16 23:02:35.430677] bdev_nvme.c:6522:discovery_attach_controller_done: *INFO*: Discovery[10.0.0.2:8009] attach nvme0 done 00:24:44.464 [2024-04-16 23:02:35.430703] bdev_nvme.c:6481:discovery_remove_controllers: *INFO*: Discovery[10.0.0.2:8009] NVM nqn.2016-06.io.spdk:cnode0:10.0.0.2:4420 found again 00:24:44.723 23:02:35 -- host/discovery.sh@101 -- # get_subsystem_names 00:24:44.723 23:02:35 -- host/discovery.sh@59 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_get_controllers 00:24:44.723 23:02:35 -- host/discovery.sh@59 -- # jq -r '.[].name' 00:24:44.723 23:02:35 -- common/autotest_common.sh@551 -- # xtrace_disable 00:24:44.723 23:02:35 -- common/autotest_common.sh@10 -- # set +x 00:24:44.723 23:02:35 -- host/discovery.sh@59 -- # sort 00:24:44.723 23:02:35 -- host/discovery.sh@59 -- # xargs 00:24:44.723 23:02:35 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:24:44.723 23:02:35 -- host/discovery.sh@101 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:24:44.723 23:02:35 -- host/discovery.sh@102 -- # get_bdev_list 00:24:44.723 23:02:35 -- host/discovery.sh@55 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:24:44.723 23:02:35 -- host/discovery.sh@55 -- # jq -r '.[].name' 00:24:44.723 23:02:35 -- common/autotest_common.sh@551 -- # xtrace_disable 00:24:44.723 23:02:35 -- common/autotest_common.sh@10 -- # set +x 00:24:44.723 23:02:35 -- host/discovery.sh@55 -- # sort 00:24:44.723 23:02:35 -- host/discovery.sh@55 -- # xargs 00:24:44.723 23:02:35 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:24:44.723 23:02:35 -- host/discovery.sh@102 -- # [[ nvme0n1 == \n\v\m\e\0\n\1 ]] 00:24:44.723 23:02:35 -- host/discovery.sh@103 -- # get_subsystem_paths nvme0 00:24:44.723 23:02:35 -- host/discovery.sh@63 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_get_controllers -n nvme0 00:24:44.723 23:02:35 -- common/autotest_common.sh@551 -- # xtrace_disable 00:24:44.723 23:02:35 -- host/discovery.sh@63 -- # jq -r '.[].ctrlrs[].trid.trsvcid' 00:24:44.723 23:02:35 -- common/autotest_common.sh@10 -- # set +x 00:24:44.723 23:02:35 -- host/discovery.sh@63 -- # sort -n 00:24:44.723 23:02:35 -- host/discovery.sh@63 -- # xargs 00:24:44.723 23:02:35 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:24:44.723 23:02:35 -- host/discovery.sh@103 -- # [[ 4420 == \4\4\2\0 ]] 00:24:44.723 23:02:35 -- host/discovery.sh@104 -- # get_notification_count 00:24:44.723 23:02:35 -- host/discovery.sh@74 -- # rpc_cmd -s /tmp/host.sock notify_get_notifications -i 0 00:24:44.723 23:02:35 -- host/discovery.sh@74 -- # jq '. | length' 00:24:44.723 23:02:35 -- common/autotest_common.sh@551 -- # xtrace_disable 00:24:44.723 23:02:35 -- common/autotest_common.sh@10 -- # set +x 00:24:44.723 23:02:35 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:24:44.723 23:02:35 -- host/discovery.sh@74 -- # notification_count=1 00:24:44.723 23:02:35 -- host/discovery.sh@75 -- # notify_id=1 00:24:44.723 23:02:35 -- host/discovery.sh@105 -- # [[ 1 == 1 ]] 00:24:44.723 23:02:35 -- host/discovery.sh@108 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode0 null1 00:24:44.723 23:02:35 -- common/autotest_common.sh@551 -- # xtrace_disable 00:24:44.723 23:02:35 -- common/autotest_common.sh@10 -- # set +x 00:24:44.723 23:02:35 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:24:44.723 23:02:35 -- host/discovery.sh@109 -- # sleep 1 00:24:46.127 23:02:36 -- host/discovery.sh@110 -- # get_bdev_list 00:24:46.127 23:02:36 -- host/discovery.sh@55 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:24:46.127 23:02:36 -- common/autotest_common.sh@551 -- # xtrace_disable 00:24:46.127 23:02:36 -- host/discovery.sh@55 -- # jq -r '.[].name' 00:24:46.127 23:02:36 -- common/autotest_common.sh@10 -- # set +x 00:24:46.127 23:02:36 -- host/discovery.sh@55 -- # sort 00:24:46.127 23:02:36 -- host/discovery.sh@55 -- # xargs 00:24:46.127 23:02:36 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:24:46.127 23:02:36 -- host/discovery.sh@110 -- # [[ nvme0n1 nvme0n2 == \n\v\m\e\0\n\1\ \n\v\m\e\0\n\2 ]] 00:24:46.127 23:02:36 -- host/discovery.sh@111 -- # get_notification_count 00:24:46.127 23:02:36 -- host/discovery.sh@74 -- # rpc_cmd -s /tmp/host.sock notify_get_notifications -i 1 00:24:46.127 23:02:36 -- host/discovery.sh@74 -- # jq '. | length' 00:24:46.127 23:02:36 -- common/autotest_common.sh@551 -- # xtrace_disable 00:24:46.127 23:02:36 -- common/autotest_common.sh@10 -- # set +x 00:24:46.127 23:02:36 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:24:46.127 23:02:36 -- host/discovery.sh@74 -- # notification_count=1 00:24:46.127 23:02:36 -- host/discovery.sh@75 -- # notify_id=2 00:24:46.127 23:02:36 -- host/discovery.sh@112 -- # [[ 1 == 1 ]] 00:24:46.127 23:02:36 -- host/discovery.sh@116 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode0 -t tcp -a 10.0.0.2 -s 4421 00:24:46.127 23:02:36 -- common/autotest_common.sh@551 -- # xtrace_disable 00:24:46.127 23:02:36 -- common/autotest_common.sh@10 -- # set +x 00:24:46.127 [2024-04-16 23:02:36.918877] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4421 *** 00:24:46.127 [2024-04-16 23:02:36.919549] bdev_nvme.c:6685:discovery_aer_cb: *INFO*: Discovery[10.0.0.2:8009] got aer 00:24:46.127 [2024-04-16 23:02:36.919588] bdev_nvme.c:6666:get_discovery_log_page: *INFO*: Discovery[10.0.0.2:8009] sent discovery log page command 00:24:46.127 23:02:36 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:24:46.127 23:02:36 -- host/discovery.sh@117 -- # sleep 1 00:24:46.127 [2024-04-16 23:02:37.045941] bdev_nvme.c:6627:discovery_log_page_cb: *INFO*: Discovery[10.0.0.2:8009] NVM nqn.2016-06.io.spdk:cnode0:10.0.0.2:4421 new path for nvme0 00:24:46.127 [2024-04-16 23:02:37.225999] bdev_nvme.c:6522:discovery_attach_controller_done: *INFO*: Discovery[10.0.0.2:8009] attach nvme0 done 00:24:46.127 [2024-04-16 23:02:37.226029] bdev_nvme.c:6481:discovery_remove_controllers: *INFO*: Discovery[10.0.0.2:8009] NVM nqn.2016-06.io.spdk:cnode0:10.0.0.2:4420 found again 00:24:46.127 [2024-04-16 23:02:37.226041] bdev_nvme.c:6481:discovery_remove_controllers: *INFO*: Discovery[10.0.0.2:8009] NVM nqn.2016-06.io.spdk:cnode0:10.0.0.2:4421 found again 00:24:47.064 23:02:37 -- host/discovery.sh@118 -- # get_subsystem_names 00:24:47.064 23:02:37 -- host/discovery.sh@59 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_get_controllers 00:24:47.064 23:02:37 -- common/autotest_common.sh@551 -- # xtrace_disable 00:24:47.064 23:02:37 -- host/discovery.sh@59 -- # jq -r '.[].name' 00:24:47.064 23:02:37 -- common/autotest_common.sh@10 -- # set +x 00:24:47.064 23:02:37 -- host/discovery.sh@59 -- # sort 00:24:47.064 23:02:37 -- host/discovery.sh@59 -- # xargs 00:24:47.064 23:02:37 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:24:47.064 23:02:37 -- host/discovery.sh@118 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:24:47.064 23:02:37 -- host/discovery.sh@119 -- # get_bdev_list 00:24:47.064 23:02:37 -- host/discovery.sh@55 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:24:47.064 23:02:37 -- host/discovery.sh@55 -- # jq -r '.[].name' 00:24:47.064 23:02:37 -- common/autotest_common.sh@551 -- # xtrace_disable 00:24:47.064 23:02:37 -- common/autotest_common.sh@10 -- # set +x 00:24:47.064 23:02:37 -- host/discovery.sh@55 -- # sort 00:24:47.064 23:02:37 -- host/discovery.sh@55 -- # xargs 00:24:47.064 23:02:37 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:24:47.064 23:02:38 -- host/discovery.sh@119 -- # [[ nvme0n1 nvme0n2 == \n\v\m\e\0\n\1\ \n\v\m\e\0\n\2 ]] 00:24:47.064 23:02:38 -- host/discovery.sh@120 -- # get_subsystem_paths nvme0 00:24:47.064 23:02:38 -- host/discovery.sh@63 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_get_controllers -n nvme0 00:24:47.064 23:02:38 -- common/autotest_common.sh@551 -- # xtrace_disable 00:24:47.064 23:02:38 -- host/discovery.sh@63 -- # jq -r '.[].ctrlrs[].trid.trsvcid' 00:24:47.064 23:02:38 -- common/autotest_common.sh@10 -- # set +x 00:24:47.064 23:02:38 -- host/discovery.sh@63 -- # sort -n 00:24:47.064 23:02:38 -- host/discovery.sh@63 -- # xargs 00:24:47.064 23:02:38 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:24:47.064 23:02:38 -- host/discovery.sh@120 -- # [[ 4420 4421 == \4\4\2\0\ \4\4\2\1 ]] 00:24:47.064 23:02:38 -- host/discovery.sh@121 -- # get_notification_count 00:24:47.064 23:02:38 -- host/discovery.sh@74 -- # rpc_cmd -s /tmp/host.sock notify_get_notifications -i 2 00:24:47.064 23:02:38 -- common/autotest_common.sh@551 -- # xtrace_disable 00:24:47.064 23:02:38 -- host/discovery.sh@74 -- # jq '. | length' 00:24:47.064 23:02:38 -- common/autotest_common.sh@10 -- # set +x 00:24:47.064 23:02:38 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:24:47.064 23:02:38 -- host/discovery.sh@74 -- # notification_count=0 00:24:47.064 23:02:38 -- host/discovery.sh@75 -- # notify_id=2 00:24:47.064 23:02:38 -- host/discovery.sh@122 -- # [[ 0 == 0 ]] 00:24:47.064 23:02:38 -- host/discovery.sh@126 -- # rpc_cmd nvmf_subsystem_remove_listener nqn.2016-06.io.spdk:cnode0 -t tcp -a 10.0.0.2 -s 4420 00:24:47.064 23:02:38 -- common/autotest_common.sh@551 -- # xtrace_disable 00:24:47.064 23:02:38 -- common/autotest_common.sh@10 -- # set +x 00:24:47.064 [2024-04-16 23:02:38.102703] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:24:47.064 [2024-04-16 23:02:38.102744] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:47.064 [2024-04-16 23:02:38.102764] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:24:47.064 [2024-04-16 23:02:38.102781] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:47.064 [2024-04-16 23:02:38.102796] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:24:47.064 [2024-04-16 23:02:38.102816] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:47.064 [2024-04-16 23:02:38.102832] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:24:47.064 [2024-04-16 23:02:38.102847] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:47.064 [2024-04-16 23:02:38.102862] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x150ab70 is same with the state(5) to be set 00:24:47.064 [2024-04-16 23:02:38.103123] bdev_nvme.c:6685:discovery_aer_cb: *INFO*: Discovery[10.0.0.2:8009] got aer 00:24:47.064 [2024-04-16 23:02:38.103155] bdev_nvme.c:6666:get_discovery_log_page: *INFO*: Discovery[10.0.0.2:8009] sent discovery log page command 00:24:47.064 23:02:38 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:24:47.064 23:02:38 -- host/discovery.sh@127 -- # sleep 1 00:24:47.064 [2024-04-16 23:02:38.112706] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x150ab70 (9): Bad file descriptor 00:24:47.064 [2024-04-16 23:02:38.122751] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode0] resetting controller 00:24:47.064 [2024-04-16 23:02:38.123011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:47.064 [2024-04-16 23:02:38.123173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:47.064 [2024-04-16 23:02:38.123229] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x150ab70 with addr=10.0.0.2, port=4420 00:24:47.064 [2024-04-16 23:02:38.123247] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x150ab70 is same with the state(5) to be set 00:24:47.064 [2024-04-16 23:02:38.123271] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x150ab70 (9): Bad file descriptor 00:24:47.064 [2024-04-16 23:02:38.123308] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode0] Ctrlr is in error state 00:24:47.064 [2024-04-16 23:02:38.123328] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode0] controller reinitialization failed 00:24:47.064 [2024-04-16 23:02:38.123358] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode0] in failed state. 00:24:47.064 [2024-04-16 23:02:38.123390] bdev_nvme.c:2024:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:47.064 [2024-04-16 23:02:38.132831] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode0] resetting controller 00:24:47.064 [2024-04-16 23:02:38.133021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:47.064 [2024-04-16 23:02:38.133236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:47.064 [2024-04-16 23:02:38.133264] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x150ab70 with addr=10.0.0.2, port=4420 00:24:47.064 [2024-04-16 23:02:38.133280] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x150ab70 is same with the state(5) to be set 00:24:47.064 [2024-04-16 23:02:38.133322] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x150ab70 (9): Bad file descriptor 00:24:47.065 [2024-04-16 23:02:38.133357] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode0] Ctrlr is in error state 00:24:47.065 [2024-04-16 23:02:38.133374] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode0] controller reinitialization failed 00:24:47.065 [2024-04-16 23:02:38.133403] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode0] in failed state. 00:24:47.065 [2024-04-16 23:02:38.133423] bdev_nvme.c:2024:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:47.065 [2024-04-16 23:02:38.142908] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode0] resetting controller 00:24:47.065 [2024-04-16 23:02:38.143122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:47.065 [2024-04-16 23:02:38.143293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:47.065 [2024-04-16 23:02:38.143321] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x150ab70 with addr=10.0.0.2, port=4420 00:24:47.065 [2024-04-16 23:02:38.143337] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x150ab70 is same with the state(5) to be set 00:24:47.065 [2024-04-16 23:02:38.143360] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x150ab70 (9): Bad file descriptor 00:24:47.065 [2024-04-16 23:02:38.143396] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode0] Ctrlr is in error state 00:24:47.065 [2024-04-16 23:02:38.143414] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode0] controller reinitialization failed 00:24:47.065 [2024-04-16 23:02:38.143428] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode0] in failed state. 00:24:47.065 [2024-04-16 23:02:38.143474] bdev_nvme.c:2024:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:47.065 [2024-04-16 23:02:38.152984] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode0] resetting controller 00:24:47.065 [2024-04-16 23:02:38.153196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:47.065 [2024-04-16 23:02:38.153363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:47.065 [2024-04-16 23:02:38.153390] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x150ab70 with addr=10.0.0.2, port=4420 00:24:47.065 [2024-04-16 23:02:38.153406] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x150ab70 is same with the state(5) to be set 00:24:47.065 [2024-04-16 23:02:38.153430] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x150ab70 (9): Bad file descriptor 00:24:47.065 [2024-04-16 23:02:38.153464] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode0] Ctrlr is in error state 00:24:47.065 [2024-04-16 23:02:38.153482] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode0] controller reinitialization failed 00:24:47.065 [2024-04-16 23:02:38.153496] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode0] in failed state. 00:24:47.065 [2024-04-16 23:02:38.153539] bdev_nvme.c:2024:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:47.065 [2024-04-16 23:02:38.163065] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode0] resetting controller 00:24:47.065 [2024-04-16 23:02:38.163260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:47.065 [2024-04-16 23:02:38.163380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:47.065 [2024-04-16 23:02:38.163405] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x150ab70 with addr=10.0.0.2, port=4420 00:24:47.065 [2024-04-16 23:02:38.163422] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x150ab70 is same with the state(5) to be set 00:24:47.065 [2024-04-16 23:02:38.163444] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x150ab70 (9): Bad file descriptor 00:24:47.065 [2024-04-16 23:02:38.163493] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode0] Ctrlr is in error state 00:24:47.065 [2024-04-16 23:02:38.163510] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode0] controller reinitialization failed 00:24:47.065 [2024-04-16 23:02:38.163526] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode0] in failed state. 00:24:47.065 [2024-04-16 23:02:38.163575] bdev_nvme.c:2024:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:47.065 [2024-04-16 23:02:38.173141] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode0] resetting controller 00:24:47.065 [2024-04-16 23:02:38.173388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:47.065 [2024-04-16 23:02:38.173634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:47.065 [2024-04-16 23:02:38.173659] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x150ab70 with addr=10.0.0.2, port=4420 00:24:47.065 [2024-04-16 23:02:38.173692] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x150ab70 is same with the state(5) to be set 00:24:47.065 [2024-04-16 23:02:38.173716] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x150ab70 (9): Bad file descriptor 00:24:47.065 [2024-04-16 23:02:38.173753] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode0] Ctrlr is in error state 00:24:47.065 [2024-04-16 23:02:38.173774] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode0] controller reinitialization failed 00:24:47.065 [2024-04-16 23:02:38.173789] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode0] in failed state. 00:24:47.065 [2024-04-16 23:02:38.173811] bdev_nvme.c:2024:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:47.065 [2024-04-16 23:02:38.183225] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode0] resetting controller 00:24:47.065 [2024-04-16 23:02:38.183458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:47.065 [2024-04-16 23:02:38.183629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:47.065 [2024-04-16 23:02:38.183659] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x150ab70 with addr=10.0.0.2, port=4420 00:24:47.065 [2024-04-16 23:02:38.183677] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x150ab70 is same with the state(5) to be set 00:24:47.065 [2024-04-16 23:02:38.183713] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x150ab70 (9): Bad file descriptor 00:24:47.065 [2024-04-16 23:02:38.183749] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode0] Ctrlr is in error state 00:24:47.065 [2024-04-16 23:02:38.183769] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode0] controller reinitialization failed 00:24:47.065 [2024-04-16 23:02:38.183784] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode0] in failed state. 00:24:47.065 [2024-04-16 23:02:38.183818] bdev_nvme.c:2024:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:47.065 [2024-04-16 23:02:38.189810] bdev_nvme.c:6490:discovery_remove_controllers: *INFO*: Discovery[10.0.0.2:8009] NVM nqn.2016-06.io.spdk:cnode0:10.0.0.2:4420 not found 00:24:47.065 [2024-04-16 23:02:38.189843] bdev_nvme.c:6481:discovery_remove_controllers: *INFO*: Discovery[10.0.0.2:8009] NVM nqn.2016-06.io.spdk:cnode0:10.0.0.2:4421 found again 00:24:47.999 23:02:39 -- host/discovery.sh@128 -- # get_subsystem_names 00:24:47.999 23:02:39 -- host/discovery.sh@59 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_get_controllers 00:24:47.999 23:02:39 -- host/discovery.sh@59 -- # jq -r '.[].name' 00:24:47.999 23:02:39 -- common/autotest_common.sh@551 -- # xtrace_disable 00:24:47.999 23:02:39 -- host/discovery.sh@59 -- # sort 00:24:47.999 23:02:39 -- common/autotest_common.sh@10 -- # set +x 00:24:47.999 23:02:39 -- host/discovery.sh@59 -- # xargs 00:24:47.999 23:02:39 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:24:48.257 23:02:39 -- host/discovery.sh@128 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:24:48.257 23:02:39 -- host/discovery.sh@129 -- # get_bdev_list 00:24:48.257 23:02:39 -- host/discovery.sh@55 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:24:48.257 23:02:39 -- common/autotest_common.sh@551 -- # xtrace_disable 00:24:48.257 23:02:39 -- host/discovery.sh@55 -- # jq -r '.[].name' 00:24:48.257 23:02:39 -- common/autotest_common.sh@10 -- # set +x 00:24:48.257 23:02:39 -- host/discovery.sh@55 -- # sort 00:24:48.257 23:02:39 -- host/discovery.sh@55 -- # xargs 00:24:48.257 23:02:39 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:24:48.257 23:02:39 -- host/discovery.sh@129 -- # [[ nvme0n1 nvme0n2 == \n\v\m\e\0\n\1\ \n\v\m\e\0\n\2 ]] 00:24:48.257 23:02:39 -- host/discovery.sh@130 -- # get_subsystem_paths nvme0 00:24:48.257 23:02:39 -- host/discovery.sh@63 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_get_controllers -n nvme0 00:24:48.257 23:02:39 -- common/autotest_common.sh@551 -- # xtrace_disable 00:24:48.257 23:02:39 -- host/discovery.sh@63 -- # jq -r '.[].ctrlrs[].trid.trsvcid' 00:24:48.257 23:02:39 -- common/autotest_common.sh@10 -- # set +x 00:24:48.257 23:02:39 -- host/discovery.sh@63 -- # sort -n 00:24:48.257 23:02:39 -- host/discovery.sh@63 -- # xargs 00:24:48.257 23:02:39 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:24:48.257 23:02:39 -- host/discovery.sh@130 -- # [[ 4421 == \4\4\2\1 ]] 00:24:48.257 23:02:39 -- host/discovery.sh@131 -- # get_notification_count 00:24:48.257 23:02:39 -- host/discovery.sh@74 -- # rpc_cmd -s /tmp/host.sock notify_get_notifications -i 2 00:24:48.257 23:02:39 -- host/discovery.sh@74 -- # jq '. | length' 00:24:48.257 23:02:39 -- common/autotest_common.sh@551 -- # xtrace_disable 00:24:48.257 23:02:39 -- common/autotest_common.sh@10 -- # set +x 00:24:48.257 23:02:39 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:24:48.258 23:02:39 -- host/discovery.sh@74 -- # notification_count=0 00:24:48.258 23:02:39 -- host/discovery.sh@75 -- # notify_id=2 00:24:48.258 23:02:39 -- host/discovery.sh@132 -- # [[ 0 == 0 ]] 00:24:48.258 23:02:39 -- host/discovery.sh@134 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_stop_discovery -b nvme 00:24:48.258 23:02:39 -- common/autotest_common.sh@551 -- # xtrace_disable 00:24:48.258 23:02:39 -- common/autotest_common.sh@10 -- # set +x 00:24:48.258 23:02:39 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:24:48.258 23:02:39 -- host/discovery.sh@135 -- # sleep 1 00:24:49.194 23:02:40 -- host/discovery.sh@136 -- # get_subsystem_names 00:24:49.194 23:02:40 -- host/discovery.sh@59 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_get_controllers 00:24:49.194 23:02:40 -- common/autotest_common.sh@551 -- # xtrace_disable 00:24:49.194 23:02:40 -- common/autotest_common.sh@10 -- # set +x 00:24:49.194 23:02:40 -- host/discovery.sh@59 -- # jq -r '.[].name' 00:24:49.194 23:02:40 -- host/discovery.sh@59 -- # sort 00:24:49.194 23:02:40 -- host/discovery.sh@59 -- # xargs 00:24:49.194 23:02:40 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:24:49.453 23:02:40 -- host/discovery.sh@136 -- # [[ '' == '' ]] 00:24:49.453 23:02:40 -- host/discovery.sh@137 -- # get_bdev_list 00:24:49.453 23:02:40 -- host/discovery.sh@55 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:24:49.453 23:02:40 -- common/autotest_common.sh@551 -- # xtrace_disable 00:24:49.453 23:02:40 -- common/autotest_common.sh@10 -- # set +x 00:24:49.453 23:02:40 -- host/discovery.sh@55 -- # jq -r '.[].name' 00:24:49.453 23:02:40 -- host/discovery.sh@55 -- # sort 00:24:49.453 23:02:40 -- host/discovery.sh@55 -- # xargs 00:24:49.453 23:02:40 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:24:49.453 23:02:40 -- host/discovery.sh@137 -- # [[ '' == '' ]] 00:24:49.453 23:02:40 -- host/discovery.sh@138 -- # get_notification_count 00:24:49.453 23:02:40 -- host/discovery.sh@74 -- # rpc_cmd -s /tmp/host.sock notify_get_notifications -i 2 00:24:49.453 23:02:40 -- common/autotest_common.sh@551 -- # xtrace_disable 00:24:49.453 23:02:40 -- common/autotest_common.sh@10 -- # set +x 00:24:49.453 23:02:40 -- host/discovery.sh@74 -- # jq '. | length' 00:24:49.453 23:02:40 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:24:49.453 23:02:40 -- host/discovery.sh@74 -- # notification_count=2 00:24:49.453 23:02:40 -- host/discovery.sh@75 -- # notify_id=4 00:24:49.453 23:02:40 -- host/discovery.sh@139 -- # [[ 2 == 2 ]] 00:24:49.453 23:02:40 -- host/discovery.sh@142 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_start_discovery -b nvme -t tcp -a 10.0.0.2 -s 8009 -f ipv4 -q nqn.2021-12.io.spdk:test -w 00:24:49.453 23:02:40 -- common/autotest_common.sh@551 -- # xtrace_disable 00:24:49.453 23:02:40 -- common/autotest_common.sh@10 -- # set +x 00:24:50.393 [2024-04-16 23:02:41.425856] bdev_nvme.c:6703:discovery_attach_cb: *INFO*: Discovery[10.0.0.2:8009] discovery ctrlr attached 00:24:50.393 [2024-04-16 23:02:41.425891] bdev_nvme.c:6783:discovery_poller: *INFO*: Discovery[10.0.0.2:8009] discovery ctrlr connected 00:24:50.393 [2024-04-16 23:02:41.425917] bdev_nvme.c:6666:get_discovery_log_page: *INFO*: Discovery[10.0.0.2:8009] sent discovery log page command 00:24:50.393 [2024-04-16 23:02:41.513191] bdev_nvme.c:6632:discovery_log_page_cb: *INFO*: Discovery[10.0.0.2:8009] NVM nqn.2016-06.io.spdk:cnode0:10.0.0.2:4421 new subsystem nvme0 00:24:50.652 [2024-04-16 23:02:41.579474] bdev_nvme.c:6522:discovery_attach_controller_done: *INFO*: Discovery[10.0.0.2:8009] attach nvme0 done 00:24:50.652 [2024-04-16 23:02:41.579514] bdev_nvme.c:6481:discovery_remove_controllers: *INFO*: Discovery[10.0.0.2:8009] NVM nqn.2016-06.io.spdk:cnode0:10.0.0.2:4421 found again 00:24:50.652 23:02:41 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:24:50.652 23:02:41 -- host/discovery.sh@144 -- # NOT rpc_cmd -s /tmp/host.sock bdev_nvme_start_discovery -b nvme -t tcp -a 10.0.0.2 -s 8009 -f ipv4 -q nqn.2021-12.io.spdk:test -w 00:24:50.652 23:02:41 -- common/autotest_common.sh@640 -- # local es=0 00:24:50.652 23:02:41 -- common/autotest_common.sh@642 -- # valid_exec_arg rpc_cmd -s /tmp/host.sock bdev_nvme_start_discovery -b nvme -t tcp -a 10.0.0.2 -s 8009 -f ipv4 -q nqn.2021-12.io.spdk:test -w 00:24:50.652 23:02:41 -- common/autotest_common.sh@628 -- # local arg=rpc_cmd 00:24:50.652 23:02:41 -- common/autotest_common.sh@632 -- # case "$(type -t "$arg")" in 00:24:50.652 23:02:41 -- common/autotest_common.sh@632 -- # type -t rpc_cmd 00:24:50.652 23:02:41 -- common/autotest_common.sh@632 -- # case "$(type -t "$arg")" in 00:24:50.652 23:02:41 -- common/autotest_common.sh@643 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_start_discovery -b nvme -t tcp -a 10.0.0.2 -s 8009 -f ipv4 -q nqn.2021-12.io.spdk:test -w 00:24:50.652 23:02:41 -- common/autotest_common.sh@551 -- # xtrace_disable 00:24:50.652 23:02:41 -- common/autotest_common.sh@10 -- # set +x 00:24:50.652 request: 00:24:50.652 { 00:24:50.652 "name": "nvme", 00:24:50.652 "trtype": "tcp", 00:24:50.652 "traddr": "10.0.0.2", 00:24:50.652 "hostnqn": "nqn.2021-12.io.spdk:test", 00:24:50.652 "adrfam": "ipv4", 00:24:50.652 "trsvcid": "8009", 00:24:50.652 "wait_for_attach": true, 00:24:50.652 "method": "bdev_nvme_start_discovery", 00:24:50.652 "req_id": 1 00:24:50.652 } 00:24:50.652 Got JSON-RPC error response 00:24:50.652 response: 00:24:50.652 { 00:24:50.652 "code": -17, 00:24:50.652 "message": "File exists" 00:24:50.652 } 00:24:50.652 23:02:41 -- common/autotest_common.sh@579 -- # [[ 1 == 0 ]] 00:24:50.652 23:02:41 -- common/autotest_common.sh@643 -- # es=1 00:24:50.652 23:02:41 -- common/autotest_common.sh@651 -- # (( es > 128 )) 00:24:50.652 23:02:41 -- common/autotest_common.sh@662 -- # [[ -n '' ]] 00:24:50.652 23:02:41 -- common/autotest_common.sh@667 -- # (( !es == 0 )) 00:24:50.652 23:02:41 -- host/discovery.sh@146 -- # get_discovery_ctrlrs 00:24:50.652 23:02:41 -- host/discovery.sh@67 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_get_discovery_info 00:24:50.652 23:02:41 -- common/autotest_common.sh@551 -- # xtrace_disable 00:24:50.652 23:02:41 -- host/discovery.sh@67 -- # jq -r '.[].name' 00:24:50.652 23:02:41 -- common/autotest_common.sh@10 -- # set +x 00:24:50.652 23:02:41 -- host/discovery.sh@67 -- # sort 00:24:50.652 23:02:41 -- host/discovery.sh@67 -- # xargs 00:24:50.652 23:02:41 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:24:50.652 23:02:41 -- host/discovery.sh@146 -- # [[ nvme == \n\v\m\e ]] 00:24:50.652 23:02:41 -- host/discovery.sh@147 -- # get_bdev_list 00:24:50.652 23:02:41 -- host/discovery.sh@55 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:24:50.652 23:02:41 -- host/discovery.sh@55 -- # jq -r '.[].name' 00:24:50.652 23:02:41 -- common/autotest_common.sh@551 -- # xtrace_disable 00:24:50.652 23:02:41 -- common/autotest_common.sh@10 -- # set +x 00:24:50.652 23:02:41 -- host/discovery.sh@55 -- # sort 00:24:50.652 23:02:41 -- host/discovery.sh@55 -- # xargs 00:24:50.652 23:02:41 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:24:50.652 23:02:41 -- host/discovery.sh@147 -- # [[ nvme0n1 nvme0n2 == \n\v\m\e\0\n\1\ \n\v\m\e\0\n\2 ]] 00:24:50.652 23:02:41 -- host/discovery.sh@150 -- # NOT rpc_cmd -s /tmp/host.sock bdev_nvme_start_discovery -b nvme_second -t tcp -a 10.0.0.2 -s 8009 -f ipv4 -q nqn.2021-12.io.spdk:test -w 00:24:50.652 23:02:41 -- common/autotest_common.sh@640 -- # local es=0 00:24:50.652 23:02:41 -- common/autotest_common.sh@642 -- # valid_exec_arg rpc_cmd -s /tmp/host.sock bdev_nvme_start_discovery -b nvme_second -t tcp -a 10.0.0.2 -s 8009 -f ipv4 -q nqn.2021-12.io.spdk:test -w 00:24:50.652 23:02:41 -- common/autotest_common.sh@628 -- # local arg=rpc_cmd 00:24:50.652 23:02:41 -- common/autotest_common.sh@632 -- # case "$(type -t "$arg")" in 00:24:50.652 23:02:41 -- common/autotest_common.sh@632 -- # type -t rpc_cmd 00:24:50.652 23:02:41 -- common/autotest_common.sh@632 -- # case "$(type -t "$arg")" in 00:24:50.652 23:02:41 -- common/autotest_common.sh@643 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_start_discovery -b nvme_second -t tcp -a 10.0.0.2 -s 8009 -f ipv4 -q nqn.2021-12.io.spdk:test -w 00:24:50.652 23:02:41 -- common/autotest_common.sh@551 -- # xtrace_disable 00:24:50.652 23:02:41 -- common/autotest_common.sh@10 -- # set +x 00:24:50.652 request: 00:24:50.652 { 00:24:50.652 "name": "nvme_second", 00:24:50.652 "trtype": "tcp", 00:24:50.652 "traddr": "10.0.0.2", 00:24:50.652 "hostnqn": "nqn.2021-12.io.spdk:test", 00:24:50.652 "adrfam": "ipv4", 00:24:50.652 "trsvcid": "8009", 00:24:50.652 "wait_for_attach": true, 00:24:50.653 "method": "bdev_nvme_start_discovery", 00:24:50.653 "req_id": 1 00:24:50.653 } 00:24:50.653 Got JSON-RPC error response 00:24:50.653 response: 00:24:50.653 { 00:24:50.653 "code": -17, 00:24:50.653 "message": "File exists" 00:24:50.653 } 00:24:50.653 23:02:41 -- common/autotest_common.sh@579 -- # [[ 1 == 0 ]] 00:24:50.653 23:02:41 -- common/autotest_common.sh@643 -- # es=1 00:24:50.653 23:02:41 -- common/autotest_common.sh@651 -- # (( es > 128 )) 00:24:50.653 23:02:41 -- common/autotest_common.sh@662 -- # [[ -n '' ]] 00:24:50.653 23:02:41 -- common/autotest_common.sh@667 -- # (( !es == 0 )) 00:24:50.653 23:02:41 -- host/discovery.sh@152 -- # get_discovery_ctrlrs 00:24:50.653 23:02:41 -- host/discovery.sh@67 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_get_discovery_info 00:24:50.653 23:02:41 -- host/discovery.sh@67 -- # jq -r '.[].name' 00:24:50.653 23:02:41 -- common/autotest_common.sh@551 -- # xtrace_disable 00:24:50.653 23:02:41 -- common/autotest_common.sh@10 -- # set +x 00:24:50.653 23:02:41 -- host/discovery.sh@67 -- # sort 00:24:50.653 23:02:41 -- host/discovery.sh@67 -- # xargs 00:24:50.653 23:02:41 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:24:50.653 23:02:41 -- host/discovery.sh@152 -- # [[ nvme == \n\v\m\e ]] 00:24:50.653 23:02:41 -- host/discovery.sh@153 -- # get_bdev_list 00:24:50.653 23:02:41 -- host/discovery.sh@55 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:24:50.653 23:02:41 -- common/autotest_common.sh@551 -- # xtrace_disable 00:24:50.653 23:02:41 -- host/discovery.sh@55 -- # jq -r '.[].name' 00:24:50.653 23:02:41 -- common/autotest_common.sh@10 -- # set +x 00:24:50.653 23:02:41 -- host/discovery.sh@55 -- # sort 00:24:50.653 23:02:41 -- host/discovery.sh@55 -- # xargs 00:24:50.653 23:02:41 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:24:50.653 23:02:41 -- host/discovery.sh@153 -- # [[ nvme0n1 nvme0n2 == \n\v\m\e\0\n\1\ \n\v\m\e\0\n\2 ]] 00:24:50.653 23:02:41 -- host/discovery.sh@156 -- # NOT rpc_cmd -s /tmp/host.sock bdev_nvme_start_discovery -b nvme_second -t tcp -a 10.0.0.2 -s 8010 -f ipv4 -q nqn.2021-12.io.spdk:test -T 3000 00:24:50.653 23:02:41 -- common/autotest_common.sh@640 -- # local es=0 00:24:50.653 23:02:41 -- common/autotest_common.sh@642 -- # valid_exec_arg rpc_cmd -s /tmp/host.sock bdev_nvme_start_discovery -b nvme_second -t tcp -a 10.0.0.2 -s 8010 -f ipv4 -q nqn.2021-12.io.spdk:test -T 3000 00:24:50.653 23:02:41 -- common/autotest_common.sh@628 -- # local arg=rpc_cmd 00:24:50.911 23:02:41 -- common/autotest_common.sh@632 -- # case "$(type -t "$arg")" in 00:24:50.911 23:02:41 -- common/autotest_common.sh@632 -- # type -t rpc_cmd 00:24:50.911 23:02:41 -- common/autotest_common.sh@632 -- # case "$(type -t "$arg")" in 00:24:50.911 23:02:41 -- common/autotest_common.sh@643 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_start_discovery -b nvme_second -t tcp -a 10.0.0.2 -s 8010 -f ipv4 -q nqn.2021-12.io.spdk:test -T 3000 00:24:50.911 23:02:41 -- common/autotest_common.sh@551 -- # xtrace_disable 00:24:50.911 23:02:41 -- common/autotest_common.sh@10 -- # set +x 00:24:51.848 [2024-04-16 23:02:42.786875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:51.848 [2024-04-16 23:02:42.787102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:51.848 [2024-04-16 23:02:42.787133] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147bdf0 with addr=10.0.0.2, port=8010 00:24:51.848 [2024-04-16 23:02:42.787159] nvme_tcp.c:2596:nvme_tcp_ctrlr_construct: *ERROR*: failed to create admin qpair 00:24:51.848 [2024-04-16 23:02:42.787182] nvme.c: 821:nvme_probe_internal: *ERROR*: NVMe ctrlr scan failed 00:24:51.848 [2024-04-16 23:02:42.787199] bdev_nvme.c:6765:discovery_poller: *ERROR*: Discovery[10.0.0.2:8010] could not start discovery connect 00:24:52.785 [2024-04-16 23:02:43.789308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:52.785 [2024-04-16 23:02:43.789500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:52.785 [2024-04-16 23:02:43.789532] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x147bdf0 with addr=10.0.0.2, port=8010 00:24:52.785 [2024-04-16 23:02:43.789560] nvme_tcp.c:2596:nvme_tcp_ctrlr_construct: *ERROR*: failed to create admin qpair 00:24:52.785 [2024-04-16 23:02:43.789576] nvme.c: 821:nvme_probe_internal: *ERROR*: NVMe ctrlr scan failed 00:24:52.785 [2024-04-16 23:02:43.789590] bdev_nvme.c:6765:discovery_poller: *ERROR*: Discovery[10.0.0.2:8010] could not start discovery connect 00:24:53.721 [2024-04-16 23:02:44.791550] bdev_nvme.c:6746:discovery_poller: *ERROR*: Discovery[10.0.0.2:8010] timed out while attaching discovery ctrlr 00:24:53.721 request: 00:24:53.721 { 00:24:53.721 "name": "nvme_second", 00:24:53.721 "trtype": "tcp", 00:24:53.721 "traddr": "10.0.0.2", 00:24:53.721 "hostnqn": "nqn.2021-12.io.spdk:test", 00:24:53.721 "adrfam": "ipv4", 00:24:53.721 "trsvcid": "8010", 00:24:53.721 "attach_timeout_ms": 3000, 00:24:53.721 "method": "bdev_nvme_start_discovery", 00:24:53.721 "req_id": 1 00:24:53.721 } 00:24:53.721 Got JSON-RPC error response 00:24:53.721 response: 00:24:53.721 { 00:24:53.721 "code": -110, 00:24:53.721 "message": "Connection timed out" 00:24:53.721 } 00:24:53.721 23:02:44 -- common/autotest_common.sh@579 -- # [[ 1 == 0 ]] 00:24:53.721 23:02:44 -- common/autotest_common.sh@643 -- # es=1 00:24:53.721 23:02:44 -- common/autotest_common.sh@651 -- # (( es > 128 )) 00:24:53.721 23:02:44 -- common/autotest_common.sh@662 -- # [[ -n '' ]] 00:24:53.721 23:02:44 -- common/autotest_common.sh@667 -- # (( !es == 0 )) 00:24:53.721 23:02:44 -- host/discovery.sh@158 -- # get_discovery_ctrlrs 00:24:53.721 23:02:44 -- host/discovery.sh@67 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_get_discovery_info 00:24:53.721 23:02:44 -- host/discovery.sh@67 -- # jq -r '.[].name' 00:24:53.721 23:02:44 -- common/autotest_common.sh@551 -- # xtrace_disable 00:24:53.721 23:02:44 -- host/discovery.sh@67 -- # sort 00:24:53.721 23:02:44 -- common/autotest_common.sh@10 -- # set +x 00:24:53.721 23:02:44 -- host/discovery.sh@67 -- # xargs 00:24:53.721 23:02:44 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:24:53.721 23:02:44 -- host/discovery.sh@158 -- # [[ nvme == \n\v\m\e ]] 00:24:53.721 23:02:44 -- host/discovery.sh@160 -- # trap - SIGINT SIGTERM EXIT 00:24:53.721 23:02:44 -- host/discovery.sh@162 -- # kill 373605 00:24:53.721 23:02:44 -- host/discovery.sh@163 -- # nvmftestfini 00:24:53.721 23:02:44 -- nvmf/common.sh@476 -- # nvmfcleanup 00:24:53.721 23:02:44 -- nvmf/common.sh@116 -- # sync 00:24:53.721 23:02:44 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:24:53.721 23:02:44 -- nvmf/common.sh@119 -- # set +e 00:24:53.721 23:02:44 -- nvmf/common.sh@120 -- # for i in {1..20} 00:24:53.721 23:02:44 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:24:53.721 rmmod nvme_tcp 00:24:53.979 rmmod nvme_fabrics 00:24:53.979 rmmod nvme_keyring 00:24:53.979 23:02:44 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:24:53.979 23:02:44 -- nvmf/common.sh@123 -- # set -e 00:24:53.979 23:02:44 -- nvmf/common.sh@124 -- # return 0 00:24:53.979 23:02:44 -- nvmf/common.sh@477 -- # '[' -n 373451 ']' 00:24:53.979 23:02:44 -- nvmf/common.sh@478 -- # killprocess 373451 00:24:53.979 23:02:44 -- common/autotest_common.sh@926 -- # '[' -z 373451 ']' 00:24:53.979 23:02:44 -- common/autotest_common.sh@930 -- # kill -0 373451 00:24:53.979 23:02:44 -- common/autotest_common.sh@931 -- # uname 00:24:53.979 23:02:44 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:24:53.979 23:02:44 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 373451 00:24:53.979 23:02:44 -- common/autotest_common.sh@932 -- # process_name=reactor_1 00:24:53.979 23:02:44 -- common/autotest_common.sh@936 -- # '[' reactor_1 = sudo ']' 00:24:53.980 23:02:44 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 373451' 00:24:53.980 killing process with pid 373451 00:24:53.980 23:02:44 -- common/autotest_common.sh@945 -- # kill 373451 00:24:53.980 23:02:44 -- common/autotest_common.sh@950 -- # wait 373451 00:24:54.238 23:02:45 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:24:54.238 23:02:45 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:24:54.238 23:02:45 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:24:54.238 23:02:45 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:24:54.238 23:02:45 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:24:54.238 23:02:45 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:24:54.238 23:02:45 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:24:54.238 23:02:45 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:24:56.141 23:02:47 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:24:56.141 00:24:56.141 real 0m17.324s 00:24:56.141 user 0m26.801s 00:24:56.141 sys 0m2.992s 00:24:56.141 23:02:47 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:24:56.141 23:02:47 -- common/autotest_common.sh@10 -- # set +x 00:24:56.141 ************************************ 00:24:56.141 END TEST nvmf_discovery 00:24:56.141 ************************************ 00:24:56.141 23:02:47 -- nvmf/nvmf.sh@101 -- # run_test nvmf_discovery_remove_ifc /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/discovery_remove_ifc.sh --transport=tcp 00:24:56.141 23:02:47 -- common/autotest_common.sh@1077 -- # '[' 3 -le 1 ']' 00:24:56.141 23:02:47 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:24:56.141 23:02:47 -- common/autotest_common.sh@10 -- # set +x 00:24:56.141 ************************************ 00:24:56.141 START TEST nvmf_discovery_remove_ifc 00:24:56.400 ************************************ 00:24:56.400 23:02:47 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/discovery_remove_ifc.sh --transport=tcp 00:24:56.400 * Looking for test storage... 00:24:56.400 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host 00:24:56.400 23:02:47 -- host/discovery_remove_ifc.sh@12 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:24:56.400 23:02:47 -- nvmf/common.sh@7 -- # uname -s 00:24:56.400 23:02:47 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:24:56.400 23:02:47 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:24:56.400 23:02:47 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:24:56.400 23:02:47 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:24:56.400 23:02:47 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:24:56.400 23:02:47 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:24:56.400 23:02:47 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:24:56.400 23:02:47 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:24:56.400 23:02:47 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:24:56.400 23:02:47 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:24:56.400 23:02:47 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:24:56.400 23:02:47 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:24:56.400 23:02:47 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:24:56.400 23:02:47 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:24:56.400 23:02:47 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:24:56.400 23:02:47 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:24:56.400 23:02:47 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:24:56.400 23:02:47 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:24:56.400 23:02:47 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:24:56.400 23:02:47 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:24:56.400 23:02:47 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:24:56.400 23:02:47 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:24:56.400 23:02:47 -- paths/export.sh@5 -- # export PATH 00:24:56.400 23:02:47 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:24:56.400 23:02:47 -- nvmf/common.sh@46 -- # : 0 00:24:56.400 23:02:47 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:24:56.400 23:02:47 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:24:56.400 23:02:47 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:24:56.400 23:02:47 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:24:56.400 23:02:47 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:24:56.400 23:02:47 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:24:56.400 23:02:47 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:24:56.400 23:02:47 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:24:56.401 23:02:47 -- host/discovery_remove_ifc.sh@14 -- # '[' tcp == rdma ']' 00:24:56.401 23:02:47 -- host/discovery_remove_ifc.sh@19 -- # discovery_port=8009 00:24:56.401 23:02:47 -- host/discovery_remove_ifc.sh@20 -- # discovery_nqn=nqn.2014-08.org.nvmexpress.discovery 00:24:56.401 23:02:47 -- host/discovery_remove_ifc.sh@23 -- # nqn=nqn.2016-06.io.spdk:cnode 00:24:56.401 23:02:47 -- host/discovery_remove_ifc.sh@25 -- # host_nqn=nqn.2021-12.io.spdk:test 00:24:56.401 23:02:47 -- host/discovery_remove_ifc.sh@26 -- # host_sock=/tmp/host.sock 00:24:56.401 23:02:47 -- host/discovery_remove_ifc.sh@39 -- # nvmftestinit 00:24:56.401 23:02:47 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:24:56.401 23:02:47 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:24:56.401 23:02:47 -- nvmf/common.sh@436 -- # prepare_net_devs 00:24:56.401 23:02:47 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:24:56.401 23:02:47 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:24:56.401 23:02:47 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:24:56.401 23:02:47 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:24:56.401 23:02:47 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:24:56.401 23:02:47 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:24:56.401 23:02:47 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:24:56.401 23:02:47 -- nvmf/common.sh@284 -- # xtrace_disable 00:24:56.401 23:02:47 -- common/autotest_common.sh@10 -- # set +x 00:24:58.307 23:02:49 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:24:58.307 23:02:49 -- nvmf/common.sh@290 -- # pci_devs=() 00:24:58.307 23:02:49 -- nvmf/common.sh@290 -- # local -a pci_devs 00:24:58.307 23:02:49 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:24:58.307 23:02:49 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:24:58.307 23:02:49 -- nvmf/common.sh@292 -- # pci_drivers=() 00:24:58.307 23:02:49 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:24:58.307 23:02:49 -- nvmf/common.sh@294 -- # net_devs=() 00:24:58.307 23:02:49 -- nvmf/common.sh@294 -- # local -ga net_devs 00:24:58.307 23:02:49 -- nvmf/common.sh@295 -- # e810=() 00:24:58.307 23:02:49 -- nvmf/common.sh@295 -- # local -ga e810 00:24:58.307 23:02:49 -- nvmf/common.sh@296 -- # x722=() 00:24:58.307 23:02:49 -- nvmf/common.sh@296 -- # local -ga x722 00:24:58.307 23:02:49 -- nvmf/common.sh@297 -- # mlx=() 00:24:58.307 23:02:49 -- nvmf/common.sh@297 -- # local -ga mlx 00:24:58.307 23:02:49 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:24:58.307 23:02:49 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:24:58.307 23:02:49 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:24:58.307 23:02:49 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:24:58.307 23:02:49 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:24:58.307 23:02:49 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:24:58.307 23:02:49 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:24:58.307 23:02:49 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:24:58.307 23:02:49 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:24:58.307 23:02:49 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:24:58.307 23:02:49 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:24:58.307 23:02:49 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:24:58.307 23:02:49 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:24:58.307 23:02:49 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:24:58.307 23:02:49 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:24:58.307 23:02:49 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:24:58.307 23:02:49 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:24:58.307 23:02:49 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:24:58.307 23:02:49 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:24:58.307 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:24:58.307 23:02:49 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:24:58.307 23:02:49 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:24:58.307 23:02:49 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:24:58.307 23:02:49 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:24:58.307 23:02:49 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:24:58.307 23:02:49 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:24:58.307 23:02:49 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:24:58.307 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:24:58.307 23:02:49 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:24:58.307 23:02:49 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:24:58.307 23:02:49 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:24:58.307 23:02:49 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:24:58.307 23:02:49 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:24:58.307 23:02:49 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:24:58.307 23:02:49 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:24:58.307 23:02:49 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:24:58.307 23:02:49 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:24:58.307 23:02:49 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:24:58.307 23:02:49 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:24:58.307 23:02:49 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:24:58.307 23:02:49 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:24:58.307 Found net devices under 0000:0a:00.0: cvl_0_0 00:24:58.307 23:02:49 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:24:58.307 23:02:49 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:24:58.307 23:02:49 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:24:58.307 23:02:49 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:24:58.307 23:02:49 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:24:58.307 23:02:49 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:24:58.307 Found net devices under 0000:0a:00.1: cvl_0_1 00:24:58.307 23:02:49 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:24:58.307 23:02:49 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:24:58.307 23:02:49 -- nvmf/common.sh@402 -- # is_hw=yes 00:24:58.307 23:02:49 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:24:58.307 23:02:49 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:24:58.307 23:02:49 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:24:58.307 23:02:49 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:24:58.307 23:02:49 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:24:58.307 23:02:49 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:24:58.307 23:02:49 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:24:58.307 23:02:49 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:24:58.307 23:02:49 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:24:58.307 23:02:49 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:24:58.307 23:02:49 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:24:58.307 23:02:49 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:24:58.307 23:02:49 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:24:58.307 23:02:49 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:24:58.307 23:02:49 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:24:58.307 23:02:49 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:24:58.307 23:02:49 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:24:58.307 23:02:49 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:24:58.307 23:02:49 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:24:58.307 23:02:49 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:24:58.307 23:02:49 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:24:58.307 23:02:49 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:24:58.307 23:02:49 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:24:58.307 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:24:58.307 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.224 ms 00:24:58.307 00:24:58.307 --- 10.0.0.2 ping statistics --- 00:24:58.307 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:24:58.307 rtt min/avg/max/mdev = 0.224/0.224/0.224/0.000 ms 00:24:58.307 23:02:49 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:24:58.307 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:24:58.307 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.148 ms 00:24:58.307 00:24:58.307 --- 10.0.0.1 ping statistics --- 00:24:58.307 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:24:58.308 rtt min/avg/max/mdev = 0.148/0.148/0.148/0.000 ms 00:24:58.308 23:02:49 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:24:58.308 23:02:49 -- nvmf/common.sh@410 -- # return 0 00:24:58.308 23:02:49 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:24:58.308 23:02:49 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:24:58.308 23:02:49 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:24:58.308 23:02:49 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:24:58.308 23:02:49 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:24:58.308 23:02:49 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:24:58.308 23:02:49 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:24:58.308 23:02:49 -- host/discovery_remove_ifc.sh@40 -- # nvmfappstart -m 0x2 00:24:58.308 23:02:49 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:24:58.308 23:02:49 -- common/autotest_common.sh@712 -- # xtrace_disable 00:24:58.308 23:02:49 -- common/autotest_common.sh@10 -- # set +x 00:24:58.308 23:02:49 -- nvmf/common.sh@469 -- # nvmfpid=377074 00:24:58.308 23:02:49 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x2 00:24:58.308 23:02:49 -- nvmf/common.sh@470 -- # waitforlisten 377074 00:24:58.308 23:02:49 -- common/autotest_common.sh@819 -- # '[' -z 377074 ']' 00:24:58.308 23:02:49 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk.sock 00:24:58.308 23:02:49 -- common/autotest_common.sh@824 -- # local max_retries=100 00:24:58.308 23:02:49 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:24:58.308 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:24:58.308 23:02:49 -- common/autotest_common.sh@828 -- # xtrace_disable 00:24:58.308 23:02:49 -- common/autotest_common.sh@10 -- # set +x 00:24:58.308 [2024-04-16 23:02:49.311389] Starting SPDK v24.01.1-pre git sha1 4b134b4ab / DPDK 23.11.0 initialization... 00:24:58.308 [2024-04-16 23:02:49.311474] [ DPDK EAL parameters: nvmf -c 0x2 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:24:58.308 EAL: No free 2048 kB hugepages reported on node 1 00:24:58.308 [2024-04-16 23:02:49.374226] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:24:58.567 [2024-04-16 23:02:49.480117] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:24:58.567 [2024-04-16 23:02:49.480267] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:24:58.567 [2024-04-16 23:02:49.480286] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:24:58.567 [2024-04-16 23:02:49.480299] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:24:58.567 [2024-04-16 23:02:49.480326] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:24:59.501 23:02:50 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:24:59.502 23:02:50 -- common/autotest_common.sh@852 -- # return 0 00:24:59.502 23:02:50 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:24:59.502 23:02:50 -- common/autotest_common.sh@718 -- # xtrace_disable 00:24:59.502 23:02:50 -- common/autotest_common.sh@10 -- # set +x 00:24:59.502 23:02:50 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:24:59.502 23:02:50 -- host/discovery_remove_ifc.sh@43 -- # rpc_cmd 00:24:59.502 23:02:50 -- common/autotest_common.sh@551 -- # xtrace_disable 00:24:59.502 23:02:50 -- common/autotest_common.sh@10 -- # set +x 00:24:59.502 [2024-04-16 23:02:50.340379] tcp.c: 659:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:24:59.502 [2024-04-16 23:02:50.348508] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 8009 *** 00:24:59.502 null0 00:24:59.502 [2024-04-16 23:02:50.380520] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:24:59.502 23:02:50 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:24:59.502 23:02:50 -- host/discovery_remove_ifc.sh@59 -- # hostpid=377226 00:24:59.502 23:02:50 -- host/discovery_remove_ifc.sh@58 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -m 0x1 -r /tmp/host.sock --wait-for-rpc -L bdev_nvme 00:24:59.502 23:02:50 -- host/discovery_remove_ifc.sh@60 -- # waitforlisten 377226 /tmp/host.sock 00:24:59.502 23:02:50 -- common/autotest_common.sh@819 -- # '[' -z 377226 ']' 00:24:59.502 23:02:50 -- common/autotest_common.sh@823 -- # local rpc_addr=/tmp/host.sock 00:24:59.502 23:02:50 -- common/autotest_common.sh@824 -- # local max_retries=100 00:24:59.502 23:02:50 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /tmp/host.sock...' 00:24:59.502 Waiting for process to start up and listen on UNIX domain socket /tmp/host.sock... 00:24:59.502 23:02:50 -- common/autotest_common.sh@828 -- # xtrace_disable 00:24:59.502 23:02:50 -- common/autotest_common.sh@10 -- # set +x 00:24:59.502 [2024-04-16 23:02:50.440312] Starting SPDK v24.01.1-pre git sha1 4b134b4ab / DPDK 23.11.0 initialization... 00:24:59.502 [2024-04-16 23:02:50.440391] [ DPDK EAL parameters: nvmf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid377226 ] 00:24:59.502 EAL: No free 2048 kB hugepages reported on node 1 00:24:59.502 [2024-04-16 23:02:50.504625] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:24:59.502 [2024-04-16 23:02:50.618932] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:24:59.502 [2024-04-16 23:02:50.619085] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:24:59.761 23:02:50 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:24:59.761 23:02:50 -- common/autotest_common.sh@852 -- # return 0 00:24:59.761 23:02:50 -- host/discovery_remove_ifc.sh@62 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; killprocess $hostpid; nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:24:59.761 23:02:50 -- host/discovery_remove_ifc.sh@65 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_set_options -e 1 00:24:59.761 23:02:50 -- common/autotest_common.sh@551 -- # xtrace_disable 00:24:59.761 23:02:50 -- common/autotest_common.sh@10 -- # set +x 00:24:59.761 23:02:50 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:24:59.761 23:02:50 -- host/discovery_remove_ifc.sh@66 -- # rpc_cmd -s /tmp/host.sock framework_start_init 00:24:59.761 23:02:50 -- common/autotest_common.sh@551 -- # xtrace_disable 00:24:59.761 23:02:50 -- common/autotest_common.sh@10 -- # set +x 00:24:59.761 23:02:50 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:24:59.761 23:02:50 -- host/discovery_remove_ifc.sh@69 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_start_discovery -b nvme -t tcp -a 10.0.0.2 -s 8009 -f ipv4 -q nqn.2021-12.io.spdk:test --ctrlr-loss-timeout-sec 2 --reconnect-delay-sec 1 --fast-io-fail-timeout-sec 1 --wait-for-attach 00:24:59.761 23:02:50 -- common/autotest_common.sh@551 -- # xtrace_disable 00:24:59.761 23:02:50 -- common/autotest_common.sh@10 -- # set +x 00:25:00.698 [2024-04-16 23:02:51.820092] bdev_nvme.c:6703:discovery_attach_cb: *INFO*: Discovery[10.0.0.2:8009] discovery ctrlr attached 00:25:00.698 [2024-04-16 23:02:51.820129] bdev_nvme.c:6783:discovery_poller: *INFO*: Discovery[10.0.0.2:8009] discovery ctrlr connected 00:25:00.698 [2024-04-16 23:02:51.820155] bdev_nvme.c:6666:get_discovery_log_page: *INFO*: Discovery[10.0.0.2:8009] sent discovery log page command 00:25:00.957 [2024-04-16 23:02:51.907519] bdev_nvme.c:6632:discovery_log_page_cb: *INFO*: Discovery[10.0.0.2:8009] NVM nqn.2016-06.io.spdk:cnode0:10.0.0.2:4420 new subsystem nvme0 00:25:00.957 [2024-04-16 23:02:51.969263] bdev_nvme.c:7492:bdev_nvme_readv: *DEBUG*: read 8 blocks with offset 0 00:25:00.957 [2024-04-16 23:02:51.969309] bdev_nvme.c:7492:bdev_nvme_readv: *DEBUG*: read 1 blocks with offset 0 00:25:00.957 [2024-04-16 23:02:51.969346] bdev_nvme.c:7492:bdev_nvme_readv: *DEBUG*: read 64 blocks with offset 0 00:25:00.957 [2024-04-16 23:02:51.969367] bdev_nvme.c:6522:discovery_attach_controller_done: *INFO*: Discovery[10.0.0.2:8009] attach nvme0 done 00:25:00.957 [2024-04-16 23:02:51.969398] bdev_nvme.c:6481:discovery_remove_controllers: *INFO*: Discovery[10.0.0.2:8009] NVM nqn.2016-06.io.spdk:cnode0:10.0.0.2:4420 found again 00:25:00.957 23:02:51 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:25:00.957 23:02:51 -- host/discovery_remove_ifc.sh@72 -- # wait_for_bdev nvme0n1 00:25:00.957 23:02:51 -- host/discovery_remove_ifc.sh@33 -- # get_bdev_list 00:25:00.957 23:02:51 -- host/discovery_remove_ifc.sh@29 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:25:00.957 23:02:51 -- host/discovery_remove_ifc.sh@29 -- # jq -r '.[].name' 00:25:00.957 23:02:51 -- common/autotest_common.sh@551 -- # xtrace_disable 00:25:00.957 23:02:51 -- common/autotest_common.sh@10 -- # set +x 00:25:00.957 23:02:51 -- host/discovery_remove_ifc.sh@29 -- # sort 00:25:00.957 23:02:51 -- host/discovery_remove_ifc.sh@29 -- # xargs 00:25:00.957 [2024-04-16 23:02:51.976342] bdev_nvme.c:1581:bdev_nvme_disconnected_qpair_cb: *DEBUG*: qpair 0x1c72220 was disconnected and freed. delete nvme_qpair. 00:25:00.957 23:02:51 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:25:00.957 23:02:52 -- host/discovery_remove_ifc.sh@33 -- # [[ nvme0n1 != \n\v\m\e\0\n\1 ]] 00:25:00.957 23:02:52 -- host/discovery_remove_ifc.sh@75 -- # ip netns exec cvl_0_0_ns_spdk ip addr del 10.0.0.2/24 dev cvl_0_0 00:25:00.957 23:02:52 -- host/discovery_remove_ifc.sh@76 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 down 00:25:00.957 23:02:52 -- host/discovery_remove_ifc.sh@79 -- # wait_for_bdev '' 00:25:00.957 23:02:52 -- host/discovery_remove_ifc.sh@33 -- # get_bdev_list 00:25:00.957 23:02:52 -- host/discovery_remove_ifc.sh@29 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:25:00.957 23:02:52 -- host/discovery_remove_ifc.sh@29 -- # jq -r '.[].name' 00:25:00.957 23:02:52 -- common/autotest_common.sh@551 -- # xtrace_disable 00:25:00.957 23:02:52 -- common/autotest_common.sh@10 -- # set +x 00:25:00.957 23:02:52 -- host/discovery_remove_ifc.sh@29 -- # sort 00:25:00.957 23:02:52 -- host/discovery_remove_ifc.sh@29 -- # xargs 00:25:00.957 23:02:52 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:25:01.216 23:02:52 -- host/discovery_remove_ifc.sh@33 -- # [[ nvme0n1 != '' ]] 00:25:01.216 23:02:52 -- host/discovery_remove_ifc.sh@34 -- # sleep 1 00:25:02.151 23:02:53 -- host/discovery_remove_ifc.sh@33 -- # get_bdev_list 00:25:02.151 23:02:53 -- host/discovery_remove_ifc.sh@29 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:25:02.151 23:02:53 -- host/discovery_remove_ifc.sh@29 -- # jq -r '.[].name' 00:25:02.151 23:02:53 -- common/autotest_common.sh@551 -- # xtrace_disable 00:25:02.151 23:02:53 -- common/autotest_common.sh@10 -- # set +x 00:25:02.151 23:02:53 -- host/discovery_remove_ifc.sh@29 -- # sort 00:25:02.151 23:02:53 -- host/discovery_remove_ifc.sh@29 -- # xargs 00:25:02.151 23:02:53 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:25:02.151 23:02:53 -- host/discovery_remove_ifc.sh@33 -- # [[ nvme0n1 != '' ]] 00:25:02.151 23:02:53 -- host/discovery_remove_ifc.sh@34 -- # sleep 1 00:25:03.088 23:02:54 -- host/discovery_remove_ifc.sh@33 -- # get_bdev_list 00:25:03.088 23:02:54 -- host/discovery_remove_ifc.sh@29 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:25:03.088 23:02:54 -- common/autotest_common.sh@551 -- # xtrace_disable 00:25:03.088 23:02:54 -- host/discovery_remove_ifc.sh@29 -- # jq -r '.[].name' 00:25:03.088 23:02:54 -- common/autotest_common.sh@10 -- # set +x 00:25:03.088 23:02:54 -- host/discovery_remove_ifc.sh@29 -- # sort 00:25:03.088 23:02:54 -- host/discovery_remove_ifc.sh@29 -- # xargs 00:25:03.088 23:02:54 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:25:03.088 23:02:54 -- host/discovery_remove_ifc.sh@33 -- # [[ nvme0n1 != '' ]] 00:25:03.088 23:02:54 -- host/discovery_remove_ifc.sh@34 -- # sleep 1 00:25:04.505 23:02:55 -- host/discovery_remove_ifc.sh@33 -- # get_bdev_list 00:25:04.505 23:02:55 -- host/discovery_remove_ifc.sh@29 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:25:04.505 23:02:55 -- host/discovery_remove_ifc.sh@29 -- # jq -r '.[].name' 00:25:04.505 23:02:55 -- common/autotest_common.sh@551 -- # xtrace_disable 00:25:04.505 23:02:55 -- host/discovery_remove_ifc.sh@29 -- # sort 00:25:04.505 23:02:55 -- common/autotest_common.sh@10 -- # set +x 00:25:04.505 23:02:55 -- host/discovery_remove_ifc.sh@29 -- # xargs 00:25:04.505 23:02:55 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:25:04.505 23:02:55 -- host/discovery_remove_ifc.sh@33 -- # [[ nvme0n1 != '' ]] 00:25:04.505 23:02:55 -- host/discovery_remove_ifc.sh@34 -- # sleep 1 00:25:05.440 23:02:56 -- host/discovery_remove_ifc.sh@33 -- # get_bdev_list 00:25:05.440 23:02:56 -- host/discovery_remove_ifc.sh@29 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:25:05.440 23:02:56 -- host/discovery_remove_ifc.sh@29 -- # jq -r '.[].name' 00:25:05.440 23:02:56 -- common/autotest_common.sh@551 -- # xtrace_disable 00:25:05.440 23:02:56 -- host/discovery_remove_ifc.sh@29 -- # sort 00:25:05.440 23:02:56 -- common/autotest_common.sh@10 -- # set +x 00:25:05.440 23:02:56 -- host/discovery_remove_ifc.sh@29 -- # xargs 00:25:05.440 23:02:56 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:25:05.440 23:02:56 -- host/discovery_remove_ifc.sh@33 -- # [[ nvme0n1 != '' ]] 00:25:05.440 23:02:56 -- host/discovery_remove_ifc.sh@34 -- # sleep 1 00:25:06.378 23:02:57 -- host/discovery_remove_ifc.sh@33 -- # get_bdev_list 00:25:06.378 23:02:57 -- host/discovery_remove_ifc.sh@29 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:25:06.378 23:02:57 -- host/discovery_remove_ifc.sh@29 -- # jq -r '.[].name' 00:25:06.378 23:02:57 -- common/autotest_common.sh@551 -- # xtrace_disable 00:25:06.378 23:02:57 -- host/discovery_remove_ifc.sh@29 -- # sort 00:25:06.378 23:02:57 -- common/autotest_common.sh@10 -- # set +x 00:25:06.378 23:02:57 -- host/discovery_remove_ifc.sh@29 -- # xargs 00:25:06.378 23:02:57 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:25:06.378 23:02:57 -- host/discovery_remove_ifc.sh@33 -- # [[ nvme0n1 != '' ]] 00:25:06.378 23:02:57 -- host/discovery_remove_ifc.sh@34 -- # sleep 1 00:25:06.378 [2024-04-16 23:02:57.410460] /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/include/spdk_internal/nvme_tcp.h: 428:nvme_tcp_read_data: *ERROR*: spdk_sock_recv() failed, errno 110: Connection timed out 00:25:06.378 [2024-04-16 23:02:57.410531] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:25:06.378 [2024-04-16 23:02:57.410555] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:06.378 [2024-04-16 23:02:57.410574] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:25:06.378 [2024-04-16 23:02:57.410591] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:06.378 [2024-04-16 23:02:57.410608] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:25:06.378 [2024-04-16 23:02:57.410624] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:06.378 [2024-04-16 23:02:57.410641] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:25:06.378 [2024-04-16 23:02:57.410657] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:06.378 [2024-04-16 23:02:57.410674] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: KEEP ALIVE (18) qid:0 cid:4 nsid:0 cdw10:00000000 cdw11:00000000 00:25:06.378 [2024-04-16 23:02:57.410690] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:06.378 [2024-04-16 23:02:57.410706] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c38800 is same with the state(5) to be set 00:25:06.378 [2024-04-16 23:02:57.420479] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c38800 (9): Bad file descriptor 00:25:06.378 [2024-04-16 23:02:57.430523] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode0] resetting controller 00:25:07.317 23:02:58 -- host/discovery_remove_ifc.sh@33 -- # get_bdev_list 00:25:07.317 23:02:58 -- host/discovery_remove_ifc.sh@29 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:25:07.317 23:02:58 -- host/discovery_remove_ifc.sh@29 -- # jq -r '.[].name' 00:25:07.317 23:02:58 -- common/autotest_common.sh@551 -- # xtrace_disable 00:25:07.317 23:02:58 -- common/autotest_common.sh@10 -- # set +x 00:25:07.317 23:02:58 -- host/discovery_remove_ifc.sh@29 -- # sort 00:25:07.317 23:02:58 -- host/discovery_remove_ifc.sh@29 -- # xargs 00:25:07.576 [2024-04-16 23:02:58.447219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 110 00:25:08.514 [2024-04-16 23:02:59.471239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 110 00:25:08.514 [2024-04-16 23:02:59.471306] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c38800 with addr=10.0.0.2, port=4420 00:25:08.514 [2024-04-16 23:02:59.471333] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c38800 is same with the state(5) to be set 00:25:08.514 [2024-04-16 23:02:59.471805] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c38800 (9): Bad file descriptor 00:25:08.514 [2024-04-16 23:02:59.471853] bdev_nvme.c:2024:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:25:08.514 [2024-04-16 23:02:59.471891] bdev_nvme.c:6454:remove_discovery_entry: *INFO*: Discovery[10.0.0.2:8009] Remove discovery entry: nqn.2016-06.io.spdk:cnode0:10.0.0.2:4420 00:25:08.514 [2024-04-16 23:02:59.471933] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:25:08.514 [2024-04-16 23:02:59.471957] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:08.514 [2024-04-16 23:02:59.471978] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:25:08.514 [2024-04-16 23:02:59.471994] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:08.514 [2024-04-16 23:02:59.472011] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:25:08.514 [2024-04-16 23:02:59.472026] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:08.514 [2024-04-16 23:02:59.472042] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:25:08.514 [2024-04-16 23:02:59.472058] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:08.514 [2024-04-16 23:02:59.472075] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: KEEP ALIVE (18) qid:0 cid:4 nsid:0 cdw10:00000000 cdw11:00000000 00:25:08.514 [2024-04-16 23:02:59.472090] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:08.514 [2024-04-16 23:02:59.472105] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2014-08.org.nvmexpress.discovery] in failed state. 00:25:08.514 [2024-04-16 23:02:59.472417] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c38c10 (9): Bad file descriptor 00:25:08.514 [2024-04-16 23:02:59.473434] nvme_fabric.c: 214:nvme_fabric_prop_get_cmd_async: *ERROR*: Failed to send Property Get fabrics command 00:25:08.514 [2024-04-16 23:02:59.473454] nvme_ctrlr.c:1135:nvme_ctrlr_shutdown_async: *ERROR*: [nqn.2014-08.org.nvmexpress.discovery] Failed to read the CC register 00:25:08.514 23:02:59 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:25:08.514 23:02:59 -- host/discovery_remove_ifc.sh@33 -- # [[ nvme0n1 != '' ]] 00:25:08.514 23:02:59 -- host/discovery_remove_ifc.sh@34 -- # sleep 1 00:25:09.448 23:03:00 -- host/discovery_remove_ifc.sh@33 -- # get_bdev_list 00:25:09.448 23:03:00 -- host/discovery_remove_ifc.sh@29 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:25:09.448 23:03:00 -- host/discovery_remove_ifc.sh@29 -- # jq -r '.[].name' 00:25:09.448 23:03:00 -- common/autotest_common.sh@551 -- # xtrace_disable 00:25:09.448 23:03:00 -- common/autotest_common.sh@10 -- # set +x 00:25:09.448 23:03:00 -- host/discovery_remove_ifc.sh@29 -- # sort 00:25:09.448 23:03:00 -- host/discovery_remove_ifc.sh@29 -- # xargs 00:25:09.448 23:03:00 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:25:09.448 23:03:00 -- host/discovery_remove_ifc.sh@33 -- # [[ '' != '' ]] 00:25:09.448 23:03:00 -- host/discovery_remove_ifc.sh@82 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:25:09.448 23:03:00 -- host/discovery_remove_ifc.sh@83 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:25:09.448 23:03:00 -- host/discovery_remove_ifc.sh@86 -- # wait_for_bdev nvme1n1 00:25:09.448 23:03:00 -- host/discovery_remove_ifc.sh@33 -- # get_bdev_list 00:25:09.448 23:03:00 -- host/discovery_remove_ifc.sh@29 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:25:09.448 23:03:00 -- host/discovery_remove_ifc.sh@29 -- # jq -r '.[].name' 00:25:09.448 23:03:00 -- common/autotest_common.sh@551 -- # xtrace_disable 00:25:09.448 23:03:00 -- common/autotest_common.sh@10 -- # set +x 00:25:09.448 23:03:00 -- host/discovery_remove_ifc.sh@29 -- # sort 00:25:09.448 23:03:00 -- host/discovery_remove_ifc.sh@29 -- # xargs 00:25:09.707 23:03:00 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:25:09.707 23:03:00 -- host/discovery_remove_ifc.sh@33 -- # [[ '' != \n\v\m\e\1\n\1 ]] 00:25:09.707 23:03:00 -- host/discovery_remove_ifc.sh@34 -- # sleep 1 00:25:10.641 [2024-04-16 23:03:01.523993] bdev_nvme.c:6703:discovery_attach_cb: *INFO*: Discovery[10.0.0.2:8009] discovery ctrlr attached 00:25:10.641 [2024-04-16 23:03:01.524025] bdev_nvme.c:6783:discovery_poller: *INFO*: Discovery[10.0.0.2:8009] discovery ctrlr connected 00:25:10.641 [2024-04-16 23:03:01.524046] bdev_nvme.c:6666:get_discovery_log_page: *INFO*: Discovery[10.0.0.2:8009] sent discovery log page command 00:25:10.641 23:03:01 -- host/discovery_remove_ifc.sh@33 -- # get_bdev_list 00:25:10.641 23:03:01 -- host/discovery_remove_ifc.sh@29 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:25:10.641 23:03:01 -- host/discovery_remove_ifc.sh@29 -- # jq -r '.[].name' 00:25:10.641 23:03:01 -- common/autotest_common.sh@551 -- # xtrace_disable 00:25:10.641 23:03:01 -- common/autotest_common.sh@10 -- # set +x 00:25:10.641 23:03:01 -- host/discovery_remove_ifc.sh@29 -- # sort 00:25:10.641 23:03:01 -- host/discovery_remove_ifc.sh@29 -- # xargs 00:25:10.641 23:03:01 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:25:10.641 [2024-04-16 23:03:01.652572] bdev_nvme.c:6632:discovery_log_page_cb: *INFO*: Discovery[10.0.0.2:8009] NVM nqn.2016-06.io.spdk:cnode0:10.0.0.2:4420 new subsystem nvme1 00:25:10.641 23:03:01 -- host/discovery_remove_ifc.sh@33 -- # [[ '' != \n\v\m\e\1\n\1 ]] 00:25:10.641 23:03:01 -- host/discovery_remove_ifc.sh@34 -- # sleep 1 00:25:10.641 [2024-04-16 23:03:01.754527] bdev_nvme.c:7492:bdev_nvme_readv: *DEBUG*: read 8 blocks with offset 0 00:25:10.641 [2024-04-16 23:03:01.754570] bdev_nvme.c:7492:bdev_nvme_readv: *DEBUG*: read 1 blocks with offset 0 00:25:10.641 [2024-04-16 23:03:01.754602] bdev_nvme.c:7492:bdev_nvme_readv: *DEBUG*: read 64 blocks with offset 0 00:25:10.641 [2024-04-16 23:03:01.754622] bdev_nvme.c:6522:discovery_attach_controller_done: *INFO*: Discovery[10.0.0.2:8009] attach nvme1 done 00:25:10.641 [2024-04-16 23:03:01.754635] bdev_nvme.c:6481:discovery_remove_controllers: *INFO*: Discovery[10.0.0.2:8009] NVM nqn.2016-06.io.spdk:cnode0:10.0.0.2:4420 found again 00:25:10.900 [2024-04-16 23:03:01.802841] bdev_nvme.c:1581:bdev_nvme_disconnected_qpair_cb: *DEBUG*: qpair 0x1c462b0 was disconnected and freed. delete nvme_qpair. 00:25:11.841 23:03:02 -- host/discovery_remove_ifc.sh@33 -- # get_bdev_list 00:25:11.841 23:03:02 -- host/discovery_remove_ifc.sh@29 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:25:11.841 23:03:02 -- host/discovery_remove_ifc.sh@29 -- # jq -r '.[].name' 00:25:11.841 23:03:02 -- common/autotest_common.sh@551 -- # xtrace_disable 00:25:11.841 23:03:02 -- common/autotest_common.sh@10 -- # set +x 00:25:11.841 23:03:02 -- host/discovery_remove_ifc.sh@29 -- # sort 00:25:11.841 23:03:02 -- host/discovery_remove_ifc.sh@29 -- # xargs 00:25:11.841 23:03:02 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:25:11.841 23:03:02 -- host/discovery_remove_ifc.sh@33 -- # [[ nvme1n1 != \n\v\m\e\1\n\1 ]] 00:25:11.841 23:03:02 -- host/discovery_remove_ifc.sh@88 -- # trap - SIGINT SIGTERM EXIT 00:25:11.841 23:03:02 -- host/discovery_remove_ifc.sh@90 -- # killprocess 377226 00:25:11.841 23:03:02 -- common/autotest_common.sh@926 -- # '[' -z 377226 ']' 00:25:11.841 23:03:02 -- common/autotest_common.sh@930 -- # kill -0 377226 00:25:11.841 23:03:02 -- common/autotest_common.sh@931 -- # uname 00:25:11.841 23:03:02 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:25:11.841 23:03:02 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 377226 00:25:11.841 23:03:02 -- common/autotest_common.sh@932 -- # process_name=reactor_0 00:25:11.841 23:03:02 -- common/autotest_common.sh@936 -- # '[' reactor_0 = sudo ']' 00:25:11.841 23:03:02 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 377226' 00:25:11.841 killing process with pid 377226 00:25:11.841 23:03:02 -- common/autotest_common.sh@945 -- # kill 377226 00:25:11.841 23:03:02 -- common/autotest_common.sh@950 -- # wait 377226 00:25:12.100 23:03:02 -- host/discovery_remove_ifc.sh@91 -- # nvmftestfini 00:25:12.100 23:03:02 -- nvmf/common.sh@476 -- # nvmfcleanup 00:25:12.100 23:03:02 -- nvmf/common.sh@116 -- # sync 00:25:12.100 23:03:02 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:25:12.100 23:03:02 -- nvmf/common.sh@119 -- # set +e 00:25:12.100 23:03:02 -- nvmf/common.sh@120 -- # for i in {1..20} 00:25:12.100 23:03:02 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:25:12.100 rmmod nvme_tcp 00:25:12.100 rmmod nvme_fabrics 00:25:12.100 rmmod nvme_keyring 00:25:12.100 23:03:03 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:25:12.100 23:03:03 -- nvmf/common.sh@123 -- # set -e 00:25:12.100 23:03:03 -- nvmf/common.sh@124 -- # return 0 00:25:12.100 23:03:03 -- nvmf/common.sh@477 -- # '[' -n 377074 ']' 00:25:12.100 23:03:03 -- nvmf/common.sh@478 -- # killprocess 377074 00:25:12.100 23:03:03 -- common/autotest_common.sh@926 -- # '[' -z 377074 ']' 00:25:12.100 23:03:03 -- common/autotest_common.sh@930 -- # kill -0 377074 00:25:12.100 23:03:03 -- common/autotest_common.sh@931 -- # uname 00:25:12.100 23:03:03 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:25:12.100 23:03:03 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 377074 00:25:12.100 23:03:03 -- common/autotest_common.sh@932 -- # process_name=reactor_1 00:25:12.100 23:03:03 -- common/autotest_common.sh@936 -- # '[' reactor_1 = sudo ']' 00:25:12.100 23:03:03 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 377074' 00:25:12.100 killing process with pid 377074 00:25:12.100 23:03:03 -- common/autotest_common.sh@945 -- # kill 377074 00:25:12.100 23:03:03 -- common/autotest_common.sh@950 -- # wait 377074 00:25:12.359 23:03:03 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:25:12.359 23:03:03 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:25:12.359 23:03:03 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:25:12.359 23:03:03 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:25:12.359 23:03:03 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:25:12.359 23:03:03 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:25:12.359 23:03:03 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:25:12.359 23:03:03 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:25:14.263 23:03:05 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:25:14.263 00:25:14.263 real 0m18.116s 00:25:14.263 user 0m25.277s 00:25:14.263 sys 0m2.910s 00:25:14.263 23:03:05 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:25:14.263 23:03:05 -- common/autotest_common.sh@10 -- # set +x 00:25:14.263 ************************************ 00:25:14.263 END TEST nvmf_discovery_remove_ifc 00:25:14.263 ************************************ 00:25:14.522 23:03:05 -- nvmf/nvmf.sh@105 -- # [[ tcp == \t\c\p ]] 00:25:14.522 23:03:05 -- nvmf/nvmf.sh@106 -- # run_test nvmf_digest /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/digest.sh --transport=tcp 00:25:14.522 23:03:05 -- common/autotest_common.sh@1077 -- # '[' 3 -le 1 ']' 00:25:14.522 23:03:05 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:25:14.522 23:03:05 -- common/autotest_common.sh@10 -- # set +x 00:25:14.522 ************************************ 00:25:14.522 START TEST nvmf_digest 00:25:14.522 ************************************ 00:25:14.522 23:03:05 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/digest.sh --transport=tcp 00:25:14.522 * Looking for test storage... 00:25:14.522 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host 00:25:14.522 23:03:05 -- host/digest.sh@12 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:25:14.522 23:03:05 -- nvmf/common.sh@7 -- # uname -s 00:25:14.522 23:03:05 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:25:14.522 23:03:05 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:25:14.522 23:03:05 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:25:14.522 23:03:05 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:25:14.522 23:03:05 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:25:14.522 23:03:05 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:25:14.522 23:03:05 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:25:14.522 23:03:05 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:25:14.522 23:03:05 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:25:14.522 23:03:05 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:25:14.522 23:03:05 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:25:14.522 23:03:05 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:25:14.522 23:03:05 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:25:14.522 23:03:05 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:25:14.522 23:03:05 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:25:14.522 23:03:05 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:25:14.522 23:03:05 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:25:14.522 23:03:05 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:25:14.522 23:03:05 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:25:14.522 23:03:05 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:25:14.522 23:03:05 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:25:14.522 23:03:05 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:25:14.522 23:03:05 -- paths/export.sh@5 -- # export PATH 00:25:14.522 23:03:05 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:25:14.522 23:03:05 -- nvmf/common.sh@46 -- # : 0 00:25:14.522 23:03:05 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:25:14.522 23:03:05 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:25:14.522 23:03:05 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:25:14.522 23:03:05 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:25:14.522 23:03:05 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:25:14.522 23:03:05 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:25:14.522 23:03:05 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:25:14.522 23:03:05 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:25:14.522 23:03:05 -- host/digest.sh@14 -- # nqn=nqn.2016-06.io.spdk:cnode1 00:25:14.522 23:03:05 -- host/digest.sh@15 -- # bperfsock=/var/tmp/bperf.sock 00:25:14.522 23:03:05 -- host/digest.sh@16 -- # runtime=2 00:25:14.522 23:03:05 -- host/digest.sh@130 -- # [[ tcp != \t\c\p ]] 00:25:14.522 23:03:05 -- host/digest.sh@132 -- # nvmftestinit 00:25:14.522 23:03:05 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:25:14.522 23:03:05 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:25:14.522 23:03:05 -- nvmf/common.sh@436 -- # prepare_net_devs 00:25:14.522 23:03:05 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:25:14.522 23:03:05 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:25:14.522 23:03:05 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:25:14.522 23:03:05 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:25:14.522 23:03:05 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:25:14.522 23:03:05 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:25:14.522 23:03:05 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:25:14.522 23:03:05 -- nvmf/common.sh@284 -- # xtrace_disable 00:25:14.522 23:03:05 -- common/autotest_common.sh@10 -- # set +x 00:25:16.428 23:03:07 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:25:16.428 23:03:07 -- nvmf/common.sh@290 -- # pci_devs=() 00:25:16.428 23:03:07 -- nvmf/common.sh@290 -- # local -a pci_devs 00:25:16.428 23:03:07 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:25:16.428 23:03:07 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:25:16.428 23:03:07 -- nvmf/common.sh@292 -- # pci_drivers=() 00:25:16.428 23:03:07 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:25:16.428 23:03:07 -- nvmf/common.sh@294 -- # net_devs=() 00:25:16.428 23:03:07 -- nvmf/common.sh@294 -- # local -ga net_devs 00:25:16.428 23:03:07 -- nvmf/common.sh@295 -- # e810=() 00:25:16.428 23:03:07 -- nvmf/common.sh@295 -- # local -ga e810 00:25:16.428 23:03:07 -- nvmf/common.sh@296 -- # x722=() 00:25:16.428 23:03:07 -- nvmf/common.sh@296 -- # local -ga x722 00:25:16.428 23:03:07 -- nvmf/common.sh@297 -- # mlx=() 00:25:16.428 23:03:07 -- nvmf/common.sh@297 -- # local -ga mlx 00:25:16.428 23:03:07 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:25:16.428 23:03:07 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:25:16.428 23:03:07 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:25:16.428 23:03:07 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:25:16.428 23:03:07 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:25:16.428 23:03:07 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:25:16.428 23:03:07 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:25:16.428 23:03:07 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:25:16.428 23:03:07 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:25:16.428 23:03:07 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:25:16.428 23:03:07 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:25:16.428 23:03:07 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:25:16.428 23:03:07 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:25:16.428 23:03:07 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:25:16.428 23:03:07 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:25:16.428 23:03:07 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:25:16.428 23:03:07 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:25:16.428 23:03:07 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:25:16.428 23:03:07 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:25:16.428 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:25:16.428 23:03:07 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:25:16.428 23:03:07 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:25:16.428 23:03:07 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:25:16.428 23:03:07 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:25:16.428 23:03:07 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:25:16.428 23:03:07 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:25:16.428 23:03:07 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:25:16.428 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:25:16.428 23:03:07 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:25:16.428 23:03:07 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:25:16.428 23:03:07 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:25:16.428 23:03:07 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:25:16.428 23:03:07 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:25:16.428 23:03:07 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:25:16.428 23:03:07 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:25:16.428 23:03:07 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:25:16.428 23:03:07 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:25:16.428 23:03:07 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:25:16.428 23:03:07 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:25:16.428 23:03:07 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:25:16.429 23:03:07 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:25:16.429 Found net devices under 0000:0a:00.0: cvl_0_0 00:25:16.429 23:03:07 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:25:16.429 23:03:07 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:25:16.429 23:03:07 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:25:16.429 23:03:07 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:25:16.429 23:03:07 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:25:16.429 23:03:07 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:25:16.429 Found net devices under 0000:0a:00.1: cvl_0_1 00:25:16.429 23:03:07 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:25:16.429 23:03:07 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:25:16.429 23:03:07 -- nvmf/common.sh@402 -- # is_hw=yes 00:25:16.429 23:03:07 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:25:16.429 23:03:07 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:25:16.429 23:03:07 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:25:16.429 23:03:07 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:25:16.429 23:03:07 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:25:16.429 23:03:07 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:25:16.429 23:03:07 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:25:16.429 23:03:07 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:25:16.429 23:03:07 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:25:16.429 23:03:07 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:25:16.429 23:03:07 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:25:16.429 23:03:07 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:25:16.429 23:03:07 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:25:16.429 23:03:07 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:25:16.429 23:03:07 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:25:16.429 23:03:07 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:25:16.429 23:03:07 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:25:16.429 23:03:07 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:25:16.429 23:03:07 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:25:16.429 23:03:07 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:25:16.429 23:03:07 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:25:16.429 23:03:07 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:25:16.429 23:03:07 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:25:16.429 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:25:16.429 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.157 ms 00:25:16.429 00:25:16.429 --- 10.0.0.2 ping statistics --- 00:25:16.429 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:25:16.429 rtt min/avg/max/mdev = 0.157/0.157/0.157/0.000 ms 00:25:16.429 23:03:07 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:25:16.429 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:25:16.429 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.117 ms 00:25:16.429 00:25:16.429 --- 10.0.0.1 ping statistics --- 00:25:16.429 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:25:16.429 rtt min/avg/max/mdev = 0.117/0.117/0.117/0.000 ms 00:25:16.429 23:03:07 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:25:16.429 23:03:07 -- nvmf/common.sh@410 -- # return 0 00:25:16.429 23:03:07 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:25:16.429 23:03:07 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:25:16.429 23:03:07 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:25:16.429 23:03:07 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:25:16.429 23:03:07 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:25:16.429 23:03:07 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:25:16.429 23:03:07 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:25:16.429 23:03:07 -- host/digest.sh@134 -- # trap cleanup SIGINT SIGTERM EXIT 00:25:16.429 23:03:07 -- host/digest.sh@135 -- # run_test nvmf_digest_clean run_digest 00:25:16.429 23:03:07 -- common/autotest_common.sh@1077 -- # '[' 2 -le 1 ']' 00:25:16.429 23:03:07 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:25:16.429 23:03:07 -- common/autotest_common.sh@10 -- # set +x 00:25:16.429 ************************************ 00:25:16.429 START TEST nvmf_digest_clean 00:25:16.429 ************************************ 00:25:16.429 23:03:07 -- common/autotest_common.sh@1104 -- # run_digest 00:25:16.429 23:03:07 -- host/digest.sh@119 -- # nvmfappstart --wait-for-rpc 00:25:16.429 23:03:07 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:25:16.429 23:03:07 -- common/autotest_common.sh@712 -- # xtrace_disable 00:25:16.429 23:03:07 -- common/autotest_common.sh@10 -- # set +x 00:25:16.429 23:03:07 -- nvmf/common.sh@469 -- # nvmfpid=381093 00:25:16.429 23:03:07 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF --wait-for-rpc 00:25:16.429 23:03:07 -- nvmf/common.sh@470 -- # waitforlisten 381093 00:25:16.429 23:03:07 -- common/autotest_common.sh@819 -- # '[' -z 381093 ']' 00:25:16.429 23:03:07 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk.sock 00:25:16.429 23:03:07 -- common/autotest_common.sh@824 -- # local max_retries=100 00:25:16.429 23:03:07 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:25:16.429 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:25:16.429 23:03:07 -- common/autotest_common.sh@828 -- # xtrace_disable 00:25:16.429 23:03:07 -- common/autotest_common.sh@10 -- # set +x 00:25:16.688 [2024-04-16 23:03:07.584012] Starting SPDK v24.01.1-pre git sha1 4b134b4ab / DPDK 23.11.0 initialization... 00:25:16.688 [2024-04-16 23:03:07.584101] [ DPDK EAL parameters: nvmf -c 0x1 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:25:16.688 EAL: No free 2048 kB hugepages reported on node 1 00:25:16.688 [2024-04-16 23:03:07.654479] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:25:16.688 [2024-04-16 23:03:07.780030] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:25:16.688 [2024-04-16 23:03:07.780216] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:25:16.688 [2024-04-16 23:03:07.780234] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:25:16.688 [2024-04-16 23:03:07.780247] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:25:16.688 [2024-04-16 23:03:07.780274] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:25:16.688 23:03:07 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:25:16.688 23:03:07 -- common/autotest_common.sh@852 -- # return 0 00:25:16.688 23:03:07 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:25:16.688 23:03:07 -- common/autotest_common.sh@718 -- # xtrace_disable 00:25:16.688 23:03:07 -- common/autotest_common.sh@10 -- # set +x 00:25:16.946 23:03:07 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:25:16.946 23:03:07 -- host/digest.sh@120 -- # common_target_config 00:25:16.946 23:03:07 -- host/digest.sh@43 -- # rpc_cmd 00:25:16.946 23:03:07 -- common/autotest_common.sh@551 -- # xtrace_disable 00:25:16.946 23:03:07 -- common/autotest_common.sh@10 -- # set +x 00:25:16.946 null0 00:25:16.946 [2024-04-16 23:03:07.951187] tcp.c: 659:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:25:16.947 [2024-04-16 23:03:07.975384] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:25:16.947 23:03:07 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:25:16.947 23:03:07 -- host/digest.sh@122 -- # run_bperf randread 4096 128 00:25:16.947 23:03:07 -- host/digest.sh@77 -- # local rw bs qd 00:25:16.947 23:03:07 -- host/digest.sh@78 -- # local acc_module acc_executed exp_module 00:25:16.947 23:03:07 -- host/digest.sh@80 -- # rw=randread 00:25:16.947 23:03:07 -- host/digest.sh@80 -- # bs=4096 00:25:16.947 23:03:07 -- host/digest.sh@80 -- # qd=128 00:25:16.947 23:03:07 -- host/digest.sh@82 -- # bperfpid=381368 00:25:16.947 23:03:07 -- host/digest.sh@83 -- # waitforlisten 381368 /var/tmp/bperf.sock 00:25:16.947 23:03:07 -- host/digest.sh@81 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 2 -r /var/tmp/bperf.sock -w randread -o 4096 -t 2 -q 128 -z --wait-for-rpc 00:25:16.947 23:03:07 -- common/autotest_common.sh@819 -- # '[' -z 381368 ']' 00:25:16.947 23:03:07 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/bperf.sock 00:25:16.947 23:03:07 -- common/autotest_common.sh@824 -- # local max_retries=100 00:25:16.947 23:03:07 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bperf.sock...' 00:25:16.947 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bperf.sock... 00:25:16.947 23:03:07 -- common/autotest_common.sh@828 -- # xtrace_disable 00:25:16.947 23:03:07 -- common/autotest_common.sh@10 -- # set +x 00:25:16.947 [2024-04-16 23:03:08.018788] Starting SPDK v24.01.1-pre git sha1 4b134b4ab / DPDK 23.11.0 initialization... 00:25:16.947 [2024-04-16 23:03:08.018881] [ DPDK EAL parameters: bdevperf --no-shconf -c 2 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid381368 ] 00:25:16.947 EAL: No free 2048 kB hugepages reported on node 1 00:25:17.205 [2024-04-16 23:03:08.083614] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:25:17.205 [2024-04-16 23:03:08.200325] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:25:17.205 23:03:08 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:25:17.205 23:03:08 -- common/autotest_common.sh@852 -- # return 0 00:25:17.205 23:03:08 -- host/digest.sh@85 -- # [[ 0 -eq 1 ]] 00:25:17.205 23:03:08 -- host/digest.sh@86 -- # bperf_rpc framework_start_init 00:25:17.205 23:03:08 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock framework_start_init 00:25:17.464 23:03:08 -- host/digest.sh@88 -- # bperf_rpc bdev_nvme_attach_controller --ddgst -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -b nvme0 00:25:17.464 23:03:08 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock bdev_nvme_attach_controller --ddgst -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -b nvme0 00:25:18.030 nvme0n1 00:25:18.030 23:03:08 -- host/digest.sh@91 -- # bperf_py perform_tests 00:25:18.030 23:03:08 -- host/digest.sh@19 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bperf.sock perform_tests 00:25:18.030 Running I/O for 2 seconds... 00:25:20.564 00:25:20.564 Latency(us) 00:25:20.564 Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:25:20.564 Job: nvme0n1 (Core Mask 0x2, workload: randread, depth: 128, IO size: 4096) 00:25:20.564 nvme0n1 : 2.01 15733.00 61.46 0.00 0.00 8128.85 2803.48 23010.42 00:25:20.564 =================================================================================================================== 00:25:20.564 Total : 15733.00 61.46 0.00 0.00 8128.85 2803.48 23010.42 00:25:20.564 0 00:25:20.564 23:03:11 -- host/digest.sh@92 -- # read -r acc_module acc_executed 00:25:20.564 23:03:11 -- host/digest.sh@92 -- # get_accel_stats 00:25:20.564 23:03:11 -- host/digest.sh@36 -- # bperf_rpc accel_get_stats 00:25:20.564 23:03:11 -- host/digest.sh@37 -- # jq -rc '.operations[] 00:25:20.564 | select(.opcode=="crc32c") 00:25:20.564 | "\(.module_name) \(.executed)"' 00:25:20.564 23:03:11 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock accel_get_stats 00:25:20.564 23:03:11 -- host/digest.sh@93 -- # [[ 0 -eq 1 ]] 00:25:20.564 23:03:11 -- host/digest.sh@93 -- # exp_module=software 00:25:20.564 23:03:11 -- host/digest.sh@94 -- # (( acc_executed > 0 )) 00:25:20.564 23:03:11 -- host/digest.sh@95 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:25:20.564 23:03:11 -- host/digest.sh@97 -- # killprocess 381368 00:25:20.564 23:03:11 -- common/autotest_common.sh@926 -- # '[' -z 381368 ']' 00:25:20.564 23:03:11 -- common/autotest_common.sh@930 -- # kill -0 381368 00:25:20.564 23:03:11 -- common/autotest_common.sh@931 -- # uname 00:25:20.564 23:03:11 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:25:20.565 23:03:11 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 381368 00:25:20.565 23:03:11 -- common/autotest_common.sh@932 -- # process_name=reactor_1 00:25:20.565 23:03:11 -- common/autotest_common.sh@936 -- # '[' reactor_1 = sudo ']' 00:25:20.565 23:03:11 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 381368' 00:25:20.565 killing process with pid 381368 00:25:20.565 23:03:11 -- common/autotest_common.sh@945 -- # kill 381368 00:25:20.565 Received shutdown signal, test time was about 2.000000 seconds 00:25:20.565 00:25:20.565 Latency(us) 00:25:20.565 Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:25:20.565 =================================================================================================================== 00:25:20.565 Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:25:20.565 23:03:11 -- common/autotest_common.sh@950 -- # wait 381368 00:25:20.565 23:03:11 -- host/digest.sh@123 -- # run_bperf randread 131072 16 00:25:20.565 23:03:11 -- host/digest.sh@77 -- # local rw bs qd 00:25:20.565 23:03:11 -- host/digest.sh@78 -- # local acc_module acc_executed exp_module 00:25:20.565 23:03:11 -- host/digest.sh@80 -- # rw=randread 00:25:20.565 23:03:11 -- host/digest.sh@80 -- # bs=131072 00:25:20.565 23:03:11 -- host/digest.sh@80 -- # qd=16 00:25:20.565 23:03:11 -- host/digest.sh@82 -- # bperfpid=381932 00:25:20.565 23:03:11 -- host/digest.sh@81 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 2 -r /var/tmp/bperf.sock -w randread -o 131072 -t 2 -q 16 -z --wait-for-rpc 00:25:20.565 23:03:11 -- host/digest.sh@83 -- # waitforlisten 381932 /var/tmp/bperf.sock 00:25:20.565 23:03:11 -- common/autotest_common.sh@819 -- # '[' -z 381932 ']' 00:25:20.565 23:03:11 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/bperf.sock 00:25:20.565 23:03:11 -- common/autotest_common.sh@824 -- # local max_retries=100 00:25:20.565 23:03:11 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bperf.sock...' 00:25:20.565 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bperf.sock... 00:25:20.565 23:03:11 -- common/autotest_common.sh@828 -- # xtrace_disable 00:25:20.565 23:03:11 -- common/autotest_common.sh@10 -- # set +x 00:25:20.825 [2024-04-16 23:03:11.704945] Starting SPDK v24.01.1-pre git sha1 4b134b4ab / DPDK 23.11.0 initialization... 00:25:20.825 [2024-04-16 23:03:11.705023] [ DPDK EAL parameters: bdevperf --no-shconf -c 2 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid381932 ] 00:25:20.825 I/O size of 131072 is greater than zero copy threshold (65536). 00:25:20.825 Zero copy mechanism will not be used. 00:25:20.825 EAL: No free 2048 kB hugepages reported on node 1 00:25:20.825 [2024-04-16 23:03:11.767692] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:25:20.825 [2024-04-16 23:03:11.879428] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:25:21.759 23:03:12 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:25:21.759 23:03:12 -- common/autotest_common.sh@852 -- # return 0 00:25:21.759 23:03:12 -- host/digest.sh@85 -- # [[ 0 -eq 1 ]] 00:25:21.759 23:03:12 -- host/digest.sh@86 -- # bperf_rpc framework_start_init 00:25:21.759 23:03:12 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock framework_start_init 00:25:22.017 23:03:12 -- host/digest.sh@88 -- # bperf_rpc bdev_nvme_attach_controller --ddgst -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -b nvme0 00:25:22.017 23:03:12 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock bdev_nvme_attach_controller --ddgst -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -b nvme0 00:25:22.277 nvme0n1 00:25:22.277 23:03:13 -- host/digest.sh@91 -- # bperf_py perform_tests 00:25:22.277 23:03:13 -- host/digest.sh@19 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bperf.sock perform_tests 00:25:22.277 I/O size of 131072 is greater than zero copy threshold (65536). 00:25:22.277 Zero copy mechanism will not be used. 00:25:22.277 Running I/O for 2 seconds... 00:25:24.853 00:25:24.853 Latency(us) 00:25:24.853 Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:25:24.853 Job: nvme0n1 (Core Mask 0x2, workload: randread, depth: 16, IO size: 131072) 00:25:24.853 nvme0n1 : 2.00 3052.58 381.57 0.00 0.00 5237.09 4903.06 10291.58 00:25:24.853 =================================================================================================================== 00:25:24.853 Total : 3052.58 381.57 0.00 0.00 5237.09 4903.06 10291.58 00:25:24.853 0 00:25:24.853 23:03:15 -- host/digest.sh@92 -- # read -r acc_module acc_executed 00:25:24.853 23:03:15 -- host/digest.sh@92 -- # get_accel_stats 00:25:24.853 23:03:15 -- host/digest.sh@36 -- # bperf_rpc accel_get_stats 00:25:24.853 23:03:15 -- host/digest.sh@37 -- # jq -rc '.operations[] 00:25:24.853 | select(.opcode=="crc32c") 00:25:24.853 | "\(.module_name) \(.executed)"' 00:25:24.853 23:03:15 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock accel_get_stats 00:25:24.853 23:03:15 -- host/digest.sh@93 -- # [[ 0 -eq 1 ]] 00:25:24.853 23:03:15 -- host/digest.sh@93 -- # exp_module=software 00:25:24.853 23:03:15 -- host/digest.sh@94 -- # (( acc_executed > 0 )) 00:25:24.853 23:03:15 -- host/digest.sh@95 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:25:24.853 23:03:15 -- host/digest.sh@97 -- # killprocess 381932 00:25:24.853 23:03:15 -- common/autotest_common.sh@926 -- # '[' -z 381932 ']' 00:25:24.853 23:03:15 -- common/autotest_common.sh@930 -- # kill -0 381932 00:25:24.853 23:03:15 -- common/autotest_common.sh@931 -- # uname 00:25:24.853 23:03:15 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:25:24.853 23:03:15 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 381932 00:25:24.853 23:03:15 -- common/autotest_common.sh@932 -- # process_name=reactor_1 00:25:24.853 23:03:15 -- common/autotest_common.sh@936 -- # '[' reactor_1 = sudo ']' 00:25:24.853 23:03:15 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 381932' 00:25:24.853 killing process with pid 381932 00:25:24.853 23:03:15 -- common/autotest_common.sh@945 -- # kill 381932 00:25:24.853 Received shutdown signal, test time was about 2.000000 seconds 00:25:24.853 00:25:24.853 Latency(us) 00:25:24.853 Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:25:24.853 =================================================================================================================== 00:25:24.853 Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:25:24.853 23:03:15 -- common/autotest_common.sh@950 -- # wait 381932 00:25:24.853 23:03:15 -- host/digest.sh@124 -- # run_bperf randwrite 4096 128 00:25:24.853 23:03:15 -- host/digest.sh@77 -- # local rw bs qd 00:25:24.853 23:03:15 -- host/digest.sh@78 -- # local acc_module acc_executed exp_module 00:25:24.853 23:03:15 -- host/digest.sh@80 -- # rw=randwrite 00:25:24.853 23:03:15 -- host/digest.sh@80 -- # bs=4096 00:25:24.853 23:03:15 -- host/digest.sh@80 -- # qd=128 00:25:24.853 23:03:15 -- host/digest.sh@82 -- # bperfpid=382489 00:25:24.853 23:03:15 -- host/digest.sh@81 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 2 -r /var/tmp/bperf.sock -w randwrite -o 4096 -t 2 -q 128 -z --wait-for-rpc 00:25:24.853 23:03:15 -- host/digest.sh@83 -- # waitforlisten 382489 /var/tmp/bperf.sock 00:25:24.853 23:03:15 -- common/autotest_common.sh@819 -- # '[' -z 382489 ']' 00:25:24.853 23:03:15 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/bperf.sock 00:25:24.853 23:03:15 -- common/autotest_common.sh@824 -- # local max_retries=100 00:25:24.853 23:03:15 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bperf.sock...' 00:25:24.854 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bperf.sock... 00:25:24.854 23:03:15 -- common/autotest_common.sh@828 -- # xtrace_disable 00:25:24.854 23:03:15 -- common/autotest_common.sh@10 -- # set +x 00:25:25.112 [2024-04-16 23:03:15.985713] Starting SPDK v24.01.1-pre git sha1 4b134b4ab / DPDK 23.11.0 initialization... 00:25:25.112 [2024-04-16 23:03:15.985805] [ DPDK EAL parameters: bdevperf --no-shconf -c 2 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid382489 ] 00:25:25.112 EAL: No free 2048 kB hugepages reported on node 1 00:25:25.112 [2024-04-16 23:03:16.043625] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:25:25.112 [2024-04-16 23:03:16.149760] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:25:25.112 23:03:16 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:25:25.112 23:03:16 -- common/autotest_common.sh@852 -- # return 0 00:25:25.112 23:03:16 -- host/digest.sh@85 -- # [[ 0 -eq 1 ]] 00:25:25.112 23:03:16 -- host/digest.sh@86 -- # bperf_rpc framework_start_init 00:25:25.112 23:03:16 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock framework_start_init 00:25:25.682 23:03:16 -- host/digest.sh@88 -- # bperf_rpc bdev_nvme_attach_controller --ddgst -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -b nvme0 00:25:25.682 23:03:16 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock bdev_nvme_attach_controller --ddgst -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -b nvme0 00:25:25.942 nvme0n1 00:25:25.942 23:03:16 -- host/digest.sh@91 -- # bperf_py perform_tests 00:25:25.942 23:03:16 -- host/digest.sh@19 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bperf.sock perform_tests 00:25:25.942 Running I/O for 2 seconds... 00:25:28.476 00:25:28.476 Latency(us) 00:25:28.476 Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:25:28.476 Job: nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:25:28.476 nvme0n1 : 2.00 20681.48 80.79 0.00 0.00 6181.64 3252.53 17282.09 00:25:28.476 =================================================================================================================== 00:25:28.476 Total : 20681.48 80.79 0.00 0.00 6181.64 3252.53 17282.09 00:25:28.476 0 00:25:28.476 23:03:18 -- host/digest.sh@92 -- # read -r acc_module acc_executed 00:25:28.476 23:03:18 -- host/digest.sh@92 -- # get_accel_stats 00:25:28.476 23:03:18 -- host/digest.sh@36 -- # bperf_rpc accel_get_stats 00:25:28.476 23:03:18 -- host/digest.sh@37 -- # jq -rc '.operations[] 00:25:28.476 | select(.opcode=="crc32c") 00:25:28.476 | "\(.module_name) \(.executed)"' 00:25:28.476 23:03:18 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock accel_get_stats 00:25:28.476 23:03:19 -- host/digest.sh@93 -- # [[ 0 -eq 1 ]] 00:25:28.476 23:03:19 -- host/digest.sh@93 -- # exp_module=software 00:25:28.476 23:03:19 -- host/digest.sh@94 -- # (( acc_executed > 0 )) 00:25:28.476 23:03:19 -- host/digest.sh@95 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:25:28.476 23:03:19 -- host/digest.sh@97 -- # killprocess 382489 00:25:28.476 23:03:19 -- common/autotest_common.sh@926 -- # '[' -z 382489 ']' 00:25:28.476 23:03:19 -- common/autotest_common.sh@930 -- # kill -0 382489 00:25:28.476 23:03:19 -- common/autotest_common.sh@931 -- # uname 00:25:28.476 23:03:19 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:25:28.476 23:03:19 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 382489 00:25:28.476 23:03:19 -- common/autotest_common.sh@932 -- # process_name=reactor_1 00:25:28.476 23:03:19 -- common/autotest_common.sh@936 -- # '[' reactor_1 = sudo ']' 00:25:28.476 23:03:19 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 382489' 00:25:28.476 killing process with pid 382489 00:25:28.476 23:03:19 -- common/autotest_common.sh@945 -- # kill 382489 00:25:28.476 Received shutdown signal, test time was about 2.000000 seconds 00:25:28.476 00:25:28.476 Latency(us) 00:25:28.476 Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:25:28.476 =================================================================================================================== 00:25:28.476 Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:25:28.476 23:03:19 -- common/autotest_common.sh@950 -- # wait 382489 00:25:28.476 23:03:19 -- host/digest.sh@125 -- # run_bperf randwrite 131072 16 00:25:28.476 23:03:19 -- host/digest.sh@77 -- # local rw bs qd 00:25:28.476 23:03:19 -- host/digest.sh@78 -- # local acc_module acc_executed exp_module 00:25:28.476 23:03:19 -- host/digest.sh@80 -- # rw=randwrite 00:25:28.476 23:03:19 -- host/digest.sh@80 -- # bs=131072 00:25:28.476 23:03:19 -- host/digest.sh@80 -- # qd=16 00:25:28.476 23:03:19 -- host/digest.sh@82 -- # bperfpid=382905 00:25:28.476 23:03:19 -- host/digest.sh@83 -- # waitforlisten 382905 /var/tmp/bperf.sock 00:25:28.476 23:03:19 -- common/autotest_common.sh@819 -- # '[' -z 382905 ']' 00:25:28.476 23:03:19 -- host/digest.sh@81 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 2 -r /var/tmp/bperf.sock -w randwrite -o 131072 -t 2 -q 16 -z --wait-for-rpc 00:25:28.476 23:03:19 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/bperf.sock 00:25:28.476 23:03:19 -- common/autotest_common.sh@824 -- # local max_retries=100 00:25:28.476 23:03:19 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bperf.sock...' 00:25:28.476 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bperf.sock... 00:25:28.476 23:03:19 -- common/autotest_common.sh@828 -- # xtrace_disable 00:25:28.476 23:03:19 -- common/autotest_common.sh@10 -- # set +x 00:25:28.476 [2024-04-16 23:03:19.554013] Starting SPDK v24.01.1-pre git sha1 4b134b4ab / DPDK 23.11.0 initialization... 00:25:28.476 [2024-04-16 23:03:19.554080] [ DPDK EAL parameters: bdevperf --no-shconf -c 2 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid382905 ] 00:25:28.476 I/O size of 131072 is greater than zero copy threshold (65536). 00:25:28.476 Zero copy mechanism will not be used. 00:25:28.476 EAL: No free 2048 kB hugepages reported on node 1 00:25:28.734 [2024-04-16 23:03:19.614942] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:25:28.734 [2024-04-16 23:03:19.730033] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:25:28.734 23:03:19 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:25:28.734 23:03:19 -- common/autotest_common.sh@852 -- # return 0 00:25:28.734 23:03:19 -- host/digest.sh@85 -- # [[ 0 -eq 1 ]] 00:25:28.734 23:03:19 -- host/digest.sh@86 -- # bperf_rpc framework_start_init 00:25:28.734 23:03:19 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock framework_start_init 00:25:28.992 23:03:20 -- host/digest.sh@88 -- # bperf_rpc bdev_nvme_attach_controller --ddgst -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -b nvme0 00:25:28.992 23:03:20 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock bdev_nvme_attach_controller --ddgst -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -b nvme0 00:25:29.561 nvme0n1 00:25:29.561 23:03:20 -- host/digest.sh@91 -- # bperf_py perform_tests 00:25:29.561 23:03:20 -- host/digest.sh@19 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bperf.sock perform_tests 00:25:29.561 I/O size of 131072 is greater than zero copy threshold (65536). 00:25:29.561 Zero copy mechanism will not be used. 00:25:29.561 Running I/O for 2 seconds... 00:25:31.466 00:25:31.466 Latency(us) 00:25:31.466 Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:25:31.466 Job: nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 16, IO size: 131072) 00:25:31.466 nvme0n1 : 2.00 3765.15 470.64 0.00 0.00 4240.54 2961.26 8446.86 00:25:31.466 =================================================================================================================== 00:25:31.466 Total : 3765.15 470.64 0.00 0.00 4240.54 2961.26 8446.86 00:25:31.466 0 00:25:31.466 23:03:22 -- host/digest.sh@92 -- # read -r acc_module acc_executed 00:25:31.466 23:03:22 -- host/digest.sh@92 -- # get_accel_stats 00:25:31.466 23:03:22 -- host/digest.sh@36 -- # bperf_rpc accel_get_stats 00:25:31.466 23:03:22 -- host/digest.sh@37 -- # jq -rc '.operations[] 00:25:31.466 | select(.opcode=="crc32c") 00:25:31.466 | "\(.module_name) \(.executed)"' 00:25:31.466 23:03:22 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock accel_get_stats 00:25:31.725 23:03:22 -- host/digest.sh@93 -- # [[ 0 -eq 1 ]] 00:25:31.725 23:03:22 -- host/digest.sh@93 -- # exp_module=software 00:25:31.725 23:03:22 -- host/digest.sh@94 -- # (( acc_executed > 0 )) 00:25:31.725 23:03:22 -- host/digest.sh@95 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:25:31.725 23:03:22 -- host/digest.sh@97 -- # killprocess 382905 00:25:31.725 23:03:22 -- common/autotest_common.sh@926 -- # '[' -z 382905 ']' 00:25:31.725 23:03:22 -- common/autotest_common.sh@930 -- # kill -0 382905 00:25:31.725 23:03:22 -- common/autotest_common.sh@931 -- # uname 00:25:31.725 23:03:22 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:25:31.725 23:03:22 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 382905 00:25:31.725 23:03:22 -- common/autotest_common.sh@932 -- # process_name=reactor_1 00:25:31.725 23:03:22 -- common/autotest_common.sh@936 -- # '[' reactor_1 = sudo ']' 00:25:31.725 23:03:22 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 382905' 00:25:31.725 killing process with pid 382905 00:25:31.725 23:03:22 -- common/autotest_common.sh@945 -- # kill 382905 00:25:31.725 Received shutdown signal, test time was about 2.000000 seconds 00:25:31.725 00:25:31.725 Latency(us) 00:25:31.725 Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:25:31.725 =================================================================================================================== 00:25:31.725 Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:25:31.725 23:03:22 -- common/autotest_common.sh@950 -- # wait 382905 00:25:31.984 23:03:23 -- host/digest.sh@126 -- # killprocess 381093 00:25:31.984 23:03:23 -- common/autotest_common.sh@926 -- # '[' -z 381093 ']' 00:25:31.984 23:03:23 -- common/autotest_common.sh@930 -- # kill -0 381093 00:25:31.984 23:03:23 -- common/autotest_common.sh@931 -- # uname 00:25:31.984 23:03:23 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:25:31.984 23:03:23 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 381093 00:25:31.984 23:03:23 -- common/autotest_common.sh@932 -- # process_name=reactor_0 00:25:31.984 23:03:23 -- common/autotest_common.sh@936 -- # '[' reactor_0 = sudo ']' 00:25:32.243 23:03:23 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 381093' 00:25:32.243 killing process with pid 381093 00:25:32.243 23:03:23 -- common/autotest_common.sh@945 -- # kill 381093 00:25:32.243 23:03:23 -- common/autotest_common.sh@950 -- # wait 381093 00:25:32.504 00:25:32.504 real 0m15.838s 00:25:32.504 user 0m31.420s 00:25:32.504 sys 0m4.226s 00:25:32.504 23:03:23 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:25:32.504 23:03:23 -- common/autotest_common.sh@10 -- # set +x 00:25:32.504 ************************************ 00:25:32.504 END TEST nvmf_digest_clean 00:25:32.504 ************************************ 00:25:32.504 23:03:23 -- host/digest.sh@136 -- # run_test nvmf_digest_error run_digest_error 00:25:32.504 23:03:23 -- common/autotest_common.sh@1077 -- # '[' 2 -le 1 ']' 00:25:32.504 23:03:23 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:25:32.504 23:03:23 -- common/autotest_common.sh@10 -- # set +x 00:25:32.504 ************************************ 00:25:32.504 START TEST nvmf_digest_error 00:25:32.504 ************************************ 00:25:32.504 23:03:23 -- common/autotest_common.sh@1104 -- # run_digest_error 00:25:32.504 23:03:23 -- host/digest.sh@101 -- # nvmfappstart --wait-for-rpc 00:25:32.504 23:03:23 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:25:32.504 23:03:23 -- common/autotest_common.sh@712 -- # xtrace_disable 00:25:32.504 23:03:23 -- common/autotest_common.sh@10 -- # set +x 00:25:32.504 23:03:23 -- nvmf/common.sh@469 -- # nvmfpid=383360 00:25:32.504 23:03:23 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF --wait-for-rpc 00:25:32.504 23:03:23 -- nvmf/common.sh@470 -- # waitforlisten 383360 00:25:32.504 23:03:23 -- common/autotest_common.sh@819 -- # '[' -z 383360 ']' 00:25:32.504 23:03:23 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk.sock 00:25:32.504 23:03:23 -- common/autotest_common.sh@824 -- # local max_retries=100 00:25:32.504 23:03:23 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:25:32.504 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:25:32.504 23:03:23 -- common/autotest_common.sh@828 -- # xtrace_disable 00:25:32.504 23:03:23 -- common/autotest_common.sh@10 -- # set +x 00:25:32.504 [2024-04-16 23:03:23.460805] Starting SPDK v24.01.1-pre git sha1 4b134b4ab / DPDK 23.11.0 initialization... 00:25:32.504 [2024-04-16 23:03:23.460890] [ DPDK EAL parameters: nvmf -c 0x1 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:25:32.504 EAL: No free 2048 kB hugepages reported on node 1 00:25:32.504 [2024-04-16 23:03:23.531699] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:25:32.763 [2024-04-16 23:03:23.642872] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:25:32.763 [2024-04-16 23:03:23.643019] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:25:32.763 [2024-04-16 23:03:23.643035] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:25:32.763 [2024-04-16 23:03:23.643047] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:25:32.763 [2024-04-16 23:03:23.643083] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:25:32.763 23:03:23 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:25:32.763 23:03:23 -- common/autotest_common.sh@852 -- # return 0 00:25:32.763 23:03:23 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:25:32.763 23:03:23 -- common/autotest_common.sh@718 -- # xtrace_disable 00:25:32.763 23:03:23 -- common/autotest_common.sh@10 -- # set +x 00:25:32.763 23:03:23 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:25:32.763 23:03:23 -- host/digest.sh@103 -- # rpc_cmd accel_assign_opc -o crc32c -m error 00:25:32.763 23:03:23 -- common/autotest_common.sh@551 -- # xtrace_disable 00:25:32.763 23:03:23 -- common/autotest_common.sh@10 -- # set +x 00:25:32.763 [2024-04-16 23:03:23.695649] accel_rpc.c: 168:rpc_accel_assign_opc: *NOTICE*: Operation crc32c will be assigned to module error 00:25:32.763 23:03:23 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:25:32.763 23:03:23 -- host/digest.sh@104 -- # common_target_config 00:25:32.763 23:03:23 -- host/digest.sh@43 -- # rpc_cmd 00:25:32.763 23:03:23 -- common/autotest_common.sh@551 -- # xtrace_disable 00:25:32.763 23:03:23 -- common/autotest_common.sh@10 -- # set +x 00:25:32.763 null0 00:25:32.763 [2024-04-16 23:03:23.817925] tcp.c: 659:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:25:32.763 [2024-04-16 23:03:23.842129] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:25:32.763 23:03:23 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:25:32.763 23:03:23 -- host/digest.sh@107 -- # run_bperf_err randread 4096 128 00:25:32.763 23:03:23 -- host/digest.sh@54 -- # local rw bs qd 00:25:32.763 23:03:23 -- host/digest.sh@56 -- # rw=randread 00:25:32.763 23:03:23 -- host/digest.sh@56 -- # bs=4096 00:25:32.763 23:03:23 -- host/digest.sh@56 -- # qd=128 00:25:32.763 23:03:23 -- host/digest.sh@58 -- # bperfpid=383494 00:25:32.763 23:03:23 -- host/digest.sh@60 -- # waitforlisten 383494 /var/tmp/bperf.sock 00:25:32.763 23:03:23 -- host/digest.sh@57 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 2 -r /var/tmp/bperf.sock -w randread -o 4096 -t 2 -q 128 -z 00:25:32.763 23:03:23 -- common/autotest_common.sh@819 -- # '[' -z 383494 ']' 00:25:32.763 23:03:23 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/bperf.sock 00:25:32.763 23:03:23 -- common/autotest_common.sh@824 -- # local max_retries=100 00:25:32.763 23:03:23 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bperf.sock...' 00:25:32.763 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bperf.sock... 00:25:32.763 23:03:23 -- common/autotest_common.sh@828 -- # xtrace_disable 00:25:32.763 23:03:23 -- common/autotest_common.sh@10 -- # set +x 00:25:32.763 [2024-04-16 23:03:23.888824] Starting SPDK v24.01.1-pre git sha1 4b134b4ab / DPDK 23.11.0 initialization... 00:25:32.763 [2024-04-16 23:03:23.888899] [ DPDK EAL parameters: bdevperf --no-shconf -c 2 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid383494 ] 00:25:33.022 EAL: No free 2048 kB hugepages reported on node 1 00:25:33.022 [2024-04-16 23:03:23.953439] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:25:33.022 [2024-04-16 23:03:24.063913] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:25:33.958 23:03:24 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:25:33.958 23:03:24 -- common/autotest_common.sh@852 -- # return 0 00:25:33.958 23:03:24 -- host/digest.sh@61 -- # bperf_rpc bdev_nvme_set_options --nvme-error-stat --bdev-retry-count -1 00:25:33.958 23:03:24 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock bdev_nvme_set_options --nvme-error-stat --bdev-retry-count -1 00:25:34.215 23:03:25 -- host/digest.sh@63 -- # rpc_cmd accel_error_inject_error -o crc32c -t disable 00:25:34.215 23:03:25 -- common/autotest_common.sh@551 -- # xtrace_disable 00:25:34.215 23:03:25 -- common/autotest_common.sh@10 -- # set +x 00:25:34.215 23:03:25 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:25:34.215 23:03:25 -- host/digest.sh@64 -- # bperf_rpc bdev_nvme_attach_controller --ddgst -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -b nvme0 00:25:34.215 23:03:25 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock bdev_nvme_attach_controller --ddgst -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -b nvme0 00:25:34.474 nvme0n1 00:25:34.734 23:03:25 -- host/digest.sh@67 -- # rpc_cmd accel_error_inject_error -o crc32c -t corrupt -i 256 00:25:34.734 23:03:25 -- common/autotest_common.sh@551 -- # xtrace_disable 00:25:34.734 23:03:25 -- common/autotest_common.sh@10 -- # set +x 00:25:34.734 23:03:25 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:25:34.734 23:03:25 -- host/digest.sh@69 -- # bperf_py perform_tests 00:25:34.734 23:03:25 -- host/digest.sh@19 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bperf.sock perform_tests 00:25:34.734 Running I/O for 2 seconds... 00:25:34.735 [2024-04-16 23:03:25.772265] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x21f6f00) 00:25:34.735 [2024-04-16 23:03:25.772310] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:344 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:34.735 [2024-04-16 23:03:25.772327] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:25:34.735 [2024-04-16 23:03:25.791869] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x21f6f00) 00:25:34.735 [2024-04-16 23:03:25.791907] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:7908 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:34.735 [2024-04-16 23:03:25.791926] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:25:34.735 [2024-04-16 23:03:25.811843] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x21f6f00) 00:25:34.735 [2024-04-16 23:03:25.811880] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:11672 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:34.735 [2024-04-16 23:03:25.811899] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:25:34.735 [2024-04-16 23:03:25.831575] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x21f6f00) 00:25:34.735 [2024-04-16 23:03:25.831613] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:2355 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:34.735 [2024-04-16 23:03:25.831632] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:25:34.735 [2024-04-16 23:03:25.851284] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x21f6f00) 00:25:34.735 [2024-04-16 23:03:25.851321] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:865 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:34.735 [2024-04-16 23:03:25.851340] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:25:34.995 [2024-04-16 23:03:25.870646] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x21f6f00) 00:25:34.995 [2024-04-16 23:03:25.870684] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:12536 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:34.995 [2024-04-16 23:03:25.870714] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:11 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:25:34.995 [2024-04-16 23:03:25.890198] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x21f6f00) 00:25:34.995 [2024-04-16 23:03:25.890257] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:19765 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:34.995 [2024-04-16 23:03:25.890273] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:13 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:25:34.995 [2024-04-16 23:03:25.909559] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x21f6f00) 00:25:34.995 [2024-04-16 23:03:25.909596] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:1641 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:34.995 [2024-04-16 23:03:25.909616] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:25:34.995 [2024-04-16 23:03:25.929124] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x21f6f00) 00:25:34.995 [2024-04-16 23:03:25.929161] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:17 nsid:1 lba:17016 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:34.995 [2024-04-16 23:03:25.929195] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:17 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:25:34.995 [2024-04-16 23:03:25.948413] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x21f6f00) 00:25:34.995 [2024-04-16 23:03:25.948444] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:19 nsid:1 lba:1144 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:34.995 [2024-04-16 23:03:25.948474] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:19 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:25:34.995 [2024-04-16 23:03:25.967682] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x21f6f00) 00:25:34.995 [2024-04-16 23:03:25.967718] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:21 nsid:1 lba:14310 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:34.995 [2024-04-16 23:03:25.967737] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:21 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:25:34.995 [2024-04-16 23:03:25.987258] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x21f6f00) 00:25:34.995 [2024-04-16 23:03:25.987287] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:23 nsid:1 lba:1217 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:34.995 [2024-04-16 23:03:25.987303] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:23 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:25:34.995 [2024-04-16 23:03:26.006649] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x21f6f00) 00:25:34.995 [2024-04-16 23:03:26.006686] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:25 nsid:1 lba:1785 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:34.995 [2024-04-16 23:03:26.006706] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:25 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:25:34.995 [2024-04-16 23:03:26.026299] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x21f6f00) 00:25:34.995 [2024-04-16 23:03:26.026329] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:27 nsid:1 lba:5756 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:34.995 [2024-04-16 23:03:26.026345] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:27 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:25:34.995 [2024-04-16 23:03:26.046091] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x21f6f00) 00:25:34.995 [2024-04-16 23:03:26.046128] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:29 nsid:1 lba:18528 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:34.995 [2024-04-16 23:03:26.046148] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:29 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:25:34.995 [2024-04-16 23:03:26.065744] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x21f6f00) 00:25:34.995 [2024-04-16 23:03:26.065780] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:31 nsid:1 lba:14442 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:34.995 [2024-04-16 23:03:26.065800] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:31 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:25:34.995 [2024-04-16 23:03:26.085075] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x21f6f00) 00:25:34.995 [2024-04-16 23:03:26.085112] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:33 nsid:1 lba:3437 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:34.995 [2024-04-16 23:03:26.085132] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:33 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:25:34.995 [2024-04-16 23:03:26.104608] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x21f6f00) 00:25:34.995 [2024-04-16 23:03:26.104650] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:35 nsid:1 lba:8650 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:34.995 [2024-04-16 23:03:26.104670] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:35 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:25:35.256 [2024-04-16 23:03:26.124393] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x21f6f00) 00:25:35.256 [2024-04-16 23:03:26.124423] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:37 nsid:1 lba:16517 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:35.256 [2024-04-16 23:03:26.124440] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:37 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:25:35.256 [2024-04-16 23:03:26.137316] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x21f6f00) 00:25:35.256 [2024-04-16 23:03:26.137348] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:124 nsid:1 lba:23107 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:35.256 [2024-04-16 23:03:26.137364] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:124 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:25:35.256 [2024-04-16 23:03:26.156727] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x21f6f00) 00:25:35.256 [2024-04-16 23:03:26.156763] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:21 nsid:1 lba:5265 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:35.256 [2024-04-16 23:03:26.156783] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:21 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:25:35.256 [2024-04-16 23:03:26.175843] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x21f6f00) 00:25:35.256 [2024-04-16 23:03:26.175880] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:19 nsid:1 lba:10458 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:35.256 [2024-04-16 23:03:26.175899] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:19 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:25:35.256 [2024-04-16 23:03:26.195182] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x21f6f00) 00:25:35.256 [2024-04-16 23:03:26.195217] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:17 nsid:1 lba:16235 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:35.256 [2024-04-16 23:03:26.195251] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:17 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:25:35.256 [2024-04-16 23:03:26.214712] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x21f6f00) 00:25:35.256 [2024-04-16 23:03:26.214748] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:15837 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:35.256 [2024-04-16 23:03:26.214768] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:25:35.256 [2024-04-16 23:03:26.234435] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x21f6f00) 00:25:35.256 [2024-04-16 23:03:26.234464] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:11089 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:35.256 [2024-04-16 23:03:26.234496] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:13 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:25:35.256 [2024-04-16 23:03:26.253849] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x21f6f00) 00:25:35.256 [2024-04-16 23:03:26.253885] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:5076 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:35.256 [2024-04-16 23:03:26.253904] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:11 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:25:35.256 [2024-04-16 23:03:26.273663] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x21f6f00) 00:25:35.256 [2024-04-16 23:03:26.273699] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:19284 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:35.256 [2024-04-16 23:03:26.273720] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:25:35.256 [2024-04-16 23:03:26.293184] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x21f6f00) 00:25:35.256 [2024-04-16 23:03:26.293233] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:2934 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:35.256 [2024-04-16 23:03:26.293249] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:25:35.256 [2024-04-16 23:03:26.312088] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x21f6f00) 00:25:35.256 [2024-04-16 23:03:26.312124] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:8903 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:35.256 [2024-04-16 23:03:26.312144] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:25:35.256 [2024-04-16 23:03:26.331583] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x21f6f00) 00:25:35.256 [2024-04-16 23:03:26.331619] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:22160 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:35.256 [2024-04-16 23:03:26.331639] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:25:35.256 [2024-04-16 23:03:26.350968] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x21f6f00) 00:25:35.256 [2024-04-16 23:03:26.351004] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:5044 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:35.256 [2024-04-16 23:03:26.351024] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:25:35.256 [2024-04-16 23:03:26.379266] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x21f6f00) 00:25:35.256 [2024-04-16 23:03:26.379297] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:13822 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:35.256 [2024-04-16 23:03:26.379313] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:25:35.515 [2024-04-16 23:03:26.398749] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x21f6f00) 00:25:35.515 [2024-04-16 23:03:26.398785] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:16449 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:35.515 [2024-04-16 23:03:26.398805] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:25:35.515 [2024-04-16 23:03:26.418377] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x21f6f00) 00:25:35.515 [2024-04-16 23:03:26.418406] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:12949 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:35.515 [2024-04-16 23:03:26.418422] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:25:35.515 [2024-04-16 23:03:26.438086] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x21f6f00) 00:25:35.515 [2024-04-16 23:03:26.438122] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:22317 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:35.515 [2024-04-16 23:03:26.438153] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:25:35.515 [2024-04-16 23:03:26.457635] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x21f6f00) 00:25:35.515 [2024-04-16 23:03:26.457671] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:18709 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:35.515 [2024-04-16 23:03:26.457691] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:25:35.515 [2024-04-16 23:03:26.477462] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x21f6f00) 00:25:35.515 [2024-04-16 23:03:26.477509] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:5944 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:35.515 [2024-04-16 23:03:26.477530] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:10 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:25:35.515 [2024-04-16 23:03:26.496784] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x21f6f00) 00:25:35.515 [2024-04-16 23:03:26.496819] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:16666 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:35.515 [2024-04-16 23:03:26.496838] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:12 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:25:35.515 [2024-04-16 23:03:26.516324] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x21f6f00) 00:25:35.515 [2024-04-16 23:03:26.516355] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:6549 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:35.515 [2024-04-16 23:03:26.516372] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:25:35.515 [2024-04-16 23:03:26.535930] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x21f6f00) 00:25:35.515 [2024-04-16 23:03:26.535966] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:16 nsid:1 lba:21257 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:35.515 [2024-04-16 23:03:26.535987] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:16 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:25:35.515 [2024-04-16 23:03:26.555760] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x21f6f00) 00:25:35.515 [2024-04-16 23:03:26.555799] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:18 nsid:1 lba:12120 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:35.515 [2024-04-16 23:03:26.555819] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:18 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:25:35.515 [2024-04-16 23:03:26.575167] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x21f6f00) 00:25:35.515 [2024-04-16 23:03:26.575210] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:20 nsid:1 lba:4358 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:35.515 [2024-04-16 23:03:26.575243] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:20 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:25:35.515 [2024-04-16 23:03:26.593806] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x21f6f00) 00:25:35.515 [2024-04-16 23:03:26.593843] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:22 nsid:1 lba:2541 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:35.515 [2024-04-16 23:03:26.593863] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:22 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:25:35.515 [2024-04-16 23:03:26.613254] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x21f6f00) 00:25:35.515 [2024-04-16 23:03:26.613291] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:24 nsid:1 lba:6876 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:35.515 [2024-04-16 23:03:26.613309] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:24 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:25:35.515 [2024-04-16 23:03:26.632300] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x21f6f00) 00:25:35.515 [2024-04-16 23:03:26.632331] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:26 nsid:1 lba:19069 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:35.515 [2024-04-16 23:03:26.632362] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:26 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:25:35.774 [2024-04-16 23:03:26.651730] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x21f6f00) 00:25:35.774 [2024-04-16 23:03:26.651767] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:28 nsid:1 lba:3314 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:35.774 [2024-04-16 23:03:26.651787] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:28 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:25:35.774 [2024-04-16 23:03:26.671067] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x21f6f00) 00:25:35.774 [2024-04-16 23:03:26.671103] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:30 nsid:1 lba:14442 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:35.774 [2024-04-16 23:03:26.671122] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:30 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:25:35.774 [2024-04-16 23:03:26.690798] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x21f6f00) 00:25:35.774 [2024-04-16 23:03:26.690834] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:32 nsid:1 lba:571 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:35.774 [2024-04-16 23:03:26.690853] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:32 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:25:35.774 [2024-04-16 23:03:26.710253] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x21f6f00) 00:25:35.774 [2024-04-16 23:03:26.710283] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:34 nsid:1 lba:5812 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:35.774 [2024-04-16 23:03:26.710299] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:34 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:25:35.774 [2024-04-16 23:03:26.729826] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x21f6f00) 00:25:35.774 [2024-04-16 23:03:26.729862] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:36 nsid:1 lba:1316 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:35.774 [2024-04-16 23:03:26.729882] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:36 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:25:35.774 [2024-04-16 23:03:26.748975] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x21f6f00) 00:25:35.774 [2024-04-16 23:03:26.749012] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:38 nsid:1 lba:2160 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:35.774 [2024-04-16 23:03:26.749031] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:38 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:25:35.774 [2024-04-16 23:03:26.768379] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x21f6f00) 00:25:35.774 [2024-04-16 23:03:26.768408] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:40 nsid:1 lba:6022 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:35.774 [2024-04-16 23:03:26.768423] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:40 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:25:35.774 [2024-04-16 23:03:26.788061] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x21f6f00) 00:25:35.774 [2024-04-16 23:03:26.788097] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:42 nsid:1 lba:13365 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:35.774 [2024-04-16 23:03:26.788117] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:42 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:25:35.774 [2024-04-16 23:03:26.807581] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x21f6f00) 00:25:35.774 [2024-04-16 23:03:26.807617] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:44 nsid:1 lba:5525 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:35.774 [2024-04-16 23:03:26.807636] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:44 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:25:35.774 [2024-04-16 23:03:26.826983] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x21f6f00) 00:25:35.774 [2024-04-16 23:03:26.827020] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:46 nsid:1 lba:656 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:35.774 [2024-04-16 23:03:26.827040] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:46 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:25:35.774 [2024-04-16 23:03:26.846931] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x21f6f00) 00:25:35.774 [2024-04-16 23:03:26.846968] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:48 nsid:1 lba:3022 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:35.774 [2024-04-16 23:03:26.846988] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:48 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:25:35.774 [2024-04-16 23:03:26.866573] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x21f6f00) 00:25:35.774 [2024-04-16 23:03:26.866610] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:50 nsid:1 lba:11119 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:35.774 [2024-04-16 23:03:26.866629] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:50 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:25:35.774 [2024-04-16 23:03:26.886015] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x21f6f00) 00:25:35.774 [2024-04-16 23:03:26.886052] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:52 nsid:1 lba:7148 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:35.774 [2024-04-16 23:03:26.886072] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:52 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:25:36.032 [2024-04-16 23:03:26.906326] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x21f6f00) 00:25:36.032 [2024-04-16 23:03:26.906359] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:54 nsid:1 lba:8849 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:36.032 [2024-04-16 23:03:26.906376] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:54 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:25:36.032 [2024-04-16 23:03:26.926293] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x21f6f00) 00:25:36.032 [2024-04-16 23:03:26.926327] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:56 nsid:1 lba:15570 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:36.032 [2024-04-16 23:03:26.926345] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:56 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:25:36.032 [2024-04-16 23:03:26.946468] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x21f6f00) 00:25:36.032 [2024-04-16 23:03:26.946508] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:58 nsid:1 lba:4859 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:36.032 [2024-04-16 23:03:26.946551] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:58 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:25:36.032 [2024-04-16 23:03:26.966566] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x21f6f00) 00:25:36.032 [2024-04-16 23:03:26.966601] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:60 nsid:1 lba:1408 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:36.032 [2024-04-16 23:03:26.966631] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:60 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:25:36.032 [2024-04-16 23:03:26.985289] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x21f6f00) 00:25:36.032 [2024-04-16 23:03:26.985318] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:62 nsid:1 lba:18787 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:36.032 [2024-04-16 23:03:26.985337] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:62 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:25:36.032 [2024-04-16 23:03:27.004770] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x21f6f00) 00:25:36.032 [2024-04-16 23:03:27.004806] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:64 nsid:1 lba:4864 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:36.032 [2024-04-16 23:03:27.004825] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:64 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:25:36.032 [2024-04-16 23:03:27.024596] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x21f6f00) 00:25:36.032 [2024-04-16 23:03:27.024631] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:66 nsid:1 lba:11685 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:36.032 [2024-04-16 23:03:27.024651] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:66 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:25:36.032 [2024-04-16 23:03:27.044128] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x21f6f00) 00:25:36.032 [2024-04-16 23:03:27.044164] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:68 nsid:1 lba:15704 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:36.032 [2024-04-16 23:03:27.044196] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:68 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:25:36.032 [2024-04-16 23:03:27.063610] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x21f6f00) 00:25:36.032 [2024-04-16 23:03:27.063646] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:70 nsid:1 lba:9005 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:36.032 [2024-04-16 23:03:27.063665] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:70 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:25:36.032 [2024-04-16 23:03:27.083454] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x21f6f00) 00:25:36.032 [2024-04-16 23:03:27.083504] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:72 nsid:1 lba:13177 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:36.032 [2024-04-16 23:03:27.083527] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:72 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:25:36.032 [2024-04-16 23:03:27.102912] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x21f6f00) 00:25:36.033 [2024-04-16 23:03:27.102948] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:74 nsid:1 lba:5225 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:36.033 [2024-04-16 23:03:27.102967] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:74 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:25:36.033 [2024-04-16 23:03:27.122250] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x21f6f00) 00:25:36.033 [2024-04-16 23:03:27.122280] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:76 nsid:1 lba:21038 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:36.033 [2024-04-16 23:03:27.122298] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:76 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:25:36.033 [2024-04-16 23:03:27.141683] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x21f6f00) 00:25:36.033 [2024-04-16 23:03:27.141719] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:78 nsid:1 lba:24895 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:36.033 [2024-04-16 23:03:27.141739] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:78 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:25:36.292 [2024-04-16 23:03:27.161297] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x21f6f00) 00:25:36.292 [2024-04-16 23:03:27.161327] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:80 nsid:1 lba:3596 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:36.293 [2024-04-16 23:03:27.161354] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:80 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:25:36.293 [2024-04-16 23:03:27.180713] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x21f6f00) 00:25:36.293 [2024-04-16 23:03:27.180749] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:82 nsid:1 lba:23668 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:36.293 [2024-04-16 23:03:27.180773] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:82 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:25:36.293 [2024-04-16 23:03:27.200302] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x21f6f00) 00:25:36.293 [2024-04-16 23:03:27.200342] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:84 nsid:1 lba:4199 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:36.293 [2024-04-16 23:03:27.200361] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:84 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:25:36.293 [2024-04-16 23:03:27.219753] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x21f6f00) 00:25:36.293 [2024-04-16 23:03:27.219789] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:86 nsid:1 lba:13343 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:36.293 [2024-04-16 23:03:27.219808] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:86 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:25:36.293 [2024-04-16 23:03:27.239695] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x21f6f00) 00:25:36.293 [2024-04-16 23:03:27.239731] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:88 nsid:1 lba:11065 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:36.293 [2024-04-16 23:03:27.239750] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:88 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:25:36.293 [2024-04-16 23:03:27.259936] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x21f6f00) 00:25:36.293 [2024-04-16 23:03:27.259972] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:90 nsid:1 lba:17694 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:36.293 [2024-04-16 23:03:27.259995] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:90 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:25:36.293 [2024-04-16 23:03:27.279921] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x21f6f00) 00:25:36.293 [2024-04-16 23:03:27.279956] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:92 nsid:1 lba:9243 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:36.293 [2024-04-16 23:03:27.279985] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:92 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:25:36.293 [2024-04-16 23:03:27.299269] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x21f6f00) 00:25:36.293 [2024-04-16 23:03:27.299304] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:94 nsid:1 lba:4480 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:36.293 [2024-04-16 23:03:27.299324] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:94 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:25:36.293 [2024-04-16 23:03:27.319147] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x21f6f00) 00:25:36.293 [2024-04-16 23:03:27.319190] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:96 nsid:1 lba:559 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:36.293 [2024-04-16 23:03:27.319210] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:96 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:25:36.293 [2024-04-16 23:03:27.338825] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x21f6f00) 00:25:36.293 [2024-04-16 23:03:27.338870] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:98 nsid:1 lba:25077 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:36.293 [2024-04-16 23:03:27.338889] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:98 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:25:36.293 [2024-04-16 23:03:27.357613] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x21f6f00) 00:25:36.293 [2024-04-16 23:03:27.357648] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:100 nsid:1 lba:786 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:36.293 [2024-04-16 23:03:27.357668] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:100 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:25:36.293 [2024-04-16 23:03:27.377216] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x21f6f00) 00:25:36.293 [2024-04-16 23:03:27.377262] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:102 nsid:1 lba:3652 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:36.293 [2024-04-16 23:03:27.377280] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:102 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:25:36.293 [2024-04-16 23:03:27.396545] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x21f6f00) 00:25:36.293 [2024-04-16 23:03:27.396582] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:104 nsid:1 lba:17101 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:36.293 [2024-04-16 23:03:27.396602] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:104 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:25:36.293 [2024-04-16 23:03:27.416035] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x21f6f00) 00:25:36.293 [2024-04-16 23:03:27.416071] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:126 nsid:1 lba:20660 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:36.293 [2024-04-16 23:03:27.416091] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:126 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:25:36.553 [2024-04-16 23:03:27.435639] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x21f6f00) 00:25:36.553 [2024-04-16 23:03:27.435676] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:124 nsid:1 lba:23235 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:36.553 [2024-04-16 23:03:27.435696] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:124 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:25:36.553 [2024-04-16 23:03:27.455407] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x21f6f00) 00:25:36.553 [2024-04-16 23:03:27.455442] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:122 nsid:1 lba:13441 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:36.553 [2024-04-16 23:03:27.455459] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:122 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:25:36.553 [2024-04-16 23:03:27.475089] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x21f6f00) 00:25:36.553 [2024-04-16 23:03:27.475125] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:120 nsid:1 lba:6051 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:36.553 [2024-04-16 23:03:27.475144] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:120 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:25:36.553 [2024-04-16 23:03:27.494817] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x21f6f00) 00:25:36.553 [2024-04-16 23:03:27.494853] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:118 nsid:1 lba:25415 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:36.553 [2024-04-16 23:03:27.494873] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:118 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:25:36.553 [2024-04-16 23:03:27.514457] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x21f6f00) 00:25:36.553 [2024-04-16 23:03:27.514506] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:116 nsid:1 lba:15958 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:36.553 [2024-04-16 23:03:27.514525] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:116 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:25:36.553 [2024-04-16 23:03:27.534327] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x21f6f00) 00:25:36.553 [2024-04-16 23:03:27.534363] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:114 nsid:1 lba:2425 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:36.553 [2024-04-16 23:03:27.534382] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:114 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:25:36.553 [2024-04-16 23:03:27.553911] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x21f6f00) 00:25:36.553 [2024-04-16 23:03:27.553946] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:112 nsid:1 lba:24561 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:36.553 [2024-04-16 23:03:27.553966] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:112 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:25:36.553 [2024-04-16 23:03:27.573355] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x21f6f00) 00:25:36.553 [2024-04-16 23:03:27.573386] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:110 nsid:1 lba:24009 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:36.553 [2024-04-16 23:03:27.573403] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:110 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:25:36.553 [2024-04-16 23:03:27.593153] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x21f6f00) 00:25:36.553 [2024-04-16 23:03:27.593196] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:108 nsid:1 lba:22690 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:36.553 [2024-04-16 23:03:27.593217] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:108 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:25:36.553 [2024-04-16 23:03:27.612316] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x21f6f00) 00:25:36.553 [2024-04-16 23:03:27.612345] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:106 nsid:1 lba:17310 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:36.553 [2024-04-16 23:03:27.612362] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:106 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:25:36.553 [2024-04-16 23:03:27.640581] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x21f6f00) 00:25:36.553 [2024-04-16 23:03:27.640618] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:107 nsid:1 lba:17830 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:36.553 [2024-04-16 23:03:27.640637] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:107 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:25:36.553 [2024-04-16 23:03:27.660309] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x21f6f00) 00:25:36.553 [2024-04-16 23:03:27.660339] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:109 nsid:1 lba:20612 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:36.553 [2024-04-16 23:03:27.660355] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:109 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:25:36.553 [2024-04-16 23:03:27.680353] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x21f6f00) 00:25:36.554 [2024-04-16 23:03:27.680382] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:111 nsid:1 lba:17968 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:36.554 [2024-04-16 23:03:27.680398] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:111 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:25:36.812 [2024-04-16 23:03:27.700421] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x21f6f00) 00:25:36.812 [2024-04-16 23:03:27.700459] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:113 nsid:1 lba:21655 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:36.812 [2024-04-16 23:03:27.700475] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:113 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:25:36.812 [2024-04-16 23:03:27.719721] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x21f6f00) 00:25:36.812 [2024-04-16 23:03:27.719757] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:115 nsid:1 lba:5985 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:36.812 [2024-04-16 23:03:27.719778] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:115 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:25:36.812 [2024-04-16 23:03:27.738874] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x21f6f00) 00:25:36.812 [2024-04-16 23:03:27.738912] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:117 nsid:1 lba:11767 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:36.812 [2024-04-16 23:03:27.738932] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:117 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:25:36.812 00:25:36.812 Latency(us) 00:25:36.812 Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:25:36.812 Job: nvme0n1 (Core Mask 0x2, workload: randread, depth: 128, IO size: 4096) 00:25:36.812 nvme0n1 : 2.01 12956.98 50.61 0.00 0.00 9871.20 4466.16 38059.43 00:25:36.812 =================================================================================================================== 00:25:36.812 Total : 12956.98 50.61 0.00 0.00 9871.20 4466.16 38059.43 00:25:36.812 0 00:25:36.812 23:03:27 -- host/digest.sh@71 -- # get_transient_errcount nvme0n1 00:25:36.812 23:03:27 -- host/digest.sh@27 -- # bperf_rpc bdev_get_iostat -b nvme0n1 00:25:36.812 23:03:27 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock bdev_get_iostat -b nvme0n1 00:25:36.812 23:03:27 -- host/digest.sh@28 -- # jq -r '.bdevs[0] 00:25:36.812 | .driver_specific 00:25:36.812 | .nvme_error 00:25:36.812 | .status_code 00:25:36.812 | .command_transient_transport_error' 00:25:37.072 23:03:28 -- host/digest.sh@71 -- # (( 101 > 0 )) 00:25:37.072 23:03:28 -- host/digest.sh@73 -- # killprocess 383494 00:25:37.072 23:03:28 -- common/autotest_common.sh@926 -- # '[' -z 383494 ']' 00:25:37.072 23:03:28 -- common/autotest_common.sh@930 -- # kill -0 383494 00:25:37.072 23:03:28 -- common/autotest_common.sh@931 -- # uname 00:25:37.072 23:03:28 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:25:37.072 23:03:28 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 383494 00:25:37.072 23:03:28 -- common/autotest_common.sh@932 -- # process_name=reactor_1 00:25:37.072 23:03:28 -- common/autotest_common.sh@936 -- # '[' reactor_1 = sudo ']' 00:25:37.072 23:03:28 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 383494' 00:25:37.072 killing process with pid 383494 00:25:37.072 23:03:28 -- common/autotest_common.sh@945 -- # kill 383494 00:25:37.072 Received shutdown signal, test time was about 2.000000 seconds 00:25:37.072 00:25:37.072 Latency(us) 00:25:37.072 Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:25:37.072 =================================================================================================================== 00:25:37.072 Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:25:37.072 23:03:28 -- common/autotest_common.sh@950 -- # wait 383494 00:25:37.331 23:03:28 -- host/digest.sh@108 -- # run_bperf_err randread 131072 16 00:25:37.331 23:03:28 -- host/digest.sh@54 -- # local rw bs qd 00:25:37.331 23:03:28 -- host/digest.sh@56 -- # rw=randread 00:25:37.331 23:03:28 -- host/digest.sh@56 -- # bs=131072 00:25:37.331 23:03:28 -- host/digest.sh@56 -- # qd=16 00:25:37.331 23:03:28 -- host/digest.sh@58 -- # bperfpid=384051 00:25:37.331 23:03:28 -- host/digest.sh@57 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 2 -r /var/tmp/bperf.sock -w randread -o 131072 -t 2 -q 16 -z 00:25:37.331 23:03:28 -- host/digest.sh@60 -- # waitforlisten 384051 /var/tmp/bperf.sock 00:25:37.331 23:03:28 -- common/autotest_common.sh@819 -- # '[' -z 384051 ']' 00:25:37.331 23:03:28 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/bperf.sock 00:25:37.331 23:03:28 -- common/autotest_common.sh@824 -- # local max_retries=100 00:25:37.331 23:03:28 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bperf.sock...' 00:25:37.331 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bperf.sock... 00:25:37.331 23:03:28 -- common/autotest_common.sh@828 -- # xtrace_disable 00:25:37.331 23:03:28 -- common/autotest_common.sh@10 -- # set +x 00:25:37.331 [2024-04-16 23:03:28.358311] Starting SPDK v24.01.1-pre git sha1 4b134b4ab / DPDK 23.11.0 initialization... 00:25:37.331 [2024-04-16 23:03:28.358392] [ DPDK EAL parameters: bdevperf --no-shconf -c 2 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid384051 ] 00:25:37.331 I/O size of 131072 is greater than zero copy threshold (65536). 00:25:37.331 Zero copy mechanism will not be used. 00:25:37.331 EAL: No free 2048 kB hugepages reported on node 1 00:25:37.331 [2024-04-16 23:03:28.421847] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:25:37.590 [2024-04-16 23:03:28.529416] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:25:38.527 23:03:29 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:25:38.527 23:03:29 -- common/autotest_common.sh@852 -- # return 0 00:25:38.527 23:03:29 -- host/digest.sh@61 -- # bperf_rpc bdev_nvme_set_options --nvme-error-stat --bdev-retry-count -1 00:25:38.527 23:03:29 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock bdev_nvme_set_options --nvme-error-stat --bdev-retry-count -1 00:25:38.527 23:03:29 -- host/digest.sh@63 -- # rpc_cmd accel_error_inject_error -o crc32c -t disable 00:25:38.527 23:03:29 -- common/autotest_common.sh@551 -- # xtrace_disable 00:25:38.527 23:03:29 -- common/autotest_common.sh@10 -- # set +x 00:25:38.527 23:03:29 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:25:38.527 23:03:29 -- host/digest.sh@64 -- # bperf_rpc bdev_nvme_attach_controller --ddgst -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -b nvme0 00:25:38.527 23:03:29 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock bdev_nvme_attach_controller --ddgst -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -b nvme0 00:25:39.095 nvme0n1 00:25:39.095 23:03:29 -- host/digest.sh@67 -- # rpc_cmd accel_error_inject_error -o crc32c -t corrupt -i 32 00:25:39.095 23:03:29 -- common/autotest_common.sh@551 -- # xtrace_disable 00:25:39.095 23:03:29 -- common/autotest_common.sh@10 -- # set +x 00:25:39.095 23:03:29 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:25:39.095 23:03:29 -- host/digest.sh@69 -- # bperf_py perform_tests 00:25:39.095 23:03:29 -- host/digest.sh@19 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bperf.sock perform_tests 00:25:39.095 I/O size of 131072 is greater than zero copy threshold (65536). 00:25:39.095 Zero copy mechanism will not be used. 00:25:39.095 Running I/O for 2 seconds... 00:25:39.095 [2024-04-16 23:03:30.057490] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1186880) 00:25:39.095 [2024-04-16 23:03:30.057554] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:5216 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:39.095 [2024-04-16 23:03:30.057588] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:25:39.095 [2024-04-16 23:03:30.068652] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1186880) 00:25:39.095 [2024-04-16 23:03:30.068690] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:8192 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:39.095 [2024-04-16 23:03:30.068711] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:25:39.095 [2024-04-16 23:03:30.077541] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1186880) 00:25:39.095 [2024-04-16 23:03:30.077579] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:2976 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:39.095 [2024-04-16 23:03:30.077600] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:25:39.095 [2024-04-16 23:03:30.086255] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1186880) 00:25:39.095 [2024-04-16 23:03:30.086285] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:22272 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:39.095 [2024-04-16 23:03:30.086302] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:25:39.095 [2024-04-16 23:03:30.094910] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1186880) 00:25:39.095 [2024-04-16 23:03:30.094947] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:15392 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:39.095 [2024-04-16 23:03:30.094967] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:25:39.095 [2024-04-16 23:03:30.103572] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1186880) 00:25:39.095 [2024-04-16 23:03:30.103608] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:3264 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:39.095 [2024-04-16 23:03:30.103628] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:25:39.095 [2024-04-16 23:03:30.112444] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1186880) 00:25:39.095 [2024-04-16 23:03:30.112475] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:5152 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:39.095 [2024-04-16 23:03:30.112492] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:25:39.095 [2024-04-16 23:03:30.121238] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1186880) 00:25:39.095 [2024-04-16 23:03:30.121270] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:5120 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:39.095 [2024-04-16 23:03:30.121287] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:25:39.095 [2024-04-16 23:03:30.129825] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1186880) 00:25:39.095 [2024-04-16 23:03:30.129862] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:22720 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:39.095 [2024-04-16 23:03:30.129882] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:25:39.095 [2024-04-16 23:03:30.138465] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1186880) 00:25:39.095 [2024-04-16 23:03:30.138496] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:11680 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:39.095 [2024-04-16 23:03:30.138513] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:25:39.095 [2024-04-16 23:03:30.147148] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1186880) 00:25:39.095 [2024-04-16 23:03:30.147194] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:21504 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:39.095 [2024-04-16 23:03:30.147231] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:25:39.095 [2024-04-16 23:03:30.155670] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1186880) 00:25:39.095 [2024-04-16 23:03:30.155706] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:17952 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:39.095 [2024-04-16 23:03:30.155725] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:25:39.095 [2024-04-16 23:03:30.164467] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1186880) 00:25:39.095 [2024-04-16 23:03:30.164512] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:24128 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:39.095 [2024-04-16 23:03:30.164529] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:25:39.095 [2024-04-16 23:03:30.173224] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1186880) 00:25:39.095 [2024-04-16 23:03:30.173254] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:17344 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:39.095 [2024-04-16 23:03:30.173270] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:25:39.095 [2024-04-16 23:03:30.181818] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1186880) 00:25:39.095 [2024-04-16 23:03:30.181855] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:5504 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:39.095 [2024-04-16 23:03:30.181875] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:25:39.095 [2024-04-16 23:03:30.190435] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1186880) 00:25:39.095 [2024-04-16 23:03:30.190483] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:2368 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:39.095 [2024-04-16 23:03:30.190509] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:25:39.095 [2024-04-16 23:03:30.199223] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1186880) 00:25:39.095 [2024-04-16 23:03:30.199271] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:18912 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:39.095 [2024-04-16 23:03:30.199287] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:25:39.095 [2024-04-16 23:03:30.208240] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1186880) 00:25:39.095 [2024-04-16 23:03:30.208274] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:17024 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:39.095 [2024-04-16 23:03:30.208292] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:25:39.095 [2024-04-16 23:03:30.216914] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1186880) 00:25:39.095 [2024-04-16 23:03:30.216963] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:4416 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:39.095 [2024-04-16 23:03:30.216983] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:25:39.354 [2024-04-16 23:03:30.225332] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1186880) 00:25:39.354 [2024-04-16 23:03:30.225379] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:15264 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:39.354 [2024-04-16 23:03:30.225396] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:25:39.354 [2024-04-16 23:03:30.233986] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1186880) 00:25:39.354 [2024-04-16 23:03:30.234024] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:9120 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:39.354 [2024-04-16 23:03:30.234043] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:25:39.354 [2024-04-16 23:03:30.242584] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1186880) 00:25:39.354 [2024-04-16 23:03:30.242620] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:18112 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:39.354 [2024-04-16 23:03:30.242640] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:25:39.354 [2024-04-16 23:03:30.251479] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1186880) 00:25:39.354 [2024-04-16 23:03:30.251509] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:13920 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:39.354 [2024-04-16 23:03:30.251548] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:25:39.355 [2024-04-16 23:03:30.260406] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1186880) 00:25:39.355 [2024-04-16 23:03:30.260445] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:8608 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:39.355 [2024-04-16 23:03:30.260461] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:25:39.355 [2024-04-16 23:03:30.269171] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1186880) 00:25:39.355 [2024-04-16 23:03:30.269233] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:5408 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:39.355 [2024-04-16 23:03:30.269252] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:25:39.355 [2024-04-16 23:03:30.277852] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1186880) 00:25:39.355 [2024-04-16 23:03:30.277888] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:18368 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:39.355 [2024-04-16 23:03:30.277907] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:25:39.355 [2024-04-16 23:03:30.286357] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1186880) 00:25:39.355 [2024-04-16 23:03:30.286388] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:12608 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:39.355 [2024-04-16 23:03:30.286404] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:25:39.355 [2024-04-16 23:03:30.294597] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1186880) 00:25:39.355 [2024-04-16 23:03:30.294633] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:19744 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:39.355 [2024-04-16 23:03:30.294653] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:25:39.355 [2024-04-16 23:03:30.303113] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1186880) 00:25:39.355 [2024-04-16 23:03:30.303148] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:17920 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:39.355 [2024-04-16 23:03:30.303168] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:25:39.355 [2024-04-16 23:03:30.312220] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1186880) 00:25:39.355 [2024-04-16 23:03:30.312252] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:15072 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:39.355 [2024-04-16 23:03:30.312271] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:25:39.355 [2024-04-16 23:03:30.322642] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1186880) 00:25:39.355 [2024-04-16 23:03:30.322673] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:7296 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:39.355 [2024-04-16 23:03:30.322691] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:25:39.355 [2024-04-16 23:03:30.333040] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1186880) 00:25:39.355 [2024-04-16 23:03:30.333090] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:25216 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:39.355 [2024-04-16 23:03:30.333110] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:25:39.355 [2024-04-16 23:03:30.343816] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1186880) 00:25:39.355 [2024-04-16 23:03:30.343851] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:3104 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:39.355 [2024-04-16 23:03:30.343870] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:25:39.355 [2024-04-16 23:03:30.353151] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1186880) 00:25:39.355 [2024-04-16 23:03:30.353196] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:24352 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:39.355 [2024-04-16 23:03:30.353230] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:25:39.355 [2024-04-16 23:03:30.361849] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1186880) 00:25:39.355 [2024-04-16 23:03:30.361884] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:4384 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:39.355 [2024-04-16 23:03:30.361903] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:25:39.355 [2024-04-16 23:03:30.370478] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1186880) 00:25:39.355 [2024-04-16 23:03:30.370508] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:4096 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:39.355 [2024-04-16 23:03:30.370540] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:25:39.355 [2024-04-16 23:03:30.379130] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1186880) 00:25:39.355 [2024-04-16 23:03:30.379165] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:20160 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:39.355 [2024-04-16 23:03:30.379193] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:25:39.355 [2024-04-16 23:03:30.387647] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1186880) 00:25:39.355 [2024-04-16 23:03:30.387682] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:17888 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:39.355 [2024-04-16 23:03:30.387701] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:25:39.355 [2024-04-16 23:03:30.396492] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1186880) 00:25:39.355 [2024-04-16 23:03:30.396535] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:384 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:39.355 [2024-04-16 23:03:30.396555] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:25:39.355 [2024-04-16 23:03:30.405358] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1186880) 00:25:39.355 [2024-04-16 23:03:30.405388] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:2496 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:39.355 [2024-04-16 23:03:30.405410] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:25:39.355 [2024-04-16 23:03:30.414156] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1186880) 00:25:39.355 [2024-04-16 23:03:30.414198] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:12288 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:39.355 [2024-04-16 23:03:30.414242] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:25:39.355 [2024-04-16 23:03:30.422940] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1186880) 00:25:39.355 [2024-04-16 23:03:30.422981] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:10816 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:39.355 [2024-04-16 23:03:30.423001] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:25:39.355 [2024-04-16 23:03:30.431531] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1186880) 00:25:39.355 [2024-04-16 23:03:30.431565] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:18016 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:39.355 [2024-04-16 23:03:30.431584] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:25:39.355 [2024-04-16 23:03:30.440224] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1186880) 00:25:39.355 [2024-04-16 23:03:30.440268] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:6624 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:39.355 [2024-04-16 23:03:30.440287] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:25:39.355 [2024-04-16 23:03:30.449092] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1186880) 00:25:39.355 [2024-04-16 23:03:30.449126] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:17248 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:39.355 [2024-04-16 23:03:30.449145] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:25:39.355 [2024-04-16 23:03:30.457892] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1186880) 00:25:39.355 [2024-04-16 23:03:30.457927] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:1312 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:39.355 [2024-04-16 23:03:30.457946] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:25:39.355 [2024-04-16 23:03:30.466502] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1186880) 00:25:39.355 [2024-04-16 23:03:30.466548] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:640 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:39.355 [2024-04-16 23:03:30.466566] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:25:39.355 [2024-04-16 23:03:30.475222] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1186880) 00:25:39.355 [2024-04-16 23:03:30.475251] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:22688 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:39.355 [2024-04-16 23:03:30.475270] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:25:39.614 [2024-04-16 23:03:30.483857] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1186880) 00:25:39.614 [2024-04-16 23:03:30.483892] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:21120 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:39.614 [2024-04-16 23:03:30.483914] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:25:39.614 [2024-04-16 23:03:30.492546] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1186880) 00:25:39.614 [2024-04-16 23:03:30.492581] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:10816 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:39.614 [2024-04-16 23:03:30.492603] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:25:39.614 [2024-04-16 23:03:30.501711] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1186880) 00:25:39.614 [2024-04-16 23:03:30.501747] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:22208 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:39.615 [2024-04-16 23:03:30.501766] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:25:39.615 [2024-04-16 23:03:30.510964] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1186880) 00:25:39.615 [2024-04-16 23:03:30.510999] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:5152 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:39.615 [2024-04-16 23:03:30.511019] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:25:39.615 [2024-04-16 23:03:30.520049] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1186880) 00:25:39.615 [2024-04-16 23:03:30.520084] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:20832 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:39.615 [2024-04-16 23:03:30.520104] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:25:39.615 [2024-04-16 23:03:30.529316] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1186880) 00:25:39.615 [2024-04-16 23:03:30.529345] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:5728 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:39.615 [2024-04-16 23:03:30.529363] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:25:39.615 [2024-04-16 23:03:30.538235] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1186880) 00:25:39.615 [2024-04-16 23:03:30.538264] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:18816 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:39.615 [2024-04-16 23:03:30.538287] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:25:39.615 [2024-04-16 23:03:30.547047] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1186880) 00:25:39.615 [2024-04-16 23:03:30.547082] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:18592 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:39.615 [2024-04-16 23:03:30.547102] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:25:39.615 [2024-04-16 23:03:30.555683] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1186880) 00:25:39.615 [2024-04-16 23:03:30.555718] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:6496 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:39.615 [2024-04-16 23:03:30.555737] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:25:39.615 [2024-04-16 23:03:30.564269] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1186880) 00:25:39.615 [2024-04-16 23:03:30.564313] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:4288 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:39.615 [2024-04-16 23:03:30.564331] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:25:39.615 [2024-04-16 23:03:30.572926] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1186880) 00:25:39.615 [2024-04-16 23:03:30.572960] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:16288 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:39.615 [2024-04-16 23:03:30.572990] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:25:39.615 [2024-04-16 23:03:30.581535] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1186880) 00:25:39.615 [2024-04-16 23:03:30.581570] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:11328 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:39.615 [2024-04-16 23:03:30.581590] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:25:39.615 [2024-04-16 23:03:30.590312] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1186880) 00:25:39.615 [2024-04-16 23:03:30.590341] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:15904 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:39.615 [2024-04-16 23:03:30.590358] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:25:39.615 [2024-04-16 23:03:30.598935] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1186880) 00:25:39.615 [2024-04-16 23:03:30.598969] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:23232 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:39.615 [2024-04-16 23:03:30.598988] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:25:39.615 [2024-04-16 23:03:30.607516] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1186880) 00:25:39.615 [2024-04-16 23:03:30.607550] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:20384 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:39.615 [2024-04-16 23:03:30.607569] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:25:39.615 [2024-04-16 23:03:30.616138] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1186880) 00:25:39.615 [2024-04-16 23:03:30.616187] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:14176 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:39.615 [2024-04-16 23:03:30.616223] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:25:39.615 [2024-04-16 23:03:30.624800] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1186880) 00:25:39.615 [2024-04-16 23:03:30.624836] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:16800 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:39.615 [2024-04-16 23:03:30.624856] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:25:39.615 [2024-04-16 23:03:30.633474] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1186880) 00:25:39.615 [2024-04-16 23:03:30.633504] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:13152 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:39.615 [2024-04-16 23:03:30.633538] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:25:39.615 [2024-04-16 23:03:30.642073] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1186880) 00:25:39.615 [2024-04-16 23:03:30.642107] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:12928 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:39.615 [2024-04-16 23:03:30.642127] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:25:39.615 [2024-04-16 23:03:30.650820] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1186880) 00:25:39.615 [2024-04-16 23:03:30.650861] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:8192 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:39.615 [2024-04-16 23:03:30.650881] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:25:39.615 [2024-04-16 23:03:30.659495] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1186880) 00:25:39.615 [2024-04-16 23:03:30.659531] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:5984 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:39.615 [2024-04-16 23:03:30.659550] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:25:39.615 [2024-04-16 23:03:30.668131] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1186880) 00:25:39.615 [2024-04-16 23:03:30.668186] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:24544 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:39.615 [2024-04-16 23:03:30.668221] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:25:39.615 [2024-04-16 23:03:30.676821] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1186880) 00:25:39.615 [2024-04-16 23:03:30.676855] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:16032 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:39.615 [2024-04-16 23:03:30.676874] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:25:39.615 [2024-04-16 23:03:30.685497] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1186880) 00:25:39.615 [2024-04-16 23:03:30.685532] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:23104 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:39.615 [2024-04-16 23:03:30.685551] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:25:39.615 [2024-04-16 23:03:30.694080] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1186880) 00:25:39.615 [2024-04-16 23:03:30.694115] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:3328 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:39.615 [2024-04-16 23:03:30.694134] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:25:39.615 [2024-04-16 23:03:30.702811] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1186880) 00:25:39.615 [2024-04-16 23:03:30.702846] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:3968 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:39.616 [2024-04-16 23:03:30.702865] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:25:39.616 [2024-04-16 23:03:30.711338] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1186880) 00:25:39.616 [2024-04-16 23:03:30.711367] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:9408 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:39.616 [2024-04-16 23:03:30.711387] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:25:39.616 [2024-04-16 23:03:30.720095] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1186880) 00:25:39.616 [2024-04-16 23:03:30.720130] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:1152 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:39.616 [2024-04-16 23:03:30.720149] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:25:39.616 [2024-04-16 23:03:30.728834] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1186880) 00:25:39.616 [2024-04-16 23:03:30.728870] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:9824 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:39.616 [2024-04-16 23:03:30.728889] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:25:39.616 [2024-04-16 23:03:30.737375] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1186880) 00:25:39.616 [2024-04-16 23:03:30.737405] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:20320 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:39.616 [2024-04-16 23:03:30.737421] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:25:39.874 [2024-04-16 23:03:30.746096] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1186880) 00:25:39.874 [2024-04-16 23:03:30.746133] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:14272 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:39.874 [2024-04-16 23:03:30.746155] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:25:39.874 [2024-04-16 23:03:30.754905] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1186880) 00:25:39.874 [2024-04-16 23:03:30.754940] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:5856 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:39.874 [2024-04-16 23:03:30.754964] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:25:39.875 [2024-04-16 23:03:30.763437] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1186880) 00:25:39.875 [2024-04-16 23:03:30.763483] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:21792 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:39.875 [2024-04-16 23:03:30.763504] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:25:39.875 [2024-04-16 23:03:30.772149] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1186880) 00:25:39.875 [2024-04-16 23:03:30.772192] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:25312 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:39.875 [2024-04-16 23:03:30.772227] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:25:39.875 [2024-04-16 23:03:30.780840] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1186880) 00:25:39.875 [2024-04-16 23:03:30.780875] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:12320 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:39.875 [2024-04-16 23:03:30.780895] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:25:39.875 [2024-04-16 23:03:30.789542] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1186880) 00:25:39.875 [2024-04-16 23:03:30.789577] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:6016 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:39.875 [2024-04-16 23:03:30.789598] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:25:39.875 [2024-04-16 23:03:30.798222] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1186880) 00:25:39.875 [2024-04-16 23:03:30.798255] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:3264 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:39.875 [2024-04-16 23:03:30.798271] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:25:39.875 [2024-04-16 23:03:30.806839] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1186880) 00:25:39.875 [2024-04-16 23:03:30.806873] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:23264 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:39.875 [2024-04-16 23:03:30.806893] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:25:39.875 [2024-04-16 23:03:30.815407] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1186880) 00:25:39.875 [2024-04-16 23:03:30.815436] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:14496 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:39.875 [2024-04-16 23:03:30.815468] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:25:39.875 [2024-04-16 23:03:30.823980] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1186880) 00:25:39.875 [2024-04-16 23:03:30.824015] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:3712 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:39.875 [2024-04-16 23:03:30.824037] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:25:39.875 [2024-04-16 23:03:30.832465] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1186880) 00:25:39.875 [2024-04-16 23:03:30.832494] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:10048 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:39.875 [2024-04-16 23:03:30.832529] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:25:39.875 [2024-04-16 23:03:30.841196] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1186880) 00:25:39.875 [2024-04-16 23:03:30.841243] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:23200 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:39.875 [2024-04-16 23:03:30.841262] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:25:39.875 [2024-04-16 23:03:30.849822] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1186880) 00:25:39.875 [2024-04-16 23:03:30.849858] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:480 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:39.875 [2024-04-16 23:03:30.849877] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:25:39.875 [2024-04-16 23:03:30.858559] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1186880) 00:25:39.875 [2024-04-16 23:03:30.858594] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:17024 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:39.875 [2024-04-16 23:03:30.858614] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:25:39.875 [2024-04-16 23:03:30.867188] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1186880) 00:25:39.875 [2024-04-16 23:03:30.867234] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:11296 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:39.875 [2024-04-16 23:03:30.867252] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:25:39.875 [2024-04-16 23:03:30.875846] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1186880) 00:25:39.875 [2024-04-16 23:03:30.875881] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:9088 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:39.875 [2024-04-16 23:03:30.875901] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:25:39.875 [2024-04-16 23:03:30.884493] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1186880) 00:25:39.875 [2024-04-16 23:03:30.884529] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:20160 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:39.875 [2024-04-16 23:03:30.884548] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:25:39.875 [2024-04-16 23:03:30.893166] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1186880) 00:25:39.875 [2024-04-16 23:03:30.893224] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:7968 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:39.875 [2024-04-16 23:03:30.893242] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:25:39.875 [2024-04-16 23:03:30.901948] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1186880) 00:25:39.875 [2024-04-16 23:03:30.901983] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:4352 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:39.875 [2024-04-16 23:03:30.902002] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:25:39.875 [2024-04-16 23:03:30.910681] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1186880) 00:25:39.875 [2024-04-16 23:03:30.910716] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:4224 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:39.875 [2024-04-16 23:03:30.910736] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:25:39.875 [2024-04-16 23:03:30.919415] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1186880) 00:25:39.875 [2024-04-16 23:03:30.919444] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:14240 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:39.875 [2024-04-16 23:03:30.919482] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:25:39.875 [2024-04-16 23:03:30.928229] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1186880) 00:25:39.875 [2024-04-16 23:03:30.928259] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:14016 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:39.875 [2024-04-16 23:03:30.928277] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:25:39.875 [2024-04-16 23:03:30.936761] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1186880) 00:25:39.875 [2024-04-16 23:03:30.936797] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:7616 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:39.875 [2024-04-16 23:03:30.936816] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:25:39.875 [2024-04-16 23:03:30.945438] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1186880) 00:25:39.875 [2024-04-16 23:03:30.945478] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:8928 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:39.875 [2024-04-16 23:03:30.945516] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:25:39.875 [2024-04-16 23:03:30.954201] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1186880) 00:25:39.875 [2024-04-16 23:03:30.954246] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:6048 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:39.875 [2024-04-16 23:03:30.954262] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:25:39.875 [2024-04-16 23:03:30.962743] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1186880) 00:25:39.875 [2024-04-16 23:03:30.962778] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:14752 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:39.875 [2024-04-16 23:03:30.962797] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:25:39.875 [2024-04-16 23:03:30.971610] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1186880) 00:25:39.875 [2024-04-16 23:03:30.971644] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:20480 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:39.875 [2024-04-16 23:03:30.971664] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:25:39.875 [2024-04-16 23:03:30.980449] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1186880) 00:25:39.875 [2024-04-16 23:03:30.980493] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:22976 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:39.875 [2024-04-16 23:03:30.980513] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:25:39.875 [2024-04-16 23:03:30.989026] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1186880) 00:25:39.875 [2024-04-16 23:03:30.989059] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:9952 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:39.875 [2024-04-16 23:03:30.989078] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:25:39.875 [2024-04-16 23:03:30.997837] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1186880) 00:25:39.876 [2024-04-16 23:03:30.997872] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:5632 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:39.876 [2024-04-16 23:03:30.997899] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:25:40.157 [2024-04-16 23:03:31.006353] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1186880) 00:25:40.157 [2024-04-16 23:03:31.006395] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:17248 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:40.157 [2024-04-16 23:03:31.006412] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:25:40.157 [2024-04-16 23:03:31.014753] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1186880) 00:25:40.157 [2024-04-16 23:03:31.014784] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:1696 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:40.157 [2024-04-16 23:03:31.014808] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:25:40.157 [2024-04-16 23:03:31.023238] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1186880) 00:25:40.157 [2024-04-16 23:03:31.023273] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:24736 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:40.157 [2024-04-16 23:03:31.023292] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:25:40.157 [2024-04-16 23:03:31.031929] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1186880) 00:25:40.157 [2024-04-16 23:03:31.031964] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:5120 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:40.157 [2024-04-16 23:03:31.031984] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:25:40.157 [2024-04-16 23:03:31.040427] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1186880) 00:25:40.157 [2024-04-16 23:03:31.040473] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:3456 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:40.157 [2024-04-16 23:03:31.040493] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:25:40.157 [2024-04-16 23:03:31.049143] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1186880) 00:25:40.157 [2024-04-16 23:03:31.049189] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:12352 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:40.157 [2024-04-16 23:03:31.049237] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:25:40.157 [2024-04-16 23:03:31.057836] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1186880) 00:25:40.157 [2024-04-16 23:03:31.057871] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:3392 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:40.157 [2024-04-16 23:03:31.057890] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:25:40.157 [2024-04-16 23:03:31.066423] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1186880) 00:25:40.157 [2024-04-16 23:03:31.066453] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:13760 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:40.157 [2024-04-16 23:03:31.066469] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:25:40.157 [2024-04-16 23:03:31.075114] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1186880) 00:25:40.157 [2024-04-16 23:03:31.075150] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:15936 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:40.157 [2024-04-16 23:03:31.075169] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:25:40.157 [2024-04-16 23:03:31.083652] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1186880) 00:25:40.157 [2024-04-16 23:03:31.083689] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:5152 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:40.157 [2024-04-16 23:03:31.083709] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:25:40.157 [2024-04-16 23:03:31.092303] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1186880) 00:25:40.157 [2024-04-16 23:03:31.092333] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:12160 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:40.157 [2024-04-16 23:03:31.092354] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:25:40.157 [2024-04-16 23:03:31.100933] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1186880) 00:25:40.157 [2024-04-16 23:03:31.100968] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:5984 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:40.157 [2024-04-16 23:03:31.100988] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:25:40.157 [2024-04-16 23:03:31.109469] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1186880) 00:25:40.157 [2024-04-16 23:03:31.109515] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:21280 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:40.157 [2024-04-16 23:03:31.109535] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:25:40.157 [2024-04-16 23:03:31.118163] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1186880) 00:25:40.157 [2024-04-16 23:03:31.118221] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:8544 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:40.157 [2024-04-16 23:03:31.118239] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:25:40.157 [2024-04-16 23:03:31.126787] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1186880) 00:25:40.157 [2024-04-16 23:03:31.126823] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:12288 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:40.157 [2024-04-16 23:03:31.126842] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:25:40.157 [2024-04-16 23:03:31.135517] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1186880) 00:25:40.157 [2024-04-16 23:03:31.135561] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:24416 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:40.157 [2024-04-16 23:03:31.135577] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:25:40.157 [2024-04-16 23:03:31.144284] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1186880) 00:25:40.157 [2024-04-16 23:03:31.144313] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:24576 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:40.157 [2024-04-16 23:03:31.144329] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:25:40.158 [2024-04-16 23:03:31.152962] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1186880) 00:25:40.158 [2024-04-16 23:03:31.152998] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:20736 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:40.158 [2024-04-16 23:03:31.153018] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:25:40.158 [2024-04-16 23:03:31.161772] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1186880) 00:25:40.158 [2024-04-16 23:03:31.161807] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:4512 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:40.158 [2024-04-16 23:03:31.161826] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:25:40.158 [2024-04-16 23:03:31.170494] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1186880) 00:25:40.158 [2024-04-16 23:03:31.170548] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:5536 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:40.158 [2024-04-16 23:03:31.170569] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:25:40.158 [2024-04-16 23:03:31.179190] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1186880) 00:25:40.158 [2024-04-16 23:03:31.179224] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:7776 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:40.158 [2024-04-16 23:03:31.179255] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:25:40.158 [2024-04-16 23:03:31.187947] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1186880) 00:25:40.158 [2024-04-16 23:03:31.187982] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:24160 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:40.158 [2024-04-16 23:03:31.188001] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:25:40.158 [2024-04-16 23:03:31.196584] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1186880) 00:25:40.158 [2024-04-16 23:03:31.196620] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:16608 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:40.158 [2024-04-16 23:03:31.196640] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:25:40.158 [2024-04-16 23:03:31.205171] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1186880) 00:25:40.158 [2024-04-16 23:03:31.205228] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:11392 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:40.158 [2024-04-16 23:03:31.205245] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:25:40.158 [2024-04-16 23:03:31.213779] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1186880) 00:25:40.158 [2024-04-16 23:03:31.213814] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:13856 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:40.158 [2024-04-16 23:03:31.213834] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:25:40.158 [2024-04-16 23:03:31.222549] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1186880) 00:25:40.158 [2024-04-16 23:03:31.222579] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:25248 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:40.158 [2024-04-16 23:03:31.222595] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:25:40.158 [2024-04-16 23:03:31.231151] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1186880) 00:25:40.158 [2024-04-16 23:03:31.231196] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:6240 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:40.158 [2024-04-16 23:03:31.231232] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:25:40.158 [2024-04-16 23:03:31.239758] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1186880) 00:25:40.158 [2024-04-16 23:03:31.239793] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:15328 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:40.158 [2024-04-16 23:03:31.239812] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:25:40.158 [2024-04-16 23:03:31.248323] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1186880) 00:25:40.158 [2024-04-16 23:03:31.248352] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:22720 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:40.158 [2024-04-16 23:03:31.248368] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:25:40.158 [2024-04-16 23:03:31.256992] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1186880) 00:25:40.158 [2024-04-16 23:03:31.257028] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:17664 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:40.158 [2024-04-16 23:03:31.257048] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:25:40.158 [2024-04-16 23:03:31.265135] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1186880) 00:25:40.158 [2024-04-16 23:03:31.265185] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:3328 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:40.158 [2024-04-16 23:03:31.265204] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:25:40.419 [2024-04-16 23:03:31.273486] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1186880) 00:25:40.419 [2024-04-16 23:03:31.273533] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:14944 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:40.419 [2024-04-16 23:03:31.273554] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:25:40.419 [2024-04-16 23:03:31.282133] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1186880) 00:25:40.419 [2024-04-16 23:03:31.282169] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:5632 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:40.419 [2024-04-16 23:03:31.282201] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:25:40.419 [2024-04-16 23:03:31.290738] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1186880) 00:25:40.419 [2024-04-16 23:03:31.290774] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:3744 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:40.419 [2024-04-16 23:03:31.290794] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:25:40.419 [2024-04-16 23:03:31.299469] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1186880) 00:25:40.419 [2024-04-16 23:03:31.299499] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:5504 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:40.419 [2024-04-16 23:03:31.299516] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:25:40.419 [2024-04-16 23:03:31.308115] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1186880) 00:25:40.419 [2024-04-16 23:03:31.308151] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:13312 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:40.419 [2024-04-16 23:03:31.308171] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:25:40.419 [2024-04-16 23:03:31.316844] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1186880) 00:25:40.419 [2024-04-16 23:03:31.316879] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:16320 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:40.419 [2024-04-16 23:03:31.316905] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:25:40.419 [2024-04-16 23:03:31.325416] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1186880) 00:25:40.419 [2024-04-16 23:03:31.325461] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:10912 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:40.419 [2024-04-16 23:03:31.325477] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:25:40.419 [2024-04-16 23:03:31.334142] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1186880) 00:25:40.419 [2024-04-16 23:03:31.334186] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:1600 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:40.419 [2024-04-16 23:03:31.334220] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:25:40.419 [2024-04-16 23:03:31.342855] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1186880) 00:25:40.419 [2024-04-16 23:03:31.342891] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:13024 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:40.419 [2024-04-16 23:03:31.342911] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:25:40.419 [2024-04-16 23:03:31.351442] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1186880) 00:25:40.419 [2024-04-16 23:03:31.351471] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:1408 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:40.419 [2024-04-16 23:03:31.351487] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:25:40.419 [2024-04-16 23:03:31.359991] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1186880) 00:25:40.419 [2024-04-16 23:03:31.360027] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:8832 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:40.419 [2024-04-16 23:03:31.360047] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:25:40.420 [2024-04-16 23:03:31.368577] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1186880) 00:25:40.420 [2024-04-16 23:03:31.368614] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:7744 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:40.420 [2024-04-16 23:03:31.368634] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:25:40.420 [2024-04-16 23:03:31.377267] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1186880) 00:25:40.420 [2024-04-16 23:03:31.377297] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:23328 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:40.420 [2024-04-16 23:03:31.377313] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:25:40.420 [2024-04-16 23:03:31.386006] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1186880) 00:25:40.420 [2024-04-16 23:03:31.386041] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:12512 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:40.420 [2024-04-16 23:03:31.386061] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:25:40.420 [2024-04-16 23:03:31.394451] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1186880) 00:25:40.420 [2024-04-16 23:03:31.394487] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:11488 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:40.420 [2024-04-16 23:03:31.394504] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:25:40.420 [2024-04-16 23:03:31.403185] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1186880) 00:25:40.420 [2024-04-16 23:03:31.403233] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:3616 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:40.420 [2024-04-16 23:03:31.403250] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:25:40.420 [2024-04-16 23:03:31.411959] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1186880) 00:25:40.420 [2024-04-16 23:03:31.411995] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:3872 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:40.420 [2024-04-16 23:03:31.412015] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:25:40.420 [2024-04-16 23:03:31.420541] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1186880) 00:25:40.420 [2024-04-16 23:03:31.420577] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:19872 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:40.420 [2024-04-16 23:03:31.420596] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:25:40.420 [2024-04-16 23:03:31.429165] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1186880) 00:25:40.420 [2024-04-16 23:03:31.429225] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:10112 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:40.420 [2024-04-16 23:03:31.429242] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:25:40.420 [2024-04-16 23:03:31.437746] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1186880) 00:25:40.420 [2024-04-16 23:03:31.437783] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:19552 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:40.420 [2024-04-16 23:03:31.437803] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:25:40.420 [2024-04-16 23:03:31.446378] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1186880) 00:25:40.420 [2024-04-16 23:03:31.446408] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:15104 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:40.420 [2024-04-16 23:03:31.446424] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:25:40.420 [2024-04-16 23:03:31.455108] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1186880) 00:25:40.420 [2024-04-16 23:03:31.455144] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:1440 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:40.420 [2024-04-16 23:03:31.455163] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:25:40.420 [2024-04-16 23:03:31.463654] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1186880) 00:25:40.420 [2024-04-16 23:03:31.463690] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:4416 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:40.420 [2024-04-16 23:03:31.463719] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:25:40.420 [2024-04-16 23:03:31.472289] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1186880) 00:25:40.420 [2024-04-16 23:03:31.472319] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:10720 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:40.420 [2024-04-16 23:03:31.472336] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:25:40.420 [2024-04-16 23:03:31.481156] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1186880) 00:25:40.420 [2024-04-16 23:03:31.481203] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:3328 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:40.420 [2024-04-16 23:03:31.481236] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:25:40.420 [2024-04-16 23:03:31.489869] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1186880) 00:25:40.420 [2024-04-16 23:03:31.489898] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:13376 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:40.420 [2024-04-16 23:03:31.489915] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:25:40.420 [2024-04-16 23:03:31.498615] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1186880) 00:25:40.420 [2024-04-16 23:03:31.498651] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:11104 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:40.420 [2024-04-16 23:03:31.498670] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:25:40.420 [2024-04-16 23:03:31.507535] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1186880) 00:25:40.420 [2024-04-16 23:03:31.507585] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:18752 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:40.420 [2024-04-16 23:03:31.507604] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:25:40.420 [2024-04-16 23:03:31.518194] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1186880) 00:25:40.420 [2024-04-16 23:03:31.518241] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:24864 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:40.420 [2024-04-16 23:03:31.518258] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:25:40.420 [2024-04-16 23:03:31.528168] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1186880) 00:25:40.420 [2024-04-16 23:03:31.528226] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:14208 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:40.420 [2024-04-16 23:03:31.528243] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:25:40.420 [2024-04-16 23:03:31.537650] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1186880) 00:25:40.420 [2024-04-16 23:03:31.537685] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:21760 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:40.420 [2024-04-16 23:03:31.537706] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:25:40.681 [2024-04-16 23:03:31.547703] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1186880) 00:25:40.681 [2024-04-16 23:03:31.547745] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:24352 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:40.681 [2024-04-16 23:03:31.547766] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:25:40.681 [2024-04-16 23:03:31.557745] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1186880) 00:25:40.681 [2024-04-16 23:03:31.557796] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:18880 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:40.681 [2024-04-16 23:03:31.557820] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:25:40.681 [2024-04-16 23:03:31.566703] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1186880) 00:25:40.681 [2024-04-16 23:03:31.566755] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:19136 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:40.681 [2024-04-16 23:03:31.566778] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:25:40.681 [2024-04-16 23:03:31.575172] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1186880) 00:25:40.681 [2024-04-16 23:03:31.575230] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:8064 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:40.681 [2024-04-16 23:03:31.575248] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:25:40.681 [2024-04-16 23:03:31.585869] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1186880) 00:25:40.681 [2024-04-16 23:03:31.585906] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:1600 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:40.681 [2024-04-16 23:03:31.585926] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:25:40.681 [2024-04-16 23:03:31.595225] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1186880) 00:25:40.681 [2024-04-16 23:03:31.595255] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:2752 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:40.681 [2024-04-16 23:03:31.595272] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:25:40.681 [2024-04-16 23:03:31.604886] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1186880) 00:25:40.681 [2024-04-16 23:03:31.604922] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:18400 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:40.681 [2024-04-16 23:03:31.604942] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:25:40.681 [2024-04-16 23:03:31.615649] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1186880) 00:25:40.681 [2024-04-16 23:03:31.615701] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:4608 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:40.681 [2024-04-16 23:03:31.615731] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:25:40.681 [2024-04-16 23:03:31.624490] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1186880) 00:25:40.681 [2024-04-16 23:03:31.624534] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:13120 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:40.681 [2024-04-16 23:03:31.624554] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:25:40.681 [2024-04-16 23:03:31.633225] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1186880) 00:25:40.681 [2024-04-16 23:03:31.633256] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:13024 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:40.681 [2024-04-16 23:03:31.633273] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:25:40.681 [2024-04-16 23:03:31.641654] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1186880) 00:25:40.681 [2024-04-16 23:03:31.641690] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:25216 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:40.681 [2024-04-16 23:03:31.641709] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:25:40.681 [2024-04-16 23:03:31.650242] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1186880) 00:25:40.681 [2024-04-16 23:03:31.650273] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:12672 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:40.681 [2024-04-16 23:03:31.650290] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:25:40.681 [2024-04-16 23:03:31.658894] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1186880) 00:25:40.681 [2024-04-16 23:03:31.658930] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:18656 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:40.681 [2024-04-16 23:03:31.658950] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:25:40.681 [2024-04-16 23:03:31.667568] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1186880) 00:25:40.681 [2024-04-16 23:03:31.667604] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:1504 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:40.681 [2024-04-16 23:03:31.667624] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:25:40.681 [2024-04-16 23:03:31.677270] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1186880) 00:25:40.681 [2024-04-16 23:03:31.677307] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:14464 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:40.681 [2024-04-16 23:03:31.677324] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:25:40.681 [2024-04-16 23:03:31.687046] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1186880) 00:25:40.681 [2024-04-16 23:03:31.687082] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:22880 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:40.681 [2024-04-16 23:03:31.687101] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:25:40.681 [2024-04-16 23:03:31.696410] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1186880) 00:25:40.681 [2024-04-16 23:03:31.696441] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:1024 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:40.681 [2024-04-16 23:03:31.696472] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:25:40.681 [2024-04-16 23:03:31.706083] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1186880) 00:25:40.681 [2024-04-16 23:03:31.706119] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:4608 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:40.681 [2024-04-16 23:03:31.706145] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:25:40.681 [2024-04-16 23:03:31.715409] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1186880) 00:25:40.681 [2024-04-16 23:03:31.715439] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:8512 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:40.681 [2024-04-16 23:03:31.715471] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:25:40.681 [2024-04-16 23:03:31.724845] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1186880) 00:25:40.681 [2024-04-16 23:03:31.724882] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:5856 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:40.681 [2024-04-16 23:03:31.724902] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:25:40.681 [2024-04-16 23:03:31.733758] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1186880) 00:25:40.682 [2024-04-16 23:03:31.733795] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:12032 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:40.682 [2024-04-16 23:03:31.733814] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:25:40.682 [2024-04-16 23:03:31.744590] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1186880) 00:25:40.682 [2024-04-16 23:03:31.744627] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:23392 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:40.682 [2024-04-16 23:03:31.744647] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:25:40.682 [2024-04-16 23:03:31.755573] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1186880) 00:25:40.682 [2024-04-16 23:03:31.755610] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:3776 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:40.682 [2024-04-16 23:03:31.755630] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:25:40.682 [2024-04-16 23:03:31.766531] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1186880) 00:25:40.682 [2024-04-16 23:03:31.766568] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:7424 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:40.682 [2024-04-16 23:03:31.766588] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:25:40.682 [2024-04-16 23:03:31.775483] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1186880) 00:25:40.682 [2024-04-16 23:03:31.775519] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:5824 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:40.682 [2024-04-16 23:03:31.775540] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:25:40.682 [2024-04-16 23:03:31.784741] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1186880) 00:25:40.682 [2024-04-16 23:03:31.784777] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:18560 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:40.682 [2024-04-16 23:03:31.784796] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:25:40.682 [2024-04-16 23:03:31.794357] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1186880) 00:25:40.682 [2024-04-16 23:03:31.794387] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:12352 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:40.682 [2024-04-16 23:03:31.794403] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:25:40.682 [2024-04-16 23:03:31.803735] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1186880) 00:25:40.682 [2024-04-16 23:03:31.803771] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:4320 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:40.682 [2024-04-16 23:03:31.803792] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:25:40.941 [2024-04-16 23:03:31.813405] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1186880) 00:25:40.941 [2024-04-16 23:03:31.813436] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:18912 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:40.941 [2024-04-16 23:03:31.813453] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:25:40.941 [2024-04-16 23:03:31.822254] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1186880) 00:25:40.941 [2024-04-16 23:03:31.822284] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:1312 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:40.941 [2024-04-16 23:03:31.822300] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:25:40.941 [2024-04-16 23:03:31.830950] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1186880) 00:25:40.941 [2024-04-16 23:03:31.830985] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:15360 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:40.941 [2024-04-16 23:03:31.831006] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:25:40.941 [2024-04-16 23:03:31.839590] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1186880) 00:25:40.941 [2024-04-16 23:03:31.839626] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:15872 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:40.941 [2024-04-16 23:03:31.839645] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:25:40.941 [2024-04-16 23:03:31.848164] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1186880) 00:25:40.941 [2024-04-16 23:03:31.848223] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:10464 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:40.941 [2024-04-16 23:03:31.848244] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:25:40.941 [2024-04-16 23:03:31.856926] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1186880) 00:25:40.941 [2024-04-16 23:03:31.856962] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:11232 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:40.941 [2024-04-16 23:03:31.856981] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:25:40.941 [2024-04-16 23:03:31.865515] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1186880) 00:25:40.941 [2024-04-16 23:03:31.865560] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:16736 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:40.941 [2024-04-16 23:03:31.865587] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:25:40.941 [2024-04-16 23:03:31.874146] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1186880) 00:25:40.941 [2024-04-16 23:03:31.874191] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:10592 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:40.941 [2024-04-16 23:03:31.874228] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:25:40.941 [2024-04-16 23:03:31.882802] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1186880) 00:25:40.941 [2024-04-16 23:03:31.882836] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:23264 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:40.941 [2024-04-16 23:03:31.882856] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:25:40.941 [2024-04-16 23:03:31.891557] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1186880) 00:25:40.941 [2024-04-16 23:03:31.891592] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:9376 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:40.941 [2024-04-16 23:03:31.891613] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:25:40.941 [2024-04-16 23:03:31.900255] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1186880) 00:25:40.941 [2024-04-16 23:03:31.900285] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:5632 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:40.941 [2024-04-16 23:03:31.900302] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:25:40.941 [2024-04-16 23:03:31.908945] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1186880) 00:25:40.941 [2024-04-16 23:03:31.908980] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:4608 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:40.941 [2024-04-16 23:03:31.909000] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:25:40.941 [2024-04-16 23:03:31.917564] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1186880) 00:25:40.941 [2024-04-16 23:03:31.917600] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:16416 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:40.941 [2024-04-16 23:03:31.917619] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:25:40.941 [2024-04-16 23:03:31.926361] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1186880) 00:25:40.942 [2024-04-16 23:03:31.926390] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:2464 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:40.942 [2024-04-16 23:03:31.926423] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:25:40.942 [2024-04-16 23:03:31.935009] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1186880) 00:25:40.942 [2024-04-16 23:03:31.935043] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:2464 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:40.942 [2024-04-16 23:03:31.935062] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:25:40.942 [2024-04-16 23:03:31.943643] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1186880) 00:25:40.942 [2024-04-16 23:03:31.943684] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:22912 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:40.942 [2024-04-16 23:03:31.943705] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:25:40.942 [2024-04-16 23:03:31.952346] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1186880) 00:25:40.942 [2024-04-16 23:03:31.952377] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:17280 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:40.942 [2024-04-16 23:03:31.952394] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:25:40.942 [2024-04-16 23:03:31.960945] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1186880) 00:25:40.942 [2024-04-16 23:03:31.960981] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:19264 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:40.942 [2024-04-16 23:03:31.961000] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:25:40.942 [2024-04-16 23:03:31.969606] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1186880) 00:25:40.942 [2024-04-16 23:03:31.969641] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:9696 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:40.942 [2024-04-16 23:03:31.969661] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:25:40.942 [2024-04-16 23:03:31.978229] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1186880) 00:25:40.942 [2024-04-16 23:03:31.978259] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:23232 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:40.942 [2024-04-16 23:03:31.978290] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:25:40.942 [2024-04-16 23:03:31.986921] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1186880) 00:25:40.942 [2024-04-16 23:03:31.986956] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:11744 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:40.942 [2024-04-16 23:03:31.986975] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:25:40.942 [2024-04-16 23:03:31.995596] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1186880) 00:25:40.942 [2024-04-16 23:03:31.995631] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:16256 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:40.942 [2024-04-16 23:03:31.995650] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:25:40.942 [2024-04-16 23:03:32.004417] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1186880) 00:25:40.942 [2024-04-16 23:03:32.004446] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:21184 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:40.942 [2024-04-16 23:03:32.004482] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:25:40.942 [2024-04-16 23:03:32.013065] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1186880) 00:25:40.942 [2024-04-16 23:03:32.013101] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:21248 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:40.942 [2024-04-16 23:03:32.013121] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:25:40.942 [2024-04-16 23:03:32.021916] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1186880) 00:25:40.942 [2024-04-16 23:03:32.021952] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:384 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:40.942 [2024-04-16 23:03:32.021971] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:25:40.942 [2024-04-16 23:03:32.030429] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1186880) 00:25:40.942 [2024-04-16 23:03:32.030474] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:24224 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:40.942 [2024-04-16 23:03:32.030491] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:25:40.942 [2024-04-16 23:03:32.038968] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1186880) 00:25:40.942 [2024-04-16 23:03:32.039003] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:13728 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:40.942 [2024-04-16 23:03:32.039023] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:25:40.942 [2024-04-16 23:03:32.047364] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1186880) 00:25:40.942 [2024-04-16 23:03:32.047409] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:11648 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:40.942 [2024-04-16 23:03:32.047432] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:25:40.942 00:25:40.942 Latency(us) 00:25:40.942 Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:25:40.942 Job: nvme0n1 (Core Mask 0x2, workload: randread, depth: 16, IO size: 131072) 00:25:40.942 nvme0n1 : 2.00 3496.85 437.11 0.00 0.00 4570.07 3713.71 12330.48 00:25:40.942 =================================================================================================================== 00:25:40.942 Total : 3496.85 437.11 0.00 0.00 4570.07 3713.71 12330.48 00:25:40.942 0 00:25:40.942 23:03:32 -- host/digest.sh@71 -- # get_transient_errcount nvme0n1 00:25:40.942 23:03:32 -- host/digest.sh@27 -- # bperf_rpc bdev_get_iostat -b nvme0n1 00:25:40.942 23:03:32 -- host/digest.sh@28 -- # jq -r '.bdevs[0] 00:25:40.942 | .driver_specific 00:25:40.942 | .nvme_error 00:25:40.942 | .status_code 00:25:40.942 | .command_transient_transport_error' 00:25:40.942 23:03:32 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock bdev_get_iostat -b nvme0n1 00:25:41.200 23:03:32 -- host/digest.sh@71 -- # (( 226 > 0 )) 00:25:41.200 23:03:32 -- host/digest.sh@73 -- # killprocess 384051 00:25:41.200 23:03:32 -- common/autotest_common.sh@926 -- # '[' -z 384051 ']' 00:25:41.200 23:03:32 -- common/autotest_common.sh@930 -- # kill -0 384051 00:25:41.200 23:03:32 -- common/autotest_common.sh@931 -- # uname 00:25:41.200 23:03:32 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:25:41.200 23:03:32 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 384051 00:25:41.458 23:03:32 -- common/autotest_common.sh@932 -- # process_name=reactor_1 00:25:41.458 23:03:32 -- common/autotest_common.sh@936 -- # '[' reactor_1 = sudo ']' 00:25:41.458 23:03:32 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 384051' 00:25:41.458 killing process with pid 384051 00:25:41.458 23:03:32 -- common/autotest_common.sh@945 -- # kill 384051 00:25:41.458 Received shutdown signal, test time was about 2.000000 seconds 00:25:41.458 00:25:41.458 Latency(us) 00:25:41.458 Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:25:41.458 =================================================================================================================== 00:25:41.458 Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:25:41.458 23:03:32 -- common/autotest_common.sh@950 -- # wait 384051 00:25:41.718 23:03:32 -- host/digest.sh@113 -- # run_bperf_err randwrite 4096 128 00:25:41.718 23:03:32 -- host/digest.sh@54 -- # local rw bs qd 00:25:41.718 23:03:32 -- host/digest.sh@56 -- # rw=randwrite 00:25:41.718 23:03:32 -- host/digest.sh@56 -- # bs=4096 00:25:41.718 23:03:32 -- host/digest.sh@56 -- # qd=128 00:25:41.718 23:03:32 -- host/digest.sh@58 -- # bperfpid=384605 00:25:41.718 23:03:32 -- host/digest.sh@57 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 2 -r /var/tmp/bperf.sock -w randwrite -o 4096 -t 2 -q 128 -z 00:25:41.718 23:03:32 -- host/digest.sh@60 -- # waitforlisten 384605 /var/tmp/bperf.sock 00:25:41.718 23:03:32 -- common/autotest_common.sh@819 -- # '[' -z 384605 ']' 00:25:41.718 23:03:32 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/bperf.sock 00:25:41.718 23:03:32 -- common/autotest_common.sh@824 -- # local max_retries=100 00:25:41.718 23:03:32 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bperf.sock...' 00:25:41.718 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bperf.sock... 00:25:41.718 23:03:32 -- common/autotest_common.sh@828 -- # xtrace_disable 00:25:41.718 23:03:32 -- common/autotest_common.sh@10 -- # set +x 00:25:41.718 [2024-04-16 23:03:32.628395] Starting SPDK v24.01.1-pre git sha1 4b134b4ab / DPDK 23.11.0 initialization... 00:25:41.718 [2024-04-16 23:03:32.628469] [ DPDK EAL parameters: bdevperf --no-shconf -c 2 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid384605 ] 00:25:41.718 EAL: No free 2048 kB hugepages reported on node 1 00:25:41.718 [2024-04-16 23:03:32.688312] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:25:41.718 [2024-04-16 23:03:32.801042] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:25:42.653 23:03:33 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:25:42.653 23:03:33 -- common/autotest_common.sh@852 -- # return 0 00:25:42.653 23:03:33 -- host/digest.sh@61 -- # bperf_rpc bdev_nvme_set_options --nvme-error-stat --bdev-retry-count -1 00:25:42.653 23:03:33 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock bdev_nvme_set_options --nvme-error-stat --bdev-retry-count -1 00:25:42.911 23:03:33 -- host/digest.sh@63 -- # rpc_cmd accel_error_inject_error -o crc32c -t disable 00:25:42.911 23:03:33 -- common/autotest_common.sh@551 -- # xtrace_disable 00:25:42.911 23:03:33 -- common/autotest_common.sh@10 -- # set +x 00:25:42.911 23:03:33 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:25:42.911 23:03:33 -- host/digest.sh@64 -- # bperf_rpc bdev_nvme_attach_controller --ddgst -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -b nvme0 00:25:42.911 23:03:33 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock bdev_nvme_attach_controller --ddgst -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -b nvme0 00:25:43.170 nvme0n1 00:25:43.170 23:03:34 -- host/digest.sh@67 -- # rpc_cmd accel_error_inject_error -o crc32c -t corrupt -i 256 00:25:43.170 23:03:34 -- common/autotest_common.sh@551 -- # xtrace_disable 00:25:43.170 23:03:34 -- common/autotest_common.sh@10 -- # set +x 00:25:43.430 23:03:34 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:25:43.430 23:03:34 -- host/digest.sh@69 -- # bperf_py perform_tests 00:25:43.430 23:03:34 -- host/digest.sh@19 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bperf.sock perform_tests 00:25:43.430 Running I/O for 2 seconds... 00:25:43.430 [2024-04-16 23:03:34.433781] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1229240) with pdu=0x2000190fef90 00:25:43.430 [2024-04-16 23:03:34.434567] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:22580 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:43.430 [2024-04-16 23:03:34.434608] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:43.430 [2024-04-16 23:03:34.447937] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1229240) with pdu=0x2000190fef90 00:25:43.430 [2024-04-16 23:03:34.449016] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:3 nsid:1 lba:6872 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:43.430 [2024-04-16 23:03:34.449051] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:007f p:0 m:0 dnr:0 00:25:43.430 [2024-04-16 23:03:34.462673] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1229240) with pdu=0x2000190ee190 00:25:43.430 [2024-04-16 23:03:34.463460] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:5 nsid:1 lba:14357 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:43.430 [2024-04-16 23:03:34.463490] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:007e p:0 m:0 dnr:0 00:25:43.430 [2024-04-16 23:03:34.476471] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1229240) with pdu=0x2000190f1868 00:25:43.430 [2024-04-16 23:03:34.477146] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:7 nsid:1 lba:11577 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:43.430 [2024-04-16 23:03:34.477184] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:007d p:0 m:0 dnr:0 00:25:43.430 [2024-04-16 23:03:34.490470] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1229240) with pdu=0x2000190df118 00:25:43.430 [2024-04-16 23:03:34.491160] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:9 nsid:1 lba:1979 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:43.430 [2024-04-16 23:03:34.491197] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:007c p:0 m:0 dnr:0 00:25:43.430 [2024-04-16 23:03:34.504956] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1229240) with pdu=0x2000190df118 00:25:43.430 [2024-04-16 23:03:34.505624] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:11 nsid:1 lba:24109 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:43.431 [2024-04-16 23:03:34.505654] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:11 cdw0:0 sqhd:007b p:0 m:0 dnr:0 00:25:43.431 [2024-04-16 23:03:34.519165] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1229240) with pdu=0x2000190f0bc0 00:25:43.431 [2024-04-16 23:03:34.519830] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:13 nsid:1 lba:5736 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:43.431 [2024-04-16 23:03:34.519858] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:13 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:25:43.431 [2024-04-16 23:03:34.533337] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1229240) with pdu=0x2000190f0bc0 00:25:43.431 [2024-04-16 23:03:34.534064] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:15674 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:43.431 [2024-04-16 23:03:34.534097] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0079 p:0 m:0 dnr:0 00:25:43.431 [2024-04-16 23:03:34.546835] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1229240) with pdu=0x2000190f2510 00:25:43.431 [2024-04-16 23:03:34.547554] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:17 nsid:1 lba:13063 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:43.431 [2024-04-16 23:03:34.547587] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:17 cdw0:0 sqhd:0078 p:0 m:0 dnr:0 00:25:43.689 [2024-04-16 23:03:34.561399] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1229240) with pdu=0x2000190f4b08 00:25:43.689 [2024-04-16 23:03:34.562094] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:19 nsid:1 lba:23470 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:43.689 [2024-04-16 23:03:34.562133] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:19 cdw0:0 sqhd:0077 p:0 m:0 dnr:0 00:25:43.690 [2024-04-16 23:03:34.575837] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1229240) with pdu=0x2000190f81e0 00:25:43.690 [2024-04-16 23:03:34.576511] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:18210 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:43.690 [2024-04-16 23:03:34.576545] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0076 p:0 m:0 dnr:0 00:25:43.690 [2024-04-16 23:03:34.589795] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1229240) with pdu=0x2000190fb048 00:25:43.690 [2024-04-16 23:03:34.590449] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:9 nsid:1 lba:8968 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:43.690 [2024-04-16 23:03:34.590479] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0075 p:0 m:0 dnr:0 00:25:43.690 [2024-04-16 23:03:34.603938] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1229240) with pdu=0x2000190e0630 00:25:43.690 [2024-04-16 23:03:34.605016] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:5 nsid:1 lba:4297 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:43.690 [2024-04-16 23:03:34.605049] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0074 p:0 m:0 dnr:0 00:25:43.690 [2024-04-16 23:03:34.618453] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1229240) with pdu=0x2000190e0630 00:25:43.690 [2024-04-16 23:03:34.619209] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:21 nsid:1 lba:20073 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:43.690 [2024-04-16 23:03:34.619256] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:21 cdw0:0 sqhd:0073 p:0 m:0 dnr:0 00:25:43.690 [2024-04-16 23:03:34.632992] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1229240) with pdu=0x2000190df550 00:25:43.690 [2024-04-16 23:03:34.633677] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:13 nsid:1 lba:8075 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:43.690 [2024-04-16 23:03:34.633709] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:13 cdw0:0 sqhd:0072 p:0 m:0 dnr:0 00:25:43.690 [2024-04-16 23:03:34.647569] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1229240) with pdu=0x2000190f3e60 00:25:43.690 [2024-04-16 23:03:34.648205] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:17 nsid:1 lba:17157 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:43.690 [2024-04-16 23:03:34.648258] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:17 cdw0:0 sqhd:0071 p:0 m:0 dnr:0 00:25:43.690 [2024-04-16 23:03:34.663059] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1229240) with pdu=0x2000190fe2e8 00:25:43.690 [2024-04-16 23:03:34.664398] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:5 nsid:1 lba:12383 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:43.690 [2024-04-16 23:03:34.664427] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0070 p:0 m:0 dnr:0 00:25:43.690 [2024-04-16 23:03:34.676102] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1229240) with pdu=0x2000190f0bc0 00:25:43.690 [2024-04-16 23:03:34.677261] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:19350 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:43.690 [2024-04-16 23:03:34.677290] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:007f p:0 m:0 dnr:0 00:25:43.690 [2024-04-16 23:03:34.690883] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1229240) with pdu=0x2000190f81e0 00:25:43.690 [2024-04-16 23:03:34.691705] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:17 nsid:1 lba:19610 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:43.690 [2024-04-16 23:03:34.691738] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:17 cdw0:0 sqhd:006d p:0 m:0 dnr:0 00:25:43.690 [2024-04-16 23:03:34.704042] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1229240) with pdu=0x2000190f1ca0 00:25:43.690 [2024-04-16 23:03:34.705136] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:9 nsid:1 lba:18119 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:43.690 [2024-04-16 23:03:34.705187] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0040 p:0 m:0 dnr:0 00:25:43.690 [2024-04-16 23:03:34.721621] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1229240) with pdu=0x2000190f9b30 00:25:43.690 [2024-04-16 23:03:34.723439] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:124 nsid:1 lba:15321 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:43.690 [2024-04-16 23:03:34.723484] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:124 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:25:43.690 [2024-04-16 23:03:34.735155] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1229240) with pdu=0x2000190e4578 00:25:43.690 [2024-04-16 23:03:34.736441] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:52 nsid:1 lba:2212 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:43.690 [2024-04-16 23:03:34.736472] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:52 cdw0:0 sqhd:007c p:0 m:0 dnr:0 00:25:43.690 [2024-04-16 23:03:34.747922] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1229240) with pdu=0x2000190e8088 00:25:43.690 [2024-04-16 23:03:34.748478] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:54 nsid:1 lba:3319 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:43.690 [2024-04-16 23:03:34.748524] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:54 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:25:43.690 [2024-04-16 23:03:34.765680] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1229240) with pdu=0x2000190f20d8 00:25:43.690 [2024-04-16 23:03:34.766924] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:98 nsid:1 lba:2831 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:43.690 [2024-04-16 23:03:34.766953] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:98 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:25:43.690 [2024-04-16 23:03:34.778188] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1229240) with pdu=0x2000190f1430 00:25:43.690 [2024-04-16 23:03:34.779745] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:17 nsid:1 lba:10743 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:43.690 [2024-04-16 23:03:34.779775] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:17 cdw0:0 sqhd:006b p:0 m:0 dnr:0 00:25:43.690 [2024-04-16 23:03:34.792837] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1229240) with pdu=0x2000190de470 00:25:43.690 [2024-04-16 23:03:34.794505] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:35 nsid:1 lba:12588 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:43.690 [2024-04-16 23:03:34.794535] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:35 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:25:43.690 [2024-04-16 23:03:34.808425] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1229240) with pdu=0x2000190e49b0 00:25:43.690 [2024-04-16 23:03:34.809723] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:112 nsid:1 lba:19193 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:43.690 [2024-04-16 23:03:34.809768] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:112 cdw0:0 sqhd:007d p:0 m:0 dnr:0 00:25:43.950 [2024-04-16 23:03:34.821415] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1229240) with pdu=0x2000190e6738 00:25:43.950 [2024-04-16 23:03:34.822036] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:59 nsid:1 lba:16850 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:43.950 [2024-04-16 23:03:34.822069] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:59 cdw0:0 sqhd:0040 p:0 m:0 dnr:0 00:25:43.950 [2024-04-16 23:03:34.839149] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1229240) with pdu=0x2000190fb480 00:25:43.950 [2024-04-16 23:03:34.840457] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:33 nsid:1 lba:17447 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:43.950 [2024-04-16 23:03:34.840504] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:33 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:43.950 [2024-04-16 23:03:34.851731] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1229240) with pdu=0x2000190e6738 00:25:43.950 [2024-04-16 23:03:34.853397] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:27 nsid:1 lba:16635 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:43.950 [2024-04-16 23:03:34.853426] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:27 cdw0:0 sqhd:006c p:0 m:0 dnr:0 00:25:43.950 [2024-04-16 23:03:34.866446] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1229240) with pdu=0x2000190f7970 00:25:43.950 [2024-04-16 23:03:34.868073] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:49 nsid:1 lba:13992 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:43.950 [2024-04-16 23:03:34.868103] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:49 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:43.950 [2024-04-16 23:03:34.881806] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1229240) with pdu=0x2000190df550 00:25:43.950 [2024-04-16 23:03:34.883090] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:83 nsid:1 lba:24628 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:43.950 [2024-04-16 23:03:34.883136] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:83 cdw0:0 sqhd:007e p:0 m:0 dnr:0 00:25:43.950 [2024-04-16 23:03:34.894876] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1229240) with pdu=0x2000190f1ca0 00:25:43.950 [2024-04-16 23:03:34.895464] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:64 nsid:1 lba:17547 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:43.950 [2024-04-16 23:03:34.895509] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:64 cdw0:0 sqhd:003f p:0 m:0 dnr:0 00:25:43.950 [2024-04-16 23:03:34.912670] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1229240) with pdu=0x2000190f5be8 00:25:43.950 [2024-04-16 23:03:34.913860] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:114 nsid:1 lba:2571 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:43.950 [2024-04-16 23:03:34.913888] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:114 cdw0:0 sqhd:007f p:0 m:0 dnr:0 00:25:43.950 [2024-04-16 23:03:34.925361] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1229240) with pdu=0x2000190fe720 00:25:43.950 [2024-04-16 23:03:34.927019] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:120 nsid:1 lba:13243 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:43.950 [2024-04-16 23:03:34.927065] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:120 cdw0:0 sqhd:006d p:0 m:0 dnr:0 00:25:43.950 [2024-04-16 23:03:34.939701] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1229240) with pdu=0x2000190ea680 00:25:43.950 [2024-04-16 23:03:34.941383] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:122 nsid:1 lba:20615 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:43.950 [2024-04-16 23:03:34.941431] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:122 cdw0:0 sqhd:006c p:0 m:0 dnr:0 00:25:43.950 [2024-04-16 23:03:34.954076] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1229240) with pdu=0x2000190eb328 00:25:43.950 [2024-04-16 23:03:34.955743] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:38 nsid:1 lba:7152 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:43.950 [2024-04-16 23:03:34.955776] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:38 cdw0:0 sqhd:006b p:0 m:0 dnr:0 00:25:43.950 [2024-04-16 23:03:34.967466] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1229240) with pdu=0x2000190e8d30 00:25:43.950 [2024-04-16 23:03:34.968050] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:75 nsid:1 lba:17034 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:43.950 [2024-04-16 23:03:34.968082] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:75 cdw0:0 sqhd:003a p:0 m:0 dnr:0 00:25:43.950 [2024-04-16 23:03:34.983528] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1229240) with pdu=0x2000190e4140 00:25:43.950 [2024-04-16 23:03:34.985415] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:70 nsid:1 lba:7066 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:43.950 [2024-04-16 23:03:34.985460] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:70 cdw0:0 sqhd:007b p:0 m:0 dnr:0 00:25:43.950 [2024-04-16 23:03:34.997742] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1229240) with pdu=0x2000190e4de8 00:25:43.950 [2024-04-16 23:03:34.999591] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:87 nsid:1 lba:5198 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:43.950 [2024-04-16 23:03:34.999624] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:87 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:25:43.950 [2024-04-16 23:03:35.012043] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1229240) with pdu=0x2000190f2510 00:25:43.950 [2024-04-16 23:03:35.013851] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:85 nsid:1 lba:3031 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:43.950 [2024-04-16 23:03:35.013883] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:85 cdw0:0 sqhd:0079 p:0 m:0 dnr:0 00:25:43.951 [2024-04-16 23:03:35.026029] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1229240) with pdu=0x2000190fd640 00:25:43.951 [2024-04-16 23:03:35.027837] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:14 nsid:1 lba:21201 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:43.951 [2024-04-16 23:03:35.027870] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0078 p:0 m:0 dnr:0 00:25:43.951 [2024-04-16 23:03:35.040427] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1229240) with pdu=0x2000190e5a90 00:25:43.951 [2024-04-16 23:03:35.042278] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:123 nsid:1 lba:22365 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:43.951 [2024-04-16 23:03:35.042319] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:123 cdw0:0 sqhd:0077 p:0 m:0 dnr:0 00:25:43.951 [2024-04-16 23:03:35.054628] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1229240) with pdu=0x2000190fd640 00:25:43.951 [2024-04-16 23:03:35.056442] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:6 nsid:1 lba:6719 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:43.951 [2024-04-16 23:03:35.056485] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:0076 p:0 m:0 dnr:0 00:25:43.951 [2024-04-16 23:03:35.068747] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1229240) with pdu=0x2000190e7818 00:25:43.951 [2024-04-16 23:03:35.070560] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:65 nsid:1 lba:8302 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:43.951 [2024-04-16 23:03:35.070592] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:65 cdw0:0 sqhd:0075 p:0 m:0 dnr:0 00:25:44.211 [2024-04-16 23:03:35.081931] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1229240) with pdu=0x2000190f1430 00:25:44.211 [2024-04-16 23:03:35.082569] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:91 nsid:1 lba:14188 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:44.211 [2024-04-16 23:03:35.082595] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:91 cdw0:0 sqhd:003b p:0 m:0 dnr:0 00:25:44.211 [2024-04-16 23:03:35.096158] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1229240) with pdu=0x2000190e5a90 00:25:44.211 [2024-04-16 23:03:35.097354] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:101 nsid:1 lba:458 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:44.211 [2024-04-16 23:03:35.097382] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:101 cdw0:0 sqhd:004a p:0 m:0 dnr:0 00:25:44.211 [2024-04-16 23:03:35.109819] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1229240) with pdu=0x2000190edd58 00:25:44.211 [2024-04-16 23:03:35.111326] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:68 nsid:1 lba:22588 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:44.211 [2024-04-16 23:03:35.111355] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:68 cdw0:0 sqhd:0078 p:0 m:0 dnr:0 00:25:44.211 [2024-04-16 23:03:35.125247] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1229240) with pdu=0x2000190ec408 00:25:44.211 [2024-04-16 23:03:35.126793] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:77 nsid:1 lba:20119 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:44.211 [2024-04-16 23:03:35.126828] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:77 cdw0:0 sqhd:0077 p:0 m:0 dnr:0 00:25:44.211 [2024-04-16 23:03:35.137552] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1229240) with pdu=0x2000190f81e0 00:25:44.211 [2024-04-16 23:03:35.137774] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:47 nsid:1 lba:791 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:44.211 [2024-04-16 23:03:35.137807] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:47 cdw0:0 sqhd:0037 p:0 m:0 dnr:0 00:25:44.211 [2024-04-16 23:03:35.155149] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1229240) with pdu=0x2000190f1ca0 00:25:44.211 [2024-04-16 23:03:35.155948] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:8 nsid:1 lba:24922 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:44.211 [2024-04-16 23:03:35.155977] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0077 p:0 m:0 dnr:0 00:25:44.211 [2024-04-16 23:03:35.167903] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1229240) with pdu=0x2000190ed4e8 00:25:44.211 [2024-04-16 23:03:35.169145] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:122 nsid:1 lba:4441 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:44.211 [2024-04-16 23:03:35.169174] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:122 cdw0:0 sqhd:004b p:0 m:0 dnr:0 00:25:44.211 [2024-04-16 23:03:35.182430] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1229240) with pdu=0x2000190e0630 00:25:44.211 [2024-04-16 23:03:35.183616] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:71 nsid:1 lba:5599 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:44.211 [2024-04-16 23:03:35.183662] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:71 cdw0:0 sqhd:0047 p:0 m:0 dnr:0 00:25:44.211 [2024-04-16 23:03:35.195542] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1229240) with pdu=0x2000190ea680 00:25:44.211 [2024-04-16 23:03:35.196222] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:114 nsid:1 lba:10430 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:44.211 [2024-04-16 23:03:35.196265] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:114 cdw0:0 sqhd:0045 p:0 m:0 dnr:0 00:25:44.211 [2024-04-16 23:03:35.210376] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1229240) with pdu=0x2000190ff3c8 00:25:44.211 [2024-04-16 23:03:35.211987] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:111 nsid:1 lba:563 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:44.211 [2024-04-16 23:03:35.212021] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:111 cdw0:0 sqhd:0074 p:0 m:0 dnr:0 00:25:44.211 [2024-04-16 23:03:35.226204] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1229240) with pdu=0x2000190f0bc0 00:25:44.211 [2024-04-16 23:03:35.227058] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:124 nsid:1 lba:14297 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:44.211 [2024-04-16 23:03:35.227090] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:124 cdw0:0 sqhd:0046 p:0 m:0 dnr:0 00:25:44.211 [2024-04-16 23:03:35.240400] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1229240) with pdu=0x2000190f9b30 00:25:44.211 [2024-04-16 23:03:35.241712] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:41 nsid:1 lba:17032 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:44.211 [2024-04-16 23:03:35.241744] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:41 cdw0:0 sqhd:0055 p:0 m:0 dnr:0 00:25:44.211 [2024-04-16 23:03:35.253293] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1229240) with pdu=0x2000190df988 00:25:44.211 [2024-04-16 23:03:35.254097] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:41 nsid:1 lba:4476 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:44.211 [2024-04-16 23:03:35.254142] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:41 cdw0:0 sqhd:0053 p:0 m:0 dnr:0 00:25:44.211 [2024-04-16 23:03:35.266318] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1229240) with pdu=0x2000190fdeb0 00:25:44.211 [2024-04-16 23:03:35.266450] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:94 nsid:1 lba:8237 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:44.211 [2024-04-16 23:03:35.266492] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:94 cdw0:0 sqhd:0015 p:0 m:0 dnr:0 00:25:44.211 [2024-04-16 23:03:35.283775] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1229240) with pdu=0x2000190fc998 00:25:44.211 [2024-04-16 23:03:35.284600] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:70 nsid:1 lba:17199 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:44.211 [2024-04-16 23:03:35.284634] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:70 cdw0:0 sqhd:0055 p:0 m:0 dnr:0 00:25:44.211 [2024-04-16 23:03:35.296076] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1229240) with pdu=0x2000190f46d0 00:25:44.211 [2024-04-16 23:03:35.297313] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:44 nsid:1 lba:895 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:44.211 [2024-04-16 23:03:35.297340] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:44 cdw0:0 sqhd:0042 p:0 m:0 dnr:0 00:25:44.211 [2024-04-16 23:03:35.310856] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1229240) with pdu=0x2000190f31b8 00:25:44.211 [2024-04-16 23:03:35.311931] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:74 nsid:1 lba:16028 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:44.212 [2024-04-16 23:03:35.311960] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:74 cdw0:0 sqhd:0055 p:0 m:0 dnr:0 00:25:44.212 [2024-04-16 23:03:35.327007] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1229240) with pdu=0x2000190f7970 00:25:44.212 [2024-04-16 23:03:35.328337] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:72 nsid:1 lba:7377 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:44.212 [2024-04-16 23:03:35.328365] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:72 cdw0:0 sqhd:0065 p:0 m:0 dnr:0 00:25:44.472 [2024-04-16 23:03:35.339747] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1229240) with pdu=0x2000190e1f80 00:25:44.472 [2024-04-16 23:03:35.340018] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:30 nsid:1 lba:24064 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:44.472 [2024-04-16 23:03:35.340046] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:30 cdw0:0 sqhd:0042 p:0 m:0 dnr:0 00:25:44.472 [2024-04-16 23:03:35.352765] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1229240) with pdu=0x2000190f6020 00:25:44.472 [2024-04-16 23:03:35.353090] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:76 nsid:1 lba:17509 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:44.472 [2024-04-16 23:03:35.353123] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:76 cdw0:0 sqhd:0012 p:0 m:0 dnr:0 00:25:44.472 [2024-04-16 23:03:35.369723] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1229240) with pdu=0x2000190ebfd0 00:25:44.472 [2024-04-16 23:03:35.371024] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:28 nsid:1 lba:25498 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:44.472 [2024-04-16 23:03:35.371069] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:28 cdw0:0 sqhd:0053 p:0 m:0 dnr:0 00:25:44.472 [2024-04-16 23:03:35.383767] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1229240) with pdu=0x2000190e0630 00:25:44.472 [2024-04-16 23:03:35.385368] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:64 nsid:1 lba:341 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:44.472 [2024-04-16 23:03:35.385397] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:64 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:25:44.472 [2024-04-16 23:03:35.399257] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1229240) with pdu=0x2000190e5220 00:25:44.472 [2024-04-16 23:03:35.400928] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:102 nsid:1 lba:9247 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:44.472 [2024-04-16 23:03:35.400961] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:102 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:44.472 [2024-04-16 23:03:35.411553] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1229240) with pdu=0x2000190f7538 00:25:44.472 [2024-04-16 23:03:35.411830] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:29 nsid:1 lba:16264 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:44.472 [2024-04-16 23:03:35.411857] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:29 cdw0:0 sqhd:0040 p:0 m:0 dnr:0 00:25:44.472 [2024-04-16 23:03:35.428908] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1229240) with pdu=0x2000190e73e0 00:25:44.472 [2024-04-16 23:03:35.429834] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:71 nsid:1 lba:13346 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:44.472 [2024-04-16 23:03:35.429861] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:71 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:44.472 [2024-04-16 23:03:35.442586] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1229240) with pdu=0x2000190fcdd0 00:25:44.472 [2024-04-16 23:03:35.444320] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:117 nsid:1 lba:22688 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:44.472 [2024-04-16 23:03:35.444359] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:117 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:44.472 [2024-04-16 23:03:35.454778] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1229240) with pdu=0x2000190f31b8 00:25:44.472 [2024-04-16 23:03:35.455315] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:26 nsid:1 lba:22670 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:44.472 [2024-04-16 23:03:35.455357] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:26 cdw0:0 sqhd:0051 p:0 m:0 dnr:0 00:25:44.472 [2024-04-16 23:03:35.468468] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1229240) with pdu=0x2000190f46d0 00:25:44.472 [2024-04-16 23:03:35.469687] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:71 nsid:1 lba:6121 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:44.472 [2024-04-16 23:03:35.469720] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:71 cdw0:0 sqhd:0040 p:0 m:0 dnr:0 00:25:44.472 [2024-04-16 23:03:35.486204] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1229240) with pdu=0x2000190e99d8 00:25:44.473 [2024-04-16 23:03:35.488121] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:79 nsid:1 lba:5646 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:44.473 [2024-04-16 23:03:35.488154] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:79 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:25:44.473 [2024-04-16 23:03:35.499331] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1229240) with pdu=0x2000190e6fa8 00:25:44.473 [2024-04-16 23:03:35.500119] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:91 nsid:1 lba:18762 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:44.473 [2024-04-16 23:03:35.500152] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:91 cdw0:0 sqhd:004f p:0 m:0 dnr:0 00:25:44.473 [2024-04-16 23:03:35.511919] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1229240) with pdu=0x2000190fd208 00:25:44.473 [2024-04-16 23:03:35.513107] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:78 nsid:1 lba:25474 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:44.473 [2024-04-16 23:03:35.513140] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:78 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:25:44.473 [2024-04-16 23:03:35.526025] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1229240) with pdu=0x2000190ef270 00:25:44.473 [2024-04-16 23:03:35.527293] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:80 nsid:1 lba:823 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:44.473 [2024-04-16 23:03:35.527335] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:80 cdw0:0 sqhd:0040 p:0 m:0 dnr:0 00:25:44.473 [2024-04-16 23:03:35.540647] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1229240) with pdu=0x2000190eff18 00:25:44.473 [2024-04-16 23:03:35.541835] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:82 nsid:1 lba:22379 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:44.473 [2024-04-16 23:03:35.541869] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:82 cdw0:0 sqhd:003f p:0 m:0 dnr:0 00:25:44.473 [2024-04-16 23:03:35.555152] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1229240) with pdu=0x2000190de038 00:25:44.473 [2024-04-16 23:03:35.556341] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:97 nsid:1 lba:24476 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:44.473 [2024-04-16 23:03:35.556383] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:97 cdw0:0 sqhd:003e p:0 m:0 dnr:0 00:25:44.473 [2024-04-16 23:03:35.569511] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1229240) with pdu=0x2000190df550 00:25:44.473 [2024-04-16 23:03:35.570706] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:62 nsid:1 lba:17502 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:44.473 [2024-04-16 23:03:35.570739] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:62 cdw0:0 sqhd:003d p:0 m:0 dnr:0 00:25:44.473 [2024-04-16 23:03:35.584149] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1229240) with pdu=0x2000190de038 00:25:44.473 [2024-04-16 23:03:35.585354] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:40 nsid:1 lba:22482 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:44.473 [2024-04-16 23:03:35.585382] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:40 cdw0:0 sqhd:003c p:0 m:0 dnr:0 00:25:44.473 [2024-04-16 23:03:35.598557] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1229240) with pdu=0x2000190f81e0 00:25:44.473 [2024-04-16 23:03:35.599705] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:14451 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:44.473 [2024-04-16 23:03:35.599737] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:003b p:0 m:0 dnr:0 00:25:44.732 [2024-04-16 23:03:35.614748] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1229240) with pdu=0x2000190fb048 00:25:44.732 [2024-04-16 23:03:35.615952] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:83 nsid:1 lba:8076 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:44.732 [2024-04-16 23:03:35.615986] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:83 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:25:44.732 [2024-04-16 23:03:35.629117] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1229240) with pdu=0x2000190e5ec8 00:25:44.732 [2024-04-16 23:03:35.630294] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:73 nsid:1 lba:6070 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:44.732 [2024-04-16 23:03:35.630322] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:73 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:44.732 [2024-04-16 23:03:35.643765] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1229240) with pdu=0x2000190f2d80 00:25:44.732 [2024-04-16 23:03:35.644545] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:62 nsid:1 lba:21193 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:44.732 [2024-04-16 23:03:35.644573] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:62 cdw0:0 sqhd:0051 p:0 m:0 dnr:0 00:25:44.732 [2024-04-16 23:03:35.656592] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1229240) with pdu=0x2000190ec840 00:25:44.732 [2024-04-16 23:03:35.657782] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:82 nsid:1 lba:4500 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:44.732 [2024-04-16 23:03:35.657815] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:82 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:25:44.732 [2024-04-16 23:03:35.672104] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1229240) with pdu=0x2000190f5378 00:25:44.732 [2024-04-16 23:03:35.673817] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:116 nsid:1 lba:10946 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:44.732 [2024-04-16 23:03:35.673844] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:116 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:25:44.732 [2024-04-16 23:03:35.688368] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1229240) with pdu=0x2000190efae0 00:25:44.732 [2024-04-16 23:03:35.690314] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:116 nsid:1 lba:5454 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:44.732 [2024-04-16 23:03:35.690358] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:116 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:25:44.732 [2024-04-16 23:03:35.702817] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1229240) with pdu=0x2000190e3d08 00:25:44.732 [2024-04-16 23:03:35.704700] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:58 nsid:1 lba:23004 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:44.732 [2024-04-16 23:03:35.704733] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:58 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:44.732 [2024-04-16 23:03:35.717034] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1229240) with pdu=0x2000190f31b8 00:25:44.732 [2024-04-16 23:03:35.719103] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:24 nsid:1 lba:22887 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:44.732 [2024-04-16 23:03:35.719135] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:24 cdw0:0 sqhd:007f p:0 m:0 dnr:0 00:25:44.732 [2024-04-16 23:03:35.731834] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1229240) with pdu=0x2000190fa3a0 00:25:44.732 [2024-04-16 23:03:35.733701] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:76 nsid:1 lba:1685 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:44.732 [2024-04-16 23:03:35.733735] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:76 cdw0:0 sqhd:007e p:0 m:0 dnr:0 00:25:44.732 [2024-04-16 23:03:35.745525] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1229240) with pdu=0x2000190df988 00:25:44.732 [2024-04-16 23:03:35.747416] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:74 nsid:1 lba:11799 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:44.732 [2024-04-16 23:03:35.747463] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:74 cdw0:0 sqhd:007d p:0 m:0 dnr:0 00:25:44.732 [2024-04-16 23:03:35.760109] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1229240) with pdu=0x2000190e5a90 00:25:44.732 [2024-04-16 23:03:35.761955] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:34 nsid:1 lba:9593 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:44.732 [2024-04-16 23:03:35.761988] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:34 cdw0:0 sqhd:007c p:0 m:0 dnr:0 00:25:44.732 [2024-04-16 23:03:35.774512] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1229240) with pdu=0x2000190eaef0 00:25:44.732 [2024-04-16 23:03:35.776366] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:21 nsid:1 lba:2744 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:44.732 [2024-04-16 23:03:35.776395] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:21 cdw0:0 sqhd:007b p:0 m:0 dnr:0 00:25:44.732 [2024-04-16 23:03:35.788935] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1229240) with pdu=0x2000190fc998 00:25:44.732 [2024-04-16 23:03:35.790765] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:54 nsid:1 lba:2573 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:44.732 [2024-04-16 23:03:35.790798] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:54 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:25:44.732 [2024-04-16 23:03:35.803067] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1229240) with pdu=0x2000190ed920 00:25:44.732 [2024-04-16 23:03:35.804884] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:73 nsid:1 lba:567 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:44.732 [2024-04-16 23:03:35.804929] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:73 cdw0:0 sqhd:0079 p:0 m:0 dnr:0 00:25:44.732 [2024-04-16 23:03:35.817076] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1229240) with pdu=0x2000190eb328 00:25:44.732 [2024-04-16 23:03:35.818934] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:62 nsid:1 lba:18113 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:44.732 [2024-04-16 23:03:35.818974] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:62 cdw0:0 sqhd:0078 p:0 m:0 dnr:0 00:25:44.732 [2024-04-16 23:03:35.831295] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1229240) with pdu=0x2000190de038 00:25:44.732 [2024-04-16 23:03:35.833095] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:124 nsid:1 lba:22147 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:44.733 [2024-04-16 23:03:35.833127] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:124 cdw0:0 sqhd:0077 p:0 m:0 dnr:0 00:25:44.733 [2024-04-16 23:03:35.844977] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1229240) with pdu=0x2000190ebb98 00:25:44.733 [2024-04-16 23:03:35.846712] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:28 nsid:1 lba:21473 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:44.733 [2024-04-16 23:03:35.846744] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:28 cdw0:0 sqhd:0076 p:0 m:0 dnr:0 00:25:44.733 [2024-04-16 23:03:35.858351] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1229240) with pdu=0x2000190e3498 00:25:44.991 [2024-04-16 23:03:35.860014] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:10 nsid:1 lba:769 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:44.991 [2024-04-16 23:03:35.860043] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:10 cdw0:0 sqhd:0075 p:0 m:0 dnr:0 00:25:44.991 [2024-04-16 23:03:35.872339] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1229240) with pdu=0x2000190fbcf0 00:25:44.991 [2024-04-16 23:03:35.873644] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:33 nsid:1 lba:17795 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:44.991 [2024-04-16 23:03:35.873677] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:33 cdw0:0 sqhd:0074 p:0 m:0 dnr:0 00:25:44.991 [2024-04-16 23:03:35.884679] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1229240) with pdu=0x2000190eea00 00:25:44.991 [2024-04-16 23:03:35.884822] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:60 nsid:1 lba:25077 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:44.991 [2024-04-16 23:03:35.884848] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:60 cdw0:0 sqhd:0033 p:0 m:0 dnr:0 00:25:44.991 [2024-04-16 23:03:35.898888] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1229240) with pdu=0x2000190e95a0 00:25:44.991 [2024-04-16 23:03:35.899953] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:75 nsid:1 lba:6265 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:44.991 [2024-04-16 23:03:35.899986] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:75 cdw0:0 sqhd:0033 p:0 m:0 dnr:0 00:25:44.991 [2024-04-16 23:03:35.914580] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1229240) with pdu=0x2000190f2510 00:25:44.991 [2024-04-16 23:03:35.916193] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:20728 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:44.991 [2024-04-16 23:03:35.916236] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0073 p:0 m:0 dnr:0 00:25:44.991 [2024-04-16 23:03:35.931014] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1229240) with pdu=0x2000190ed4e8 00:25:44.991 [2024-04-16 23:03:35.932754] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:19 nsid:1 lba:10815 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:44.991 [2024-04-16 23:03:35.932787] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:19 cdw0:0 sqhd:0073 p:0 m:0 dnr:0 00:25:44.991 [2024-04-16 23:03:35.945022] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1229240) with pdu=0x2000190ddc00 00:25:44.991 [2024-04-16 23:03:35.946786] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:57 nsid:1 lba:19559 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:44.991 [2024-04-16 23:03:35.946825] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:57 cdw0:0 sqhd:0072 p:0 m:0 dnr:0 00:25:44.991 [2024-04-16 23:03:35.959506] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1229240) with pdu=0x2000190e1f80 00:25:44.991 [2024-04-16 23:03:35.961279] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:75 nsid:1 lba:21483 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:44.991 [2024-04-16 23:03:35.961323] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:75 cdw0:0 sqhd:0071 p:0 m:0 dnr:0 00:25:44.991 [2024-04-16 23:03:35.973696] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1229240) with pdu=0x2000190ebfd0 00:25:44.991 [2024-04-16 23:03:35.975433] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:121 nsid:1 lba:6607 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:44.991 [2024-04-16 23:03:35.975461] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:121 cdw0:0 sqhd:0070 p:0 m:0 dnr:0 00:25:44.991 [2024-04-16 23:03:35.988283] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1229240) with pdu=0x2000190f6890 00:25:44.991 [2024-04-16 23:03:35.989988] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:35 nsid:1 lba:12323 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:44.991 [2024-04-16 23:03:35.990022] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:35 cdw0:0 sqhd:006f p:0 m:0 dnr:0 00:25:44.991 [2024-04-16 23:03:36.002654] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1229240) with pdu=0x2000190e23b8 00:25:44.991 [2024-04-16 23:03:36.004406] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:106 nsid:1 lba:4453 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:44.991 [2024-04-16 23:03:36.004450] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:106 cdw0:0 sqhd:006e p:0 m:0 dnr:0 00:25:44.991 [2024-04-16 23:03:36.017263] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1229240) with pdu=0x2000190ebb98 00:25:44.991 [2024-04-16 23:03:36.018934] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:85 nsid:1 lba:6146 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:44.991 [2024-04-16 23:03:36.018967] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:85 cdw0:0 sqhd:006d p:0 m:0 dnr:0 00:25:44.991 [2024-04-16 23:03:36.031466] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1229240) with pdu=0x2000190fb048 00:25:44.991 [2024-04-16 23:03:36.033158] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:48 nsid:1 lba:1643 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:44.991 [2024-04-16 23:03:36.033203] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:48 cdw0:0 sqhd:006c p:0 m:0 dnr:0 00:25:44.991 [2024-04-16 23:03:36.045765] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1229240) with pdu=0x2000190e3498 00:25:44.991 [2024-04-16 23:03:36.047488] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:23 nsid:1 lba:6928 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:44.991 [2024-04-16 23:03:36.047521] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:23 cdw0:0 sqhd:006b p:0 m:0 dnr:0 00:25:44.991 [2024-04-16 23:03:36.059648] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1229240) with pdu=0x2000190f0350 00:25:44.992 [2024-04-16 23:03:36.061324] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:92 nsid:1 lba:2730 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:44.992 [2024-04-16 23:03:36.061351] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:92 cdw0:0 sqhd:006a p:0 m:0 dnr:0 00:25:44.992 [2024-04-16 23:03:36.073609] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1229240) with pdu=0x2000190fb480 00:25:44.992 [2024-04-16 23:03:36.075274] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:107 nsid:1 lba:13874 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:44.992 [2024-04-16 23:03:36.075302] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:107 cdw0:0 sqhd:0069 p:0 m:0 dnr:0 00:25:44.992 [2024-04-16 23:03:36.087226] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1229240) with pdu=0x2000190e3498 00:25:44.992 [2024-04-16 23:03:36.088847] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:53 nsid:1 lba:1247 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:44.992 [2024-04-16 23:03:36.088879] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:53 cdw0:0 sqhd:0068 p:0 m:0 dnr:0 00:25:44.992 [2024-04-16 23:03:36.100803] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1229240) with pdu=0x2000190f3a28 00:25:44.992 [2024-04-16 23:03:36.102374] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:4501 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:44.992 [2024-04-16 23:03:36.102400] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0067 p:0 m:0 dnr:0 00:25:44.992 [2024-04-16 23:03:36.114241] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1229240) with pdu=0x2000190f9b30 00:25:44.992 [2024-04-16 23:03:36.115805] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:56 nsid:1 lba:2597 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:44.992 [2024-04-16 23:03:36.115836] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:56 cdw0:0 sqhd:0066 p:0 m:0 dnr:0 00:25:45.250 [2024-04-16 23:03:36.127555] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1229240) with pdu=0x2000190fac10 00:25:45.250 [2024-04-16 23:03:36.128803] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:42 nsid:1 lba:14756 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:45.250 [2024-04-16 23:03:36.128836] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:42 cdw0:0 sqhd:0065 p:0 m:0 dnr:0 00:25:45.250 [2024-04-16 23:03:36.141656] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1229240) with pdu=0x2000190ebb98 00:25:45.250 [2024-04-16 23:03:36.143230] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:29 nsid:1 lba:23149 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:45.250 [2024-04-16 23:03:36.143259] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:29 cdw0:0 sqhd:0076 p:0 m:0 dnr:0 00:25:45.250 [2024-04-16 23:03:36.156631] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1229240) with pdu=0x2000190ed920 00:25:45.250 [2024-04-16 23:03:36.157351] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:69 nsid:1 lba:15090 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:45.250 [2024-04-16 23:03:36.157378] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:69 cdw0:0 sqhd:0063 p:0 m:0 dnr:0 00:25:45.250 [2024-04-16 23:03:36.170999] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1229240) with pdu=0x2000190f4f40 00:25:45.250 [2024-04-16 23:03:36.171565] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:125 nsid:1 lba:1004 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:45.250 [2024-04-16 23:03:36.171592] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:125 cdw0:0 sqhd:0062 p:0 m:0 dnr:0 00:25:45.251 [2024-04-16 23:03:36.184933] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1229240) with pdu=0x2000190e88f8 00:25:45.251 [2024-04-16 23:03:36.186429] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:18 nsid:1 lba:8496 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:45.251 [2024-04-16 23:03:36.186460] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:18 cdw0:0 sqhd:0062 p:0 m:0 dnr:0 00:25:45.251 [2024-04-16 23:03:36.198512] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1229240) with pdu=0x2000190f7970 00:25:45.251 [2024-04-16 23:03:36.199151] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:51 nsid:1 lba:18827 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:45.251 [2024-04-16 23:03:36.199189] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:51 cdw0:0 sqhd:0032 p:0 m:0 dnr:0 00:25:45.251 [2024-04-16 23:03:36.213486] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1229240) with pdu=0x2000190eff18 00:25:45.251 [2024-04-16 23:03:36.214962] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:101 nsid:1 lba:4374 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:45.251 [2024-04-16 23:03:36.214991] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:101 cdw0:0 sqhd:0070 p:0 m:0 dnr:0 00:25:45.251 [2024-04-16 23:03:36.227570] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1229240) with pdu=0x2000190f0788 00:25:45.251 [2024-04-16 23:03:36.228184] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:32 nsid:1 lba:18511 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:45.251 [2024-04-16 23:03:36.228217] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:32 cdw0:0 sqhd:006f p:0 m:0 dnr:0 00:25:45.251 [2024-04-16 23:03:36.241432] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1229240) with pdu=0x2000190e0ea0 00:25:45.251 [2024-04-16 23:03:36.242010] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:33 nsid:1 lba:19804 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:45.251 [2024-04-16 23:03:36.242042] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:33 cdw0:0 sqhd:006e p:0 m:0 dnr:0 00:25:45.251 [2024-04-16 23:03:36.255398] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1229240) with pdu=0x2000190f2948 00:25:45.251 [2024-04-16 23:03:36.255889] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:28 nsid:1 lba:5082 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:45.251 [2024-04-16 23:03:36.255916] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:28 cdw0:0 sqhd:006d p:0 m:0 dnr:0 00:25:45.251 [2024-04-16 23:03:36.269266] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1229240) with pdu=0x2000190fa3a0 00:25:45.251 [2024-04-16 23:03:36.269714] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:37 nsid:1 lba:24224 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:45.251 [2024-04-16 23:03:36.269756] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:37 cdw0:0 sqhd:006c p:0 m:0 dnr:0 00:25:45.251 [2024-04-16 23:03:36.283403] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1229240) with pdu=0x2000190fb480 00:25:45.251 [2024-04-16 23:03:36.283916] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:26 nsid:1 lba:24009 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:45.251 [2024-04-16 23:03:36.283947] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:26 cdw0:0 sqhd:006b p:0 m:0 dnr:0 00:25:45.251 [2024-04-16 23:03:36.297633] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1229240) with pdu=0x2000190f5378 00:25:45.251 [2024-04-16 23:03:36.298060] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:47 nsid:1 lba:6752 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:45.251 [2024-04-16 23:03:36.298101] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:47 cdw0:0 sqhd:006a p:0 m:0 dnr:0 00:25:45.251 [2024-04-16 23:03:36.312038] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1229240) with pdu=0x2000190e88f8 00:25:45.251 [2024-04-16 23:03:36.312476] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:81 nsid:1 lba:21551 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:45.251 [2024-04-16 23:03:36.312518] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:81 cdw0:0 sqhd:0069 p:0 m:0 dnr:0 00:25:45.251 [2024-04-16 23:03:36.326367] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1229240) with pdu=0x2000190e0ea0 00:25:45.251 [2024-04-16 23:03:36.326785] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:27 nsid:1 lba:22753 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:45.251 [2024-04-16 23:03:36.326812] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:27 cdw0:0 sqhd:0068 p:0 m:0 dnr:0 00:25:45.251 [2024-04-16 23:03:36.340566] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1229240) with pdu=0x2000190fc560 00:25:45.251 [2024-04-16 23:03:36.340965] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:78 nsid:1 lba:14083 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:45.251 [2024-04-16 23:03:36.340993] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:78 cdw0:0 sqhd:0067 p:0 m:0 dnr:0 00:25:45.251 [2024-04-16 23:03:36.354941] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1229240) with pdu=0x2000190e95a0 00:25:45.251 [2024-04-16 23:03:36.355328] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:71 nsid:1 lba:6692 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:45.251 [2024-04-16 23:03:36.355366] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:71 cdw0:0 sqhd:0066 p:0 m:0 dnr:0 00:25:45.251 [2024-04-16 23:03:36.369541] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1229240) with pdu=0x2000190ec408 00:25:45.251 [2024-04-16 23:03:36.369898] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:44 nsid:1 lba:19597 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:45.251 [2024-04-16 23:03:36.369925] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:44 cdw0:0 sqhd:0065 p:0 m:0 dnr:0 00:25:45.508 [2024-04-16 23:03:36.385381] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1229240) with pdu=0x2000190e4de8 00:25:45.508 [2024-04-16 23:03:36.386410] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:96 nsid:1 lba:471 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:45.508 [2024-04-16 23:03:36.386437] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:96 cdw0:0 sqhd:0064 p:0 m:0 dnr:0 00:25:45.509 [2024-04-16 23:03:36.399917] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1229240) with pdu=0x2000190f4b08 00:25:45.509 [2024-04-16 23:03:36.401398] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:126 nsid:1 lba:1242 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:45.509 [2024-04-16 23:03:36.401425] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:126 cdw0:0 sqhd:0073 p:0 m:0 dnr:0 00:25:45.509 [2024-04-16 23:03:36.411424] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1229240) with pdu=0x2000190fef90 00:25:45.509 [2024-04-16 23:03:36.412754] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:48 nsid:1 lba:23104 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:45.509 [2024-04-16 23:03:36.412787] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:48 cdw0:0 sqhd:0060 p:0 m:0 dnr:0 00:25:45.509 00:25:45.509 Latency(us) 00:25:45.509 Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:25:45.509 Job: nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:25:45.509 nvme0n1 : 2.01 17795.13 69.51 0.00 0.00 7182.75 4344.79 17767.54 00:25:45.509 =================================================================================================================== 00:25:45.509 Total : 17795.13 69.51 0.00 0.00 7182.75 4344.79 17767.54 00:25:45.509 0 00:25:45.509 23:03:36 -- host/digest.sh@71 -- # get_transient_errcount nvme0n1 00:25:45.509 23:03:36 -- host/digest.sh@27 -- # bperf_rpc bdev_get_iostat -b nvme0n1 00:25:45.509 23:03:36 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock bdev_get_iostat -b nvme0n1 00:25:45.509 23:03:36 -- host/digest.sh@28 -- # jq -r '.bdevs[0] 00:25:45.509 | .driver_specific 00:25:45.509 | .nvme_error 00:25:45.509 | .status_code 00:25:45.509 | .command_transient_transport_error' 00:25:45.767 23:03:36 -- host/digest.sh@71 -- # (( 139 > 0 )) 00:25:45.767 23:03:36 -- host/digest.sh@73 -- # killprocess 384605 00:25:45.767 23:03:36 -- common/autotest_common.sh@926 -- # '[' -z 384605 ']' 00:25:45.767 23:03:36 -- common/autotest_common.sh@930 -- # kill -0 384605 00:25:45.767 23:03:36 -- common/autotest_common.sh@931 -- # uname 00:25:45.767 23:03:36 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:25:45.767 23:03:36 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 384605 00:25:45.767 23:03:36 -- common/autotest_common.sh@932 -- # process_name=reactor_1 00:25:45.767 23:03:36 -- common/autotest_common.sh@936 -- # '[' reactor_1 = sudo ']' 00:25:45.767 23:03:36 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 384605' 00:25:45.767 killing process with pid 384605 00:25:45.767 23:03:36 -- common/autotest_common.sh@945 -- # kill 384605 00:25:45.767 Received shutdown signal, test time was about 2.000000 seconds 00:25:45.767 00:25:45.767 Latency(us) 00:25:45.767 Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:25:45.767 =================================================================================================================== 00:25:45.767 Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:25:45.767 23:03:36 -- common/autotest_common.sh@950 -- # wait 384605 00:25:46.027 23:03:36 -- host/digest.sh@114 -- # run_bperf_err randwrite 131072 16 00:25:46.027 23:03:36 -- host/digest.sh@54 -- # local rw bs qd 00:25:46.027 23:03:36 -- host/digest.sh@56 -- # rw=randwrite 00:25:46.027 23:03:36 -- host/digest.sh@56 -- # bs=131072 00:25:46.027 23:03:36 -- host/digest.sh@56 -- # qd=16 00:25:46.027 23:03:36 -- host/digest.sh@58 -- # bperfpid=385042 00:25:46.027 23:03:36 -- host/digest.sh@57 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 2 -r /var/tmp/bperf.sock -w randwrite -o 131072 -t 2 -q 16 -z 00:25:46.027 23:03:36 -- host/digest.sh@60 -- # waitforlisten 385042 /var/tmp/bperf.sock 00:25:46.027 23:03:36 -- common/autotest_common.sh@819 -- # '[' -z 385042 ']' 00:25:46.027 23:03:36 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/bperf.sock 00:25:46.027 23:03:36 -- common/autotest_common.sh@824 -- # local max_retries=100 00:25:46.027 23:03:36 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bperf.sock...' 00:25:46.027 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bperf.sock... 00:25:46.027 23:03:36 -- common/autotest_common.sh@828 -- # xtrace_disable 00:25:46.027 23:03:36 -- common/autotest_common.sh@10 -- # set +x 00:25:46.027 [2024-04-16 23:03:37.014132] Starting SPDK v24.01.1-pre git sha1 4b134b4ab / DPDK 23.11.0 initialization... 00:25:46.027 [2024-04-16 23:03:37.014245] [ DPDK EAL parameters: bdevperf --no-shconf -c 2 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid385042 ] 00:25:46.027 I/O size of 131072 is greater than zero copy threshold (65536). 00:25:46.027 Zero copy mechanism will not be used. 00:25:46.027 EAL: No free 2048 kB hugepages reported on node 1 00:25:46.027 [2024-04-16 23:03:37.075833] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:25:46.287 [2024-04-16 23:03:37.186548] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:25:46.853 23:03:37 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:25:46.853 23:03:37 -- common/autotest_common.sh@852 -- # return 0 00:25:46.853 23:03:37 -- host/digest.sh@61 -- # bperf_rpc bdev_nvme_set_options --nvme-error-stat --bdev-retry-count -1 00:25:46.853 23:03:37 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock bdev_nvme_set_options --nvme-error-stat --bdev-retry-count -1 00:25:47.111 23:03:38 -- host/digest.sh@63 -- # rpc_cmd accel_error_inject_error -o crc32c -t disable 00:25:47.111 23:03:38 -- common/autotest_common.sh@551 -- # xtrace_disable 00:25:47.111 23:03:38 -- common/autotest_common.sh@10 -- # set +x 00:25:47.111 23:03:38 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:25:47.111 23:03:38 -- host/digest.sh@64 -- # bperf_rpc bdev_nvme_attach_controller --ddgst -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -b nvme0 00:25:47.111 23:03:38 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock bdev_nvme_attach_controller --ddgst -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -b nvme0 00:25:47.681 nvme0n1 00:25:47.681 23:03:38 -- host/digest.sh@67 -- # rpc_cmd accel_error_inject_error -o crc32c -t corrupt -i 32 00:25:47.681 23:03:38 -- common/autotest_common.sh@551 -- # xtrace_disable 00:25:47.681 23:03:38 -- common/autotest_common.sh@10 -- # set +x 00:25:47.681 23:03:38 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:25:47.681 23:03:38 -- host/digest.sh@69 -- # bperf_py perform_tests 00:25:47.681 23:03:38 -- host/digest.sh@19 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bperf.sock perform_tests 00:25:47.681 I/O size of 131072 is greater than zero copy threshold (65536). 00:25:47.681 Zero copy mechanism will not be used. 00:25:47.681 Running I/O for 2 seconds... 00:25:47.681 [2024-04-16 23:03:38.629790] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x12293e0) with pdu=0x2000190fef90 00:25:47.681 [2024-04-16 23:03:38.630133] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:24544 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:47.681 [2024-04-16 23:03:38.630185] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:25:47.681 [2024-04-16 23:03:38.638789] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x12293e0) with pdu=0x2000190fef90 00:25:47.681 [2024-04-16 23:03:38.638991] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:25536 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:47.681 [2024-04-16 23:03:38.639024] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:25:47.681 [2024-04-16 23:03:38.647917] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x12293e0) with pdu=0x2000190fef90 00:25:47.681 [2024-04-16 23:03:38.648142] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:12352 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:47.681 [2024-04-16 23:03:38.648181] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:25:47.681 [2024-04-16 23:03:38.656931] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x12293e0) with pdu=0x2000190fef90 00:25:47.681 [2024-04-16 23:03:38.657142] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:10304 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:47.681 [2024-04-16 23:03:38.657170] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:25:47.681 [2024-04-16 23:03:38.665359] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x12293e0) with pdu=0x2000190fef90 00:25:47.681 [2024-04-16 23:03:38.665729] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:20608 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:47.681 [2024-04-16 23:03:38.665763] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:25:47.681 [2024-04-16 23:03:38.674368] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x12293e0) with pdu=0x2000190fef90 00:25:47.681 [2024-04-16 23:03:38.674598] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:1056 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:47.681 [2024-04-16 23:03:38.674652] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:25:47.681 [2024-04-16 23:03:38.684262] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x12293e0) with pdu=0x2000190fef90 00:25:47.681 [2024-04-16 23:03:38.684481] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:16000 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:47.681 [2024-04-16 23:03:38.684512] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:25:47.681 [2024-04-16 23:03:38.694325] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x12293e0) with pdu=0x2000190fef90 00:25:47.681 [2024-04-16 23:03:38.694636] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:16224 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:47.681 [2024-04-16 23:03:38.694671] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:25:47.681 [2024-04-16 23:03:38.703589] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x12293e0) with pdu=0x2000190fef90 00:25:47.681 [2024-04-16 23:03:38.703826] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:6144 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:47.681 [2024-04-16 23:03:38.703860] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:25:47.681 [2024-04-16 23:03:38.713355] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x12293e0) with pdu=0x2000190fef90 00:25:47.681 [2024-04-16 23:03:38.713606] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:5536 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:47.681 [2024-04-16 23:03:38.713639] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:25:47.681 [2024-04-16 23:03:38.722397] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x12293e0) with pdu=0x2000190fef90 00:25:47.681 [2024-04-16 23:03:38.722647] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:20896 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:47.681 [2024-04-16 23:03:38.722680] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:25:47.681 [2024-04-16 23:03:38.731062] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x12293e0) with pdu=0x2000190fef90 00:25:47.681 [2024-04-16 23:03:38.731245] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:6016 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:47.681 [2024-04-16 23:03:38.731273] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:25:47.681 [2024-04-16 23:03:38.740196] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x12293e0) with pdu=0x2000190fef90 00:25:47.681 [2024-04-16 23:03:38.740430] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:24576 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:47.681 [2024-04-16 23:03:38.740460] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:25:47.681 [2024-04-16 23:03:38.748999] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x12293e0) with pdu=0x2000190fef90 00:25:47.681 [2024-04-16 23:03:38.749337] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:9568 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:47.681 [2024-04-16 23:03:38.749367] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:25:47.681 [2024-04-16 23:03:38.758570] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x12293e0) with pdu=0x2000190fef90 00:25:47.681 [2024-04-16 23:03:38.758927] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:5632 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:47.681 [2024-04-16 23:03:38.758961] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:25:47.681 [2024-04-16 23:03:38.769704] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x12293e0) with pdu=0x2000190fef90 00:25:47.681 [2024-04-16 23:03:38.769974] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:5248 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:47.681 [2024-04-16 23:03:38.770009] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:25:47.681 [2024-04-16 23:03:38.778853] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x12293e0) with pdu=0x2000190fef90 00:25:47.681 [2024-04-16 23:03:38.779272] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:928 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:47.681 [2024-04-16 23:03:38.779304] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:25:47.681 [2024-04-16 23:03:38.788760] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x12293e0) with pdu=0x2000190fef90 00:25:47.681 [2024-04-16 23:03:38.789012] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:544 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:47.681 [2024-04-16 23:03:38.789045] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:25:47.681 [2024-04-16 23:03:38.798010] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x12293e0) with pdu=0x2000190fef90 00:25:47.681 [2024-04-16 23:03:38.798241] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:22112 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:47.681 [2024-04-16 23:03:38.798270] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:25:47.681 [2024-04-16 23:03:38.806793] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x12293e0) with pdu=0x2000190fef90 00:25:47.681 [2024-04-16 23:03:38.807032] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:19552 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:47.682 [2024-04-16 23:03:38.807065] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:25:47.942 [2024-04-16 23:03:38.815540] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x12293e0) with pdu=0x2000190fef90 00:25:47.942 [2024-04-16 23:03:38.815828] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:2208 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:47.942 [2024-04-16 23:03:38.815861] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:25:47.942 [2024-04-16 23:03:38.824720] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x12293e0) with pdu=0x2000190fef90 00:25:47.942 [2024-04-16 23:03:38.824944] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:8448 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:47.942 [2024-04-16 23:03:38.824977] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:25:47.942 [2024-04-16 23:03:38.834480] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x12293e0) with pdu=0x2000190fef90 00:25:47.942 [2024-04-16 23:03:38.834774] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:6848 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:47.942 [2024-04-16 23:03:38.834807] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:25:47.942 [2024-04-16 23:03:38.843904] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x12293e0) with pdu=0x2000190fef90 00:25:47.942 [2024-04-16 23:03:38.844173] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:16096 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:47.942 [2024-04-16 23:03:38.844230] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:25:47.942 [2024-04-16 23:03:38.853011] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x12293e0) with pdu=0x2000190fef90 00:25:47.942 [2024-04-16 23:03:38.853312] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:7744 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:47.942 [2024-04-16 23:03:38.853343] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:25:47.942 [2024-04-16 23:03:38.861737] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x12293e0) with pdu=0x2000190fef90 00:25:47.942 [2024-04-16 23:03:38.862036] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:16576 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:47.942 [2024-04-16 23:03:38.862070] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:25:47.942 [2024-04-16 23:03:38.871559] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x12293e0) with pdu=0x2000190fef90 00:25:47.942 [2024-04-16 23:03:38.871728] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:19968 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:47.942 [2024-04-16 23:03:38.871759] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:25:47.942 [2024-04-16 23:03:38.879439] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x12293e0) with pdu=0x2000190fef90 00:25:47.942 [2024-04-16 23:03:38.879729] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:2624 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:47.942 [2024-04-16 23:03:38.879762] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:25:47.942 [2024-04-16 23:03:38.889618] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x12293e0) with pdu=0x2000190fef90 00:25:47.942 [2024-04-16 23:03:38.889930] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:8704 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:47.942 [2024-04-16 23:03:38.889961] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:25:47.942 [2024-04-16 23:03:38.898912] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x12293e0) with pdu=0x2000190fef90 00:25:47.942 [2024-04-16 23:03:38.899187] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:2688 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:47.942 [2024-04-16 23:03:38.899234] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:25:47.942 [2024-04-16 23:03:38.907802] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x12293e0) with pdu=0x2000190fef90 00:25:47.942 [2024-04-16 23:03:38.908076] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:13344 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:47.942 [2024-04-16 23:03:38.908110] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:25:47.942 [2024-04-16 23:03:38.917272] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x12293e0) with pdu=0x2000190fef90 00:25:47.942 [2024-04-16 23:03:38.917523] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:17920 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:47.942 [2024-04-16 23:03:38.917565] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:25:47.942 [2024-04-16 23:03:38.926431] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x12293e0) with pdu=0x2000190fef90 00:25:47.942 [2024-04-16 23:03:38.926756] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:9024 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:47.942 [2024-04-16 23:03:38.926789] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:25:47.942 [2024-04-16 23:03:38.935914] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x12293e0) with pdu=0x2000190fef90 00:25:47.942 [2024-04-16 23:03:38.936184] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:14624 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:47.942 [2024-04-16 23:03:38.936230] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:25:47.942 [2024-04-16 23:03:38.944840] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x12293e0) with pdu=0x2000190fef90 00:25:47.942 [2024-04-16 23:03:38.945046] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:25568 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:47.942 [2024-04-16 23:03:38.945076] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:25:47.942 [2024-04-16 23:03:38.952621] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x12293e0) with pdu=0x2000190fef90 00:25:47.943 [2024-04-16 23:03:38.952836] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:21664 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:47.943 [2024-04-16 23:03:38.952878] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:25:47.943 [2024-04-16 23:03:38.961392] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x12293e0) with pdu=0x2000190fef90 00:25:47.943 [2024-04-16 23:03:38.961615] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:8032 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:47.943 [2024-04-16 23:03:38.961646] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:25:47.943 [2024-04-16 23:03:38.970344] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x12293e0) with pdu=0x2000190fef90 00:25:47.943 [2024-04-16 23:03:38.970645] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:13696 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:47.943 [2024-04-16 23:03:38.970675] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:25:47.943 [2024-04-16 23:03:38.980064] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x12293e0) with pdu=0x2000190fef90 00:25:47.943 [2024-04-16 23:03:38.980335] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:4512 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:47.943 [2024-04-16 23:03:38.980366] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:25:47.943 [2024-04-16 23:03:38.989562] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x12293e0) with pdu=0x2000190fef90 00:25:47.943 [2024-04-16 23:03:38.989922] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:23936 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:47.943 [2024-04-16 23:03:38.989956] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:25:47.943 [2024-04-16 23:03:38.998757] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x12293e0) with pdu=0x2000190fef90 00:25:47.943 [2024-04-16 23:03:38.999028] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:22048 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:47.943 [2024-04-16 23:03:38.999062] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:25:47.943 [2024-04-16 23:03:39.008467] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x12293e0) with pdu=0x2000190fef90 00:25:47.943 [2024-04-16 23:03:39.008774] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:19040 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:47.943 [2024-04-16 23:03:39.008807] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:25:47.943 [2024-04-16 23:03:39.017651] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x12293e0) with pdu=0x2000190fef90 00:25:47.943 [2024-04-16 23:03:39.017830] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:6048 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:47.943 [2024-04-16 23:03:39.017861] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:25:47.943 [2024-04-16 23:03:39.026111] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x12293e0) with pdu=0x2000190fef90 00:25:47.943 [2024-04-16 23:03:39.026325] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:6912 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:47.943 [2024-04-16 23:03:39.026355] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:25:47.943 [2024-04-16 23:03:39.036093] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x12293e0) with pdu=0x2000190fef90 00:25:47.943 [2024-04-16 23:03:39.036326] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:21696 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:47.943 [2024-04-16 23:03:39.036355] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:25:47.943 [2024-04-16 23:03:39.045255] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x12293e0) with pdu=0x2000190fef90 00:25:47.943 [2024-04-16 23:03:39.045486] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:7488 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:47.943 [2024-04-16 23:03:39.045515] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:25:47.943 [2024-04-16 23:03:39.053866] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x12293e0) with pdu=0x2000190fef90 00:25:47.943 [2024-04-16 23:03:39.054152] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:25248 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:47.943 [2024-04-16 23:03:39.054193] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:25:47.943 [2024-04-16 23:03:39.063114] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x12293e0) with pdu=0x2000190fef90 00:25:47.943 [2024-04-16 23:03:39.063474] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:21728 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:47.943 [2024-04-16 23:03:39.063505] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:25:48.203 [2024-04-16 23:03:39.070646] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x12293e0) with pdu=0x2000190fef90 00:25:48.203 [2024-04-16 23:03:39.070930] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:8864 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.203 [2024-04-16 23:03:39.070966] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:25:48.203 [2024-04-16 23:03:39.079222] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x12293e0) with pdu=0x2000190fef90 00:25:48.203 [2024-04-16 23:03:39.079393] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:5248 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.203 [2024-04-16 23:03:39.079422] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:25:48.203 [2024-04-16 23:03:39.088422] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x12293e0) with pdu=0x2000190fef90 00:25:48.203 [2024-04-16 23:03:39.088719] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:1216 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.203 [2024-04-16 23:03:39.088752] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:25:48.203 [2024-04-16 23:03:39.097467] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x12293e0) with pdu=0x2000190fef90 00:25:48.203 [2024-04-16 23:03:39.097698] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:20704 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.203 [2024-04-16 23:03:39.097731] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:25:48.203 [2024-04-16 23:03:39.105801] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x12293e0) with pdu=0x2000190fef90 00:25:48.203 [2024-04-16 23:03:39.106074] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:10560 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.203 [2024-04-16 23:03:39.106106] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:25:48.203 [2024-04-16 23:03:39.115697] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x12293e0) with pdu=0x2000190fef90 00:25:48.203 [2024-04-16 23:03:39.115995] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:24960 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.203 [2024-04-16 23:03:39.116029] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:25:48.203 [2024-04-16 23:03:39.125121] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x12293e0) with pdu=0x2000190fef90 00:25:48.203 [2024-04-16 23:03:39.125290] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:16064 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.203 [2024-04-16 23:03:39.125320] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:25:48.203 [2024-04-16 23:03:39.134290] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x12293e0) with pdu=0x2000190fef90 00:25:48.203 [2024-04-16 23:03:39.134583] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:18272 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.203 [2024-04-16 23:03:39.134616] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:25:48.203 [2024-04-16 23:03:39.143196] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x12293e0) with pdu=0x2000190fef90 00:25:48.203 [2024-04-16 23:03:39.143491] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:16384 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.203 [2024-04-16 23:03:39.143523] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:25:48.203 [2024-04-16 23:03:39.152918] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x12293e0) with pdu=0x2000190fef90 00:25:48.203 [2024-04-16 23:03:39.153171] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:3776 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.203 [2024-04-16 23:03:39.153225] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:25:48.203 [2024-04-16 23:03:39.161784] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x12293e0) with pdu=0x2000190fef90 00:25:48.203 [2024-04-16 23:03:39.162013] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:6848 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.203 [2024-04-16 23:03:39.162045] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:25:48.203 [2024-04-16 23:03:39.171762] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x12293e0) with pdu=0x2000190fef90 00:25:48.203 [2024-04-16 23:03:39.172121] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:11744 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.204 [2024-04-16 23:03:39.172153] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:25:48.204 [2024-04-16 23:03:39.181769] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x12293e0) with pdu=0x2000190fef90 00:25:48.204 [2024-04-16 23:03:39.181955] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:4224 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.204 [2024-04-16 23:03:39.181986] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:25:48.204 [2024-04-16 23:03:39.190154] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x12293e0) with pdu=0x2000190fef90 00:25:48.204 [2024-04-16 23:03:39.190326] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:13728 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.204 [2024-04-16 23:03:39.190356] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:25:48.204 [2024-04-16 23:03:39.197782] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x12293e0) with pdu=0x2000190fef90 00:25:48.204 [2024-04-16 23:03:39.197953] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:22880 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.204 [2024-04-16 23:03:39.197982] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:25:48.204 [2024-04-16 23:03:39.205448] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x12293e0) with pdu=0x2000190fef90 00:25:48.204 [2024-04-16 23:03:39.205823] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:3232 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.204 [2024-04-16 23:03:39.205856] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:25:48.204 [2024-04-16 23:03:39.214885] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x12293e0) with pdu=0x2000190fef90 00:25:48.204 [2024-04-16 23:03:39.215229] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:13824 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.204 [2024-04-16 23:03:39.215260] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:25:48.204 [2024-04-16 23:03:39.223671] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x12293e0) with pdu=0x2000190fef90 00:25:48.204 [2024-04-16 23:03:39.223903] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:21664 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.204 [2024-04-16 23:03:39.223933] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:25:48.204 [2024-04-16 23:03:39.231104] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x12293e0) with pdu=0x2000190fef90 00:25:48.204 [2024-04-16 23:03:39.231257] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:8448 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.204 [2024-04-16 23:03:39.231288] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:25:48.204 [2024-04-16 23:03:39.240689] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x12293e0) with pdu=0x2000190fef90 00:25:48.204 [2024-04-16 23:03:39.240996] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:6496 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.204 [2024-04-16 23:03:39.241029] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:25:48.204 [2024-04-16 23:03:39.249641] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x12293e0) with pdu=0x2000190fef90 00:25:48.204 [2024-04-16 23:03:39.249865] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:16864 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.204 [2024-04-16 23:03:39.249898] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:25:48.204 [2024-04-16 23:03:39.259284] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x12293e0) with pdu=0x2000190fef90 00:25:48.204 [2024-04-16 23:03:39.259430] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:24864 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.204 [2024-04-16 23:03:39.259460] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:25:48.204 [2024-04-16 23:03:39.267383] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x12293e0) with pdu=0x2000190fef90 00:25:48.204 [2024-04-16 23:03:39.267606] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:15904 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.204 [2024-04-16 23:03:39.267640] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:25:48.204 [2024-04-16 23:03:39.276958] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x12293e0) with pdu=0x2000190fef90 00:25:48.204 [2024-04-16 23:03:39.277323] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:5152 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.204 [2024-04-16 23:03:39.277354] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:25:48.204 [2024-04-16 23:03:39.286459] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x12293e0) with pdu=0x2000190fef90 00:25:48.204 [2024-04-16 23:03:39.286749] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:5056 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.204 [2024-04-16 23:03:39.286782] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:25:48.204 [2024-04-16 23:03:39.295408] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x12293e0) with pdu=0x2000190fef90 00:25:48.204 [2024-04-16 23:03:39.295717] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:16832 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.204 [2024-04-16 23:03:39.295761] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:25:48.204 [2024-04-16 23:03:39.304815] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x12293e0) with pdu=0x2000190fef90 00:25:48.204 [2024-04-16 23:03:39.305013] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:7968 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.204 [2024-04-16 23:03:39.305051] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:25:48.204 [2024-04-16 23:03:39.313666] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x12293e0) with pdu=0x2000190fef90 00:25:48.204 [2024-04-16 23:03:39.313855] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:23264 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.204 [2024-04-16 23:03:39.313887] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:25:48.204 [2024-04-16 23:03:39.323114] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x12293e0) with pdu=0x2000190fef90 00:25:48.204 [2024-04-16 23:03:39.323363] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:20704 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.204 [2024-04-16 23:03:39.323392] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:25:48.463 [2024-04-16 23:03:39.332963] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x12293e0) with pdu=0x2000190fef90 00:25:48.463 [2024-04-16 23:03:39.333260] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:19328 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.463 [2024-04-16 23:03:39.333291] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:25:48.463 [2024-04-16 23:03:39.342549] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x12293e0) with pdu=0x2000190fef90 00:25:48.463 [2024-04-16 23:03:39.342902] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:22656 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.463 [2024-04-16 23:03:39.342934] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:25:48.463 [2024-04-16 23:03:39.352488] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x12293e0) with pdu=0x2000190fef90 00:25:48.463 [2024-04-16 23:03:39.352683] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:18784 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.463 [2024-04-16 23:03:39.352730] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:25:48.463 [2024-04-16 23:03:39.362710] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x12293e0) with pdu=0x2000190fef90 00:25:48.463 [2024-04-16 23:03:39.363008] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:7424 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.463 [2024-04-16 23:03:39.363041] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:25:48.463 [2024-04-16 23:03:39.372854] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x12293e0) with pdu=0x2000190fef90 00:25:48.463 [2024-04-16 23:03:39.373096] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:12640 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.463 [2024-04-16 23:03:39.373129] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:25:48.463 [2024-04-16 23:03:39.382557] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x12293e0) with pdu=0x2000190fef90 00:25:48.463 [2024-04-16 23:03:39.382775] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:11392 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.463 [2024-04-16 23:03:39.382808] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:25:48.463 [2024-04-16 23:03:39.390677] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x12293e0) with pdu=0x2000190fef90 00:25:48.463 [2024-04-16 23:03:39.390911] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:18880 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.463 [2024-04-16 23:03:39.390944] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:25:48.463 [2024-04-16 23:03:39.400139] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x12293e0) with pdu=0x2000190fef90 00:25:48.463 [2024-04-16 23:03:39.400351] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:12608 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.463 [2024-04-16 23:03:39.400378] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:25:48.463 [2024-04-16 23:03:39.409758] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x12293e0) with pdu=0x2000190fef90 00:25:48.463 [2024-04-16 23:03:39.409975] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:20576 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.463 [2024-04-16 23:03:39.410008] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:25:48.463 [2024-04-16 23:03:39.418656] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x12293e0) with pdu=0x2000190fef90 00:25:48.463 [2024-04-16 23:03:39.418983] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:6112 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.463 [2024-04-16 23:03:39.419015] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:25:48.463 [2024-04-16 23:03:39.426967] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x12293e0) with pdu=0x2000190fef90 00:25:48.463 [2024-04-16 23:03:39.427204] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:14336 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.463 [2024-04-16 23:03:39.427249] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:25:48.463 [2024-04-16 23:03:39.435665] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x12293e0) with pdu=0x2000190fef90 00:25:48.463 [2024-04-16 23:03:39.435820] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:8512 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.463 [2024-04-16 23:03:39.435852] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:25:48.463 [2024-04-16 23:03:39.444227] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x12293e0) with pdu=0x2000190fef90 00:25:48.463 [2024-04-16 23:03:39.444340] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:15168 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.464 [2024-04-16 23:03:39.444369] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:25:48.464 [2024-04-16 23:03:39.452286] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x12293e0) with pdu=0x2000190fef90 00:25:48.464 [2024-04-16 23:03:39.452455] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:10464 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.464 [2024-04-16 23:03:39.452494] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:25:48.464 [2024-04-16 23:03:39.460226] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x12293e0) with pdu=0x2000190fef90 00:25:48.464 [2024-04-16 23:03:39.460334] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:6624 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.464 [2024-04-16 23:03:39.460362] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:25:48.464 [2024-04-16 23:03:39.467360] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x12293e0) with pdu=0x2000190fef90 00:25:48.464 [2024-04-16 23:03:39.467583] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:25184 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.464 [2024-04-16 23:03:39.467612] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:25:48.464 [2024-04-16 23:03:39.476026] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x12293e0) with pdu=0x2000190fef90 00:25:48.464 [2024-04-16 23:03:39.476316] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:25344 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.464 [2024-04-16 23:03:39.476345] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:25:48.464 [2024-04-16 23:03:39.485623] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x12293e0) with pdu=0x2000190fef90 00:25:48.464 [2024-04-16 23:03:39.485872] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:9184 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.464 [2024-04-16 23:03:39.485900] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:25:48.464 [2024-04-16 23:03:39.494145] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x12293e0) with pdu=0x2000190fef90 00:25:48.464 [2024-04-16 23:03:39.494368] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:2912 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.464 [2024-04-16 23:03:39.494396] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:25:48.464 [2024-04-16 23:03:39.502646] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x12293e0) with pdu=0x2000190fef90 00:25:48.464 [2024-04-16 23:03:39.502904] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:20480 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.464 [2024-04-16 23:03:39.502933] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:25:48.464 [2024-04-16 23:03:39.511766] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x12293e0) with pdu=0x2000190fef90 00:25:48.464 [2024-04-16 23:03:39.511978] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:12992 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.464 [2024-04-16 23:03:39.512007] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:25:48.464 [2024-04-16 23:03:39.519546] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x12293e0) with pdu=0x2000190fef90 00:25:48.464 [2024-04-16 23:03:39.519726] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:11136 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.464 [2024-04-16 23:03:39.519757] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:25:48.464 [2024-04-16 23:03:39.529187] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x12293e0) with pdu=0x2000190fef90 00:25:48.464 [2024-04-16 23:03:39.529419] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:12928 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.464 [2024-04-16 23:03:39.529447] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:25:48.464 [2024-04-16 23:03:39.538155] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x12293e0) with pdu=0x2000190fef90 00:25:48.464 [2024-04-16 23:03:39.538417] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:20384 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.464 [2024-04-16 23:03:39.538451] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:25:48.464 [2024-04-16 23:03:39.547597] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x12293e0) with pdu=0x2000190fef90 00:25:48.464 [2024-04-16 23:03:39.547875] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:7968 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.464 [2024-04-16 23:03:39.547906] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:25:48.464 [2024-04-16 23:03:39.556596] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x12293e0) with pdu=0x2000190fef90 00:25:48.464 [2024-04-16 23:03:39.556802] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:21504 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.464 [2024-04-16 23:03:39.556834] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:25:48.464 [2024-04-16 23:03:39.566171] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x12293e0) with pdu=0x2000190fef90 00:25:48.464 [2024-04-16 23:03:39.566490] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:16128 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.464 [2024-04-16 23:03:39.566520] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:25:48.464 [2024-04-16 23:03:39.575850] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x12293e0) with pdu=0x2000190fef90 00:25:48.464 [2024-04-16 23:03:39.576153] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:12448 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.464 [2024-04-16 23:03:39.576193] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:25:48.464 [2024-04-16 23:03:39.585067] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x12293e0) with pdu=0x2000190fef90 00:25:48.464 [2024-04-16 23:03:39.585338] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:16224 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.464 [2024-04-16 23:03:39.585368] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:25:48.723 [2024-04-16 23:03:39.595460] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x12293e0) with pdu=0x2000190fef90 00:25:48.723 [2024-04-16 23:03:39.595744] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:9216 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.723 [2024-04-16 23:03:39.595776] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:25:48.723 [2024-04-16 23:03:39.603769] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x12293e0) with pdu=0x2000190fef90 00:25:48.723 [2024-04-16 23:03:39.603970] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:24320 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.723 [2024-04-16 23:03:39.604002] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:25:48.723 [2024-04-16 23:03:39.612071] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x12293e0) with pdu=0x2000190fef90 00:25:48.723 [2024-04-16 23:03:39.612394] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:7328 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.723 [2024-04-16 23:03:39.612423] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:25:48.723 [2024-04-16 23:03:39.621297] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x12293e0) with pdu=0x2000190fef90 00:25:48.723 [2024-04-16 23:03:39.621407] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:18496 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.723 [2024-04-16 23:03:39.621435] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:25:48.723 [2024-04-16 23:03:39.631200] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x12293e0) with pdu=0x2000190fef90 00:25:48.723 [2024-04-16 23:03:39.631449] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:14240 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.723 [2024-04-16 23:03:39.631475] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:25:48.723 [2024-04-16 23:03:39.639725] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x12293e0) with pdu=0x2000190fef90 00:25:48.723 [2024-04-16 23:03:39.640008] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:5760 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.723 [2024-04-16 23:03:39.640040] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:25:48.723 [2024-04-16 23:03:39.648249] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x12293e0) with pdu=0x2000190fef90 00:25:48.723 [2024-04-16 23:03:39.648562] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:24288 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.723 [2024-04-16 23:03:39.648591] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:25:48.723 [2024-04-16 23:03:39.657840] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x12293e0) with pdu=0x2000190fef90 00:25:48.723 [2024-04-16 23:03:39.658163] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:17568 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.723 [2024-04-16 23:03:39.658203] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:25:48.723 [2024-04-16 23:03:39.666569] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x12293e0) with pdu=0x2000190fef90 00:25:48.723 [2024-04-16 23:03:39.666779] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:21952 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.723 [2024-04-16 23:03:39.666810] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:25:48.723 [2024-04-16 23:03:39.675849] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x12293e0) with pdu=0x2000190fef90 00:25:48.723 [2024-04-16 23:03:39.676125] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:18208 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.723 [2024-04-16 23:03:39.676156] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:25:48.723 [2024-04-16 23:03:39.685319] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x12293e0) with pdu=0x2000190fef90 00:25:48.723 [2024-04-16 23:03:39.685519] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:23744 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.723 [2024-04-16 23:03:39.685548] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:25:48.723 [2024-04-16 23:03:39.694565] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x12293e0) with pdu=0x2000190fef90 00:25:48.723 [2024-04-16 23:03:39.694804] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:21920 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.723 [2024-04-16 23:03:39.694837] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:25:48.723 [2024-04-16 23:03:39.703600] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x12293e0) with pdu=0x2000190fef90 00:25:48.723 [2024-04-16 23:03:39.703896] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:13952 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.724 [2024-04-16 23:03:39.703928] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:25:48.724 [2024-04-16 23:03:39.713600] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x12293e0) with pdu=0x2000190fef90 00:25:48.724 [2024-04-16 23:03:39.713929] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:8480 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.724 [2024-04-16 23:03:39.713961] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:25:48.724 [2024-04-16 23:03:39.722357] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x12293e0) with pdu=0x2000190fef90 00:25:48.724 [2024-04-16 23:03:39.722585] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:23008 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.724 [2024-04-16 23:03:39.722617] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:25:48.724 [2024-04-16 23:03:39.731675] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x12293e0) with pdu=0x2000190fef90 00:25:48.724 [2024-04-16 23:03:39.731931] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:7680 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.724 [2024-04-16 23:03:39.731964] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:25:48.724 [2024-04-16 23:03:39.740732] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x12293e0) with pdu=0x2000190fef90 00:25:48.724 [2024-04-16 23:03:39.741015] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:3168 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.724 [2024-04-16 23:03:39.741047] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:25:48.724 [2024-04-16 23:03:39.750266] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x12293e0) with pdu=0x2000190fef90 00:25:48.724 [2024-04-16 23:03:39.750539] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:22080 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.724 [2024-04-16 23:03:39.750567] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:25:48.724 [2024-04-16 23:03:39.759634] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x12293e0) with pdu=0x2000190fef90 00:25:48.724 [2024-04-16 23:03:39.759902] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:2976 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.724 [2024-04-16 23:03:39.759934] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:25:48.724 [2024-04-16 23:03:39.768639] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x12293e0) with pdu=0x2000190fef90 00:25:48.724 [2024-04-16 23:03:39.768932] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:2816 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.724 [2024-04-16 23:03:39.768964] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:25:48.724 [2024-04-16 23:03:39.777528] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x12293e0) with pdu=0x2000190fef90 00:25:48.724 [2024-04-16 23:03:39.777739] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:17344 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.724 [2024-04-16 23:03:39.777776] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:25:48.724 [2024-04-16 23:03:39.786772] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x12293e0) with pdu=0x2000190fef90 00:25:48.724 [2024-04-16 23:03:39.787025] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:8864 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.724 [2024-04-16 23:03:39.787058] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:25:48.724 [2024-04-16 23:03:39.795020] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x12293e0) with pdu=0x2000190fef90 00:25:48.724 [2024-04-16 23:03:39.795316] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:8576 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.724 [2024-04-16 23:03:39.795346] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:25:48.724 [2024-04-16 23:03:39.803484] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x12293e0) with pdu=0x2000190fef90 00:25:48.724 [2024-04-16 23:03:39.803731] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:22336 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.724 [2024-04-16 23:03:39.803763] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:25:48.724 [2024-04-16 23:03:39.812270] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x12293e0) with pdu=0x2000190fef90 00:25:48.724 [2024-04-16 23:03:39.812480] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:5984 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.724 [2024-04-16 23:03:39.812509] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:25:48.724 [2024-04-16 23:03:39.821232] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x12293e0) with pdu=0x2000190fef90 00:25:48.724 [2024-04-16 23:03:39.821434] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:20480 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.724 [2024-04-16 23:03:39.821464] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:25:48.724 [2024-04-16 23:03:39.829973] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x12293e0) with pdu=0x2000190fef90 00:25:48.724 [2024-04-16 23:03:39.830247] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:14496 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.724 [2024-04-16 23:03:39.830276] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:25:48.724 [2024-04-16 23:03:39.839683] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x12293e0) with pdu=0x2000190fef90 00:25:48.724 [2024-04-16 23:03:39.840022] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:25504 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.724 [2024-04-16 23:03:39.840053] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:25:48.724 [2024-04-16 23:03:39.849241] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x12293e0) with pdu=0x2000190fef90 00:25:48.724 [2024-04-16 23:03:39.849544] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:9024 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.724 [2024-04-16 23:03:39.849576] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:25:48.984 [2024-04-16 23:03:39.858445] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x12293e0) with pdu=0x2000190fef90 00:25:48.984 [2024-04-16 23:03:39.858701] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:608 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.984 [2024-04-16 23:03:39.858733] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:25:48.984 [2024-04-16 23:03:39.867460] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x12293e0) with pdu=0x2000190fef90 00:25:48.984 [2024-04-16 23:03:39.867735] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:12544 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.984 [2024-04-16 23:03:39.867768] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:25:48.984 [2024-04-16 23:03:39.876368] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x12293e0) with pdu=0x2000190fef90 00:25:48.984 [2024-04-16 23:03:39.876526] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:21376 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.984 [2024-04-16 23:03:39.876573] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:25:48.984 [2024-04-16 23:03:39.884479] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x12293e0) with pdu=0x2000190fef90 00:25:48.984 [2024-04-16 23:03:39.884680] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:21024 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.984 [2024-04-16 23:03:39.884712] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:25:48.984 [2024-04-16 23:03:39.892917] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x12293e0) with pdu=0x2000190fef90 00:25:48.984 [2024-04-16 23:03:39.893163] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:25504 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.984 [2024-04-16 23:03:39.893225] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:25:48.984 [2024-04-16 23:03:39.900953] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x12293e0) with pdu=0x2000190fef90 00:25:48.984 [2024-04-16 23:03:39.901141] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:6016 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.984 [2024-04-16 23:03:39.901173] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:25:48.984 [2024-04-16 23:03:39.910718] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x12293e0) with pdu=0x2000190fef90 00:25:48.984 [2024-04-16 23:03:39.911001] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:4960 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.984 [2024-04-16 23:03:39.911034] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:25:48.984 [2024-04-16 23:03:39.919902] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x12293e0) with pdu=0x2000190fef90 00:25:48.984 [2024-04-16 23:03:39.920230] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:21600 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.984 [2024-04-16 23:03:39.920259] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:25:48.984 [2024-04-16 23:03:39.929067] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x12293e0) with pdu=0x2000190fef90 00:25:48.984 [2024-04-16 23:03:39.929239] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:18400 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.984 [2024-04-16 23:03:39.929267] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:25:48.984 [2024-04-16 23:03:39.938014] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x12293e0) with pdu=0x2000190fef90 00:25:48.984 [2024-04-16 23:03:39.938298] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:10208 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.984 [2024-04-16 23:03:39.938329] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:25:48.984 [2024-04-16 23:03:39.945732] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x12293e0) with pdu=0x2000190fef90 00:25:48.984 [2024-04-16 23:03:39.945987] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:3648 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.984 [2024-04-16 23:03:39.946016] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:25:48.984 [2024-04-16 23:03:39.954112] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x12293e0) with pdu=0x2000190fef90 00:25:48.984 [2024-04-16 23:03:39.954391] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:4160 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.984 [2024-04-16 23:03:39.954421] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:25:48.984 [2024-04-16 23:03:39.962769] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x12293e0) with pdu=0x2000190fef90 00:25:48.984 [2024-04-16 23:03:39.962888] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:23776 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.984 [2024-04-16 23:03:39.962919] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:25:48.984 [2024-04-16 23:03:39.970927] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x12293e0) with pdu=0x2000190fef90 00:25:48.984 [2024-04-16 23:03:39.971135] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:8064 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.984 [2024-04-16 23:03:39.971167] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:25:48.984 [2024-04-16 23:03:39.980870] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x12293e0) with pdu=0x2000190fef90 00:25:48.984 [2024-04-16 23:03:39.981060] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:19808 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.984 [2024-04-16 23:03:39.981093] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:25:48.984 [2024-04-16 23:03:39.990120] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x12293e0) with pdu=0x2000190fef90 00:25:48.984 [2024-04-16 23:03:39.990403] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:4704 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.984 [2024-04-16 23:03:39.990432] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:25:48.984 [2024-04-16 23:03:39.999074] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x12293e0) with pdu=0x2000190fef90 00:25:48.984 [2024-04-16 23:03:39.999270] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:20128 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.984 [2024-04-16 23:03:39.999299] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:25:48.984 [2024-04-16 23:03:40.006776] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x12293e0) with pdu=0x2000190fef90 00:25:48.984 [2024-04-16 23:03:40.007164] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:2560 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.984 [2024-04-16 23:03:40.007237] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:25:48.984 [2024-04-16 23:03:40.015860] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x12293e0) with pdu=0x2000190fef90 00:25:48.984 [2024-04-16 23:03:40.016042] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:15200 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.984 [2024-04-16 23:03:40.016076] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:25:48.984 [2024-04-16 23:03:40.024344] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x12293e0) with pdu=0x2000190fef90 00:25:48.984 [2024-04-16 23:03:40.024566] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:11584 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.984 [2024-04-16 23:03:40.024602] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:25:48.984 [2024-04-16 23:03:40.032345] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x12293e0) with pdu=0x2000190fef90 00:25:48.984 [2024-04-16 23:03:40.032539] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:19200 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.984 [2024-04-16 23:03:40.032573] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:25:48.984 [2024-04-16 23:03:40.039488] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x12293e0) with pdu=0x2000190fef90 00:25:48.984 [2024-04-16 23:03:40.039812] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:19552 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.984 [2024-04-16 23:03:40.039847] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:25:48.984 [2024-04-16 23:03:40.048578] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x12293e0) with pdu=0x2000190fef90 00:25:48.984 [2024-04-16 23:03:40.048791] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:10560 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.984 [2024-04-16 23:03:40.048825] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:25:48.984 [2024-04-16 23:03:40.056839] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x12293e0) with pdu=0x2000190fef90 00:25:48.984 [2024-04-16 23:03:40.057068] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:1312 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.984 [2024-04-16 23:03:40.057100] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:25:48.984 [2024-04-16 23:03:40.065607] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x12293e0) with pdu=0x2000190fef90 00:25:48.984 [2024-04-16 23:03:40.065847] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:12832 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.984 [2024-04-16 23:03:40.065879] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:25:48.984 [2024-04-16 23:03:40.074906] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x12293e0) with pdu=0x2000190fef90 00:25:48.984 [2024-04-16 23:03:40.075109] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:8800 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.985 [2024-04-16 23:03:40.075142] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:25:48.985 [2024-04-16 23:03:40.083863] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x12293e0) with pdu=0x2000190fef90 00:25:48.985 [2024-04-16 23:03:40.084072] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:22016 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.985 [2024-04-16 23:03:40.084104] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:25:48.985 [2024-04-16 23:03:40.092716] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x12293e0) with pdu=0x2000190fef90 00:25:48.985 [2024-04-16 23:03:40.092974] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:6272 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.985 [2024-04-16 23:03:40.093006] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:25:48.985 [2024-04-16 23:03:40.100407] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x12293e0) with pdu=0x2000190fef90 00:25:48.985 [2024-04-16 23:03:40.100595] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:10720 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.985 [2024-04-16 23:03:40.100627] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:25:48.985 [2024-04-16 23:03:40.109485] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x12293e0) with pdu=0x2000190fef90 00:25:48.985 [2024-04-16 23:03:40.109750] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:13632 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.985 [2024-04-16 23:03:40.109781] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:25:49.243 [2024-04-16 23:03:40.118737] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x12293e0) with pdu=0x2000190fef90 00:25:49.243 [2024-04-16 23:03:40.118896] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:17024 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:49.243 [2024-04-16 23:03:40.118928] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:25:49.243 [2024-04-16 23:03:40.127415] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x12293e0) with pdu=0x2000190fef90 00:25:49.243 [2024-04-16 23:03:40.127600] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:18400 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:49.243 [2024-04-16 23:03:40.127629] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:25:49.243 [2024-04-16 23:03:40.136448] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x12293e0) with pdu=0x2000190fef90 00:25:49.243 [2024-04-16 23:03:40.136752] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:13824 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:49.243 [2024-04-16 23:03:40.136784] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:25:49.243 [2024-04-16 23:03:40.146999] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x12293e0) with pdu=0x2000190fef90 00:25:49.243 [2024-04-16 23:03:40.147314] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:17600 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:49.243 [2024-04-16 23:03:40.147343] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:25:49.243 [2024-04-16 23:03:40.155200] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x12293e0) with pdu=0x2000190fef90 00:25:49.243 [2024-04-16 23:03:40.155367] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:11712 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:49.243 [2024-04-16 23:03:40.155395] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:25:49.243 [2024-04-16 23:03:40.162576] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x12293e0) with pdu=0x2000190fef90 00:25:49.243 [2024-04-16 23:03:40.162826] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:16832 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:49.243 [2024-04-16 23:03:40.162854] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:25:49.243 [2024-04-16 23:03:40.171145] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x12293e0) with pdu=0x2000190fef90 00:25:49.243 [2024-04-16 23:03:40.171318] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:23712 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:49.243 [2024-04-16 23:03:40.171347] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:25:49.243 [2024-04-16 23:03:40.180009] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x12293e0) with pdu=0x2000190fef90 00:25:49.243 [2024-04-16 23:03:40.180307] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:9696 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:49.243 [2024-04-16 23:03:40.180337] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:25:49.243 [2024-04-16 23:03:40.188649] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x12293e0) with pdu=0x2000190fef90 00:25:49.243 [2024-04-16 23:03:40.188817] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:3264 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:49.243 [2024-04-16 23:03:40.188845] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:25:49.243 [2024-04-16 23:03:40.197269] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x12293e0) with pdu=0x2000190fef90 00:25:49.243 [2024-04-16 23:03:40.197475] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:18016 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:49.243 [2024-04-16 23:03:40.197504] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:25:49.243 [2024-04-16 23:03:40.205160] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x12293e0) with pdu=0x2000190fef90 00:25:49.243 [2024-04-16 23:03:40.205476] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:1440 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:49.244 [2024-04-16 23:03:40.205506] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:25:49.244 [2024-04-16 23:03:40.213474] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x12293e0) with pdu=0x2000190fef90 00:25:49.244 [2024-04-16 23:03:40.213797] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:21600 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:49.244 [2024-04-16 23:03:40.213827] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:25:49.244 [2024-04-16 23:03:40.221492] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x12293e0) with pdu=0x2000190fef90 00:25:49.244 [2024-04-16 23:03:40.221777] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:19008 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:49.244 [2024-04-16 23:03:40.221810] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:25:49.244 [2024-04-16 23:03:40.230458] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x12293e0) with pdu=0x2000190fef90 00:25:49.244 [2024-04-16 23:03:40.230731] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:8256 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:49.244 [2024-04-16 23:03:40.230769] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:25:49.244 [2024-04-16 23:03:40.238373] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x12293e0) with pdu=0x2000190fef90 00:25:49.244 [2024-04-16 23:03:40.238547] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:10976 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:49.244 [2024-04-16 23:03:40.238575] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:25:49.244 [2024-04-16 23:03:40.246832] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x12293e0) with pdu=0x2000190fef90 00:25:49.244 [2024-04-16 23:03:40.246993] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:7648 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:49.244 [2024-04-16 23:03:40.247024] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:25:49.244 [2024-04-16 23:03:40.255170] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x12293e0) with pdu=0x2000190fef90 00:25:49.244 [2024-04-16 23:03:40.255401] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:11104 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:49.244 [2024-04-16 23:03:40.255431] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:25:49.244 [2024-04-16 23:03:40.264976] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x12293e0) with pdu=0x2000190fef90 00:25:49.244 [2024-04-16 23:03:40.265136] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:24512 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:49.244 [2024-04-16 23:03:40.265167] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:25:49.244 [2024-04-16 23:03:40.273854] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x12293e0) with pdu=0x2000190fef90 00:25:49.244 [2024-04-16 23:03:40.274091] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:16512 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:49.244 [2024-04-16 23:03:40.274124] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:25:49.244 [2024-04-16 23:03:40.283532] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x12293e0) with pdu=0x2000190fef90 00:25:49.244 [2024-04-16 23:03:40.283823] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:23872 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:49.244 [2024-04-16 23:03:40.283852] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:25:49.244 [2024-04-16 23:03:40.293285] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x12293e0) with pdu=0x2000190fef90 00:25:49.244 [2024-04-16 23:03:40.293432] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:15072 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:49.244 [2024-04-16 23:03:40.293461] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:25:49.244 [2024-04-16 23:03:40.301795] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x12293e0) with pdu=0x2000190fef90 00:25:49.244 [2024-04-16 23:03:40.302171] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:3968 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:49.244 [2024-04-16 23:03:40.302211] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:25:49.244 [2024-04-16 23:03:40.310854] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x12293e0) with pdu=0x2000190fef90 00:25:49.244 [2024-04-16 23:03:40.311000] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:2112 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:49.244 [2024-04-16 23:03:40.311032] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:25:49.244 [2024-04-16 23:03:40.319328] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x12293e0) with pdu=0x2000190fef90 00:25:49.244 [2024-04-16 23:03:40.319578] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:11360 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:49.244 [2024-04-16 23:03:40.319608] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:25:49.244 [2024-04-16 23:03:40.328156] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x12293e0) with pdu=0x2000190fef90 00:25:49.244 [2024-04-16 23:03:40.328402] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:25024 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:49.244 [2024-04-16 23:03:40.328432] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:25:49.244 [2024-04-16 23:03:40.336373] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x12293e0) with pdu=0x2000190fef90 00:25:49.244 [2024-04-16 23:03:40.336548] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:8160 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:49.244 [2024-04-16 23:03:40.336575] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:25:49.244 [2024-04-16 23:03:40.344286] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x12293e0) with pdu=0x2000190fef90 00:25:49.244 [2024-04-16 23:03:40.344491] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:2624 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:49.244 [2024-04-16 23:03:40.344518] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:25:49.244 [2024-04-16 23:03:40.353652] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x12293e0) with pdu=0x2000190fef90 00:25:49.244 [2024-04-16 23:03:40.353943] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:5760 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:49.244 [2024-04-16 23:03:40.353972] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:25:49.244 [2024-04-16 23:03:40.362246] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x12293e0) with pdu=0x2000190fef90 00:25:49.244 [2024-04-16 23:03:40.362462] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:4896 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:49.244 [2024-04-16 23:03:40.362509] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:25:49.244 [2024-04-16 23:03:40.370481] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x12293e0) with pdu=0x2000190fef90 00:25:49.244 [2024-04-16 23:03:40.370785] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:7968 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:49.244 [2024-04-16 23:03:40.370818] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:25:49.505 [2024-04-16 23:03:40.378292] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x12293e0) with pdu=0x2000190fef90 00:25:49.505 [2024-04-16 23:03:40.378475] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:23584 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:49.505 [2024-04-16 23:03:40.378504] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:25:49.505 [2024-04-16 23:03:40.385265] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x12293e0) with pdu=0x2000190fef90 00:25:49.505 [2024-04-16 23:03:40.385376] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:5408 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:49.505 [2024-04-16 23:03:40.385405] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:25:49.505 [2024-04-16 23:03:40.393580] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x12293e0) with pdu=0x2000190fef90 00:25:49.505 [2024-04-16 23:03:40.393868] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:24480 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:49.505 [2024-04-16 23:03:40.393901] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:25:49.505 [2024-04-16 23:03:40.401697] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x12293e0) with pdu=0x2000190fef90 00:25:49.505 [2024-04-16 23:03:40.401925] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:10752 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:49.505 [2024-04-16 23:03:40.401957] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:25:49.505 [2024-04-16 23:03:40.411394] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x12293e0) with pdu=0x2000190fef90 00:25:49.505 [2024-04-16 23:03:40.411623] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:14880 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:49.505 [2024-04-16 23:03:40.411652] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:25:49.505 [2024-04-16 23:03:40.420382] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x12293e0) with pdu=0x2000190fef90 00:25:49.505 [2024-04-16 23:03:40.420682] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:25504 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:49.505 [2024-04-16 23:03:40.420711] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:25:49.505 [2024-04-16 23:03:40.429256] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x12293e0) with pdu=0x2000190fef90 00:25:49.505 [2024-04-16 23:03:40.429591] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:6784 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:49.505 [2024-04-16 23:03:40.429620] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:25:49.505 [2024-04-16 23:03:40.438851] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x12293e0) with pdu=0x2000190fef90 00:25:49.505 [2024-04-16 23:03:40.439234] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:10912 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:49.505 [2024-04-16 23:03:40.439264] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:25:49.505 [2024-04-16 23:03:40.447682] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x12293e0) with pdu=0x2000190fef90 00:25:49.505 [2024-04-16 23:03:40.447881] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:2560 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:49.505 [2024-04-16 23:03:40.447912] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:25:49.505 [2024-04-16 23:03:40.457009] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x12293e0) with pdu=0x2000190fef90 00:25:49.505 [2024-04-16 23:03:40.457159] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:7072 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:49.505 [2024-04-16 23:03:40.457232] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:25:49.505 [2024-04-16 23:03:40.464455] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x12293e0) with pdu=0x2000190fef90 00:25:49.505 [2024-04-16 23:03:40.464650] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:10368 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:49.505 [2024-04-16 23:03:40.464678] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:25:49.505 [2024-04-16 23:03:40.472501] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x12293e0) with pdu=0x2000190fef90 00:25:49.505 [2024-04-16 23:03:40.472824] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:8640 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:49.505 [2024-04-16 23:03:40.472856] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:25:49.505 [2024-04-16 23:03:40.481981] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x12293e0) with pdu=0x2000190fef90 00:25:49.505 [2024-04-16 23:03:40.482236] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:7104 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:49.505 [2024-04-16 23:03:40.482266] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:25:49.505 [2024-04-16 23:03:40.491013] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x12293e0) with pdu=0x2000190fef90 00:25:49.505 [2024-04-16 23:03:40.491319] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:7264 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:49.506 [2024-04-16 23:03:40.491349] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:25:49.506 [2024-04-16 23:03:40.499106] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x12293e0) with pdu=0x2000190fef90 00:25:49.506 [2024-04-16 23:03:40.499378] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:8352 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:49.506 [2024-04-16 23:03:40.499408] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:25:49.506 [2024-04-16 23:03:40.507571] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x12293e0) with pdu=0x2000190fef90 00:25:49.506 [2024-04-16 23:03:40.507880] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:15744 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:49.506 [2024-04-16 23:03:40.507912] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:25:49.506 [2024-04-16 23:03:40.516416] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x12293e0) with pdu=0x2000190fef90 00:25:49.506 [2024-04-16 23:03:40.516659] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:22880 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:49.506 [2024-04-16 23:03:40.516691] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:25:49.506 [2024-04-16 23:03:40.525486] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x12293e0) with pdu=0x2000190fef90 00:25:49.506 [2024-04-16 23:03:40.525748] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:3904 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:49.506 [2024-04-16 23:03:40.525781] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:25:49.506 [2024-04-16 23:03:40.533873] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x12293e0) with pdu=0x2000190fef90 00:25:49.506 [2024-04-16 23:03:40.534165] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:5056 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:49.506 [2024-04-16 23:03:40.534206] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:25:49.506 [2024-04-16 23:03:40.543950] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x12293e0) with pdu=0x2000190fef90 00:25:49.506 [2024-04-16 23:03:40.544311] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:18048 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:49.506 [2024-04-16 23:03:40.544340] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:25:49.506 [2024-04-16 23:03:40.553151] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x12293e0) with pdu=0x2000190fef90 00:25:49.506 [2024-04-16 23:03:40.553360] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:21184 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:49.506 [2024-04-16 23:03:40.553389] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:25:49.506 [2024-04-16 23:03:40.561564] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x12293e0) with pdu=0x2000190fef90 00:25:49.506 [2024-04-16 23:03:40.561806] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:24576 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:49.506 [2024-04-16 23:03:40.561838] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:25:49.506 [2024-04-16 23:03:40.570810] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x12293e0) with pdu=0x2000190fef90 00:25:49.506 [2024-04-16 23:03:40.571138] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:3264 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:49.506 [2024-04-16 23:03:40.571172] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:25:49.506 [2024-04-16 23:03:40.580240] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x12293e0) with pdu=0x2000190fef90 00:25:49.506 [2024-04-16 23:03:40.580587] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:800 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:49.506 [2024-04-16 23:03:40.580620] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:25:49.506 [2024-04-16 23:03:40.590443] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x12293e0) with pdu=0x2000190fef90 00:25:49.506 [2024-04-16 23:03:40.590678] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:25024 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:49.506 [2024-04-16 23:03:40.590710] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:25:49.506 [2024-04-16 23:03:40.600055] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x12293e0) with pdu=0x2000190fef90 00:25:49.506 [2024-04-16 23:03:40.600346] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:10176 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:49.506 [2024-04-16 23:03:40.600376] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:25:49.506 [2024-04-16 23:03:40.609473] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x12293e0) with pdu=0x2000190fef90 00:25:49.506 [2024-04-16 23:03:40.609676] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:9440 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:49.506 [2024-04-16 23:03:40.609721] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:25:49.506 [2024-04-16 23:03:40.618973] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x12293e0) with pdu=0x2000190fef90 00:25:49.506 [2024-04-16 23:03:40.619192] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:6112 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:49.506 [2024-04-16 23:03:40.619236] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:25:49.506 00:25:49.506 Latency(us) 00:25:49.506 Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:25:49.506 Job: nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 16, IO size: 131072) 00:25:49.506 nvme0n1 : 2.00 3458.01 432.25 0.00 0.00 4616.01 3106.89 10728.49 00:25:49.506 =================================================================================================================== 00:25:49.506 Total : 3458.01 432.25 0.00 0.00 4616.01 3106.89 10728.49 00:25:49.506 0 00:25:49.764 23:03:40 -- host/digest.sh@71 -- # get_transient_errcount nvme0n1 00:25:49.764 23:03:40 -- host/digest.sh@27 -- # bperf_rpc bdev_get_iostat -b nvme0n1 00:25:49.764 23:03:40 -- host/digest.sh@28 -- # jq -r '.bdevs[0] 00:25:49.764 | .driver_specific 00:25:49.764 | .nvme_error 00:25:49.764 | .status_code 00:25:49.764 | .command_transient_transport_error' 00:25:49.764 23:03:40 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock bdev_get_iostat -b nvme0n1 00:25:49.764 23:03:40 -- host/digest.sh@71 -- # (( 223 > 0 )) 00:25:49.764 23:03:40 -- host/digest.sh@73 -- # killprocess 385042 00:25:49.764 23:03:40 -- common/autotest_common.sh@926 -- # '[' -z 385042 ']' 00:25:49.764 23:03:40 -- common/autotest_common.sh@930 -- # kill -0 385042 00:25:49.765 23:03:40 -- common/autotest_common.sh@931 -- # uname 00:25:49.765 23:03:40 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:25:49.765 23:03:40 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 385042 00:25:50.023 23:03:40 -- common/autotest_common.sh@932 -- # process_name=reactor_1 00:25:50.023 23:03:40 -- common/autotest_common.sh@936 -- # '[' reactor_1 = sudo ']' 00:25:50.023 23:03:40 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 385042' 00:25:50.023 killing process with pid 385042 00:25:50.023 23:03:40 -- common/autotest_common.sh@945 -- # kill 385042 00:25:50.023 Received shutdown signal, test time was about 2.000000 seconds 00:25:50.023 00:25:50.023 Latency(us) 00:25:50.023 Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:25:50.023 =================================================================================================================== 00:25:50.023 Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:25:50.023 23:03:40 -- common/autotest_common.sh@950 -- # wait 385042 00:25:50.281 23:03:41 -- host/digest.sh@115 -- # killprocess 383360 00:25:50.281 23:03:41 -- common/autotest_common.sh@926 -- # '[' -z 383360 ']' 00:25:50.281 23:03:41 -- common/autotest_common.sh@930 -- # kill -0 383360 00:25:50.281 23:03:41 -- common/autotest_common.sh@931 -- # uname 00:25:50.281 23:03:41 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:25:50.281 23:03:41 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 383360 00:25:50.281 23:03:41 -- common/autotest_common.sh@932 -- # process_name=reactor_0 00:25:50.281 23:03:41 -- common/autotest_common.sh@936 -- # '[' reactor_0 = sudo ']' 00:25:50.281 23:03:41 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 383360' 00:25:50.281 killing process with pid 383360 00:25:50.281 23:03:41 -- common/autotest_common.sh@945 -- # kill 383360 00:25:50.281 23:03:41 -- common/autotest_common.sh@950 -- # wait 383360 00:25:50.540 00:25:50.540 real 0m18.062s 00:25:50.540 user 0m34.866s 00:25:50.540 sys 0m4.969s 00:25:50.540 23:03:41 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:25:50.540 23:03:41 -- common/autotest_common.sh@10 -- # set +x 00:25:50.540 ************************************ 00:25:50.540 END TEST nvmf_digest_error 00:25:50.540 ************************************ 00:25:50.540 23:03:41 -- host/digest.sh@138 -- # trap - SIGINT SIGTERM EXIT 00:25:50.540 23:03:41 -- host/digest.sh@139 -- # nvmftestfini 00:25:50.540 23:03:41 -- nvmf/common.sh@476 -- # nvmfcleanup 00:25:50.540 23:03:41 -- nvmf/common.sh@116 -- # sync 00:25:50.540 23:03:41 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:25:50.540 23:03:41 -- nvmf/common.sh@119 -- # set +e 00:25:50.540 23:03:41 -- nvmf/common.sh@120 -- # for i in {1..20} 00:25:50.540 23:03:41 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:25:50.540 rmmod nvme_tcp 00:25:50.540 rmmod nvme_fabrics 00:25:50.540 rmmod nvme_keyring 00:25:50.540 23:03:41 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:25:50.540 23:03:41 -- nvmf/common.sh@123 -- # set -e 00:25:50.540 23:03:41 -- nvmf/common.sh@124 -- # return 0 00:25:50.540 23:03:41 -- nvmf/common.sh@477 -- # '[' -n 383360 ']' 00:25:50.540 23:03:41 -- nvmf/common.sh@478 -- # killprocess 383360 00:25:50.540 23:03:41 -- common/autotest_common.sh@926 -- # '[' -z 383360 ']' 00:25:50.540 23:03:41 -- common/autotest_common.sh@930 -- # kill -0 383360 00:25:50.540 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/autotest_common.sh: line 930: kill: (383360) - No such process 00:25:50.540 23:03:41 -- common/autotest_common.sh@953 -- # echo 'Process with pid 383360 is not found' 00:25:50.540 Process with pid 383360 is not found 00:25:50.540 23:03:41 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:25:50.540 23:03:41 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:25:50.540 23:03:41 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:25:50.540 23:03:41 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:25:50.540 23:03:41 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:25:50.540 23:03:41 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:25:50.540 23:03:41 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:25:50.540 23:03:41 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:25:53.082 23:03:43 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:25:53.082 00:25:53.082 real 0m38.184s 00:25:53.082 user 1m7.086s 00:25:53.082 sys 0m10.672s 00:25:53.082 23:03:43 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:25:53.082 23:03:43 -- common/autotest_common.sh@10 -- # set +x 00:25:53.082 ************************************ 00:25:53.082 END TEST nvmf_digest 00:25:53.082 ************************************ 00:25:53.082 23:03:43 -- nvmf/nvmf.sh@109 -- # [[ 0 -eq 1 ]] 00:25:53.082 23:03:43 -- nvmf/nvmf.sh@114 -- # [[ 0 -eq 1 ]] 00:25:53.082 23:03:43 -- nvmf/nvmf.sh@119 -- # [[ phy == phy ]] 00:25:53.082 23:03:43 -- nvmf/nvmf.sh@121 -- # run_test nvmf_bdevperf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/bdevperf.sh --transport=tcp 00:25:53.082 23:03:43 -- common/autotest_common.sh@1077 -- # '[' 3 -le 1 ']' 00:25:53.082 23:03:43 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:25:53.082 23:03:43 -- common/autotest_common.sh@10 -- # set +x 00:25:53.082 ************************************ 00:25:53.082 START TEST nvmf_bdevperf 00:25:53.082 ************************************ 00:25:53.082 23:03:43 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/bdevperf.sh --transport=tcp 00:25:53.082 * Looking for test storage... 00:25:53.082 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host 00:25:53.082 23:03:43 -- host/bdevperf.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:25:53.082 23:03:43 -- nvmf/common.sh@7 -- # uname -s 00:25:53.082 23:03:43 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:25:53.082 23:03:43 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:25:53.082 23:03:43 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:25:53.082 23:03:43 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:25:53.082 23:03:43 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:25:53.082 23:03:43 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:25:53.082 23:03:43 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:25:53.082 23:03:43 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:25:53.082 23:03:43 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:25:53.082 23:03:43 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:25:53.082 23:03:43 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:25:53.082 23:03:43 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:25:53.082 23:03:43 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:25:53.082 23:03:43 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:25:53.082 23:03:43 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:25:53.082 23:03:43 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:25:53.082 23:03:43 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:25:53.082 23:03:43 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:25:53.082 23:03:43 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:25:53.082 23:03:43 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:25:53.082 23:03:43 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:25:53.082 23:03:43 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:25:53.082 23:03:43 -- paths/export.sh@5 -- # export PATH 00:25:53.083 23:03:43 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:25:53.083 23:03:43 -- nvmf/common.sh@46 -- # : 0 00:25:53.083 23:03:43 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:25:53.083 23:03:43 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:25:53.083 23:03:43 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:25:53.083 23:03:43 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:25:53.083 23:03:43 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:25:53.083 23:03:43 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:25:53.083 23:03:43 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:25:53.083 23:03:43 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:25:53.083 23:03:43 -- host/bdevperf.sh@11 -- # MALLOC_BDEV_SIZE=64 00:25:53.083 23:03:43 -- host/bdevperf.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:25:53.083 23:03:43 -- host/bdevperf.sh@24 -- # nvmftestinit 00:25:53.083 23:03:43 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:25:53.083 23:03:43 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:25:53.083 23:03:43 -- nvmf/common.sh@436 -- # prepare_net_devs 00:25:53.083 23:03:43 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:25:53.083 23:03:43 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:25:53.083 23:03:43 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:25:53.083 23:03:43 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:25:53.083 23:03:43 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:25:53.083 23:03:43 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:25:53.083 23:03:43 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:25:53.083 23:03:43 -- nvmf/common.sh@284 -- # xtrace_disable 00:25:53.083 23:03:43 -- common/autotest_common.sh@10 -- # set +x 00:25:54.458 23:03:45 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:25:54.458 23:03:45 -- nvmf/common.sh@290 -- # pci_devs=() 00:25:54.458 23:03:45 -- nvmf/common.sh@290 -- # local -a pci_devs 00:25:54.458 23:03:45 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:25:54.458 23:03:45 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:25:54.458 23:03:45 -- nvmf/common.sh@292 -- # pci_drivers=() 00:25:54.458 23:03:45 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:25:54.458 23:03:45 -- nvmf/common.sh@294 -- # net_devs=() 00:25:54.458 23:03:45 -- nvmf/common.sh@294 -- # local -ga net_devs 00:25:54.458 23:03:45 -- nvmf/common.sh@295 -- # e810=() 00:25:54.458 23:03:45 -- nvmf/common.sh@295 -- # local -ga e810 00:25:54.458 23:03:45 -- nvmf/common.sh@296 -- # x722=() 00:25:54.458 23:03:45 -- nvmf/common.sh@296 -- # local -ga x722 00:25:54.458 23:03:45 -- nvmf/common.sh@297 -- # mlx=() 00:25:54.458 23:03:45 -- nvmf/common.sh@297 -- # local -ga mlx 00:25:54.458 23:03:45 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:25:54.458 23:03:45 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:25:54.458 23:03:45 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:25:54.458 23:03:45 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:25:54.458 23:03:45 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:25:54.458 23:03:45 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:25:54.459 23:03:45 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:25:54.459 23:03:45 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:25:54.459 23:03:45 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:25:54.459 23:03:45 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:25:54.459 23:03:45 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:25:54.459 23:03:45 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:25:54.459 23:03:45 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:25:54.459 23:03:45 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:25:54.459 23:03:45 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:25:54.459 23:03:45 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:25:54.459 23:03:45 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:25:54.459 23:03:45 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:25:54.459 23:03:45 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:25:54.459 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:25:54.459 23:03:45 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:25:54.459 23:03:45 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:25:54.459 23:03:45 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:25:54.459 23:03:45 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:25:54.459 23:03:45 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:25:54.459 23:03:45 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:25:54.459 23:03:45 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:25:54.459 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:25:54.459 23:03:45 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:25:54.459 23:03:45 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:25:54.459 23:03:45 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:25:54.459 23:03:45 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:25:54.459 23:03:45 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:25:54.459 23:03:45 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:25:54.459 23:03:45 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:25:54.459 23:03:45 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:25:54.459 23:03:45 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:25:54.459 23:03:45 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:25:54.459 23:03:45 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:25:54.459 23:03:45 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:25:54.459 23:03:45 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:25:54.459 Found net devices under 0000:0a:00.0: cvl_0_0 00:25:54.459 23:03:45 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:25:54.459 23:03:45 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:25:54.459 23:03:45 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:25:54.459 23:03:45 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:25:54.459 23:03:45 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:25:54.459 23:03:45 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:25:54.459 Found net devices under 0000:0a:00.1: cvl_0_1 00:25:54.459 23:03:45 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:25:54.459 23:03:45 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:25:54.459 23:03:45 -- nvmf/common.sh@402 -- # is_hw=yes 00:25:54.459 23:03:45 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:25:54.459 23:03:45 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:25:54.459 23:03:45 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:25:54.459 23:03:45 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:25:54.459 23:03:45 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:25:54.459 23:03:45 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:25:54.459 23:03:45 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:25:54.459 23:03:45 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:25:54.459 23:03:45 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:25:54.459 23:03:45 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:25:54.459 23:03:45 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:25:54.459 23:03:45 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:25:54.459 23:03:45 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:25:54.459 23:03:45 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:25:54.459 23:03:45 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:25:54.459 23:03:45 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:25:54.459 23:03:45 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:25:54.459 23:03:45 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:25:54.459 23:03:45 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:25:54.459 23:03:45 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:25:54.716 23:03:45 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:25:54.716 23:03:45 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:25:54.716 23:03:45 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:25:54.716 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:25:54.716 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.201 ms 00:25:54.716 00:25:54.716 --- 10.0.0.2 ping statistics --- 00:25:54.716 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:25:54.716 rtt min/avg/max/mdev = 0.201/0.201/0.201/0.000 ms 00:25:54.716 23:03:45 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:25:54.716 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:25:54.716 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.111 ms 00:25:54.716 00:25:54.716 --- 10.0.0.1 ping statistics --- 00:25:54.716 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:25:54.716 rtt min/avg/max/mdev = 0.111/0.111/0.111/0.000 ms 00:25:54.716 23:03:45 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:25:54.716 23:03:45 -- nvmf/common.sh@410 -- # return 0 00:25:54.716 23:03:45 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:25:54.716 23:03:45 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:25:54.716 23:03:45 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:25:54.716 23:03:45 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:25:54.716 23:03:45 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:25:54.716 23:03:45 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:25:54.716 23:03:45 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:25:54.716 23:03:45 -- host/bdevperf.sh@25 -- # tgt_init 00:25:54.716 23:03:45 -- host/bdevperf.sh@15 -- # nvmfappstart -m 0xE 00:25:54.716 23:03:45 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:25:54.716 23:03:45 -- common/autotest_common.sh@712 -- # xtrace_disable 00:25:54.716 23:03:45 -- common/autotest_common.sh@10 -- # set +x 00:25:54.716 23:03:45 -- nvmf/common.sh@469 -- # nvmfpid=387540 00:25:54.716 23:03:45 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xE 00:25:54.716 23:03:45 -- nvmf/common.sh@470 -- # waitforlisten 387540 00:25:54.716 23:03:45 -- common/autotest_common.sh@819 -- # '[' -z 387540 ']' 00:25:54.716 23:03:45 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk.sock 00:25:54.716 23:03:45 -- common/autotest_common.sh@824 -- # local max_retries=100 00:25:54.716 23:03:45 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:25:54.716 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:25:54.716 23:03:45 -- common/autotest_common.sh@828 -- # xtrace_disable 00:25:54.716 23:03:45 -- common/autotest_common.sh@10 -- # set +x 00:25:54.716 [2024-04-16 23:03:45.686071] Starting SPDK v24.01.1-pre git sha1 4b134b4ab / DPDK 23.11.0 initialization... 00:25:54.716 [2024-04-16 23:03:45.686144] [ DPDK EAL parameters: nvmf -c 0xE --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:25:54.716 EAL: No free 2048 kB hugepages reported on node 1 00:25:54.716 [2024-04-16 23:03:45.753371] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 3 00:25:54.973 [2024-04-16 23:03:45.869667] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:25:54.973 [2024-04-16 23:03:45.869839] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:25:54.973 [2024-04-16 23:03:45.869858] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:25:54.973 [2024-04-16 23:03:45.869873] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:25:54.973 [2024-04-16 23:03:45.869959] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:25:54.973 [2024-04-16 23:03:45.870075] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:25:54.973 [2024-04-16 23:03:45.870078] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:25:55.542 23:03:46 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:25:55.542 23:03:46 -- common/autotest_common.sh@852 -- # return 0 00:25:55.542 23:03:46 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:25:55.542 23:03:46 -- common/autotest_common.sh@718 -- # xtrace_disable 00:25:55.542 23:03:46 -- common/autotest_common.sh@10 -- # set +x 00:25:55.542 23:03:46 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:25:55.542 23:03:46 -- host/bdevperf.sh@17 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:25:55.542 23:03:46 -- common/autotest_common.sh@551 -- # xtrace_disable 00:25:55.542 23:03:46 -- common/autotest_common.sh@10 -- # set +x 00:25:55.542 [2024-04-16 23:03:46.655251] tcp.c: 659:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:25:55.542 23:03:46 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:25:55.542 23:03:46 -- host/bdevperf.sh@18 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc0 00:25:55.542 23:03:46 -- common/autotest_common.sh@551 -- # xtrace_disable 00:25:55.542 23:03:46 -- common/autotest_common.sh@10 -- # set +x 00:25:55.827 Malloc0 00:25:55.827 23:03:46 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:25:55.827 23:03:46 -- host/bdevperf.sh@19 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:25:55.827 23:03:46 -- common/autotest_common.sh@551 -- # xtrace_disable 00:25:55.827 23:03:46 -- common/autotest_common.sh@10 -- # set +x 00:25:55.827 23:03:46 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:25:55.827 23:03:46 -- host/bdevperf.sh@20 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:25:55.827 23:03:46 -- common/autotest_common.sh@551 -- # xtrace_disable 00:25:55.827 23:03:46 -- common/autotest_common.sh@10 -- # set +x 00:25:55.827 23:03:46 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:25:55.827 23:03:46 -- host/bdevperf.sh@21 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:25:55.827 23:03:46 -- common/autotest_common.sh@551 -- # xtrace_disable 00:25:55.827 23:03:46 -- common/autotest_common.sh@10 -- # set +x 00:25:55.827 [2024-04-16 23:03:46.728356] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:25:55.827 23:03:46 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:25:55.827 23:03:46 -- host/bdevperf.sh@27 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf --json /dev/fd/62 -q 128 -o 4096 -w verify -t 1 00:25:55.827 23:03:46 -- host/bdevperf.sh@27 -- # gen_nvmf_target_json 00:25:55.827 23:03:46 -- nvmf/common.sh@520 -- # config=() 00:25:55.827 23:03:46 -- nvmf/common.sh@520 -- # local subsystem config 00:25:55.827 23:03:46 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:25:55.827 23:03:46 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:25:55.827 { 00:25:55.827 "params": { 00:25:55.827 "name": "Nvme$subsystem", 00:25:55.827 "trtype": "$TEST_TRANSPORT", 00:25:55.827 "traddr": "$NVMF_FIRST_TARGET_IP", 00:25:55.827 "adrfam": "ipv4", 00:25:55.827 "trsvcid": "$NVMF_PORT", 00:25:55.827 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:25:55.827 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:25:55.827 "hdgst": ${hdgst:-false}, 00:25:55.827 "ddgst": ${ddgst:-false} 00:25:55.827 }, 00:25:55.827 "method": "bdev_nvme_attach_controller" 00:25:55.827 } 00:25:55.827 EOF 00:25:55.827 )") 00:25:55.827 23:03:46 -- nvmf/common.sh@542 -- # cat 00:25:55.827 23:03:46 -- nvmf/common.sh@544 -- # jq . 00:25:55.827 23:03:46 -- nvmf/common.sh@545 -- # IFS=, 00:25:55.827 23:03:46 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:25:55.827 "params": { 00:25:55.827 "name": "Nvme1", 00:25:55.827 "trtype": "tcp", 00:25:55.827 "traddr": "10.0.0.2", 00:25:55.827 "adrfam": "ipv4", 00:25:55.827 "trsvcid": "4420", 00:25:55.827 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:25:55.827 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:25:55.827 "hdgst": false, 00:25:55.827 "ddgst": false 00:25:55.827 }, 00:25:55.827 "method": "bdev_nvme_attach_controller" 00:25:55.827 }' 00:25:55.827 [2024-04-16 23:03:46.772705] Starting SPDK v24.01.1-pre git sha1 4b134b4ab / DPDK 23.11.0 initialization... 00:25:55.827 [2024-04-16 23:03:46.772774] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid387697 ] 00:25:55.827 EAL: No free 2048 kB hugepages reported on node 1 00:25:55.827 [2024-04-16 23:03:46.832289] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:25:56.085 [2024-04-16 23:03:46.940131] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:25:56.085 Running I/O for 1 seconds... 00:25:57.023 00:25:57.023 Latency(us) 00:25:57.023 Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:25:57.023 Job: Nvme1n1 (Core Mask 0x1, workload: verify, depth: 128, IO size: 4096) 00:25:57.023 Verification LBA range: start 0x0 length 0x4000 00:25:57.023 Nvme1n1 : 1.01 12971.73 50.67 0.00 0.00 9822.94 1037.65 16699.54 00:25:57.023 =================================================================================================================== 00:25:57.023 Total : 12971.73 50.67 0.00 0.00 9822.94 1037.65 16699.54 00:25:57.281 23:03:48 -- host/bdevperf.sh@30 -- # bdevperfpid=387935 00:25:57.281 23:03:48 -- host/bdevperf.sh@32 -- # sleep 3 00:25:57.281 23:03:48 -- host/bdevperf.sh@29 -- # gen_nvmf_target_json 00:25:57.281 23:03:48 -- host/bdevperf.sh@29 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf --json /dev/fd/63 -q 128 -o 4096 -w verify -t 15 -f 00:25:57.281 23:03:48 -- nvmf/common.sh@520 -- # config=() 00:25:57.281 23:03:48 -- nvmf/common.sh@520 -- # local subsystem config 00:25:57.281 23:03:48 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:25:57.281 23:03:48 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:25:57.281 { 00:25:57.281 "params": { 00:25:57.281 "name": "Nvme$subsystem", 00:25:57.281 "trtype": "$TEST_TRANSPORT", 00:25:57.281 "traddr": "$NVMF_FIRST_TARGET_IP", 00:25:57.281 "adrfam": "ipv4", 00:25:57.281 "trsvcid": "$NVMF_PORT", 00:25:57.281 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:25:57.281 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:25:57.281 "hdgst": ${hdgst:-false}, 00:25:57.281 "ddgst": ${ddgst:-false} 00:25:57.281 }, 00:25:57.281 "method": "bdev_nvme_attach_controller" 00:25:57.281 } 00:25:57.281 EOF 00:25:57.281 )") 00:25:57.281 23:03:48 -- nvmf/common.sh@542 -- # cat 00:25:57.281 23:03:48 -- nvmf/common.sh@544 -- # jq . 00:25:57.281 23:03:48 -- nvmf/common.sh@545 -- # IFS=, 00:25:57.281 23:03:48 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:25:57.281 "params": { 00:25:57.281 "name": "Nvme1", 00:25:57.281 "trtype": "tcp", 00:25:57.281 "traddr": "10.0.0.2", 00:25:57.281 "adrfam": "ipv4", 00:25:57.281 "trsvcid": "4420", 00:25:57.281 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:25:57.281 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:25:57.281 "hdgst": false, 00:25:57.281 "ddgst": false 00:25:57.281 }, 00:25:57.281 "method": "bdev_nvme_attach_controller" 00:25:57.281 }' 00:25:57.540 [2024-04-16 23:03:48.426435] Starting SPDK v24.01.1-pre git sha1 4b134b4ab / DPDK 23.11.0 initialization... 00:25:57.540 [2024-04-16 23:03:48.426553] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid387935 ] 00:25:57.540 EAL: No free 2048 kB hugepages reported on node 1 00:25:57.540 [2024-04-16 23:03:48.488619] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:25:57.540 [2024-04-16 23:03:48.597490] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:25:57.798 Running I/O for 15 seconds... 00:26:00.335 23:03:51 -- host/bdevperf.sh@33 -- # kill -9 387540 00:26:00.335 23:03:51 -- host/bdevperf.sh@35 -- # sleep 3 00:26:00.335 [2024-04-16 23:03:51.400201] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:86 nsid:1 lba:127416 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:00.335 [2024-04-16 23:03:51.400266] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:00.335 [2024-04-16 23:03:51.400305] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:44 nsid:1 lba:127432 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:00.335 [2024-04-16 23:03:51.400325] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:00.335 [2024-04-16 23:03:51.400343] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:30 nsid:1 lba:126848 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:00.335 [2024-04-16 23:03:51.400359] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:00.335 [2024-04-16 23:03:51.400375] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:21 nsid:1 lba:126856 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:00.335 [2024-04-16 23:03:51.400390] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:00.335 [2024-04-16 23:03:51.400407] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:59 nsid:1 lba:126872 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:00.335 [2024-04-16 23:03:51.400422] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:00.335 [2024-04-16 23:03:51.400439] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:28 nsid:1 lba:126896 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:00.335 [2024-04-16 23:03:51.400469] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:00.335 [2024-04-16 23:03:51.400486] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:124 nsid:1 lba:126904 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:00.335 [2024-04-16 23:03:51.400500] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:00.335 [2024-04-16 23:03:51.400532] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:114 nsid:1 lba:126920 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:00.335 [2024-04-16 23:03:51.400550] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:00.335 [2024-04-16 23:03:51.400570] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:47 nsid:1 lba:126944 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:00.335 [2024-04-16 23:03:51.400588] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:00.335 [2024-04-16 23:03:51.400609] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:105 nsid:1 lba:126968 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:00.335 [2024-04-16 23:03:51.400624] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:00.335 [2024-04-16 23:03:51.400641] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:71 nsid:1 lba:127440 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:00.335 [2024-04-16 23:03:51.400656] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:00.336 [2024-04-16 23:03:51.400673] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:127464 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:00.336 [2024-04-16 23:03:51.400691] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:00.336 [2024-04-16 23:03:51.400711] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:70 nsid:1 lba:127472 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:00.336 [2024-04-16 23:03:51.400728] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:00.336 [2024-04-16 23:03:51.400748] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:43 nsid:1 lba:127496 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:00.336 [2024-04-16 23:03:51.400769] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:00.336 [2024-04-16 23:03:51.400790] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:76 nsid:1 lba:127504 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:00.336 [2024-04-16 23:03:51.400809] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:00.336 [2024-04-16 23:03:51.400830] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:85 nsid:1 lba:127512 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:00.336 [2024-04-16 23:03:51.400845] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:00.336 [2024-04-16 23:03:51.400863] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:29 nsid:1 lba:127528 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:00.336 [2024-04-16 23:03:51.400878] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:00.336 [2024-04-16 23:03:51.400895] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:112 nsid:1 lba:127536 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:00.336 [2024-04-16 23:03:51.400911] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:00.336 [2024-04-16 23:03:51.400927] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:107 nsid:1 lba:127544 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:00.336 [2024-04-16 23:03:51.400942] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:00.336 [2024-04-16 23:03:51.400959] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:104 nsid:1 lba:126984 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:00.336 [2024-04-16 23:03:51.400975] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:00.336 [2024-04-16 23:03:51.400993] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:127000 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:00.336 [2024-04-16 23:03:51.401008] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:00.336 [2024-04-16 23:03:51.401025] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:127016 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:00.336 [2024-04-16 23:03:51.401040] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:00.336 [2024-04-16 23:03:51.401057] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:120 nsid:1 lba:127024 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:00.336 [2024-04-16 23:03:51.401072] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:00.336 [2024-04-16 23:03:51.401089] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:78 nsid:1 lba:127032 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:00.336 [2024-04-16 23:03:51.401104] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:00.336 [2024-04-16 23:03:51.401121] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:79 nsid:1 lba:127040 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:00.336 [2024-04-16 23:03:51.401136] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:00.336 [2024-04-16 23:03:51.401153] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:25 nsid:1 lba:127048 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:00.336 [2024-04-16 23:03:51.401168] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:00.336 [2024-04-16 23:03:51.401199] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:113 nsid:1 lba:127056 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:00.336 [2024-04-16 23:03:51.401234] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:00.336 [2024-04-16 23:03:51.401250] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:55 nsid:1 lba:127552 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:00.336 [2024-04-16 23:03:51.401264] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:00.336 [2024-04-16 23:03:51.401279] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:90 nsid:1 lba:127560 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:00.336 [2024-04-16 23:03:51.401293] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:00.336 [2024-04-16 23:03:51.401308] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:38 nsid:1 lba:127568 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:00.336 [2024-04-16 23:03:51.401321] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:00.336 [2024-04-16 23:03:51.401336] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:127584 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:00.336 [2024-04-16 23:03:51.401350] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:00.336 [2024-04-16 23:03:51.401364] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:72 nsid:1 lba:127592 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:00.336 [2024-04-16 23:03:51.401378] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:00.336 [2024-04-16 23:03:51.401393] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:35 nsid:1 lba:127600 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:00.336 [2024-04-16 23:03:51.401407] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:00.336 [2024-04-16 23:03:51.401422] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:31 nsid:1 lba:127608 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:00.336 [2024-04-16 23:03:51.401436] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:00.336 [2024-04-16 23:03:51.401451] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:93 nsid:1 lba:127624 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:00.336 [2024-04-16 23:03:51.401479] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:00.336 [2024-04-16 23:03:51.401494] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:16 nsid:1 lba:127632 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:00.336 [2024-04-16 23:03:51.401507] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:00.336 [2024-04-16 23:03:51.401522] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:80 nsid:1 lba:127664 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:00.336 [2024-04-16 23:03:51.401553] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:00.336 [2024-04-16 23:03:51.401570] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:12 nsid:1 lba:127680 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:00.336 [2024-04-16 23:03:51.401585] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:00.336 [2024-04-16 23:03:51.401602] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:84 nsid:1 lba:127064 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:00.336 [2024-04-16 23:03:51.401621] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:00.336 [2024-04-16 23:03:51.401638] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:69 nsid:1 lba:127072 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:00.336 [2024-04-16 23:03:51.401653] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:00.336 [2024-04-16 23:03:51.401670] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:115 nsid:1 lba:127080 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:00.336 [2024-04-16 23:03:51.401686] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:00.336 [2024-04-16 23:03:51.401702] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:23 nsid:1 lba:127104 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:00.336 [2024-04-16 23:03:51.401717] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:00.336 [2024-04-16 23:03:51.401734] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:92 nsid:1 lba:127112 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:00.336 [2024-04-16 23:03:51.401749] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:00.336 [2024-04-16 23:03:51.401766] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:22 nsid:1 lba:127120 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:00.336 [2024-04-16 23:03:51.401781] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:00.336 [2024-04-16 23:03:51.401798] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:111 nsid:1 lba:127168 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:00.336 [2024-04-16 23:03:51.401813] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:00.336 [2024-04-16 23:03:51.401829] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:39 nsid:1 lba:127176 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:00.336 [2024-04-16 23:03:51.401844] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:00.336 [2024-04-16 23:03:51.401860] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:54 nsid:1 lba:127688 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:00.336 [2024-04-16 23:03:51.401876] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:00.336 [2024-04-16 23:03:51.401892] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:18 nsid:1 lba:127696 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:00.336 [2024-04-16 23:03:51.401907] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:00.336 [2024-04-16 23:03:51.401924] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:82 nsid:1 lba:127200 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:00.336 [2024-04-16 23:03:51.401939] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:00.336 [2024-04-16 23:03:51.401956] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:127208 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:00.336 [2024-04-16 23:03:51.401971] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:00.336 [2024-04-16 23:03:51.401987] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:37 nsid:1 lba:127216 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:00.336 [2024-04-16 23:03:51.402002] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:00.337 [2024-04-16 23:03:51.402023] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:60 nsid:1 lba:127224 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:00.337 [2024-04-16 23:03:51.402039] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:00.337 [2024-04-16 23:03:51.402057] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:66 nsid:1 lba:127272 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:00.337 [2024-04-16 23:03:51.402072] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:00.337 [2024-04-16 23:03:51.402089] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:51 nsid:1 lba:127280 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:00.337 [2024-04-16 23:03:51.402104] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:00.337 [2024-04-16 23:03:51.402121] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:122 nsid:1 lba:127352 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:00.337 [2024-04-16 23:03:51.402136] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:00.337 [2024-04-16 23:03:51.402152] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:68 nsid:1 lba:127368 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:00.337 [2024-04-16 23:03:51.402167] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:00.337 [2024-04-16 23:03:51.402190] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:127704 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:00.337 [2024-04-16 23:03:51.402207] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:00.337 [2024-04-16 23:03:51.402249] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:108 nsid:1 lba:127712 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:00.337 [2024-04-16 23:03:51.402263] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:00.337 [2024-04-16 23:03:51.402278] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:58 nsid:1 lba:127720 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:00.337 [2024-04-16 23:03:51.402291] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:00.337 [2024-04-16 23:03:51.402306] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:62 nsid:1 lba:127728 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:00.337 [2024-04-16 23:03:51.402320] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:00.337 [2024-04-16 23:03:51.402335] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:83 nsid:1 lba:127736 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:00.337 [2024-04-16 23:03:51.402349] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:00.337 [2024-04-16 23:03:51.402363] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:99 nsid:1 lba:127744 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:00.337 [2024-04-16 23:03:51.402378] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:00.337 [2024-04-16 23:03:51.402393] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:42 nsid:1 lba:127752 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:00.337 [2024-04-16 23:03:51.402407] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:00.337 [2024-04-16 23:03:51.402421] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:89 nsid:1 lba:127760 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:00.337 [2024-04-16 23:03:51.402439] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:00.337 [2024-04-16 23:03:51.402455] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:95 nsid:1 lba:127768 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:00.337 [2024-04-16 23:03:51.402483] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:00.337 [2024-04-16 23:03:51.402497] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:106 nsid:1 lba:127776 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:00.337 [2024-04-16 23:03:51.402510] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:00.337 [2024-04-16 23:03:51.402540] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:117 nsid:1 lba:127784 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:00.337 [2024-04-16 23:03:51.402556] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:00.337 [2024-04-16 23:03:51.402572] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:10 nsid:1 lba:127792 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:00.337 [2024-04-16 23:03:51.402587] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:00.337 [2024-04-16 23:03:51.402605] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:74 nsid:1 lba:127800 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:00.337 [2024-04-16 23:03:51.402621] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:00.337 [2024-04-16 23:03:51.402637] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:91 nsid:1 lba:127808 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:00.337 [2024-04-16 23:03:51.402653] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:00.337 [2024-04-16 23:03:51.402669] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:126 nsid:1 lba:127816 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:00.337 [2024-04-16 23:03:51.402685] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:00.337 [2024-04-16 23:03:51.402701] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:109 nsid:1 lba:127824 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:00.337 [2024-04-16 23:03:51.402716] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:00.337 [2024-04-16 23:03:51.402733] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:64 nsid:1 lba:127832 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:00.337 [2024-04-16 23:03:51.402748] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:00.337 [2024-04-16 23:03:51.402764] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:46 nsid:1 lba:127840 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:00.337 [2024-04-16 23:03:51.402779] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:00.337 [2024-04-16 23:03:51.402796] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:127848 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:00.337 [2024-04-16 23:03:51.402811] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:00.337 [2024-04-16 23:03:51.402827] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:63 nsid:1 lba:127856 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:00.337 [2024-04-16 23:03:51.402842] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:00.337 [2024-04-16 23:03:51.402859] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:5 nsid:1 lba:127864 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:00.337 [2024-04-16 23:03:51.402878] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:00.337 [2024-04-16 23:03:51.402895] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:123 nsid:1 lba:127872 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:00.337 [2024-04-16 23:03:51.402911] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:00.337 [2024-04-16 23:03:51.402928] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:50 nsid:1 lba:127880 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:00.337 [2024-04-16 23:03:51.402943] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:00.337 [2024-04-16 23:03:51.402959] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:97 nsid:1 lba:127888 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:00.337 [2024-04-16 23:03:51.402975] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:00.337 [2024-04-16 23:03:51.402991] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:100 nsid:1 lba:127896 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:00.337 [2024-04-16 23:03:51.403006] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:00.337 [2024-04-16 23:03:51.403022] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:125 nsid:1 lba:127384 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:00.337 [2024-04-16 23:03:51.403037] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:00.337 [2024-04-16 23:03:51.403053] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:20 nsid:1 lba:127392 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:00.337 [2024-04-16 23:03:51.403069] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:00.337 [2024-04-16 23:03:51.403086] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:32 nsid:1 lba:127400 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:00.337 [2024-04-16 23:03:51.403101] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:00.337 [2024-04-16 23:03:51.403117] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:81 nsid:1 lba:127408 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:00.337 [2024-04-16 23:03:51.403133] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:00.337 [2024-04-16 23:03:51.403150] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:127424 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:00.337 [2024-04-16 23:03:51.403165] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:00.337 [2024-04-16 23:03:51.403189] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:27 nsid:1 lba:127448 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:00.337 [2024-04-16 23:03:51.403206] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:00.337 [2024-04-16 23:03:51.403238] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:56 nsid:1 lba:127456 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:00.337 [2024-04-16 23:03:51.403252] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:00.337 [2024-04-16 23:03:51.403267] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:40 nsid:1 lba:127480 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:00.337 [2024-04-16 23:03:51.403281] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:00.337 [2024-04-16 23:03:51.403302] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:127904 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:00.337 [2024-04-16 23:03:51.403317] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:00.337 [2024-04-16 23:03:51.403333] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:119 nsid:1 lba:127912 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:00.338 [2024-04-16 23:03:51.403347] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:00.338 [2024-04-16 23:03:51.403361] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:103 nsid:1 lba:127920 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:00.338 [2024-04-16 23:03:51.403375] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:00.338 [2024-04-16 23:03:51.403390] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:127928 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:00.338 [2024-04-16 23:03:51.403404] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:00.338 [2024-04-16 23:03:51.403419] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:118 nsid:1 lba:127936 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:00.338 [2024-04-16 23:03:51.403433] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:00.338 [2024-04-16 23:03:51.403448] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:17 nsid:1 lba:127944 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:00.338 [2024-04-16 23:03:51.403475] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:00.338 [2024-04-16 23:03:51.403490] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:26 nsid:1 lba:127952 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:00.338 [2024-04-16 23:03:51.403502] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:00.338 [2024-04-16 23:03:51.403516] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:110 nsid:1 lba:127960 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:00.338 [2024-04-16 23:03:51.403547] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:00.338 [2024-04-16 23:03:51.403564] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:57 nsid:1 lba:127968 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:00.338 [2024-04-16 23:03:51.403591] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:00.338 [2024-04-16 23:03:51.403609] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:45 nsid:1 lba:127976 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:00.338 [2024-04-16 23:03:51.403625] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:00.338 [2024-04-16 23:03:51.403642] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:24 nsid:1 lba:127984 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:00.338 [2024-04-16 23:03:51.403658] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:00.338 [2024-04-16 23:03:51.403675] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:3 nsid:1 lba:127992 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:00.338 [2024-04-16 23:03:51.403690] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:00.338 [2024-04-16 23:03:51.403707] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:19 nsid:1 lba:128000 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:00.338 [2024-04-16 23:03:51.403727] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:00.338 [2024-04-16 23:03:51.403744] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:52 nsid:1 lba:128008 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:00.338 [2024-04-16 23:03:51.403760] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:00.338 [2024-04-16 23:03:51.403776] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:98 nsid:1 lba:128016 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:00.338 [2024-04-16 23:03:51.403792] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:00.338 [2024-04-16 23:03:51.403809] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:33 nsid:1 lba:128024 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:00.338 [2024-04-16 23:03:51.403824] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:00.338 [2024-04-16 23:03:51.403840] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:53 nsid:1 lba:128032 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:00.338 [2024-04-16 23:03:51.403856] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:00.338 [2024-04-16 23:03:51.403873] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:94 nsid:1 lba:128040 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:00.338 [2024-04-16 23:03:51.403888] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:00.338 [2024-04-16 23:03:51.403905] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:102 nsid:1 lba:128048 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:00.338 [2024-04-16 23:03:51.403920] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:00.338 [2024-04-16 23:03:51.403937] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:67 nsid:1 lba:128056 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:00.338 [2024-04-16 23:03:51.403952] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:00.338 [2024-04-16 23:03:51.403969] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:41 nsid:1 lba:128064 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:00.338 [2024-04-16 23:03:51.403984] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:00.338 [2024-04-16 23:03:51.404001] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:96 nsid:1 lba:128072 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:00.338 [2024-04-16 23:03:51.404016] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:00.338 [2024-04-16 23:03:51.404032] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:87 nsid:1 lba:128080 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:00.338 [2024-04-16 23:03:51.404048] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:00.338 [2024-04-16 23:03:51.404064] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:128088 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:00.338 [2024-04-16 23:03:51.404079] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:00.338 [2024-04-16 23:03:51.404096] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:75 nsid:1 lba:128096 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:00.338 [2024-04-16 23:03:51.404111] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:00.338 [2024-04-16 23:03:51.404132] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:101 nsid:1 lba:128104 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:00.338 [2024-04-16 23:03:51.404148] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:00.338 [2024-04-16 23:03:51.404165] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:116 nsid:1 lba:128112 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:00.338 [2024-04-16 23:03:51.404187] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:00.338 [2024-04-16 23:03:51.404222] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:49 nsid:1 lba:128120 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:00.338 [2024-04-16 23:03:51.404239] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:00.338 [2024-04-16 23:03:51.404255] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:73 nsid:1 lba:128128 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:00.338 [2024-04-16 23:03:51.404269] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:00.338 [2024-04-16 23:03:51.404284] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:88 nsid:1 lba:128136 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:00.338 [2024-04-16 23:03:51.404298] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:00.338 [2024-04-16 23:03:51.404314] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:8 nsid:1 lba:128144 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:00.338 [2024-04-16 23:03:51.404328] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:00.338 [2024-04-16 23:03:51.404343] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:121 nsid:1 lba:127488 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:00.338 [2024-04-16 23:03:51.404358] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:00.338 [2024-04-16 23:03:51.404373] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:34 nsid:1 lba:127520 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:00.338 [2024-04-16 23:03:51.404387] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:00.338 [2024-04-16 23:03:51.404402] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:77 nsid:1 lba:127576 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:00.338 [2024-04-16 23:03:51.404416] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:00.338 [2024-04-16 23:03:51.404441] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:61 nsid:1 lba:127616 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:00.338 [2024-04-16 23:03:51.404470] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:00.338 [2024-04-16 23:03:51.404489] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:36 nsid:1 lba:127640 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:00.338 [2024-04-16 23:03:51.404504] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:00.338 [2024-04-16 23:03:51.404521] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:65 nsid:1 lba:127648 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:00.338 [2024-04-16 23:03:51.404537] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:00.338 [2024-04-16 23:03:51.404554] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:48 nsid:1 lba:127656 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:00.338 [2024-04-16 23:03:51.404574] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:00.338 [2024-04-16 23:03:51.404591] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1be13a0 is same with the state(5) to be set 00:26:00.338 [2024-04-16 23:03:51.404610] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:26:00.338 [2024-04-16 23:03:51.404623] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:26:00.338 [2024-04-16 23:03:51.404636] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:127672 len:8 PRP1 0x0 PRP2 0x0 00:26:00.338 [2024-04-16 23:03:51.404650] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:00.338 [2024-04-16 23:03:51.404718] bdev_nvme.c:1576:bdev_nvme_disconnected_qpair_cb: *NOTICE*: qpair 0x1be13a0 was disconnected and freed. reset controller. 00:26:00.338 [2024-04-16 23:03:51.407191] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:00.338 [2024-04-16 23:03:51.407287] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1bc2400 (9): Bad file descriptor 00:26:00.339 [2024-04-16 23:03:51.407787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:00.339 [2024-04-16 23:03:51.408027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:00.339 [2024-04-16 23:03:51.408088] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1bc2400 with addr=10.0.0.2, port=4420 00:26:00.339 [2024-04-16 23:03:51.408106] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1bc2400 is same with the state(5) to be set 00:26:00.339 [2024-04-16 23:03:51.408492] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1bc2400 (9): Bad file descriptor 00:26:00.339 [2024-04-16 23:03:51.408664] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:00.339 [2024-04-16 23:03:51.408687] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:00.339 [2024-04-16 23:03:51.408705] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:00.339 [2024-04-16 23:03:51.411044] bdev_nvme.c:2024:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:00.339 [2024-04-16 23:03:51.420015] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:00.339 [2024-04-16 23:03:51.420381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:00.339 [2024-04-16 23:03:51.420560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:00.339 [2024-04-16 23:03:51.420586] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1bc2400 with addr=10.0.0.2, port=4420 00:26:00.339 [2024-04-16 23:03:51.420603] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1bc2400 is same with the state(5) to be set 00:26:00.339 [2024-04-16 23:03:51.420784] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1bc2400 (9): Bad file descriptor 00:26:00.339 [2024-04-16 23:03:51.420947] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:00.339 [2024-04-16 23:03:51.420972] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:00.339 [2024-04-16 23:03:51.420987] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:00.339 [2024-04-16 23:03:51.423409] bdev_nvme.c:2024:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:00.339 [2024-04-16 23:03:51.432815] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:00.339 [2024-04-16 23:03:51.433142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:00.339 [2024-04-16 23:03:51.433353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:00.339 [2024-04-16 23:03:51.433384] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1bc2400 with addr=10.0.0.2, port=4420 00:26:00.339 [2024-04-16 23:03:51.433402] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1bc2400 is same with the state(5) to be set 00:26:00.339 [2024-04-16 23:03:51.433566] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1bc2400 (9): Bad file descriptor 00:26:00.339 [2024-04-16 23:03:51.433768] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:00.339 [2024-04-16 23:03:51.433793] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:00.339 [2024-04-16 23:03:51.433809] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:00.339 [2024-04-16 23:03:51.436155] bdev_nvme.c:2024:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:00.339 [2024-04-16 23:03:51.445192] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:00.339 [2024-04-16 23:03:51.445549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:00.339 [2024-04-16 23:03:51.445730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:00.339 [2024-04-16 23:03:51.445757] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1bc2400 with addr=10.0.0.2, port=4420 00:26:00.339 [2024-04-16 23:03:51.445790] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1bc2400 is same with the state(5) to be set 00:26:00.339 [2024-04-16 23:03:51.445937] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1bc2400 (9): Bad file descriptor 00:26:00.339 [2024-04-16 23:03:51.446142] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:00.339 [2024-04-16 23:03:51.446165] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:00.339 [2024-04-16 23:03:51.446190] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:00.339 [2024-04-16 23:03:51.448546] bdev_nvme.c:2024:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:00.339 [2024-04-16 23:03:51.457715] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:00.339 [2024-04-16 23:03:51.458083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:00.339 [2024-04-16 23:03:51.458289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:00.339 [2024-04-16 23:03:51.458316] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1bc2400 with addr=10.0.0.2, port=4420 00:26:00.339 [2024-04-16 23:03:51.458332] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1bc2400 is same with the state(5) to be set 00:26:00.339 [2024-04-16 23:03:51.458513] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1bc2400 (9): Bad file descriptor 00:26:00.339 [2024-04-16 23:03:51.458716] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:00.339 [2024-04-16 23:03:51.458741] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:00.339 [2024-04-16 23:03:51.458757] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:00.599 [2024-04-16 23:03:51.461346] bdev_nvme.c:2024:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:00.599 [2024-04-16 23:03:51.470483] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:00.599 [2024-04-16 23:03:51.470877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:00.599 [2024-04-16 23:03:51.471010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:00.599 [2024-04-16 23:03:51.471039] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1bc2400 with addr=10.0.0.2, port=4420 00:26:00.599 [2024-04-16 23:03:51.471063] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1bc2400 is same with the state(5) to be set 00:26:00.599 [2024-04-16 23:03:51.471225] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1bc2400 (9): Bad file descriptor 00:26:00.599 [2024-04-16 23:03:51.471395] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:00.599 [2024-04-16 23:03:51.471419] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:00.599 [2024-04-16 23:03:51.471434] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:00.599 [2024-04-16 23:03:51.473790] bdev_nvme.c:2024:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:00.599 [2024-04-16 23:03:51.483025] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:00.599 [2024-04-16 23:03:51.483359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:00.599 [2024-04-16 23:03:51.483676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:00.599 [2024-04-16 23:03:51.483727] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1bc2400 with addr=10.0.0.2, port=4420 00:26:00.599 [2024-04-16 23:03:51.483744] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1bc2400 is same with the state(5) to be set 00:26:00.599 [2024-04-16 23:03:51.483873] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1bc2400 (9): Bad file descriptor 00:26:00.599 [2024-04-16 23:03:51.484004] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:00.599 [2024-04-16 23:03:51.484027] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:00.599 [2024-04-16 23:03:51.484043] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:00.599 [2024-04-16 23:03:51.486284] bdev_nvme.c:2024:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:00.599 [2024-04-16 23:03:51.495651] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:00.599 [2024-04-16 23:03:51.495956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:00.599 [2024-04-16 23:03:51.496101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:00.599 [2024-04-16 23:03:51.496129] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1bc2400 with addr=10.0.0.2, port=4420 00:26:00.599 [2024-04-16 23:03:51.496146] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1bc2400 is same with the state(5) to be set 00:26:00.599 [2024-04-16 23:03:51.496323] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1bc2400 (9): Bad file descriptor 00:26:00.599 [2024-04-16 23:03:51.496509] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:00.599 [2024-04-16 23:03:51.496532] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:00.599 [2024-04-16 23:03:51.496548] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:00.599 [2024-04-16 23:03:51.498720] bdev_nvme.c:2024:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:00.599 [2024-04-16 23:03:51.508374] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:00.599 [2024-04-16 23:03:51.508796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:00.599 [2024-04-16 23:03:51.508974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:00.599 [2024-04-16 23:03:51.509003] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1bc2400 with addr=10.0.0.2, port=4420 00:26:00.599 [2024-04-16 23:03:51.509020] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1bc2400 is same with the state(5) to be set 00:26:00.600 [2024-04-16 23:03:51.509204] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1bc2400 (9): Bad file descriptor 00:26:00.600 [2024-04-16 23:03:51.509338] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:00.600 [2024-04-16 23:03:51.509361] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:00.600 [2024-04-16 23:03:51.509377] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:00.600 [2024-04-16 23:03:51.511748] bdev_nvme.c:2024:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:00.600 [2024-04-16 23:03:51.521053] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:00.600 [2024-04-16 23:03:51.521365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:00.600 [2024-04-16 23:03:51.521553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:00.600 [2024-04-16 23:03:51.521580] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1bc2400 with addr=10.0.0.2, port=4420 00:26:00.600 [2024-04-16 23:03:51.521598] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1bc2400 is same with the state(5) to be set 00:26:00.600 [2024-04-16 23:03:51.521745] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1bc2400 (9): Bad file descriptor 00:26:00.600 [2024-04-16 23:03:51.521949] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:00.600 [2024-04-16 23:03:51.521973] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:00.600 [2024-04-16 23:03:51.521989] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:00.600 [2024-04-16 23:03:51.524337] bdev_nvme.c:2024:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:00.600 [2024-04-16 23:03:51.533505] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:00.600 [2024-04-16 23:03:51.533888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:00.600 [2024-04-16 23:03:51.534039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:00.600 [2024-04-16 23:03:51.534067] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1bc2400 with addr=10.0.0.2, port=4420 00:26:00.600 [2024-04-16 23:03:51.534084] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1bc2400 is same with the state(5) to be set 00:26:00.600 [2024-04-16 23:03:51.534244] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1bc2400 (9): Bad file descriptor 00:26:00.600 [2024-04-16 23:03:51.534413] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:00.600 [2024-04-16 23:03:51.534437] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:00.600 [2024-04-16 23:03:51.534452] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:00.600 [2024-04-16 23:03:51.536686] bdev_nvme.c:2024:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:00.600 [2024-04-16 23:03:51.545926] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:00.600 [2024-04-16 23:03:51.546237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:00.600 [2024-04-16 23:03:51.546442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:00.600 [2024-04-16 23:03:51.546467] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1bc2400 with addr=10.0.0.2, port=4420 00:26:00.600 [2024-04-16 23:03:51.546483] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1bc2400 is same with the state(5) to be set 00:26:00.600 [2024-04-16 23:03:51.546692] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1bc2400 (9): Bad file descriptor 00:26:00.600 [2024-04-16 23:03:51.546892] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:00.600 [2024-04-16 23:03:51.546917] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:00.600 [2024-04-16 23:03:51.546932] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:00.600 [2024-04-16 23:03:51.548931] bdev_nvme.c:2024:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:00.600 [2024-04-16 23:03:51.558488] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:00.600 [2024-04-16 23:03:51.558802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:00.600 [2024-04-16 23:03:51.558967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:00.600 [2024-04-16 23:03:51.558995] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1bc2400 with addr=10.0.0.2, port=4420 00:26:00.600 [2024-04-16 23:03:51.559013] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1bc2400 is same with the state(5) to be set 00:26:00.600 [2024-04-16 23:03:51.559188] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1bc2400 (9): Bad file descriptor 00:26:00.600 [2024-04-16 23:03:51.559340] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:00.600 [2024-04-16 23:03:51.559363] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:00.600 [2024-04-16 23:03:51.559379] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:00.600 [2024-04-16 23:03:51.561733] bdev_nvme.c:2024:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:00.600 [2024-04-16 23:03:51.570986] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:00.600 [2024-04-16 23:03:51.571371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:00.600 [2024-04-16 23:03:51.571522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:00.600 [2024-04-16 23:03:51.571550] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1bc2400 with addr=10.0.0.2, port=4420 00:26:00.600 [2024-04-16 23:03:51.571567] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1bc2400 is same with the state(5) to be set 00:26:00.600 [2024-04-16 23:03:51.571750] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1bc2400 (9): Bad file descriptor 00:26:00.600 [2024-04-16 23:03:51.571901] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:00.600 [2024-04-16 23:03:51.571924] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:00.600 [2024-04-16 23:03:51.571939] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:00.600 [2024-04-16 23:03:51.574466] bdev_nvme.c:2024:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:00.600 [2024-04-16 23:03:51.583366] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:00.600 [2024-04-16 23:03:51.583728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:00.600 [2024-04-16 23:03:51.583894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:00.600 [2024-04-16 23:03:51.583924] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1bc2400 with addr=10.0.0.2, port=4420 00:26:00.600 [2024-04-16 23:03:51.583942] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1bc2400 is same with the state(5) to be set 00:26:00.600 [2024-04-16 23:03:51.584107] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1bc2400 (9): Bad file descriptor 00:26:00.600 [2024-04-16 23:03:51.584271] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:00.600 [2024-04-16 23:03:51.584300] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:00.600 [2024-04-16 23:03:51.584317] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:00.600 [2024-04-16 23:03:51.586620] bdev_nvme.c:2024:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:00.600 [2024-04-16 23:03:51.596162] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:00.600 [2024-04-16 23:03:51.596561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:00.600 [2024-04-16 23:03:51.596717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:00.600 [2024-04-16 23:03:51.596758] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1bc2400 with addr=10.0.0.2, port=4420 00:26:00.600 [2024-04-16 23:03:51.596774] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1bc2400 is same with the state(5) to be set 00:26:00.600 [2024-04-16 23:03:51.596939] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1bc2400 (9): Bad file descriptor 00:26:00.600 [2024-04-16 23:03:51.597129] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:00.600 [2024-04-16 23:03:51.597153] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:00.600 [2024-04-16 23:03:51.597168] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:00.600 [2024-04-16 23:03:51.599571] bdev_nvme.c:2024:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:00.600 [2024-04-16 23:03:51.608882] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:00.600 [2024-04-16 23:03:51.609235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:00.600 [2024-04-16 23:03:51.609395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:00.600 [2024-04-16 23:03:51.609423] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1bc2400 with addr=10.0.0.2, port=4420 00:26:00.600 [2024-04-16 23:03:51.609441] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1bc2400 is same with the state(5) to be set 00:26:00.600 [2024-04-16 23:03:51.609624] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1bc2400 (9): Bad file descriptor 00:26:00.600 [2024-04-16 23:03:51.609756] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:00.600 [2024-04-16 23:03:51.609779] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:00.600 [2024-04-16 23:03:51.609794] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:00.600 [2024-04-16 23:03:51.611969] bdev_nvme.c:2024:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:00.600 [2024-04-16 23:03:51.621734] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:00.600 [2024-04-16 23:03:51.622092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:00.600 [2024-04-16 23:03:51.622245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:00.600 [2024-04-16 23:03:51.622274] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1bc2400 with addr=10.0.0.2, port=4420 00:26:00.600 [2024-04-16 23:03:51.622291] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1bc2400 is same with the state(5) to be set 00:26:00.600 [2024-04-16 23:03:51.622474] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1bc2400 (9): Bad file descriptor 00:26:00.600 [2024-04-16 23:03:51.622625] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:00.600 [2024-04-16 23:03:51.622648] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:00.600 [2024-04-16 23:03:51.622668] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:00.601 [2024-04-16 23:03:51.624828] bdev_nvme.c:2024:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:00.601 [2024-04-16 23:03:51.634226] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:00.601 [2024-04-16 23:03:51.634583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:00.601 [2024-04-16 23:03:51.634770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:00.601 [2024-04-16 23:03:51.634799] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1bc2400 with addr=10.0.0.2, port=4420 00:26:00.601 [2024-04-16 23:03:51.634816] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1bc2400 is same with the state(5) to be set 00:26:00.601 [2024-04-16 23:03:51.634981] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1bc2400 (9): Bad file descriptor 00:26:00.601 [2024-04-16 23:03:51.635113] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:00.601 [2024-04-16 23:03:51.635136] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:00.601 [2024-04-16 23:03:51.635152] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:00.601 [2024-04-16 23:03:51.637630] bdev_nvme.c:2024:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:00.601 [2024-04-16 23:03:51.646900] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:00.601 [2024-04-16 23:03:51.647254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:00.601 [2024-04-16 23:03:51.647435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:00.601 [2024-04-16 23:03:51.647462] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1bc2400 with addr=10.0.0.2, port=4420 00:26:00.601 [2024-04-16 23:03:51.647478] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1bc2400 is same with the state(5) to be set 00:26:00.601 [2024-04-16 23:03:51.647650] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1bc2400 (9): Bad file descriptor 00:26:00.601 [2024-04-16 23:03:51.647810] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:00.601 [2024-04-16 23:03:51.647834] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:00.601 [2024-04-16 23:03:51.647849] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:00.601 [2024-04-16 23:03:51.650064] bdev_nvme.c:2024:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:00.601 [2024-04-16 23:03:51.659800] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:00.601 [2024-04-16 23:03:51.660127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:00.601 [2024-04-16 23:03:51.660301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:00.601 [2024-04-16 23:03:51.660330] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1bc2400 with addr=10.0.0.2, port=4420 00:26:00.601 [2024-04-16 23:03:51.660347] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1bc2400 is same with the state(5) to be set 00:26:00.601 [2024-04-16 23:03:51.660475] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1bc2400 (9): Bad file descriptor 00:26:00.601 [2024-04-16 23:03:51.660626] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:00.601 [2024-04-16 23:03:51.660649] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:00.601 [2024-04-16 23:03:51.660664] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:00.601 [2024-04-16 23:03:51.663103] bdev_nvme.c:2024:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:00.601 [2024-04-16 23:03:51.672313] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:00.601 [2024-04-16 23:03:51.672608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:00.601 [2024-04-16 23:03:51.672807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:00.601 [2024-04-16 23:03:51.672832] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1bc2400 with addr=10.0.0.2, port=4420 00:26:00.601 [2024-04-16 23:03:51.672848] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1bc2400 is same with the state(5) to be set 00:26:00.601 [2024-04-16 23:03:51.673013] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1bc2400 (9): Bad file descriptor 00:26:00.601 [2024-04-16 23:03:51.673143] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:00.601 [2024-04-16 23:03:51.673167] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:00.601 [2024-04-16 23:03:51.673192] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:00.601 [2024-04-16 23:03:51.675590] bdev_nvme.c:2024:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:00.601 [2024-04-16 23:03:51.684836] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:00.601 [2024-04-16 23:03:51.685169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:00.601 [2024-04-16 23:03:51.685314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:00.601 [2024-04-16 23:03:51.685342] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1bc2400 with addr=10.0.0.2, port=4420 00:26:00.601 [2024-04-16 23:03:51.685359] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1bc2400 is same with the state(5) to be set 00:26:00.601 [2024-04-16 23:03:51.685524] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1bc2400 (9): Bad file descriptor 00:26:00.601 [2024-04-16 23:03:51.685675] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:00.601 [2024-04-16 23:03:51.685699] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:00.601 [2024-04-16 23:03:51.685714] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:00.601 [2024-04-16 23:03:51.687878] bdev_nvme.c:2024:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:00.601 [2024-04-16 23:03:51.697115] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:00.601 [2024-04-16 23:03:51.697453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:00.601 [2024-04-16 23:03:51.697612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:00.601 [2024-04-16 23:03:51.697637] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1bc2400 with addr=10.0.0.2, port=4420 00:26:00.601 [2024-04-16 23:03:51.697652] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1bc2400 is same with the state(5) to be set 00:26:00.601 [2024-04-16 23:03:51.697768] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1bc2400 (9): Bad file descriptor 00:26:00.601 [2024-04-16 23:03:51.698012] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:00.601 [2024-04-16 23:03:51.698036] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:00.601 [2024-04-16 23:03:51.698051] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:00.601 [2024-04-16 23:03:51.700604] bdev_nvme.c:2024:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:00.601 [2024-04-16 23:03:51.709824] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:00.601 [2024-04-16 23:03:51.710226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:00.601 [2024-04-16 23:03:51.710379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:00.601 [2024-04-16 23:03:51.710404] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1bc2400 with addr=10.0.0.2, port=4420 00:26:00.601 [2024-04-16 23:03:51.710420] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1bc2400 is same with the state(5) to be set 00:26:00.601 [2024-04-16 23:03:51.710580] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1bc2400 (9): Bad file descriptor 00:26:00.601 [2024-04-16 23:03:51.710731] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:00.601 [2024-04-16 23:03:51.710755] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:00.601 [2024-04-16 23:03:51.710770] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:00.601 [2024-04-16 23:03:51.713112] bdev_nvme.c:2024:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:00.601 [2024-04-16 23:03:51.722437] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:00.601 [2024-04-16 23:03:51.722753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:00.601 [2024-04-16 23:03:51.722913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:00.601 [2024-04-16 23:03:51.722943] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1bc2400 with addr=10.0.0.2, port=4420 00:26:00.601 [2024-04-16 23:03:51.722961] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1bc2400 is same with the state(5) to be set 00:26:00.601 [2024-04-16 23:03:51.723144] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1bc2400 (9): Bad file descriptor 00:26:00.601 [2024-04-16 23:03:51.723324] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:00.601 [2024-04-16 23:03:51.723348] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:00.601 [2024-04-16 23:03:51.723364] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:00.601 [2024-04-16 23:03:51.725759] bdev_nvme.c:2024:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:00.862 [2024-04-16 23:03:51.734825] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:00.862 [2024-04-16 23:03:51.735205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:00.862 [2024-04-16 23:03:51.735372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:00.862 [2024-04-16 23:03:51.735401] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1bc2400 with addr=10.0.0.2, port=4420 00:26:00.862 [2024-04-16 23:03:51.735418] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1bc2400 is same with the state(5) to be set 00:26:00.862 [2024-04-16 23:03:51.735566] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1bc2400 (9): Bad file descriptor 00:26:00.862 [2024-04-16 23:03:51.735734] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:00.862 [2024-04-16 23:03:51.735758] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:00.862 [2024-04-16 23:03:51.735773] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:00.862 [2024-04-16 23:03:51.738089] bdev_nvme.c:2024:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:00.862 [2024-04-16 23:03:51.747378] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:00.862 [2024-04-16 23:03:51.747782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:00.862 [2024-04-16 23:03:51.747968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:00.862 [2024-04-16 23:03:51.747997] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1bc2400 with addr=10.0.0.2, port=4420 00:26:00.862 [2024-04-16 23:03:51.748014] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1bc2400 is same with the state(5) to be set 00:26:00.862 [2024-04-16 23:03:51.748244] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1bc2400 (9): Bad file descriptor 00:26:00.862 [2024-04-16 23:03:51.748414] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:00.862 [2024-04-16 23:03:51.748437] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:00.862 [2024-04-16 23:03:51.748453] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:00.862 [2024-04-16 23:03:51.750775] bdev_nvme.c:2024:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:00.862 [2024-04-16 23:03:51.760181] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:00.862 [2024-04-16 23:03:51.760664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:00.862 [2024-04-16 23:03:51.760803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:00.862 [2024-04-16 23:03:51.760831] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1bc2400 with addr=10.0.0.2, port=4420 00:26:00.862 [2024-04-16 23:03:51.760849] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1bc2400 is same with the state(5) to be set 00:26:00.862 [2024-04-16 23:03:51.760978] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1bc2400 (9): Bad file descriptor 00:26:00.862 [2024-04-16 23:03:51.761146] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:00.862 [2024-04-16 23:03:51.761170] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:00.862 [2024-04-16 23:03:51.761194] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:00.862 [2024-04-16 23:03:51.763356] bdev_nvme.c:2024:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:00.862 [2024-04-16 23:03:51.772926] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:00.862 [2024-04-16 23:03:51.773312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:00.862 [2024-04-16 23:03:51.773481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:00.862 [2024-04-16 23:03:51.773509] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1bc2400 with addr=10.0.0.2, port=4420 00:26:00.862 [2024-04-16 23:03:51.773527] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1bc2400 is same with the state(5) to be set 00:26:00.862 [2024-04-16 23:03:51.773657] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1bc2400 (9): Bad file descriptor 00:26:00.862 [2024-04-16 23:03:51.773843] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:00.862 [2024-04-16 23:03:51.773866] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:00.862 [2024-04-16 23:03:51.773882] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:00.862 [2024-04-16 23:03:51.776340] bdev_nvme.c:2024:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:00.862 [2024-04-16 23:03:51.785502] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:00.862 [2024-04-16 23:03:51.785846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:00.862 [2024-04-16 23:03:51.786006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:00.862 [2024-04-16 23:03:51.786040] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1bc2400 with addr=10.0.0.2, port=4420 00:26:00.862 [2024-04-16 23:03:51.786059] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1bc2400 is same with the state(5) to be set 00:26:00.862 [2024-04-16 23:03:51.786199] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1bc2400 (9): Bad file descriptor 00:26:00.862 [2024-04-16 23:03:51.786387] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:00.862 [2024-04-16 23:03:51.786411] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:00.862 [2024-04-16 23:03:51.786426] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:00.862 [2024-04-16 23:03:51.788677] bdev_nvme.c:2024:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:00.862 [2024-04-16 23:03:51.797815] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:00.862 [2024-04-16 23:03:51.798190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:00.862 [2024-04-16 23:03:51.798330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:00.862 [2024-04-16 23:03:51.798357] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1bc2400 with addr=10.0.0.2, port=4420 00:26:00.862 [2024-04-16 23:03:51.798374] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1bc2400 is same with the state(5) to be set 00:26:00.862 [2024-04-16 23:03:51.798503] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1bc2400 (9): Bad file descriptor 00:26:00.862 [2024-04-16 23:03:51.798689] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:00.862 [2024-04-16 23:03:51.798713] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:00.863 [2024-04-16 23:03:51.798728] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:00.863 [2024-04-16 23:03:51.801105] bdev_nvme.c:2024:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:00.863 [2024-04-16 23:03:51.810399] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:00.863 [2024-04-16 23:03:51.810806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:00.863 [2024-04-16 23:03:51.810974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:00.863 [2024-04-16 23:03:51.811002] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1bc2400 with addr=10.0.0.2, port=4420 00:26:00.863 [2024-04-16 23:03:51.811020] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1bc2400 is same with the state(5) to be set 00:26:00.863 [2024-04-16 23:03:51.811167] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1bc2400 (9): Bad file descriptor 00:26:00.863 [2024-04-16 23:03:51.811380] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:00.863 [2024-04-16 23:03:51.811404] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:00.863 [2024-04-16 23:03:51.811419] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:00.863 [2024-04-16 23:03:51.813674] bdev_nvme.c:2024:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:00.863 [2024-04-16 23:03:51.822986] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:00.863 [2024-04-16 23:03:51.823338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:00.863 [2024-04-16 23:03:51.823503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:00.863 [2024-04-16 23:03:51.823532] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1bc2400 with addr=10.0.0.2, port=4420 00:26:00.863 [2024-04-16 23:03:51.823558] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1bc2400 is same with the state(5) to be set 00:26:00.863 [2024-04-16 23:03:51.823706] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1bc2400 (9): Bad file descriptor 00:26:00.863 [2024-04-16 23:03:51.823874] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:00.863 [2024-04-16 23:03:51.823897] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:00.863 [2024-04-16 23:03:51.823912] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:00.863 [2024-04-16 23:03:51.826319] bdev_nvme.c:2024:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:00.863 [2024-04-16 23:03:51.835621] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:00.863 [2024-04-16 23:03:51.835939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:00.863 [2024-04-16 23:03:51.836122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:00.863 [2024-04-16 23:03:51.836151] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1bc2400 with addr=10.0.0.2, port=4420 00:26:00.863 [2024-04-16 23:03:51.836169] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1bc2400 is same with the state(5) to be set 00:26:00.863 [2024-04-16 23:03:51.836382] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1bc2400 (9): Bad file descriptor 00:26:00.863 [2024-04-16 23:03:51.836478] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:00.863 [2024-04-16 23:03:51.836501] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:00.863 [2024-04-16 23:03:51.836516] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:00.863 [2024-04-16 23:03:51.838787] bdev_nvme.c:2024:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:00.863 [2024-04-16 23:03:51.848327] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:00.863 [2024-04-16 23:03:51.848722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:00.863 [2024-04-16 23:03:51.848907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:00.863 [2024-04-16 23:03:51.848935] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1bc2400 with addr=10.0.0.2, port=4420 00:26:00.863 [2024-04-16 23:03:51.848953] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1bc2400 is same with the state(5) to be set 00:26:00.863 [2024-04-16 23:03:51.849154] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1bc2400 (9): Bad file descriptor 00:26:00.863 [2024-04-16 23:03:51.849278] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:00.863 [2024-04-16 23:03:51.849302] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:00.863 [2024-04-16 23:03:51.849317] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:00.863 [2024-04-16 23:03:51.851708] bdev_nvme.c:2024:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:00.863 [2024-04-16 23:03:51.860835] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:00.863 [2024-04-16 23:03:51.861142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:00.863 [2024-04-16 23:03:51.861316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:00.863 [2024-04-16 23:03:51.861345] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1bc2400 with addr=10.0.0.2, port=4420 00:26:00.863 [2024-04-16 23:03:51.861363] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1bc2400 is same with the state(5) to be set 00:26:00.863 [2024-04-16 23:03:51.861497] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1bc2400 (9): Bad file descriptor 00:26:00.863 [2024-04-16 23:03:51.861630] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:00.863 [2024-04-16 23:03:51.861654] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:00.863 [2024-04-16 23:03:51.861669] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:00.863 [2024-04-16 23:03:51.863828] bdev_nvme.c:2024:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:00.863 [2024-04-16 23:03:51.873498] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:00.863 [2024-04-16 23:03:51.873847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:00.863 [2024-04-16 23:03:51.873991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:00.863 [2024-04-16 23:03:51.874037] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1bc2400 with addr=10.0.0.2, port=4420 00:26:00.863 [2024-04-16 23:03:51.874055] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1bc2400 is same with the state(5) to be set 00:26:00.863 [2024-04-16 23:03:51.874225] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1bc2400 (9): Bad file descriptor 00:26:00.863 [2024-04-16 23:03:51.874339] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:00.863 [2024-04-16 23:03:51.874358] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:00.863 [2024-04-16 23:03:51.874371] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:00.863 [2024-04-16 23:03:51.876630] bdev_nvme.c:2024:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:00.863 [2024-04-16 23:03:51.886017] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:00.863 [2024-04-16 23:03:51.886349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:00.863 [2024-04-16 23:03:51.886521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:00.863 [2024-04-16 23:03:51.886549] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1bc2400 with addr=10.0.0.2, port=4420 00:26:00.863 [2024-04-16 23:03:51.886567] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1bc2400 is same with the state(5) to be set 00:26:00.863 [2024-04-16 23:03:51.886749] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1bc2400 (9): Bad file descriptor 00:26:00.863 [2024-04-16 23:03:51.886900] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:00.863 [2024-04-16 23:03:51.886923] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:00.863 [2024-04-16 23:03:51.886938] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:00.863 [2024-04-16 23:03:51.889291] bdev_nvme.c:2024:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:00.863 [2024-04-16 23:03:51.898690] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:00.863 [2024-04-16 23:03:51.899090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:00.863 [2024-04-16 23:03:51.899288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:00.863 [2024-04-16 23:03:51.899321] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1bc2400 with addr=10.0.0.2, port=4420 00:26:00.863 [2024-04-16 23:03:51.899337] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1bc2400 is same with the state(5) to be set 00:26:00.863 [2024-04-16 23:03:51.899498] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1bc2400 (9): Bad file descriptor 00:26:00.863 [2024-04-16 23:03:51.899703] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:00.863 [2024-04-16 23:03:51.899727] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:00.863 [2024-04-16 23:03:51.899743] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:00.863 [2024-04-16 23:03:51.902231] bdev_nvme.c:2024:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:00.863 [2024-04-16 23:03:51.911205] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:00.863 [2024-04-16 23:03:51.911551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:00.863 [2024-04-16 23:03:51.911809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:00.863 [2024-04-16 23:03:51.911860] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1bc2400 with addr=10.0.0.2, port=4420 00:26:00.863 [2024-04-16 23:03:51.911878] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1bc2400 is same with the state(5) to be set 00:26:00.863 [2024-04-16 23:03:51.912025] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1bc2400 (9): Bad file descriptor 00:26:00.863 [2024-04-16 23:03:51.912187] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:00.863 [2024-04-16 23:03:51.912211] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:00.863 [2024-04-16 23:03:51.912236] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:00.863 [2024-04-16 23:03:51.914463] bdev_nvme.c:2024:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:00.863 [2024-04-16 23:03:51.923822] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:00.863 [2024-04-16 23:03:51.924153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:00.863 [2024-04-16 23:03:51.924321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:00.864 [2024-04-16 23:03:51.924347] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1bc2400 with addr=10.0.0.2, port=4420 00:26:00.864 [2024-04-16 23:03:51.924363] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1bc2400 is same with the state(5) to be set 00:26:00.864 [2024-04-16 23:03:51.924526] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1bc2400 (9): Bad file descriptor 00:26:00.864 [2024-04-16 23:03:51.924693] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:00.864 [2024-04-16 23:03:51.924717] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:00.864 [2024-04-16 23:03:51.924732] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:00.864 [2024-04-16 23:03:51.927105] bdev_nvme.c:2024:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:00.864 [2024-04-16 23:03:51.936489] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:00.864 [2024-04-16 23:03:51.936848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:00.864 [2024-04-16 23:03:51.937038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:00.864 [2024-04-16 23:03:51.937066] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1bc2400 with addr=10.0.0.2, port=4420 00:26:00.864 [2024-04-16 23:03:51.937084] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1bc2400 is same with the state(5) to be set 00:26:00.864 [2024-04-16 23:03:51.937276] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1bc2400 (9): Bad file descriptor 00:26:00.864 [2024-04-16 23:03:51.937427] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:00.864 [2024-04-16 23:03:51.937455] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:00.864 [2024-04-16 23:03:51.937471] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:00.864 [2024-04-16 23:03:51.939650] bdev_nvme.c:2024:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:00.864 [2024-04-16 23:03:51.949096] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:00.864 [2024-04-16 23:03:51.949430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:00.864 [2024-04-16 23:03:51.949553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:00.864 [2024-04-16 23:03:51.949578] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1bc2400 with addr=10.0.0.2, port=4420 00:26:00.864 [2024-04-16 23:03:51.949594] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1bc2400 is same with the state(5) to be set 00:26:00.864 [2024-04-16 23:03:51.949765] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1bc2400 (9): Bad file descriptor 00:26:00.864 [2024-04-16 23:03:51.949933] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:00.864 [2024-04-16 23:03:51.949956] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:00.864 [2024-04-16 23:03:51.949972] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:00.864 [2024-04-16 23:03:51.952259] bdev_nvme.c:2024:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:00.864 [2024-04-16 23:03:51.961729] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:00.864 [2024-04-16 23:03:51.962071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:00.864 [2024-04-16 23:03:51.962260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:00.864 [2024-04-16 23:03:51.962289] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1bc2400 with addr=10.0.0.2, port=4420 00:26:00.864 [2024-04-16 23:03:51.962307] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1bc2400 is same with the state(5) to be set 00:26:00.864 [2024-04-16 23:03:51.962453] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1bc2400 (9): Bad file descriptor 00:26:00.864 [2024-04-16 23:03:51.962657] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:00.864 [2024-04-16 23:03:51.962681] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:00.864 [2024-04-16 23:03:51.962696] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:00.864 [2024-04-16 23:03:51.965106] bdev_nvme.c:2024:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:00.864 [2024-04-16 23:03:51.974346] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:00.864 [2024-04-16 23:03:51.974839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:00.864 [2024-04-16 23:03:51.975014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:00.864 [2024-04-16 23:03:51.975042] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1bc2400 with addr=10.0.0.2, port=4420 00:26:00.864 [2024-04-16 23:03:51.975060] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1bc2400 is same with the state(5) to be set 00:26:00.864 [2024-04-16 23:03:51.975198] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1bc2400 (9): Bad file descriptor 00:26:00.864 [2024-04-16 23:03:51.975372] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:00.864 [2024-04-16 23:03:51.975395] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:00.864 [2024-04-16 23:03:51.975416] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:00.864 [2024-04-16 23:03:51.977646] bdev_nvme.c:2024:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:00.864 [2024-04-16 23:03:51.986786] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:00.864 [2024-04-16 23:03:51.987149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:00.864 [2024-04-16 23:03:51.987344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:00.864 [2024-04-16 23:03:51.987375] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1bc2400 with addr=10.0.0.2, port=4420 00:26:00.864 [2024-04-16 23:03:51.987393] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1bc2400 is same with the state(5) to be set 00:26:00.864 [2024-04-16 23:03:51.987576] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1bc2400 (9): Bad file descriptor 00:26:00.864 [2024-04-16 23:03:51.987763] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:00.864 [2024-04-16 23:03:51.987787] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:00.864 [2024-04-16 23:03:51.987802] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:01.124 [2024-04-16 23:03:51.990137] bdev_nvme.c:2024:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:01.124 [2024-04-16 23:03:51.999499] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:01.124 [2024-04-16 23:03:51.999813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:01.124 [2024-04-16 23:03:51.999977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:01.124 [2024-04-16 23:03:52.000003] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1bc2400 with addr=10.0.0.2, port=4420 00:26:01.124 [2024-04-16 23:03:52.000035] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1bc2400 is same with the state(5) to be set 00:26:01.124 [2024-04-16 23:03:52.000210] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1bc2400 (9): Bad file descriptor 00:26:01.124 [2024-04-16 23:03:52.000370] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:01.124 [2024-04-16 23:03:52.000393] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:01.124 [2024-04-16 23:03:52.000409] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:01.124 [2024-04-16 23:03:52.002803] bdev_nvme.c:2024:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:01.124 [2024-04-16 23:03:52.012003] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:01.124 [2024-04-16 23:03:52.012472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:01.124 [2024-04-16 23:03:52.012645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:01.124 [2024-04-16 23:03:52.012673] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1bc2400 with addr=10.0.0.2, port=4420 00:26:01.124 [2024-04-16 23:03:52.012690] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1bc2400 is same with the state(5) to be set 00:26:01.124 [2024-04-16 23:03:52.012837] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1bc2400 (9): Bad file descriptor 00:26:01.124 [2024-04-16 23:03:52.013005] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:01.124 [2024-04-16 23:03:52.013029] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:01.124 [2024-04-16 23:03:52.013044] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:01.124 [2024-04-16 23:03:52.015235] bdev_nvme.c:2024:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:01.124 [2024-04-16 23:03:52.024480] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:01.124 [2024-04-16 23:03:52.024836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:01.124 [2024-04-16 23:03:52.024981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:01.124 [2024-04-16 23:03:52.025006] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1bc2400 with addr=10.0.0.2, port=4420 00:26:01.124 [2024-04-16 23:03:52.025022] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1bc2400 is same with the state(5) to be set 00:26:01.124 [2024-04-16 23:03:52.025214] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1bc2400 (9): Bad file descriptor 00:26:01.124 [2024-04-16 23:03:52.025383] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:01.124 [2024-04-16 23:03:52.025406] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:01.124 [2024-04-16 23:03:52.025421] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:01.124 [2024-04-16 23:03:52.027724] bdev_nvme.c:2024:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:01.124 [2024-04-16 23:03:52.037167] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:01.124 [2024-04-16 23:03:52.037563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:01.124 [2024-04-16 23:03:52.037785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:01.124 [2024-04-16 23:03:52.037812] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1bc2400 with addr=10.0.0.2, port=4420 00:26:01.124 [2024-04-16 23:03:52.037829] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1bc2400 is same with the state(5) to be set 00:26:01.124 [2024-04-16 23:03:52.037976] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1bc2400 (9): Bad file descriptor 00:26:01.124 [2024-04-16 23:03:52.038191] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:01.124 [2024-04-16 23:03:52.038215] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:01.124 [2024-04-16 23:03:52.038230] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:01.124 [2024-04-16 23:03:52.040748] bdev_nvme.c:2024:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:01.124 [2024-04-16 23:03:52.049703] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:01.124 [2024-04-16 23:03:52.050103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:01.124 [2024-04-16 23:03:52.050297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:01.124 [2024-04-16 23:03:52.050345] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1bc2400 with addr=10.0.0.2, port=4420 00:26:01.124 [2024-04-16 23:03:52.050362] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1bc2400 is same with the state(5) to be set 00:26:01.124 [2024-04-16 23:03:52.050527] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1bc2400 (9): Bad file descriptor 00:26:01.124 [2024-04-16 23:03:52.050713] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:01.124 [2024-04-16 23:03:52.050737] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:01.124 [2024-04-16 23:03:52.050752] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:01.124 [2024-04-16 23:03:52.052890] bdev_nvme.c:2024:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:01.124 [2024-04-16 23:03:52.062146] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:01.124 [2024-04-16 23:03:52.062516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:01.124 [2024-04-16 23:03:52.062719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:01.124 [2024-04-16 23:03:52.062749] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1bc2400 with addr=10.0.0.2, port=4420 00:26:01.124 [2024-04-16 23:03:52.062766] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1bc2400 is same with the state(5) to be set 00:26:01.124 [2024-04-16 23:03:52.062858] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1bc2400 (9): Bad file descriptor 00:26:01.124 [2024-04-16 23:03:52.063009] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:01.124 [2024-04-16 23:03:52.063032] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:01.124 [2024-04-16 23:03:52.063047] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:01.124 [2024-04-16 23:03:52.065269] bdev_nvme.c:2024:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:01.124 [2024-04-16 23:03:52.074814] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:01.124 [2024-04-16 23:03:52.075105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:01.125 [2024-04-16 23:03:52.075276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:01.125 [2024-04-16 23:03:52.075303] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1bc2400 with addr=10.0.0.2, port=4420 00:26:01.125 [2024-04-16 23:03:52.075319] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1bc2400 is same with the state(5) to be set 00:26:01.125 [2024-04-16 23:03:52.075497] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1bc2400 (9): Bad file descriptor 00:26:01.125 [2024-04-16 23:03:52.075694] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:01.125 [2024-04-16 23:03:52.075718] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:01.125 [2024-04-16 23:03:52.075733] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:01.125 [2024-04-16 23:03:52.078072] bdev_nvme.c:2024:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:01.125 [2024-04-16 23:03:52.087399] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:01.125 [2024-04-16 23:03:52.087731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:01.125 [2024-04-16 23:03:52.087878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:01.125 [2024-04-16 23:03:52.087903] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1bc2400 with addr=10.0.0.2, port=4420 00:26:01.125 [2024-04-16 23:03:52.087919] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1bc2400 is same with the state(5) to be set 00:26:01.125 [2024-04-16 23:03:52.088084] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1bc2400 (9): Bad file descriptor 00:26:01.125 [2024-04-16 23:03:52.088246] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:01.125 [2024-04-16 23:03:52.088270] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:01.125 [2024-04-16 23:03:52.088285] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:01.125 [2024-04-16 23:03:52.090681] bdev_nvme.c:2024:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:01.125 [2024-04-16 23:03:52.099855] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:01.125 [2024-04-16 23:03:52.100193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:01.125 [2024-04-16 23:03:52.100381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:01.125 [2024-04-16 23:03:52.100407] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1bc2400 with addr=10.0.0.2, port=4420 00:26:01.125 [2024-04-16 23:03:52.100422] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1bc2400 is same with the state(5) to be set 00:26:01.125 [2024-04-16 23:03:52.100617] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1bc2400 (9): Bad file descriptor 00:26:01.125 [2024-04-16 23:03:52.100804] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:01.125 [2024-04-16 23:03:52.100827] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:01.125 [2024-04-16 23:03:52.100842] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:01.125 [2024-04-16 23:03:52.103257] bdev_nvme.c:2024:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:01.125 [2024-04-16 23:03:52.112455] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:01.125 [2024-04-16 23:03:52.112775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:01.125 [2024-04-16 23:03:52.112911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:01.125 [2024-04-16 23:03:52.112940] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1bc2400 with addr=10.0.0.2, port=4420 00:26:01.125 [2024-04-16 23:03:52.112957] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1bc2400 is same with the state(5) to be set 00:26:01.125 [2024-04-16 23:03:52.113184] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1bc2400 (9): Bad file descriptor 00:26:01.125 [2024-04-16 23:03:52.113372] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:01.125 [2024-04-16 23:03:52.113396] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:01.125 [2024-04-16 23:03:52.113411] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:01.125 [2024-04-16 23:03:52.115673] bdev_nvme.c:2024:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:01.125 [2024-04-16 23:03:52.124916] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:01.125 [2024-04-16 23:03:52.125325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:01.125 [2024-04-16 23:03:52.125459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:01.125 [2024-04-16 23:03:52.125488] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1bc2400 with addr=10.0.0.2, port=4420 00:26:01.125 [2024-04-16 23:03:52.125505] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1bc2400 is same with the state(5) to be set 00:26:01.125 [2024-04-16 23:03:52.125670] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1bc2400 (9): Bad file descriptor 00:26:01.125 [2024-04-16 23:03:52.125857] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:01.125 [2024-04-16 23:03:52.125880] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:01.125 [2024-04-16 23:03:52.125895] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:01.125 [2024-04-16 23:03:52.128382] bdev_nvme.c:2024:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:01.125 [2024-04-16 23:03:52.137414] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:01.125 [2024-04-16 23:03:52.137765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:01.125 [2024-04-16 23:03:52.137936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:01.125 [2024-04-16 23:03:52.137966] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1bc2400 with addr=10.0.0.2, port=4420 00:26:01.125 [2024-04-16 23:03:52.137983] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1bc2400 is same with the state(5) to be set 00:26:01.125 [2024-04-16 23:03:52.138214] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1bc2400 (9): Bad file descriptor 00:26:01.125 [2024-04-16 23:03:52.138366] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:01.125 [2024-04-16 23:03:52.138389] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:01.125 [2024-04-16 23:03:52.138404] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:01.125 [2024-04-16 23:03:52.140759] bdev_nvme.c:2024:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:01.125 [2024-04-16 23:03:52.149915] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:01.125 [2024-04-16 23:03:52.150205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:01.125 [2024-04-16 23:03:52.150340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:01.125 [2024-04-16 23:03:52.150368] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1bc2400 with addr=10.0.0.2, port=4420 00:26:01.125 [2024-04-16 23:03:52.150385] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1bc2400 is same with the state(5) to be set 00:26:01.125 [2024-04-16 23:03:52.150568] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1bc2400 (9): Bad file descriptor 00:26:01.125 [2024-04-16 23:03:52.150683] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:01.125 [2024-04-16 23:03:52.150706] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:01.125 [2024-04-16 23:03:52.150721] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:01.125 [2024-04-16 23:03:52.153005] bdev_nvme.c:2024:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:01.125 [2024-04-16 23:03:52.162477] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:01.125 [2024-04-16 23:03:52.162793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:01.125 [2024-04-16 23:03:52.162962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:01.125 [2024-04-16 23:03:52.162989] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1bc2400 with addr=10.0.0.2, port=4420 00:26:01.125 [2024-04-16 23:03:52.163007] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1bc2400 is same with the state(5) to be set 00:26:01.125 [2024-04-16 23:03:52.163153] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1bc2400 (9): Bad file descriptor 00:26:01.125 [2024-04-16 23:03:52.163295] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:01.125 [2024-04-16 23:03:52.163319] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:01.125 [2024-04-16 23:03:52.163334] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:01.125 [2024-04-16 23:03:52.165761] bdev_nvme.c:2024:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:01.125 [2024-04-16 23:03:52.174933] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:01.125 [2024-04-16 23:03:52.175270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:01.125 [2024-04-16 23:03:52.175418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:01.125 [2024-04-16 23:03:52.175445] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1bc2400 with addr=10.0.0.2, port=4420 00:26:01.125 [2024-04-16 23:03:52.175483] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1bc2400 is same with the state(5) to be set 00:26:01.125 [2024-04-16 23:03:52.175667] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1bc2400 (9): Bad file descriptor 00:26:01.125 [2024-04-16 23:03:52.175908] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:01.125 [2024-04-16 23:03:52.175931] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:01.125 [2024-04-16 23:03:52.175947] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:01.125 [2024-04-16 23:03:52.178239] bdev_nvme.c:2024:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:01.125 [2024-04-16 23:03:52.187753] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:01.125 [2024-04-16 23:03:52.188046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:01.125 [2024-04-16 23:03:52.188204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:01.125 [2024-04-16 23:03:52.188230] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1bc2400 with addr=10.0.0.2, port=4420 00:26:01.125 [2024-04-16 23:03:52.188246] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1bc2400 is same with the state(5) to be set 00:26:01.126 [2024-04-16 23:03:52.188379] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1bc2400 (9): Bad file descriptor 00:26:01.126 [2024-04-16 23:03:52.188558] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:01.126 [2024-04-16 23:03:52.188582] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:01.126 [2024-04-16 23:03:52.188598] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:01.126 [2024-04-16 23:03:52.190774] bdev_nvme.c:2024:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:01.126 [2024-04-16 23:03:52.200300] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:01.126 [2024-04-16 23:03:52.200747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:01.126 [2024-04-16 23:03:52.200908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:01.126 [2024-04-16 23:03:52.200935] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1bc2400 with addr=10.0.0.2, port=4420 00:26:01.126 [2024-04-16 23:03:52.200952] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1bc2400 is same with the state(5) to be set 00:26:01.126 [2024-04-16 23:03:52.201117] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1bc2400 (9): Bad file descriptor 00:26:01.126 [2024-04-16 23:03:52.201276] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:01.126 [2024-04-16 23:03:52.201300] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:01.126 [2024-04-16 23:03:52.201315] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:01.126 [2024-04-16 23:03:52.203546] bdev_nvme.c:2024:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:01.126 [2024-04-16 23:03:52.212731] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:01.126 [2024-04-16 23:03:52.213046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:01.126 [2024-04-16 23:03:52.213188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:01.126 [2024-04-16 23:03:52.213214] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1bc2400 with addr=10.0.0.2, port=4420 00:26:01.126 [2024-04-16 23:03:52.213230] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1bc2400 is same with the state(5) to be set 00:26:01.126 [2024-04-16 23:03:52.213383] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1bc2400 (9): Bad file descriptor 00:26:01.126 [2024-04-16 23:03:52.213571] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:01.126 [2024-04-16 23:03:52.213595] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:01.126 [2024-04-16 23:03:52.213610] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:01.126 [2024-04-16 23:03:52.216125] bdev_nvme.c:2024:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:01.126 [2024-04-16 23:03:52.225204] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:01.126 [2024-04-16 23:03:52.225498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:01.126 [2024-04-16 23:03:52.225657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:01.126 [2024-04-16 23:03:52.225685] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1bc2400 with addr=10.0.0.2, port=4420 00:26:01.126 [2024-04-16 23:03:52.225702] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1bc2400 is same with the state(5) to be set 00:26:01.126 [2024-04-16 23:03:52.225867] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1bc2400 (9): Bad file descriptor 00:26:01.126 [2024-04-16 23:03:52.226071] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:01.126 [2024-04-16 23:03:52.226095] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:01.126 [2024-04-16 23:03:52.226109] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:01.126 [2024-04-16 23:03:52.228600] bdev_nvme.c:2024:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:01.126 [2024-04-16 23:03:52.237597] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:01.126 [2024-04-16 23:03:52.237935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:01.126 [2024-04-16 23:03:52.238119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:01.126 [2024-04-16 23:03:52.238149] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1bc2400 with addr=10.0.0.2, port=4420 00:26:01.126 [2024-04-16 23:03:52.238167] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1bc2400 is same with the state(5) to be set 00:26:01.126 [2024-04-16 23:03:52.238345] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1bc2400 (9): Bad file descriptor 00:26:01.126 [2024-04-16 23:03:52.238532] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:01.126 [2024-04-16 23:03:52.238555] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:01.126 [2024-04-16 23:03:52.238570] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:01.126 [2024-04-16 23:03:52.240946] bdev_nvme.c:2024:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:01.126 [2024-04-16 23:03:52.250207] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:01.126 [2024-04-16 23:03:52.250623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:01.126 [2024-04-16 23:03:52.250786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:01.126 [2024-04-16 23:03:52.250817] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1bc2400 with addr=10.0.0.2, port=4420 00:26:01.126 [2024-04-16 23:03:52.250848] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1bc2400 is same with the state(5) to be set 00:26:01.126 [2024-04-16 23:03:52.251070] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1bc2400 (9): Bad file descriptor 00:26:01.126 [2024-04-16 23:03:52.251257] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:01.126 [2024-04-16 23:03:52.251282] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:01.386 [2024-04-16 23:03:52.251297] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:01.386 [2024-04-16 23:03:52.253579] bdev_nvme.c:2024:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:01.386 [2024-04-16 23:03:52.262749] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:01.386 [2024-04-16 23:03:52.263119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:01.386 [2024-04-16 23:03:52.263295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:01.386 [2024-04-16 23:03:52.263324] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1bc2400 with addr=10.0.0.2, port=4420 00:26:01.386 [2024-04-16 23:03:52.263341] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1bc2400 is same with the state(5) to be set 00:26:01.386 [2024-04-16 23:03:52.263506] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1bc2400 (9): Bad file descriptor 00:26:01.386 [2024-04-16 23:03:52.263711] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:01.386 [2024-04-16 23:03:52.263735] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:01.386 [2024-04-16 23:03:52.263750] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:01.386 [2024-04-16 23:03:52.266090] bdev_nvme.c:2024:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:01.386 [2024-04-16 23:03:52.275301] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:01.386 [2024-04-16 23:03:52.275763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:01.386 [2024-04-16 23:03:52.275942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:01.386 [2024-04-16 23:03:52.275970] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1bc2400 with addr=10.0.0.2, port=4420 00:26:01.386 [2024-04-16 23:03:52.275988] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1bc2400 is same with the state(5) to be set 00:26:01.386 [2024-04-16 23:03:52.276199] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1bc2400 (9): Bad file descriptor 00:26:01.386 [2024-04-16 23:03:52.276314] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:01.386 [2024-04-16 23:03:52.276337] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:01.386 [2024-04-16 23:03:52.276352] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:01.386 [2024-04-16 23:03:52.278582] bdev_nvme.c:2024:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:01.386 [2024-04-16 23:03:52.287757] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:01.386 [2024-04-16 23:03:52.288078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:01.386 [2024-04-16 23:03:52.288238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:01.386 [2024-04-16 23:03:52.288268] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1bc2400 with addr=10.0.0.2, port=4420 00:26:01.386 [2024-04-16 23:03:52.288286] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1bc2400 is same with the state(5) to be set 00:26:01.386 [2024-04-16 23:03:52.288470] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1bc2400 (9): Bad file descriptor 00:26:01.386 [2024-04-16 23:03:52.288638] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:01.386 [2024-04-16 23:03:52.288667] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:01.386 [2024-04-16 23:03:52.288683] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:01.386 [2024-04-16 23:03:52.290930] bdev_nvme.c:2024:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:01.386 [2024-04-16 23:03:52.300387] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:01.386 [2024-04-16 23:03:52.300718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:01.386 [2024-04-16 23:03:52.300852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:01.386 [2024-04-16 23:03:52.300877] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1bc2400 with addr=10.0.0.2, port=4420 00:26:01.386 [2024-04-16 23:03:52.300893] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1bc2400 is same with the state(5) to be set 00:26:01.386 [2024-04-16 23:03:52.301090] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1bc2400 (9): Bad file descriptor 00:26:01.386 [2024-04-16 23:03:52.301246] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:01.386 [2024-04-16 23:03:52.301270] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:01.386 [2024-04-16 23:03:52.301286] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:01.386 [2024-04-16 23:03:52.303768] bdev_nvme.c:2024:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:01.386 [2024-04-16 23:03:52.312781] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:01.386 [2024-04-16 23:03:52.313146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:01.386 [2024-04-16 23:03:52.313341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:01.386 [2024-04-16 23:03:52.313370] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1bc2400 with addr=10.0.0.2, port=4420 00:26:01.386 [2024-04-16 23:03:52.313387] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1bc2400 is same with the state(5) to be set 00:26:01.386 [2024-04-16 23:03:52.313534] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1bc2400 (9): Bad file descriptor 00:26:01.386 [2024-04-16 23:03:52.313721] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:01.387 [2024-04-16 23:03:52.313744] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:01.387 [2024-04-16 23:03:52.313759] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:01.387 [2024-04-16 23:03:52.316250] bdev_nvme.c:2024:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:01.387 [2024-04-16 23:03:52.325317] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:01.387 [2024-04-16 23:03:52.325644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:01.387 [2024-04-16 23:03:52.325805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:01.387 [2024-04-16 23:03:52.325834] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1bc2400 with addr=10.0.0.2, port=4420 00:26:01.387 [2024-04-16 23:03:52.325852] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1bc2400 is same with the state(5) to be set 00:26:01.387 [2024-04-16 23:03:52.325999] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1bc2400 (9): Bad file descriptor 00:26:01.387 [2024-04-16 23:03:52.326167] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:01.387 [2024-04-16 23:03:52.326201] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:01.387 [2024-04-16 23:03:52.326222] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:01.387 [2024-04-16 23:03:52.328398] bdev_nvme.c:2024:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:01.387 [2024-04-16 23:03:52.337820] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:01.387 [2024-04-16 23:03:52.338190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:01.387 [2024-04-16 23:03:52.338384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:01.387 [2024-04-16 23:03:52.338412] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1bc2400 with addr=10.0.0.2, port=4420 00:26:01.387 [2024-04-16 23:03:52.338430] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1bc2400 is same with the state(5) to be set 00:26:01.387 [2024-04-16 23:03:52.338613] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1bc2400 (9): Bad file descriptor 00:26:01.387 [2024-04-16 23:03:52.338763] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:01.387 [2024-04-16 23:03:52.338786] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:01.387 [2024-04-16 23:03:52.338801] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:01.387 [2024-04-16 23:03:52.341183] bdev_nvme.c:2024:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:01.387 [2024-04-16 23:03:52.350423] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:01.387 [2024-04-16 23:03:52.350794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:01.387 [2024-04-16 23:03:52.350956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:01.387 [2024-04-16 23:03:52.350981] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1bc2400 with addr=10.0.0.2, port=4420 00:26:01.387 [2024-04-16 23:03:52.350997] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1bc2400 is same with the state(5) to be set 00:26:01.387 [2024-04-16 23:03:52.351144] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1bc2400 (9): Bad file descriptor 00:26:01.387 [2024-04-16 23:03:52.351357] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:01.387 [2024-04-16 23:03:52.351381] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:01.387 [2024-04-16 23:03:52.351397] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:01.387 [2024-04-16 23:03:52.353697] bdev_nvme.c:2024:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:01.387 [2024-04-16 23:03:52.362978] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:01.387 [2024-04-16 23:03:52.363392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:01.387 [2024-04-16 23:03:52.363544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:01.387 [2024-04-16 23:03:52.363573] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1bc2400 with addr=10.0.0.2, port=4420 00:26:01.387 [2024-04-16 23:03:52.363591] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1bc2400 is same with the state(5) to be set 00:26:01.387 [2024-04-16 23:03:52.363737] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1bc2400 (9): Bad file descriptor 00:26:01.387 [2024-04-16 23:03:52.363869] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:01.387 [2024-04-16 23:03:52.363892] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:01.387 [2024-04-16 23:03:52.363908] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:01.387 [2024-04-16 23:03:52.366334] bdev_nvme.c:2024:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:01.387 [2024-04-16 23:03:52.375740] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:01.387 [2024-04-16 23:03:52.376081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:01.387 [2024-04-16 23:03:52.376244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:01.387 [2024-04-16 23:03:52.376273] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1bc2400 with addr=10.0.0.2, port=4420 00:26:01.387 [2024-04-16 23:03:52.376291] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1bc2400 is same with the state(5) to be set 00:26:01.387 [2024-04-16 23:03:52.376491] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1bc2400 (9): Bad file descriptor 00:26:01.387 [2024-04-16 23:03:52.376659] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:01.387 [2024-04-16 23:03:52.376682] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:01.387 [2024-04-16 23:03:52.376698] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:01.387 [2024-04-16 23:03:52.378872] bdev_nvme.c:2024:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:01.387 [2024-04-16 23:03:52.388079] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:01.387 [2024-04-16 23:03:52.388389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:01.387 [2024-04-16 23:03:52.388544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:01.387 [2024-04-16 23:03:52.388572] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1bc2400 with addr=10.0.0.2, port=4420 00:26:01.387 [2024-04-16 23:03:52.388589] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1bc2400 is same with the state(5) to be set 00:26:01.387 [2024-04-16 23:03:52.388772] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1bc2400 (9): Bad file descriptor 00:26:01.387 [2024-04-16 23:03:52.388905] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:01.387 [2024-04-16 23:03:52.388928] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:01.387 [2024-04-16 23:03:52.388943] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:01.387 [2024-04-16 23:03:52.391206] bdev_nvme.c:2024:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:01.387 [2024-04-16 23:03:52.400402] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:01.387 [2024-04-16 23:03:52.400749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:01.387 [2024-04-16 23:03:52.400912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:01.387 [2024-04-16 23:03:52.400941] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1bc2400 with addr=10.0.0.2, port=4420 00:26:01.387 [2024-04-16 23:03:52.400958] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1bc2400 is same with the state(5) to be set 00:26:01.387 [2024-04-16 23:03:52.401105] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1bc2400 (9): Bad file descriptor 00:26:01.387 [2024-04-16 23:03:52.401267] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:01.387 [2024-04-16 23:03:52.401291] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:01.387 [2024-04-16 23:03:52.401306] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:01.387 [2024-04-16 23:03:52.403533] bdev_nvme.c:2024:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:01.387 [2024-04-16 23:03:52.413014] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:01.387 [2024-04-16 23:03:52.413337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:01.387 [2024-04-16 23:03:52.413496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:01.387 [2024-04-16 23:03:52.413524] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1bc2400 with addr=10.0.0.2, port=4420 00:26:01.387 [2024-04-16 23:03:52.413541] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1bc2400 is same with the state(5) to be set 00:26:01.387 [2024-04-16 23:03:52.413743] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1bc2400 (9): Bad file descriptor 00:26:01.387 [2024-04-16 23:03:52.413947] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:01.387 [2024-04-16 23:03:52.413970] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:01.387 [2024-04-16 23:03:52.413985] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:01.387 [2024-04-16 23:03:52.416314] bdev_nvme.c:2024:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:01.387 [2024-04-16 23:03:52.425752] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:01.387 [2024-04-16 23:03:52.426055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:01.387 [2024-04-16 23:03:52.426204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:01.387 [2024-04-16 23:03:52.426233] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1bc2400 with addr=10.0.0.2, port=4420 00:26:01.387 [2024-04-16 23:03:52.426251] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1bc2400 is same with the state(5) to be set 00:26:01.387 [2024-04-16 23:03:52.426434] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1bc2400 (9): Bad file descriptor 00:26:01.387 [2024-04-16 23:03:52.426584] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:01.387 [2024-04-16 23:03:52.426607] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:01.387 [2024-04-16 23:03:52.426622] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:01.387 [2024-04-16 23:03:52.428978] bdev_nvme.c:2024:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:01.387 [2024-04-16 23:03:52.438338] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:01.388 [2024-04-16 23:03:52.438650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:01.388 [2024-04-16 23:03:52.438807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:01.388 [2024-04-16 23:03:52.438836] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1bc2400 with addr=10.0.0.2, port=4420 00:26:01.388 [2024-04-16 23:03:52.438853] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1bc2400 is same with the state(5) to be set 00:26:01.388 [2024-04-16 23:03:52.439017] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1bc2400 (9): Bad file descriptor 00:26:01.388 [2024-04-16 23:03:52.439150] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:01.388 [2024-04-16 23:03:52.439173] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:01.388 [2024-04-16 23:03:52.439200] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:01.388 [2024-04-16 23:03:52.441502] bdev_nvme.c:2024:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:01.388 [2024-04-16 23:03:52.450950] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:01.388 [2024-04-16 23:03:52.451363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:01.388 [2024-04-16 23:03:52.451580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:01.388 [2024-04-16 23:03:52.451627] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1bc2400 with addr=10.0.0.2, port=4420 00:26:01.388 [2024-04-16 23:03:52.451645] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1bc2400 is same with the state(5) to be set 00:26:01.388 [2024-04-16 23:03:52.451810] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1bc2400 (9): Bad file descriptor 00:26:01.388 [2024-04-16 23:03:52.451924] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:01.388 [2024-04-16 23:03:52.451947] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:01.388 [2024-04-16 23:03:52.451962] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:01.388 [2024-04-16 23:03:52.454255] bdev_nvme.c:2024:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:01.388 [2024-04-16 23:03:52.463472] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:01.388 [2024-04-16 23:03:52.463838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:01.388 [2024-04-16 23:03:52.464003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:01.388 [2024-04-16 23:03:52.464032] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1bc2400 with addr=10.0.0.2, port=4420 00:26:01.388 [2024-04-16 23:03:52.464050] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1bc2400 is same with the state(5) to be set 00:26:01.388 [2024-04-16 23:03:52.464246] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1bc2400 (9): Bad file descriptor 00:26:01.388 [2024-04-16 23:03:52.464382] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:01.388 [2024-04-16 23:03:52.464403] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:01.388 [2024-04-16 23:03:52.464416] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:01.388 [2024-04-16 23:03:52.466897] bdev_nvme.c:2024:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:01.388 [2024-04-16 23:03:52.475893] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:01.388 [2024-04-16 23:03:52.476266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:01.388 [2024-04-16 23:03:52.476430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:01.388 [2024-04-16 23:03:52.476458] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1bc2400 with addr=10.0.0.2, port=4420 00:26:01.388 [2024-04-16 23:03:52.476475] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1bc2400 is same with the state(5) to be set 00:26:01.388 [2024-04-16 23:03:52.476640] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1bc2400 (9): Bad file descriptor 00:26:01.388 [2024-04-16 23:03:52.476809] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:01.388 [2024-04-16 23:03:52.476832] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:01.388 [2024-04-16 23:03:52.476847] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:01.388 [2024-04-16 23:03:52.479199] bdev_nvme.c:2024:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:01.388 [2024-04-16 23:03:52.488487] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:01.388 [2024-04-16 23:03:52.488869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:01.388 [2024-04-16 23:03:52.489018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:01.388 [2024-04-16 23:03:52.489052] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1bc2400 with addr=10.0.0.2, port=4420 00:26:01.388 [2024-04-16 23:03:52.489070] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1bc2400 is same with the state(5) to be set 00:26:01.388 [2024-04-16 23:03:52.489267] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1bc2400 (9): Bad file descriptor 00:26:01.388 [2024-04-16 23:03:52.489419] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:01.388 [2024-04-16 23:03:52.489442] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:01.388 [2024-04-16 23:03:52.489457] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:01.388 [2024-04-16 23:03:52.491649] bdev_nvme.c:2024:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:01.388 [2024-04-16 23:03:52.500937] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:01.388 [2024-04-16 23:03:52.501266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:01.388 [2024-04-16 23:03:52.501571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:01.388 [2024-04-16 23:03:52.501625] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1bc2400 with addr=10.0.0.2, port=4420 00:26:01.388 [2024-04-16 23:03:52.501642] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1bc2400 is same with the state(5) to be set 00:26:01.388 [2024-04-16 23:03:52.501807] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1bc2400 (9): Bad file descriptor 00:26:01.388 [2024-04-16 23:03:52.501975] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:01.388 [2024-04-16 23:03:52.501998] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:01.388 [2024-04-16 23:03:52.502013] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:01.388 [2024-04-16 23:03:52.504286] bdev_nvme.c:2024:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:01.648 [2024-04-16 23:03:52.513512] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:01.648 [2024-04-16 23:03:52.513891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:01.648 [2024-04-16 23:03:52.514055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:01.648 [2024-04-16 23:03:52.514085] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1bc2400 with addr=10.0.0.2, port=4420 00:26:01.648 [2024-04-16 23:03:52.514102] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1bc2400 is same with the state(5) to be set 00:26:01.648 [2024-04-16 23:03:52.514317] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1bc2400 (9): Bad file descriptor 00:26:01.648 [2024-04-16 23:03:52.514469] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:01.648 [2024-04-16 23:03:52.514493] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:01.648 [2024-04-16 23:03:52.514508] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:01.648 [2024-04-16 23:03:52.516934] bdev_nvme.c:2024:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:01.648 [2024-04-16 23:03:52.526417] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:01.648 [2024-04-16 23:03:52.526743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:01.648 [2024-04-16 23:03:52.526881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:01.648 [2024-04-16 23:03:52.526911] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1bc2400 with addr=10.0.0.2, port=4420 00:26:01.648 [2024-04-16 23:03:52.526933] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1bc2400 is same with the state(5) to be set 00:26:01.648 [2024-04-16 23:03:52.527136] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1bc2400 (9): Bad file descriptor 00:26:01.648 [2024-04-16 23:03:52.527279] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:01.648 [2024-04-16 23:03:52.527303] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:01.648 [2024-04-16 23:03:52.527318] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:01.648 [2024-04-16 23:03:52.529710] bdev_nvme.c:2024:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:01.648 [2024-04-16 23:03:52.538943] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:01.648 [2024-04-16 23:03:52.539233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:01.648 [2024-04-16 23:03:52.539361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:01.648 [2024-04-16 23:03:52.539389] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1bc2400 with addr=10.0.0.2, port=4420 00:26:01.648 [2024-04-16 23:03:52.539407] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1bc2400 is same with the state(5) to be set 00:26:01.648 [2024-04-16 23:03:52.539553] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1bc2400 (9): Bad file descriptor 00:26:01.648 [2024-04-16 23:03:52.539705] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:01.648 [2024-04-16 23:03:52.539728] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:01.648 [2024-04-16 23:03:52.539743] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:01.648 [2024-04-16 23:03:52.542134] bdev_nvme.c:2024:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:01.649 [2024-04-16 23:03:52.551396] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:01.649 [2024-04-16 23:03:52.551799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:01.649 [2024-04-16 23:03:52.552003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:01.649 [2024-04-16 23:03:52.552028] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1bc2400 with addr=10.0.0.2, port=4420 00:26:01.649 [2024-04-16 23:03:52.552044] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1bc2400 is same with the state(5) to be set 00:26:01.649 [2024-04-16 23:03:52.552229] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1bc2400 (9): Bad file descriptor 00:26:01.649 [2024-04-16 23:03:52.552428] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:01.649 [2024-04-16 23:03:52.552451] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:01.649 [2024-04-16 23:03:52.552466] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:01.649 [2024-04-16 23:03:52.554765] bdev_nvme.c:2024:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:01.649 [2024-04-16 23:03:52.563812] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:01.649 [2024-04-16 23:03:52.564138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:01.649 [2024-04-16 23:03:52.564275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:01.649 [2024-04-16 23:03:52.564304] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1bc2400 with addr=10.0.0.2, port=4420 00:26:01.649 [2024-04-16 23:03:52.564322] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1bc2400 is same with the state(5) to be set 00:26:01.649 [2024-04-16 23:03:52.564493] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1bc2400 (9): Bad file descriptor 00:26:01.649 [2024-04-16 23:03:52.564626] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:01.649 [2024-04-16 23:03:52.564649] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:01.649 [2024-04-16 23:03:52.564664] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:01.649 [2024-04-16 23:03:52.567001] bdev_nvme.c:2024:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:01.649 [2024-04-16 23:03:52.576376] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:01.649 [2024-04-16 23:03:52.576751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:01.649 [2024-04-16 23:03:52.576937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:01.649 [2024-04-16 23:03:52.576965] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1bc2400 with addr=10.0.0.2, port=4420 00:26:01.649 [2024-04-16 23:03:52.576983] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1bc2400 is same with the state(5) to be set 00:26:01.649 [2024-04-16 23:03:52.577129] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1bc2400 (9): Bad file descriptor 00:26:01.649 [2024-04-16 23:03:52.577289] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:01.649 [2024-04-16 23:03:52.577313] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:01.649 [2024-04-16 23:03:52.577328] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:01.649 [2024-04-16 23:03:52.579648] bdev_nvme.c:2024:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:01.649 [2024-04-16 23:03:52.588860] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:01.649 [2024-04-16 23:03:52.589162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:01.649 [2024-04-16 23:03:52.589334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:01.649 [2024-04-16 23:03:52.589363] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1bc2400 with addr=10.0.0.2, port=4420 00:26:01.649 [2024-04-16 23:03:52.589380] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1bc2400 is same with the state(5) to be set 00:26:01.649 [2024-04-16 23:03:52.589581] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1bc2400 (9): Bad file descriptor 00:26:01.649 [2024-04-16 23:03:52.589804] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:01.649 [2024-04-16 23:03:52.589828] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:01.649 [2024-04-16 23:03:52.589843] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:01.649 [2024-04-16 23:03:52.592056] bdev_nvme.c:2024:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:01.649 [2024-04-16 23:03:52.601435] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:01.649 [2024-04-16 23:03:52.601804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:01.649 [2024-04-16 23:03:52.601954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:01.649 [2024-04-16 23:03:52.601982] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1bc2400 with addr=10.0.0.2, port=4420 00:26:01.649 [2024-04-16 23:03:52.601999] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1bc2400 is same with the state(5) to be set 00:26:01.649 [2024-04-16 23:03:52.602212] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1bc2400 (9): Bad file descriptor 00:26:01.649 [2024-04-16 23:03:52.602442] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:01.649 [2024-04-16 23:03:52.602466] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:01.649 [2024-04-16 23:03:52.602481] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:01.649 [2024-04-16 23:03:52.604676] bdev_nvme.c:2024:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:01.649 [2024-04-16 23:03:52.614018] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:01.649 [2024-04-16 23:03:52.614381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:01.649 [2024-04-16 23:03:52.614575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:01.649 [2024-04-16 23:03:52.614603] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1bc2400 with addr=10.0.0.2, port=4420 00:26:01.649 [2024-04-16 23:03:52.614621] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1bc2400 is same with the state(5) to be set 00:26:01.649 [2024-04-16 23:03:52.614840] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1bc2400 (9): Bad file descriptor 00:26:01.649 [2024-04-16 23:03:52.614990] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:01.649 [2024-04-16 23:03:52.615014] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:01.649 [2024-04-16 23:03:52.615029] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:01.649 [2024-04-16 23:03:52.617501] bdev_nvme.c:2024:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:01.649 [2024-04-16 23:03:52.626740] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:01.649 [2024-04-16 23:03:52.627116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:01.649 [2024-04-16 23:03:52.627344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:01.649 [2024-04-16 23:03:52.627373] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1bc2400 with addr=10.0.0.2, port=4420 00:26:01.649 [2024-04-16 23:03:52.627390] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1bc2400 is same with the state(5) to be set 00:26:01.649 [2024-04-16 23:03:52.627591] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1bc2400 (9): Bad file descriptor 00:26:01.649 [2024-04-16 23:03:52.627777] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:01.649 [2024-04-16 23:03:52.627801] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:01.649 [2024-04-16 23:03:52.627816] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:01.649 [2024-04-16 23:03:52.630083] bdev_nvme.c:2024:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:01.649 [2024-04-16 23:03:52.639409] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:01.649 [2024-04-16 23:03:52.639824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:01.649 [2024-04-16 23:03:52.640008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:01.649 [2024-04-16 23:03:52.640049] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1bc2400 with addr=10.0.0.2, port=4420 00:26:01.649 [2024-04-16 23:03:52.640066] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1bc2400 is same with the state(5) to be set 00:26:01.649 [2024-04-16 23:03:52.640244] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1bc2400 (9): Bad file descriptor 00:26:01.649 [2024-04-16 23:03:52.640395] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:01.649 [2024-04-16 23:03:52.640423] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:01.649 [2024-04-16 23:03:52.640439] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:01.649 [2024-04-16 23:03:52.642505] bdev_nvme.c:2024:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:01.649 [2024-04-16 23:03:52.651910] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:01.649 [2024-04-16 23:03:52.652267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:01.649 [2024-04-16 23:03:52.652414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:01.649 [2024-04-16 23:03:52.652439] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1bc2400 with addr=10.0.0.2, port=4420 00:26:01.649 [2024-04-16 23:03:52.652455] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1bc2400 is same with the state(5) to be set 00:26:01.649 [2024-04-16 23:03:52.652638] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1bc2400 (9): Bad file descriptor 00:26:01.649 [2024-04-16 23:03:52.652825] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:01.649 [2024-04-16 23:03:52.652849] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:01.649 [2024-04-16 23:03:52.652864] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:01.649 [2024-04-16 23:03:52.655303] bdev_nvme.c:2024:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:01.649 [2024-04-16 23:03:52.664392] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:01.649 [2024-04-16 23:03:52.664730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:01.649 [2024-04-16 23:03:52.664905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:01.649 [2024-04-16 23:03:52.664930] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1bc2400 with addr=10.0.0.2, port=4420 00:26:01.650 [2024-04-16 23:03:52.664945] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1bc2400 is same with the state(5) to be set 00:26:01.650 [2024-04-16 23:03:52.665108] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1bc2400 (9): Bad file descriptor 00:26:01.650 [2024-04-16 23:03:52.665301] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:01.650 [2024-04-16 23:03:52.665326] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:01.650 [2024-04-16 23:03:52.665341] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:01.650 [2024-04-16 23:03:52.667674] bdev_nvme.c:2024:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:01.650 [2024-04-16 23:03:52.676798] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:01.650 [2024-04-16 23:03:52.677093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:01.650 [2024-04-16 23:03:52.677255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:01.650 [2024-04-16 23:03:52.677282] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1bc2400 with addr=10.0.0.2, port=4420 00:26:01.650 [2024-04-16 23:03:52.677298] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1bc2400 is same with the state(5) to be set 00:26:01.650 [2024-04-16 23:03:52.677477] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1bc2400 (9): Bad file descriptor 00:26:01.650 [2024-04-16 23:03:52.677663] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:01.650 [2024-04-16 23:03:52.677686] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:01.650 [2024-04-16 23:03:52.677707] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:01.650 [2024-04-16 23:03:52.680063] bdev_nvme.c:2024:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:01.650 [2024-04-16 23:03:52.689262] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:01.650 [2024-04-16 23:03:52.689698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:01.650 [2024-04-16 23:03:52.689870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:01.650 [2024-04-16 23:03:52.689895] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1bc2400 with addr=10.0.0.2, port=4420 00:26:01.650 [2024-04-16 23:03:52.689911] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1bc2400 is same with the state(5) to be set 00:26:01.650 [2024-04-16 23:03:52.690059] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1bc2400 (9): Bad file descriptor 00:26:01.650 [2024-04-16 23:03:52.690258] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:01.650 [2024-04-16 23:03:52.690283] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:01.650 [2024-04-16 23:03:52.690298] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:01.650 [2024-04-16 23:03:52.692688] bdev_nvme.c:2024:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:01.650 [2024-04-16 23:03:52.702034] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:01.650 [2024-04-16 23:03:52.702399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:01.650 [2024-04-16 23:03:52.702581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:01.650 [2024-04-16 23:03:52.702606] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1bc2400 with addr=10.0.0.2, port=4420 00:26:01.650 [2024-04-16 23:03:52.702622] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1bc2400 is same with the state(5) to be set 00:26:01.650 [2024-04-16 23:03:52.702790] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1bc2400 (9): Bad file descriptor 00:26:01.650 [2024-04-16 23:03:52.702977] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:01.650 [2024-04-16 23:03:52.703000] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:01.650 [2024-04-16 23:03:52.703015] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:01.650 [2024-04-16 23:03:52.705379] bdev_nvme.c:2024:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:01.650 [2024-04-16 23:03:52.714549] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:01.650 [2024-04-16 23:03:52.714940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:01.650 [2024-04-16 23:03:52.715110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:01.650 [2024-04-16 23:03:52.715136] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1bc2400 with addr=10.0.0.2, port=4420 00:26:01.650 [2024-04-16 23:03:52.715151] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1bc2400 is same with the state(5) to be set 00:26:01.650 [2024-04-16 23:03:52.715309] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1bc2400 (9): Bad file descriptor 00:26:01.650 [2024-04-16 23:03:52.715509] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:01.650 [2024-04-16 23:03:52.715533] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:01.650 [2024-04-16 23:03:52.715548] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:01.650 [2024-04-16 23:03:52.717807] bdev_nvme.c:2024:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:01.650 [2024-04-16 23:03:52.726948] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:01.650 [2024-04-16 23:03:52.727245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:01.650 [2024-04-16 23:03:52.727429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:01.650 [2024-04-16 23:03:52.727458] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1bc2400 with addr=10.0.0.2, port=4420 00:26:01.650 [2024-04-16 23:03:52.727475] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1bc2400 is same with the state(5) to be set 00:26:01.650 [2024-04-16 23:03:52.727640] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1bc2400 (9): Bad file descriptor 00:26:01.650 [2024-04-16 23:03:52.727791] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:01.650 [2024-04-16 23:03:52.727814] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:01.650 [2024-04-16 23:03:52.727829] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:01.650 [2024-04-16 23:03:52.730152] bdev_nvme.c:2024:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:01.650 [2024-04-16 23:03:52.739413] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:01.650 [2024-04-16 23:03:52.739792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:01.650 [2024-04-16 23:03:52.739947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:01.650 [2024-04-16 23:03:52.739974] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1bc2400 with addr=10.0.0.2, port=4420 00:26:01.650 [2024-04-16 23:03:52.739992] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1bc2400 is same with the state(5) to be set 00:26:01.650 [2024-04-16 23:03:52.740156] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1bc2400 (9): Bad file descriptor 00:26:01.650 [2024-04-16 23:03:52.740319] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:01.650 [2024-04-16 23:03:52.740343] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:01.650 [2024-04-16 23:03:52.740358] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:01.650 [2024-04-16 23:03:52.742659] bdev_nvme.c:2024:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:01.650 [2024-04-16 23:03:52.751967] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:01.650 [2024-04-16 23:03:52.752211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:01.650 [2024-04-16 23:03:52.752406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:01.650 [2024-04-16 23:03:52.752431] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1bc2400 with addr=10.0.0.2, port=4420 00:26:01.650 [2024-04-16 23:03:52.752447] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1bc2400 is same with the state(5) to be set 00:26:01.650 [2024-04-16 23:03:52.752575] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1bc2400 (9): Bad file descriptor 00:26:01.650 [2024-04-16 23:03:52.752811] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:01.650 [2024-04-16 23:03:52.752834] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:01.650 [2024-04-16 23:03:52.752849] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:01.650 [2024-04-16 23:03:52.755134] bdev_nvme.c:2024:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:01.650 [2024-04-16 23:03:52.764545] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:01.650 [2024-04-16 23:03:52.764844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:01.650 [2024-04-16 23:03:52.765000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:01.650 [2024-04-16 23:03:52.765027] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1bc2400 with addr=10.0.0.2, port=4420 00:26:01.650 [2024-04-16 23:03:52.765043] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1bc2400 is same with the state(5) to be set 00:26:01.650 [2024-04-16 23:03:52.765214] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1bc2400 (9): Bad file descriptor 00:26:01.650 [2024-04-16 23:03:52.765383] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:01.650 [2024-04-16 23:03:52.765406] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:01.650 [2024-04-16 23:03:52.765421] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:01.650 [2024-04-16 23:03:52.767811] bdev_nvme.c:2024:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:01.930 [2024-04-16 23:03:52.777159] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:01.930 [2024-04-16 23:03:52.777520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:01.930 [2024-04-16 23:03:52.777746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:01.930 [2024-04-16 23:03:52.777796] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1bc2400 with addr=10.0.0.2, port=4420 00:26:01.930 [2024-04-16 23:03:52.777814] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1bc2400 is same with the state(5) to be set 00:26:01.930 [2024-04-16 23:03:52.777998] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1bc2400 (9): Bad file descriptor 00:26:01.930 [2024-04-16 23:03:52.778167] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:01.930 [2024-04-16 23:03:52.778200] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:01.930 [2024-04-16 23:03:52.778216] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:01.930 [2024-04-16 23:03:52.780286] bdev_nvme.c:2024:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:01.930 [2024-04-16 23:03:52.789539] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:01.930 [2024-04-16 23:03:52.789883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:01.930 [2024-04-16 23:03:52.790063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:01.930 [2024-04-16 23:03:52.790089] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1bc2400 with addr=10.0.0.2, port=4420 00:26:01.930 [2024-04-16 23:03:52.790121] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1bc2400 is same with the state(5) to be set 00:26:01.930 [2024-04-16 23:03:52.790278] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1bc2400 (9): Bad file descriptor 00:26:01.930 [2024-04-16 23:03:52.790411] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:01.930 [2024-04-16 23:03:52.790434] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:01.930 [2024-04-16 23:03:52.790449] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:01.930 [2024-04-16 23:03:52.792930] bdev_nvme.c:2024:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:01.930 [2024-04-16 23:03:52.802262] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:01.930 [2024-04-16 23:03:52.802588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:01.930 [2024-04-16 23:03:52.802715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:01.930 [2024-04-16 23:03:52.802745] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1bc2400 with addr=10.0.0.2, port=4420 00:26:01.930 [2024-04-16 23:03:52.802762] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1bc2400 is same with the state(5) to be set 00:26:01.930 [2024-04-16 23:03:52.802945] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1bc2400 (9): Bad file descriptor 00:26:01.930 [2024-04-16 23:03:52.803114] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:01.930 [2024-04-16 23:03:52.803138] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:01.930 [2024-04-16 23:03:52.803153] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:01.930 [2024-04-16 23:03:52.805484] bdev_nvme.c:2024:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:01.930 [2024-04-16 23:03:52.814690] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:01.931 [2024-04-16 23:03:52.815052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:01.931 [2024-04-16 23:03:52.815209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:01.931 [2024-04-16 23:03:52.815236] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1bc2400 with addr=10.0.0.2, port=4420 00:26:01.931 [2024-04-16 23:03:52.815253] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1bc2400 is same with the state(5) to be set 00:26:01.931 [2024-04-16 23:03:52.815412] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1bc2400 (9): Bad file descriptor 00:26:01.931 [2024-04-16 23:03:52.815635] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:01.931 [2024-04-16 23:03:52.815658] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:01.931 [2024-04-16 23:03:52.815673] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:01.931 [2024-04-16 23:03:52.817739] bdev_nvme.c:2024:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:01.931 [2024-04-16 23:03:52.827183] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:01.931 [2024-04-16 23:03:52.827570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:01.931 [2024-04-16 23:03:52.827698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:01.931 [2024-04-16 23:03:52.827727] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1bc2400 with addr=10.0.0.2, port=4420 00:26:01.931 [2024-04-16 23:03:52.827745] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1bc2400 is same with the state(5) to be set 00:26:01.931 [2024-04-16 23:03:52.827910] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1bc2400 (9): Bad file descriptor 00:26:01.931 [2024-04-16 23:03:52.828060] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:01.931 [2024-04-16 23:03:52.828083] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:01.931 [2024-04-16 23:03:52.828098] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:01.931 [2024-04-16 23:03:52.830597] bdev_nvme.c:2024:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:01.931 [2024-04-16 23:03:52.839679] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:01.931 [2024-04-16 23:03:52.840059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:01.931 [2024-04-16 23:03:52.840231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:01.931 [2024-04-16 23:03:52.840259] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1bc2400 with addr=10.0.0.2, port=4420 00:26:01.931 [2024-04-16 23:03:52.840276] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1bc2400 is same with the state(5) to be set 00:26:01.931 [2024-04-16 23:03:52.840443] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1bc2400 (9): Bad file descriptor 00:26:01.931 [2024-04-16 23:03:52.840594] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:01.931 [2024-04-16 23:03:52.840618] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:01.931 [2024-04-16 23:03:52.840633] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:01.931 [2024-04-16 23:03:52.842922] bdev_nvme.c:2024:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:01.931 [2024-04-16 23:03:52.852218] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:01.931 [2024-04-16 23:03:52.852500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:01.931 [2024-04-16 23:03:52.852629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:01.931 [2024-04-16 23:03:52.852657] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1bc2400 with addr=10.0.0.2, port=4420 00:26:01.931 [2024-04-16 23:03:52.852674] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1bc2400 is same with the state(5) to be set 00:26:01.931 [2024-04-16 23:03:52.852857] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1bc2400 (9): Bad file descriptor 00:26:01.931 [2024-04-16 23:03:52.853044] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:01.931 [2024-04-16 23:03:52.853068] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:01.931 [2024-04-16 23:03:52.853083] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:01.931 [2024-04-16 23:03:52.855503] bdev_nvme.c:2024:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:01.931 [2024-04-16 23:03:52.864828] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:01.931 [2024-04-16 23:03:52.865149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:01.931 [2024-04-16 23:03:52.865300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:01.931 [2024-04-16 23:03:52.865326] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1bc2400 with addr=10.0.0.2, port=4420 00:26:01.931 [2024-04-16 23:03:52.865342] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1bc2400 is same with the state(5) to be set 00:26:01.931 [2024-04-16 23:03:52.865458] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1bc2400 (9): Bad file descriptor 00:26:01.931 [2024-04-16 23:03:52.865671] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:01.931 [2024-04-16 23:03:52.865695] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:01.931 [2024-04-16 23:03:52.865710] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:01.931 [2024-04-16 23:03:52.867978] bdev_nvme.c:2024:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:01.931 [2024-04-16 23:03:52.877228] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:01.931 [2024-04-16 23:03:52.877545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:01.931 [2024-04-16 23:03:52.877696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:01.931 [2024-04-16 23:03:52.877721] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1bc2400 with addr=10.0.0.2, port=4420 00:26:01.931 [2024-04-16 23:03:52.877756] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1bc2400 is same with the state(5) to be set 00:26:01.931 [2024-04-16 23:03:52.877922] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1bc2400 (9): Bad file descriptor 00:26:01.931 [2024-04-16 23:03:52.878109] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:01.931 [2024-04-16 23:03:52.878132] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:01.931 [2024-04-16 23:03:52.878147] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:01.931 [2024-04-16 23:03:52.880532] bdev_nvme.c:2024:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:01.931 [2024-04-16 23:03:52.889730] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:01.931 [2024-04-16 23:03:52.890038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:01.931 [2024-04-16 23:03:52.890195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:01.931 [2024-04-16 23:03:52.890236] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1bc2400 with addr=10.0.0.2, port=4420 00:26:01.931 [2024-04-16 23:03:52.890253] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1bc2400 is same with the state(5) to be set 00:26:01.931 [2024-04-16 23:03:52.890399] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1bc2400 (9): Bad file descriptor 00:26:01.931 [2024-04-16 23:03:52.890586] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:01.931 [2024-04-16 23:03:52.890610] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:01.931 [2024-04-16 23:03:52.890625] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:01.931 [2024-04-16 23:03:52.892974] bdev_nvme.c:2024:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:01.931 [2024-04-16 23:03:52.902327] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:01.931 [2024-04-16 23:03:52.902653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:01.931 [2024-04-16 23:03:52.902913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:01.931 [2024-04-16 23:03:52.902969] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1bc2400 with addr=10.0.0.2, port=4420 00:26:01.931 [2024-04-16 23:03:52.902986] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1bc2400 is same with the state(5) to be set 00:26:01.931 [2024-04-16 23:03:52.903133] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1bc2400 (9): Bad file descriptor 00:26:01.931 [2024-04-16 23:03:52.903293] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:01.931 [2024-04-16 23:03:52.903317] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:01.931 [2024-04-16 23:03:52.903332] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:01.931 [2024-04-16 23:03:52.905673] bdev_nvme.c:2024:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:01.931 [2024-04-16 23:03:52.915058] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:01.931 [2024-04-16 23:03:52.915375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:01.932 [2024-04-16 23:03:52.915499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:01.932 [2024-04-16 23:03:52.915529] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1bc2400 with addr=10.0.0.2, port=4420 00:26:01.932 [2024-04-16 23:03:52.915546] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1bc2400 is same with the state(5) to be set 00:26:01.932 [2024-04-16 23:03:52.915698] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1bc2400 (9): Bad file descriptor 00:26:01.932 [2024-04-16 23:03:52.915849] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:01.932 [2024-04-16 23:03:52.915872] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:01.932 [2024-04-16 23:03:52.915887] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:01.932 [2024-04-16 23:03:52.918230] bdev_nvme.c:2024:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:01.932 [2024-04-16 23:03:52.927492] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:01.932 [2024-04-16 23:03:52.927808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:01.932 [2024-04-16 23:03:52.927966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:01.932 [2024-04-16 23:03:52.927993] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1bc2400 with addr=10.0.0.2, port=4420 00:26:01.932 [2024-04-16 23:03:52.928011] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1bc2400 is same with the state(5) to be set 00:26:01.932 [2024-04-16 23:03:52.928203] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1bc2400 (9): Bad file descriptor 00:26:01.932 [2024-04-16 23:03:52.928366] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:01.932 [2024-04-16 23:03:52.928388] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:01.932 [2024-04-16 23:03:52.928402] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:01.932 [2024-04-16 23:03:52.930488] bdev_nvme.c:2024:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:01.932 [2024-04-16 23:03:52.940163] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:01.932 [2024-04-16 23:03:52.940449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:01.932 [2024-04-16 23:03:52.940603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:01.932 [2024-04-16 23:03:52.940628] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1bc2400 with addr=10.0.0.2, port=4420 00:26:01.932 [2024-04-16 23:03:52.940643] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1bc2400 is same with the state(5) to be set 00:26:01.932 [2024-04-16 23:03:52.940821] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1bc2400 (9): Bad file descriptor 00:26:01.932 [2024-04-16 23:03:52.940990] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:01.932 [2024-04-16 23:03:52.941013] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:01.932 [2024-04-16 23:03:52.941028] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:01.932 [2024-04-16 23:03:52.943442] bdev_nvme.c:2024:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:01.932 [2024-04-16 23:03:52.952600] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:01.932 [2024-04-16 23:03:52.952924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:01.932 [2024-04-16 23:03:52.953083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:01.932 [2024-04-16 23:03:52.953111] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1bc2400 with addr=10.0.0.2, port=4420 00:26:01.932 [2024-04-16 23:03:52.953128] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1bc2400 is same with the state(5) to be set 00:26:01.932 [2024-04-16 23:03:52.953343] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1bc2400 (9): Bad file descriptor 00:26:01.932 [2024-04-16 23:03:52.953522] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:01.932 [2024-04-16 23:03:52.953546] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:01.932 [2024-04-16 23:03:52.953561] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:01.932 [2024-04-16 23:03:52.956029] bdev_nvme.c:2024:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:01.932 [2024-04-16 23:03:52.964907] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:01.932 [2024-04-16 23:03:52.965295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:01.932 [2024-04-16 23:03:52.965431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:01.932 [2024-04-16 23:03:52.965456] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1bc2400 with addr=10.0.0.2, port=4420 00:26:01.932 [2024-04-16 23:03:52.965472] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1bc2400 is same with the state(5) to be set 00:26:01.932 [2024-04-16 23:03:52.965688] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1bc2400 (9): Bad file descriptor 00:26:01.932 [2024-04-16 23:03:52.965821] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:01.932 [2024-04-16 23:03:52.965844] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:01.932 [2024-04-16 23:03:52.965859] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:01.932 [2024-04-16 23:03:52.968286] bdev_nvme.c:2024:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:01.932 [2024-04-16 23:03:52.977344] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:01.932 [2024-04-16 23:03:52.977718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:01.932 [2024-04-16 23:03:52.977921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:01.932 [2024-04-16 23:03:52.977949] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1bc2400 with addr=10.0.0.2, port=4420 00:26:01.932 [2024-04-16 23:03:52.977967] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1bc2400 is same with the state(5) to be set 00:26:01.932 [2024-04-16 23:03:52.978149] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1bc2400 (9): Bad file descriptor 00:26:01.932 [2024-04-16 23:03:52.978380] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:01.932 [2024-04-16 23:03:52.978403] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:01.932 [2024-04-16 23:03:52.978416] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:01.932 [2024-04-16 23:03:52.980884] bdev_nvme.c:2024:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:01.932 [2024-04-16 23:03:52.989928] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:01.932 [2024-04-16 23:03:52.990266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:01.932 [2024-04-16 23:03:52.990415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:01.932 [2024-04-16 23:03:52.990441] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1bc2400 with addr=10.0.0.2, port=4420 00:26:01.932 [2024-04-16 23:03:52.990472] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1bc2400 is same with the state(5) to be set 00:26:01.932 [2024-04-16 23:03:52.990637] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1bc2400 (9): Bad file descriptor 00:26:01.932 [2024-04-16 23:03:52.990769] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:01.932 [2024-04-16 23:03:52.990801] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:01.932 [2024-04-16 23:03:52.990817] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:01.932 [2024-04-16 23:03:52.993255] bdev_nvme.c:2024:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:01.932 [2024-04-16 23:03:53.002390] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:01.932 [2024-04-16 23:03:53.002693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:01.932 [2024-04-16 23:03:53.002878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:01.932 [2024-04-16 23:03:53.002907] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1bc2400 with addr=10.0.0.2, port=4420 00:26:01.932 [2024-04-16 23:03:53.002924] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1bc2400 is same with the state(5) to be set 00:26:01.932 [2024-04-16 23:03:53.003053] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1bc2400 (9): Bad file descriptor 00:26:01.932 [2024-04-16 23:03:53.003216] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:01.932 [2024-04-16 23:03:53.003240] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:01.932 [2024-04-16 23:03:53.003255] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:01.932 [2024-04-16 23:03:53.005649] bdev_nvme.c:2024:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:01.932 [2024-04-16 23:03:53.014984] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:01.932 [2024-04-16 23:03:53.015309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:01.932 [2024-04-16 23:03:53.015448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:01.932 [2024-04-16 23:03:53.015476] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1bc2400 with addr=10.0.0.2, port=4420 00:26:01.932 [2024-04-16 23:03:53.015494] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1bc2400 is same with the state(5) to be set 00:26:01.932 [2024-04-16 23:03:53.015678] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1bc2400 (9): Bad file descriptor 00:26:01.932 [2024-04-16 23:03:53.015902] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:01.932 [2024-04-16 23:03:53.015925] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:01.932 [2024-04-16 23:03:53.015941] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:01.932 [2024-04-16 23:03:53.018172] bdev_nvme.c:2024:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:01.932 [2024-04-16 23:03:53.027448] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:01.932 [2024-04-16 23:03:53.027809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:01.932 [2024-04-16 23:03:53.027981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:01.932 [2024-04-16 23:03:53.028007] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1bc2400 with addr=10.0.0.2, port=4420 00:26:01.932 [2024-04-16 23:03:53.028023] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1bc2400 is same with the state(5) to be set 00:26:01.932 [2024-04-16 23:03:53.028193] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1bc2400 (9): Bad file descriptor 00:26:01.933 [2024-04-16 23:03:53.028365] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:01.933 [2024-04-16 23:03:53.028390] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:01.933 [2024-04-16 23:03:53.028411] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:01.933 [2024-04-16 23:03:53.030550] bdev_nvme.c:2024:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:01.933 [2024-04-16 23:03:53.040191] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:01.933 [2024-04-16 23:03:53.040569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:01.933 [2024-04-16 23:03:53.040729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:01.933 [2024-04-16 23:03:53.040757] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1bc2400 with addr=10.0.0.2, port=4420 00:26:01.933 [2024-04-16 23:03:53.040775] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1bc2400 is same with the state(5) to be set 00:26:01.933 [2024-04-16 23:03:53.040957] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1bc2400 (9): Bad file descriptor 00:26:01.933 [2024-04-16 23:03:53.041108] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:01.933 [2024-04-16 23:03:53.041131] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:01.933 [2024-04-16 23:03:53.041146] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:01.933 [2024-04-16 23:03:53.043406] bdev_nvme.c:2024:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:01.933 [2024-04-16 23:03:53.052919] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:01.933 [2024-04-16 23:03:53.053251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:01.933 [2024-04-16 23:03:53.053420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:01.933 [2024-04-16 23:03:53.053446] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1bc2400 with addr=10.0.0.2, port=4420 00:26:01.933 [2024-04-16 23:03:53.053463] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1bc2400 is same with the state(5) to be set 00:26:01.933 [2024-04-16 23:03:53.053651] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1bc2400 (9): Bad file descriptor 00:26:01.933 [2024-04-16 23:03:53.053883] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:01.933 [2024-04-16 23:03:53.053910] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:01.933 [2024-04-16 23:03:53.053926] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:02.194 [2024-04-16 23:03:53.056424] bdev_nvme.c:2024:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:02.194 [2024-04-16 23:03:53.065448] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:02.194 [2024-04-16 23:03:53.065849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:02.194 [2024-04-16 23:03:53.066000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:02.194 [2024-04-16 23:03:53.066030] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1bc2400 with addr=10.0.0.2, port=4420 00:26:02.194 [2024-04-16 23:03:53.066048] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1bc2400 is same with the state(5) to be set 00:26:02.194 [2024-04-16 23:03:53.066226] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1bc2400 (9): Bad file descriptor 00:26:02.194 [2024-04-16 23:03:53.066360] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:02.194 [2024-04-16 23:03:53.066383] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:02.194 [2024-04-16 23:03:53.066399] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:02.194 [2024-04-16 23:03:53.068780] bdev_nvme.c:2024:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:02.194 [2024-04-16 23:03:53.078116] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:02.194 [2024-04-16 23:03:53.078466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:02.194 [2024-04-16 23:03:53.078653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:02.194 [2024-04-16 23:03:53.078700] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1bc2400 with addr=10.0.0.2, port=4420 00:26:02.194 [2024-04-16 23:03:53.078718] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1bc2400 is same with the state(5) to be set 00:26:02.194 [2024-04-16 23:03:53.078883] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1bc2400 (9): Bad file descriptor 00:26:02.194 [2024-04-16 23:03:53.079088] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:02.194 [2024-04-16 23:03:53.079112] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:02.194 [2024-04-16 23:03:53.079127] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:02.194 [2024-04-16 23:03:53.081472] bdev_nvme.c:2024:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:02.194 [2024-04-16 23:03:53.090770] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:02.194 [2024-04-16 23:03:53.091093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:02.194 [2024-04-16 23:03:53.091255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:02.194 [2024-04-16 23:03:53.091285] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1bc2400 with addr=10.0.0.2, port=4420 00:26:02.194 [2024-04-16 23:03:53.091302] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1bc2400 is same with the state(5) to be set 00:26:02.194 [2024-04-16 23:03:53.091486] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1bc2400 (9): Bad file descriptor 00:26:02.194 [2024-04-16 23:03:53.091601] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:02.194 [2024-04-16 23:03:53.091624] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:02.194 [2024-04-16 23:03:53.091639] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:02.194 [2024-04-16 23:03:53.093975] bdev_nvme.c:2024:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:02.194 [2024-04-16 23:03:53.103391] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:02.194 [2024-04-16 23:03:53.103717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:02.194 [2024-04-16 23:03:53.103878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:02.194 [2024-04-16 23:03:53.103906] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1bc2400 with addr=10.0.0.2, port=4420 00:26:02.194 [2024-04-16 23:03:53.103924] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1bc2400 is same with the state(5) to be set 00:26:02.194 [2024-04-16 23:03:53.104053] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1bc2400 (9): Bad file descriptor 00:26:02.194 [2024-04-16 23:03:53.104230] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:02.194 [2024-04-16 23:03:53.104254] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:02.194 [2024-04-16 23:03:53.104269] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:02.194 [2024-04-16 23:03:53.106517] bdev_nvme.c:2024:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:02.194 [2024-04-16 23:03:53.115914] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:02.194 [2024-04-16 23:03:53.116242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:02.194 [2024-04-16 23:03:53.116416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:02.194 [2024-04-16 23:03:53.116445] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1bc2400 with addr=10.0.0.2, port=4420 00:26:02.194 [2024-04-16 23:03:53.116462] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1bc2400 is same with the state(5) to be set 00:26:02.194 [2024-04-16 23:03:53.116645] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1bc2400 (9): Bad file descriptor 00:26:02.194 [2024-04-16 23:03:53.116814] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:02.194 [2024-04-16 23:03:53.116837] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:02.194 [2024-04-16 23:03:53.116852] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:02.194 [2024-04-16 23:03:53.119083] bdev_nvme.c:2024:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:02.194 [2024-04-16 23:03:53.128602] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:02.194 [2024-04-16 23:03:53.128903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:02.194 [2024-04-16 23:03:53.129066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:02.194 [2024-04-16 23:03:53.129094] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1bc2400 with addr=10.0.0.2, port=4420 00:26:02.194 [2024-04-16 23:03:53.129112] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1bc2400 is same with the state(5) to be set 00:26:02.194 [2024-04-16 23:03:53.129250] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1bc2400 (9): Bad file descriptor 00:26:02.194 [2024-04-16 23:03:53.129383] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:02.194 [2024-04-16 23:03:53.129407] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:02.194 [2024-04-16 23:03:53.129422] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:02.194 [2024-04-16 23:03:53.131959] bdev_nvme.c:2024:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:02.194 [2024-04-16 23:03:53.140887] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:02.194 [2024-04-16 23:03:53.141234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:02.194 [2024-04-16 23:03:53.141394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:02.194 [2024-04-16 23:03:53.141422] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1bc2400 with addr=10.0.0.2, port=4420 00:26:02.194 [2024-04-16 23:03:53.141440] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1bc2400 is same with the state(5) to be set 00:26:02.194 [2024-04-16 23:03:53.141587] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1bc2400 (9): Bad file descriptor 00:26:02.194 [2024-04-16 23:03:53.141809] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:02.194 [2024-04-16 23:03:53.141832] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:02.194 [2024-04-16 23:03:53.141847] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:02.194 [2024-04-16 23:03:53.144095] bdev_nvme.c:2024:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:02.194 [2024-04-16 23:03:53.153319] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:02.194 [2024-04-16 23:03:53.153709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:02.194 [2024-04-16 23:03:53.153881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:02.194 [2024-04-16 23:03:53.153909] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1bc2400 with addr=10.0.0.2, port=4420 00:26:02.194 [2024-04-16 23:03:53.153926] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1bc2400 is same with the state(5) to be set 00:26:02.194 [2024-04-16 23:03:53.154090] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1bc2400 (9): Bad file descriptor 00:26:02.194 [2024-04-16 23:03:53.154285] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:02.194 [2024-04-16 23:03:53.154309] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:02.194 [2024-04-16 23:03:53.154324] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:02.194 [2024-04-16 23:03:53.156701] bdev_nvme.c:2024:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:02.194 [2024-04-16 23:03:53.165920] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:02.194 [2024-04-16 23:03:53.166250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:02.194 [2024-04-16 23:03:53.166394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:02.194 [2024-04-16 23:03:53.166423] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1bc2400 with addr=10.0.0.2, port=4420 00:26:02.194 [2024-04-16 23:03:53.166440] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1bc2400 is same with the state(5) to be set 00:26:02.194 [2024-04-16 23:03:53.166588] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1bc2400 (9): Bad file descriptor 00:26:02.194 [2024-04-16 23:03:53.166810] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:02.194 [2024-04-16 23:03:53.166834] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:02.194 [2024-04-16 23:03:53.166849] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:02.194 [2024-04-16 23:03:53.169136] bdev_nvme.c:2024:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:02.194 [2024-04-16 23:03:53.178512] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:02.194 [2024-04-16 23:03:53.178810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:02.194 [2024-04-16 23:03:53.178969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:02.194 [2024-04-16 23:03:53.178996] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1bc2400 with addr=10.0.0.2, port=4420 00:26:02.194 [2024-04-16 23:03:53.179012] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1bc2400 is same with the state(5) to be set 00:26:02.194 [2024-04-16 23:03:53.179204] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1bc2400 (9): Bad file descriptor 00:26:02.194 [2024-04-16 23:03:53.179356] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:02.194 [2024-04-16 23:03:53.179379] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:02.194 [2024-04-16 23:03:53.179394] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:02.194 [2024-04-16 23:03:53.181661] bdev_nvme.c:2024:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:02.194 [2024-04-16 23:03:53.191054] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:02.194 [2024-04-16 23:03:53.191409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:02.194 [2024-04-16 23:03:53.191605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:02.194 [2024-04-16 23:03:53.191631] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1bc2400 with addr=10.0.0.2, port=4420 00:26:02.194 [2024-04-16 23:03:53.191646] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1bc2400 is same with the state(5) to be set 00:26:02.195 [2024-04-16 23:03:53.191829] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1bc2400 (9): Bad file descriptor 00:26:02.195 [2024-04-16 23:03:53.191980] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:02.195 [2024-04-16 23:03:53.192004] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:02.195 [2024-04-16 23:03:53.192019] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:02.195 [2024-04-16 23:03:53.194384] bdev_nvme.c:2024:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:02.195 [2024-04-16 23:03:53.203719] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:02.195 [2024-04-16 23:03:53.204078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:02.195 [2024-04-16 23:03:53.204245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:02.195 [2024-04-16 23:03:53.204274] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1bc2400 with addr=10.0.0.2, port=4420 00:26:02.195 [2024-04-16 23:03:53.204291] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1bc2400 is same with the state(5) to be set 00:26:02.195 [2024-04-16 23:03:53.204420] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1bc2400 (9): Bad file descriptor 00:26:02.195 [2024-04-16 23:03:53.204588] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:02.195 [2024-04-16 23:03:53.204612] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:02.195 [2024-04-16 23:03:53.204627] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:02.195 [2024-04-16 23:03:53.206982] bdev_nvme.c:2024:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:02.195 [2024-04-16 23:03:53.216152] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:02.195 [2024-04-16 23:03:53.216455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:02.195 [2024-04-16 23:03:53.216618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:02.195 [2024-04-16 23:03:53.216646] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1bc2400 with addr=10.0.0.2, port=4420 00:26:02.195 [2024-04-16 23:03:53.216663] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1bc2400 is same with the state(5) to be set 00:26:02.195 [2024-04-16 23:03:53.216810] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1bc2400 (9): Bad file descriptor 00:26:02.195 [2024-04-16 23:03:53.216960] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:02.195 [2024-04-16 23:03:53.216983] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:02.195 [2024-04-16 23:03:53.216999] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:02.195 [2024-04-16 23:03:53.219239] bdev_nvme.c:2024:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:02.195 [2024-04-16 23:03:53.228724] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:02.195 [2024-04-16 23:03:53.229008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:02.195 [2024-04-16 23:03:53.229170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:02.195 [2024-04-16 23:03:53.229208] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1bc2400 with addr=10.0.0.2, port=4420 00:26:02.195 [2024-04-16 23:03:53.229242] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1bc2400 is same with the state(5) to be set 00:26:02.195 [2024-04-16 23:03:53.229408] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1bc2400 (9): Bad file descriptor 00:26:02.195 [2024-04-16 23:03:53.229577] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:02.195 [2024-04-16 23:03:53.229600] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:02.195 [2024-04-16 23:03:53.229615] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:02.195 [2024-04-16 23:03:53.231684] bdev_nvme.c:2024:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:02.195 [2024-04-16 23:03:53.241274] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:02.195 [2024-04-16 23:03:53.241711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:02.195 [2024-04-16 23:03:53.241898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:02.195 [2024-04-16 23:03:53.241926] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1bc2400 with addr=10.0.0.2, port=4420 00:26:02.195 [2024-04-16 23:03:53.241943] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1bc2400 is same with the state(5) to be set 00:26:02.195 [2024-04-16 23:03:53.242072] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1bc2400 (9): Bad file descriptor 00:26:02.195 [2024-04-16 23:03:53.242215] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:02.195 [2024-04-16 23:03:53.242239] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:02.195 [2024-04-16 23:03:53.242254] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:02.195 [2024-04-16 23:03:53.244467] bdev_nvme.c:2024:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:02.195 [2024-04-16 23:03:53.253823] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:02.195 [2024-04-16 23:03:53.254204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:02.195 [2024-04-16 23:03:53.254341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:02.195 [2024-04-16 23:03:53.254366] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1bc2400 with addr=10.0.0.2, port=4420 00:26:02.195 [2024-04-16 23:03:53.254382] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1bc2400 is same with the state(5) to be set 00:26:02.195 [2024-04-16 23:03:53.254577] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1bc2400 (9): Bad file descriptor 00:26:02.195 [2024-04-16 23:03:53.254738] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:02.195 [2024-04-16 23:03:53.254761] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:02.195 [2024-04-16 23:03:53.254777] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:02.195 [2024-04-16 23:03:53.257046] bdev_nvme.c:2024:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:02.195 [2024-04-16 23:03:53.266147] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:02.195 [2024-04-16 23:03:53.266552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:02.195 [2024-04-16 23:03:53.266730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:02.195 [2024-04-16 23:03:53.266759] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1bc2400 with addr=10.0.0.2, port=4420 00:26:02.195 [2024-04-16 23:03:53.266776] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1bc2400 is same with the state(5) to be set 00:26:02.195 [2024-04-16 23:03:53.266946] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1bc2400 (9): Bad file descriptor 00:26:02.195 [2024-04-16 23:03:53.267133] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:02.195 [2024-04-16 23:03:53.267156] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:02.195 [2024-04-16 23:03:53.267171] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:02.195 [2024-04-16 23:03:53.269454] bdev_nvme.c:2024:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:02.195 [2024-04-16 23:03:53.278688] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:02.195 [2024-04-16 23:03:53.279129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:02.195 [2024-04-16 23:03:53.279301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:02.195 [2024-04-16 23:03:53.279331] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1bc2400 with addr=10.0.0.2, port=4420 00:26:02.195 [2024-04-16 23:03:53.279348] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1bc2400 is same with the state(5) to be set 00:26:02.195 [2024-04-16 23:03:53.279495] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1bc2400 (9): Bad file descriptor 00:26:02.195 [2024-04-16 23:03:53.279627] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:02.195 [2024-04-16 23:03:53.279650] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:02.195 [2024-04-16 23:03:53.279665] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:02.195 [2024-04-16 23:03:53.282093] bdev_nvme.c:2024:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:02.195 [2024-04-16 23:03:53.291146] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:02.195 [2024-04-16 23:03:53.291527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:02.195 [2024-04-16 23:03:53.291763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:02.195 [2024-04-16 23:03:53.291792] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1bc2400 with addr=10.0.0.2, port=4420 00:26:02.195 [2024-04-16 23:03:53.291809] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1bc2400 is same with the state(5) to be set 00:26:02.195 [2024-04-16 23:03:53.291992] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1bc2400 (9): Bad file descriptor 00:26:02.195 [2024-04-16 23:03:53.292106] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:02.195 [2024-04-16 23:03:53.292129] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:02.195 [2024-04-16 23:03:53.292144] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:02.195 [2024-04-16 23:03:53.294383] bdev_nvme.c:2024:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:02.195 [2024-04-16 23:03:53.303701] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:02.195 [2024-04-16 23:03:53.304018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:02.195 [2024-04-16 23:03:53.304214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:02.195 [2024-04-16 23:03:53.304244] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1bc2400 with addr=10.0.0.2, port=4420 00:26:02.195 [2024-04-16 23:03:53.304261] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1bc2400 is same with the state(5) to be set 00:26:02.195 [2024-04-16 23:03:53.304498] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1bc2400 (9): Bad file descriptor 00:26:02.195 [2024-04-16 23:03:53.304690] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:02.195 [2024-04-16 23:03:53.304714] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:02.195 [2024-04-16 23:03:53.304729] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:02.195 [2024-04-16 23:03:53.307105] bdev_nvme.c:2024:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:02.195 [2024-04-16 23:03:53.316323] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:02.195 [2024-04-16 23:03:53.316658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:02.195 [2024-04-16 23:03:53.316843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:02.195 [2024-04-16 23:03:53.316872] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1bc2400 with addr=10.0.0.2, port=4420 00:26:02.195 [2024-04-16 23:03:53.316890] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1bc2400 is same with the state(5) to be set 00:26:02.195 [2024-04-16 23:03:53.317055] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1bc2400 (9): Bad file descriptor 00:26:02.195 [2024-04-16 23:03:53.317267] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:02.195 [2024-04-16 23:03:53.317293] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:02.195 [2024-04-16 23:03:53.317318] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:02.195 [2024-04-16 23:03:53.319763] bdev_nvme.c:2024:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:02.457 [2024-04-16 23:03:53.329102] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:02.457 [2024-04-16 23:03:53.329462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:02.457 [2024-04-16 23:03:53.329612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:02.457 [2024-04-16 23:03:53.329637] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1bc2400 with addr=10.0.0.2, port=4420 00:26:02.457 [2024-04-16 23:03:53.329654] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1bc2400 is same with the state(5) to be set 00:26:02.457 [2024-04-16 23:03:53.329852] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1bc2400 (9): Bad file descriptor 00:26:02.457 [2024-04-16 23:03:53.330002] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:02.457 [2024-04-16 23:03:53.330025] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:02.457 [2024-04-16 23:03:53.330041] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:02.457 [2024-04-16 23:03:53.332335] bdev_nvme.c:2024:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:02.457 [2024-04-16 23:03:53.341708] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:02.457 [2024-04-16 23:03:53.342037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:02.457 [2024-04-16 23:03:53.342202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:02.457 [2024-04-16 23:03:53.342231] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1bc2400 with addr=10.0.0.2, port=4420 00:26:02.457 [2024-04-16 23:03:53.342249] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1bc2400 is same with the state(5) to be set 00:26:02.457 [2024-04-16 23:03:53.342378] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1bc2400 (9): Bad file descriptor 00:26:02.457 [2024-04-16 23:03:53.342553] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:02.457 [2024-04-16 23:03:53.342576] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:02.457 [2024-04-16 23:03:53.342591] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:02.457 [2024-04-16 23:03:53.344767] bdev_nvme.c:2024:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:02.457 [2024-04-16 23:03:53.354309] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:02.457 [2024-04-16 23:03:53.354686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:02.457 [2024-04-16 23:03:53.354892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:02.457 [2024-04-16 23:03:53.354938] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1bc2400 with addr=10.0.0.2, port=4420 00:26:02.457 [2024-04-16 23:03:53.354955] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1bc2400 is same with the state(5) to be set 00:26:02.457 [2024-04-16 23:03:53.355120] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1bc2400 (9): Bad file descriptor 00:26:02.457 [2024-04-16 23:03:53.355336] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:02.457 [2024-04-16 23:03:53.355360] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:02.457 [2024-04-16 23:03:53.355375] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:02.457 [2024-04-16 23:03:53.357731] bdev_nvme.c:2024:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:02.457 [2024-04-16 23:03:53.366664] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:02.457 [2024-04-16 23:03:53.367040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:02.457 [2024-04-16 23:03:53.367226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:02.457 [2024-04-16 23:03:53.367256] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1bc2400 with addr=10.0.0.2, port=4420 00:26:02.457 [2024-04-16 23:03:53.367274] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1bc2400 is same with the state(5) to be set 00:26:02.457 [2024-04-16 23:03:53.367456] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1bc2400 (9): Bad file descriptor 00:26:02.457 [2024-04-16 23:03:53.367589] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:02.457 [2024-04-16 23:03:53.367612] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:02.457 [2024-04-16 23:03:53.367627] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:02.457 [2024-04-16 23:03:53.370001] bdev_nvme.c:2024:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:02.457 [2024-04-16 23:03:53.379297] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:02.457 [2024-04-16 23:03:53.379672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:02.457 [2024-04-16 23:03:53.379843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:02.457 [2024-04-16 23:03:53.379891] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1bc2400 with addr=10.0.0.2, port=4420 00:26:02.457 [2024-04-16 23:03:53.379908] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1bc2400 is same with the state(5) to be set 00:26:02.457 [2024-04-16 23:03:53.380091] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1bc2400 (9): Bad file descriptor 00:26:02.457 [2024-04-16 23:03:53.380234] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:02.457 [2024-04-16 23:03:53.380258] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:02.457 [2024-04-16 23:03:53.380279] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:02.457 [2024-04-16 23:03:53.382762] bdev_nvme.c:2024:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:02.457 [2024-04-16 23:03:53.391836] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:02.457 [2024-04-16 23:03:53.392162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:02.457 [2024-04-16 23:03:53.392348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:02.457 [2024-04-16 23:03:53.392373] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1bc2400 with addr=10.0.0.2, port=4420 00:26:02.457 [2024-04-16 23:03:53.392389] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1bc2400 is same with the state(5) to be set 00:26:02.457 [2024-04-16 23:03:53.392597] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1bc2400 (9): Bad file descriptor 00:26:02.457 [2024-04-16 23:03:53.392777] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:02.457 [2024-04-16 23:03:53.392801] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:02.457 [2024-04-16 23:03:53.392816] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:02.457 [2024-04-16 23:03:53.395156] bdev_nvme.c:2024:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:02.457 [2024-04-16 23:03:53.404437] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:02.458 [2024-04-16 23:03:53.404738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:02.458 [2024-04-16 23:03:53.404906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:02.458 [2024-04-16 23:03:53.404934] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1bc2400 with addr=10.0.0.2, port=4420 00:26:02.458 [2024-04-16 23:03:53.404952] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1bc2400 is same with the state(5) to be set 00:26:02.458 [2024-04-16 23:03:53.405098] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1bc2400 (9): Bad file descriptor 00:26:02.458 [2024-04-16 23:03:53.405261] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:02.458 [2024-04-16 23:03:53.405285] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:02.458 [2024-04-16 23:03:53.405300] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:02.458 [2024-04-16 23:03:53.407604] bdev_nvme.c:2024:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:02.458 [2024-04-16 23:03:53.417030] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:02.458 [2024-04-16 23:03:53.417435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:02.458 [2024-04-16 23:03:53.417626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:02.458 [2024-04-16 23:03:53.417655] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1bc2400 with addr=10.0.0.2, port=4420 00:26:02.458 [2024-04-16 23:03:53.417672] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1bc2400 is same with the state(5) to be set 00:26:02.458 [2024-04-16 23:03:53.417855] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1bc2400 (9): Bad file descriptor 00:26:02.458 [2024-04-16 23:03:53.418005] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:02.458 [2024-04-16 23:03:53.418029] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:02.458 [2024-04-16 23:03:53.418049] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:02.458 [2024-04-16 23:03:53.420294] bdev_nvme.c:2024:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:02.458 [2024-04-16 23:03:53.429585] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:02.458 [2024-04-16 23:03:53.429945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:02.458 [2024-04-16 23:03:53.430091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:02.458 [2024-04-16 23:03:53.430117] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1bc2400 with addr=10.0.0.2, port=4420 00:26:02.458 [2024-04-16 23:03:53.430132] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1bc2400 is same with the state(5) to be set 00:26:02.458 [2024-04-16 23:03:53.430274] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1bc2400 (9): Bad file descriptor 00:26:02.458 [2024-04-16 23:03:53.430455] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:02.458 [2024-04-16 23:03:53.430493] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:02.458 [2024-04-16 23:03:53.430509] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:02.458 [2024-04-16 23:03:53.432707] bdev_nvme.c:2024:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:02.458 [2024-04-16 23:03:53.442153] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:02.458 [2024-04-16 23:03:53.442497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:02.458 [2024-04-16 23:03:53.442624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:02.458 [2024-04-16 23:03:53.442654] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1bc2400 with addr=10.0.0.2, port=4420 00:26:02.458 [2024-04-16 23:03:53.442672] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1bc2400 is same with the state(5) to be set 00:26:02.458 [2024-04-16 23:03:53.442801] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1bc2400 (9): Bad file descriptor 00:26:02.458 [2024-04-16 23:03:53.442934] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:02.458 [2024-04-16 23:03:53.442957] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:02.458 [2024-04-16 23:03:53.442972] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:02.458 [2024-04-16 23:03:53.445248] bdev_nvme.c:2024:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:02.458 [2024-04-16 23:03:53.454647] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:02.458 [2024-04-16 23:03:53.454992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:02.458 [2024-04-16 23:03:53.455154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:02.458 [2024-04-16 23:03:53.455190] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1bc2400 with addr=10.0.0.2, port=4420 00:26:02.458 [2024-04-16 23:03:53.455210] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1bc2400 is same with the state(5) to be set 00:26:02.458 [2024-04-16 23:03:53.455393] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1bc2400 (9): Bad file descriptor 00:26:02.458 [2024-04-16 23:03:53.455544] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:02.458 [2024-04-16 23:03:53.455567] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:02.458 [2024-04-16 23:03:53.455582] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:02.458 [2024-04-16 23:03:53.457773] bdev_nvme.c:2024:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:02.458 [2024-04-16 23:03:53.467147] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:02.458 [2024-04-16 23:03:53.467520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:02.458 [2024-04-16 23:03:53.467686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:02.458 [2024-04-16 23:03:53.467715] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1bc2400 with addr=10.0.0.2, port=4420 00:26:02.458 [2024-04-16 23:03:53.467732] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1bc2400 is same with the state(5) to be set 00:26:02.458 [2024-04-16 23:03:53.467915] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1bc2400 (9): Bad file descriptor 00:26:02.458 [2024-04-16 23:03:53.468084] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:02.458 [2024-04-16 23:03:53.468107] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:02.458 [2024-04-16 23:03:53.468123] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:02.458 [2024-04-16 23:03:53.470398] bdev_nvme.c:2024:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:02.458 [2024-04-16 23:03:53.479607] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:02.458 [2024-04-16 23:03:53.479949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:02.458 [2024-04-16 23:03:53.480116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:02.458 [2024-04-16 23:03:53.480143] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1bc2400 with addr=10.0.0.2, port=4420 00:26:02.458 [2024-04-16 23:03:53.480161] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1bc2400 is same with the state(5) to be set 00:26:02.458 [2024-04-16 23:03:53.480317] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1bc2400 (9): Bad file descriptor 00:26:02.458 [2024-04-16 23:03:53.480540] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:02.458 [2024-04-16 23:03:53.480563] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:02.458 [2024-04-16 23:03:53.480579] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:02.458 [2024-04-16 23:03:53.482990] bdev_nvme.c:2024:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:02.458 [2024-04-16 23:03:53.492047] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:02.458 [2024-04-16 23:03:53.492392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:02.458 [2024-04-16 23:03:53.492556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:02.458 [2024-04-16 23:03:53.492584] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1bc2400 with addr=10.0.0.2, port=4420 00:26:02.458 [2024-04-16 23:03:53.492601] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1bc2400 is same with the state(5) to be set 00:26:02.458 [2024-04-16 23:03:53.492748] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1bc2400 (9): Bad file descriptor 00:26:02.458 [2024-04-16 23:03:53.492880] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:02.458 [2024-04-16 23:03:53.492903] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:02.458 [2024-04-16 23:03:53.492918] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:02.458 [2024-04-16 23:03:53.495151] bdev_nvme.c:2024:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:02.458 [2024-04-16 23:03:53.504654] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:02.458 [2024-04-16 23:03:53.504990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:02.459 [2024-04-16 23:03:53.505115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:02.459 [2024-04-16 23:03:53.505144] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1bc2400 with addr=10.0.0.2, port=4420 00:26:02.459 [2024-04-16 23:03:53.505161] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1bc2400 is same with the state(5) to be set 00:26:02.459 [2024-04-16 23:03:53.505317] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1bc2400 (9): Bad file descriptor 00:26:02.459 [2024-04-16 23:03:53.505504] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:02.459 [2024-04-16 23:03:53.505527] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:02.459 [2024-04-16 23:03:53.505543] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:02.459 [2024-04-16 23:03:53.507955] bdev_nvme.c:2024:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:02.459 [2024-04-16 23:03:53.517279] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:02.459 [2024-04-16 23:03:53.517620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:02.459 [2024-04-16 23:03:53.517875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:02.459 [2024-04-16 23:03:53.517900] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1bc2400 with addr=10.0.0.2, port=4420 00:26:02.459 [2024-04-16 23:03:53.517916] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1bc2400 is same with the state(5) to be set 00:26:02.459 [2024-04-16 23:03:53.518119] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1bc2400 (9): Bad file descriptor 00:26:02.459 [2024-04-16 23:03:53.518282] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:02.459 [2024-04-16 23:03:53.518304] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:02.459 [2024-04-16 23:03:53.518318] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:02.459 [2024-04-16 23:03:53.520829] bdev_nvme.c:2024:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:02.459 [2024-04-16 23:03:53.529818] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:02.459 [2024-04-16 23:03:53.530136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:02.459 [2024-04-16 23:03:53.530309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:02.459 [2024-04-16 23:03:53.530338] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1bc2400 with addr=10.0.0.2, port=4420 00:26:02.459 [2024-04-16 23:03:53.530355] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1bc2400 is same with the state(5) to be set 00:26:02.459 [2024-04-16 23:03:53.530520] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1bc2400 (9): Bad file descriptor 00:26:02.459 [2024-04-16 23:03:53.530688] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:02.459 [2024-04-16 23:03:53.530711] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:02.459 [2024-04-16 23:03:53.530727] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:02.459 [2024-04-16 23:03:53.532973] bdev_nvme.c:2024:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:02.459 [2024-04-16 23:03:53.542278] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:02.459 [2024-04-16 23:03:53.542640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:02.459 [2024-04-16 23:03:53.542842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:02.459 [2024-04-16 23:03:53.542868] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1bc2400 with addr=10.0.0.2, port=4420 00:26:02.459 [2024-04-16 23:03:53.542884] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1bc2400 is same with the state(5) to be set 00:26:02.459 [2024-04-16 23:03:53.543113] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1bc2400 (9): Bad file descriptor 00:26:02.459 [2024-04-16 23:03:53.543329] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:02.459 [2024-04-16 23:03:53.543353] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:02.459 [2024-04-16 23:03:53.543368] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:02.459 [2024-04-16 23:03:53.545670] bdev_nvme.c:2024:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:02.459 [2024-04-16 23:03:53.554990] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:02.459 [2024-04-16 23:03:53.555339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:02.459 [2024-04-16 23:03:53.555563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:02.459 [2024-04-16 23:03:53.555592] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1bc2400 with addr=10.0.0.2, port=4420 00:26:02.459 [2024-04-16 23:03:53.555610] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1bc2400 is same with the state(5) to be set 00:26:02.459 [2024-04-16 23:03:53.555811] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1bc2400 (9): Bad file descriptor 00:26:02.459 [2024-04-16 23:03:53.555998] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:02.459 [2024-04-16 23:03:53.556021] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:02.459 [2024-04-16 23:03:53.556037] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:02.459 [2024-04-16 23:03:53.558371] bdev_nvme.c:2024:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:02.459 [2024-04-16 23:03:53.567494] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:02.459 [2024-04-16 23:03:53.567884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:02.459 [2024-04-16 23:03:53.568033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:02.459 [2024-04-16 23:03:53.568061] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1bc2400 with addr=10.0.0.2, port=4420 00:26:02.459 [2024-04-16 23:03:53.568078] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1bc2400 is same with the state(5) to be set 00:26:02.459 [2024-04-16 23:03:53.568272] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1bc2400 (9): Bad file descriptor 00:26:02.459 [2024-04-16 23:03:53.568423] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:02.459 [2024-04-16 23:03:53.568447] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:02.459 [2024-04-16 23:03:53.568462] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:02.459 [2024-04-16 23:03:53.570763] bdev_nvme.c:2024:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:02.459 [2024-04-16 23:03:53.580044] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:02.459 [2024-04-16 23:03:53.580388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:02.459 [2024-04-16 23:03:53.580568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:02.459 [2024-04-16 23:03:53.580594] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1bc2400 with addr=10.0.0.2, port=4420 00:26:02.459 [2024-04-16 23:03:53.580633] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1bc2400 is same with the state(5) to be set 00:26:02.459 [2024-04-16 23:03:53.580805] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1bc2400 (9): Bad file descriptor 00:26:02.459 [2024-04-16 23:03:53.580980] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:02.459 [2024-04-16 23:03:53.581004] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:02.459 [2024-04-16 23:03:53.581020] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:02.720 [2024-04-16 23:03:53.583392] bdev_nvme.c:2024:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:02.720 [2024-04-16 23:03:53.592657] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:02.720 [2024-04-16 23:03:53.593076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:02.720 [2024-04-16 23:03:53.593255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:02.720 [2024-04-16 23:03:53.593282] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1bc2400 with addr=10.0.0.2, port=4420 00:26:02.720 [2024-04-16 23:03:53.593297] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1bc2400 is same with the state(5) to be set 00:26:02.720 [2024-04-16 23:03:53.593461] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1bc2400 (9): Bad file descriptor 00:26:02.720 [2024-04-16 23:03:53.593627] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:02.720 [2024-04-16 23:03:53.593650] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:02.720 [2024-04-16 23:03:53.593666] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:02.720 [2024-04-16 23:03:53.595859] bdev_nvme.c:2024:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:02.720 [2024-04-16 23:03:53.605366] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:02.720 [2024-04-16 23:03:53.605678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:02.720 [2024-04-16 23:03:53.605867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:02.720 [2024-04-16 23:03:53.605895] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1bc2400 with addr=10.0.0.2, port=4420 00:26:02.720 [2024-04-16 23:03:53.605912] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1bc2400 is same with the state(5) to be set 00:26:02.720 [2024-04-16 23:03:53.606113] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1bc2400 (9): Bad file descriptor 00:26:02.720 [2024-04-16 23:03:53.606293] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:02.720 [2024-04-16 23:03:53.606317] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:02.720 [2024-04-16 23:03:53.606332] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:02.720 [2024-04-16 23:03:53.608670] bdev_nvme.c:2024:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:02.720 [2024-04-16 23:03:53.617863] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:02.720 [2024-04-16 23:03:53.618254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:02.721 [2024-04-16 23:03:53.618407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:02.721 [2024-04-16 23:03:53.618435] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1bc2400 with addr=10.0.0.2, port=4420 00:26:02.721 [2024-04-16 23:03:53.618453] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1bc2400 is same with the state(5) to be set 00:26:02.721 [2024-04-16 23:03:53.618660] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1bc2400 (9): Bad file descriptor 00:26:02.721 [2024-04-16 23:03:53.618829] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:02.721 [2024-04-16 23:03:53.618853] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:02.721 [2024-04-16 23:03:53.618868] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:02.721 [2024-04-16 23:03:53.621064] bdev_nvme.c:2024:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:02.721 [2024-04-16 23:03:53.630499] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:02.721 [2024-04-16 23:03:53.630796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:02.721 [2024-04-16 23:03:53.630984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:02.721 [2024-04-16 23:03:53.631012] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1bc2400 with addr=10.0.0.2, port=4420 00:26:02.721 [2024-04-16 23:03:53.631029] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1bc2400 is same with the state(5) to be set 00:26:02.721 [2024-04-16 23:03:53.631206] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1bc2400 (9): Bad file descriptor 00:26:02.721 [2024-04-16 23:03:53.631375] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:02.721 [2024-04-16 23:03:53.631398] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:02.721 [2024-04-16 23:03:53.631414] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:02.721 [2024-04-16 23:03:53.633767] bdev_nvme.c:2024:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:02.721 [2024-04-16 23:03:53.643463] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:02.721 [2024-04-16 23:03:53.643807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:02.721 [2024-04-16 23:03:53.643956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:02.721 [2024-04-16 23:03:53.643981] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1bc2400 with addr=10.0.0.2, port=4420 00:26:02.721 [2024-04-16 23:03:53.643997] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1bc2400 is same with the state(5) to be set 00:26:02.721 [2024-04-16 23:03:53.644213] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1bc2400 (9): Bad file descriptor 00:26:02.721 [2024-04-16 23:03:53.644366] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:02.721 [2024-04-16 23:03:53.644389] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:02.721 [2024-04-16 23:03:53.644405] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:02.721 [2024-04-16 23:03:53.646670] bdev_nvme.c:2024:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:02.721 [2024-04-16 23:03:53.656210] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:02.721 [2024-04-16 23:03:53.656550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:02.721 [2024-04-16 23:03:53.656690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:02.721 [2024-04-16 23:03:53.656716] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1bc2400 with addr=10.0.0.2, port=4420 00:26:02.721 [2024-04-16 23:03:53.656731] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1bc2400 is same with the state(5) to be set 00:26:02.721 [2024-04-16 23:03:53.656937] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1bc2400 (9): Bad file descriptor 00:26:02.721 [2024-04-16 23:03:53.657088] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:02.721 [2024-04-16 23:03:53.657111] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:02.721 [2024-04-16 23:03:53.657127] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:02.721 [2024-04-16 23:03:53.659563] bdev_nvme.c:2024:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:02.721 [2024-04-16 23:03:53.668875] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:02.721 [2024-04-16 23:03:53.669253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:02.721 [2024-04-16 23:03:53.669409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:02.721 [2024-04-16 23:03:53.669434] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1bc2400 with addr=10.0.0.2, port=4420 00:26:02.721 [2024-04-16 23:03:53.669450] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1bc2400 is same with the state(5) to be set 00:26:02.721 [2024-04-16 23:03:53.669630] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1bc2400 (9): Bad file descriptor 00:26:02.721 [2024-04-16 23:03:53.669831] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:02.721 [2024-04-16 23:03:53.669854] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:02.721 [2024-04-16 23:03:53.669869] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:02.721 [2024-04-16 23:03:53.672084] bdev_nvme.c:2024:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:02.721 [2024-04-16 23:03:53.681619] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:02.721 [2024-04-16 23:03:53.681958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:02.721 [2024-04-16 23:03:53.682143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:02.721 [2024-04-16 23:03:53.682171] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1bc2400 with addr=10.0.0.2, port=4420 00:26:02.721 [2024-04-16 23:03:53.682200] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1bc2400 is same with the state(5) to be set 00:26:02.721 [2024-04-16 23:03:53.682384] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1bc2400 (9): Bad file descriptor 00:26:02.721 [2024-04-16 23:03:53.682534] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:02.721 [2024-04-16 23:03:53.682557] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:02.721 [2024-04-16 23:03:53.682573] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:02.721 [2024-04-16 23:03:53.684841] bdev_nvme.c:2024:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:02.721 [2024-04-16 23:03:53.694164] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:02.721 [2024-04-16 23:03:53.694527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:02.721 [2024-04-16 23:03:53.694676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:02.721 [2024-04-16 23:03:53.694701] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1bc2400 with addr=10.0.0.2, port=4420 00:26:02.721 [2024-04-16 23:03:53.694716] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1bc2400 is same with the state(5) to be set 00:26:02.721 [2024-04-16 23:03:53.694914] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1bc2400 (9): Bad file descriptor 00:26:02.721 [2024-04-16 23:03:53.695106] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:02.721 [2024-04-16 23:03:53.695130] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:02.721 [2024-04-16 23:03:53.695145] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:02.721 [2024-04-16 23:03:53.697509] bdev_nvme.c:2024:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:02.721 [2024-04-16 23:03:53.706874] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:02.721 [2024-04-16 23:03:53.707300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:02.721 [2024-04-16 23:03:53.707423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:02.721 [2024-04-16 23:03:53.707449] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1bc2400 with addr=10.0.0.2, port=4420 00:26:02.721 [2024-04-16 23:03:53.707464] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1bc2400 is same with the state(5) to be set 00:26:02.721 [2024-04-16 23:03:53.707608] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1bc2400 (9): Bad file descriptor 00:26:02.721 [2024-04-16 23:03:53.707773] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:02.721 [2024-04-16 23:03:53.707797] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:02.721 [2024-04-16 23:03:53.707812] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:02.721 [2024-04-16 23:03:53.710112] bdev_nvme.c:2024:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:02.721 [2024-04-16 23:03:53.719457] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:02.721 [2024-04-16 23:03:53.719881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:02.721 [2024-04-16 23:03:53.720043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:02.721 [2024-04-16 23:03:53.720070] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1bc2400 with addr=10.0.0.2, port=4420 00:26:02.721 [2024-04-16 23:03:53.720088] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1bc2400 is same with the state(5) to be set 00:26:02.721 [2024-04-16 23:03:53.720282] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1bc2400 (9): Bad file descriptor 00:26:02.721 [2024-04-16 23:03:53.720487] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:02.721 [2024-04-16 23:03:53.720511] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:02.721 [2024-04-16 23:03:53.720526] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:02.721 [2024-04-16 23:03:53.723150] bdev_nvme.c:2024:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:02.721 [2024-04-16 23:03:53.731817] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:02.721 [2024-04-16 23:03:53.732196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:02.721 [2024-04-16 23:03:53.732359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:02.721 [2024-04-16 23:03:53.732387] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1bc2400 with addr=10.0.0.2, port=4420 00:26:02.721 [2024-04-16 23:03:53.732405] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1bc2400 is same with the state(5) to be set 00:26:02.722 [2024-04-16 23:03:53.732587] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1bc2400 (9): Bad file descriptor 00:26:02.722 [2024-04-16 23:03:53.732737] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:02.722 [2024-04-16 23:03:53.732766] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:02.722 [2024-04-16 23:03:53.732782] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:02.722 [2024-04-16 23:03:53.735142] bdev_nvme.c:2024:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:02.722 [2024-04-16 23:03:53.744432] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:02.722 [2024-04-16 23:03:53.744750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:02.722 [2024-04-16 23:03:53.744946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:02.722 [2024-04-16 23:03:53.744971] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1bc2400 with addr=10.0.0.2, port=4420 00:26:02.722 [2024-04-16 23:03:53.744987] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1bc2400 is same with the state(5) to be set 00:26:02.722 [2024-04-16 23:03:53.745237] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1bc2400 (9): Bad file descriptor 00:26:02.722 [2024-04-16 23:03:53.745420] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:02.722 [2024-04-16 23:03:53.745445] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:02.722 [2024-04-16 23:03:53.745460] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:02.722 [2024-04-16 23:03:53.747868] bdev_nvme.c:2024:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:02.722 [2024-04-16 23:03:53.756892] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:02.722 [2024-04-16 23:03:53.757217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:02.722 [2024-04-16 23:03:53.757377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:02.722 [2024-04-16 23:03:53.757403] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1bc2400 with addr=10.0.0.2, port=4420 00:26:02.722 [2024-04-16 23:03:53.757434] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1bc2400 is same with the state(5) to be set 00:26:02.722 [2024-04-16 23:03:53.757644] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1bc2400 (9): Bad file descriptor 00:26:02.722 [2024-04-16 23:03:53.757814] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:02.722 [2024-04-16 23:03:53.757837] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:02.722 [2024-04-16 23:03:53.757852] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:02.722 [2024-04-16 23:03:53.760069] bdev_nvme.c:2024:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:02.722 [2024-04-16 23:03:53.769567] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:02.722 [2024-04-16 23:03:53.769882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:02.722 [2024-04-16 23:03:53.770044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:02.722 [2024-04-16 23:03:53.770072] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1bc2400 with addr=10.0.0.2, port=4420 00:26:02.722 [2024-04-16 23:03:53.770089] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1bc2400 is same with the state(5) to be set 00:26:02.722 [2024-04-16 23:03:53.770321] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1bc2400 (9): Bad file descriptor 00:26:02.722 [2024-04-16 23:03:53.770491] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:02.722 [2024-04-16 23:03:53.770514] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:02.722 [2024-04-16 23:03:53.770535] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:02.722 [2024-04-16 23:03:53.772768] bdev_nvme.c:2024:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:02.722 [2024-04-16 23:03:53.782154] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:02.722 [2024-04-16 23:03:53.782519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:02.722 [2024-04-16 23:03:53.782688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:02.722 [2024-04-16 23:03:53.782713] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1bc2400 with addr=10.0.0.2, port=4420 00:26:02.722 [2024-04-16 23:03:53.782729] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1bc2400 is same with the state(5) to be set 00:26:02.722 [2024-04-16 23:03:53.782878] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1bc2400 (9): Bad file descriptor 00:26:02.722 [2024-04-16 23:03:53.782997] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:02.722 [2024-04-16 23:03:53.783021] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:02.722 [2024-04-16 23:03:53.783036] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:02.722 [2024-04-16 23:03:53.785383] bdev_nvme.c:2024:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:02.722 [2024-04-16 23:03:53.794919] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:02.722 [2024-04-16 23:03:53.795284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:02.722 [2024-04-16 23:03:53.795456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:02.722 [2024-04-16 23:03:53.795482] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1bc2400 with addr=10.0.0.2, port=4420 00:26:02.722 [2024-04-16 23:03:53.795497] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1bc2400 is same with the state(5) to be set 00:26:02.722 [2024-04-16 23:03:53.795645] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1bc2400 (9): Bad file descriptor 00:26:02.722 [2024-04-16 23:03:53.795816] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:02.722 [2024-04-16 23:03:53.795840] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:02.722 [2024-04-16 23:03:53.795855] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:02.722 [2024-04-16 23:03:53.798310] bdev_nvme.c:2024:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:02.722 [2024-04-16 23:03:53.807545] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:02.722 [2024-04-16 23:03:53.807903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:02.722 [2024-04-16 23:03:53.808084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:02.722 [2024-04-16 23:03:53.808110] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1bc2400 with addr=10.0.0.2, port=4420 00:26:02.722 [2024-04-16 23:03:53.808140] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1bc2400 is same with the state(5) to be set 00:26:02.722 [2024-04-16 23:03:53.808315] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1bc2400 (9): Bad file descriptor 00:26:02.722 [2024-04-16 23:03:53.808466] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:02.722 [2024-04-16 23:03:53.808489] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:02.722 [2024-04-16 23:03:53.808504] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:02.722 [2024-04-16 23:03:53.810679] bdev_nvme.c:2024:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:02.722 [2024-04-16 23:03:53.820137] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:02.722 [2024-04-16 23:03:53.820504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:02.722 [2024-04-16 23:03:53.820732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:02.722 [2024-04-16 23:03:53.820784] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1bc2400 with addr=10.0.0.2, port=4420 00:26:02.722 [2024-04-16 23:03:53.820802] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1bc2400 is same with the state(5) to be set 00:26:02.722 [2024-04-16 23:03:53.820985] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1bc2400 (9): Bad file descriptor 00:26:02.722 [2024-04-16 23:03:53.821172] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:02.722 [2024-04-16 23:03:53.821206] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:02.722 [2024-04-16 23:03:53.821221] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:02.722 [2024-04-16 23:03:53.823522] bdev_nvme.c:2024:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:02.722 [2024-04-16 23:03:53.832605] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:02.722 [2024-04-16 23:03:53.832934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:02.722 [2024-04-16 23:03:53.833119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:02.722 [2024-04-16 23:03:53.833148] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1bc2400 with addr=10.0.0.2, port=4420 00:26:02.722 [2024-04-16 23:03:53.833165] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1bc2400 is same with the state(5) to be set 00:26:02.722 [2024-04-16 23:03:53.833326] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1bc2400 (9): Bad file descriptor 00:26:02.722 [2024-04-16 23:03:53.833458] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:02.722 [2024-04-16 23:03:53.833482] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:02.722 [2024-04-16 23:03:53.833497] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:02.722 [2024-04-16 23:03:53.835941] bdev_nvme.c:2024:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:02.722 [2024-04-16 23:03:53.845154] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:02.722 [2024-04-16 23:03:53.845500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:02.722 [2024-04-16 23:03:53.845737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:02.722 [2024-04-16 23:03:53.845784] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1bc2400 with addr=10.0.0.2, port=4420 00:26:02.722 [2024-04-16 23:03:53.845802] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1bc2400 is same with the state(5) to be set 00:26:02.722 [2024-04-16 23:03:53.845950] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1bc2400 (9): Bad file descriptor 00:26:02.722 [2024-04-16 23:03:53.846207] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:02.723 [2024-04-16 23:03:53.846234] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:02.723 [2024-04-16 23:03:53.846250] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:02.983 [2024-04-16 23:03:53.848635] bdev_nvme.c:2024:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:02.983 [2024-04-16 23:03:53.857703] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:02.983 [2024-04-16 23:03:53.858204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:02.983 [2024-04-16 23:03:53.858447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:02.983 [2024-04-16 23:03:53.858487] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1bc2400 with addr=10.0.0.2, port=4420 00:26:02.983 [2024-04-16 23:03:53.858503] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1bc2400 is same with the state(5) to be set 00:26:02.983 [2024-04-16 23:03:53.858677] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1bc2400 (9): Bad file descriptor 00:26:02.983 [2024-04-16 23:03:53.858896] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:02.983 [2024-04-16 23:03:53.858920] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:02.983 [2024-04-16 23:03:53.858936] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:02.983 [2024-04-16 23:03:53.861112] bdev_nvme.c:2024:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:02.983 [2024-04-16 23:03:53.870199] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:02.983 [2024-04-16 23:03:53.870533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:02.983 [2024-04-16 23:03:53.870714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:02.983 [2024-04-16 23:03:53.870739] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1bc2400 with addr=10.0.0.2, port=4420 00:26:02.983 [2024-04-16 23:03:53.870771] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1bc2400 is same with the state(5) to be set 00:26:02.983 [2024-04-16 23:03:53.870919] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1bc2400 (9): Bad file descriptor 00:26:02.983 [2024-04-16 23:03:53.871088] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:02.983 [2024-04-16 23:03:53.871112] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:02.983 [2024-04-16 23:03:53.871127] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:02.983 [2024-04-16 23:03:53.873183] bdev_nvme.c:2024:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:02.983 [2024-04-16 23:03:53.882881] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:02.983 [2024-04-16 23:03:53.883242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:02.983 [2024-04-16 23:03:53.883508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:02.983 [2024-04-16 23:03:53.883548] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1bc2400 with addr=10.0.0.2, port=4420 00:26:02.983 [2024-04-16 23:03:53.883564] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1bc2400 is same with the state(5) to be set 00:26:02.983 [2024-04-16 23:03:53.883677] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1bc2400 (9): Bad file descriptor 00:26:02.983 [2024-04-16 23:03:53.883878] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:02.983 [2024-04-16 23:03:53.883902] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:02.983 [2024-04-16 23:03:53.883917] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:02.983 [2024-04-16 23:03:53.886281] bdev_nvme.c:2024:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:02.983 [2024-04-16 23:03:53.895517] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:02.983 [2024-04-16 23:03:53.895851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:02.983 [2024-04-16 23:03:53.896031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:02.983 [2024-04-16 23:03:53.896057] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1bc2400 with addr=10.0.0.2, port=4420 00:26:02.983 [2024-04-16 23:03:53.896073] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1bc2400 is same with the state(5) to be set 00:26:02.983 [2024-04-16 23:03:53.896246] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1bc2400 (9): Bad file descriptor 00:26:02.983 [2024-04-16 23:03:53.896468] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:02.983 [2024-04-16 23:03:53.896492] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:02.983 [2024-04-16 23:03:53.896507] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:02.983 [2024-04-16 23:03:53.898788] bdev_nvme.c:2024:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:02.983 [2024-04-16 23:03:53.908049] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:02.983 [2024-04-16 23:03:53.908369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:02.983 [2024-04-16 23:03:53.908536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:02.984 [2024-04-16 23:03:53.908565] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1bc2400 with addr=10.0.0.2, port=4420 00:26:02.984 [2024-04-16 23:03:53.908583] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1bc2400 is same with the state(5) to be set 00:26:02.984 [2024-04-16 23:03:53.908784] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1bc2400 (9): Bad file descriptor 00:26:02.984 [2024-04-16 23:03:53.908952] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:02.984 [2024-04-16 23:03:53.908975] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:02.984 [2024-04-16 23:03:53.908990] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:02.984 [2024-04-16 23:03:53.911110] bdev_nvme.c:2024:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:02.984 [2024-04-16 23:03:53.920420] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:02.984 [2024-04-16 23:03:53.920882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:02.984 [2024-04-16 23:03:53.921056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:02.984 [2024-04-16 23:03:53.921084] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1bc2400 with addr=10.0.0.2, port=4420 00:26:02.984 [2024-04-16 23:03:53.921101] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1bc2400 is same with the state(5) to be set 00:26:02.984 [2024-04-16 23:03:53.921239] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1bc2400 (9): Bad file descriptor 00:26:02.984 [2024-04-16 23:03:53.921462] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:02.984 [2024-04-16 23:03:53.921485] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:02.984 [2024-04-16 23:03:53.921500] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:02.984 [2024-04-16 23:03:53.923873] bdev_nvme.c:2024:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:02.984 [2024-04-16 23:03:53.932776] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:02.984 [2024-04-16 23:03:53.933124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:02.984 [2024-04-16 23:03:53.933295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:02.984 [2024-04-16 23:03:53.933326] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1bc2400 with addr=10.0.0.2, port=4420 00:26:02.984 [2024-04-16 23:03:53.933343] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1bc2400 is same with the state(5) to be set 00:26:02.984 [2024-04-16 23:03:53.933507] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1bc2400 (9): Bad file descriptor 00:26:02.984 [2024-04-16 23:03:53.933675] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:02.984 [2024-04-16 23:03:53.933699] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:02.984 [2024-04-16 23:03:53.933714] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:02.984 [2024-04-16 23:03:53.936086] bdev_nvme.c:2024:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:02.984 [2024-04-16 23:03:53.945312] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:02.984 [2024-04-16 23:03:53.945727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:02.984 [2024-04-16 23:03:53.945922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:02.984 [2024-04-16 23:03:53.945965] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1bc2400 with addr=10.0.0.2, port=4420 00:26:02.984 [2024-04-16 23:03:53.945983] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1bc2400 is same with the state(5) to be set 00:26:02.984 [2024-04-16 23:03:53.946148] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1bc2400 (9): Bad file descriptor 00:26:02.984 [2024-04-16 23:03:53.946344] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:02.984 [2024-04-16 23:03:53.946368] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:02.984 [2024-04-16 23:03:53.946384] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:02.984 [2024-04-16 23:03:53.948684] bdev_nvme.c:2024:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:02.984 [2024-04-16 23:03:53.957975] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:02.984 [2024-04-16 23:03:53.958303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:02.984 [2024-04-16 23:03:53.958426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:02.984 [2024-04-16 23:03:53.958450] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1bc2400 with addr=10.0.0.2, port=4420 00:26:02.984 [2024-04-16 23:03:53.958466] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1bc2400 is same with the state(5) to be set 00:26:02.984 [2024-04-16 23:03:53.958623] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1bc2400 (9): Bad file descriptor 00:26:02.984 [2024-04-16 23:03:53.958828] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:02.984 [2024-04-16 23:03:53.958852] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:02.984 [2024-04-16 23:03:53.958868] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:02.984 [2024-04-16 23:03:53.961226] bdev_nvme.c:2024:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:02.984 [2024-04-16 23:03:53.970587] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:02.984 [2024-04-16 23:03:53.970930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:02.984 [2024-04-16 23:03:53.971087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:02.984 [2024-04-16 23:03:53.971115] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1bc2400 with addr=10.0.0.2, port=4420 00:26:02.984 [2024-04-16 23:03:53.971138] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1bc2400 is same with the state(5) to be set 00:26:02.984 [2024-04-16 23:03:53.971304] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1bc2400 (9): Bad file descriptor 00:26:02.984 [2024-04-16 23:03:53.971440] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:02.984 [2024-04-16 23:03:53.971476] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:02.984 [2024-04-16 23:03:53.971490] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:02.984 [2024-04-16 23:03:53.973892] bdev_nvme.c:2024:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:02.984 [2024-04-16 23:03:53.983147] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:02.984 [2024-04-16 23:03:53.983458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:02.984 [2024-04-16 23:03:53.983597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:02.984 [2024-04-16 23:03:53.983621] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1bc2400 with addr=10.0.0.2, port=4420 00:26:02.984 [2024-04-16 23:03:53.983637] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1bc2400 is same with the state(5) to be set 00:26:02.984 [2024-04-16 23:03:53.983769] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1bc2400 (9): Bad file descriptor 00:26:02.984 [2024-04-16 23:03:53.983916] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:02.984 [2024-04-16 23:03:53.983940] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:02.984 [2024-04-16 23:03:53.983955] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:02.984 [2024-04-16 23:03:53.986277] bdev_nvme.c:2024:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:02.984 [2024-04-16 23:03:53.995689] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:02.984 [2024-04-16 23:03:53.996050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:02.984 [2024-04-16 23:03:53.996235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:02.984 [2024-04-16 23:03:53.996262] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1bc2400 with addr=10.0.0.2, port=4420 00:26:02.984 [2024-04-16 23:03:53.996278] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1bc2400 is same with the state(5) to be set 00:26:02.984 [2024-04-16 23:03:53.996411] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1bc2400 (9): Bad file descriptor 00:26:02.984 [2024-04-16 23:03:53.996590] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:02.984 [2024-04-16 23:03:53.996614] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:02.984 [2024-04-16 23:03:53.996629] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:02.984 [2024-04-16 23:03:53.998918] bdev_nvme.c:2024:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:02.984 [2024-04-16 23:03:54.007930] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:02.984 [2024-04-16 23:03:54.008273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:02.984 [2024-04-16 23:03:54.008443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:02.984 [2024-04-16 23:03:54.008469] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1bc2400 with addr=10.0.0.2, port=4420 00:26:02.984 [2024-04-16 23:03:54.008484] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1bc2400 is same with the state(5) to be set 00:26:02.984 [2024-04-16 23:03:54.008621] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1bc2400 (9): Bad file descriptor 00:26:02.984 [2024-04-16 23:03:54.008841] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:02.984 [2024-04-16 23:03:54.008861] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:02.984 [2024-04-16 23:03:54.008873] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:02.984 [2024-04-16 23:03:54.010859] bdev_nvme.c:2024:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:02.984 [2024-04-16 23:03:54.020488] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:02.984 [2024-04-16 23:03:54.020843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:02.984 [2024-04-16 23:03:54.021011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:02.984 [2024-04-16 23:03:54.021037] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1bc2400 with addr=10.0.0.2, port=4420 00:26:02.984 [2024-04-16 23:03:54.021052] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1bc2400 is same with the state(5) to be set 00:26:02.984 [2024-04-16 23:03:54.021272] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1bc2400 (9): Bad file descriptor 00:26:02.984 [2024-04-16 23:03:54.021441] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:02.985 [2024-04-16 23:03:54.021464] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:02.985 [2024-04-16 23:03:54.021479] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:02.985 [2024-04-16 23:03:54.023890] bdev_nvme.c:2024:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:02.985 [2024-04-16 23:03:54.033002] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:02.985 [2024-04-16 23:03:54.033341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:02.985 [2024-04-16 23:03:54.033521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:02.985 [2024-04-16 23:03:54.033546] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1bc2400 with addr=10.0.0.2, port=4420 00:26:02.985 [2024-04-16 23:03:54.033561] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1bc2400 is same with the state(5) to be set 00:26:02.985 [2024-04-16 23:03:54.033742] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1bc2400 (9): Bad file descriptor 00:26:02.985 [2024-04-16 23:03:54.033893] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:02.985 [2024-04-16 23:03:54.033916] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:02.985 [2024-04-16 23:03:54.033931] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:02.985 [2024-04-16 23:03:54.036302] bdev_nvme.c:2024:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:02.985 [2024-04-16 23:03:54.045641] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:02.985 [2024-04-16 23:03:54.045983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:02.985 [2024-04-16 23:03:54.046168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:02.985 [2024-04-16 23:03:54.046200] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1bc2400 with addr=10.0.0.2, port=4420 00:26:02.985 [2024-04-16 23:03:54.046233] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1bc2400 is same with the state(5) to be set 00:26:02.985 [2024-04-16 23:03:54.046434] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1bc2400 (9): Bad file descriptor 00:26:02.985 [2024-04-16 23:03:54.046607] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:02.985 [2024-04-16 23:03:54.046631] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:02.985 [2024-04-16 23:03:54.046646] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:02.985 [2024-04-16 23:03:54.049144] bdev_nvme.c:2024:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:02.985 [2024-04-16 23:03:54.057901] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:02.985 [2024-04-16 23:03:54.058308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:02.985 [2024-04-16 23:03:54.058480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:02.985 [2024-04-16 23:03:54.058521] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1bc2400 with addr=10.0.0.2, port=4420 00:26:02.985 [2024-04-16 23:03:54.058537] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1bc2400 is same with the state(5) to be set 00:26:02.985 [2024-04-16 23:03:54.058708] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1bc2400 (9): Bad file descriptor 00:26:02.985 [2024-04-16 23:03:54.058907] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:02.985 [2024-04-16 23:03:54.058931] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:02.985 [2024-04-16 23:03:54.058948] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:02.985 [2024-04-16 23:03:54.061201] bdev_nvme.c:2024:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:02.985 [2024-04-16 23:03:54.070536] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:02.985 [2024-04-16 23:03:54.070909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:02.985 [2024-04-16 23:03:54.071097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:02.985 [2024-04-16 23:03:54.071141] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1bc2400 with addr=10.0.0.2, port=4420 00:26:02.985 [2024-04-16 23:03:54.071158] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1bc2400 is same with the state(5) to be set 00:26:02.985 [2024-04-16 23:03:54.071349] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1bc2400 (9): Bad file descriptor 00:26:02.985 [2024-04-16 23:03:54.071571] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:02.985 [2024-04-16 23:03:54.071595] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:02.985 [2024-04-16 23:03:54.071610] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:02.985 [2024-04-16 23:03:54.073998] bdev_nvme.c:2024:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:02.985 [2024-04-16 23:03:54.083092] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:02.985 [2024-04-16 23:03:54.083449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:02.985 [2024-04-16 23:03:54.083656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:02.985 [2024-04-16 23:03:54.083689] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1bc2400 with addr=10.0.0.2, port=4420 00:26:02.985 [2024-04-16 23:03:54.083723] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1bc2400 is same with the state(5) to be set 00:26:02.985 [2024-04-16 23:03:54.083888] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1bc2400 (9): Bad file descriptor 00:26:02.985 [2024-04-16 23:03:54.084074] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:02.985 [2024-04-16 23:03:54.084103] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:02.985 [2024-04-16 23:03:54.084119] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:02.985 [2024-04-16 23:03:54.086356] bdev_nvme.c:2024:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:02.985 [2024-04-16 23:03:54.095545] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:02.985 [2024-04-16 23:03:54.095917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:02.985 [2024-04-16 23:03:54.096072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:02.985 [2024-04-16 23:03:54.096097] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1bc2400 with addr=10.0.0.2, port=4420 00:26:02.985 [2024-04-16 23:03:54.096112] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1bc2400 is same with the state(5) to be set 00:26:02.985 [2024-04-16 23:03:54.096263] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1bc2400 (9): Bad file descriptor 00:26:02.985 [2024-04-16 23:03:54.096468] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:02.985 [2024-04-16 23:03:54.096491] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:02.985 [2024-04-16 23:03:54.096506] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:02.985 [2024-04-16 23:03:54.098712] bdev_nvme.c:2024:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:02.985 [2024-04-16 23:03:54.108145] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:02.985 [2024-04-16 23:03:54.108518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:02.985 [2024-04-16 23:03:54.108690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:02.985 [2024-04-16 23:03:54.108718] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1bc2400 with addr=10.0.0.2, port=4420 00:26:02.985 [2024-04-16 23:03:54.108735] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1bc2400 is same with the state(5) to be set 00:26:02.985 [2024-04-16 23:03:54.108864] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1bc2400 (9): Bad file descriptor 00:26:02.985 [2024-04-16 23:03:54.109032] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:02.985 [2024-04-16 23:03:54.109055] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:02.985 [2024-04-16 23:03:54.109071] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:03.245 [2024-04-16 23:03:54.111412] bdev_nvme.c:2024:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:03.245 [2024-04-16 23:03:54.120701] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:03.245 [2024-04-16 23:03:54.121067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:03.245 [2024-04-16 23:03:54.121231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:03.245 [2024-04-16 23:03:54.121260] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1bc2400 with addr=10.0.0.2, port=4420 00:26:03.245 [2024-04-16 23:03:54.121278] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1bc2400 is same with the state(5) to be set 00:26:03.245 [2024-04-16 23:03:54.121408] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1bc2400 (9): Bad file descriptor 00:26:03.245 [2024-04-16 23:03:54.121577] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:03.245 [2024-04-16 23:03:54.121600] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:03.245 [2024-04-16 23:03:54.121621] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:03.245 [2024-04-16 23:03:54.123716] bdev_nvme.c:2024:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:03.245 [2024-04-16 23:03:54.133290] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:03.245 [2024-04-16 23:03:54.133613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:03.245 [2024-04-16 23:03:54.133770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:03.245 [2024-04-16 23:03:54.133798] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1bc2400 with addr=10.0.0.2, port=4420 00:26:03.245 [2024-04-16 23:03:54.133816] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1bc2400 is same with the state(5) to be set 00:26:03.245 [2024-04-16 23:03:54.133999] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1bc2400 (9): Bad file descriptor 00:26:03.245 [2024-04-16 23:03:54.134150] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:03.245 [2024-04-16 23:03:54.134173] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:03.245 [2024-04-16 23:03:54.134200] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:03.245 [2024-04-16 23:03:54.136522] bdev_nvme.c:2024:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:03.245 [2024-04-16 23:03:54.145787] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:03.245 [2024-04-16 23:03:54.146115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:03.245 [2024-04-16 23:03:54.146327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:03.245 [2024-04-16 23:03:54.146354] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1bc2400 with addr=10.0.0.2, port=4420 00:26:03.245 [2024-04-16 23:03:54.146370] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1bc2400 is same with the state(5) to be set 00:26:03.245 [2024-04-16 23:03:54.146578] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1bc2400 (9): Bad file descriptor 00:26:03.245 [2024-04-16 23:03:54.146710] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:03.245 [2024-04-16 23:03:54.146733] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:03.245 [2024-04-16 23:03:54.146749] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:03.245 [2024-04-16 23:03:54.148994] bdev_nvme.c:2024:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:03.245 [2024-04-16 23:03:54.158320] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:03.245 [2024-04-16 23:03:54.158672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:03.245 [2024-04-16 23:03:54.158832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:03.245 [2024-04-16 23:03:54.158860] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1bc2400 with addr=10.0.0.2, port=4420 00:26:03.245 [2024-04-16 23:03:54.158877] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1bc2400 is same with the state(5) to be set 00:26:03.245 [2024-04-16 23:03:54.159077] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1bc2400 (9): Bad file descriptor 00:26:03.245 [2024-04-16 23:03:54.159248] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:03.245 [2024-04-16 23:03:54.159270] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:03.245 [2024-04-16 23:03:54.159283] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:03.245 [2024-04-16 23:03:54.161523] bdev_nvme.c:2024:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:03.245 [2024-04-16 23:03:54.170911] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:03.245 [2024-04-16 23:03:54.171204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:03.245 [2024-04-16 23:03:54.171391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:03.245 [2024-04-16 23:03:54.171416] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1bc2400 with addr=10.0.0.2, port=4420 00:26:03.245 [2024-04-16 23:03:54.171432] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1bc2400 is same with the state(5) to be set 00:26:03.245 [2024-04-16 23:03:54.171623] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1bc2400 (9): Bad file descriptor 00:26:03.245 [2024-04-16 23:03:54.171756] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:03.245 [2024-04-16 23:03:54.171780] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:03.245 [2024-04-16 23:03:54.171795] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:03.245 [2024-04-16 23:03:54.174029] bdev_nvme.c:2024:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:03.245 [2024-04-16 23:03:54.183377] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:03.245 [2024-04-16 23:03:54.183745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:03.245 [2024-04-16 23:03:54.183907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:03.245 [2024-04-16 23:03:54.183935] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1bc2400 with addr=10.0.0.2, port=4420 00:26:03.245 [2024-04-16 23:03:54.183952] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1bc2400 is same with the state(5) to be set 00:26:03.245 [2024-04-16 23:03:54.184117] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1bc2400 (9): Bad file descriptor 00:26:03.245 [2024-04-16 23:03:54.184313] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:03.245 [2024-04-16 23:03:54.184334] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:03.245 [2024-04-16 23:03:54.184347] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:03.245 [2024-04-16 23:03:54.186720] bdev_nvme.c:2024:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:03.245 [2024-04-16 23:03:54.195786] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:03.245 [2024-04-16 23:03:54.196183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:03.245 [2024-04-16 23:03:54.196311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:03.245 [2024-04-16 23:03:54.196339] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1bc2400 with addr=10.0.0.2, port=4420 00:26:03.245 [2024-04-16 23:03:54.196357] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1bc2400 is same with the state(5) to be set 00:26:03.245 [2024-04-16 23:03:54.196522] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1bc2400 (9): Bad file descriptor 00:26:03.245 [2024-04-16 23:03:54.196672] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:03.245 [2024-04-16 23:03:54.196695] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:03.245 [2024-04-16 23:03:54.196710] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:03.245 [2024-04-16 23:03:54.199144] bdev_nvme.c:2024:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:03.245 [2024-04-16 23:03:54.208082] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:03.245 [2024-04-16 23:03:54.208391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:03.245 [2024-04-16 23:03:54.208598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:03.245 [2024-04-16 23:03:54.208648] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1bc2400 with addr=10.0.0.2, port=4420 00:26:03.245 [2024-04-16 23:03:54.208684] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1bc2400 is same with the state(5) to be set 00:26:03.245 [2024-04-16 23:03:54.208832] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1bc2400 (9): Bad file descriptor 00:26:03.246 [2024-04-16 23:03:54.209037] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:03.246 [2024-04-16 23:03:54.209060] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:03.246 [2024-04-16 23:03:54.209075] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:03.246 [2024-04-16 23:03:54.211566] bdev_nvme.c:2024:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:03.246 [2024-04-16 23:03:54.220657] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:03.246 [2024-04-16 23:03:54.220961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:03.246 [2024-04-16 23:03:54.221103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:03.246 [2024-04-16 23:03:54.221132] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1bc2400 with addr=10.0.0.2, port=4420 00:26:03.246 [2024-04-16 23:03:54.221149] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1bc2400 is same with the state(5) to be set 00:26:03.246 [2024-04-16 23:03:54.221310] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1bc2400 (9): Bad file descriptor 00:26:03.246 [2024-04-16 23:03:54.221447] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:03.246 [2024-04-16 23:03:54.221487] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:03.246 [2024-04-16 23:03:54.221502] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:03.246 [2024-04-16 23:03:54.223798] bdev_nvme.c:2024:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:03.246 [2024-04-16 23:03:54.233196] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:03.246 [2024-04-16 23:03:54.233480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:03.246 [2024-04-16 23:03:54.233621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:03.246 [2024-04-16 23:03:54.233646] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1bc2400 with addr=10.0.0.2, port=4420 00:26:03.246 [2024-04-16 23:03:54.233661] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1bc2400 is same with the state(5) to be set 00:26:03.246 [2024-04-16 23:03:54.233809] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1bc2400 (9): Bad file descriptor 00:26:03.246 [2024-04-16 23:03:54.233961] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:03.246 [2024-04-16 23:03:54.233982] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:03.246 [2024-04-16 23:03:54.233996] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:03.246 [2024-04-16 23:03:54.236063] bdev_nvme.c:2024:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:03.246 [2024-04-16 23:03:54.245540] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:03.246 [2024-04-16 23:03:54.245880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:03.246 [2024-04-16 23:03:54.246037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:03.246 [2024-04-16 23:03:54.246063] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1bc2400 with addr=10.0.0.2, port=4420 00:26:03.246 [2024-04-16 23:03:54.246079] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1bc2400 is same with the state(5) to be set 00:26:03.246 [2024-04-16 23:03:54.246237] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1bc2400 (9): Bad file descriptor 00:26:03.246 [2024-04-16 23:03:54.246405] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:03.246 [2024-04-16 23:03:54.246426] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:03.246 [2024-04-16 23:03:54.246440] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:03.246 [2024-04-16 23:03:54.248398] bdev_nvme.c:2024:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:03.246 [2024-04-16 23:03:54.258192] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:03.246 [2024-04-16 23:03:54.258481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:03.246 [2024-04-16 23:03:54.258638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:03.246 [2024-04-16 23:03:54.258667] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1bc2400 with addr=10.0.0.2, port=4420 00:26:03.246 [2024-04-16 23:03:54.258684] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1bc2400 is same with the state(5) to be set 00:26:03.246 [2024-04-16 23:03:54.258866] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1bc2400 (9): Bad file descriptor 00:26:03.246 [2024-04-16 23:03:54.259003] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:03.246 [2024-04-16 23:03:54.259024] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:03.246 [2024-04-16 23:03:54.259037] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:03.246 [2024-04-16 23:03:54.261278] bdev_nvme.c:2024:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:03.246 [2024-04-16 23:03:54.270830] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:03.246 [2024-04-16 23:03:54.271161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:03.246 [2024-04-16 23:03:54.271289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:03.246 [2024-04-16 23:03:54.271316] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1bc2400 with addr=10.0.0.2, port=4420 00:26:03.246 [2024-04-16 23:03:54.271332] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1bc2400 is same with the state(5) to be set 00:26:03.246 [2024-04-16 23:03:54.271485] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1bc2400 (9): Bad file descriptor 00:26:03.246 [2024-04-16 23:03:54.271643] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:03.246 [2024-04-16 23:03:54.271665] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:03.246 [2024-04-16 23:03:54.271679] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:03.246 [2024-04-16 23:03:54.274084] bdev_nvme.c:2024:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:03.246 [2024-04-16 23:03:54.283518] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:03.246 [2024-04-16 23:03:54.283883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:03.246 [2024-04-16 23:03:54.284126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:03.246 [2024-04-16 23:03:54.284159] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1bc2400 with addr=10.0.0.2, port=4420 00:26:03.246 [2024-04-16 23:03:54.284185] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1bc2400 is same with the state(5) to be set 00:26:03.246 [2024-04-16 23:03:54.284352] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1bc2400 (9): Bad file descriptor 00:26:03.246 [2024-04-16 23:03:54.284521] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:03.246 [2024-04-16 23:03:54.284544] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:03.246 [2024-04-16 23:03:54.284559] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:03.246 [2024-04-16 23:03:54.286876] bdev_nvme.c:2024:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:03.246 [2024-04-16 23:03:54.296086] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:03.246 [2024-04-16 23:03:54.296385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:03.246 [2024-04-16 23:03:54.296620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:03.246 [2024-04-16 23:03:54.296649] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1bc2400 with addr=10.0.0.2, port=4420 00:26:03.246 [2024-04-16 23:03:54.296666] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1bc2400 is same with the state(5) to be set 00:26:03.246 [2024-04-16 23:03:54.296832] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1bc2400 (9): Bad file descriptor 00:26:03.246 [2024-04-16 23:03:54.296982] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:03.246 [2024-04-16 23:03:54.297005] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:03.246 [2024-04-16 23:03:54.297020] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:03.246 [2024-04-16 23:03:54.299309] bdev_nvme.c:2024:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:03.246 [2024-04-16 23:03:54.308518] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:03.246 [2024-04-16 23:03:54.308899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:03.246 [2024-04-16 23:03:54.309085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:03.246 [2024-04-16 23:03:54.309114] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1bc2400 with addr=10.0.0.2, port=4420 00:26:03.246 [2024-04-16 23:03:54.309131] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1bc2400 is same with the state(5) to be set 00:26:03.246 [2024-04-16 23:03:54.309289] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1bc2400 (9): Bad file descriptor 00:26:03.246 [2024-04-16 23:03:54.309459] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:03.246 [2024-04-16 23:03:54.309482] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:03.246 [2024-04-16 23:03:54.309497] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:03.246 [2024-04-16 23:03:54.311688] bdev_nvme.c:2024:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:03.246 [2024-04-16 23:03:54.321138] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:03.246 [2024-04-16 23:03:54.321498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:03.246 [2024-04-16 23:03:54.321665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:03.246 [2024-04-16 23:03:54.321691] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1bc2400 with addr=10.0.0.2, port=4420 00:26:03.246 [2024-04-16 23:03:54.321711] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1bc2400 is same with the state(5) to be set 00:26:03.246 [2024-04-16 23:03:54.321888] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1bc2400 (9): Bad file descriptor 00:26:03.246 [2024-04-16 23:03:54.322093] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:03.246 [2024-04-16 23:03:54.322116] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:03.246 [2024-04-16 23:03:54.322131] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:03.246 [2024-04-16 23:03:54.324566] bdev_nvme.c:2024:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:03.246 [2024-04-16 23:03:54.333731] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:03.246 [2024-04-16 23:03:54.334118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:03.246 [2024-04-16 23:03:54.334312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:03.246 [2024-04-16 23:03:54.334341] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1bc2400 with addr=10.0.0.2, port=4420 00:26:03.246 [2024-04-16 23:03:54.334359] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1bc2400 is same with the state(5) to be set 00:26:03.246 [2024-04-16 23:03:54.334506] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1bc2400 (9): Bad file descriptor 00:26:03.246 [2024-04-16 23:03:54.334656] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:03.246 [2024-04-16 23:03:54.334679] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:03.247 [2024-04-16 23:03:54.334694] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:03.247 [2024-04-16 23:03:54.337161] bdev_nvme.c:2024:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:03.247 [2024-04-16 23:03:54.346392] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:03.247 [2024-04-16 23:03:54.346793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:03.247 [2024-04-16 23:03:54.346967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:03.247 [2024-04-16 23:03:54.347011] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1bc2400 with addr=10.0.0.2, port=4420 00:26:03.247 [2024-04-16 23:03:54.347029] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1bc2400 is same with the state(5) to be set 00:26:03.247 [2024-04-16 23:03:54.347205] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1bc2400 (9): Bad file descriptor 00:26:03.247 [2024-04-16 23:03:54.347356] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:03.247 [2024-04-16 23:03:54.347379] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:03.247 [2024-04-16 23:03:54.347394] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:03.247 [2024-04-16 23:03:54.349765] bdev_nvme.c:2024:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:03.247 [2024-04-16 23:03:54.359038] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:03.247 [2024-04-16 23:03:54.359403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:03.247 [2024-04-16 23:03:54.359586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:03.247 [2024-04-16 23:03:54.359614] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1bc2400 with addr=10.0.0.2, port=4420 00:26:03.247 [2024-04-16 23:03:54.359632] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1bc2400 is same with the state(5) to be set 00:26:03.247 [2024-04-16 23:03:54.359765] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1bc2400 (9): Bad file descriptor 00:26:03.247 [2024-04-16 23:03:54.359916] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:03.247 [2024-04-16 23:03:54.359939] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:03.247 [2024-04-16 23:03:54.359954] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:03.247 [2024-04-16 23:03:54.362425] bdev_nvme.c:2024:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:03.507 [2024-04-16 23:03:54.371811] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:03.507 [2024-04-16 23:03:54.372147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:03.507 [2024-04-16 23:03:54.372319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:03.508 [2024-04-16 23:03:54.372349] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1bc2400 with addr=10.0.0.2, port=4420 00:26:03.508 [2024-04-16 23:03:54.372368] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1bc2400 is same with the state(5) to be set 00:26:03.508 [2024-04-16 23:03:54.372547] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1bc2400 (9): Bad file descriptor 00:26:03.508 [2024-04-16 23:03:54.372735] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:03.508 [2024-04-16 23:03:54.372759] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:03.508 [2024-04-16 23:03:54.372774] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:03.508 [2024-04-16 23:03:54.375151] bdev_nvme.c:2024:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:03.508 [2024-04-16 23:03:54.384362] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:03.508 [2024-04-16 23:03:54.384786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:03.508 [2024-04-16 23:03:54.384986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:03.508 [2024-04-16 23:03:54.385014] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1bc2400 with addr=10.0.0.2, port=4420 00:26:03.508 [2024-04-16 23:03:54.385032] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1bc2400 is same with the state(5) to be set 00:26:03.508 [2024-04-16 23:03:54.385187] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1bc2400 (9): Bad file descriptor 00:26:03.508 [2024-04-16 23:03:54.385374] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:03.508 [2024-04-16 23:03:54.385398] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:03.508 [2024-04-16 23:03:54.385413] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:03.508 [2024-04-16 23:03:54.387768] bdev_nvme.c:2024:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:03.508 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/bdevperf.sh: line 35: 387540 Killed "${NVMF_APP[@]}" "$@" 00:26:03.508 23:03:54 -- host/bdevperf.sh@36 -- # tgt_init 00:26:03.508 23:03:54 -- host/bdevperf.sh@15 -- # nvmfappstart -m 0xE 00:26:03.508 23:03:54 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:26:03.508 23:03:54 -- common/autotest_common.sh@712 -- # xtrace_disable 00:26:03.508 23:03:54 -- common/autotest_common.sh@10 -- # set +x 00:26:03.508 [2024-04-16 23:03:54.396893] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:03.508 23:03:54 -- nvmf/common.sh@469 -- # nvmfpid=388660 00:26:03.508 23:03:54 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xE 00:26:03.508 [2024-04-16 23:03:54.397231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:03.508 23:03:54 -- nvmf/common.sh@470 -- # waitforlisten 388660 00:26:03.508 [2024-04-16 23:03:54.397364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:03.508 [2024-04-16 23:03:54.397404] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1bc2400 with addr=10.0.0.2, port=4420 00:26:03.508 [2024-04-16 23:03:54.397421] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1bc2400 is same with the state(5) to be set 00:26:03.508 23:03:54 -- common/autotest_common.sh@819 -- # '[' -z 388660 ']' 00:26:03.508 [2024-04-16 23:03:54.397587] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1bc2400 (9): Bad file descriptor 00:26:03.508 23:03:54 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk.sock 00:26:03.508 [2024-04-16 23:03:54.397737] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:03.508 23:03:54 -- common/autotest_common.sh@824 -- # local max_retries=100 00:26:03.508 [2024-04-16 23:03:54.397761] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:03.508 [2024-04-16 23:03:54.397778] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:03.508 23:03:54 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:26:03.508 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:26:03.508 23:03:54 -- common/autotest_common.sh@828 -- # xtrace_disable 00:26:03.508 23:03:54 -- common/autotest_common.sh@10 -- # set +x 00:26:03.508 [2024-04-16 23:03:54.400028] bdev_nvme.c:2024:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:03.508 [2024-04-16 23:03:54.409506] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:03.508 [2024-04-16 23:03:54.409769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:03.508 [2024-04-16 23:03:54.409908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:03.508 [2024-04-16 23:03:54.409936] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1bc2400 with addr=10.0.0.2, port=4420 00:26:03.508 [2024-04-16 23:03:54.409953] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1bc2400 is same with the state(5) to be set 00:26:03.508 [2024-04-16 23:03:54.410101] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1bc2400 (9): Bad file descriptor 00:26:03.508 [2024-04-16 23:03:54.410279] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:03.508 [2024-04-16 23:03:54.410303] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:03.508 [2024-04-16 23:03:54.410318] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:03.508 [2024-04-16 23:03:54.412777] bdev_nvme.c:2024:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:03.508 [2024-04-16 23:03:54.421734] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:03.508 [2024-04-16 23:03:54.422075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:03.508 [2024-04-16 23:03:54.422225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:03.508 [2024-04-16 23:03:54.422252] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1bc2400 with addr=10.0.0.2, port=4420 00:26:03.508 [2024-04-16 23:03:54.422268] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1bc2400 is same with the state(5) to be set 00:26:03.508 [2024-04-16 23:03:54.422400] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1bc2400 (9): Bad file descriptor 00:26:03.508 [2024-04-16 23:03:54.422552] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:03.508 [2024-04-16 23:03:54.422573] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:03.508 [2024-04-16 23:03:54.422592] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:03.508 [2024-04-16 23:03:54.424651] bdev_nvme.c:2024:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:03.508 [2024-04-16 23:03:54.433887] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:03.508 [2024-04-16 23:03:54.434201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:03.508 [2024-04-16 23:03:54.434354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:03.508 [2024-04-16 23:03:54.434380] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1bc2400 with addr=10.0.0.2, port=4420 00:26:03.508 [2024-04-16 23:03:54.434396] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1bc2400 is same with the state(5) to be set 00:26:03.508 [2024-04-16 23:03:54.434529] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1bc2400 (9): Bad file descriptor 00:26:03.508 [2024-04-16 23:03:54.434689] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:03.508 [2024-04-16 23:03:54.434710] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:03.508 [2024-04-16 23:03:54.434723] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:03.508 [2024-04-16 23:03:54.434768] Starting SPDK v24.01.1-pre git sha1 4b134b4ab / DPDK 23.11.0 initialization... 00:26:03.508 [2024-04-16 23:03:54.434841] [ DPDK EAL parameters: nvmf -c 0xE --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:26:03.508 [2024-04-16 23:03:54.436787] bdev_nvme.c:2024:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:03.508 [2024-04-16 23:03:54.446112] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:03.508 [2024-04-16 23:03:54.446445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:03.508 [2024-04-16 23:03:54.446591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:03.508 [2024-04-16 23:03:54.446618] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1bc2400 with addr=10.0.0.2, port=4420 00:26:03.508 [2024-04-16 23:03:54.446634] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1bc2400 is same with the state(5) to be set 00:26:03.508 [2024-04-16 23:03:54.446782] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1bc2400 (9): Bad file descriptor 00:26:03.508 [2024-04-16 23:03:54.447003] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:03.508 [2024-04-16 23:03:54.447023] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:03.508 [2024-04-16 23:03:54.447036] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:03.508 [2024-04-16 23:03:54.448917] bdev_nvme.c:2024:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:03.508 [2024-04-16 23:03:54.458184] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:03.508 [2024-04-16 23:03:54.458493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:03.508 [2024-04-16 23:03:54.458636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:03.508 [2024-04-16 23:03:54.458661] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1bc2400 with addr=10.0.0.2, port=4420 00:26:03.508 [2024-04-16 23:03:54.458677] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1bc2400 is same with the state(5) to be set 00:26:03.508 [2024-04-16 23:03:54.458777] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1bc2400 (9): Bad file descriptor 00:26:03.509 [2024-04-16 23:03:54.458974] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:03.509 [2024-04-16 23:03:54.458994] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:03.509 [2024-04-16 23:03:54.459007] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:03.509 [2024-04-16 23:03:54.461019] bdev_nvme.c:2024:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:03.509 [2024-04-16 23:03:54.470307] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:03.509 [2024-04-16 23:03:54.470727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:03.509 [2024-04-16 23:03:54.470882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:03.509 [2024-04-16 23:03:54.470907] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1bc2400 with addr=10.0.0.2, port=4420 00:26:03.509 [2024-04-16 23:03:54.470923] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1bc2400 is same with the state(5) to be set 00:26:03.509 [2024-04-16 23:03:54.471087] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1bc2400 (9): Bad file descriptor 00:26:03.509 [2024-04-16 23:03:54.471255] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:03.509 [2024-04-16 23:03:54.471277] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:03.509 [2024-04-16 23:03:54.471291] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:03.509 EAL: No free 2048 kB hugepages reported on node 1 00:26:03.509 [2024-04-16 23:03:54.473521] bdev_nvme.c:2024:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:03.509 [2024-04-16 23:03:54.482571] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:03.509 [2024-04-16 23:03:54.482983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:03.509 [2024-04-16 23:03:54.483168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:03.509 [2024-04-16 23:03:54.483200] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1bc2400 with addr=10.0.0.2, port=4420 00:26:03.509 [2024-04-16 23:03:54.483216] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1bc2400 is same with the state(5) to be set 00:26:03.509 [2024-04-16 23:03:54.483381] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1bc2400 (9): Bad file descriptor 00:26:03.509 [2024-04-16 23:03:54.483528] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:03.509 [2024-04-16 23:03:54.483548] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:03.509 [2024-04-16 23:03:54.483561] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:03.509 [2024-04-16 23:03:54.485689] bdev_nvme.c:2024:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:03.509 [2024-04-16 23:03:54.494894] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:03.509 [2024-04-16 23:03:54.495317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:03.509 [2024-04-16 23:03:54.495458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:03.509 [2024-04-16 23:03:54.495484] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1bc2400 with addr=10.0.0.2, port=4420 00:26:03.509 [2024-04-16 23:03:54.495501] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1bc2400 is same with the state(5) to be set 00:26:03.509 [2024-04-16 23:03:54.495650] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1bc2400 (9): Bad file descriptor 00:26:03.509 [2024-04-16 23:03:54.495871] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:03.509 [2024-04-16 23:03:54.495897] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:03.509 [2024-04-16 23:03:54.495911] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:03.509 [2024-04-16 23:03:54.498271] bdev_nvme.c:2024:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:03.509 [2024-04-16 23:03:54.504897] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 3 00:26:03.509 [2024-04-16 23:03:54.507199] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:03.509 [2024-04-16 23:03:54.507449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:03.509 [2024-04-16 23:03:54.507575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:03.509 [2024-04-16 23:03:54.507600] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1bc2400 with addr=10.0.0.2, port=4420 00:26:03.509 [2024-04-16 23:03:54.507616] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1bc2400 is same with the state(5) to be set 00:26:03.509 [2024-04-16 23:03:54.507781] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1bc2400 (9): Bad file descriptor 00:26:03.509 [2024-04-16 23:03:54.507960] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:03.509 [2024-04-16 23:03:54.507981] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:03.509 [2024-04-16 23:03:54.507994] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:03.509 [2024-04-16 23:03:54.510039] bdev_nvme.c:2024:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:03.509 [2024-04-16 23:03:54.519355] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:03.509 [2024-04-16 23:03:54.519825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:03.509 [2024-04-16 23:03:54.519965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:03.509 [2024-04-16 23:03:54.519991] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1bc2400 with addr=10.0.0.2, port=4420 00:26:03.509 [2024-04-16 23:03:54.520010] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1bc2400 is same with the state(5) to be set 00:26:03.509 [2024-04-16 23:03:54.520191] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1bc2400 (9): Bad file descriptor 00:26:03.509 [2024-04-16 23:03:54.520360] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:03.509 [2024-04-16 23:03:54.520381] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:03.509 [2024-04-16 23:03:54.520396] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:03.509 [2024-04-16 23:03:54.522396] bdev_nvme.c:2024:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:03.509 [2024-04-16 23:03:54.531680] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:03.509 [2024-04-16 23:03:54.531988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:03.509 [2024-04-16 23:03:54.532152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:03.509 [2024-04-16 23:03:54.532185] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1bc2400 with addr=10.0.0.2, port=4420 00:26:03.509 [2024-04-16 23:03:54.532203] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1bc2400 is same with the state(5) to be set 00:26:03.509 [2024-04-16 23:03:54.532385] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1bc2400 (9): Bad file descriptor 00:26:03.509 [2024-04-16 23:03:54.532548] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:03.509 [2024-04-16 23:03:54.532575] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:03.509 [2024-04-16 23:03:54.532589] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:03.509 [2024-04-16 23:03:54.534587] bdev_nvme.c:2024:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:03.509 [2024-04-16 23:03:54.543859] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:03.509 [2024-04-16 23:03:54.544244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:03.509 [2024-04-16 23:03:54.544401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:03.509 [2024-04-16 23:03:54.544427] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1bc2400 with addr=10.0.0.2, port=4420 00:26:03.509 [2024-04-16 23:03:54.544443] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1bc2400 is same with the state(5) to be set 00:26:03.509 [2024-04-16 23:03:54.544591] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1bc2400 (9): Bad file descriptor 00:26:03.509 [2024-04-16 23:03:54.544753] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:03.509 [2024-04-16 23:03:54.544773] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:03.509 [2024-04-16 23:03:54.544786] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:03.509 [2024-04-16 23:03:54.546746] bdev_nvme.c:2024:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:03.509 [2024-04-16 23:03:54.556125] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:03.509 [2024-04-16 23:03:54.556511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:03.509 [2024-04-16 23:03:54.556637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:03.509 [2024-04-16 23:03:54.556663] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1bc2400 with addr=10.0.0.2, port=4420 00:26:03.509 [2024-04-16 23:03:54.556679] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1bc2400 is same with the state(5) to be set 00:26:03.509 [2024-04-16 23:03:54.556844] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1bc2400 (9): Bad file descriptor 00:26:03.509 [2024-04-16 23:03:54.557026] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:03.509 [2024-04-16 23:03:54.557047] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:03.509 [2024-04-16 23:03:54.557060] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:03.509 [2024-04-16 23:03:54.559073] bdev_nvme.c:2024:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:03.509 [2024-04-16 23:03:54.568466] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:03.509 [2024-04-16 23:03:54.568945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:03.509 [2024-04-16 23:03:54.569108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:03.509 [2024-04-16 23:03:54.569134] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1bc2400 with addr=10.0.0.2, port=4420 00:26:03.509 [2024-04-16 23:03:54.569154] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1bc2400 is same with the state(5) to be set 00:26:03.509 [2024-04-16 23:03:54.569334] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1bc2400 (9): Bad file descriptor 00:26:03.509 [2024-04-16 23:03:54.569504] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:03.509 [2024-04-16 23:03:54.569540] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:03.509 [2024-04-16 23:03:54.569563] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:03.510 [2024-04-16 23:03:54.571575] bdev_nvme.c:2024:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:03.510 [2024-04-16 23:03:54.580862] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:03.510 [2024-04-16 23:03:54.581261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:03.510 [2024-04-16 23:03:54.581411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:03.510 [2024-04-16 23:03:54.581437] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1bc2400 with addr=10.0.0.2, port=4420 00:26:03.510 [2024-04-16 23:03:54.581453] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1bc2400 is same with the state(5) to be set 00:26:03.510 [2024-04-16 23:03:54.581570] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1bc2400 (9): Bad file descriptor 00:26:03.510 [2024-04-16 23:03:54.581732] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:03.510 [2024-04-16 23:03:54.581752] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:03.510 [2024-04-16 23:03:54.581765] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:03.510 [2024-04-16 23:03:54.583779] bdev_nvme.c:2024:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:03.510 [2024-04-16 23:03:54.592957] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:03.510 [2024-04-16 23:03:54.593323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:03.510 [2024-04-16 23:03:54.593501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:03.510 [2024-04-16 23:03:54.593527] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1bc2400 with addr=10.0.0.2, port=4420 00:26:03.510 [2024-04-16 23:03:54.593543] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1bc2400 is same with the state(5) to be set 00:26:03.510 [2024-04-16 23:03:54.593692] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1bc2400 (9): Bad file descriptor 00:26:03.510 [2024-04-16 23:03:54.593882] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:03.510 [2024-04-16 23:03:54.593902] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:03.510 [2024-04-16 23:03:54.593915] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:03.510 [2024-04-16 23:03:54.596097] bdev_nvme.c:2024:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:03.510 [2024-04-16 23:03:54.605127] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:03.510 [2024-04-16 23:03:54.605416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:03.510 [2024-04-16 23:03:54.605569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:03.510 [2024-04-16 23:03:54.605594] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1bc2400 with addr=10.0.0.2, port=4420 00:26:03.510 [2024-04-16 23:03:54.605610] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1bc2400 is same with the state(5) to be set 00:26:03.510 [2024-04-16 23:03:54.605760] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1bc2400 (9): Bad file descriptor 00:26:03.510 [2024-04-16 23:03:54.605908] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:03.510 [2024-04-16 23:03:54.605929] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:03.510 [2024-04-16 23:03:54.605942] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:03.510 [2024-04-16 23:03:54.607940] bdev_nvme.c:2024:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:03.510 [2024-04-16 23:03:54.612503] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:26:03.510 [2024-04-16 23:03:54.612639] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:26:03.510 [2024-04-16 23:03:54.612658] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:26:03.510 [2024-04-16 23:03:54.612671] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:26:03.510 [2024-04-16 23:03:54.612725] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:26:03.510 [2024-04-16 23:03:54.612848] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:26:03.510 [2024-04-16 23:03:54.612851] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:26:03.510 [2024-04-16 23:03:54.617527] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:03.510 [2024-04-16 23:03:54.617884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:03.510 [2024-04-16 23:03:54.618102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:03.510 [2024-04-16 23:03:54.618128] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1bc2400 with addr=10.0.0.2, port=4420 00:26:03.510 [2024-04-16 23:03:54.618145] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1bc2400 is same with the state(5) to be set 00:26:03.510 [2024-04-16 23:03:54.618322] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1bc2400 (9): Bad file descriptor 00:26:03.510 [2024-04-16 23:03:54.618477] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:03.510 [2024-04-16 23:03:54.618499] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:03.510 [2024-04-16 23:03:54.618514] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:03.510 [2024-04-16 23:03:54.620641] bdev_nvme.c:2024:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:03.510 [2024-04-16 23:03:54.630050] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:03.510 [2024-04-16 23:03:54.630495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:03.510 [2024-04-16 23:03:54.630658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:03.510 [2024-04-16 23:03:54.630685] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1bc2400 with addr=10.0.0.2, port=4420 00:26:03.510 [2024-04-16 23:03:54.630704] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1bc2400 is same with the state(5) to be set 00:26:03.510 [2024-04-16 23:03:54.630884] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1bc2400 (9): Bad file descriptor 00:26:03.510 [2024-04-16 23:03:54.631039] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:03.510 [2024-04-16 23:03:54.631064] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:03.510 [2024-04-16 23:03:54.631080] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:03.510 [2024-04-16 23:03:54.633203] bdev_nvme.c:2024:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:03.771 [2024-04-16 23:03:54.642453] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:03.771 [2024-04-16 23:03:54.642891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:03.771 [2024-04-16 23:03:54.643022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:03.771 [2024-04-16 23:03:54.643048] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1bc2400 with addr=10.0.0.2, port=4420 00:26:03.771 [2024-04-16 23:03:54.643066] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1bc2400 is same with the state(5) to be set 00:26:03.771 [2024-04-16 23:03:54.643295] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1bc2400 (9): Bad file descriptor 00:26:03.771 [2024-04-16 23:03:54.643503] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:03.771 [2024-04-16 23:03:54.643525] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:03.771 [2024-04-16 23:03:54.643541] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:03.771 [2024-04-16 23:03:54.645730] bdev_nvme.c:2024:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:03.771 [2024-04-16 23:03:54.654838] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:03.771 [2024-04-16 23:03:54.655290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:03.771 [2024-04-16 23:03:54.655449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:03.771 [2024-04-16 23:03:54.655482] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1bc2400 with addr=10.0.0.2, port=4420 00:26:03.771 [2024-04-16 23:03:54.655500] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1bc2400 is same with the state(5) to be set 00:26:03.771 [2024-04-16 23:03:54.655626] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1bc2400 (9): Bad file descriptor 00:26:03.771 [2024-04-16 23:03:54.655780] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:03.771 [2024-04-16 23:03:54.655802] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:03.771 [2024-04-16 23:03:54.655817] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:03.771 [2024-04-16 23:03:54.657842] bdev_nvme.c:2024:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:03.771 [2024-04-16 23:03:54.667381] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:03.771 [2024-04-16 23:03:54.667791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:03.771 [2024-04-16 23:03:54.667965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:03.771 [2024-04-16 23:03:54.667991] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1bc2400 with addr=10.0.0.2, port=4420 00:26:03.771 [2024-04-16 23:03:54.668010] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1bc2400 is same with the state(5) to be set 00:26:03.771 [2024-04-16 23:03:54.668165] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1bc2400 (9): Bad file descriptor 00:26:03.771 [2024-04-16 23:03:54.668281] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:03.771 [2024-04-16 23:03:54.668303] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:03.771 [2024-04-16 23:03:54.668319] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:03.771 [2024-04-16 23:03:54.670375] bdev_nvme.c:2024:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:03.771 [2024-04-16 23:03:54.679641] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:03.771 [2024-04-16 23:03:54.680143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:03.771 [2024-04-16 23:03:54.680307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:03.771 [2024-04-16 23:03:54.680335] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1bc2400 with addr=10.0.0.2, port=4420 00:26:03.771 [2024-04-16 23:03:54.680354] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1bc2400 is same with the state(5) to be set 00:26:03.771 [2024-04-16 23:03:54.680528] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1bc2400 (9): Bad file descriptor 00:26:03.771 [2024-04-16 23:03:54.680625] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:03.771 [2024-04-16 23:03:54.680646] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:03.771 [2024-04-16 23:03:54.680661] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:03.771 [2024-04-16 23:03:54.682980] bdev_nvme.c:2024:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:03.771 [2024-04-16 23:03:54.692022] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:03.771 [2024-04-16 23:03:54.692403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:03.771 [2024-04-16 23:03:54.692534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:03.771 [2024-04-16 23:03:54.692560] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1bc2400 with addr=10.0.0.2, port=4420 00:26:03.771 [2024-04-16 23:03:54.692578] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1bc2400 is same with the state(5) to be set 00:26:03.771 [2024-04-16 23:03:54.692703] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1bc2400 (9): Bad file descriptor 00:26:03.771 [2024-04-16 23:03:54.692919] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:03.771 [2024-04-16 23:03:54.692941] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:03.771 [2024-04-16 23:03:54.692957] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:03.771 [2024-04-16 23:03:54.695110] bdev_nvme.c:2024:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:03.771 [2024-04-16 23:03:54.704519] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:03.771 [2024-04-16 23:03:54.704883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:03.771 [2024-04-16 23:03:54.705002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:03.771 [2024-04-16 23:03:54.705026] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1bc2400 with addr=10.0.0.2, port=4420 00:26:03.771 [2024-04-16 23:03:54.705042] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1bc2400 is same with the state(5) to be set 00:26:03.771 [2024-04-16 23:03:54.705204] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1bc2400 (9): Bad file descriptor 00:26:03.771 [2024-04-16 23:03:54.705366] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:03.771 [2024-04-16 23:03:54.705388] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:03.771 [2024-04-16 23:03:54.705402] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:03.771 [2024-04-16 23:03:54.707516] bdev_nvme.c:2024:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:03.772 [2024-04-16 23:03:54.716714] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:03.772 [2024-04-16 23:03:54.717072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:03.772 [2024-04-16 23:03:54.717236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:03.772 [2024-04-16 23:03:54.717264] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1bc2400 with addr=10.0.0.2, port=4420 00:26:03.772 [2024-04-16 23:03:54.717281] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1bc2400 is same with the state(5) to be set 00:26:03.772 [2024-04-16 23:03:54.717414] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1bc2400 (9): Bad file descriptor 00:26:03.772 [2024-04-16 23:03:54.717579] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:03.772 [2024-04-16 23:03:54.717608] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:03.772 [2024-04-16 23:03:54.717623] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:03.772 [2024-04-16 23:03:54.719637] bdev_nvme.c:2024:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:03.772 [2024-04-16 23:03:54.728849] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:03.772 [2024-04-16 23:03:54.729210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:03.772 [2024-04-16 23:03:54.729358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:03.772 [2024-04-16 23:03:54.729383] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1bc2400 with addr=10.0.0.2, port=4420 00:26:03.772 [2024-04-16 23:03:54.729399] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1bc2400 is same with the state(5) to be set 00:26:03.772 [2024-04-16 23:03:54.729548] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1bc2400 (9): Bad file descriptor 00:26:03.772 [2024-04-16 23:03:54.729729] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:03.772 [2024-04-16 23:03:54.729750] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:03.772 [2024-04-16 23:03:54.729763] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:03.772 [2024-04-16 23:03:54.731890] bdev_nvme.c:2024:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:03.772 [2024-04-16 23:03:54.741073] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:03.772 [2024-04-16 23:03:54.741386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:03.772 [2024-04-16 23:03:54.741560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:03.772 [2024-04-16 23:03:54.741586] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1bc2400 with addr=10.0.0.2, port=4420 00:26:03.772 [2024-04-16 23:03:54.741601] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1bc2400 is same with the state(5) to be set 00:26:03.772 [2024-04-16 23:03:54.741734] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1bc2400 (9): Bad file descriptor 00:26:03.772 [2024-04-16 23:03:54.741918] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:03.772 [2024-04-16 23:03:54.741939] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:03.772 [2024-04-16 23:03:54.741953] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:03.772 [2024-04-16 23:03:54.744080] bdev_nvme.c:2024:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:03.772 [2024-04-16 23:03:54.753343] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:03.772 [2024-04-16 23:03:54.753649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:03.772 [2024-04-16 23:03:54.753798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:03.772 [2024-04-16 23:03:54.753823] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1bc2400 with addr=10.0.0.2, port=4420 00:26:03.772 [2024-04-16 23:03:54.753839] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1bc2400 is same with the state(5) to be set 00:26:03.772 [2024-04-16 23:03:54.754019] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1bc2400 (9): Bad file descriptor 00:26:03.772 [2024-04-16 23:03:54.754239] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:03.772 [2024-04-16 23:03:54.754262] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:03.772 [2024-04-16 23:03:54.754284] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:03.772 [2024-04-16 23:03:54.756382] bdev_nvme.c:2024:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:03.772 [2024-04-16 23:03:54.765879] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:03.772 [2024-04-16 23:03:54.766189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:03.772 [2024-04-16 23:03:54.766304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:03.772 [2024-04-16 23:03:54.766330] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1bc2400 with addr=10.0.0.2, port=4420 00:26:03.772 [2024-04-16 23:03:54.766346] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1bc2400 is same with the state(5) to be set 00:26:03.772 [2024-04-16 23:03:54.766478] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1bc2400 (9): Bad file descriptor 00:26:03.772 [2024-04-16 23:03:54.766649] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:03.772 [2024-04-16 23:03:54.766670] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:03.772 [2024-04-16 23:03:54.766683] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:03.772 [2024-04-16 23:03:54.768701] bdev_nvme.c:2024:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:03.772 [2024-04-16 23:03:54.778042] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:03.772 [2024-04-16 23:03:54.778358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:03.772 [2024-04-16 23:03:54.778486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:03.772 [2024-04-16 23:03:54.778513] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1bc2400 with addr=10.0.0.2, port=4420 00:26:03.772 [2024-04-16 23:03:54.778529] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1bc2400 is same with the state(5) to be set 00:26:03.772 [2024-04-16 23:03:54.778645] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1bc2400 (9): Bad file descriptor 00:26:03.772 [2024-04-16 23:03:54.778827] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:03.772 [2024-04-16 23:03:54.778848] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:03.772 [2024-04-16 23:03:54.778861] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:03.772 [2024-04-16 23:03:54.781006] bdev_nvme.c:2024:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:03.772 [2024-04-16 23:03:54.790369] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:03.772 [2024-04-16 23:03:54.790725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:03.772 [2024-04-16 23:03:54.790886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:03.772 [2024-04-16 23:03:54.790912] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1bc2400 with addr=10.0.0.2, port=4420 00:26:03.772 [2024-04-16 23:03:54.790927] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1bc2400 is same with the state(5) to be set 00:26:03.772 [2024-04-16 23:03:54.791060] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1bc2400 (9): Bad file descriptor 00:26:03.772 [2024-04-16 23:03:54.791220] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:03.772 [2024-04-16 23:03:54.791241] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:03.772 [2024-04-16 23:03:54.791255] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:03.772 [2024-04-16 23:03:54.793242] bdev_nvme.c:2024:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:03.772 [2024-04-16 23:03:54.802740] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:03.772 [2024-04-16 23:03:54.803029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:03.772 [2024-04-16 23:03:54.803205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:03.772 [2024-04-16 23:03:54.803231] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1bc2400 with addr=10.0.0.2, port=4420 00:26:03.772 [2024-04-16 23:03:54.803247] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1bc2400 is same with the state(5) to be set 00:26:03.772 [2024-04-16 23:03:54.803379] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1bc2400 (9): Bad file descriptor 00:26:03.772 [2024-04-16 23:03:54.803562] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:03.772 [2024-04-16 23:03:54.803583] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:03.772 [2024-04-16 23:03:54.803596] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:03.772 [2024-04-16 23:03:54.805674] bdev_nvme.c:2024:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:03.772 [2024-04-16 23:03:54.815064] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:03.772 [2024-04-16 23:03:54.815382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:03.772 [2024-04-16 23:03:54.815529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:03.772 [2024-04-16 23:03:54.815555] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1bc2400 with addr=10.0.0.2, port=4420 00:26:03.772 [2024-04-16 23:03:54.815570] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1bc2400 is same with the state(5) to be set 00:26:03.772 [2024-04-16 23:03:54.815718] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1bc2400 (9): Bad file descriptor 00:26:03.772 [2024-04-16 23:03:54.815853] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:03.772 [2024-04-16 23:03:54.815873] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:03.773 [2024-04-16 23:03:54.815886] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:03.773 [2024-04-16 23:03:54.818007] bdev_nvme.c:2024:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:03.773 [2024-04-16 23:03:54.827374] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:03.773 [2024-04-16 23:03:54.827713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:03.773 [2024-04-16 23:03:54.827846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:03.773 [2024-04-16 23:03:54.827870] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1bc2400 with addr=10.0.0.2, port=4420 00:26:03.773 [2024-04-16 23:03:54.827885] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1bc2400 is same with the state(5) to be set 00:26:03.773 [2024-04-16 23:03:54.828050] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1bc2400 (9): Bad file descriptor 00:26:03.773 [2024-04-16 23:03:54.828256] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:03.773 [2024-04-16 23:03:54.828278] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:03.773 [2024-04-16 23:03:54.828292] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:03.773 [2024-04-16 23:03:54.830299] bdev_nvme.c:2024:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:03.773 [2024-04-16 23:03:54.839791] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:03.773 [2024-04-16 23:03:54.840094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:03.773 [2024-04-16 23:03:54.840239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:03.773 [2024-04-16 23:03:54.840266] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1bc2400 with addr=10.0.0.2, port=4420 00:26:03.773 [2024-04-16 23:03:54.840282] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1bc2400 is same with the state(5) to be set 00:26:03.773 [2024-04-16 23:03:54.840415] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1bc2400 (9): Bad file descriptor 00:26:03.773 [2024-04-16 23:03:54.840565] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:03.773 [2024-04-16 23:03:54.840586] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:03.773 [2024-04-16 23:03:54.840599] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:03.773 [2024-04-16 23:03:54.842724] bdev_nvme.c:2024:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:03.773 [2024-04-16 23:03:54.852139] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:03.773 [2024-04-16 23:03:54.852445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:03.773 [2024-04-16 23:03:54.852565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:03.773 [2024-04-16 23:03:54.852590] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1bc2400 with addr=10.0.0.2, port=4420 00:26:03.773 [2024-04-16 23:03:54.852606] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1bc2400 is same with the state(5) to be set 00:26:03.773 [2024-04-16 23:03:54.852738] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1bc2400 (9): Bad file descriptor 00:26:03.773 [2024-04-16 23:03:54.852936] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:03.773 [2024-04-16 23:03:54.852957] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:03.773 [2024-04-16 23:03:54.852970] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:03.773 [2024-04-16 23:03:54.855119] bdev_nvme.c:2024:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:03.773 [2024-04-16 23:03:54.864396] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:03.773 [2024-04-16 23:03:54.864759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:03.773 [2024-04-16 23:03:54.864911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:03.773 [2024-04-16 23:03:54.864936] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1bc2400 with addr=10.0.0.2, port=4420 00:26:03.773 [2024-04-16 23:03:54.864952] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1bc2400 is same with the state(5) to be set 00:26:03.773 [2024-04-16 23:03:54.865101] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1bc2400 (9): Bad file descriptor 00:26:03.773 [2024-04-16 23:03:54.865275] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:03.773 [2024-04-16 23:03:54.865297] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:03.773 [2024-04-16 23:03:54.865311] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:03.773 [2024-04-16 23:03:54.867368] bdev_nvme.c:2024:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:03.773 [2024-04-16 23:03:54.876560] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:03.773 [2024-04-16 23:03:54.876868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:03.773 [2024-04-16 23:03:54.877015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:03.773 [2024-04-16 23:03:54.877039] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1bc2400 with addr=10.0.0.2, port=4420 00:26:03.773 [2024-04-16 23:03:54.877055] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1bc2400 is same with the state(5) to be set 00:26:03.773 [2024-04-16 23:03:54.877243] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1bc2400 (9): Bad file descriptor 00:26:03.773 [2024-04-16 23:03:54.877379] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:03.773 [2024-04-16 23:03:54.877400] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:03.773 [2024-04-16 23:03:54.877414] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:03.773 [2024-04-16 23:03:54.879482] bdev_nvme.c:2024:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:03.773 [2024-04-16 23:03:54.888851] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:03.773 [2024-04-16 23:03:54.889169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:03.773 [2024-04-16 23:03:54.889325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:03.773 [2024-04-16 23:03:54.889350] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1bc2400 with addr=10.0.0.2, port=4420 00:26:03.773 [2024-04-16 23:03:54.889366] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1bc2400 is same with the state(5) to be set 00:26:03.773 [2024-04-16 23:03:54.889482] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1bc2400 (9): Bad file descriptor 00:26:03.773 [2024-04-16 23:03:54.889663] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:03.773 [2024-04-16 23:03:54.889684] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:03.773 [2024-04-16 23:03:54.889697] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:03.773 [2024-04-16 23:03:54.891624] bdev_nvme.c:2024:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:04.033 [2024-04-16 23:03:54.901173] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:04.033 [2024-04-16 23:03:54.901514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:04.033 [2024-04-16 23:03:54.901663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:04.033 [2024-04-16 23:03:54.901689] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1bc2400 with addr=10.0.0.2, port=4420 00:26:04.033 [2024-04-16 23:03:54.901705] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1bc2400 is same with the state(5) to be set 00:26:04.033 [2024-04-16 23:03:54.901805] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1bc2400 (9): Bad file descriptor 00:26:04.033 [2024-04-16 23:03:54.902019] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:04.033 [2024-04-16 23:03:54.902040] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:04.033 [2024-04-16 23:03:54.902054] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:04.033 [2024-04-16 23:03:54.904157] bdev_nvme.c:2024:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:04.033 [2024-04-16 23:03:54.913512] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:04.033 [2024-04-16 23:03:54.913814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:04.033 [2024-04-16 23:03:54.913960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:04.033 [2024-04-16 23:03:54.913991] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1bc2400 with addr=10.0.0.2, port=4420 00:26:04.033 [2024-04-16 23:03:54.914007] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1bc2400 is same with the state(5) to be set 00:26:04.033 [2024-04-16 23:03:54.914123] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1bc2400 (9): Bad file descriptor 00:26:04.033 [2024-04-16 23:03:54.914299] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:04.033 [2024-04-16 23:03:54.914322] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:04.033 [2024-04-16 23:03:54.914335] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:04.033 [2024-04-16 23:03:54.916275] bdev_nvme.c:2024:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:04.033 [2024-04-16 23:03:54.925706] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:04.033 [2024-04-16 23:03:54.926023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:04.033 [2024-04-16 23:03:54.926165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:04.033 [2024-04-16 23:03:54.926197] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1bc2400 with addr=10.0.0.2, port=4420 00:26:04.033 [2024-04-16 23:03:54.926214] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1bc2400 is same with the state(5) to be set 00:26:04.033 [2024-04-16 23:03:54.926345] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1bc2400 (9): Bad file descriptor 00:26:04.033 [2024-04-16 23:03:54.926497] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:04.033 [2024-04-16 23:03:54.926519] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:04.033 [2024-04-16 23:03:54.926532] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:04.033 [2024-04-16 23:03:54.928530] bdev_nvme.c:2024:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:04.033 [2024-04-16 23:03:54.938004] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:04.033 [2024-04-16 23:03:54.938355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:04.033 [2024-04-16 23:03:54.938480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:04.033 [2024-04-16 23:03:54.938503] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1bc2400 with addr=10.0.0.2, port=4420 00:26:04.033 [2024-04-16 23:03:54.938518] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1bc2400 is same with the state(5) to be set 00:26:04.033 [2024-04-16 23:03:54.938683] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1bc2400 (9): Bad file descriptor 00:26:04.033 [2024-04-16 23:03:54.938833] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:04.033 [2024-04-16 23:03:54.938854] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:04.033 [2024-04-16 23:03:54.938867] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:04.033 [2024-04-16 23:03:54.941116] bdev_nvme.c:2024:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:04.033 [2024-04-16 23:03:54.950298] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:04.033 [2024-04-16 23:03:54.950564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:04.033 [2024-04-16 23:03:54.950713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:04.033 [2024-04-16 23:03:54.950737] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1bc2400 with addr=10.0.0.2, port=4420 00:26:04.033 [2024-04-16 23:03:54.950758] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1bc2400 is same with the state(5) to be set 00:26:04.033 [2024-04-16 23:03:54.950939] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1bc2400 (9): Bad file descriptor 00:26:04.033 [2024-04-16 23:03:54.951106] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:04.033 [2024-04-16 23:03:54.951127] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:04.033 [2024-04-16 23:03:54.951140] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:04.033 [2024-04-16 23:03:54.953263] bdev_nvme.c:2024:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:04.034 [2024-04-16 23:03:54.962430] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:04.034 [2024-04-16 23:03:54.962730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:04.034 [2024-04-16 23:03:54.962868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:04.034 [2024-04-16 23:03:54.962893] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1bc2400 with addr=10.0.0.2, port=4420 00:26:04.034 [2024-04-16 23:03:54.962908] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1bc2400 is same with the state(5) to be set 00:26:04.034 [2024-04-16 23:03:54.963040] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1bc2400 (9): Bad file descriptor 00:26:04.034 [2024-04-16 23:03:54.963143] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:04.034 [2024-04-16 23:03:54.963186] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:04.034 [2024-04-16 23:03:54.963202] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:04.034 [2024-04-16 23:03:54.965207] bdev_nvme.c:2024:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:04.034 [2024-04-16 23:03:54.974913] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:04.034 [2024-04-16 23:03:54.975202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:04.034 [2024-04-16 23:03:54.975354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:04.034 [2024-04-16 23:03:54.975380] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1bc2400 with addr=10.0.0.2, port=4420 00:26:04.034 [2024-04-16 23:03:54.975395] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1bc2400 is same with the state(5) to be set 00:26:04.034 [2024-04-16 23:03:54.975527] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1bc2400 (9): Bad file descriptor 00:26:04.034 [2024-04-16 23:03:54.975661] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:04.034 [2024-04-16 23:03:54.975682] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:04.034 [2024-04-16 23:03:54.975696] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:04.034 [2024-04-16 23:03:54.977572] bdev_nvme.c:2024:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:04.034 [2024-04-16 23:03:54.987260] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:04.034 [2024-04-16 23:03:54.987576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:04.034 [2024-04-16 23:03:54.987709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:04.034 [2024-04-16 23:03:54.987734] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1bc2400 with addr=10.0.0.2, port=4420 00:26:04.034 [2024-04-16 23:03:54.987750] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1bc2400 is same with the state(5) to be set 00:26:04.034 [2024-04-16 23:03:54.987871] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1bc2400 (9): Bad file descriptor 00:26:04.034 [2024-04-16 23:03:54.988069] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:04.034 [2024-04-16 23:03:54.988090] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:04.034 [2024-04-16 23:03:54.988103] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:04.034 [2024-04-16 23:03:54.990136] bdev_nvme.c:2024:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:04.034 [2024-04-16 23:03:54.999599] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:04.034 [2024-04-16 23:03:54.999875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:04.034 [2024-04-16 23:03:55.000006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:04.034 [2024-04-16 23:03:55.000031] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1bc2400 with addr=10.0.0.2, port=4420 00:26:04.034 [2024-04-16 23:03:55.000047] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1bc2400 is same with the state(5) to be set 00:26:04.034 [2024-04-16 23:03:55.000187] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1bc2400 (9): Bad file descriptor 00:26:04.034 [2024-04-16 23:03:55.000340] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:04.034 [2024-04-16 23:03:55.000361] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:04.034 [2024-04-16 23:03:55.000374] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:04.034 [2024-04-16 23:03:55.002511] bdev_nvme.c:2024:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:04.034 [2024-04-16 23:03:55.011776] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:04.034 [2024-04-16 23:03:55.012063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:04.034 [2024-04-16 23:03:55.012198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:04.034 [2024-04-16 23:03:55.012225] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1bc2400 with addr=10.0.0.2, port=4420 00:26:04.034 [2024-04-16 23:03:55.012241] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1bc2400 is same with the state(5) to be set 00:26:04.034 [2024-04-16 23:03:55.012422] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1bc2400 (9): Bad file descriptor 00:26:04.034 [2024-04-16 23:03:55.012602] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:04.034 [2024-04-16 23:03:55.012623] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:04.034 [2024-04-16 23:03:55.012637] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:04.034 [2024-04-16 23:03:55.014696] bdev_nvme.c:2024:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:04.034 [2024-04-16 23:03:55.024018] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:04.034 [2024-04-16 23:03:55.024355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:04.034 [2024-04-16 23:03:55.024471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:04.034 [2024-04-16 23:03:55.024496] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1bc2400 with addr=10.0.0.2, port=4420 00:26:04.034 [2024-04-16 23:03:55.024511] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1bc2400 is same with the state(5) to be set 00:26:04.034 [2024-04-16 23:03:55.024659] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1bc2400 (9): Bad file descriptor 00:26:04.034 [2024-04-16 23:03:55.024831] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:04.034 [2024-04-16 23:03:55.024852] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:04.034 [2024-04-16 23:03:55.024865] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:04.034 [2024-04-16 23:03:55.026891] bdev_nvme.c:2024:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:04.034 [2024-04-16 23:03:55.036286] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:04.034 [2024-04-16 23:03:55.036638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:04.034 [2024-04-16 23:03:55.036788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:04.034 [2024-04-16 23:03:55.036813] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1bc2400 with addr=10.0.0.2, port=4420 00:26:04.034 [2024-04-16 23:03:55.036829] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1bc2400 is same with the state(5) to be set 00:26:04.034 [2024-04-16 23:03:55.036976] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1bc2400 (9): Bad file descriptor 00:26:04.034 [2024-04-16 23:03:55.037109] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:04.034 [2024-04-16 23:03:55.037130] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:04.034 [2024-04-16 23:03:55.037143] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:04.034 [2024-04-16 23:03:55.039246] bdev_nvme.c:2024:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:04.034 [2024-04-16 23:03:55.048659] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:04.034 [2024-04-16 23:03:55.048959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:04.034 [2024-04-16 23:03:55.049132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:04.034 [2024-04-16 23:03:55.049157] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1bc2400 with addr=10.0.0.2, port=4420 00:26:04.034 [2024-04-16 23:03:55.049173] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1bc2400 is same with the state(5) to be set 00:26:04.034 [2024-04-16 23:03:55.049297] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1bc2400 (9): Bad file descriptor 00:26:04.034 [2024-04-16 23:03:55.049432] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:04.034 [2024-04-16 23:03:55.049468] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:04.034 [2024-04-16 23:03:55.049482] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:04.034 [2024-04-16 23:03:55.051512] bdev_nvme.c:2024:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:04.034 [2024-04-16 23:03:55.060913] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:04.034 [2024-04-16 23:03:55.061189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:04.034 [2024-04-16 23:03:55.061310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:04.034 [2024-04-16 23:03:55.061335] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1bc2400 with addr=10.0.0.2, port=4420 00:26:04.034 [2024-04-16 23:03:55.061351] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1bc2400 is same with the state(5) to be set 00:26:04.034 [2024-04-16 23:03:55.061483] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1bc2400 (9): Bad file descriptor 00:26:04.034 [2024-04-16 23:03:55.061680] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:04.034 [2024-04-16 23:03:55.061706] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:04.034 [2024-04-16 23:03:55.061720] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:04.034 [2024-04-16 23:03:55.063835] bdev_nvme.c:2024:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:04.034 [2024-04-16 23:03:55.073313] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:04.034 [2024-04-16 23:03:55.073683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:04.034 [2024-04-16 23:03:55.073797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:04.035 [2024-04-16 23:03:55.073823] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1bc2400 with addr=10.0.0.2, port=4420 00:26:04.035 [2024-04-16 23:03:55.073839] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1bc2400 is same with the state(5) to be set 00:26:04.035 [2024-04-16 23:03:55.073955] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1bc2400 (9): Bad file descriptor 00:26:04.035 [2024-04-16 23:03:55.074058] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:04.035 [2024-04-16 23:03:55.074094] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:04.035 [2024-04-16 23:03:55.074107] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:04.035 [2024-04-16 23:03:55.076077] bdev_nvme.c:2024:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:04.035 [2024-04-16 23:03:55.085645] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:04.035 [2024-04-16 23:03:55.085929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:04.035 [2024-04-16 23:03:55.086049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:04.035 [2024-04-16 23:03:55.086074] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1bc2400 with addr=10.0.0.2, port=4420 00:26:04.035 [2024-04-16 23:03:55.086090] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1bc2400 is same with the state(5) to be set 00:26:04.035 [2024-04-16 23:03:55.086263] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1bc2400 (9): Bad file descriptor 00:26:04.035 [2024-04-16 23:03:55.086428] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:04.035 [2024-04-16 23:03:55.086449] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:04.035 [2024-04-16 23:03:55.086462] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:04.035 [2024-04-16 23:03:55.088600] bdev_nvme.c:2024:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:04.035 [2024-04-16 23:03:55.097831] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:04.035 [2024-04-16 23:03:55.098196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:04.035 [2024-04-16 23:03:55.098321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:04.035 [2024-04-16 23:03:55.098346] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1bc2400 with addr=10.0.0.2, port=4420 00:26:04.035 [2024-04-16 23:03:55.098362] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1bc2400 is same with the state(5) to be set 00:26:04.035 [2024-04-16 23:03:55.098494] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1bc2400 (9): Bad file descriptor 00:26:04.035 [2024-04-16 23:03:55.098644] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:04.035 [2024-04-16 23:03:55.098666] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:04.035 [2024-04-16 23:03:55.098687] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:04.035 [2024-04-16 23:03:55.100864] bdev_nvme.c:2024:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:04.035 [2024-04-16 23:03:55.110233] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:04.035 [2024-04-16 23:03:55.110557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:04.035 [2024-04-16 23:03:55.110705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:04.035 [2024-04-16 23:03:55.110730] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1bc2400 with addr=10.0.0.2, port=4420 00:26:04.035 [2024-04-16 23:03:55.110746] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1bc2400 is same with the state(5) to be set 00:26:04.035 [2024-04-16 23:03:55.110845] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1bc2400 (9): Bad file descriptor 00:26:04.035 [2024-04-16 23:03:55.110964] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:04.035 [2024-04-16 23:03:55.110985] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:04.035 [2024-04-16 23:03:55.111014] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:04.035 [2024-04-16 23:03:55.113277] bdev_nvme.c:2024:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:04.035 [2024-04-16 23:03:55.122592] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:04.035 [2024-04-16 23:03:55.122926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:04.035 [2024-04-16 23:03:55.123060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:04.035 [2024-04-16 23:03:55.123085] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1bc2400 with addr=10.0.0.2, port=4420 00:26:04.035 [2024-04-16 23:03:55.123101] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1bc2400 is same with the state(5) to be set 00:26:04.035 [2024-04-16 23:03:55.123226] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1bc2400 (9): Bad file descriptor 00:26:04.035 [2024-04-16 23:03:55.123346] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:04.035 [2024-04-16 23:03:55.123367] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:04.035 [2024-04-16 23:03:55.123381] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:04.035 [2024-04-16 23:03:55.125507] bdev_nvme.c:2024:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:04.035 [2024-04-16 23:03:55.134941] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:04.035 [2024-04-16 23:03:55.135296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:04.035 [2024-04-16 23:03:55.135427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:04.035 [2024-04-16 23:03:55.135452] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1bc2400 with addr=10.0.0.2, port=4420 00:26:04.035 [2024-04-16 23:03:55.135468] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1bc2400 is same with the state(5) to be set 00:26:04.035 [2024-04-16 23:03:55.135616] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1bc2400 (9): Bad file descriptor 00:26:04.035 [2024-04-16 23:03:55.135815] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:04.035 [2024-04-16 23:03:55.135837] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:04.035 [2024-04-16 23:03:55.135850] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:04.035 [2024-04-16 23:03:55.137894] bdev_nvme.c:2024:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:04.035 [2024-04-16 23:03:55.147191] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:04.035 [2024-04-16 23:03:55.147482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:04.035 [2024-04-16 23:03:55.147624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:04.035 [2024-04-16 23:03:55.147650] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1bc2400 with addr=10.0.0.2, port=4420 00:26:04.035 [2024-04-16 23:03:55.147665] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1bc2400 is same with the state(5) to be set 00:26:04.035 [2024-04-16 23:03:55.147765] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1bc2400 (9): Bad file descriptor 00:26:04.035 [2024-04-16 23:03:55.147868] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:04.035 [2024-04-16 23:03:55.147890] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:04.035 [2024-04-16 23:03:55.147903] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:04.035 [2024-04-16 23:03:55.149977] bdev_nvme.c:2024:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:04.035 [2024-04-16 23:03:55.159668] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:04.295 [2024-04-16 23:03:55.159970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:04.295 [2024-04-16 23:03:55.160116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:04.295 [2024-04-16 23:03:55.160142] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1bc2400 with addr=10.0.0.2, port=4420 00:26:04.295 [2024-04-16 23:03:55.160159] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1bc2400 is same with the state(5) to be set 00:26:04.295 [2024-04-16 23:03:55.160332] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1bc2400 (9): Bad file descriptor 00:26:04.295 [2024-04-16 23:03:55.160500] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:04.295 [2024-04-16 23:03:55.160521] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:04.295 [2024-04-16 23:03:55.160535] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:04.295 [2024-04-16 23:03:55.162528] bdev_nvme.c:2024:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:04.295 [2024-04-16 23:03:55.172029] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:04.295 [2024-04-16 23:03:55.172352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:04.295 [2024-04-16 23:03:55.172500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:04.295 [2024-04-16 23:03:55.172525] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1bc2400 with addr=10.0.0.2, port=4420 00:26:04.295 [2024-04-16 23:03:55.172541] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1bc2400 is same with the state(5) to be set 00:26:04.295 [2024-04-16 23:03:55.172722] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1bc2400 (9): Bad file descriptor 00:26:04.295 [2024-04-16 23:03:55.172904] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:04.295 [2024-04-16 23:03:55.172926] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:04.295 [2024-04-16 23:03:55.172939] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:04.295 [2024-04-16 23:03:55.175014] bdev_nvme.c:2024:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:04.295 [2024-04-16 23:03:55.184411] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:04.295 [2024-04-16 23:03:55.184754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:04.295 [2024-04-16 23:03:55.184903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:04.295 [2024-04-16 23:03:55.184929] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1bc2400 with addr=10.0.0.2, port=4420 00:26:04.295 [2024-04-16 23:03:55.184945] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1bc2400 is same with the state(5) to be set 00:26:04.295 [2024-04-16 23:03:55.185125] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1bc2400 (9): Bad file descriptor 00:26:04.295 [2024-04-16 23:03:55.185302] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:04.295 [2024-04-16 23:03:55.185324] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:04.295 [2024-04-16 23:03:55.185338] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:04.295 [2024-04-16 23:03:55.187275] bdev_nvme.c:2024:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:04.295 [2024-04-16 23:03:55.196783] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:04.295 [2024-04-16 23:03:55.197112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:04.295 [2024-04-16 23:03:55.197256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:04.295 [2024-04-16 23:03:55.197282] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1bc2400 with addr=10.0.0.2, port=4420 00:26:04.295 [2024-04-16 23:03:55.197298] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1bc2400 is same with the state(5) to be set 00:26:04.295 [2024-04-16 23:03:55.197431] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1bc2400 (9): Bad file descriptor 00:26:04.295 [2024-04-16 23:03:55.197595] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:04.295 [2024-04-16 23:03:55.197616] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:04.295 [2024-04-16 23:03:55.197630] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:04.295 [2024-04-16 23:03:55.200006] bdev_nvme.c:2024:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:04.295 [2024-04-16 23:03:55.209051] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:04.295 [2024-04-16 23:03:55.209391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:04.295 [2024-04-16 23:03:55.209503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:04.295 [2024-04-16 23:03:55.209528] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1bc2400 with addr=10.0.0.2, port=4420 00:26:04.295 [2024-04-16 23:03:55.209544] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1bc2400 is same with the state(5) to be set 00:26:04.295 [2024-04-16 23:03:55.209708] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1bc2400 (9): Bad file descriptor 00:26:04.295 [2024-04-16 23:03:55.209906] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:04.296 [2024-04-16 23:03:55.209927] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:04.296 [2024-04-16 23:03:55.209940] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:04.296 [2024-04-16 23:03:55.212035] bdev_nvme.c:2024:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:04.296 [2024-04-16 23:03:55.221308] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:04.296 [2024-04-16 23:03:55.221643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:04.296 [2024-04-16 23:03:55.221792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:04.296 [2024-04-16 23:03:55.221817] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1bc2400 with addr=10.0.0.2, port=4420 00:26:04.296 [2024-04-16 23:03:55.221833] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1bc2400 is same with the state(5) to be set 00:26:04.296 [2024-04-16 23:03:55.221965] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1bc2400 (9): Bad file descriptor 00:26:04.296 [2024-04-16 23:03:55.222115] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:04.296 [2024-04-16 23:03:55.222136] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:04.296 [2024-04-16 23:03:55.222149] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:04.296 [2024-04-16 23:03:55.224123] bdev_nvme.c:2024:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:04.296 [2024-04-16 23:03:55.233531] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:04.296 [2024-04-16 23:03:55.233845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:04.296 [2024-04-16 23:03:55.233996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:04.296 [2024-04-16 23:03:55.234022] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1bc2400 with addr=10.0.0.2, port=4420 00:26:04.296 [2024-04-16 23:03:55.234037] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1bc2400 is same with the state(5) to be set 00:26:04.296 [2024-04-16 23:03:55.234213] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1bc2400 (9): Bad file descriptor 00:26:04.296 [2024-04-16 23:03:55.234350] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:04.296 [2024-04-16 23:03:55.234371] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:04.296 [2024-04-16 23:03:55.234385] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:04.296 [2024-04-16 23:03:55.236533] bdev_nvme.c:2024:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:04.296 [2024-04-16 23:03:55.245926] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:04.296 [2024-04-16 23:03:55.246237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:04.296 [2024-04-16 23:03:55.246376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:04.296 [2024-04-16 23:03:55.246402] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1bc2400 with addr=10.0.0.2, port=4420 00:26:04.296 [2024-04-16 23:03:55.246417] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1bc2400 is same with the state(5) to be set 00:26:04.296 [2024-04-16 23:03:55.246517] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1bc2400 (9): Bad file descriptor 00:26:04.296 [2024-04-16 23:03:55.246668] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:04.296 [2024-04-16 23:03:55.246703] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:04.296 [2024-04-16 23:03:55.246716] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:04.296 [2024-04-16 23:03:55.248732] bdev_nvme.c:2024:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:04.296 [2024-04-16 23:03:55.258285] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:04.296 [2024-04-16 23:03:55.258618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:04.296 [2024-04-16 23:03:55.258763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:04.296 [2024-04-16 23:03:55.258793] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1bc2400 with addr=10.0.0.2, port=4420 00:26:04.296 [2024-04-16 23:03:55.258809] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1bc2400 is same with the state(5) to be set 00:26:04.296 [2024-04-16 23:03:55.258925] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1bc2400 (9): Bad file descriptor 00:26:04.296 [2024-04-16 23:03:55.259090] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:04.296 [2024-04-16 23:03:55.259111] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:04.296 [2024-04-16 23:03:55.259124] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:04.296 [2024-04-16 23:03:55.261200] bdev_nvme.c:2024:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:04.296 [2024-04-16 23:03:55.270538] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:04.296 [2024-04-16 23:03:55.270861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:04.296 [2024-04-16 23:03:55.271006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:04.296 [2024-04-16 23:03:55.271031] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1bc2400 with addr=10.0.0.2, port=4420 00:26:04.296 [2024-04-16 23:03:55.271046] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1bc2400 is same with the state(5) to be set 00:26:04.296 [2024-04-16 23:03:55.271220] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1bc2400 (9): Bad file descriptor 00:26:04.296 [2024-04-16 23:03:55.271340] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:04.296 [2024-04-16 23:03:55.271361] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:04.296 [2024-04-16 23:03:55.271375] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:04.296 [2024-04-16 23:03:55.273556] bdev_nvme.c:2024:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:04.296 [2024-04-16 23:03:55.282830] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:04.296 [2024-04-16 23:03:55.283145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:04.296 [2024-04-16 23:03:55.283302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:04.296 [2024-04-16 23:03:55.283329] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1bc2400 with addr=10.0.0.2, port=4420 00:26:04.296 [2024-04-16 23:03:55.283345] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1bc2400 is same with the state(5) to be set 00:26:04.296 [2024-04-16 23:03:55.283478] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1bc2400 (9): Bad file descriptor 00:26:04.296 [2024-04-16 23:03:55.283643] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:04.296 [2024-04-16 23:03:55.283664] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:04.296 [2024-04-16 23:03:55.283678] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:04.296 [2024-04-16 23:03:55.285791] bdev_nvme.c:2024:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:04.296 [2024-04-16 23:03:55.295098] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:04.296 [2024-04-16 23:03:55.295397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:04.296 [2024-04-16 23:03:55.295566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:04.296 [2024-04-16 23:03:55.295592] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1bc2400 with addr=10.0.0.2, port=4420 00:26:04.296 [2024-04-16 23:03:55.295613] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1bc2400 is same with the state(5) to be set 00:26:04.296 [2024-04-16 23:03:55.295795] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1bc2400 (9): Bad file descriptor 00:26:04.296 [2024-04-16 23:03:55.295945] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:04.296 [2024-04-16 23:03:55.295966] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:04.296 [2024-04-16 23:03:55.295980] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:04.296 [2024-04-16 23:03:55.297882] bdev_nvme.c:2024:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:04.296 [2024-04-16 23:03:55.307344] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:04.296 [2024-04-16 23:03:55.307647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:04.296 [2024-04-16 23:03:55.307762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:04.296 [2024-04-16 23:03:55.307788] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1bc2400 with addr=10.0.0.2, port=4420 00:26:04.296 [2024-04-16 23:03:55.307804] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1bc2400 is same with the state(5) to be set 00:26:04.296 [2024-04-16 23:03:55.307920] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1bc2400 (9): Bad file descriptor 00:26:04.296 [2024-04-16 23:03:55.308119] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:04.296 [2024-04-16 23:03:55.308140] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:04.296 [2024-04-16 23:03:55.308170] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:04.296 [2024-04-16 23:03:55.310230] bdev_nvme.c:2024:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:04.296 [2024-04-16 23:03:55.319690] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:04.296 [2024-04-16 23:03:55.320019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:04.296 [2024-04-16 23:03:55.320181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:04.296 [2024-04-16 23:03:55.320207] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1bc2400 with addr=10.0.0.2, port=4420 00:26:04.296 [2024-04-16 23:03:55.320223] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1bc2400 is same with the state(5) to be set 00:26:04.296 [2024-04-16 23:03:55.320373] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1bc2400 (9): Bad file descriptor 00:26:04.296 [2024-04-16 23:03:55.320555] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:04.296 [2024-04-16 23:03:55.320577] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:04.296 [2024-04-16 23:03:55.320590] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:04.297 [2024-04-16 23:03:55.322625] bdev_nvme.c:2024:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:04.297 [2024-04-16 23:03:55.331908] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:04.297 [2024-04-16 23:03:55.332238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:04.297 [2024-04-16 23:03:55.332385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:04.297 [2024-04-16 23:03:55.332412] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1bc2400 with addr=10.0.0.2, port=4420 00:26:04.297 [2024-04-16 23:03:55.332427] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1bc2400 is same with the state(5) to be set 00:26:04.297 [2024-04-16 23:03:55.332552] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1bc2400 (9): Bad file descriptor 00:26:04.297 [2024-04-16 23:03:55.332702] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:04.297 [2024-04-16 23:03:55.332723] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:04.297 [2024-04-16 23:03:55.332737] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:04.297 [2024-04-16 23:03:55.334738] bdev_nvme.c:2024:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:04.297 [2024-04-16 23:03:55.344237] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:04.297 [2024-04-16 23:03:55.344529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:04.297 [2024-04-16 23:03:55.344681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:04.297 [2024-04-16 23:03:55.344706] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1bc2400 with addr=10.0.0.2, port=4420 00:26:04.297 [2024-04-16 23:03:55.344722] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1bc2400 is same with the state(5) to be set 00:26:04.297 [2024-04-16 23:03:55.344870] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1bc2400 (9): Bad file descriptor 00:26:04.297 [2024-04-16 23:03:55.345023] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:04.297 [2024-04-16 23:03:55.345044] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:04.297 [2024-04-16 23:03:55.345058] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:04.297 [2024-04-16 23:03:55.347099] bdev_nvme.c:2024:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:04.297 [2024-04-16 23:03:55.356659] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:04.297 [2024-04-16 23:03:55.356990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:04.297 [2024-04-16 23:03:55.357172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:04.297 [2024-04-16 23:03:55.357206] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1bc2400 with addr=10.0.0.2, port=4420 00:26:04.297 [2024-04-16 23:03:55.357222] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1bc2400 is same with the state(5) to be set 00:26:04.297 [2024-04-16 23:03:55.357387] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1bc2400 (9): Bad file descriptor 00:26:04.297 [2024-04-16 23:03:55.357553] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:04.297 [2024-04-16 23:03:55.357573] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:04.297 [2024-04-16 23:03:55.357587] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:04.297 [2024-04-16 23:03:55.359697] bdev_nvme.c:2024:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:04.297 [2024-04-16 23:03:55.368843] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:04.297 [2024-04-16 23:03:55.369137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:04.297 [2024-04-16 23:03:55.369317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:04.297 [2024-04-16 23:03:55.369343] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1bc2400 with addr=10.0.0.2, port=4420 00:26:04.297 [2024-04-16 23:03:55.369360] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1bc2400 is same with the state(5) to be set 00:26:04.297 [2024-04-16 23:03:55.369526] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1bc2400 (9): Bad file descriptor 00:26:04.297 [2024-04-16 23:03:55.369695] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:04.297 [2024-04-16 23:03:55.369717] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:04.297 [2024-04-16 23:03:55.369731] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:04.297 [2024-04-16 23:03:55.371795] bdev_nvme.c:2024:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:04.297 [2024-04-16 23:03:55.381305] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:04.297 [2024-04-16 23:03:55.381648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:04.297 [2024-04-16 23:03:55.381789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:04.297 [2024-04-16 23:03:55.381815] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1bc2400 with addr=10.0.0.2, port=4420 00:26:04.297 [2024-04-16 23:03:55.381832] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1bc2400 is same with the state(5) to be set 00:26:04.297 [2024-04-16 23:03:55.381964] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1bc2400 (9): Bad file descriptor 00:26:04.297 [2024-04-16 23:03:55.382146] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:04.297 [2024-04-16 23:03:55.382167] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:04.297 [2024-04-16 23:03:55.382203] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:04.297 [2024-04-16 23:03:55.384322] bdev_nvme.c:2024:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:04.297 [2024-04-16 23:03:55.393609] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:04.297 [2024-04-16 23:03:55.393948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:04.297 [2024-04-16 23:03:55.394087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:04.297 [2024-04-16 23:03:55.394112] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1bc2400 with addr=10.0.0.2, port=4420 00:26:04.297 [2024-04-16 23:03:55.394128] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1bc2400 is same with the state(5) to be set 00:26:04.297 [2024-04-16 23:03:55.394255] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1bc2400 (9): Bad file descriptor 00:26:04.297 [2024-04-16 23:03:55.394402] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:04.297 [2024-04-16 23:03:55.394424] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:04.297 [2024-04-16 23:03:55.394438] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:04.297 [2024-04-16 23:03:55.396353] bdev_nvme.c:2024:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:04.297 [2024-04-16 23:03:55.406147] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:04.297 [2024-04-16 23:03:55.406479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:04.297 [2024-04-16 23:03:55.406595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:04.297 [2024-04-16 23:03:55.406619] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1bc2400 with addr=10.0.0.2, port=4420 00:26:04.297 [2024-04-16 23:03:55.406635] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1bc2400 is same with the state(5) to be set 00:26:04.297 [2024-04-16 23:03:55.406799] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1bc2400 (9): Bad file descriptor 00:26:04.297 [2024-04-16 23:03:55.406919] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:04.297 [2024-04-16 23:03:55.406945] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:04.297 [2024-04-16 23:03:55.406959] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:04.297 [2024-04-16 23:03:55.408838] bdev_nvme.c:2024:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:04.297 23:03:55 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:26:04.297 23:03:55 -- common/autotest_common.sh@852 -- # return 0 00:26:04.297 23:03:55 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:26:04.297 23:03:55 -- common/autotest_common.sh@718 -- # xtrace_disable 00:26:04.297 23:03:55 -- common/autotest_common.sh@10 -- # set +x 00:26:04.297 [2024-04-16 23:03:55.418486] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:04.297 [2024-04-16 23:03:55.418769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:04.297 [2024-04-16 23:03:55.418919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:04.297 [2024-04-16 23:03:55.418945] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1bc2400 with addr=10.0.0.2, port=4420 00:26:04.297 [2024-04-16 23:03:55.418960] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1bc2400 is same with the state(5) to be set 00:26:04.297 [2024-04-16 23:03:55.419109] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1bc2400 (9): Bad file descriptor 00:26:04.297 [2024-04-16 23:03:55.419305] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:04.297 [2024-04-16 23:03:55.419327] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:04.297 [2024-04-16 23:03:55.419340] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:04.297 [2024-04-16 23:03:55.421503] bdev_nvme.c:2024:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:04.556 [2024-04-16 23:03:55.430759] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:04.556 [2024-04-16 23:03:55.431091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:04.556 [2024-04-16 23:03:55.431237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:04.556 [2024-04-16 23:03:55.431265] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1bc2400 with addr=10.0.0.2, port=4420 00:26:04.556 [2024-04-16 23:03:55.431282] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1bc2400 is same with the state(5) to be set 00:26:04.556 [2024-04-16 23:03:55.431399] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1bc2400 (9): Bad file descriptor 00:26:04.556 [2024-04-16 23:03:55.431503] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:04.556 [2024-04-16 23:03:55.431548] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:04.556 [2024-04-16 23:03:55.431562] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:04.556 [2024-04-16 23:03:55.433581] bdev_nvme.c:2024:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:04.556 23:03:55 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:26:04.556 23:03:55 -- host/bdevperf.sh@17 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:26:04.556 23:03:55 -- common/autotest_common.sh@551 -- # xtrace_disable 00:26:04.556 23:03:55 -- common/autotest_common.sh@10 -- # set +x 00:26:04.556 [2024-04-16 23:03:55.441939] tcp.c: 659:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:26:04.556 [2024-04-16 23:03:55.443221] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:04.556 [2024-04-16 23:03:55.443476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:04.556 [2024-04-16 23:03:55.443636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:04.556 [2024-04-16 23:03:55.443667] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1bc2400 with addr=10.0.0.2, port=4420 00:26:04.556 [2024-04-16 23:03:55.443684] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1bc2400 is same with the state(5) to be set 00:26:04.556 [2024-04-16 23:03:55.443816] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1bc2400 (9): Bad file descriptor 00:26:04.556 [2024-04-16 23:03:55.443998] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:04.556 [2024-04-16 23:03:55.444019] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:04.556 [2024-04-16 23:03:55.444032] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:04.556 [2024-04-16 23:03:55.446174] bdev_nvme.c:2024:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:04.556 23:03:55 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:26:04.556 23:03:55 -- host/bdevperf.sh@18 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc0 00:26:04.556 23:03:55 -- common/autotest_common.sh@551 -- # xtrace_disable 00:26:04.556 23:03:55 -- common/autotest_common.sh@10 -- # set +x 00:26:04.556 [2024-04-16 23:03:55.455448] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:04.556 [2024-04-16 23:03:55.455756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:04.556 [2024-04-16 23:03:55.455874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:04.556 [2024-04-16 23:03:55.455900] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1bc2400 with addr=10.0.0.2, port=4420 00:26:04.556 [2024-04-16 23:03:55.455916] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1bc2400 is same with the state(5) to be set 00:26:04.556 [2024-04-16 23:03:55.456081] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1bc2400 (9): Bad file descriptor 00:26:04.556 [2024-04-16 23:03:55.456209] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:04.556 [2024-04-16 23:03:55.456231] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:04.556 [2024-04-16 23:03:55.456244] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:04.556 [2024-04-16 23:03:55.458398] bdev_nvme.c:2024:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:04.556 [2024-04-16 23:03:55.467787] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:04.556 [2024-04-16 23:03:55.468055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:04.556 [2024-04-16 23:03:55.468224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:04.556 [2024-04-16 23:03:55.468251] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1bc2400 with addr=10.0.0.2, port=4420 00:26:04.556 [2024-04-16 23:03:55.468267] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1bc2400 is same with the state(5) to be set 00:26:04.556 [2024-04-16 23:03:55.468382] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1bc2400 (9): Bad file descriptor 00:26:04.556 [2024-04-16 23:03:55.468575] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:04.556 [2024-04-16 23:03:55.468596] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:04.556 [2024-04-16 23:03:55.468609] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:04.556 [2024-04-16 23:03:55.470764] bdev_nvme.c:2024:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:04.556 [2024-04-16 23:03:55.480219] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:04.556 [2024-04-16 23:03:55.480578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:04.556 [2024-04-16 23:03:55.480749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:04.556 [2024-04-16 23:03:55.480775] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1bc2400 with addr=10.0.0.2, port=4420 00:26:04.556 [2024-04-16 23:03:55.480793] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1bc2400 is same with the state(5) to be set 00:26:04.556 [2024-04-16 23:03:55.480995] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1bc2400 (9): Bad file descriptor 00:26:04.556 [2024-04-16 23:03:55.481161] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:04.556 [2024-04-16 23:03:55.481207] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:04.556 [2024-04-16 23:03:55.481224] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:04.556 [2024-04-16 23:03:55.483297] bdev_nvme.c:2024:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:04.556 [2024-04-16 23:03:55.492692] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:04.556 [2024-04-16 23:03:55.493162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:04.556 [2024-04-16 23:03:55.493330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:04.556 [2024-04-16 23:03:55.493356] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1bc2400 with addr=10.0.0.2, port=4420 00:26:04.556 [2024-04-16 23:03:55.493376] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1bc2400 is same with the state(5) to be set 00:26:04.556 [2024-04-16 23:03:55.493501] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1bc2400 (9): Bad file descriptor 00:26:04.556 [2024-04-16 23:03:55.493685] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:04.556 [2024-04-16 23:03:55.493706] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:04.556 [2024-04-16 23:03:55.493723] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:04.556 Malloc0 00:26:04.556 23:03:55 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:26:04.556 23:03:55 -- host/bdevperf.sh@19 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:26:04.556 23:03:55 -- common/autotest_common.sh@551 -- # xtrace_disable 00:26:04.556 23:03:55 -- common/autotest_common.sh@10 -- # set +x 00:26:04.556 [2024-04-16 23:03:55.495797] bdev_nvme.c:2024:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:04.556 23:03:55 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:26:04.556 23:03:55 -- host/bdevperf.sh@20 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:26:04.556 23:03:55 -- common/autotest_common.sh@551 -- # xtrace_disable 00:26:04.556 23:03:55 -- common/autotest_common.sh@10 -- # set +x 00:26:04.556 [2024-04-16 23:03:55.504967] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:04.556 [2024-04-16 23:03:55.505271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:04.556 [2024-04-16 23:03:55.505403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:04.556 [2024-04-16 23:03:55.505429] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1bc2400 with addr=10.0.0.2, port=4420 00:26:04.556 [2024-04-16 23:03:55.505445] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1bc2400 is same with the state(5) to be set 00:26:04.556 [2024-04-16 23:03:55.505627] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1bc2400 (9): Bad file descriptor 00:26:04.557 [2024-04-16 23:03:55.505794] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:04.557 [2024-04-16 23:03:55.505816] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:04.557 [2024-04-16 23:03:55.505837] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:04.557 [2024-04-16 23:03:55.507781] bdev_nvme.c:2024:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:04.557 23:03:55 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:26:04.557 23:03:55 -- host/bdevperf.sh@21 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:26:04.557 23:03:55 -- common/autotest_common.sh@551 -- # xtrace_disable 00:26:04.557 23:03:55 -- common/autotest_common.sh@10 -- # set +x 00:26:04.557 [2024-04-16 23:03:55.514640] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:26:04.557 [2024-04-16 23:03:55.517342] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:04.557 23:03:55 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:26:04.557 23:03:55 -- host/bdevperf.sh@38 -- # wait 387935 00:26:04.557 [2024-04-16 23:03:55.590523] bdev_nvme.c:2026:_bdev_nvme_reset_ctrlr_complete: *NOTICE*: Resetting controller successful. 00:26:14.539 00:26:14.539 Latency(us) 00:26:14.539 Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:26:14.539 Job: Nvme1n1 (Core Mask 0x1, workload: verify, depth: 128, IO size: 4096) 00:26:14.539 Verification LBA range: start 0x0 length 0x4000 00:26:14.539 Nvme1n1 : 15.01 9365.64 36.58 16101.90 0.00 5011.48 794.93 21942.42 00:26:14.539 =================================================================================================================== 00:26:14.539 Total : 9365.64 36.58 16101.90 0.00 5011.48 794.93 21942.42 00:26:14.539 23:04:04 -- host/bdevperf.sh@39 -- # sync 00:26:14.539 23:04:04 -- host/bdevperf.sh@40 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:26:14.539 23:04:04 -- common/autotest_common.sh@551 -- # xtrace_disable 00:26:14.539 23:04:04 -- common/autotest_common.sh@10 -- # set +x 00:26:14.539 23:04:04 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:26:14.539 23:04:04 -- host/bdevperf.sh@42 -- # trap - SIGINT SIGTERM EXIT 00:26:14.539 23:04:04 -- host/bdevperf.sh@44 -- # nvmftestfini 00:26:14.539 23:04:04 -- nvmf/common.sh@476 -- # nvmfcleanup 00:26:14.539 23:04:04 -- nvmf/common.sh@116 -- # sync 00:26:14.539 23:04:04 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:26:14.539 23:04:04 -- nvmf/common.sh@119 -- # set +e 00:26:14.539 23:04:04 -- nvmf/common.sh@120 -- # for i in {1..20} 00:26:14.539 23:04:04 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:26:14.539 rmmod nvme_tcp 00:26:14.539 rmmod nvme_fabrics 00:26:14.539 rmmod nvme_keyring 00:26:14.539 23:04:04 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:26:14.539 23:04:04 -- nvmf/common.sh@123 -- # set -e 00:26:14.539 23:04:04 -- nvmf/common.sh@124 -- # return 0 00:26:14.539 23:04:04 -- nvmf/common.sh@477 -- # '[' -n 388660 ']' 00:26:14.539 23:04:04 -- nvmf/common.sh@478 -- # killprocess 388660 00:26:14.539 23:04:04 -- common/autotest_common.sh@926 -- # '[' -z 388660 ']' 00:26:14.539 23:04:04 -- common/autotest_common.sh@930 -- # kill -0 388660 00:26:14.539 23:04:04 -- common/autotest_common.sh@931 -- # uname 00:26:14.539 23:04:04 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:26:14.539 23:04:04 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 388660 00:26:14.539 23:04:04 -- common/autotest_common.sh@932 -- # process_name=reactor_1 00:26:14.539 23:04:04 -- common/autotest_common.sh@936 -- # '[' reactor_1 = sudo ']' 00:26:14.539 23:04:04 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 388660' 00:26:14.539 killing process with pid 388660 00:26:14.539 23:04:04 -- common/autotest_common.sh@945 -- # kill 388660 00:26:14.539 23:04:04 -- common/autotest_common.sh@950 -- # wait 388660 00:26:14.539 23:04:04 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:26:14.539 23:04:04 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:26:14.539 23:04:04 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:26:14.539 23:04:04 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:26:14.539 23:04:04 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:26:14.539 23:04:04 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:26:14.539 23:04:04 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:26:14.539 23:04:04 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:26:15.919 23:04:06 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:26:15.919 00:26:15.919 real 0m23.012s 00:26:15.919 user 1m1.601s 00:26:15.919 sys 0m4.692s 00:26:15.919 23:04:06 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:26:15.919 23:04:06 -- common/autotest_common.sh@10 -- # set +x 00:26:15.919 ************************************ 00:26:15.919 END TEST nvmf_bdevperf 00:26:15.919 ************************************ 00:26:15.919 23:04:06 -- nvmf/nvmf.sh@123 -- # run_test nvmf_target_disconnect /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/target_disconnect.sh --transport=tcp 00:26:15.919 23:04:06 -- common/autotest_common.sh@1077 -- # '[' 3 -le 1 ']' 00:26:15.919 23:04:06 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:26:15.919 23:04:06 -- common/autotest_common.sh@10 -- # set +x 00:26:15.919 ************************************ 00:26:15.919 START TEST nvmf_target_disconnect 00:26:15.919 ************************************ 00:26:15.919 23:04:06 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/target_disconnect.sh --transport=tcp 00:26:15.919 * Looking for test storage... 00:26:15.919 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host 00:26:15.919 23:04:06 -- host/target_disconnect.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:26:15.919 23:04:06 -- nvmf/common.sh@7 -- # uname -s 00:26:15.919 23:04:06 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:26:15.919 23:04:06 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:26:15.919 23:04:06 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:26:15.919 23:04:06 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:26:15.919 23:04:06 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:26:15.919 23:04:06 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:26:15.919 23:04:06 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:26:15.919 23:04:06 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:26:15.919 23:04:06 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:26:15.919 23:04:06 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:26:15.919 23:04:06 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:26:15.919 23:04:06 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:26:15.919 23:04:06 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:26:15.919 23:04:06 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:26:15.919 23:04:06 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:26:15.919 23:04:06 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:26:15.919 23:04:06 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:26:15.919 23:04:06 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:26:15.919 23:04:06 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:26:15.919 23:04:06 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:26:15.919 23:04:06 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:26:15.919 23:04:06 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:26:15.919 23:04:06 -- paths/export.sh@5 -- # export PATH 00:26:15.919 23:04:06 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:26:15.919 23:04:06 -- nvmf/common.sh@46 -- # : 0 00:26:15.919 23:04:06 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:26:15.919 23:04:06 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:26:15.919 23:04:06 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:26:15.919 23:04:06 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:26:15.919 23:04:06 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:26:15.919 23:04:06 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:26:15.919 23:04:06 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:26:15.919 23:04:06 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:26:15.919 23:04:06 -- host/target_disconnect.sh@11 -- # PLUGIN_DIR=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/app/fio/nvme 00:26:15.919 23:04:06 -- host/target_disconnect.sh@13 -- # MALLOC_BDEV_SIZE=64 00:26:15.919 23:04:06 -- host/target_disconnect.sh@14 -- # MALLOC_BLOCK_SIZE=512 00:26:15.919 23:04:06 -- host/target_disconnect.sh@77 -- # nvmftestinit 00:26:15.919 23:04:06 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:26:15.919 23:04:06 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:26:15.919 23:04:06 -- nvmf/common.sh@436 -- # prepare_net_devs 00:26:15.919 23:04:06 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:26:15.919 23:04:06 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:26:15.919 23:04:06 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:26:15.919 23:04:06 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:26:15.919 23:04:06 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:26:15.919 23:04:06 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:26:15.919 23:04:06 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:26:15.919 23:04:06 -- nvmf/common.sh@284 -- # xtrace_disable 00:26:15.919 23:04:06 -- common/autotest_common.sh@10 -- # set +x 00:26:17.827 23:04:08 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:26:17.827 23:04:08 -- nvmf/common.sh@290 -- # pci_devs=() 00:26:17.827 23:04:08 -- nvmf/common.sh@290 -- # local -a pci_devs 00:26:17.827 23:04:08 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:26:17.827 23:04:08 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:26:17.827 23:04:08 -- nvmf/common.sh@292 -- # pci_drivers=() 00:26:17.827 23:04:08 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:26:17.827 23:04:08 -- nvmf/common.sh@294 -- # net_devs=() 00:26:17.827 23:04:08 -- nvmf/common.sh@294 -- # local -ga net_devs 00:26:17.827 23:04:08 -- nvmf/common.sh@295 -- # e810=() 00:26:17.827 23:04:08 -- nvmf/common.sh@295 -- # local -ga e810 00:26:17.827 23:04:08 -- nvmf/common.sh@296 -- # x722=() 00:26:17.827 23:04:08 -- nvmf/common.sh@296 -- # local -ga x722 00:26:17.827 23:04:08 -- nvmf/common.sh@297 -- # mlx=() 00:26:17.827 23:04:08 -- nvmf/common.sh@297 -- # local -ga mlx 00:26:17.827 23:04:08 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:26:17.827 23:04:08 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:26:17.827 23:04:08 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:26:17.827 23:04:08 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:26:17.827 23:04:08 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:26:17.827 23:04:08 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:26:17.827 23:04:08 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:26:17.827 23:04:08 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:26:17.827 23:04:08 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:26:17.827 23:04:08 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:26:17.827 23:04:08 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:26:17.827 23:04:08 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:26:17.827 23:04:08 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:26:17.827 23:04:08 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:26:17.827 23:04:08 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:26:17.827 23:04:08 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:26:17.827 23:04:08 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:26:17.827 23:04:08 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:26:17.827 23:04:08 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:26:17.827 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:26:17.827 23:04:08 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:26:17.827 23:04:08 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:26:17.827 23:04:08 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:26:17.827 23:04:08 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:26:17.827 23:04:08 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:26:17.827 23:04:08 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:26:17.827 23:04:08 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:26:17.827 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:26:17.827 23:04:08 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:26:17.827 23:04:08 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:26:17.827 23:04:08 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:26:17.827 23:04:08 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:26:17.827 23:04:08 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:26:17.827 23:04:08 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:26:17.827 23:04:08 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:26:17.827 23:04:08 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:26:17.827 23:04:08 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:26:17.827 23:04:08 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:26:17.827 23:04:08 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:26:17.827 23:04:08 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:26:17.827 23:04:08 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:26:17.827 Found net devices under 0000:0a:00.0: cvl_0_0 00:26:17.827 23:04:08 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:26:17.827 23:04:08 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:26:17.827 23:04:08 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:26:17.827 23:04:08 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:26:17.827 23:04:08 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:26:17.827 23:04:08 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:26:17.827 Found net devices under 0000:0a:00.1: cvl_0_1 00:26:17.827 23:04:08 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:26:17.827 23:04:08 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:26:17.827 23:04:08 -- nvmf/common.sh@402 -- # is_hw=yes 00:26:17.827 23:04:08 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:26:17.827 23:04:08 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:26:17.827 23:04:08 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:26:17.827 23:04:08 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:26:17.827 23:04:08 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:26:17.827 23:04:08 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:26:17.827 23:04:08 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:26:17.827 23:04:08 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:26:17.827 23:04:08 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:26:17.827 23:04:08 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:26:17.827 23:04:08 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:26:17.827 23:04:08 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:26:17.827 23:04:08 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:26:17.827 23:04:08 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:26:17.827 23:04:08 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:26:17.827 23:04:08 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:26:17.827 23:04:08 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:26:17.827 23:04:08 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:26:17.827 23:04:08 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:26:17.827 23:04:08 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:26:17.827 23:04:08 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:26:17.827 23:04:08 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:26:17.827 23:04:08 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:26:17.827 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:26:17.827 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.117 ms 00:26:17.827 00:26:17.827 --- 10.0.0.2 ping statistics --- 00:26:17.827 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:26:17.827 rtt min/avg/max/mdev = 0.117/0.117/0.117/0.000 ms 00:26:17.827 23:04:08 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:26:17.827 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:26:17.827 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.089 ms 00:26:17.827 00:26:17.827 --- 10.0.0.1 ping statistics --- 00:26:17.827 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:26:17.827 rtt min/avg/max/mdev = 0.089/0.089/0.089/0.000 ms 00:26:17.827 23:04:08 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:26:17.827 23:04:08 -- nvmf/common.sh@410 -- # return 0 00:26:17.827 23:04:08 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:26:17.827 23:04:08 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:26:17.827 23:04:08 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:26:17.827 23:04:08 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:26:17.827 23:04:08 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:26:17.827 23:04:08 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:26:17.827 23:04:08 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:26:17.827 23:04:08 -- host/target_disconnect.sh@78 -- # run_test nvmf_target_disconnect_tc1 nvmf_target_disconnect_tc1 00:26:17.827 23:04:08 -- common/autotest_common.sh@1077 -- # '[' 2 -le 1 ']' 00:26:17.827 23:04:08 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:26:17.827 23:04:08 -- common/autotest_common.sh@10 -- # set +x 00:26:17.827 ************************************ 00:26:17.827 START TEST nvmf_target_disconnect_tc1 00:26:17.827 ************************************ 00:26:17.827 23:04:08 -- common/autotest_common.sh@1104 -- # nvmf_target_disconnect_tc1 00:26:17.827 23:04:08 -- host/target_disconnect.sh@32 -- # set +e 00:26:17.827 23:04:08 -- host/target_disconnect.sh@33 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/reconnect -q 32 -o 4096 -w randrw -M 50 -t 10 -c 0xF -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' 00:26:17.827 EAL: No free 2048 kB hugepages reported on node 1 00:26:17.827 [2024-04-16 23:04:08.807022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:17.827 [2024-04-16 23:04:08.807219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:17.827 [2024-04-16 23:04:08.807250] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xacd920 with addr=10.0.0.2, port=4420 00:26:17.827 [2024-04-16 23:04:08.807287] nvme_tcp.c:2596:nvme_tcp_ctrlr_construct: *ERROR*: failed to create admin qpair 00:26:17.827 [2024-04-16 23:04:08.807307] nvme.c: 821:nvme_probe_internal: *ERROR*: NVMe ctrlr scan failed 00:26:17.827 [2024-04-16 23:04:08.807321] nvme.c: 898:spdk_nvme_probe: *ERROR*: Create probe context failed 00:26:17.827 spdk_nvme_probe() failed for transport address '10.0.0.2' 00:26:17.827 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/reconnect: errors occurred 00:26:17.827 Initializing NVMe Controllers 00:26:17.827 23:04:08 -- host/target_disconnect.sh@33 -- # trap - ERR 00:26:17.827 23:04:08 -- host/target_disconnect.sh@33 -- # print_backtrace 00:26:17.827 23:04:08 -- common/autotest_common.sh@1132 -- # [[ hxBET =~ e ]] 00:26:17.827 23:04:08 -- common/autotest_common.sh@1132 -- # return 0 00:26:17.827 23:04:08 -- host/target_disconnect.sh@37 -- # '[' 1 '!=' 1 ']' 00:26:17.827 23:04:08 -- host/target_disconnect.sh@41 -- # set -e 00:26:17.827 00:26:17.827 real 0m0.089s 00:26:17.827 user 0m0.037s 00:26:17.827 sys 0m0.052s 00:26:17.828 23:04:08 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:26:17.828 23:04:08 -- common/autotest_common.sh@10 -- # set +x 00:26:17.828 ************************************ 00:26:17.828 END TEST nvmf_target_disconnect_tc1 00:26:17.828 ************************************ 00:26:17.828 23:04:08 -- host/target_disconnect.sh@79 -- # run_test nvmf_target_disconnect_tc2 nvmf_target_disconnect_tc2 00:26:17.828 23:04:08 -- common/autotest_common.sh@1077 -- # '[' 2 -le 1 ']' 00:26:17.828 23:04:08 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:26:17.828 23:04:08 -- common/autotest_common.sh@10 -- # set +x 00:26:17.828 ************************************ 00:26:17.828 START TEST nvmf_target_disconnect_tc2 00:26:17.828 ************************************ 00:26:17.828 23:04:08 -- common/autotest_common.sh@1104 -- # nvmf_target_disconnect_tc2 00:26:17.828 23:04:08 -- host/target_disconnect.sh@45 -- # disconnect_init 10.0.0.2 00:26:17.828 23:04:08 -- host/target_disconnect.sh@17 -- # nvmfappstart -m 0xF0 00:26:17.828 23:04:08 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:26:17.828 23:04:08 -- common/autotest_common.sh@712 -- # xtrace_disable 00:26:17.828 23:04:08 -- common/autotest_common.sh@10 -- # set +x 00:26:17.828 23:04:08 -- nvmf/common.sh@469 -- # nvmfpid=391847 00:26:17.828 23:04:08 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF0 00:26:17.828 23:04:08 -- nvmf/common.sh@470 -- # waitforlisten 391847 00:26:17.828 23:04:08 -- common/autotest_common.sh@819 -- # '[' -z 391847 ']' 00:26:17.828 23:04:08 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk.sock 00:26:17.828 23:04:08 -- common/autotest_common.sh@824 -- # local max_retries=100 00:26:17.828 23:04:08 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:26:17.828 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:26:17.828 23:04:08 -- common/autotest_common.sh@828 -- # xtrace_disable 00:26:17.828 23:04:08 -- common/autotest_common.sh@10 -- # set +x 00:26:17.828 [2024-04-16 23:04:08.885446] Starting SPDK v24.01.1-pre git sha1 4b134b4ab / DPDK 23.11.0 initialization... 00:26:17.828 [2024-04-16 23:04:08.885550] [ DPDK EAL parameters: nvmf -c 0xF0 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:26:17.828 EAL: No free 2048 kB hugepages reported on node 1 00:26:17.828 [2024-04-16 23:04:08.949021] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:26:18.088 [2024-04-16 23:04:09.058819] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:26:18.088 [2024-04-16 23:04:09.058971] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:26:18.088 [2024-04-16 23:04:09.058989] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:26:18.088 [2024-04-16 23:04:09.059002] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:26:18.088 [2024-04-16 23:04:09.059172] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 5 00:26:18.088 [2024-04-16 23:04:09.059245] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 6 00:26:18.088 [2024-04-16 23:04:09.059306] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 7 00:26:18.088 [2024-04-16 23:04:09.059309] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 4 00:26:19.047 23:04:09 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:26:19.047 23:04:09 -- common/autotest_common.sh@852 -- # return 0 00:26:19.047 23:04:09 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:26:19.047 23:04:09 -- common/autotest_common.sh@718 -- # xtrace_disable 00:26:19.047 23:04:09 -- common/autotest_common.sh@10 -- # set +x 00:26:19.047 23:04:09 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:26:19.047 23:04:09 -- host/target_disconnect.sh@19 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc0 00:26:19.047 23:04:09 -- common/autotest_common.sh@551 -- # xtrace_disable 00:26:19.047 23:04:09 -- common/autotest_common.sh@10 -- # set +x 00:26:19.047 Malloc0 00:26:19.047 23:04:09 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:26:19.047 23:04:09 -- host/target_disconnect.sh@21 -- # rpc_cmd nvmf_create_transport -t tcp -o 00:26:19.047 23:04:09 -- common/autotest_common.sh@551 -- # xtrace_disable 00:26:19.047 23:04:09 -- common/autotest_common.sh@10 -- # set +x 00:26:19.047 [2024-04-16 23:04:09.916502] tcp.c: 659:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:26:19.047 23:04:09 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:26:19.047 23:04:09 -- host/target_disconnect.sh@22 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:26:19.047 23:04:09 -- common/autotest_common.sh@551 -- # xtrace_disable 00:26:19.047 23:04:09 -- common/autotest_common.sh@10 -- # set +x 00:26:19.047 23:04:09 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:26:19.047 23:04:09 -- host/target_disconnect.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:26:19.047 23:04:09 -- common/autotest_common.sh@551 -- # xtrace_disable 00:26:19.047 23:04:09 -- common/autotest_common.sh@10 -- # set +x 00:26:19.047 23:04:09 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:26:19.047 23:04:09 -- host/target_disconnect.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:26:19.047 23:04:09 -- common/autotest_common.sh@551 -- # xtrace_disable 00:26:19.047 23:04:09 -- common/autotest_common.sh@10 -- # set +x 00:26:19.047 [2024-04-16 23:04:09.944772] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:26:19.047 23:04:09 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:26:19.047 23:04:09 -- host/target_disconnect.sh@26 -- # rpc_cmd nvmf_subsystem_add_listener discovery -t tcp -a 10.0.0.2 -s 4420 00:26:19.047 23:04:09 -- common/autotest_common.sh@551 -- # xtrace_disable 00:26:19.047 23:04:09 -- common/autotest_common.sh@10 -- # set +x 00:26:19.047 23:04:09 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:26:19.047 23:04:09 -- host/target_disconnect.sh@50 -- # reconnectpid=392009 00:26:19.047 23:04:09 -- host/target_disconnect.sh@52 -- # sleep 2 00:26:19.047 23:04:09 -- host/target_disconnect.sh@48 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/reconnect -q 32 -o 4096 -w randrw -M 50 -t 10 -c 0xF -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' 00:26:19.047 EAL: No free 2048 kB hugepages reported on node 1 00:26:20.962 23:04:11 -- host/target_disconnect.sh@53 -- # kill -9 391847 00:26:20.962 23:04:11 -- host/target_disconnect.sh@55 -- # sleep 2 00:26:20.962 Read completed with error (sct=0, sc=8) 00:26:20.962 starting I/O failed 00:26:20.962 Read completed with error (sct=0, sc=8) 00:26:20.962 starting I/O failed 00:26:20.962 Read completed with error (sct=0, sc=8) 00:26:20.962 starting I/O failed 00:26:20.962 Read completed with error (sct=0, sc=8) 00:26:20.962 starting I/O failed 00:26:20.962 Read completed with error (sct=0, sc=8) 00:26:20.962 starting I/O failed 00:26:20.962 Read completed with error (sct=0, sc=8) 00:26:20.962 starting I/O failed 00:26:20.962 Read completed with error (sct=0, sc=8) 00:26:20.962 starting I/O failed 00:26:20.962 Read completed with error (sct=0, sc=8) 00:26:20.962 starting I/O failed 00:26:20.962 Read completed with error (sct=0, sc=8) 00:26:20.962 starting I/O failed 00:26:20.962 Read completed with error (sct=0, sc=8) 00:26:20.962 starting I/O failed 00:26:20.962 Write completed with error (sct=0, sc=8) 00:26:20.962 starting I/O failed 00:26:20.962 Write completed with error (sct=0, sc=8) 00:26:20.962 starting I/O failed 00:26:20.962 Write completed with error (sct=0, sc=8) 00:26:20.962 starting I/O failed 00:26:20.962 Read completed with error (sct=0, sc=8) 00:26:20.962 starting I/O failed 00:26:20.962 Write completed with error (sct=0, sc=8) 00:26:20.962 starting I/O failed 00:26:20.962 Read completed with error (sct=0, sc=8) 00:26:20.962 starting I/O failed 00:26:20.962 Write completed with error (sct=0, sc=8) 00:26:20.962 starting I/O failed 00:26:20.962 Read completed with error (sct=0, sc=8) 00:26:20.962 starting I/O failed 00:26:20.962 Read completed with error (sct=0, sc=8) 00:26:20.962 starting I/O failed 00:26:20.962 Read completed with error (sct=0, sc=8) 00:26:20.962 starting I/O failed 00:26:20.962 Read completed with error (sct=0, sc=8) 00:26:20.962 starting I/O failed 00:26:20.962 Read completed with error (sct=0, sc=8) 00:26:20.962 starting I/O failed 00:26:20.962 Read completed with error (sct=0, sc=8) 00:26:20.962 starting I/O failed 00:26:20.962 Read completed with error (sct=0, sc=8) 00:26:20.962 starting I/O failed 00:26:20.962 Write completed with error (sct=0, sc=8) 00:26:20.962 starting I/O failed 00:26:20.962 Read completed with error (sct=0, sc=8) 00:26:20.962 starting I/O failed 00:26:20.962 Read completed with error (sct=0, sc=8) 00:26:20.962 starting I/O failed 00:26:20.962 Read completed with error (sct=0, sc=8) 00:26:20.962 starting I/O failed 00:26:20.962 Read completed with error (sct=0, sc=8) 00:26:20.962 starting I/O failed 00:26:20.962 Write completed with error (sct=0, sc=8) 00:26:20.962 starting I/O failed 00:26:20.962 Write completed with error (sct=0, sc=8) 00:26:20.962 starting I/O failed 00:26:20.962 Read completed with error (sct=0, sc=8) 00:26:20.962 starting I/O failed 00:26:20.962 Read completed with error (sct=0, sc=8) 00:26:20.962 starting I/O failed 00:26:20.962 Read completed with error (sct=0, sc=8) 00:26:20.962 starting I/O failed 00:26:20.962 Read completed with error (sct=0, sc=8) 00:26:20.962 starting I/O failed 00:26:20.962 Read completed with error (sct=0, sc=8) 00:26:20.962 starting I/O failed 00:26:20.962 [2024-04-16 23:04:11.968443] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:26:20.962 Read completed with error (sct=0, sc=8) 00:26:20.962 starting I/O failed 00:26:20.962 Read completed with error (sct=0, sc=8) 00:26:20.962 starting I/O failed 00:26:20.962 Read completed with error (sct=0, sc=8) 00:26:20.962 starting I/O failed 00:26:20.962 Read completed with error (sct=0, sc=8) 00:26:20.962 starting I/O failed 00:26:20.962 Read completed with error (sct=0, sc=8) 00:26:20.962 starting I/O failed 00:26:20.962 Read completed with error (sct=0, sc=8) 00:26:20.962 starting I/O failed 00:26:20.962 Read completed with error (sct=0, sc=8) 00:26:20.962 starting I/O failed 00:26:20.962 Write completed with error (sct=0, sc=8) 00:26:20.962 starting I/O failed 00:26:20.962 Read completed with error (sct=0, sc=8) 00:26:20.962 starting I/O failed 00:26:20.962 Write completed with error (sct=0, sc=8) 00:26:20.962 starting I/O failed 00:26:20.962 Write completed with error (sct=0, sc=8) 00:26:20.962 starting I/O failed 00:26:20.962 Read completed with error (sct=0, sc=8) 00:26:20.962 starting I/O failed 00:26:20.962 Read completed with error (sct=0, sc=8) 00:26:20.962 starting I/O failed 00:26:20.962 Read completed with error (sct=0, sc=8) 00:26:20.962 starting I/O failed 00:26:20.962 Write completed with error (sct=0, sc=8) 00:26:20.962 starting I/O failed 00:26:20.962 Write completed with error (sct=0, sc=8) 00:26:20.962 starting I/O failed 00:26:20.962 Read completed with error (sct=0, sc=8) 00:26:20.962 starting I/O failed 00:26:20.962 Read completed with error (sct=0, sc=8) 00:26:20.962 starting I/O failed 00:26:20.962 Write completed with error (sct=0, sc=8) 00:26:20.962 starting I/O failed 00:26:20.962 Write completed with error (sct=0, sc=8) 00:26:20.962 starting I/O failed 00:26:20.962 Read completed with error (sct=0, sc=8) 00:26:20.962 starting I/O failed 00:26:20.962 Write completed with error (sct=0, sc=8) 00:26:20.962 starting I/O failed 00:26:20.962 Read completed with error (sct=0, sc=8) 00:26:20.962 starting I/O failed 00:26:20.962 Read completed with error (sct=0, sc=8) 00:26:20.962 starting I/O failed 00:26:20.962 Write completed with error (sct=0, sc=8) 00:26:20.962 starting I/O failed 00:26:20.962 Read completed with error (sct=0, sc=8) 00:26:20.962 starting I/O failed 00:26:20.962 Read completed with error (sct=0, sc=8) 00:26:20.962 starting I/O failed 00:26:20.962 Read completed with error (sct=0, sc=8) 00:26:20.962 starting I/O failed 00:26:20.962 [2024-04-16 23:04:11.968748] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:26:20.962 Read completed with error (sct=0, sc=8) 00:26:20.962 starting I/O failed 00:26:20.962 Read completed with error (sct=0, sc=8) 00:26:20.962 starting I/O failed 00:26:20.962 Read completed with error (sct=0, sc=8) 00:26:20.962 starting I/O failed 00:26:20.962 Read completed with error (sct=0, sc=8) 00:26:20.962 starting I/O failed 00:26:20.962 Read completed with error (sct=0, sc=8) 00:26:20.962 starting I/O failed 00:26:20.962 Read completed with error (sct=0, sc=8) 00:26:20.962 starting I/O failed 00:26:20.962 Read completed with error (sct=0, sc=8) 00:26:20.962 starting I/O failed 00:26:20.962 Read completed with error (sct=0, sc=8) 00:26:20.962 starting I/O failed 00:26:20.962 Read completed with error (sct=0, sc=8) 00:26:20.962 starting I/O failed 00:26:20.962 Read completed with error (sct=0, sc=8) 00:26:20.962 starting I/O failed 00:26:20.962 Read completed with error (sct=0, sc=8) 00:26:20.962 starting I/O failed 00:26:20.962 Write completed with error (sct=0, sc=8) 00:26:20.962 starting I/O failed 00:26:20.962 Write completed with error (sct=0, sc=8) 00:26:20.962 starting I/O failed 00:26:20.962 Read completed with error (sct=0, sc=8) 00:26:20.962 starting I/O failed 00:26:20.962 Read completed with error (sct=0, sc=8) 00:26:20.962 starting I/O failed 00:26:20.962 Read completed with error (sct=0, sc=8) 00:26:20.962 starting I/O failed 00:26:20.962 Write completed with error (sct=0, sc=8) 00:26:20.962 starting I/O failed 00:26:20.962 Read completed with error (sct=0, sc=8) 00:26:20.962 starting I/O failed 00:26:20.962 Read completed with error (sct=0, sc=8) 00:26:20.962 starting I/O failed 00:26:20.962 Read completed with error (sct=0, sc=8) 00:26:20.962 starting I/O failed 00:26:20.962 Read completed with error (sct=0, sc=8) 00:26:20.962 starting I/O failed 00:26:20.962 Read completed with error (sct=0, sc=8) 00:26:20.962 starting I/O failed 00:26:20.962 Read completed with error (sct=0, sc=8) 00:26:20.962 starting I/O failed 00:26:20.962 Write completed with error (sct=0, sc=8) 00:26:20.962 starting I/O failed 00:26:20.962 Write completed with error (sct=0, sc=8) 00:26:20.962 starting I/O failed 00:26:20.962 Write completed with error (sct=0, sc=8) 00:26:20.962 starting I/O failed 00:26:20.962 Write completed with error (sct=0, sc=8) 00:26:20.962 starting I/O failed 00:26:20.962 Read completed with error (sct=0, sc=8) 00:26:20.962 starting I/O failed 00:26:20.962 Read completed with error (sct=0, sc=8) 00:26:20.962 starting I/O failed 00:26:20.962 Read completed with error (sct=0, sc=8) 00:26:20.962 starting I/O failed 00:26:20.962 Write completed with error (sct=0, sc=8) 00:26:20.962 starting I/O failed 00:26:20.962 Read completed with error (sct=0, sc=8) 00:26:20.962 starting I/O failed 00:26:20.962 [2024-04-16 23:04:11.969054] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:26:20.962 Read completed with error (sct=0, sc=8) 00:26:20.963 starting I/O failed 00:26:20.963 Read completed with error (sct=0, sc=8) 00:26:20.963 starting I/O failed 00:26:20.963 Read completed with error (sct=0, sc=8) 00:26:20.963 starting I/O failed 00:26:20.963 Read completed with error (sct=0, sc=8) 00:26:20.963 starting I/O failed 00:26:20.963 Read completed with error (sct=0, sc=8) 00:26:20.963 starting I/O failed 00:26:20.963 Read completed with error (sct=0, sc=8) 00:26:20.963 starting I/O failed 00:26:20.963 Read completed with error (sct=0, sc=8) 00:26:20.963 starting I/O failed 00:26:20.963 Read completed with error (sct=0, sc=8) 00:26:20.963 starting I/O failed 00:26:20.963 Read completed with error (sct=0, sc=8) 00:26:20.963 starting I/O failed 00:26:20.963 Read completed with error (sct=0, sc=8) 00:26:20.963 starting I/O failed 00:26:20.963 Read completed with error (sct=0, sc=8) 00:26:20.963 starting I/O failed 00:26:20.963 Write completed with error (sct=0, sc=8) 00:26:20.963 starting I/O failed 00:26:20.963 Read completed with error (sct=0, sc=8) 00:26:20.963 starting I/O failed 00:26:20.963 Write completed with error (sct=0, sc=8) 00:26:20.963 starting I/O failed 00:26:20.963 Write completed with error (sct=0, sc=8) 00:26:20.963 starting I/O failed 00:26:20.963 Write completed with error (sct=0, sc=8) 00:26:20.963 starting I/O failed 00:26:20.963 Read completed with error (sct=0, sc=8) 00:26:20.963 starting I/O failed 00:26:20.963 Read completed with error (sct=0, sc=8) 00:26:20.963 starting I/O failed 00:26:20.963 Write completed with error (sct=0, sc=8) 00:26:20.963 starting I/O failed 00:26:20.963 Read completed with error (sct=0, sc=8) 00:26:20.963 starting I/O failed 00:26:20.963 Read completed with error (sct=0, sc=8) 00:26:20.963 starting I/O failed 00:26:20.963 Read completed with error (sct=0, sc=8) 00:26:20.963 starting I/O failed 00:26:20.963 Write completed with error (sct=0, sc=8) 00:26:20.963 starting I/O failed 00:26:20.963 Read completed with error (sct=0, sc=8) 00:26:20.963 starting I/O failed 00:26:20.963 Write completed with error (sct=0, sc=8) 00:26:20.963 starting I/O failed 00:26:20.963 Write completed with error (sct=0, sc=8) 00:26:20.963 starting I/O failed 00:26:20.963 Read completed with error (sct=0, sc=8) 00:26:20.963 starting I/O failed 00:26:20.963 Read completed with error (sct=0, sc=8) 00:26:20.963 starting I/O failed 00:26:20.963 Write completed with error (sct=0, sc=8) 00:26:20.963 starting I/O failed 00:26:20.963 Read completed with error (sct=0, sc=8) 00:26:20.963 starting I/O failed 00:26:20.963 Write completed with error (sct=0, sc=8) 00:26:20.963 starting I/O failed 00:26:20.963 Write completed with error (sct=0, sc=8) 00:26:20.963 starting I/O failed 00:26:20.963 [2024-04-16 23:04:11.969377] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:26:20.963 [2024-04-16 23:04:11.969558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:20.963 [2024-04-16 23:04:11.969718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:20.963 [2024-04-16 23:04:11.969764] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:20.963 qpair failed and we were unable to recover it. 00:26:20.963 [2024-04-16 23:04:11.969932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:20.963 [2024-04-16 23:04:11.970069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:20.963 [2024-04-16 23:04:11.970095] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:20.963 qpair failed and we were unable to recover it. 00:26:20.963 [2024-04-16 23:04:11.970255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:20.963 [2024-04-16 23:04:11.970374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:20.963 [2024-04-16 23:04:11.970399] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:20.963 qpair failed and we were unable to recover it. 00:26:20.963 [2024-04-16 23:04:11.970518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:20.963 [2024-04-16 23:04:11.970689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:20.963 [2024-04-16 23:04:11.970714] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:20.963 qpair failed and we were unable to recover it. 00:26:20.963 [2024-04-16 23:04:11.970828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:20.963 [2024-04-16 23:04:11.970970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:20.963 [2024-04-16 23:04:11.970994] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:20.963 qpair failed and we were unable to recover it. 00:26:20.963 [2024-04-16 23:04:11.971108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:20.963 [2024-04-16 23:04:11.971244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:20.963 [2024-04-16 23:04:11.971271] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:20.963 qpair failed and we were unable to recover it. 00:26:20.963 [2024-04-16 23:04:11.971381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:20.963 [2024-04-16 23:04:11.971600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:20.963 [2024-04-16 23:04:11.971634] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:20.963 qpair failed and we were unable to recover it. 00:26:20.963 [2024-04-16 23:04:11.971800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:20.963 [2024-04-16 23:04:11.971943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:20.963 [2024-04-16 23:04:11.971969] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:20.963 qpair failed and we were unable to recover it. 00:26:20.963 [2024-04-16 23:04:11.972112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:20.963 [2024-04-16 23:04:11.972251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:20.963 [2024-04-16 23:04:11.972277] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:20.963 qpair failed and we were unable to recover it. 00:26:20.963 [2024-04-16 23:04:11.972390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:20.963 [2024-04-16 23:04:11.972541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:20.963 [2024-04-16 23:04:11.972566] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:20.963 qpair failed and we were unable to recover it. 00:26:20.963 [2024-04-16 23:04:11.972695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:20.963 [2024-04-16 23:04:11.972849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:20.963 [2024-04-16 23:04:11.972874] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:20.963 qpair failed and we were unable to recover it. 00:26:20.963 [2024-04-16 23:04:11.973009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:20.963 [2024-04-16 23:04:11.973130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:20.963 [2024-04-16 23:04:11.973157] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:20.963 qpair failed and we were unable to recover it. 00:26:20.963 [2024-04-16 23:04:11.973283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:20.963 [2024-04-16 23:04:11.973404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:20.963 [2024-04-16 23:04:11.973430] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:20.963 qpair failed and we were unable to recover it. 00:26:20.963 [2024-04-16 23:04:11.973551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:20.963 [2024-04-16 23:04:11.973683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:20.963 [2024-04-16 23:04:11.973708] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:20.963 qpair failed and we were unable to recover it. 00:26:20.963 [2024-04-16 23:04:11.973877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:20.963 [2024-04-16 23:04:11.974046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:20.963 [2024-04-16 23:04:11.974071] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:20.963 qpair failed and we were unable to recover it. 00:26:20.963 [2024-04-16 23:04:11.974240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:20.963 [2024-04-16 23:04:11.974349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:20.963 [2024-04-16 23:04:11.974375] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:20.963 qpair failed and we were unable to recover it. 00:26:20.963 [2024-04-16 23:04:11.974493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:20.963 [2024-04-16 23:04:11.974609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:20.963 [2024-04-16 23:04:11.974634] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:20.963 qpair failed and we were unable to recover it. 00:26:20.963 [2024-04-16 23:04:11.974872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:20.963 [2024-04-16 23:04:11.974997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:20.963 [2024-04-16 23:04:11.975025] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:20.963 qpair failed and we were unable to recover it. 00:26:20.963 [2024-04-16 23:04:11.975185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:20.964 [2024-04-16 23:04:11.975304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:20.964 [2024-04-16 23:04:11.975330] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:20.964 qpair failed and we were unable to recover it. 00:26:20.964 [2024-04-16 23:04:11.975477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:20.964 [2024-04-16 23:04:11.975691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:20.964 [2024-04-16 23:04:11.975719] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:20.964 qpair failed and we were unable to recover it. 00:26:20.964 [2024-04-16 23:04:11.975913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:20.964 [2024-04-16 23:04:11.976140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:20.964 [2024-04-16 23:04:11.976166] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:20.964 qpair failed and we were unable to recover it. 00:26:20.964 [2024-04-16 23:04:11.976336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:20.964 [2024-04-16 23:04:11.976504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:20.964 [2024-04-16 23:04:11.976529] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:20.964 qpair failed and we were unable to recover it. 00:26:20.964 [2024-04-16 23:04:11.976676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:20.964 [2024-04-16 23:04:11.976833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:20.964 [2024-04-16 23:04:11.976863] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:20.964 qpair failed and we were unable to recover it. 00:26:20.964 [2024-04-16 23:04:11.977046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:20.964 [2024-04-16 23:04:11.977224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:20.964 [2024-04-16 23:04:11.977250] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:20.964 qpair failed and we were unable to recover it. 00:26:20.964 [2024-04-16 23:04:11.977424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:20.964 [2024-04-16 23:04:11.977533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:20.964 [2024-04-16 23:04:11.977558] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:20.964 qpair failed and we were unable to recover it. 00:26:20.964 [2024-04-16 23:04:11.977726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:20.964 [2024-04-16 23:04:11.977864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:20.964 [2024-04-16 23:04:11.977888] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:20.964 qpair failed and we were unable to recover it. 00:26:20.964 [2024-04-16 23:04:11.978036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:20.964 [2024-04-16 23:04:11.978244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:20.964 [2024-04-16 23:04:11.978269] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:20.964 qpair failed and we were unable to recover it. 00:26:20.964 [2024-04-16 23:04:11.978387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:20.964 [2024-04-16 23:04:11.978517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:20.964 [2024-04-16 23:04:11.978542] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:20.964 qpair failed and we were unable to recover it. 00:26:20.964 [2024-04-16 23:04:11.978850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:20.964 [2024-04-16 23:04:11.979018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:20.964 [2024-04-16 23:04:11.979043] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:20.964 qpair failed and we were unable to recover it. 00:26:20.964 [2024-04-16 23:04:11.979182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:20.964 [2024-04-16 23:04:11.979297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:20.964 [2024-04-16 23:04:11.979322] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:20.964 qpair failed and we were unable to recover it. 00:26:20.964 [2024-04-16 23:04:11.979465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:20.964 [2024-04-16 23:04:11.979607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:20.964 [2024-04-16 23:04:11.979633] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:20.964 qpair failed and we were unable to recover it. 00:26:20.964 [2024-04-16 23:04:11.979861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:20.964 [2024-04-16 23:04:11.980027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:20.964 [2024-04-16 23:04:11.980055] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:20.964 qpair failed and we were unable to recover it. 00:26:20.964 [2024-04-16 23:04:11.980270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:20.964 [2024-04-16 23:04:11.980394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:20.964 [2024-04-16 23:04:11.980419] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:20.964 qpair failed and we were unable to recover it. 00:26:20.964 [2024-04-16 23:04:11.980566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:20.964 [2024-04-16 23:04:11.980761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:20.964 [2024-04-16 23:04:11.980788] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:20.964 qpair failed and we were unable to recover it. 00:26:20.964 [2024-04-16 23:04:11.980914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:20.964 [2024-04-16 23:04:11.981147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:20.964 [2024-04-16 23:04:11.981190] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:20.964 qpair failed and we were unable to recover it. 00:26:20.964 [2024-04-16 23:04:11.981368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:20.964 [2024-04-16 23:04:11.981503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:20.964 [2024-04-16 23:04:11.981529] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:20.964 qpair failed and we were unable to recover it. 00:26:20.964 [2024-04-16 23:04:11.981642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:20.964 [2024-04-16 23:04:11.981778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:20.964 [2024-04-16 23:04:11.981805] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:20.964 qpair failed and we were unable to recover it. 00:26:20.964 [2024-04-16 23:04:11.981934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:20.964 [2024-04-16 23:04:11.982048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:20.964 [2024-04-16 23:04:11.982073] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:20.964 qpair failed and we were unable to recover it. 00:26:20.964 [2024-04-16 23:04:11.982217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:20.964 [2024-04-16 23:04:11.982389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:20.964 [2024-04-16 23:04:11.982414] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:20.964 qpair failed and we were unable to recover it. 00:26:20.964 [2024-04-16 23:04:11.982525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:20.964 [2024-04-16 23:04:11.982664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:20.964 [2024-04-16 23:04:11.982692] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:20.964 qpair failed and we were unable to recover it. 00:26:20.964 [2024-04-16 23:04:11.982861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:20.964 [2024-04-16 23:04:11.983081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:20.964 [2024-04-16 23:04:11.983124] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:20.964 qpair failed and we were unable to recover it. 00:26:20.964 [2024-04-16 23:04:11.983299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:20.964 [2024-04-16 23:04:11.983444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:20.964 [2024-04-16 23:04:11.983469] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:20.964 qpair failed and we were unable to recover it. 00:26:20.964 [2024-04-16 23:04:11.983612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:20.964 [2024-04-16 23:04:11.983780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:20.964 [2024-04-16 23:04:11.983804] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:20.964 qpair failed and we were unable to recover it. 00:26:20.964 [2024-04-16 23:04:11.983916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:20.964 [2024-04-16 23:04:11.984058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:20.964 [2024-04-16 23:04:11.984083] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:20.964 qpair failed and we were unable to recover it. 00:26:20.964 [2024-04-16 23:04:11.984207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:20.964 [2024-04-16 23:04:11.984380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:20.964 [2024-04-16 23:04:11.984405] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:20.964 qpair failed and we were unable to recover it. 00:26:20.964 [2024-04-16 23:04:11.984521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:20.964 [2024-04-16 23:04:11.984637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:20.964 [2024-04-16 23:04:11.984662] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:20.965 qpair failed and we were unable to recover it. 00:26:20.965 [2024-04-16 23:04:11.984778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:20.965 [2024-04-16 23:04:11.984896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:20.965 [2024-04-16 23:04:11.984922] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:20.965 qpair failed and we were unable to recover it. 00:26:20.965 [2024-04-16 23:04:11.985039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:20.965 [2024-04-16 23:04:11.985158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:20.965 [2024-04-16 23:04:11.985190] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:20.965 qpair failed and we were unable to recover it. 00:26:20.965 [2024-04-16 23:04:11.985374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:20.965 [2024-04-16 23:04:11.985517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:20.965 [2024-04-16 23:04:11.985542] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:20.965 qpair failed and we were unable to recover it. 00:26:20.965 [2024-04-16 23:04:11.985750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:20.965 [2024-04-16 23:04:11.985863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:20.965 [2024-04-16 23:04:11.985890] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:20.965 qpair failed and we were unable to recover it. 00:26:20.965 [2024-04-16 23:04:11.986078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:20.965 [2024-04-16 23:04:11.986249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:20.965 [2024-04-16 23:04:11.986275] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:20.965 qpair failed and we were unable to recover it. 00:26:20.965 [2024-04-16 23:04:11.986420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:20.965 [2024-04-16 23:04:11.986590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:20.965 [2024-04-16 23:04:11.986616] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:20.965 qpair failed and we were unable to recover it. 00:26:20.965 [2024-04-16 23:04:11.986782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:20.965 [2024-04-16 23:04:11.986928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:20.965 [2024-04-16 23:04:11.986953] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:20.965 qpair failed and we were unable to recover it. 00:26:20.965 [2024-04-16 23:04:11.987069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:20.965 [2024-04-16 23:04:11.987183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:20.965 [2024-04-16 23:04:11.987208] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:20.965 qpair failed and we were unable to recover it. 00:26:20.965 [2024-04-16 23:04:11.987323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:20.965 [2024-04-16 23:04:11.987440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:20.965 [2024-04-16 23:04:11.987465] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:20.965 qpair failed and we were unable to recover it. 00:26:20.965 [2024-04-16 23:04:11.987605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:20.965 [2024-04-16 23:04:11.987787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:20.965 [2024-04-16 23:04:11.987811] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:20.965 qpair failed and we were unable to recover it. 00:26:20.965 [2024-04-16 23:04:11.987995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:20.965 [2024-04-16 23:04:11.988109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:20.965 [2024-04-16 23:04:11.988134] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:20.965 qpair failed and we were unable to recover it. 00:26:20.965 [2024-04-16 23:04:11.988282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:20.965 [2024-04-16 23:04:11.988427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:20.965 [2024-04-16 23:04:11.988452] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:20.965 qpair failed and we were unable to recover it. 00:26:20.965 [2024-04-16 23:04:11.988663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:20.965 [2024-04-16 23:04:11.988834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:20.965 [2024-04-16 23:04:11.988859] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:20.965 qpair failed and we were unable to recover it. 00:26:20.965 [2024-04-16 23:04:11.988972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:20.965 [2024-04-16 23:04:11.989113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:20.965 [2024-04-16 23:04:11.989138] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:20.965 qpair failed and we were unable to recover it. 00:26:20.965 [2024-04-16 23:04:11.989281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:20.965 [2024-04-16 23:04:11.989429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:20.965 [2024-04-16 23:04:11.989454] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:20.965 qpair failed and we were unable to recover it. 00:26:20.965 [2024-04-16 23:04:11.989684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:20.965 [2024-04-16 23:04:11.989838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:20.965 [2024-04-16 23:04:11.989865] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:20.965 qpair failed and we were unable to recover it. 00:26:20.965 [2024-04-16 23:04:11.990100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:20.965 [2024-04-16 23:04:11.990215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:20.965 [2024-04-16 23:04:11.990240] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:20.965 qpair failed and we were unable to recover it. 00:26:20.965 [2024-04-16 23:04:11.990382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:20.965 [2024-04-16 23:04:11.990524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:20.965 [2024-04-16 23:04:11.990549] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:20.965 qpair failed and we were unable to recover it. 00:26:20.965 [2024-04-16 23:04:11.990732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:20.965 [2024-04-16 23:04:11.990852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:20.965 [2024-04-16 23:04:11.990879] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:20.965 qpair failed and we were unable to recover it. 00:26:20.965 [2024-04-16 23:04:11.991108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:20.965 [2024-04-16 23:04:11.991224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:20.965 [2024-04-16 23:04:11.991250] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:20.965 qpair failed and we were unable to recover it. 00:26:20.965 [2024-04-16 23:04:11.991421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:20.965 [2024-04-16 23:04:11.991646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:20.965 [2024-04-16 23:04:11.991674] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:20.965 qpair failed and we were unable to recover it. 00:26:20.965 [2024-04-16 23:04:11.991923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:20.965 [2024-04-16 23:04:11.992120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:20.965 [2024-04-16 23:04:11.992149] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:20.965 qpair failed and we were unable to recover it. 00:26:20.965 [2024-04-16 23:04:11.992271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:20.965 [2024-04-16 23:04:11.992445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:20.965 [2024-04-16 23:04:11.992477] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:20.965 qpair failed and we were unable to recover it. 00:26:20.965 [2024-04-16 23:04:11.992663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:20.965 [2024-04-16 23:04:11.992814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:20.965 [2024-04-16 23:04:11.992841] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:20.965 qpair failed and we were unable to recover it. 00:26:20.965 [2024-04-16 23:04:11.992958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:20.965 [2024-04-16 23:04:11.993186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:20.965 [2024-04-16 23:04:11.993211] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:20.965 qpair failed and we were unable to recover it. 00:26:20.965 [2024-04-16 23:04:11.993334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:20.965 [2024-04-16 23:04:11.993507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:20.965 [2024-04-16 23:04:11.993532] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:20.965 qpair failed and we were unable to recover it. 00:26:20.965 [2024-04-16 23:04:11.993672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:20.965 [2024-04-16 23:04:11.993875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:20.965 [2024-04-16 23:04:11.993899] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:20.965 qpair failed and we were unable to recover it. 00:26:20.965 [2024-04-16 23:04:11.994079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:20.966 [2024-04-16 23:04:11.994224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:20.966 [2024-04-16 23:04:11.994250] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:20.966 qpair failed and we were unable to recover it. 00:26:20.966 [2024-04-16 23:04:11.994396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:20.966 [2024-04-16 23:04:11.994513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:20.966 [2024-04-16 23:04:11.994538] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:20.966 qpair failed and we were unable to recover it. 00:26:20.966 [2024-04-16 23:04:11.994694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:20.966 [2024-04-16 23:04:11.994882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:20.966 [2024-04-16 23:04:11.994907] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:20.966 qpair failed and we were unable to recover it. 00:26:20.966 [2024-04-16 23:04:11.995014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:20.966 [2024-04-16 23:04:11.995129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:20.966 [2024-04-16 23:04:11.995153] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:20.966 qpair failed and we were unable to recover it. 00:26:20.966 [2024-04-16 23:04:11.995289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:20.966 [2024-04-16 23:04:11.995445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:20.966 [2024-04-16 23:04:11.995479] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:20.966 qpair failed and we were unable to recover it. 00:26:20.966 [2024-04-16 23:04:11.995651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:20.966 [2024-04-16 23:04:11.995794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:20.966 [2024-04-16 23:04:11.995820] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:20.966 qpair failed and we were unable to recover it. 00:26:20.966 [2024-04-16 23:04:11.995945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:20.966 [2024-04-16 23:04:11.996112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:20.966 [2024-04-16 23:04:11.996138] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:20.966 qpair failed and we were unable to recover it. 00:26:20.966 [2024-04-16 23:04:11.996273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:20.966 [2024-04-16 23:04:11.996464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:20.966 [2024-04-16 23:04:11.996489] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:20.966 qpair failed and we were unable to recover it. 00:26:20.966 [2024-04-16 23:04:11.996631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:20.966 [2024-04-16 23:04:11.996795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:20.966 [2024-04-16 23:04:11.996838] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:20.966 qpair failed and we were unable to recover it. 00:26:20.966 [2024-04-16 23:04:11.997006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:20.966 [2024-04-16 23:04:11.997115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:20.966 [2024-04-16 23:04:11.997140] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:20.966 qpair failed and we were unable to recover it. 00:26:20.966 [2024-04-16 23:04:11.997261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:20.966 [2024-04-16 23:04:11.997408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:20.966 [2024-04-16 23:04:11.997451] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:20.966 qpair failed and we were unable to recover it. 00:26:20.966 [2024-04-16 23:04:11.997614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:20.966 [2024-04-16 23:04:11.997788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:20.966 [2024-04-16 23:04:11.997832] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:20.966 qpair failed and we were unable to recover it. 00:26:20.966 [2024-04-16 23:04:11.997953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:20.966 [2024-04-16 23:04:11.998092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:20.966 [2024-04-16 23:04:11.998117] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:20.966 qpair failed and we were unable to recover it. 00:26:20.966 [2024-04-16 23:04:11.998235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:20.966 [2024-04-16 23:04:11.998378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:20.966 [2024-04-16 23:04:11.998404] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:20.966 qpair failed and we were unable to recover it. 00:26:20.966 [2024-04-16 23:04:11.998551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:20.966 [2024-04-16 23:04:11.998695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:20.966 [2024-04-16 23:04:11.998725] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:20.966 qpair failed and we were unable to recover it. 00:26:20.966 [2024-04-16 23:04:11.998871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:20.966 [2024-04-16 23:04:11.999022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:20.966 [2024-04-16 23:04:11.999047] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:20.966 qpair failed and we were unable to recover it. 00:26:20.966 [2024-04-16 23:04:11.999192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:20.966 [2024-04-16 23:04:11.999325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:20.966 [2024-04-16 23:04:11.999367] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:20.966 qpair failed and we were unable to recover it. 00:26:20.966 [2024-04-16 23:04:11.999521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:20.966 [2024-04-16 23:04:11.999691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:20.966 [2024-04-16 23:04:11.999734] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:20.966 qpair failed and we were unable to recover it. 00:26:20.966 [2024-04-16 23:04:11.999900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:20.966 [2024-04-16 23:04:12.000072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:20.966 [2024-04-16 23:04:12.000097] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:20.966 qpair failed and we were unable to recover it. 00:26:20.966 [2024-04-16 23:04:12.000238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:20.966 [2024-04-16 23:04:12.000378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:20.966 [2024-04-16 23:04:12.000403] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:20.966 qpair failed and we were unable to recover it. 00:26:20.966 [2024-04-16 23:04:12.000547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:20.966 [2024-04-16 23:04:12.000721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:20.966 [2024-04-16 23:04:12.000746] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:20.966 qpair failed and we were unable to recover it. 00:26:20.966 [2024-04-16 23:04:12.000859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:20.966 [2024-04-16 23:04:12.001009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:20.966 [2024-04-16 23:04:12.001034] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:20.966 qpair failed and we were unable to recover it. 00:26:20.966 [2024-04-16 23:04:12.001203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:20.966 [2024-04-16 23:04:12.001345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:20.966 [2024-04-16 23:04:12.001371] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:20.966 qpair failed and we were unable to recover it. 00:26:20.966 [2024-04-16 23:04:12.001512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:20.966 [2024-04-16 23:04:12.001638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:20.966 [2024-04-16 23:04:12.001663] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:20.966 qpair failed and we were unable to recover it. 00:26:20.966 [2024-04-16 23:04:12.001772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:20.967 [2024-04-16 23:04:12.001913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:20.967 [2024-04-16 23:04:12.001942] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:20.967 qpair failed and we were unable to recover it. 00:26:20.967 [2024-04-16 23:04:12.002086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:20.967 [2024-04-16 23:04:12.002245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:20.967 [2024-04-16 23:04:12.002289] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:20.967 qpair failed and we were unable to recover it. 00:26:20.967 [2024-04-16 23:04:12.002431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:20.967 [2024-04-16 23:04:12.002565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:20.967 [2024-04-16 23:04:12.002590] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:20.967 qpair failed and we were unable to recover it. 00:26:20.967 [2024-04-16 23:04:12.002730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:20.967 [2024-04-16 23:04:12.002874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:20.967 [2024-04-16 23:04:12.002900] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:20.967 qpair failed and we were unable to recover it. 00:26:20.967 [2024-04-16 23:04:12.003013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:20.967 [2024-04-16 23:04:12.003154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:20.967 [2024-04-16 23:04:12.003185] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:20.967 qpair failed and we were unable to recover it. 00:26:20.967 [2024-04-16 23:04:12.003310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:20.967 [2024-04-16 23:04:12.003453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:20.967 [2024-04-16 23:04:12.003478] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:20.967 qpair failed and we were unable to recover it. 00:26:20.967 [2024-04-16 23:04:12.003647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:20.967 [2024-04-16 23:04:12.003791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:20.967 [2024-04-16 23:04:12.003816] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:20.967 qpair failed and we were unable to recover it. 00:26:20.967 [2024-04-16 23:04:12.003931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:20.967 [2024-04-16 23:04:12.004078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:20.967 [2024-04-16 23:04:12.004105] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:20.967 qpair failed and we were unable to recover it. 00:26:20.967 [2024-04-16 23:04:12.004229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:20.967 [2024-04-16 23:04:12.004374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:20.967 [2024-04-16 23:04:12.004399] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:20.967 qpair failed and we were unable to recover it. 00:26:20.967 [2024-04-16 23:04:12.004571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:20.967 [2024-04-16 23:04:12.004738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:20.967 [2024-04-16 23:04:12.004764] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:20.967 qpair failed and we were unable to recover it. 00:26:20.967 [2024-04-16 23:04:12.004931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:20.967 [2024-04-16 23:04:12.005069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:20.967 [2024-04-16 23:04:12.005094] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:20.967 qpair failed and we were unable to recover it. 00:26:20.967 [2024-04-16 23:04:12.005275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:20.967 [2024-04-16 23:04:12.005413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:20.967 [2024-04-16 23:04:12.005438] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:20.967 qpair failed and we were unable to recover it. 00:26:20.967 [2024-04-16 23:04:12.005565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:20.967 [2024-04-16 23:04:12.005679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:20.967 [2024-04-16 23:04:12.005704] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:20.967 qpair failed and we were unable to recover it. 00:26:20.967 [2024-04-16 23:04:12.005846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:20.967 [2024-04-16 23:04:12.005950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:20.967 [2024-04-16 23:04:12.005975] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:20.967 qpair failed and we were unable to recover it. 00:26:20.967 [2024-04-16 23:04:12.006114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:20.967 [2024-04-16 23:04:12.006257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:20.967 [2024-04-16 23:04:12.006283] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:20.967 qpair failed and we were unable to recover it. 00:26:20.967 [2024-04-16 23:04:12.006425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:20.967 [2024-04-16 23:04:12.006565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:20.967 [2024-04-16 23:04:12.006590] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:20.967 qpair failed and we were unable to recover it. 00:26:20.967 [2024-04-16 23:04:12.006760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:20.967 [2024-04-16 23:04:12.006929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:20.967 [2024-04-16 23:04:12.006954] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:20.967 qpair failed and we were unable to recover it. 00:26:20.967 [2024-04-16 23:04:12.007073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:20.967 [2024-04-16 23:04:12.007189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:20.967 [2024-04-16 23:04:12.007215] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:20.967 qpair failed and we were unable to recover it. 00:26:20.967 [2024-04-16 23:04:12.007357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:20.967 [2024-04-16 23:04:12.007499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:20.967 [2024-04-16 23:04:12.007525] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:20.967 qpair failed and we were unable to recover it. 00:26:20.967 [2024-04-16 23:04:12.007696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:20.967 [2024-04-16 23:04:12.007833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:20.967 [2024-04-16 23:04:12.007859] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:20.967 qpair failed and we were unable to recover it. 00:26:20.967 [2024-04-16 23:04:12.008002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:20.967 [2024-04-16 23:04:12.008186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:20.967 [2024-04-16 23:04:12.008214] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:20.968 qpair failed and we were unable to recover it. 00:26:20.968 [2024-04-16 23:04:12.008362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:20.968 [2024-04-16 23:04:12.008512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:20.968 [2024-04-16 23:04:12.008538] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:20.968 qpair failed and we were unable to recover it. 00:26:20.968 [2024-04-16 23:04:12.008680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:20.968 [2024-04-16 23:04:12.008818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:20.968 [2024-04-16 23:04:12.008844] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:20.968 qpair failed and we were unable to recover it. 00:26:20.968 [2024-04-16 23:04:12.008992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:20.968 [2024-04-16 23:04:12.009125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:20.968 [2024-04-16 23:04:12.009150] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:20.968 qpair failed and we were unable to recover it. 00:26:20.968 [2024-04-16 23:04:12.009299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:20.968 [2024-04-16 23:04:12.009413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:20.968 [2024-04-16 23:04:12.009438] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:20.968 qpair failed and we were unable to recover it. 00:26:20.968 [2024-04-16 23:04:12.009618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:20.968 [2024-04-16 23:04:12.009732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:20.968 [2024-04-16 23:04:12.009757] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:20.968 qpair failed and we were unable to recover it. 00:26:20.968 [2024-04-16 23:04:12.009871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:20.968 [2024-04-16 23:04:12.010011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:20.968 [2024-04-16 23:04:12.010036] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:20.968 qpair failed and we were unable to recover it. 00:26:20.968 [2024-04-16 23:04:12.010173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:20.968 [2024-04-16 23:04:12.010323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:20.968 [2024-04-16 23:04:12.010348] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:20.968 qpair failed and we were unable to recover it. 00:26:20.968 [2024-04-16 23:04:12.010463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:20.968 [2024-04-16 23:04:12.010576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:20.968 [2024-04-16 23:04:12.010601] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:20.968 qpair failed and we were unable to recover it. 00:26:20.968 [2024-04-16 23:04:12.010745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:20.968 [2024-04-16 23:04:12.010886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:20.968 [2024-04-16 23:04:12.010911] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:20.968 qpair failed and we were unable to recover it. 00:26:20.968 [2024-04-16 23:04:12.011052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:20.968 [2024-04-16 23:04:12.011164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:20.968 [2024-04-16 23:04:12.011197] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:20.968 qpair failed and we were unable to recover it. 00:26:20.968 [2024-04-16 23:04:12.011328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:20.968 [2024-04-16 23:04:12.011550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:20.968 [2024-04-16 23:04:12.011575] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:20.968 qpair failed and we were unable to recover it. 00:26:20.968 [2024-04-16 23:04:12.011748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:20.968 [2024-04-16 23:04:12.011868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:20.968 [2024-04-16 23:04:12.011893] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:20.968 qpair failed and we were unable to recover it. 00:26:20.968 [2024-04-16 23:04:12.012064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:20.968 [2024-04-16 23:04:12.012207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:20.968 [2024-04-16 23:04:12.012233] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:20.968 qpair failed and we were unable to recover it. 00:26:20.968 [2024-04-16 23:04:12.012372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:20.968 [2024-04-16 23:04:12.012515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:20.968 [2024-04-16 23:04:12.012541] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:20.968 qpair failed and we were unable to recover it. 00:26:20.968 [2024-04-16 23:04:12.012680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:20.968 [2024-04-16 23:04:12.012826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:20.968 [2024-04-16 23:04:12.012853] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:20.968 qpair failed and we were unable to recover it. 00:26:20.968 [2024-04-16 23:04:12.013030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:20.968 [2024-04-16 23:04:12.013148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:20.968 [2024-04-16 23:04:12.013180] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:20.968 qpair failed and we were unable to recover it. 00:26:20.968 [2024-04-16 23:04:12.013346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:20.968 [2024-04-16 23:04:12.013485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:20.968 [2024-04-16 23:04:12.013526] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:20.968 qpair failed and we were unable to recover it. 00:26:20.968 [2024-04-16 23:04:12.013666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:20.968 [2024-04-16 23:04:12.013816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:20.968 [2024-04-16 23:04:12.013840] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:20.968 qpair failed and we were unable to recover it. 00:26:20.968 [2024-04-16 23:04:12.013986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:20.968 [2024-04-16 23:04:12.014123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:20.968 [2024-04-16 23:04:12.014147] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:20.968 qpair failed and we were unable to recover it. 00:26:20.968 [2024-04-16 23:04:12.014302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:20.968 [2024-04-16 23:04:12.014450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:20.968 [2024-04-16 23:04:12.014490] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:20.968 qpair failed and we were unable to recover it. 00:26:20.968 [2024-04-16 23:04:12.014641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:20.968 [2024-04-16 23:04:12.014810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:20.968 [2024-04-16 23:04:12.014835] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:20.968 qpair failed and we were unable to recover it. 00:26:20.968 [2024-04-16 23:04:12.014977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:20.968 [2024-04-16 23:04:12.015119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:20.968 [2024-04-16 23:04:12.015145] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:20.968 qpair failed and we were unable to recover it. 00:26:20.968 [2024-04-16 23:04:12.015307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:20.968 [2024-04-16 23:04:12.015515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:20.968 [2024-04-16 23:04:12.015557] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:20.968 qpair failed and we were unable to recover it. 00:26:20.968 [2024-04-16 23:04:12.015723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:20.968 [2024-04-16 23:04:12.015916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:20.968 [2024-04-16 23:04:12.015941] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:20.968 qpair failed and we were unable to recover it. 00:26:20.968 [2024-04-16 23:04:12.016080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:20.968 [2024-04-16 23:04:12.016222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:20.968 [2024-04-16 23:04:12.016248] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:20.968 qpair failed and we were unable to recover it. 00:26:20.968 [2024-04-16 23:04:12.016410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:20.968 [2024-04-16 23:04:12.016540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:20.968 [2024-04-16 23:04:12.016565] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:20.969 qpair failed and we were unable to recover it. 00:26:20.969 [2024-04-16 23:04:12.016683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:20.969 [2024-04-16 23:04:12.016818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:20.969 [2024-04-16 23:04:12.016843] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:20.969 qpair failed and we were unable to recover it. 00:26:20.969 [2024-04-16 23:04:12.016978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:20.969 [2024-04-16 23:04:12.017112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:20.969 [2024-04-16 23:04:12.017137] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:20.969 qpair failed and we were unable to recover it. 00:26:20.969 [2024-04-16 23:04:12.017262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:20.969 [2024-04-16 23:04:12.017402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:20.969 [2024-04-16 23:04:12.017427] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:20.969 qpair failed and we were unable to recover it. 00:26:20.969 [2024-04-16 23:04:12.017555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:20.969 [2024-04-16 23:04:12.017696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:20.969 [2024-04-16 23:04:12.017722] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:20.969 qpair failed and we were unable to recover it. 00:26:20.969 [2024-04-16 23:04:12.017845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:20.969 [2024-04-16 23:04:12.017981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:20.969 [2024-04-16 23:04:12.018006] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:20.969 qpair failed and we were unable to recover it. 00:26:20.969 [2024-04-16 23:04:12.018149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:20.969 [2024-04-16 23:04:12.018303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:20.969 [2024-04-16 23:04:12.018330] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:20.969 qpair failed and we were unable to recover it. 00:26:20.969 [2024-04-16 23:04:12.018499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:20.969 [2024-04-16 23:04:12.018630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:20.969 [2024-04-16 23:04:12.018658] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:20.969 qpair failed and we were unable to recover it. 00:26:20.969 [2024-04-16 23:04:12.018833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:20.969 [2024-04-16 23:04:12.018947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:20.969 [2024-04-16 23:04:12.018972] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:20.969 qpair failed and we were unable to recover it. 00:26:20.969 [2024-04-16 23:04:12.019112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:20.969 [2024-04-16 23:04:12.019226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:20.969 [2024-04-16 23:04:12.019252] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:20.969 qpair failed and we were unable to recover it. 00:26:20.969 [2024-04-16 23:04:12.019378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:20.969 [2024-04-16 23:04:12.019519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:20.969 [2024-04-16 23:04:12.019545] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:20.969 qpair failed and we were unable to recover it. 00:26:20.969 [2024-04-16 23:04:12.019727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:20.969 [2024-04-16 23:04:12.019878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:20.969 [2024-04-16 23:04:12.019903] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:20.969 qpair failed and we were unable to recover it. 00:26:20.969 [2024-04-16 23:04:12.020019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:20.969 [2024-04-16 23:04:12.020162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:20.969 [2024-04-16 23:04:12.020196] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:20.969 qpair failed and we were unable to recover it. 00:26:20.969 [2024-04-16 23:04:12.020328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:20.969 [2024-04-16 23:04:12.020457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:20.969 [2024-04-16 23:04:12.020483] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:20.969 qpair failed and we were unable to recover it. 00:26:20.969 [2024-04-16 23:04:12.020623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:20.969 [2024-04-16 23:04:12.020793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:20.969 [2024-04-16 23:04:12.020818] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:20.969 qpair failed and we were unable to recover it. 00:26:20.969 [2024-04-16 23:04:12.020963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:20.969 [2024-04-16 23:04:12.021077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:20.969 [2024-04-16 23:04:12.021102] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:20.969 qpair failed and we were unable to recover it. 00:26:20.969 [2024-04-16 23:04:12.021270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:20.969 [2024-04-16 23:04:12.021426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:20.969 [2024-04-16 23:04:12.021451] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:20.969 qpair failed and we were unable to recover it. 00:26:20.969 [2024-04-16 23:04:12.021569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:20.969 [2024-04-16 23:04:12.021686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:20.969 [2024-04-16 23:04:12.021711] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:20.969 qpair failed and we were unable to recover it. 00:26:20.969 [2024-04-16 23:04:12.021828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:20.969 [2024-04-16 23:04:12.021942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:20.969 [2024-04-16 23:04:12.021968] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:20.969 qpair failed and we were unable to recover it. 00:26:20.969 [2024-04-16 23:04:12.022114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:20.969 [2024-04-16 23:04:12.022235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:20.969 [2024-04-16 23:04:12.022263] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:20.969 qpair failed and we were unable to recover it. 00:26:20.969 [2024-04-16 23:04:12.022406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:20.969 [2024-04-16 23:04:12.022550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:20.969 [2024-04-16 23:04:12.022576] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:20.969 qpair failed and we were unable to recover it. 00:26:20.969 [2024-04-16 23:04:12.022690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:20.969 [2024-04-16 23:04:12.022835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:20.969 [2024-04-16 23:04:12.022861] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:20.969 qpair failed and we were unable to recover it. 00:26:20.969 [2024-04-16 23:04:12.022980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:20.969 [2024-04-16 23:04:12.023120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:20.969 [2024-04-16 23:04:12.023145] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:20.969 qpair failed and we were unable to recover it. 00:26:20.969 [2024-04-16 23:04:12.023331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:20.969 [2024-04-16 23:04:12.023436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:20.969 [2024-04-16 23:04:12.023461] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:20.969 qpair failed and we were unable to recover it. 00:26:20.969 [2024-04-16 23:04:12.023594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:20.969 [2024-04-16 23:04:12.023703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:20.969 [2024-04-16 23:04:12.023728] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:20.969 qpair failed and we were unable to recover it. 00:26:20.969 [2024-04-16 23:04:12.023846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:20.969 [2024-04-16 23:04:12.023999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:20.969 [2024-04-16 23:04:12.024025] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:20.969 qpair failed and we were unable to recover it. 00:26:20.969 [2024-04-16 23:04:12.024137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:20.969 [2024-04-16 23:04:12.024312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:20.969 [2024-04-16 23:04:12.024356] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:20.969 qpair failed and we were unable to recover it. 00:26:20.969 [2024-04-16 23:04:12.024486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:20.969 [2024-04-16 23:04:12.024643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:20.969 [2024-04-16 23:04:12.024670] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:20.969 qpair failed and we were unable to recover it. 00:26:20.969 [2024-04-16 23:04:12.024812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:20.969 [2024-04-16 23:04:12.024976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:20.969 [2024-04-16 23:04:12.025001] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:20.970 qpair failed and we were unable to recover it. 00:26:20.970 [2024-04-16 23:04:12.025145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:20.970 [2024-04-16 23:04:12.025296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:20.970 [2024-04-16 23:04:12.025323] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:20.970 qpair failed and we were unable to recover it. 00:26:20.970 [2024-04-16 23:04:12.025442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:20.970 [2024-04-16 23:04:12.025638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:20.970 [2024-04-16 23:04:12.025682] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:20.970 qpair failed and we were unable to recover it. 00:26:20.970 [2024-04-16 23:04:12.025820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:20.970 [2024-04-16 23:04:12.025932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:20.970 [2024-04-16 23:04:12.025960] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:20.970 qpair failed and we were unable to recover it. 00:26:20.970 [2024-04-16 23:04:12.026105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:20.970 [2024-04-16 23:04:12.026245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:20.970 [2024-04-16 23:04:12.026271] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:20.970 qpair failed and we were unable to recover it. 00:26:20.970 [2024-04-16 23:04:12.026403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:20.970 [2024-04-16 23:04:12.026543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:20.970 [2024-04-16 23:04:12.026570] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:20.970 qpair failed and we were unable to recover it. 00:26:20.970 [2024-04-16 23:04:12.026714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:20.970 [2024-04-16 23:04:12.026859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:20.970 [2024-04-16 23:04:12.026885] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:20.970 qpair failed and we were unable to recover it. 00:26:20.970 [2024-04-16 23:04:12.027005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:20.970 [2024-04-16 23:04:12.027126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:20.970 [2024-04-16 23:04:12.027152] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:20.970 qpair failed and we were unable to recover it. 00:26:20.970 [2024-04-16 23:04:12.027330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:20.970 [2024-04-16 23:04:12.027514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:20.970 [2024-04-16 23:04:12.027558] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:20.970 qpair failed and we were unable to recover it. 00:26:20.970 [2024-04-16 23:04:12.027670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:20.970 [2024-04-16 23:04:12.027842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:20.970 [2024-04-16 23:04:12.027868] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:20.970 qpair failed and we were unable to recover it. 00:26:20.970 [2024-04-16 23:04:12.028019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:20.970 [2024-04-16 23:04:12.028192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:20.970 [2024-04-16 23:04:12.028218] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:20.970 qpair failed and we were unable to recover it. 00:26:20.970 [2024-04-16 23:04:12.028332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:20.970 [2024-04-16 23:04:12.028445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:20.970 [2024-04-16 23:04:12.028470] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:20.970 qpair failed and we were unable to recover it. 00:26:20.970 [2024-04-16 23:04:12.028612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:20.970 [2024-04-16 23:04:12.028736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:20.970 [2024-04-16 23:04:12.028765] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:20.970 qpair failed and we were unable to recover it. 00:26:20.970 [2024-04-16 23:04:12.028896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:20.970 [2024-04-16 23:04:12.029014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:20.970 [2024-04-16 23:04:12.029040] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:20.970 qpair failed and we were unable to recover it. 00:26:20.970 [2024-04-16 23:04:12.029185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:20.970 [2024-04-16 23:04:12.029354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:20.970 [2024-04-16 23:04:12.029397] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:20.970 qpair failed and we were unable to recover it. 00:26:20.970 [2024-04-16 23:04:12.029559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:20.970 [2024-04-16 23:04:12.029691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:20.970 [2024-04-16 23:04:12.029716] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:20.970 qpair failed and we were unable to recover it. 00:26:20.970 [2024-04-16 23:04:12.029859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:20.970 [2024-04-16 23:04:12.029979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:20.970 [2024-04-16 23:04:12.030005] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:20.970 qpair failed and we were unable to recover it. 00:26:20.970 [2024-04-16 23:04:12.030144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:20.970 [2024-04-16 23:04:12.030345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:20.970 [2024-04-16 23:04:12.030388] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:20.970 qpair failed and we were unable to recover it. 00:26:20.970 [2024-04-16 23:04:12.030514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:20.970 [2024-04-16 23:04:12.030694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:20.970 [2024-04-16 23:04:12.030722] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:20.970 qpair failed and we were unable to recover it. 00:26:20.970 [2024-04-16 23:04:12.030846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:20.970 [2024-04-16 23:04:12.030989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:20.970 [2024-04-16 23:04:12.031014] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:20.970 qpair failed and we were unable to recover it. 00:26:20.970 [2024-04-16 23:04:12.031186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:20.970 [2024-04-16 23:04:12.031333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:20.970 [2024-04-16 23:04:12.031358] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:20.970 qpair failed and we were unable to recover it. 00:26:20.970 [2024-04-16 23:04:12.031525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:20.970 [2024-04-16 23:04:12.031666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:20.970 [2024-04-16 23:04:12.031691] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:20.970 qpair failed and we were unable to recover it. 00:26:20.970 [2024-04-16 23:04:12.031879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:20.970 [2024-04-16 23:04:12.032030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:20.970 [2024-04-16 23:04:12.032055] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:20.970 qpair failed and we were unable to recover it. 00:26:20.970 [2024-04-16 23:04:12.032165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:20.970 [2024-04-16 23:04:12.032281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:20.970 [2024-04-16 23:04:12.032308] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:20.970 qpair failed and we were unable to recover it. 00:26:20.970 [2024-04-16 23:04:12.032474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:20.970 [2024-04-16 23:04:12.032656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:20.970 [2024-04-16 23:04:12.032698] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:20.970 qpair failed and we were unable to recover it. 00:26:20.970 [2024-04-16 23:04:12.032859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:20.970 [2024-04-16 23:04:12.033013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:20.970 [2024-04-16 23:04:12.033038] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:20.970 qpair failed and we were unable to recover it. 00:26:20.970 [2024-04-16 23:04:12.033171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:20.970 [2024-04-16 23:04:12.033344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:20.970 [2024-04-16 23:04:12.033387] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:20.970 qpair failed and we were unable to recover it. 00:26:20.970 [2024-04-16 23:04:12.033551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:20.970 [2024-04-16 23:04:12.033742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:20.970 [2024-04-16 23:04:12.033772] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:20.970 qpair failed and we were unable to recover it. 00:26:20.970 [2024-04-16 23:04:12.033923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:20.970 [2024-04-16 23:04:12.034061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:20.971 [2024-04-16 23:04:12.034086] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:20.971 qpair failed and we were unable to recover it. 00:26:20.971 [2024-04-16 23:04:12.034204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:20.971 [2024-04-16 23:04:12.034391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:20.971 [2024-04-16 23:04:12.034435] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:20.971 qpair failed and we were unable to recover it. 00:26:20.971 [2024-04-16 23:04:12.034604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:20.971 [2024-04-16 23:04:12.034767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:20.971 [2024-04-16 23:04:12.034794] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:20.971 qpair failed and we were unable to recover it. 00:26:20.971 [2024-04-16 23:04:12.034923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:20.971 [2024-04-16 23:04:12.035032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:20.971 [2024-04-16 23:04:12.035056] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:20.971 qpair failed and we were unable to recover it. 00:26:20.971 [2024-04-16 23:04:12.035165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:20.971 [2024-04-16 23:04:12.035336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:20.971 [2024-04-16 23:04:12.035381] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:20.971 qpair failed and we were unable to recover it. 00:26:20.971 [2024-04-16 23:04:12.035576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:20.971 [2024-04-16 23:04:12.035798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:20.971 [2024-04-16 23:04:12.035823] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:20.971 qpair failed and we were unable to recover it. 00:26:20.971 [2024-04-16 23:04:12.035962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:20.971 [2024-04-16 23:04:12.036104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:20.971 [2024-04-16 23:04:12.036130] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:20.971 qpair failed and we were unable to recover it. 00:26:20.971 [2024-04-16 23:04:12.036309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:20.971 [2024-04-16 23:04:12.036459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:20.971 [2024-04-16 23:04:12.036501] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:20.971 qpair failed and we were unable to recover it. 00:26:20.971 [2024-04-16 23:04:12.036689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:20.971 [2024-04-16 23:04:12.036876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:20.971 [2024-04-16 23:04:12.036901] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:20.971 qpair failed and we were unable to recover it. 00:26:20.971 [2024-04-16 23:04:12.037070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:20.971 [2024-04-16 23:04:12.037227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:20.971 [2024-04-16 23:04:12.037254] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:20.971 qpair failed and we were unable to recover it. 00:26:20.971 [2024-04-16 23:04:12.037420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:20.971 [2024-04-16 23:04:12.037629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:20.971 [2024-04-16 23:04:12.037657] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:20.971 qpair failed and we were unable to recover it. 00:26:20.971 [2024-04-16 23:04:12.037841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:20.971 [2024-04-16 23:04:12.038004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:20.971 [2024-04-16 23:04:12.038028] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:20.971 qpair failed and we were unable to recover it. 00:26:20.971 [2024-04-16 23:04:12.038190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:20.971 [2024-04-16 23:04:12.038358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:20.971 [2024-04-16 23:04:12.038401] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:20.971 qpair failed and we were unable to recover it. 00:26:20.971 [2024-04-16 23:04:12.038523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:20.971 [2024-04-16 23:04:12.038654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:20.971 [2024-04-16 23:04:12.038679] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:20.971 qpair failed and we were unable to recover it. 00:26:20.971 [2024-04-16 23:04:12.038834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:20.971 [2024-04-16 23:04:12.038991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:20.971 [2024-04-16 23:04:12.039016] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:20.971 qpair failed and we were unable to recover it. 00:26:20.971 [2024-04-16 23:04:12.039199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:20.971 [2024-04-16 23:04:12.039355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:20.971 [2024-04-16 23:04:12.039383] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:20.971 qpair failed and we were unable to recover it. 00:26:20.971 [2024-04-16 23:04:12.039594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:20.971 [2024-04-16 23:04:12.039738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:20.971 [2024-04-16 23:04:12.039781] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:20.971 qpair failed and we were unable to recover it. 00:26:20.971 [2024-04-16 23:04:12.039918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:20.971 [2024-04-16 23:04:12.040055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:20.971 [2024-04-16 23:04:12.040081] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:20.971 qpair failed and we were unable to recover it. 00:26:20.971 [2024-04-16 23:04:12.040249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:20.971 [2024-04-16 23:04:12.040395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:20.971 [2024-04-16 23:04:12.040420] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:20.971 qpair failed and we were unable to recover it. 00:26:20.971 [2024-04-16 23:04:12.040555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:20.971 [2024-04-16 23:04:12.040700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:20.971 [2024-04-16 23:04:12.040726] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:20.971 qpair failed and we were unable to recover it. 00:26:20.971 [2024-04-16 23:04:12.040886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:20.971 [2024-04-16 23:04:12.040996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:20.971 [2024-04-16 23:04:12.041021] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:20.971 qpair failed and we were unable to recover it. 00:26:20.971 [2024-04-16 23:04:12.041186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:20.971 [2024-04-16 23:04:12.041294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:20.971 [2024-04-16 23:04:12.041319] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:20.971 qpair failed and we were unable to recover it. 00:26:20.971 [2024-04-16 23:04:12.041485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:20.971 [2024-04-16 23:04:12.041610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:20.971 [2024-04-16 23:04:12.041654] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:20.971 qpair failed and we were unable to recover it. 00:26:20.971 [2024-04-16 23:04:12.041822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:20.971 [2024-04-16 23:04:12.041953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:20.971 [2024-04-16 23:04:12.041979] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:20.971 qpair failed and we were unable to recover it. 00:26:20.971 [2024-04-16 23:04:12.042096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:20.971 [2024-04-16 23:04:12.042236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:20.971 [2024-04-16 23:04:12.042262] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:20.971 qpair failed and we were unable to recover it. 00:26:20.971 [2024-04-16 23:04:12.042395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:20.971 [2024-04-16 23:04:12.042507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:20.972 [2024-04-16 23:04:12.042534] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:20.972 qpair failed and we were unable to recover it. 00:26:20.972 [2024-04-16 23:04:12.042704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:20.972 [2024-04-16 23:04:12.042839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:20.972 [2024-04-16 23:04:12.042864] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:20.972 qpair failed and we were unable to recover it. 00:26:20.972 [2024-04-16 23:04:12.043030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:20.972 [2024-04-16 23:04:12.043172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:20.972 [2024-04-16 23:04:12.043205] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:20.972 qpair failed and we were unable to recover it. 00:26:20.972 [2024-04-16 23:04:12.043342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:20.972 [2024-04-16 23:04:12.043464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:20.972 [2024-04-16 23:04:12.043489] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:20.972 qpair failed and we were unable to recover it. 00:26:20.972 [2024-04-16 23:04:12.043625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:20.972 [2024-04-16 23:04:12.043738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:20.972 [2024-04-16 23:04:12.043768] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:20.972 qpair failed and we were unable to recover it. 00:26:20.972 [2024-04-16 23:04:12.043906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:20.972 [2024-04-16 23:04:12.044018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:20.972 [2024-04-16 23:04:12.044043] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:20.972 qpair failed and we were unable to recover it. 00:26:20.972 [2024-04-16 23:04:12.044151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:20.972 [2024-04-16 23:04:12.044293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:20.972 [2024-04-16 23:04:12.044319] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:20.972 qpair failed and we were unable to recover it. 00:26:20.972 [2024-04-16 23:04:12.044466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:20.972 [2024-04-16 23:04:12.044576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:20.972 [2024-04-16 23:04:12.044601] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:20.972 qpair failed and we were unable to recover it. 00:26:20.972 [2024-04-16 23:04:12.044772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:20.972 [2024-04-16 23:04:12.044918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:20.972 [2024-04-16 23:04:12.044943] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:20.972 qpair failed and we were unable to recover it. 00:26:20.972 [2024-04-16 23:04:12.045080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:20.972 [2024-04-16 23:04:12.045220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:20.972 [2024-04-16 23:04:12.045246] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:20.972 qpair failed and we were unable to recover it. 00:26:20.972 [2024-04-16 23:04:12.045391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:20.972 [2024-04-16 23:04:12.045545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:20.972 [2024-04-16 23:04:12.045570] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:20.972 qpair failed and we were unable to recover it. 00:26:20.972 [2024-04-16 23:04:12.045710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:20.972 [2024-04-16 23:04:12.045825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:20.972 [2024-04-16 23:04:12.045851] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:20.972 qpair failed and we were unable to recover it. 00:26:20.972 [2024-04-16 23:04:12.045958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:20.972 [2024-04-16 23:04:12.046100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:20.972 [2024-04-16 23:04:12.046125] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:20.972 qpair failed and we were unable to recover it. 00:26:20.972 [2024-04-16 23:04:12.046285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:20.972 [2024-04-16 23:04:12.046474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:20.972 [2024-04-16 23:04:12.046517] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:20.972 qpair failed and we were unable to recover it. 00:26:20.972 [2024-04-16 23:04:12.046664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:20.972 [2024-04-16 23:04:12.046776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:20.972 [2024-04-16 23:04:12.046807] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:20.972 qpair failed and we were unable to recover it. 00:26:20.972 [2024-04-16 23:04:12.046917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:20.972 [2024-04-16 23:04:12.047089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:20.972 [2024-04-16 23:04:12.047114] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:20.972 qpair failed and we were unable to recover it. 00:26:20.972 [2024-04-16 23:04:12.047285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:20.972 [2024-04-16 23:04:12.047397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:20.972 [2024-04-16 23:04:12.047423] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:20.972 qpair failed and we were unable to recover it. 00:26:20.972 [2024-04-16 23:04:12.047572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:20.972 [2024-04-16 23:04:12.047714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:20.972 [2024-04-16 23:04:12.047739] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:20.972 qpair failed and we were unable to recover it. 00:26:20.972 [2024-04-16 23:04:12.047844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:20.972 [2024-04-16 23:04:12.047956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:20.972 [2024-04-16 23:04:12.047981] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:20.972 qpair failed and we were unable to recover it. 00:26:20.972 [2024-04-16 23:04:12.048116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:20.972 [2024-04-16 23:04:12.048283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:20.972 [2024-04-16 23:04:12.048309] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:20.972 qpair failed and we were unable to recover it. 00:26:20.972 [2024-04-16 23:04:12.048444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:20.972 [2024-04-16 23:04:12.048589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:20.972 [2024-04-16 23:04:12.048614] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:20.972 qpair failed and we were unable to recover it. 00:26:20.972 [2024-04-16 23:04:12.048730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:20.972 [2024-04-16 23:04:12.048868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:20.972 [2024-04-16 23:04:12.048894] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:20.972 qpair failed and we were unable to recover it. 00:26:20.972 [2024-04-16 23:04:12.049027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:20.972 [2024-04-16 23:04:12.049149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:20.972 [2024-04-16 23:04:12.049180] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:20.972 qpair failed and we were unable to recover it. 00:26:20.972 [2024-04-16 23:04:12.049351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:20.972 [2024-04-16 23:04:12.049528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:20.972 [2024-04-16 23:04:12.049554] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:20.973 qpair failed and we were unable to recover it. 00:26:20.973 [2024-04-16 23:04:12.049689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:20.973 [2024-04-16 23:04:12.049858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:20.973 [2024-04-16 23:04:12.049887] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:20.973 qpair failed and we were unable to recover it. 00:26:20.973 [2024-04-16 23:04:12.050031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:20.973 [2024-04-16 23:04:12.050172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:20.973 [2024-04-16 23:04:12.050213] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:20.973 qpair failed and we were unable to recover it. 00:26:20.973 [2024-04-16 23:04:12.050321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:20.973 [2024-04-16 23:04:12.050493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:20.973 [2024-04-16 23:04:12.050519] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:20.973 qpair failed and we were unable to recover it. 00:26:20.973 [2024-04-16 23:04:12.050687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:20.973 [2024-04-16 23:04:12.050834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:20.973 [2024-04-16 23:04:12.050861] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:20.973 qpair failed and we were unable to recover it. 00:26:20.973 [2024-04-16 23:04:12.051033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:20.973 [2024-04-16 23:04:12.051169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:20.973 [2024-04-16 23:04:12.051203] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:20.973 qpair failed and we were unable to recover it. 00:26:20.973 [2024-04-16 23:04:12.051316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:20.973 [2024-04-16 23:04:12.051453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:20.973 [2024-04-16 23:04:12.051478] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:20.973 qpair failed and we were unable to recover it. 00:26:20.973 [2024-04-16 23:04:12.051622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:20.973 [2024-04-16 23:04:12.051792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:20.973 [2024-04-16 23:04:12.051817] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:20.973 qpair failed and we were unable to recover it. 00:26:20.973 [2024-04-16 23:04:12.051935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:20.973 [2024-04-16 23:04:12.052072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:20.973 [2024-04-16 23:04:12.052097] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:20.973 qpair failed and we were unable to recover it. 00:26:20.973 [2024-04-16 23:04:12.052258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:20.973 [2024-04-16 23:04:12.052469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:20.973 [2024-04-16 23:04:12.052498] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:20.973 qpair failed and we were unable to recover it. 00:26:20.973 [2024-04-16 23:04:12.052686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:20.973 [2024-04-16 23:04:12.052830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:20.973 [2024-04-16 23:04:12.052854] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:20.973 qpair failed and we were unable to recover it. 00:26:20.973 [2024-04-16 23:04:12.052969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:20.973 [2024-04-16 23:04:12.053101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:20.973 [2024-04-16 23:04:12.053133] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:20.973 qpair failed and we were unable to recover it. 00:26:20.973 [2024-04-16 23:04:12.053283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:20.973 [2024-04-16 23:04:12.053407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:20.973 [2024-04-16 23:04:12.053432] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:20.973 qpair failed and we were unable to recover it. 00:26:20.973 [2024-04-16 23:04:12.053583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:20.973 [2024-04-16 23:04:12.053752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:20.973 [2024-04-16 23:04:12.053777] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:20.973 qpair failed and we were unable to recover it. 00:26:20.973 [2024-04-16 23:04:12.053920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:20.973 [2024-04-16 23:04:12.054061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:20.973 [2024-04-16 23:04:12.054087] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:20.973 qpair failed and we were unable to recover it. 00:26:20.973 [2024-04-16 23:04:12.054195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:20.973 [2024-04-16 23:04:12.054331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:20.973 [2024-04-16 23:04:12.054356] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:20.973 qpair failed and we were unable to recover it. 00:26:20.973 [2024-04-16 23:04:12.054524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:20.973 [2024-04-16 23:04:12.054707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:20.973 [2024-04-16 23:04:12.054732] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:20.973 qpair failed and we were unable to recover it. 00:26:20.973 [2024-04-16 23:04:12.054903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:20.973 [2024-04-16 23:04:12.055045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:20.973 [2024-04-16 23:04:12.055070] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:20.973 qpair failed and we were unable to recover it. 00:26:20.973 [2024-04-16 23:04:12.055207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:20.973 [2024-04-16 23:04:12.055324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:20.973 [2024-04-16 23:04:12.055349] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:20.973 qpair failed and we were unable to recover it. 00:26:20.973 [2024-04-16 23:04:12.055461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:20.973 [2024-04-16 23:04:12.055608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:20.973 [2024-04-16 23:04:12.055633] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:20.973 qpair failed and we were unable to recover it. 00:26:20.973 [2024-04-16 23:04:12.055808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:20.973 [2024-04-16 23:04:12.055946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:20.973 [2024-04-16 23:04:12.055972] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:20.973 qpair failed and we were unable to recover it. 00:26:20.973 [2024-04-16 23:04:12.056120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:20.973 [2024-04-16 23:04:12.056287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:20.973 [2024-04-16 23:04:12.056313] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:20.973 qpair failed and we were unable to recover it. 00:26:20.973 [2024-04-16 23:04:12.056446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:20.973 [2024-04-16 23:04:12.056619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:20.973 [2024-04-16 23:04:12.056661] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:20.973 qpair failed and we were unable to recover it. 00:26:20.973 [2024-04-16 23:04:12.056772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:20.973 [2024-04-16 23:04:12.056883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:20.973 [2024-04-16 23:04:12.056909] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:20.973 qpair failed and we were unable to recover it. 00:26:20.973 [2024-04-16 23:04:12.057061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:20.973 [2024-04-16 23:04:12.057222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:20.973 [2024-04-16 23:04:12.057251] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:20.973 qpair failed and we were unable to recover it. 00:26:20.973 [2024-04-16 23:04:12.057387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:20.973 [2024-04-16 23:04:12.057500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:20.973 [2024-04-16 23:04:12.057525] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:20.973 qpair failed and we were unable to recover it. 00:26:20.973 [2024-04-16 23:04:12.057646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:20.973 [2024-04-16 23:04:12.057789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:20.973 [2024-04-16 23:04:12.057816] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:20.973 qpair failed and we were unable to recover it. 00:26:20.973 [2024-04-16 23:04:12.057927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:20.973 [2024-04-16 23:04:12.058040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:20.973 [2024-04-16 23:04:12.058067] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:20.973 qpair failed and we were unable to recover it. 00:26:20.973 [2024-04-16 23:04:12.058232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:20.973 [2024-04-16 23:04:12.058410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:20.973 [2024-04-16 23:04:12.058436] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:20.974 qpair failed and we were unable to recover it. 00:26:20.974 [2024-04-16 23:04:12.058573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:20.974 [2024-04-16 23:04:12.058692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:20.974 [2024-04-16 23:04:12.058717] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:20.974 qpair failed and we were unable to recover it. 00:26:20.974 [2024-04-16 23:04:12.058885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:20.974 [2024-04-16 23:04:12.059023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:20.974 [2024-04-16 23:04:12.059048] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:20.974 qpair failed and we were unable to recover it. 00:26:20.974 [2024-04-16 23:04:12.059188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:20.974 [2024-04-16 23:04:12.059348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:20.974 [2024-04-16 23:04:12.059391] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:20.974 qpair failed and we were unable to recover it. 00:26:20.974 [2024-04-16 23:04:12.059531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:20.974 [2024-04-16 23:04:12.059692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:20.974 [2024-04-16 23:04:12.059717] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:20.974 qpair failed and we were unable to recover it. 00:26:20.974 [2024-04-16 23:04:12.059861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:20.974 [2024-04-16 23:04:12.059996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:20.974 [2024-04-16 23:04:12.060021] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:20.974 qpair failed and we were unable to recover it. 00:26:20.974 [2024-04-16 23:04:12.060129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:20.974 [2024-04-16 23:04:12.060300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:20.974 [2024-04-16 23:04:12.060348] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:20.974 qpair failed and we were unable to recover it. 00:26:20.974 [2024-04-16 23:04:12.060491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:20.974 [2024-04-16 23:04:12.060630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:20.974 [2024-04-16 23:04:12.060656] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:20.974 qpair failed and we were unable to recover it. 00:26:20.974 [2024-04-16 23:04:12.060761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:20.974 [2024-04-16 23:04:12.060903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:20.974 [2024-04-16 23:04:12.060928] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:20.974 qpair failed and we were unable to recover it. 00:26:20.974 [2024-04-16 23:04:12.061038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:20.974 [2024-04-16 23:04:12.061173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:20.974 [2024-04-16 23:04:12.061204] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:20.974 qpair failed and we were unable to recover it. 00:26:20.974 [2024-04-16 23:04:12.061329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:20.974 [2024-04-16 23:04:12.061447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:20.974 [2024-04-16 23:04:12.061472] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:20.974 qpair failed and we were unable to recover it. 00:26:20.974 [2024-04-16 23:04:12.061612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:20.974 [2024-04-16 23:04:12.061760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:20.974 [2024-04-16 23:04:12.061785] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:20.974 qpair failed and we were unable to recover it. 00:26:20.974 [2024-04-16 23:04:12.061922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:20.974 [2024-04-16 23:04:12.062064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:20.974 [2024-04-16 23:04:12.062089] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:20.974 qpair failed and we were unable to recover it. 00:26:20.974 [2024-04-16 23:04:12.062210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:20.974 [2024-04-16 23:04:12.062321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:20.974 [2024-04-16 23:04:12.062348] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:20.974 qpair failed and we were unable to recover it. 00:26:20.974 [2024-04-16 23:04:12.062524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:20.974 [2024-04-16 23:04:12.062665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:20.974 [2024-04-16 23:04:12.062690] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:20.974 qpair failed and we were unable to recover it. 00:26:20.974 [2024-04-16 23:04:12.062801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:20.974 [2024-04-16 23:04:12.062916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:20.974 [2024-04-16 23:04:12.062941] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:20.974 qpair failed and we were unable to recover it. 00:26:20.974 [2024-04-16 23:04:12.063061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:20.974 [2024-04-16 23:04:12.063248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:20.974 [2024-04-16 23:04:12.063277] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:20.974 qpair failed and we were unable to recover it. 00:26:20.974 [2024-04-16 23:04:12.063449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:20.974 [2024-04-16 23:04:12.063606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:20.974 [2024-04-16 23:04:12.063631] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:20.974 qpair failed and we were unable to recover it. 00:26:20.974 [2024-04-16 23:04:12.063795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:20.974 [2024-04-16 23:04:12.063913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:20.974 [2024-04-16 23:04:12.063939] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:20.974 qpair failed and we were unable to recover it. 00:26:20.974 [2024-04-16 23:04:12.064075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:20.974 [2024-04-16 23:04:12.064210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:20.974 [2024-04-16 23:04:12.064236] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:20.974 qpair failed and we were unable to recover it. 00:26:20.974 [2024-04-16 23:04:12.064393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:20.974 [2024-04-16 23:04:12.064538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:20.974 [2024-04-16 23:04:12.064580] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:20.974 qpair failed and we were unable to recover it. 00:26:20.974 [2024-04-16 23:04:12.064715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:20.974 [2024-04-16 23:04:12.064853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:20.974 [2024-04-16 23:04:12.064878] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:20.974 qpair failed and we were unable to recover it. 00:26:20.974 [2024-04-16 23:04:12.065021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:20.974 [2024-04-16 23:04:12.065161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:20.974 [2024-04-16 23:04:12.065193] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:20.974 qpair failed and we were unable to recover it. 00:26:20.974 [2024-04-16 23:04:12.065364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:20.974 [2024-04-16 23:04:12.065551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:20.974 [2024-04-16 23:04:12.065594] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:20.974 qpair failed and we were unable to recover it. 00:26:20.974 [2024-04-16 23:04:12.065798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:20.974 [2024-04-16 23:04:12.065929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:20.974 [2024-04-16 23:04:12.065954] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:20.974 qpair failed and we were unable to recover it. 00:26:20.974 [2024-04-16 23:04:12.066096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:20.974 [2024-04-16 23:04:12.066260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:20.974 [2024-04-16 23:04:12.066303] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:20.974 qpair failed and we were unable to recover it. 00:26:20.974 [2024-04-16 23:04:12.066440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:20.974 [2024-04-16 23:04:12.066649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:20.974 [2024-04-16 23:04:12.066692] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:20.974 qpair failed and we were unable to recover it. 00:26:20.974 [2024-04-16 23:04:12.066859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:20.974 [2024-04-16 23:04:12.066991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:20.974 [2024-04-16 23:04:12.067016] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:20.975 qpair failed and we were unable to recover it. 00:26:20.975 [2024-04-16 23:04:12.067126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:20.975 [2024-04-16 23:04:12.067285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:20.975 [2024-04-16 23:04:12.067314] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:20.975 qpair failed and we were unable to recover it. 00:26:20.975 [2024-04-16 23:04:12.067468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:20.975 [2024-04-16 23:04:12.067630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:20.975 [2024-04-16 23:04:12.067655] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:20.975 qpair failed and we were unable to recover it. 00:26:20.975 [2024-04-16 23:04:12.067800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:20.975 [2024-04-16 23:04:12.067970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:20.975 [2024-04-16 23:04:12.067995] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:20.975 qpair failed and we were unable to recover it. 00:26:20.975 [2024-04-16 23:04:12.068129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:20.975 [2024-04-16 23:04:12.068290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:20.975 [2024-04-16 23:04:12.068319] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:20.975 qpair failed and we were unable to recover it. 00:26:20.975 [2024-04-16 23:04:12.068505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:20.975 [2024-04-16 23:04:12.068631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:20.975 [2024-04-16 23:04:12.068656] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:20.975 qpair failed and we were unable to recover it. 00:26:20.975 [2024-04-16 23:04:12.068797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:20.975 [2024-04-16 23:04:12.068942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:20.975 [2024-04-16 23:04:12.068967] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:20.975 qpair failed and we were unable to recover it. 00:26:20.975 [2024-04-16 23:04:12.069087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:20.975 [2024-04-16 23:04:12.069232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:20.975 [2024-04-16 23:04:12.069258] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:20.975 qpair failed and we were unable to recover it. 00:26:20.975 [2024-04-16 23:04:12.069401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:20.975 [2024-04-16 23:04:12.069554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:20.975 [2024-04-16 23:04:12.069579] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:20.975 qpair failed and we were unable to recover it. 00:26:20.975 [2024-04-16 23:04:12.069708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:20.975 [2024-04-16 23:04:12.069894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:20.975 [2024-04-16 23:04:12.069919] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:20.975 qpair failed and we were unable to recover it. 00:26:20.975 [2024-04-16 23:04:12.070061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:20.975 [2024-04-16 23:04:12.070203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:20.975 [2024-04-16 23:04:12.070229] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:20.975 qpair failed and we were unable to recover it. 00:26:20.975 [2024-04-16 23:04:12.070402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:20.975 [2024-04-16 23:04:12.070583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:20.975 [2024-04-16 23:04:12.070628] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:20.975 qpair failed and we were unable to recover it. 00:26:20.975 [2024-04-16 23:04:12.070770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:20.975 [2024-04-16 23:04:12.070914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:20.975 [2024-04-16 23:04:12.070939] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:20.975 qpair failed and we were unable to recover it. 00:26:20.975 [2024-04-16 23:04:12.071080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:20.975 [2024-04-16 23:04:12.071225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:20.975 [2024-04-16 23:04:12.071252] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:20.975 qpair failed and we were unable to recover it. 00:26:20.975 [2024-04-16 23:04:12.071410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:20.975 [2024-04-16 23:04:12.071628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:20.975 [2024-04-16 23:04:12.071672] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:20.975 qpair failed and we were unable to recover it. 00:26:20.975 [2024-04-16 23:04:12.071815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:20.975 [2024-04-16 23:04:12.071986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:20.975 [2024-04-16 23:04:12.072011] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:20.975 qpair failed and we were unable to recover it. 00:26:20.975 [2024-04-16 23:04:12.072150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:20.975 [2024-04-16 23:04:12.072349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:20.975 [2024-04-16 23:04:12.072392] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:20.975 qpair failed and we were unable to recover it. 00:26:20.975 [2024-04-16 23:04:12.072564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:20.975 [2024-04-16 23:04:12.072713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:20.975 [2024-04-16 23:04:12.072756] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:20.975 qpair failed and we were unable to recover it. 00:26:20.975 [2024-04-16 23:04:12.072877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:20.975 [2024-04-16 23:04:12.073027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:20.975 [2024-04-16 23:04:12.073053] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:20.975 qpair failed and we were unable to recover it. 00:26:20.975 [2024-04-16 23:04:12.073168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:20.975 [2024-04-16 23:04:12.073366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:20.975 [2024-04-16 23:04:12.073409] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:20.975 qpair failed and we were unable to recover it. 00:26:20.975 [2024-04-16 23:04:12.073548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:20.975 [2024-04-16 23:04:12.073756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:20.975 [2024-04-16 23:04:12.073784] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:20.975 qpair failed and we were unable to recover it. 00:26:20.975 [2024-04-16 23:04:12.073913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:20.975 [2024-04-16 23:04:12.074047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:20.975 [2024-04-16 23:04:12.074072] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:20.975 qpair failed and we were unable to recover it. 00:26:20.975 [2024-04-16 23:04:12.074197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:20.975 [2024-04-16 23:04:12.074358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:20.975 [2024-04-16 23:04:12.074405] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:20.975 qpair failed and we were unable to recover it. 00:26:20.975 [2024-04-16 23:04:12.074536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:20.975 [2024-04-16 23:04:12.074706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:20.975 [2024-04-16 23:04:12.074749] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:20.975 qpair failed and we were unable to recover it. 00:26:20.975 [2024-04-16 23:04:12.074891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:20.975 [2024-04-16 23:04:12.075036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:20.975 [2024-04-16 23:04:12.075061] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:20.975 qpair failed and we were unable to recover it. 00:26:20.975 [2024-04-16 23:04:12.075181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:20.975 [2024-04-16 23:04:12.075309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:20.975 [2024-04-16 23:04:12.075352] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:20.975 qpair failed and we were unable to recover it. 00:26:20.975 [2024-04-16 23:04:12.075478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:20.975 [2024-04-16 23:04:12.075648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:20.975 [2024-04-16 23:04:12.075676] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:20.975 qpair failed and we were unable to recover it. 00:26:20.975 [2024-04-16 23:04:12.075805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:20.975 [2024-04-16 23:04:12.075942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:20.975 [2024-04-16 23:04:12.075966] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:20.975 qpair failed and we were unable to recover it. 00:26:20.975 [2024-04-16 23:04:12.076100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:20.975 [2024-04-16 23:04:12.076267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:20.975 [2024-04-16 23:04:12.076294] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:20.975 qpair failed and we were unable to recover it. 00:26:20.975 [2024-04-16 23:04:12.076460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:20.976 [2024-04-16 23:04:12.076597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:20.976 [2024-04-16 23:04:12.076622] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:20.976 qpair failed and we were unable to recover it. 00:26:20.976 [2024-04-16 23:04:12.076832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:20.976 [2024-04-16 23:04:12.076946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:20.976 [2024-04-16 23:04:12.076971] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:20.976 qpair failed and we were unable to recover it. 00:26:20.976 [2024-04-16 23:04:12.077110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:20.976 [2024-04-16 23:04:12.077252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:20.976 [2024-04-16 23:04:12.077277] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:20.976 qpair failed and we were unable to recover it. 00:26:20.976 [2024-04-16 23:04:12.077389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:20.976 [2024-04-16 23:04:12.077536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:20.976 [2024-04-16 23:04:12.077562] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:20.976 qpair failed and we were unable to recover it. 00:26:20.976 [2024-04-16 23:04:12.077704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:20.976 [2024-04-16 23:04:12.077814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:20.976 [2024-04-16 23:04:12.077839] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:20.976 qpair failed and we were unable to recover it. 00:26:20.976 [2024-04-16 23:04:12.077983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:20.976 [2024-04-16 23:04:12.078119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:20.976 [2024-04-16 23:04:12.078143] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:20.976 qpair failed and we were unable to recover it. 00:26:20.976 [2024-04-16 23:04:12.078340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:20.976 [2024-04-16 23:04:12.078467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:20.976 [2024-04-16 23:04:12.078494] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:20.976 qpair failed and we were unable to recover it. 00:26:20.976 [2024-04-16 23:04:12.078608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:20.976 [2024-04-16 23:04:12.078753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:20.976 [2024-04-16 23:04:12.078778] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:20.976 qpair failed and we were unable to recover it. 00:26:20.976 [2024-04-16 23:04:12.078891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:20.976 [2024-04-16 23:04:12.079029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:20.976 [2024-04-16 23:04:12.079054] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:20.976 qpair failed and we were unable to recover it. 00:26:20.976 [2024-04-16 23:04:12.079163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:20.976 [2024-04-16 23:04:12.079282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:20.976 [2024-04-16 23:04:12.079306] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:20.976 qpair failed and we were unable to recover it. 00:26:20.976 [2024-04-16 23:04:12.079411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:20.976 [2024-04-16 23:04:12.079518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:20.976 [2024-04-16 23:04:12.079543] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:20.976 qpair failed and we were unable to recover it. 00:26:20.976 [2024-04-16 23:04:12.079680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:20.976 [2024-04-16 23:04:12.079801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:20.976 [2024-04-16 23:04:12.079826] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:20.976 qpair failed and we were unable to recover it. 00:26:20.976 [2024-04-16 23:04:12.079958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:20.976 [2024-04-16 23:04:12.080093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:20.976 [2024-04-16 23:04:12.080118] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:20.976 qpair failed and we were unable to recover it. 00:26:20.976 [2024-04-16 23:04:12.080290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:20.976 [2024-04-16 23:04:12.080410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:20.976 [2024-04-16 23:04:12.080436] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:20.976 qpair failed and we were unable to recover it. 00:26:20.976 [2024-04-16 23:04:12.080551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:20.976 [2024-04-16 23:04:12.080716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:20.976 [2024-04-16 23:04:12.080760] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:20.976 qpair failed and we were unable to recover it. 00:26:20.976 [2024-04-16 23:04:12.080903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:20.976 [2024-04-16 23:04:12.081021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:20.976 [2024-04-16 23:04:12.081048] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:20.976 qpair failed and we were unable to recover it. 00:26:20.976 [2024-04-16 23:04:12.081157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:20.976 [2024-04-16 23:04:12.081283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:20.976 [2024-04-16 23:04:12.081310] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:20.976 qpair failed and we were unable to recover it. 00:26:20.976 [2024-04-16 23:04:12.081451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:20.976 [2024-04-16 23:04:12.081620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:20.976 [2024-04-16 23:04:12.081646] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:20.976 qpair failed and we were unable to recover it. 00:26:20.976 [2024-04-16 23:04:12.081786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:20.976 [2024-04-16 23:04:12.081943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:20.976 [2024-04-16 23:04:12.081969] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:20.976 qpair failed and we were unable to recover it. 00:26:21.252 [2024-04-16 23:04:12.082103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.252 [2024-04-16 23:04:12.082283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.252 [2024-04-16 23:04:12.082327] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.252 qpair failed and we were unable to recover it. 00:26:21.252 [2024-04-16 23:04:12.082452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.252 [2024-04-16 23:04:12.082629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.252 [2024-04-16 23:04:12.082672] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.252 qpair failed and we were unable to recover it. 00:26:21.252 [2024-04-16 23:04:12.082815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.252 [2024-04-16 23:04:12.082960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.252 [2024-04-16 23:04:12.082986] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.252 qpair failed and we were unable to recover it. 00:26:21.252 [2024-04-16 23:04:12.083125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.252 [2024-04-16 23:04:12.083302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.252 [2024-04-16 23:04:12.083327] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.252 qpair failed and we were unable to recover it. 00:26:21.252 [2024-04-16 23:04:12.083461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.252 [2024-04-16 23:04:12.083624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.252 [2024-04-16 23:04:12.083670] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.253 qpair failed and we were unable to recover it. 00:26:21.253 [2024-04-16 23:04:12.083775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.253 [2024-04-16 23:04:12.083890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.253 [2024-04-16 23:04:12.083915] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.253 qpair failed and we were unable to recover it. 00:26:21.253 [2024-04-16 23:04:12.084087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.253 [2024-04-16 23:04:12.084225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.253 [2024-04-16 23:04:12.084252] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.253 qpair failed and we were unable to recover it. 00:26:21.253 [2024-04-16 23:04:12.084359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.253 [2024-04-16 23:04:12.084503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.253 [2024-04-16 23:04:12.084528] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.253 qpair failed and we were unable to recover it. 00:26:21.253 [2024-04-16 23:04:12.084662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.253 [2024-04-16 23:04:12.084829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.253 [2024-04-16 23:04:12.084854] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.253 qpair failed and we were unable to recover it. 00:26:21.253 [2024-04-16 23:04:12.084996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.253 [2024-04-16 23:04:12.085141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.253 [2024-04-16 23:04:12.085167] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.253 qpair failed and we were unable to recover it. 00:26:21.253 [2024-04-16 23:04:12.085323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.253 [2024-04-16 23:04:12.085452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.253 [2024-04-16 23:04:12.085499] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.253 qpair failed and we were unable to recover it. 00:26:21.253 [2024-04-16 23:04:12.085627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.253 [2024-04-16 23:04:12.085812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.253 [2024-04-16 23:04:12.085837] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.253 qpair failed and we were unable to recover it. 00:26:21.253 [2024-04-16 23:04:12.085983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.253 [2024-04-16 23:04:12.086156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.253 [2024-04-16 23:04:12.086187] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.253 qpair failed and we were unable to recover it. 00:26:21.253 [2024-04-16 23:04:12.086334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.253 [2024-04-16 23:04:12.086469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.253 [2024-04-16 23:04:12.086494] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.253 qpair failed and we were unable to recover it. 00:26:21.253 [2024-04-16 23:04:12.086634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.253 [2024-04-16 23:04:12.086738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.253 [2024-04-16 23:04:12.086762] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.253 qpair failed and we were unable to recover it. 00:26:21.253 [2024-04-16 23:04:12.086879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.253 [2024-04-16 23:04:12.086987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.253 [2024-04-16 23:04:12.087013] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.253 qpair failed and we were unable to recover it. 00:26:21.253 [2024-04-16 23:04:12.087155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.253 [2024-04-16 23:04:12.087337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.253 [2024-04-16 23:04:12.087363] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.253 qpair failed and we were unable to recover it. 00:26:21.253 [2024-04-16 23:04:12.087498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.253 [2024-04-16 23:04:12.087601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.253 [2024-04-16 23:04:12.087626] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.253 qpair failed and we were unable to recover it. 00:26:21.253 [2024-04-16 23:04:12.087757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.253 [2024-04-16 23:04:12.087896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.253 [2024-04-16 23:04:12.087921] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.253 qpair failed and we were unable to recover it. 00:26:21.253 [2024-04-16 23:04:12.088090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.253 [2024-04-16 23:04:12.088252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.253 [2024-04-16 23:04:12.088296] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.253 qpair failed and we were unable to recover it. 00:26:21.253 [2024-04-16 23:04:12.088463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.253 [2024-04-16 23:04:12.088673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.253 [2024-04-16 23:04:12.088716] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.253 qpair failed and we were unable to recover it. 00:26:21.253 [2024-04-16 23:04:12.088825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.253 [2024-04-16 23:04:12.088963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.253 [2024-04-16 23:04:12.088988] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.253 qpair failed and we were unable to recover it. 00:26:21.253 [2024-04-16 23:04:12.089158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.253 [2024-04-16 23:04:12.089356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.253 [2024-04-16 23:04:12.089400] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.253 qpair failed and we were unable to recover it. 00:26:21.253 [2024-04-16 23:04:12.089554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.253 [2024-04-16 23:04:12.089734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.253 [2024-04-16 23:04:12.089778] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.253 qpair failed and we were unable to recover it. 00:26:21.253 [2024-04-16 23:04:12.089884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.253 [2024-04-16 23:04:12.090025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.253 [2024-04-16 23:04:12.090050] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.253 qpair failed and we were unable to recover it. 00:26:21.253 [2024-04-16 23:04:12.090168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.253 [2024-04-16 23:04:12.090354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.253 [2024-04-16 23:04:12.090380] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.253 qpair failed and we were unable to recover it. 00:26:21.253 [2024-04-16 23:04:12.090515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.253 [2024-04-16 23:04:12.090670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.253 [2024-04-16 23:04:12.090713] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.253 qpair failed and we were unable to recover it. 00:26:21.253 [2024-04-16 23:04:12.090821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.253 [2024-04-16 23:04:12.090965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.253 [2024-04-16 23:04:12.090990] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.253 qpair failed and we were unable to recover it. 00:26:21.253 [2024-04-16 23:04:12.091127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.253 [2024-04-16 23:04:12.091263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.253 [2024-04-16 23:04:12.091306] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.253 qpair failed and we were unable to recover it. 00:26:21.253 [2024-04-16 23:04:12.091444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.254 [2024-04-16 23:04:12.091600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.254 [2024-04-16 23:04:12.091629] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.254 qpair failed and we were unable to recover it. 00:26:21.254 [2024-04-16 23:04:12.091741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.254 [2024-04-16 23:04:12.091876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.254 [2024-04-16 23:04:12.091901] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.254 qpair failed and we were unable to recover it. 00:26:21.254 [2024-04-16 23:04:12.092017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.254 [2024-04-16 23:04:12.092127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.254 [2024-04-16 23:04:12.092153] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.254 qpair failed and we were unable to recover it. 00:26:21.254 [2024-04-16 23:04:12.092310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.254 [2024-04-16 23:04:12.092499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.254 [2024-04-16 23:04:12.092542] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.254 qpair failed and we were unable to recover it. 00:26:21.254 [2024-04-16 23:04:12.092696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.254 [2024-04-16 23:04:12.092838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.254 [2024-04-16 23:04:12.092863] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.254 qpair failed and we were unable to recover it. 00:26:21.254 [2024-04-16 23:04:12.093009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.254 [2024-04-16 23:04:12.093152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.254 [2024-04-16 23:04:12.093183] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.254 qpair failed and we were unable to recover it. 00:26:21.254 [2024-04-16 23:04:12.093313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.254 [2024-04-16 23:04:12.093525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.254 [2024-04-16 23:04:12.093571] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.254 qpair failed and we were unable to recover it. 00:26:21.254 [2024-04-16 23:04:12.093737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.254 [2024-04-16 23:04:12.093891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.254 [2024-04-16 23:04:12.093917] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.254 qpair failed and we were unable to recover it. 00:26:21.254 [2024-04-16 23:04:12.094030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.254 [2024-04-16 23:04:12.094220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.254 [2024-04-16 23:04:12.094249] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.254 qpair failed and we were unable to recover it. 00:26:21.254 [2024-04-16 23:04:12.094455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.254 [2024-04-16 23:04:12.094594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.254 [2024-04-16 23:04:12.094620] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.254 qpair failed and we were unable to recover it. 00:26:21.254 [2024-04-16 23:04:12.094784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.254 [2024-04-16 23:04:12.094922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.254 [2024-04-16 23:04:12.094952] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.254 qpair failed and we were unable to recover it. 00:26:21.254 [2024-04-16 23:04:12.095091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.254 [2024-04-16 23:04:12.095218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.254 [2024-04-16 23:04:12.095248] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.254 qpair failed and we were unable to recover it. 00:26:21.254 [2024-04-16 23:04:12.095463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.254 [2024-04-16 23:04:12.095646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.254 [2024-04-16 23:04:12.095689] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.254 qpair failed and we were unable to recover it. 00:26:21.254 [2024-04-16 23:04:12.095860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.254 [2024-04-16 23:04:12.095969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.254 [2024-04-16 23:04:12.095994] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.254 qpair failed and we were unable to recover it. 00:26:21.254 [2024-04-16 23:04:12.096171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.254 [2024-04-16 23:04:12.096307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.254 [2024-04-16 23:04:12.096335] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.254 qpair failed and we were unable to recover it. 00:26:21.254 [2024-04-16 23:04:12.096544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.254 [2024-04-16 23:04:12.096716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.254 [2024-04-16 23:04:12.096758] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.254 qpair failed and we were unable to recover it. 00:26:21.254 [2024-04-16 23:04:12.096922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.254 [2024-04-16 23:04:12.097108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.254 [2024-04-16 23:04:12.097133] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.254 qpair failed and we were unable to recover it. 00:26:21.254 [2024-04-16 23:04:12.097334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.254 [2024-04-16 23:04:12.097489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.254 [2024-04-16 23:04:12.097532] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.254 qpair failed and we were unable to recover it. 00:26:21.254 [2024-04-16 23:04:12.097709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.254 [2024-04-16 23:04:12.097925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.254 [2024-04-16 23:04:12.097969] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.254 qpair failed and we were unable to recover it. 00:26:21.254 [2024-04-16 23:04:12.098087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.254 [2024-04-16 23:04:12.098256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.254 [2024-04-16 23:04:12.098302] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.254 qpair failed and we were unable to recover it. 00:26:21.254 [2024-04-16 23:04:12.098430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.254 [2024-04-16 23:04:12.098637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.254 [2024-04-16 23:04:12.098684] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.254 qpair failed and we were unable to recover it. 00:26:21.254 [2024-04-16 23:04:12.098852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.254 [2024-04-16 23:04:12.098983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.254 [2024-04-16 23:04:12.099009] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.254 qpair failed and we were unable to recover it. 00:26:21.254 [2024-04-16 23:04:12.099132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.254 [2024-04-16 23:04:12.099246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.254 [2024-04-16 23:04:12.099272] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.254 qpair failed and we were unable to recover it. 00:26:21.254 [2024-04-16 23:04:12.099440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.254 [2024-04-16 23:04:12.099602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.254 [2024-04-16 23:04:12.099644] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.254 qpair failed and we were unable to recover it. 00:26:21.254 [2024-04-16 23:04:12.099796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.254 [2024-04-16 23:04:12.099981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.254 [2024-04-16 23:04:12.100006] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.254 qpair failed and we were unable to recover it. 00:26:21.254 [2024-04-16 23:04:12.100148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.254 [2024-04-16 23:04:12.100288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.254 [2024-04-16 23:04:12.100314] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.254 qpair failed and we were unable to recover it. 00:26:21.255 [2024-04-16 23:04:12.100470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.255 [2024-04-16 23:04:12.100596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.255 [2024-04-16 23:04:12.100623] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.255 qpair failed and we were unable to recover it. 00:26:21.255 [2024-04-16 23:04:12.100750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.255 [2024-04-16 23:04:12.100906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.255 [2024-04-16 23:04:12.100931] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.255 qpair failed and we were unable to recover it. 00:26:21.255 [2024-04-16 23:04:12.101074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.255 [2024-04-16 23:04:12.101237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.255 [2024-04-16 23:04:12.101265] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.255 qpair failed and we were unable to recover it. 00:26:21.255 [2024-04-16 23:04:12.101405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.255 [2024-04-16 23:04:12.101555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.255 [2024-04-16 23:04:12.101598] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.255 qpair failed and we were unable to recover it. 00:26:21.255 [2024-04-16 23:04:12.101790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.255 [2024-04-16 23:04:12.101942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.255 [2024-04-16 23:04:12.101974] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.255 qpair failed and we were unable to recover it. 00:26:21.255 [2024-04-16 23:04:12.102121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.255 [2024-04-16 23:04:12.102333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.255 [2024-04-16 23:04:12.102377] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.255 qpair failed and we were unable to recover it. 00:26:21.255 [2024-04-16 23:04:12.102503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.255 [2024-04-16 23:04:12.102647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.255 [2024-04-16 23:04:12.102689] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.255 qpair failed and we were unable to recover it. 00:26:21.255 [2024-04-16 23:04:12.102855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.255 [2024-04-16 23:04:12.103022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.255 [2024-04-16 23:04:12.103047] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.255 qpair failed and we were unable to recover it. 00:26:21.255 [2024-04-16 23:04:12.103234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.255 [2024-04-16 23:04:12.103423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.255 [2024-04-16 23:04:12.103449] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.255 qpair failed and we were unable to recover it. 00:26:21.255 [2024-04-16 23:04:12.103626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.255 [2024-04-16 23:04:12.103786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.255 [2024-04-16 23:04:12.103813] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.255 qpair failed and we were unable to recover it. 00:26:21.255 [2024-04-16 23:04:12.103940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.255 [2024-04-16 23:04:12.104084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.255 [2024-04-16 23:04:12.104111] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.255 qpair failed and we were unable to recover it. 00:26:21.255 [2024-04-16 23:04:12.104264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.255 [2024-04-16 23:04:12.104438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.255 [2024-04-16 23:04:12.104481] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.255 qpair failed and we were unable to recover it. 00:26:21.255 [2024-04-16 23:04:12.104633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.255 [2024-04-16 23:04:12.104795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.255 [2024-04-16 23:04:12.104820] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.255 qpair failed and we were unable to recover it. 00:26:21.255 [2024-04-16 23:04:12.104943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.255 [2024-04-16 23:04:12.105073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.255 [2024-04-16 23:04:12.105099] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.255 qpair failed and we were unable to recover it. 00:26:21.255 [2024-04-16 23:04:12.105241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.255 [2024-04-16 23:04:12.105425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.255 [2024-04-16 23:04:12.105468] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.255 qpair failed and we were unable to recover it. 00:26:21.255 [2024-04-16 23:04:12.105624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.255 [2024-04-16 23:04:12.105784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.255 [2024-04-16 23:04:12.105810] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.255 qpair failed and we were unable to recover it. 00:26:21.255 [2024-04-16 23:04:12.105927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.255 [2024-04-16 23:04:12.106079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.255 [2024-04-16 23:04:12.106104] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.255 qpair failed and we were unable to recover it. 00:26:21.255 [2024-04-16 23:04:12.106254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.255 [2024-04-16 23:04:12.106476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.255 [2024-04-16 23:04:12.106519] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.255 qpair failed and we were unable to recover it. 00:26:21.255 [2024-04-16 23:04:12.106653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.255 [2024-04-16 23:04:12.106813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.255 [2024-04-16 23:04:12.106839] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.255 qpair failed and we were unable to recover it. 00:26:21.255 [2024-04-16 23:04:12.106984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.255 [2024-04-16 23:04:12.107142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.255 [2024-04-16 23:04:12.107169] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.255 qpair failed and we were unable to recover it. 00:26:21.255 [2024-04-16 23:04:12.107337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.255 [2024-04-16 23:04:12.107492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.255 [2024-04-16 23:04:12.107537] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.255 qpair failed and we were unable to recover it. 00:26:21.255 [2024-04-16 23:04:12.107699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.255 [2024-04-16 23:04:12.107859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.255 [2024-04-16 23:04:12.107884] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.255 qpair failed and we were unable to recover it. 00:26:21.255 [2024-04-16 23:04:12.108007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.255 [2024-04-16 23:04:12.108120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.255 [2024-04-16 23:04:12.108145] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.255 qpair failed and we were unable to recover it. 00:26:21.255 [2024-04-16 23:04:12.108282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.255 [2024-04-16 23:04:12.108438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.255 [2024-04-16 23:04:12.108480] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.255 qpair failed and we were unable to recover it. 00:26:21.255 [2024-04-16 23:04:12.108673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.255 [2024-04-16 23:04:12.108816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.255 [2024-04-16 23:04:12.108841] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.255 qpair failed and we were unable to recover it. 00:26:21.255 [2024-04-16 23:04:12.108987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.255 [2024-04-16 23:04:12.109098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.255 [2024-04-16 23:04:12.109124] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.255 qpair failed and we were unable to recover it. 00:26:21.255 [2024-04-16 23:04:12.109254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.255 [2024-04-16 23:04:12.109374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.255 [2024-04-16 23:04:12.109401] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.255 qpair failed and we were unable to recover it. 00:26:21.255 [2024-04-16 23:04:12.109514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.255 [2024-04-16 23:04:12.109626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.255 [2024-04-16 23:04:12.109652] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.255 qpair failed and we were unable to recover it. 00:26:21.256 [2024-04-16 23:04:12.109803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.256 [2024-04-16 23:04:12.109921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.256 [2024-04-16 23:04:12.109948] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.256 qpair failed and we were unable to recover it. 00:26:21.256 [2024-04-16 23:04:12.110093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.256 [2024-04-16 23:04:12.110227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.256 [2024-04-16 23:04:12.110254] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.256 qpair failed and we were unable to recover it. 00:26:21.256 [2024-04-16 23:04:12.110396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.256 [2024-04-16 23:04:12.110553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.256 [2024-04-16 23:04:12.110581] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.256 qpair failed and we were unable to recover it. 00:26:21.256 [2024-04-16 23:04:12.110739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.256 [2024-04-16 23:04:12.110909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.256 [2024-04-16 23:04:12.110934] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.256 qpair failed and we were unable to recover it. 00:26:21.256 [2024-04-16 23:04:12.111047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.256 [2024-04-16 23:04:12.111199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.256 [2024-04-16 23:04:12.111225] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.256 qpair failed and we were unable to recover it. 00:26:21.256 [2024-04-16 23:04:12.111345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.256 [2024-04-16 23:04:12.111490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.256 [2024-04-16 23:04:12.111515] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.256 qpair failed and we were unable to recover it. 00:26:21.256 [2024-04-16 23:04:12.111685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.256 [2024-04-16 23:04:12.111803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.256 [2024-04-16 23:04:12.111828] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.256 qpair failed and we were unable to recover it. 00:26:21.256 [2024-04-16 23:04:12.111981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.256 [2024-04-16 23:04:12.112117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.256 [2024-04-16 23:04:12.112143] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.256 qpair failed and we were unable to recover it. 00:26:21.256 [2024-04-16 23:04:12.112288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.256 [2024-04-16 23:04:12.112403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.256 [2024-04-16 23:04:12.112428] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.256 qpair failed and we were unable to recover it. 00:26:21.256 [2024-04-16 23:04:12.112584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.256 [2024-04-16 23:04:12.112722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.256 [2024-04-16 23:04:12.112764] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.256 qpair failed and we were unable to recover it. 00:26:21.256 [2024-04-16 23:04:12.112908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.256 [2024-04-16 23:04:12.113066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.256 [2024-04-16 23:04:12.113092] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.256 qpair failed and we were unable to recover it. 00:26:21.256 [2024-04-16 23:04:12.113236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.256 [2024-04-16 23:04:12.113355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.256 [2024-04-16 23:04:12.113380] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.256 qpair failed and we were unable to recover it. 00:26:21.256 [2024-04-16 23:04:12.113494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.256 [2024-04-16 23:04:12.113613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.256 [2024-04-16 23:04:12.113639] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.256 qpair failed and we were unable to recover it. 00:26:21.256 [2024-04-16 23:04:12.113808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.256 [2024-04-16 23:04:12.113975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.256 [2024-04-16 23:04:12.114000] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.256 qpair failed and we were unable to recover it. 00:26:21.256 [2024-04-16 23:04:12.114140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.256 [2024-04-16 23:04:12.114300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.256 [2024-04-16 23:04:12.114327] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.256 qpair failed and we were unable to recover it. 00:26:21.256 [2024-04-16 23:04:12.114483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.256 [2024-04-16 23:04:12.114644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.256 [2024-04-16 23:04:12.114687] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.256 qpair failed and we were unable to recover it. 00:26:21.256 [2024-04-16 23:04:12.114848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.256 [2024-04-16 23:04:12.114995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.256 [2024-04-16 23:04:12.115022] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.256 qpair failed and we were unable to recover it. 00:26:21.256 [2024-04-16 23:04:12.115196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.256 [2024-04-16 23:04:12.115342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.256 [2024-04-16 23:04:12.115367] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.256 qpair failed and we were unable to recover it. 00:26:21.256 [2024-04-16 23:04:12.115481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.256 [2024-04-16 23:04:12.115646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.256 [2024-04-16 23:04:12.115692] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.256 qpair failed and we were unable to recover it. 00:26:21.256 [2024-04-16 23:04:12.115836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.256 [2024-04-16 23:04:12.115972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.256 [2024-04-16 23:04:12.115998] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.256 qpair failed and we were unable to recover it. 00:26:21.256 [2024-04-16 23:04:12.116108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.256 [2024-04-16 23:04:12.116292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.256 [2024-04-16 23:04:12.116318] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.256 qpair failed and we were unable to recover it. 00:26:21.256 [2024-04-16 23:04:12.116430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.256 [2024-04-16 23:04:12.116591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.256 [2024-04-16 23:04:12.116616] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.256 qpair failed and we were unable to recover it. 00:26:21.256 [2024-04-16 23:04:12.116757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.256 [2024-04-16 23:04:12.116896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.256 [2024-04-16 23:04:12.116930] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.256 qpair failed and we were unable to recover it. 00:26:21.256 [2024-04-16 23:04:12.117064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.256 [2024-04-16 23:04:12.117185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.256 [2024-04-16 23:04:12.117211] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.256 qpair failed and we were unable to recover it. 00:26:21.256 [2024-04-16 23:04:12.117318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.256 [2024-04-16 23:04:12.117431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.256 [2024-04-16 23:04:12.117456] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.256 qpair failed and we were unable to recover it. 00:26:21.256 [2024-04-16 23:04:12.117603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.256 [2024-04-16 23:04:12.117746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.256 [2024-04-16 23:04:12.117773] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.256 qpair failed and we were unable to recover it. 00:26:21.256 [2024-04-16 23:04:12.117888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.256 [2024-04-16 23:04:12.118027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.256 [2024-04-16 23:04:12.118053] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.256 qpair failed and we were unable to recover it. 00:26:21.256 [2024-04-16 23:04:12.118205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.257 [2024-04-16 23:04:12.118313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.257 [2024-04-16 23:04:12.118338] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.257 qpair failed and we were unable to recover it. 00:26:21.257 [2024-04-16 23:04:12.118478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.257 [2024-04-16 23:04:12.118624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.257 [2024-04-16 23:04:12.118649] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.257 qpair failed and we were unable to recover it. 00:26:21.257 [2024-04-16 23:04:12.118760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.257 [2024-04-16 23:04:12.118899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.257 [2024-04-16 23:04:12.118925] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.257 qpair failed and we were unable to recover it. 00:26:21.257 [2024-04-16 23:04:12.119102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.257 [2024-04-16 23:04:12.119284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.257 [2024-04-16 23:04:12.119310] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.257 qpair failed and we were unable to recover it. 00:26:21.257 [2024-04-16 23:04:12.119421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.257 [2024-04-16 23:04:12.119596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.257 [2024-04-16 23:04:12.119639] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.257 qpair failed and we were unable to recover it. 00:26:21.257 [2024-04-16 23:04:12.119820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.257 [2024-04-16 23:04:12.119960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.257 [2024-04-16 23:04:12.119986] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.257 qpair failed and we were unable to recover it. 00:26:21.257 [2024-04-16 23:04:12.120133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.257 [2024-04-16 23:04:12.120254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.257 [2024-04-16 23:04:12.120281] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.257 qpair failed and we were unable to recover it. 00:26:21.257 [2024-04-16 23:04:12.120423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.257 [2024-04-16 23:04:12.120625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.257 [2024-04-16 23:04:12.120669] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.257 qpair failed and we were unable to recover it. 00:26:21.257 [2024-04-16 23:04:12.120784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.257 [2024-04-16 23:04:12.120958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.257 [2024-04-16 23:04:12.120983] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.257 qpair failed and we were unable to recover it. 00:26:21.257 [2024-04-16 23:04:12.121096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.257 [2024-04-16 23:04:12.121235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.257 [2024-04-16 23:04:12.121261] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.257 qpair failed and we were unable to recover it. 00:26:21.257 [2024-04-16 23:04:12.121388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.257 [2024-04-16 23:04:12.121541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.257 [2024-04-16 23:04:12.121566] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.257 qpair failed and we were unable to recover it. 00:26:21.257 [2024-04-16 23:04:12.121718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.257 [2024-04-16 23:04:12.121832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.257 [2024-04-16 23:04:12.121858] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.257 qpair failed and we were unable to recover it. 00:26:21.257 [2024-04-16 23:04:12.122002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.257 [2024-04-16 23:04:12.122146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.257 [2024-04-16 23:04:12.122171] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.257 qpair failed and we were unable to recover it. 00:26:21.257 [2024-04-16 23:04:12.122314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.257 [2024-04-16 23:04:12.122429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.257 [2024-04-16 23:04:12.122458] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.257 qpair failed and we were unable to recover it. 00:26:21.257 [2024-04-16 23:04:12.122629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.257 [2024-04-16 23:04:12.122797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.257 [2024-04-16 23:04:12.122822] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.257 qpair failed and we were unable to recover it. 00:26:21.257 [2024-04-16 23:04:12.122966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.257 [2024-04-16 23:04:12.123082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.257 [2024-04-16 23:04:12.123109] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.257 qpair failed and we were unable to recover it. 00:26:21.257 [2024-04-16 23:04:12.123233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.257 [2024-04-16 23:04:12.123356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.257 [2024-04-16 23:04:12.123382] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.257 qpair failed and we were unable to recover it. 00:26:21.257 [2024-04-16 23:04:12.123501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.257 [2024-04-16 23:04:12.123642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.257 [2024-04-16 23:04:12.123667] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.257 qpair failed and we were unable to recover it. 00:26:21.257 [2024-04-16 23:04:12.123777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.257 [2024-04-16 23:04:12.123920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.257 [2024-04-16 23:04:12.123946] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.257 qpair failed and we were unable to recover it. 00:26:21.257 [2024-04-16 23:04:12.124060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.257 [2024-04-16 23:04:12.124179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.257 [2024-04-16 23:04:12.124205] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.257 qpair failed and we were unable to recover it. 00:26:21.257 [2024-04-16 23:04:12.124360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.257 [2024-04-16 23:04:12.124489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.257 [2024-04-16 23:04:12.124517] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.257 qpair failed and we were unable to recover it. 00:26:21.257 [2024-04-16 23:04:12.124649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.257 [2024-04-16 23:04:12.124765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.258 [2024-04-16 23:04:12.124791] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.258 qpair failed and we were unable to recover it. 00:26:21.258 [2024-04-16 23:04:12.124939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.258 [2024-04-16 23:04:12.125079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.258 [2024-04-16 23:04:12.125106] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.258 qpair failed and we were unable to recover it. 00:26:21.258 [2024-04-16 23:04:12.125241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.258 [2024-04-16 23:04:12.125362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.258 [2024-04-16 23:04:12.125388] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.258 qpair failed and we were unable to recover it. 00:26:21.258 [2024-04-16 23:04:12.125539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.258 [2024-04-16 23:04:12.125653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.258 [2024-04-16 23:04:12.125678] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.258 qpair failed and we were unable to recover it. 00:26:21.258 [2024-04-16 23:04:12.125819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.258 [2024-04-16 23:04:12.125943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.258 [2024-04-16 23:04:12.125968] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.258 qpair failed and we were unable to recover it. 00:26:21.258 [2024-04-16 23:04:12.126126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.258 [2024-04-16 23:04:12.126242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.258 [2024-04-16 23:04:12.126268] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.258 qpair failed and we were unable to recover it. 00:26:21.258 [2024-04-16 23:04:12.126376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.258 [2024-04-16 23:04:12.126552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.258 [2024-04-16 23:04:12.126581] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.258 qpair failed and we were unable to recover it. 00:26:21.258 [2024-04-16 23:04:12.126740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.258 [2024-04-16 23:04:12.126902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.258 [2024-04-16 23:04:12.126929] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.258 qpair failed and we were unable to recover it. 00:26:21.258 [2024-04-16 23:04:12.127073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.258 [2024-04-16 23:04:12.127216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.258 [2024-04-16 23:04:12.127243] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.258 qpair failed and we were unable to recover it. 00:26:21.258 [2024-04-16 23:04:12.127383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.258 [2024-04-16 23:04:12.127526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.258 [2024-04-16 23:04:12.127572] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.258 qpair failed and we were unable to recover it. 00:26:21.258 [2024-04-16 23:04:12.127713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.258 [2024-04-16 23:04:12.127830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.258 [2024-04-16 23:04:12.127856] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.258 qpair failed and we were unable to recover it. 00:26:21.258 [2024-04-16 23:04:12.127976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.258 [2024-04-16 23:04:12.128116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.258 [2024-04-16 23:04:12.128143] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.258 qpair failed and we were unable to recover it. 00:26:21.258 [2024-04-16 23:04:12.128279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.258 [2024-04-16 23:04:12.128391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.258 [2024-04-16 23:04:12.128417] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.258 qpair failed and we were unable to recover it. 00:26:21.258 [2024-04-16 23:04:12.128600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.258 [2024-04-16 23:04:12.128790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.258 [2024-04-16 23:04:12.128815] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.258 qpair failed and we were unable to recover it. 00:26:21.258 [2024-04-16 23:04:12.128956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.258 [2024-04-16 23:04:12.129068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.258 [2024-04-16 23:04:12.129093] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.258 qpair failed and we were unable to recover it. 00:26:21.258 [2024-04-16 23:04:12.129206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.258 [2024-04-16 23:04:12.129322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.258 [2024-04-16 23:04:12.129347] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.258 qpair failed and we were unable to recover it. 00:26:21.258 [2024-04-16 23:04:12.129462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.258 [2024-04-16 23:04:12.129582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.258 [2024-04-16 23:04:12.129607] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.258 qpair failed and we were unable to recover it. 00:26:21.258 [2024-04-16 23:04:12.129786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.258 [2024-04-16 23:04:12.129928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.258 [2024-04-16 23:04:12.129953] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.258 qpair failed and we were unable to recover it. 00:26:21.258 [2024-04-16 23:04:12.130088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.258 [2024-04-16 23:04:12.130236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.258 [2024-04-16 23:04:12.130262] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.258 qpair failed and we were unable to recover it. 00:26:21.258 [2024-04-16 23:04:12.130376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.258 [2024-04-16 23:04:12.130522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.258 [2024-04-16 23:04:12.130547] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.258 qpair failed and we were unable to recover it. 00:26:21.258 [2024-04-16 23:04:12.130690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.258 [2024-04-16 23:04:12.130864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.258 [2024-04-16 23:04:12.130889] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.258 qpair failed and we were unable to recover it. 00:26:21.258 [2024-04-16 23:04:12.131001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.258 [2024-04-16 23:04:12.131137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.258 [2024-04-16 23:04:12.131163] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.258 qpair failed and we were unable to recover it. 00:26:21.258 [2024-04-16 23:04:12.131344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.258 [2024-04-16 23:04:12.131452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.258 [2024-04-16 23:04:12.131479] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.258 qpair failed and we were unable to recover it. 00:26:21.258 [2024-04-16 23:04:12.131649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.258 [2024-04-16 23:04:12.131779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.258 [2024-04-16 23:04:12.131804] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.258 qpair failed and we were unable to recover it. 00:26:21.258 [2024-04-16 23:04:12.131920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.258 [2024-04-16 23:04:12.132066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.258 [2024-04-16 23:04:12.132101] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.258 qpair failed and we were unable to recover it. 00:26:21.258 [2024-04-16 23:04:12.132232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.258 [2024-04-16 23:04:12.132381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.258 [2024-04-16 23:04:12.132408] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.258 qpair failed and we were unable to recover it. 00:26:21.258 [2024-04-16 23:04:12.132553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.258 [2024-04-16 23:04:12.132683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.258 [2024-04-16 23:04:12.132726] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.258 qpair failed and we were unable to recover it. 00:26:21.258 [2024-04-16 23:04:12.132865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.258 [2024-04-16 23:04:12.133003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.258 [2024-04-16 23:04:12.133029] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.258 qpair failed and we were unable to recover it. 00:26:21.258 [2024-04-16 23:04:12.133163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.258 [2024-04-16 23:04:12.133365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.259 [2024-04-16 23:04:12.133391] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.259 qpair failed and we were unable to recover it. 00:26:21.259 [2024-04-16 23:04:12.133526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.259 [2024-04-16 23:04:12.133651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.259 [2024-04-16 23:04:12.133683] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.259 qpair failed and we were unable to recover it. 00:26:21.259 [2024-04-16 23:04:12.133820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.259 [2024-04-16 23:04:12.133956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.259 [2024-04-16 23:04:12.133981] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.259 qpair failed and we were unable to recover it. 00:26:21.259 [2024-04-16 23:04:12.134117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.259 [2024-04-16 23:04:12.134301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.259 [2024-04-16 23:04:12.134328] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.259 qpair failed and we were unable to recover it. 00:26:21.259 [2024-04-16 23:04:12.134477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.259 [2024-04-16 23:04:12.134676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.259 [2024-04-16 23:04:12.134701] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.259 qpair failed and we were unable to recover it. 00:26:21.259 [2024-04-16 23:04:12.134810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.259 [2024-04-16 23:04:12.134925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.259 [2024-04-16 23:04:12.134950] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.259 qpair failed and we were unable to recover it. 00:26:21.259 [2024-04-16 23:04:12.135087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.259 [2024-04-16 23:04:12.135263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.259 [2024-04-16 23:04:12.135288] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.259 qpair failed and we were unable to recover it. 00:26:21.259 [2024-04-16 23:04:12.135428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.259 [2024-04-16 23:04:12.135576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.259 [2024-04-16 23:04:12.135601] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.259 qpair failed and we were unable to recover it. 00:26:21.259 [2024-04-16 23:04:12.135708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.259 [2024-04-16 23:04:12.135817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.259 [2024-04-16 23:04:12.135842] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.259 qpair failed and we were unable to recover it. 00:26:21.259 [2024-04-16 23:04:12.135958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.259 [2024-04-16 23:04:12.136098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.259 [2024-04-16 23:04:12.136123] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.259 qpair failed and we were unable to recover it. 00:26:21.259 [2024-04-16 23:04:12.136234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.259 [2024-04-16 23:04:12.136374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.259 [2024-04-16 23:04:12.136399] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.259 qpair failed and we were unable to recover it. 00:26:21.259 [2024-04-16 23:04:12.136554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.259 [2024-04-16 23:04:12.136664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.259 [2024-04-16 23:04:12.136689] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.259 qpair failed and we were unable to recover it. 00:26:21.259 [2024-04-16 23:04:12.136830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.259 [2024-04-16 23:04:12.136996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.259 [2024-04-16 23:04:12.137021] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.259 qpair failed and we were unable to recover it. 00:26:21.259 [2024-04-16 23:04:12.137190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.259 [2024-04-16 23:04:12.137303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.259 [2024-04-16 23:04:12.137330] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.259 qpair failed and we were unable to recover it. 00:26:21.259 [2024-04-16 23:04:12.137443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.259 [2024-04-16 23:04:12.137579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.259 [2024-04-16 23:04:12.137613] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.259 qpair failed and we were unable to recover it. 00:26:21.259 [2024-04-16 23:04:12.137790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.259 [2024-04-16 23:04:12.137942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.259 [2024-04-16 23:04:12.137967] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.259 qpair failed and we were unable to recover it. 00:26:21.259 [2024-04-16 23:04:12.138082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.259 [2024-04-16 23:04:12.138239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.259 [2024-04-16 23:04:12.138264] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.259 qpair failed and we were unable to recover it. 00:26:21.259 [2024-04-16 23:04:12.138370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.259 [2024-04-16 23:04:12.138514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.259 [2024-04-16 23:04:12.138540] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.259 qpair failed and we were unable to recover it. 00:26:21.259 [2024-04-16 23:04:12.138657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.259 [2024-04-16 23:04:12.138776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.259 [2024-04-16 23:04:12.138801] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.259 qpair failed and we were unable to recover it. 00:26:21.259 [2024-04-16 23:04:12.138910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.259 [2024-04-16 23:04:12.139057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.259 [2024-04-16 23:04:12.139083] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.259 qpair failed and we were unable to recover it. 00:26:21.259 [2024-04-16 23:04:12.139264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.259 [2024-04-16 23:04:12.139413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.259 [2024-04-16 23:04:12.139438] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.259 qpair failed and we were unable to recover it. 00:26:21.259 [2024-04-16 23:04:12.139591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.259 [2024-04-16 23:04:12.139745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.259 [2024-04-16 23:04:12.139781] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.259 qpair failed and we were unable to recover it. 00:26:21.259 [2024-04-16 23:04:12.139900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.259 [2024-04-16 23:04:12.140034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.259 [2024-04-16 23:04:12.140060] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.259 qpair failed and we were unable to recover it. 00:26:21.259 [2024-04-16 23:04:12.140219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.259 [2024-04-16 23:04:12.140392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.259 [2024-04-16 23:04:12.140417] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.259 qpair failed and we were unable to recover it. 00:26:21.259 [2024-04-16 23:04:12.140561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.259 [2024-04-16 23:04:12.140674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.259 [2024-04-16 23:04:12.140701] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.259 qpair failed and we were unable to recover it. 00:26:21.259 [2024-04-16 23:04:12.140892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.259 [2024-04-16 23:04:12.141039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.259 [2024-04-16 23:04:12.141064] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.259 qpair failed and we were unable to recover it. 00:26:21.259 [2024-04-16 23:04:12.141222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.259 [2024-04-16 23:04:12.141391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.259 [2024-04-16 23:04:12.141417] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.259 qpair failed and we were unable to recover it. 00:26:21.259 [2024-04-16 23:04:12.141561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.259 [2024-04-16 23:04:12.141704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.259 [2024-04-16 23:04:12.141729] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.259 qpair failed and we were unable to recover it. 00:26:21.260 [2024-04-16 23:04:12.141873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.260 [2024-04-16 23:04:12.142017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.260 [2024-04-16 23:04:12.142042] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.260 qpair failed and we were unable to recover it. 00:26:21.260 [2024-04-16 23:04:12.142220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.260 [2024-04-16 23:04:12.142330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.260 [2024-04-16 23:04:12.142354] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.260 qpair failed and we were unable to recover it. 00:26:21.260 [2024-04-16 23:04:12.142472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.260 [2024-04-16 23:04:12.142597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.260 [2024-04-16 23:04:12.142622] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.260 qpair failed and we were unable to recover it. 00:26:21.260 [2024-04-16 23:04:12.142732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.260 [2024-04-16 23:04:12.142885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.260 [2024-04-16 23:04:12.142914] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.260 qpair failed and we were unable to recover it. 00:26:21.260 [2024-04-16 23:04:12.143058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.260 [2024-04-16 23:04:12.143210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.260 [2024-04-16 23:04:12.143236] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.260 qpair failed and we were unable to recover it. 00:26:21.260 [2024-04-16 23:04:12.143348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.260 [2024-04-16 23:04:12.143467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.260 [2024-04-16 23:04:12.143492] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.260 qpair failed and we were unable to recover it. 00:26:21.260 [2024-04-16 23:04:12.143665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.260 [2024-04-16 23:04:12.143782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.260 [2024-04-16 23:04:12.143808] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.260 qpair failed and we were unable to recover it. 00:26:21.260 [2024-04-16 23:04:12.143984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.260 [2024-04-16 23:04:12.144102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.260 [2024-04-16 23:04:12.144127] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.260 qpair failed and we were unable to recover it. 00:26:21.260 [2024-04-16 23:04:12.144271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.260 [2024-04-16 23:04:12.144384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.260 [2024-04-16 23:04:12.144409] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.260 qpair failed and we were unable to recover it. 00:26:21.260 [2024-04-16 23:04:12.144574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.260 [2024-04-16 23:04:12.144721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.260 [2024-04-16 23:04:12.144750] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.260 qpair failed and we were unable to recover it. 00:26:21.260 [2024-04-16 23:04:12.144856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.260 [2024-04-16 23:04:12.145000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.260 [2024-04-16 23:04:12.145025] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.260 qpair failed and we were unable to recover it. 00:26:21.260 [2024-04-16 23:04:12.145182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.260 [2024-04-16 23:04:12.145319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.260 [2024-04-16 23:04:12.145345] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.260 qpair failed and we were unable to recover it. 00:26:21.260 [2024-04-16 23:04:12.145476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.260 [2024-04-16 23:04:12.145703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.260 [2024-04-16 23:04:12.145728] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.260 qpair failed and we were unable to recover it. 00:26:21.260 [2024-04-16 23:04:12.145868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.260 [2024-04-16 23:04:12.145979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.260 [2024-04-16 23:04:12.146010] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.260 qpair failed and we were unable to recover it. 00:26:21.260 [2024-04-16 23:04:12.146118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.260 [2024-04-16 23:04:12.146273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.260 [2024-04-16 23:04:12.146299] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.260 qpair failed and we were unable to recover it. 00:26:21.260 [2024-04-16 23:04:12.146439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.260 [2024-04-16 23:04:12.146637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.260 [2024-04-16 23:04:12.146681] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.260 qpair failed and we were unable to recover it. 00:26:21.260 [2024-04-16 23:04:12.146852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.260 [2024-04-16 23:04:12.146990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.260 [2024-04-16 23:04:12.147015] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.260 qpair failed and we were unable to recover it. 00:26:21.260 [2024-04-16 23:04:12.147152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.260 [2024-04-16 23:04:12.147273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.260 [2024-04-16 23:04:12.147299] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.260 qpair failed and we were unable to recover it. 00:26:21.260 [2024-04-16 23:04:12.147477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.260 [2024-04-16 23:04:12.147645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.260 [2024-04-16 23:04:12.147687] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.260 qpair failed and we were unable to recover it. 00:26:21.260 [2024-04-16 23:04:12.147897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.260 [2024-04-16 23:04:12.148025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.260 [2024-04-16 23:04:12.148050] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.260 qpair failed and we were unable to recover it. 00:26:21.260 [2024-04-16 23:04:12.148195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.260 [2024-04-16 23:04:12.148342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.260 [2024-04-16 23:04:12.148368] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.260 qpair failed and we were unable to recover it. 00:26:21.260 [2024-04-16 23:04:12.148505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.260 [2024-04-16 23:04:12.148691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.260 [2024-04-16 23:04:12.148718] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.260 qpair failed and we were unable to recover it. 00:26:21.260 [2024-04-16 23:04:12.148898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.260 [2024-04-16 23:04:12.149064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.260 [2024-04-16 23:04:12.149090] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.260 qpair failed and we were unable to recover it. 00:26:21.260 [2024-04-16 23:04:12.149236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.260 [2024-04-16 23:04:12.149384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.260 [2024-04-16 23:04:12.149432] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.260 qpair failed and we were unable to recover it. 00:26:21.260 [2024-04-16 23:04:12.149620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.260 [2024-04-16 23:04:12.149810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.260 [2024-04-16 23:04:12.149852] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.260 qpair failed and we were unable to recover it. 00:26:21.260 [2024-04-16 23:04:12.149958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.260 [2024-04-16 23:04:12.150098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.260 [2024-04-16 23:04:12.150130] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.260 qpair failed and we were unable to recover it. 00:26:21.260 [2024-04-16 23:04:12.150308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.260 [2024-04-16 23:04:12.150520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.260 [2024-04-16 23:04:12.150562] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.260 qpair failed and we were unable to recover it. 00:26:21.260 [2024-04-16 23:04:12.150698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.261 [2024-04-16 23:04:12.150882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.261 [2024-04-16 23:04:12.150908] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.261 qpair failed and we were unable to recover it. 00:26:21.261 [2024-04-16 23:04:12.151093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.261 [2024-04-16 23:04:12.151251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.261 [2024-04-16 23:04:12.151279] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.261 qpair failed and we were unable to recover it. 00:26:21.261 [2024-04-16 23:04:12.151493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.261 [2024-04-16 23:04:12.151713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.261 [2024-04-16 23:04:12.151760] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.261 qpair failed and we were unable to recover it. 00:26:21.261 [2024-04-16 23:04:12.151872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.261 [2024-04-16 23:04:12.151989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.261 [2024-04-16 23:04:12.152014] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.261 qpair failed and we were unable to recover it. 00:26:21.261 [2024-04-16 23:04:12.152155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.261 [2024-04-16 23:04:12.152310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.261 [2024-04-16 23:04:12.152336] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.261 qpair failed and we were unable to recover it. 00:26:21.261 [2024-04-16 23:04:12.152452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.261 [2024-04-16 23:04:12.152561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.261 [2024-04-16 23:04:12.152586] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.261 qpair failed and we were unable to recover it. 00:26:21.261 [2024-04-16 23:04:12.152736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.261 [2024-04-16 23:04:12.152877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.261 [2024-04-16 23:04:12.152908] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.261 qpair failed and we were unable to recover it. 00:26:21.261 [2024-04-16 23:04:12.153049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.261 [2024-04-16 23:04:12.153196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.261 [2024-04-16 23:04:12.153224] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.261 qpair failed and we were unable to recover it. 00:26:21.261 [2024-04-16 23:04:12.153388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.261 [2024-04-16 23:04:12.153585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.261 [2024-04-16 23:04:12.153627] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.261 qpair failed and we were unable to recover it. 00:26:21.261 [2024-04-16 23:04:12.153763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.261 [2024-04-16 23:04:12.153878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.261 [2024-04-16 23:04:12.153904] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.261 qpair failed and we were unable to recover it. 00:26:21.261 [2024-04-16 23:04:12.154046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.261 [2024-04-16 23:04:12.154184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.261 [2024-04-16 23:04:12.154210] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.261 qpair failed and we were unable to recover it. 00:26:21.261 [2024-04-16 23:04:12.154401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.261 [2024-04-16 23:04:12.154574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.261 [2024-04-16 23:04:12.154617] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.261 qpair failed and we were unable to recover it. 00:26:21.261 [2024-04-16 23:04:12.154785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.261 [2024-04-16 23:04:12.154939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.261 [2024-04-16 23:04:12.154964] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.261 qpair failed and we were unable to recover it. 00:26:21.261 [2024-04-16 23:04:12.155077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.261 [2024-04-16 23:04:12.155187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.261 [2024-04-16 23:04:12.155213] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.261 qpair failed and we were unable to recover it. 00:26:21.261 [2024-04-16 23:04:12.155379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.261 [2024-04-16 23:04:12.155568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.261 [2024-04-16 23:04:12.155612] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.261 qpair failed and we were unable to recover it. 00:26:21.261 [2024-04-16 23:04:12.155787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.261 [2024-04-16 23:04:12.155922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.261 [2024-04-16 23:04:12.155947] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.261 qpair failed and we were unable to recover it. 00:26:21.261 [2024-04-16 23:04:12.156089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.261 [2024-04-16 23:04:12.156247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.261 [2024-04-16 23:04:12.156275] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.261 qpair failed and we were unable to recover it. 00:26:21.261 [2024-04-16 23:04:12.156439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.261 [2024-04-16 23:04:12.156602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.261 [2024-04-16 23:04:12.156643] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.261 qpair failed and we were unable to recover it. 00:26:21.261 [2024-04-16 23:04:12.156764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.261 [2024-04-16 23:04:12.156907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.261 [2024-04-16 23:04:12.156943] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.261 qpair failed and we were unable to recover it. 00:26:21.261 [2024-04-16 23:04:12.157069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.261 [2024-04-16 23:04:12.157240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.261 [2024-04-16 23:04:12.157283] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.261 qpair failed and we were unable to recover it. 00:26:21.261 [2024-04-16 23:04:12.157398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.261 [2024-04-16 23:04:12.157528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.261 [2024-04-16 23:04:12.157556] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.261 qpair failed and we were unable to recover it. 00:26:21.261 [2024-04-16 23:04:12.157670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.261 [2024-04-16 23:04:12.157826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.261 [2024-04-16 23:04:12.157853] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.261 qpair failed and we were unable to recover it. 00:26:21.261 [2024-04-16 23:04:12.157991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.261 [2024-04-16 23:04:12.158115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.261 [2024-04-16 23:04:12.158141] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.261 qpair failed and we were unable to recover it. 00:26:21.261 [2024-04-16 23:04:12.158282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.261 [2024-04-16 23:04:12.158467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.261 [2024-04-16 23:04:12.158511] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.261 qpair failed and we were unable to recover it. 00:26:21.261 [2024-04-16 23:04:12.158660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.261 [2024-04-16 23:04:12.158804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.261 [2024-04-16 23:04:12.158829] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.261 qpair failed and we were unable to recover it. 00:26:21.261 [2024-04-16 23:04:12.158944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.261 [2024-04-16 23:04:12.159064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.261 [2024-04-16 23:04:12.159090] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.261 qpair failed and we were unable to recover it. 00:26:21.261 [2024-04-16 23:04:12.159900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.261 [2024-04-16 23:04:12.160060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.261 [2024-04-16 23:04:12.160087] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.261 qpair failed and we were unable to recover it. 00:26:21.261 [2024-04-16 23:04:12.160275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.261 [2024-04-16 23:04:12.160452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.262 [2024-04-16 23:04:12.160496] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.262 qpair failed and we were unable to recover it. 00:26:21.262 [2024-04-16 23:04:12.160660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.262 [2024-04-16 23:04:12.160823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.262 [2024-04-16 23:04:12.160849] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.262 qpair failed and we were unable to recover it. 00:26:21.262 [2024-04-16 23:04:12.160972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.262 [2024-04-16 23:04:12.161152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.262 [2024-04-16 23:04:12.161186] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.262 qpair failed and we were unable to recover it. 00:26:21.262 [2024-04-16 23:04:12.161343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.262 [2024-04-16 23:04:12.161471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.262 [2024-04-16 23:04:12.161498] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.262 qpair failed and we were unable to recover it. 00:26:21.262 [2024-04-16 23:04:12.161665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.262 [2024-04-16 23:04:12.161831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.262 [2024-04-16 23:04:12.161858] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.262 qpair failed and we were unable to recover it. 00:26:21.262 [2024-04-16 23:04:12.162010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.262 [2024-04-16 23:04:12.162125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.262 [2024-04-16 23:04:12.162151] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.262 qpair failed and we were unable to recover it. 00:26:21.262 [2024-04-16 23:04:12.162331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.262 [2024-04-16 23:04:12.162492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.262 [2024-04-16 23:04:12.162521] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.262 qpair failed and we were unable to recover it. 00:26:21.262 [2024-04-16 23:04:12.162670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.262 [2024-04-16 23:04:12.162832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.262 [2024-04-16 23:04:12.162858] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.262 qpair failed and we were unable to recover it. 00:26:21.262 [2024-04-16 23:04:12.162979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.262 [2024-04-16 23:04:12.163123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.262 [2024-04-16 23:04:12.163149] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.262 qpair failed and we were unable to recover it. 00:26:21.262 [2024-04-16 23:04:12.163272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.262 [2024-04-16 23:04:12.163430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.262 [2024-04-16 23:04:12.163473] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.262 qpair failed and we were unable to recover it. 00:26:21.262 [2024-04-16 23:04:12.163653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.262 [2024-04-16 23:04:12.163824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.262 [2024-04-16 23:04:12.163850] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.262 qpair failed and we were unable to recover it. 00:26:21.262 [2024-04-16 23:04:12.163991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.262 [2024-04-16 23:04:12.164138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.262 [2024-04-16 23:04:12.164163] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.262 qpair failed and we were unable to recover it. 00:26:21.262 [2024-04-16 23:04:12.164361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.262 [2024-04-16 23:04:12.164515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.262 [2024-04-16 23:04:12.164558] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.262 qpair failed and we were unable to recover it. 00:26:21.262 [2024-04-16 23:04:12.164697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.262 [2024-04-16 23:04:12.164855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.262 [2024-04-16 23:04:12.164881] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.262 qpair failed and we were unable to recover it. 00:26:21.262 [2024-04-16 23:04:12.165000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.262 [2024-04-16 23:04:12.165116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.262 [2024-04-16 23:04:12.165141] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.262 qpair failed and we were unable to recover it. 00:26:21.262 [2024-04-16 23:04:12.165339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.262 [2024-04-16 23:04:12.165522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.262 [2024-04-16 23:04:12.165564] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.262 qpair failed and we were unable to recover it. 00:26:21.262 [2024-04-16 23:04:12.165730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.262 [2024-04-16 23:04:12.165922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.262 [2024-04-16 23:04:12.165948] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.262 qpair failed and we were unable to recover it. 00:26:21.262 [2024-04-16 23:04:12.166091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.262 [2024-04-16 23:04:12.166256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.262 [2024-04-16 23:04:12.166304] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.262 qpair failed and we were unable to recover it. 00:26:21.262 [2024-04-16 23:04:12.166468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.262 [2024-04-16 23:04:12.166642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.262 [2024-04-16 23:04:12.166684] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.262 qpair failed and we were unable to recover it. 00:26:21.262 [2024-04-16 23:04:12.166841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.262 [2024-04-16 23:04:12.167007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.262 [2024-04-16 23:04:12.167032] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.262 qpair failed and we were unable to recover it. 00:26:21.262 [2024-04-16 23:04:12.167217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.262 [2024-04-16 23:04:12.167351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.262 [2024-04-16 23:04:12.167394] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.262 qpair failed and we were unable to recover it. 00:26:21.262 [2024-04-16 23:04:12.167579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.262 [2024-04-16 23:04:12.167729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.262 [2024-04-16 23:04:12.167772] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.262 qpair failed and we were unable to recover it. 00:26:21.262 [2024-04-16 23:04:12.167915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.262 [2024-04-16 23:04:12.168050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.263 [2024-04-16 23:04:12.168075] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.263 qpair failed and we were unable to recover it. 00:26:21.263 [2024-04-16 23:04:12.168243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.263 [2024-04-16 23:04:12.168401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.263 [2024-04-16 23:04:12.168426] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.263 qpair failed and we were unable to recover it. 00:26:21.263 [2024-04-16 23:04:12.168580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.263 [2024-04-16 23:04:12.168698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.263 [2024-04-16 23:04:12.168722] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.263 qpair failed and we were unable to recover it. 00:26:21.263 [2024-04-16 23:04:12.168864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.263 [2024-04-16 23:04:12.168973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.263 [2024-04-16 23:04:12.168998] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.263 qpair failed and we were unable to recover it. 00:26:21.263 [2024-04-16 23:04:12.169136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.263 [2024-04-16 23:04:12.169265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.263 [2024-04-16 23:04:12.169290] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.263 qpair failed and we were unable to recover it. 00:26:21.263 [2024-04-16 23:04:12.169428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.263 [2024-04-16 23:04:12.169601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.263 [2024-04-16 23:04:12.169627] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.263 qpair failed and we were unable to recover it. 00:26:21.263 [2024-04-16 23:04:12.169764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.263 [2024-04-16 23:04:12.169936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.263 [2024-04-16 23:04:12.169961] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.263 qpair failed and we were unable to recover it. 00:26:21.263 [2024-04-16 23:04:12.170102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.263 [2024-04-16 23:04:12.170237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.263 [2024-04-16 23:04:12.170266] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.263 qpair failed and we were unable to recover it. 00:26:21.263 [2024-04-16 23:04:12.170456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.263 [2024-04-16 23:04:12.170669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.263 [2024-04-16 23:04:12.170712] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.263 qpair failed and we were unable to recover it. 00:26:21.263 [2024-04-16 23:04:12.170883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.263 [2024-04-16 23:04:12.171047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.263 [2024-04-16 23:04:12.171072] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.263 qpair failed and we were unable to recover it. 00:26:21.263 [2024-04-16 23:04:12.171185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.263 [2024-04-16 23:04:12.171321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.263 [2024-04-16 23:04:12.171364] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.263 qpair failed and we were unable to recover it. 00:26:21.263 [2024-04-16 23:04:12.171558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.263 [2024-04-16 23:04:12.171755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.263 [2024-04-16 23:04:12.171782] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.263 qpair failed and we were unable to recover it. 00:26:21.263 [2024-04-16 23:04:12.171923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.263 [2024-04-16 23:04:12.172089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.263 [2024-04-16 23:04:12.172114] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.263 qpair failed and we were unable to recover it. 00:26:21.263 [2024-04-16 23:04:12.172262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.263 [2024-04-16 23:04:12.172455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.263 [2024-04-16 23:04:12.172506] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.263 qpair failed and we were unable to recover it. 00:26:21.263 [2024-04-16 23:04:12.172688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.263 [2024-04-16 23:04:12.172845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.263 [2024-04-16 23:04:12.172871] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.263 qpair failed and we were unable to recover it. 00:26:21.263 [2024-04-16 23:04:12.173012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.263 [2024-04-16 23:04:12.173156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.263 [2024-04-16 23:04:12.173189] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.263 qpair failed and we were unable to recover it. 00:26:21.263 [2024-04-16 23:04:12.173365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.263 [2024-04-16 23:04:12.173519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.263 [2024-04-16 23:04:12.173561] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.263 qpair failed and we were unable to recover it. 00:26:21.263 [2024-04-16 23:04:12.173717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.263 [2024-04-16 23:04:12.173840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.263 [2024-04-16 23:04:12.173865] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.263 qpair failed and we were unable to recover it. 00:26:21.263 [2024-04-16 23:04:12.174024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.263 [2024-04-16 23:04:12.174173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.263 [2024-04-16 23:04:12.174206] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.263 qpair failed and we were unable to recover it. 00:26:21.263 [2024-04-16 23:04:12.174316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.263 [2024-04-16 23:04:12.174454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.263 [2024-04-16 23:04:12.174478] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.263 qpair failed and we were unable to recover it. 00:26:21.263 [2024-04-16 23:04:12.174634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.263 [2024-04-16 23:04:12.174747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.263 [2024-04-16 23:04:12.174772] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.263 qpair failed and we were unable to recover it. 00:26:21.263 [2024-04-16 23:04:12.174947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.263 [2024-04-16 23:04:12.175092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.263 [2024-04-16 23:04:12.175117] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.263 qpair failed and we were unable to recover it. 00:26:21.263 [2024-04-16 23:04:12.175309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.263 [2024-04-16 23:04:12.175459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.263 [2024-04-16 23:04:12.175506] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.263 qpair failed and we were unable to recover it. 00:26:21.263 [2024-04-16 23:04:12.175635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.263 [2024-04-16 23:04:12.175844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.263 [2024-04-16 23:04:12.175886] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.263 qpair failed and we were unable to recover it. 00:26:21.263 [2024-04-16 23:04:12.176023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.263 [2024-04-16 23:04:12.176167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.263 [2024-04-16 23:04:12.176198] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.263 qpair failed and we were unable to recover it. 00:26:21.263 [2024-04-16 23:04:12.176388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.263 [2024-04-16 23:04:12.176593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.263 [2024-04-16 23:04:12.176636] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.263 qpair failed and we were unable to recover it. 00:26:21.264 [2024-04-16 23:04:12.176824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.264 [2024-04-16 23:04:12.176972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.264 [2024-04-16 23:04:12.176997] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.264 qpair failed and we were unable to recover it. 00:26:21.264 [2024-04-16 23:04:12.177181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.264 [2024-04-16 23:04:12.177335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.264 [2024-04-16 23:04:12.177361] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.264 qpair failed and we were unable to recover it. 00:26:21.264 [2024-04-16 23:04:12.177499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.264 [2024-04-16 23:04:12.177612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.264 [2024-04-16 23:04:12.177637] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.264 qpair failed and we were unable to recover it. 00:26:21.264 [2024-04-16 23:04:12.177775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.264 [2024-04-16 23:04:12.177895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.264 [2024-04-16 23:04:12.177922] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.264 qpair failed and we were unable to recover it. 00:26:21.264 [2024-04-16 23:04:12.178045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.264 [2024-04-16 23:04:12.178243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.264 [2024-04-16 23:04:12.178286] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.264 qpair failed and we were unable to recover it. 00:26:21.264 [2024-04-16 23:04:12.178440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.264 [2024-04-16 23:04:12.178617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.264 [2024-04-16 23:04:12.178660] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.264 qpair failed and we were unable to recover it. 00:26:21.264 [2024-04-16 23:04:12.178786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.264 [2024-04-16 23:04:12.178932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.264 [2024-04-16 23:04:12.178957] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.264 qpair failed and we were unable to recover it. 00:26:21.264 [2024-04-16 23:04:12.179073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.264 [2024-04-16 23:04:12.179182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.264 [2024-04-16 23:04:12.179208] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.264 qpair failed and we were unable to recover it. 00:26:21.264 [2024-04-16 23:04:12.179356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.264 [2024-04-16 23:04:12.179464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.264 [2024-04-16 23:04:12.179491] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.264 qpair failed and we were unable to recover it. 00:26:21.264 [2024-04-16 23:04:12.179638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.264 [2024-04-16 23:04:12.179786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.264 [2024-04-16 23:04:12.179811] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.264 qpair failed and we were unable to recover it. 00:26:21.264 [2024-04-16 23:04:12.179958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.264 [2024-04-16 23:04:12.180095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.264 [2024-04-16 23:04:12.180120] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.264 qpair failed and we were unable to recover it. 00:26:21.264 [2024-04-16 23:04:12.180273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.264 [2024-04-16 23:04:12.180407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.264 [2024-04-16 23:04:12.180434] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.264 qpair failed and we were unable to recover it. 00:26:21.264 [2024-04-16 23:04:12.180604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.264 [2024-04-16 23:04:12.180765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.264 [2024-04-16 23:04:12.180790] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.264 qpair failed and we were unable to recover it. 00:26:21.264 [2024-04-16 23:04:12.180929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.264 [2024-04-16 23:04:12.181106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.264 [2024-04-16 23:04:12.181131] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.264 qpair failed and we were unable to recover it. 00:26:21.264 [2024-04-16 23:04:12.181340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.264 [2024-04-16 23:04:12.181515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.264 [2024-04-16 23:04:12.181556] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.264 qpair failed and we were unable to recover it. 00:26:21.264 [2024-04-16 23:04:12.181681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.264 [2024-04-16 23:04:12.181842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.264 [2024-04-16 23:04:12.181875] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.264 qpair failed and we were unable to recover it. 00:26:21.264 [2024-04-16 23:04:12.182030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.264 [2024-04-16 23:04:12.182190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.264 [2024-04-16 23:04:12.182233] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.264 qpair failed and we were unable to recover it. 00:26:21.264 [2024-04-16 23:04:12.182413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.264 [2024-04-16 23:04:12.182605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.264 [2024-04-16 23:04:12.182648] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.264 qpair failed and we were unable to recover it. 00:26:21.264 [2024-04-16 23:04:12.182800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.264 [2024-04-16 23:04:12.182970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.264 [2024-04-16 23:04:12.182995] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.264 qpair failed and we were unable to recover it. 00:26:21.264 [2024-04-16 23:04:12.183140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.264 [2024-04-16 23:04:12.183287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.264 [2024-04-16 23:04:12.183312] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.264 qpair failed and we were unable to recover it. 00:26:21.264 [2024-04-16 23:04:12.183492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.264 [2024-04-16 23:04:12.183639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.264 [2024-04-16 23:04:12.183664] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.264 qpair failed and we were unable to recover it. 00:26:21.264 [2024-04-16 23:04:12.183800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.264 [2024-04-16 23:04:12.183977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.264 [2024-04-16 23:04:12.184002] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.264 qpair failed and we were unable to recover it. 00:26:21.264 [2024-04-16 23:04:12.184135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.264 [2024-04-16 23:04:12.184800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.264 [2024-04-16 23:04:12.184830] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.264 qpair failed and we were unable to recover it. 00:26:21.264 [2024-04-16 23:04:12.185000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.264 [2024-04-16 23:04:12.185142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.264 [2024-04-16 23:04:12.185167] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.264 qpair failed and we were unable to recover it. 00:26:21.264 [2024-04-16 23:04:12.185358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.264 [2024-04-16 23:04:12.185507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.264 [2024-04-16 23:04:12.185550] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.264 qpair failed and we were unable to recover it. 00:26:21.264 [2024-04-16 23:04:12.185668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.264 [2024-04-16 23:04:12.185854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.264 [2024-04-16 23:04:12.185881] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.264 qpair failed and we were unable to recover it. 00:26:21.264 [2024-04-16 23:04:12.185995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.264 [2024-04-16 23:04:12.186137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.264 [2024-04-16 23:04:12.186163] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.264 qpair failed and we were unable to recover it. 00:26:21.265 [2024-04-16 23:04:12.186302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.265 [2024-04-16 23:04:12.186480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.265 [2024-04-16 23:04:12.186522] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.265 qpair failed and we were unable to recover it. 00:26:21.265 [2024-04-16 23:04:12.186726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.265 [2024-04-16 23:04:12.186915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.265 [2024-04-16 23:04:12.186940] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.265 qpair failed and we were unable to recover it. 00:26:21.265 [2024-04-16 23:04:12.187082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.265 [2024-04-16 23:04:12.187225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.265 [2024-04-16 23:04:12.187252] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.265 qpair failed and we were unable to recover it. 00:26:21.265 [2024-04-16 23:04:12.187393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.265 [2024-04-16 23:04:12.187539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.265 [2024-04-16 23:04:12.187581] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.265 qpair failed and we were unable to recover it. 00:26:21.265 [2024-04-16 23:04:12.187778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.265 [2024-04-16 23:04:12.187962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.265 [2024-04-16 23:04:12.187987] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.265 qpair failed and we were unable to recover it. 00:26:21.265 [2024-04-16 23:04:12.188095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.265 [2024-04-16 23:04:12.188238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.265 [2024-04-16 23:04:12.188281] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.265 qpair failed and we were unable to recover it. 00:26:21.265 [2024-04-16 23:04:12.188471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.265 [2024-04-16 23:04:12.188645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.265 [2024-04-16 23:04:12.188687] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.265 qpair failed and we were unable to recover it. 00:26:21.265 [2024-04-16 23:04:12.188848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.265 [2024-04-16 23:04:12.188971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.265 [2024-04-16 23:04:12.188996] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.265 qpair failed and we were unable to recover it. 00:26:21.265 [2024-04-16 23:04:12.189144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.265 [2024-04-16 23:04:12.189307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.265 [2024-04-16 23:04:12.189351] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.265 qpair failed and we were unable to recover it. 00:26:21.265 [2024-04-16 23:04:12.189490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.265 [2024-04-16 23:04:12.189671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.265 [2024-04-16 23:04:12.189696] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.265 qpair failed and we were unable to recover it. 00:26:21.265 [2024-04-16 23:04:12.189810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.265 [2024-04-16 23:04:12.189953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.265 [2024-04-16 23:04:12.189978] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.265 qpair failed and we were unable to recover it. 00:26:21.265 [2024-04-16 23:04:12.190112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.265 [2024-04-16 23:04:12.190280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.265 [2024-04-16 23:04:12.190323] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.265 qpair failed and we were unable to recover it. 00:26:21.265 [2024-04-16 23:04:12.190456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.265 [2024-04-16 23:04:12.190655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.265 [2024-04-16 23:04:12.190682] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.265 qpair failed and we were unable to recover it. 00:26:21.265 [2024-04-16 23:04:12.190842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.265 [2024-04-16 23:04:12.191026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.265 [2024-04-16 23:04:12.191051] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.265 qpair failed and we were unable to recover it. 00:26:21.265 [2024-04-16 23:04:12.191188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.265 [2024-04-16 23:04:12.191316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.265 [2024-04-16 23:04:12.191358] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.265 qpair failed and we were unable to recover it. 00:26:21.265 [2024-04-16 23:04:12.191490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.265 [2024-04-16 23:04:12.191709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.265 [2024-04-16 23:04:12.191752] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.265 qpair failed and we were unable to recover it. 00:26:21.265 [2024-04-16 23:04:12.191900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.265 [2024-04-16 23:04:12.192045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.265 [2024-04-16 23:04:12.192070] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.265 qpair failed and we were unable to recover it. 00:26:21.265 [2024-04-16 23:04:12.192245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.265 [2024-04-16 23:04:12.192423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.265 [2024-04-16 23:04:12.192451] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.265 qpair failed and we were unable to recover it. 00:26:21.265 [2024-04-16 23:04:12.192614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.265 [2024-04-16 23:04:12.192790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.265 [2024-04-16 23:04:12.192815] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.265 qpair failed and we were unable to recover it. 00:26:21.265 [2024-04-16 23:04:12.192964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.265 [2024-04-16 23:04:12.193092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.265 [2024-04-16 23:04:12.193116] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.265 qpair failed and we were unable to recover it. 00:26:21.265 [2024-04-16 23:04:12.193292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.265 [2024-04-16 23:04:12.193472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.265 [2024-04-16 23:04:12.193514] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.265 qpair failed and we were unable to recover it. 00:26:21.265 [2024-04-16 23:04:12.193677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.265 [2024-04-16 23:04:12.193840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.265 [2024-04-16 23:04:12.193867] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.265 qpair failed and we were unable to recover it. 00:26:21.265 [2024-04-16 23:04:12.194013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.265 [2024-04-16 23:04:12.194186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.265 [2024-04-16 23:04:12.194212] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.265 qpair failed and we were unable to recover it. 00:26:21.265 [2024-04-16 23:04:12.194375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.265 [2024-04-16 23:04:12.194554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.265 [2024-04-16 23:04:12.194599] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.265 qpair failed and we were unable to recover it. 00:26:21.265 [2024-04-16 23:04:12.194791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.265 [2024-04-16 23:04:12.194974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.265 [2024-04-16 23:04:12.195001] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.265 qpair failed and we were unable to recover it. 00:26:21.265 [2024-04-16 23:04:12.195135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.265 [2024-04-16 23:04:12.195336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.265 [2024-04-16 23:04:12.195380] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.265 qpair failed and we were unable to recover it. 00:26:21.266 [2024-04-16 23:04:12.195536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.266 [2024-04-16 23:04:12.195711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.266 [2024-04-16 23:04:12.195753] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.266 qpair failed and we were unable to recover it. 00:26:21.266 [2024-04-16 23:04:12.195915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.266 [2024-04-16 23:04:12.196112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.266 [2024-04-16 23:04:12.196137] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.266 qpair failed and we were unable to recover it. 00:26:21.266 [2024-04-16 23:04:12.196270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.266 [2024-04-16 23:04:12.196450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.266 [2024-04-16 23:04:12.196477] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.266 qpair failed and we were unable to recover it. 00:26:21.266 [2024-04-16 23:04:12.196668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.266 [2024-04-16 23:04:12.196817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.266 [2024-04-16 23:04:12.196859] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.266 qpair failed and we were unable to recover it. 00:26:21.266 [2024-04-16 23:04:12.196965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.266 [2024-04-16 23:04:12.197106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.266 [2024-04-16 23:04:12.197130] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.266 qpair failed and we were unable to recover it. 00:26:21.266 [2024-04-16 23:04:12.197264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.266 [2024-04-16 23:04:12.197449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.266 [2024-04-16 23:04:12.197473] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.266 qpair failed and we were unable to recover it. 00:26:21.266 [2024-04-16 23:04:12.197615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.266 [2024-04-16 23:04:12.197759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.266 [2024-04-16 23:04:12.197785] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.266 qpair failed and we were unable to recover it. 00:26:21.266 [2024-04-16 23:04:12.197900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.266 [2024-04-16 23:04:12.198039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.266 [2024-04-16 23:04:12.198064] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.266 qpair failed and we were unable to recover it. 00:26:21.266 [2024-04-16 23:04:12.198171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.266 [2024-04-16 23:04:12.198344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.266 [2024-04-16 23:04:12.198370] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.266 qpair failed and we were unable to recover it. 00:26:21.266 [2024-04-16 23:04:12.198492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.266 [2024-04-16 23:04:12.198611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.266 [2024-04-16 23:04:12.198639] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.266 qpair failed and we were unable to recover it. 00:26:21.266 [2024-04-16 23:04:12.198806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.266 [2024-04-16 23:04:12.198915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.266 [2024-04-16 23:04:12.198940] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.266 qpair failed and we were unable to recover it. 00:26:21.266 [2024-04-16 23:04:12.199081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.266 [2024-04-16 23:04:12.199198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.266 [2024-04-16 23:04:12.199224] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.266 qpair failed and we were unable to recover it. 00:26:21.266 [2024-04-16 23:04:12.199422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.266 [2024-04-16 23:04:12.199635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.266 [2024-04-16 23:04:12.199677] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.266 qpair failed and we were unable to recover it. 00:26:21.266 [2024-04-16 23:04:12.199878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.266 [2024-04-16 23:04:12.200018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.266 [2024-04-16 23:04:12.200044] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.266 qpair failed and we were unable to recover it. 00:26:21.266 [2024-04-16 23:04:12.200183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.266 [2024-04-16 23:04:12.200309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.266 [2024-04-16 23:04:12.200351] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.266 qpair failed and we were unable to recover it. 00:26:21.266 [2024-04-16 23:04:12.200481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.266 [2024-04-16 23:04:12.200661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.266 [2024-04-16 23:04:12.200689] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.266 qpair failed and we were unable to recover it. 00:26:21.266 [2024-04-16 23:04:12.200844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.266 [2024-04-16 23:04:12.200990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.266 [2024-04-16 23:04:12.201016] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.266 qpair failed and we were unable to recover it. 00:26:21.266 [2024-04-16 23:04:12.201213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.266 [2024-04-16 23:04:12.201355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.266 [2024-04-16 23:04:12.201380] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.266 qpair failed and we were unable to recover it. 00:26:21.266 [2024-04-16 23:04:12.201569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.266 [2024-04-16 23:04:12.201715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.266 [2024-04-16 23:04:12.201741] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.266 qpair failed and we were unable to recover it. 00:26:21.266 [2024-04-16 23:04:12.201942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.266 [2024-04-16 23:04:12.202095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.266 [2024-04-16 23:04:12.202124] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.266 qpair failed and we were unable to recover it. 00:26:21.266 [2024-04-16 23:04:12.202236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.266 [2024-04-16 23:04:12.202399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.266 [2024-04-16 23:04:12.202442] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.266 qpair failed and we were unable to recover it. 00:26:21.266 [2024-04-16 23:04:12.202626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.266 [2024-04-16 23:04:12.202803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.266 [2024-04-16 23:04:12.202845] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.266 qpair failed and we were unable to recover it. 00:26:21.266 [2024-04-16 23:04:12.203016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.266 [2024-04-16 23:04:12.203129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.266 [2024-04-16 23:04:12.203154] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.266 qpair failed and we were unable to recover it. 00:26:21.266 [2024-04-16 23:04:12.203353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.266 [2024-04-16 23:04:12.203564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.266 [2024-04-16 23:04:12.203608] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.266 qpair failed and we were unable to recover it. 00:26:21.266 [2024-04-16 23:04:12.203761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.266 [2024-04-16 23:04:12.203967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.266 [2024-04-16 23:04:12.204021] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.266 qpair failed and we were unable to recover it. 00:26:21.266 [2024-04-16 23:04:12.204185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.266 [2024-04-16 23:04:12.204394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.266 [2024-04-16 23:04:12.204437] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.266 qpair failed and we were unable to recover it. 00:26:21.266 [2024-04-16 23:04:12.204609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.267 [2024-04-16 23:04:12.204793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.267 [2024-04-16 23:04:12.204821] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.267 qpair failed and we were unable to recover it. 00:26:21.267 [2024-04-16 23:04:12.204978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.267 [2024-04-16 23:04:12.205146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.267 [2024-04-16 23:04:12.205171] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.267 qpair failed and we were unable to recover it. 00:26:21.267 [2024-04-16 23:04:12.205352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.267 [2024-04-16 23:04:12.205529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.267 [2024-04-16 23:04:12.205571] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.267 qpair failed and we were unable to recover it. 00:26:21.267 [2024-04-16 23:04:12.205736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.267 [2024-04-16 23:04:12.205943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.267 [2024-04-16 23:04:12.205991] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.267 qpair failed and we were unable to recover it. 00:26:21.267 [2024-04-16 23:04:12.206115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.267 [2024-04-16 23:04:12.206262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.267 [2024-04-16 23:04:12.206307] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.267 qpair failed and we were unable to recover it. 00:26:21.267 [2024-04-16 23:04:12.206462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.267 [2024-04-16 23:04:12.206601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.267 [2024-04-16 23:04:12.206635] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.267 qpair failed and we were unable to recover it. 00:26:21.267 [2024-04-16 23:04:12.206828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.267 [2024-04-16 23:04:12.207014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.267 [2024-04-16 23:04:12.207039] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.267 qpair failed and we were unable to recover it. 00:26:21.267 [2024-04-16 23:04:12.207207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.267 [2024-04-16 23:04:12.207368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.267 [2024-04-16 23:04:12.207410] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.267 qpair failed and we were unable to recover it. 00:26:21.267 [2024-04-16 23:04:12.207579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.267 [2024-04-16 23:04:12.207753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.267 [2024-04-16 23:04:12.207798] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.267 qpair failed and we were unable to recover it. 00:26:21.267 [2024-04-16 23:04:12.207903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.267 [2024-04-16 23:04:12.208074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.267 [2024-04-16 23:04:12.208099] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.267 qpair failed and we were unable to recover it. 00:26:21.267 [2024-04-16 23:04:12.208255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.267 [2024-04-16 23:04:12.208405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.267 [2024-04-16 23:04:12.208430] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.267 qpair failed and we were unable to recover it. 00:26:21.267 [2024-04-16 23:04:12.208571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.267 [2024-04-16 23:04:12.208713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.267 [2024-04-16 23:04:12.208740] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.267 qpair failed and we were unable to recover it. 00:26:21.267 [2024-04-16 23:04:12.208888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.267 [2024-04-16 23:04:12.209018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.267 [2024-04-16 23:04:12.209043] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.267 qpair failed and we were unable to recover it. 00:26:21.267 [2024-04-16 23:04:12.209212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.267 [2024-04-16 23:04:12.209317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.267 [2024-04-16 23:04:12.209342] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.267 qpair failed and we were unable to recover it. 00:26:21.267 [2024-04-16 23:04:12.209515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.267 [2024-04-16 23:04:12.209718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.267 [2024-04-16 23:04:12.209743] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.267 qpair failed and we were unable to recover it. 00:26:21.267 [2024-04-16 23:04:12.209886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.267 [2024-04-16 23:04:12.210001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.267 [2024-04-16 23:04:12.210026] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.267 qpair failed and we were unable to recover it. 00:26:21.267 [2024-04-16 23:04:12.210181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.267 [2024-04-16 23:04:12.210347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.267 [2024-04-16 23:04:12.210372] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.267 qpair failed and we were unable to recover it. 00:26:21.267 [2024-04-16 23:04:12.210508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.267 [2024-04-16 23:04:12.210616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.267 [2024-04-16 23:04:12.210641] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.267 qpair failed and we were unable to recover it. 00:26:21.267 [2024-04-16 23:04:12.210779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.267 [2024-04-16 23:04:12.210916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.267 [2024-04-16 23:04:12.210941] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.267 qpair failed and we were unable to recover it. 00:26:21.267 [2024-04-16 23:04:12.211087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.267 [2024-04-16 23:04:12.211253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.267 [2024-04-16 23:04:12.211279] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.267 qpair failed and we were unable to recover it. 00:26:21.268 [2024-04-16 23:04:12.211440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.268 [2024-04-16 23:04:12.211589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.268 [2024-04-16 23:04:12.211614] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.268 qpair failed and we were unable to recover it. 00:26:21.268 [2024-04-16 23:04:12.211778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.268 [2024-04-16 23:04:12.211888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.268 [2024-04-16 23:04:12.211913] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.268 qpair failed and we were unable to recover it. 00:26:21.268 [2024-04-16 23:04:12.212085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.268 [2024-04-16 23:04:12.212240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.268 [2024-04-16 23:04:12.212285] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.268 qpair failed and we were unable to recover it. 00:26:21.268 [2024-04-16 23:04:12.212458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.268 [2024-04-16 23:04:12.212615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.268 [2024-04-16 23:04:12.212657] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.268 qpair failed and we were unable to recover it. 00:26:21.268 [2024-04-16 23:04:12.212837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.268 [2024-04-16 23:04:12.212949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.268 [2024-04-16 23:04:12.212974] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.268 qpair failed and we were unable to recover it. 00:26:21.268 [2024-04-16 23:04:12.213109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.268 [2024-04-16 23:04:12.213252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.268 [2024-04-16 23:04:12.213299] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.268 qpair failed and we were unable to recover it. 00:26:21.268 [2024-04-16 23:04:12.213438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.268 [2024-04-16 23:04:12.213583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.268 [2024-04-16 23:04:12.213608] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.268 qpair failed and we were unable to recover it. 00:26:21.268 [2024-04-16 23:04:12.213750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.268 [2024-04-16 23:04:12.213858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.268 [2024-04-16 23:04:12.213882] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.268 qpair failed and we were unable to recover it. 00:26:21.268 [2024-04-16 23:04:12.213994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.268 [2024-04-16 23:04:12.214160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.268 [2024-04-16 23:04:12.214192] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.268 qpair failed and we were unable to recover it. 00:26:21.268 [2024-04-16 23:04:12.214303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.268 [2024-04-16 23:04:12.214474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.268 [2024-04-16 23:04:12.214500] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.268 qpair failed and we were unable to recover it. 00:26:21.268 [2024-04-16 23:04:12.214652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.268 [2024-04-16 23:04:12.214792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.268 [2024-04-16 23:04:12.214817] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.268 qpair failed and we were unable to recover it. 00:26:21.268 [2024-04-16 23:04:12.214942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.268 [2024-04-16 23:04:12.215082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.268 [2024-04-16 23:04:12.215107] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.268 qpair failed and we were unable to recover it. 00:26:21.268 [2024-04-16 23:04:12.215290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.268 [2024-04-16 23:04:12.215494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.268 [2024-04-16 23:04:12.215537] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.268 qpair failed and we were unable to recover it. 00:26:21.268 [2024-04-16 23:04:12.215667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.268 [2024-04-16 23:04:12.215827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.268 [2024-04-16 23:04:12.215852] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.268 qpair failed and we were unable to recover it. 00:26:21.268 [2024-04-16 23:04:12.215999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.268 [2024-04-16 23:04:12.216111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.268 [2024-04-16 23:04:12.216136] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.268 qpair failed and we were unable to recover it. 00:26:21.268 [2024-04-16 23:04:12.216303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.268 [2024-04-16 23:04:12.216476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.268 [2024-04-16 23:04:12.216504] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.268 qpair failed and we were unable to recover it. 00:26:21.268 [2024-04-16 23:04:12.216679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.268 [2024-04-16 23:04:12.216831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.268 [2024-04-16 23:04:12.216856] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.268 qpair failed and we were unable to recover it. 00:26:21.268 [2024-04-16 23:04:12.216997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.268 [2024-04-16 23:04:12.217133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.268 [2024-04-16 23:04:12.217158] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.268 qpair failed and we were unable to recover it. 00:26:21.268 [2024-04-16 23:04:12.217295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.268 [2024-04-16 23:04:12.217442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.268 [2024-04-16 23:04:12.217470] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.268 qpair failed and we were unable to recover it. 00:26:21.268 [2024-04-16 23:04:12.217645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.268 [2024-04-16 23:04:12.217796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.268 [2024-04-16 23:04:12.217821] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.268 qpair failed and we were unable to recover it. 00:26:21.268 [2024-04-16 23:04:12.217963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.268 [2024-04-16 23:04:12.218079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.268 [2024-04-16 23:04:12.218104] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.268 qpair failed and we were unable to recover it. 00:26:21.268 [2024-04-16 23:04:12.218283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.268 [2024-04-16 23:04:12.218461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.268 [2024-04-16 23:04:12.218503] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.268 qpair failed and we were unable to recover it. 00:26:21.268 [2024-04-16 23:04:12.218663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.268 [2024-04-16 23:04:12.218847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.268 [2024-04-16 23:04:12.218872] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.268 qpair failed and we were unable to recover it. 00:26:21.268 [2024-04-16 23:04:12.218992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.268 [2024-04-16 23:04:12.219141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.268 [2024-04-16 23:04:12.219166] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.268 qpair failed and we were unable to recover it. 00:26:21.268 [2024-04-16 23:04:12.219302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.268 [2024-04-16 23:04:12.219521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.268 [2024-04-16 23:04:12.219564] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.268 qpair failed and we were unable to recover it. 00:26:21.268 [2024-04-16 23:04:12.219756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.268 [2024-04-16 23:04:12.219884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.268 [2024-04-16 23:04:12.219908] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.268 qpair failed and we were unable to recover it. 00:26:21.268 [2024-04-16 23:04:12.220042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.268 [2024-04-16 23:04:12.220191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.268 [2024-04-16 23:04:12.220217] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.268 qpair failed and we were unable to recover it. 00:26:21.269 [2024-04-16 23:04:12.220340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.269 [2024-04-16 23:04:12.220482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.269 [2024-04-16 23:04:12.220506] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.269 qpair failed and we were unable to recover it. 00:26:21.269 [2024-04-16 23:04:12.220631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.269 [2024-04-16 23:04:12.220750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.269 [2024-04-16 23:04:12.220777] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.269 qpair failed and we were unable to recover it. 00:26:21.269 [2024-04-16 23:04:12.220949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.269 [2024-04-16 23:04:12.221092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.269 [2024-04-16 23:04:12.221119] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.269 qpair failed and we were unable to recover it. 00:26:21.269 [2024-04-16 23:04:12.221250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.269 [2024-04-16 23:04:12.221402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.269 [2024-04-16 23:04:12.221445] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.269 qpair failed and we were unable to recover it. 00:26:21.269 [2024-04-16 23:04:12.221571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.269 [2024-04-16 23:04:12.221756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.269 [2024-04-16 23:04:12.221781] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.269 qpair failed and we were unable to recover it. 00:26:21.269 [2024-04-16 23:04:12.221896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.269 [2024-04-16 23:04:12.222013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.269 [2024-04-16 23:04:12.222038] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.269 qpair failed and we were unable to recover it. 00:26:21.269 [2024-04-16 23:04:12.222161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.269 [2024-04-16 23:04:12.222292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.269 [2024-04-16 23:04:12.222334] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.269 qpair failed and we were unable to recover it. 00:26:21.269 [2024-04-16 23:04:12.222511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.269 [2024-04-16 23:04:12.222649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.269 [2024-04-16 23:04:12.222674] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.269 qpair failed and we were unable to recover it. 00:26:21.269 [2024-04-16 23:04:12.222845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.269 [2024-04-16 23:04:12.223015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.269 [2024-04-16 23:04:12.223040] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.269 qpair failed and we were unable to recover it. 00:26:21.269 [2024-04-16 23:04:12.223152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.269 [2024-04-16 23:04:12.223298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.269 [2024-04-16 23:04:12.223323] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.269 qpair failed and we were unable to recover it. 00:26:21.269 [2024-04-16 23:04:12.223431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.269 [2024-04-16 23:04:12.223573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.269 [2024-04-16 23:04:12.223598] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.269 qpair failed and we were unable to recover it. 00:26:21.269 [2024-04-16 23:04:12.223766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.269 [2024-04-16 23:04:12.223871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.269 [2024-04-16 23:04:12.223896] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.269 qpair failed and we were unable to recover it. 00:26:21.269 [2024-04-16 23:04:12.224078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.269 [2024-04-16 23:04:12.224230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.269 [2024-04-16 23:04:12.224257] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.269 qpair failed and we were unable to recover it. 00:26:21.269 [2024-04-16 23:04:12.224366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.269 [2024-04-16 23:04:12.224475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.269 [2024-04-16 23:04:12.224500] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.269 qpair failed and we were unable to recover it. 00:26:21.269 [2024-04-16 23:04:12.224660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.269 [2024-04-16 23:04:12.224810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.269 [2024-04-16 23:04:12.224837] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.269 qpair failed and we were unable to recover it. 00:26:21.269 [2024-04-16 23:04:12.224954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.269 [2024-04-16 23:04:12.225070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.269 [2024-04-16 23:04:12.225096] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.269 qpair failed and we were unable to recover it. 00:26:21.269 [2024-04-16 23:04:12.225245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.269 [2024-04-16 23:04:12.225377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.269 [2024-04-16 23:04:12.225403] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.269 qpair failed and we were unable to recover it. 00:26:21.269 [2024-04-16 23:04:12.225532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.269 [2024-04-16 23:04:12.225673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.269 [2024-04-16 23:04:12.225698] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.269 qpair failed and we were unable to recover it. 00:26:21.269 [2024-04-16 23:04:12.225814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.269 [2024-04-16 23:04:12.225926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.269 [2024-04-16 23:04:12.225953] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.269 qpair failed and we were unable to recover it. 00:26:21.269 [2024-04-16 23:04:12.226092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.269 [2024-04-16 23:04:12.226235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.269 [2024-04-16 23:04:12.226264] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.269 qpair failed and we were unable to recover it. 00:26:21.269 [2024-04-16 23:04:12.226445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.269 [2024-04-16 23:04:12.226606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.269 [2024-04-16 23:04:12.226633] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.269 qpair failed and we were unable to recover it. 00:26:21.269 [2024-04-16 23:04:12.226748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.269 [2024-04-16 23:04:12.226919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.269 [2024-04-16 23:04:12.226944] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.269 qpair failed and we were unable to recover it. 00:26:21.269 [2024-04-16 23:04:12.227057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.269 [2024-04-16 23:04:12.227198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.269 [2024-04-16 23:04:12.227224] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.269 qpair failed and we were unable to recover it. 00:26:21.269 [2024-04-16 23:04:12.227416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.269 [2024-04-16 23:04:12.227552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.269 [2024-04-16 23:04:12.227578] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.269 qpair failed and we were unable to recover it. 00:26:21.269 [2024-04-16 23:04:12.227700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.269 [2024-04-16 23:04:12.227842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.269 [2024-04-16 23:04:12.227869] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.269 qpair failed and we were unable to recover it. 00:26:21.269 [2024-04-16 23:04:12.227987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.269 [2024-04-16 23:04:12.228127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.269 [2024-04-16 23:04:12.228153] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.269 qpair failed and we were unable to recover it. 00:26:21.269 [2024-04-16 23:04:12.228302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.269 [2024-04-16 23:04:12.228491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.270 [2024-04-16 23:04:12.228535] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.270 qpair failed and we were unable to recover it. 00:26:21.270 [2024-04-16 23:04:12.228661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.270 [2024-04-16 23:04:12.228807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.270 [2024-04-16 23:04:12.228833] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.270 qpair failed and we were unable to recover it. 00:26:21.270 [2024-04-16 23:04:12.228945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.270 [2024-04-16 23:04:12.229063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.270 [2024-04-16 23:04:12.229089] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.270 qpair failed and we were unable to recover it. 00:26:21.270 [2024-04-16 23:04:12.229248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.270 [2024-04-16 23:04:12.229381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.270 [2024-04-16 23:04:12.229406] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.270 qpair failed and we were unable to recover it. 00:26:21.270 [2024-04-16 23:04:12.229525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.270 [2024-04-16 23:04:12.229644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.270 [2024-04-16 23:04:12.229670] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.270 qpair failed and we were unable to recover it. 00:26:21.270 [2024-04-16 23:04:12.229816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.270 [2024-04-16 23:04:12.229960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.270 [2024-04-16 23:04:12.229985] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.270 qpair failed and we were unable to recover it. 00:26:21.270 [2024-04-16 23:04:12.230111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.270 [2024-04-16 23:04:12.230254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.270 [2024-04-16 23:04:12.230299] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.270 qpair failed and we were unable to recover it. 00:26:21.270 [2024-04-16 23:04:12.230438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.270 [2024-04-16 23:04:12.230605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.270 [2024-04-16 23:04:12.230648] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.270 qpair failed and we were unable to recover it. 00:26:21.270 [2024-04-16 23:04:12.230788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.270 [2024-04-16 23:04:12.230957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.270 [2024-04-16 23:04:12.230982] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.270 qpair failed and we were unable to recover it. 00:26:21.270 [2024-04-16 23:04:12.231123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.270 [2024-04-16 23:04:12.231307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.270 [2024-04-16 23:04:12.231350] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.270 qpair failed and we were unable to recover it. 00:26:21.270 [2024-04-16 23:04:12.231459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.270 [2024-04-16 23:04:12.231614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.270 [2024-04-16 23:04:12.231657] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.270 qpair failed and we were unable to recover it. 00:26:21.270 [2024-04-16 23:04:12.231784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.270 [2024-04-16 23:04:12.231922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.270 [2024-04-16 23:04:12.231948] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.270 qpair failed and we were unable to recover it. 00:26:21.270 [2024-04-16 23:04:12.232059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.270 [2024-04-16 23:04:12.232222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.270 [2024-04-16 23:04:12.232251] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.270 qpair failed and we were unable to recover it. 00:26:21.270 [2024-04-16 23:04:12.232426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.270 [2024-04-16 23:04:12.232643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.270 [2024-04-16 23:04:12.232685] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.270 qpair failed and we were unable to recover it. 00:26:21.270 [2024-04-16 23:04:12.232828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.270 [2024-04-16 23:04:12.232965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.270 [2024-04-16 23:04:12.232991] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.270 qpair failed and we were unable to recover it. 00:26:21.270 [2024-04-16 23:04:12.233111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.270 [2024-04-16 23:04:12.233261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.270 [2024-04-16 23:04:12.233305] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.270 qpair failed and we were unable to recover it. 00:26:21.270 [2024-04-16 23:04:12.233468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.270 [2024-04-16 23:04:12.233629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.270 [2024-04-16 23:04:12.233673] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.270 qpair failed and we were unable to recover it. 00:26:21.270 [2024-04-16 23:04:12.233790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.270 [2024-04-16 23:04:12.233909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.270 [2024-04-16 23:04:12.233936] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.270 qpair failed and we were unable to recover it. 00:26:21.270 [2024-04-16 23:04:12.234103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.270 [2024-04-16 23:04:12.234268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.270 [2024-04-16 23:04:12.234297] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.270 qpair failed and we were unable to recover it. 00:26:21.270 [2024-04-16 23:04:12.234483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.270 [2024-04-16 23:04:12.234634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.270 [2024-04-16 23:04:12.234677] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.270 qpair failed and we were unable to recover it. 00:26:21.270 [2024-04-16 23:04:12.234787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.270 [2024-04-16 23:04:12.234900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.270 [2024-04-16 23:04:12.234925] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.270 qpair failed and we were unable to recover it. 00:26:21.270 [2024-04-16 23:04:12.235042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.270 [2024-04-16 23:04:12.235157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.270 [2024-04-16 23:04:12.235187] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.270 qpair failed and we were unable to recover it. 00:26:21.270 [2024-04-16 23:04:12.235330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.270 [2024-04-16 23:04:12.235447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.270 [2024-04-16 23:04:12.235472] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.270 qpair failed and we were unable to recover it. 00:26:21.270 [2024-04-16 23:04:12.235588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.270 [2024-04-16 23:04:12.235699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.270 [2024-04-16 23:04:12.235725] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.270 qpair failed and we were unable to recover it. 00:26:21.270 [2024-04-16 23:04:12.235836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.270 [2024-04-16 23:04:12.235940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.270 [2024-04-16 23:04:12.235965] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.270 qpair failed and we were unable to recover it. 00:26:21.270 [2024-04-16 23:04:12.236097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.270 [2024-04-16 23:04:12.236240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.270 [2024-04-16 23:04:12.236266] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.270 qpair failed and we were unable to recover it. 00:26:21.270 [2024-04-16 23:04:12.236436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.270 [2024-04-16 23:04:12.236587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.270 [2024-04-16 23:04:12.236612] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.270 qpair failed and we were unable to recover it. 00:26:21.270 [2024-04-16 23:04:12.236761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.271 [2024-04-16 23:04:12.236875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.271 [2024-04-16 23:04:12.236900] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.271 qpair failed and we were unable to recover it. 00:26:21.271 [2024-04-16 23:04:12.237048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.271 [2024-04-16 23:04:12.237157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.271 [2024-04-16 23:04:12.237189] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.271 qpair failed and we were unable to recover it. 00:26:21.271 [2024-04-16 23:04:12.237389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.271 [2024-04-16 23:04:12.237531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.271 [2024-04-16 23:04:12.237556] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.271 qpair failed and we were unable to recover it. 00:26:21.271 [2024-04-16 23:04:12.237663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.271 [2024-04-16 23:04:12.237806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.271 [2024-04-16 23:04:12.237831] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.271 qpair failed and we were unable to recover it. 00:26:21.271 [2024-04-16 23:04:12.237940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.271 [2024-04-16 23:04:12.238066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.271 [2024-04-16 23:04:12.238091] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.271 qpair failed and we were unable to recover it. 00:26:21.271 [2024-04-16 23:04:12.238206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.271 [2024-04-16 23:04:12.238341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.271 [2024-04-16 23:04:12.238366] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.271 qpair failed and we were unable to recover it. 00:26:21.271 [2024-04-16 23:04:12.238480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.271 [2024-04-16 23:04:12.238584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.271 [2024-04-16 23:04:12.238609] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.271 qpair failed and we were unable to recover it. 00:26:21.271 [2024-04-16 23:04:12.238772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.271 [2024-04-16 23:04:12.238889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.271 [2024-04-16 23:04:12.238916] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.271 qpair failed and we were unable to recover it. 00:26:21.271 [2024-04-16 23:04:12.239056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.271 [2024-04-16 23:04:12.239211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.271 [2024-04-16 23:04:12.239237] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.271 qpair failed and we were unable to recover it. 00:26:21.271 [2024-04-16 23:04:12.239359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.271 [2024-04-16 23:04:12.239497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.271 [2024-04-16 23:04:12.239523] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.271 qpair failed and we were unable to recover it. 00:26:21.271 [2024-04-16 23:04:12.239668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.271 [2024-04-16 23:04:12.239791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.271 [2024-04-16 23:04:12.239816] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.271 qpair failed and we were unable to recover it. 00:26:21.271 [2024-04-16 23:04:12.239958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.271 [2024-04-16 23:04:12.240069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.271 [2024-04-16 23:04:12.240095] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.271 qpair failed and we were unable to recover it. 00:26:21.271 [2024-04-16 23:04:12.240234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.271 [2024-04-16 23:04:12.240389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.271 [2024-04-16 23:04:12.240432] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.271 qpair failed and we were unable to recover it. 00:26:21.271 [2024-04-16 23:04:12.240636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.271 [2024-04-16 23:04:12.240810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.271 [2024-04-16 23:04:12.240835] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.271 qpair failed and we were unable to recover it. 00:26:21.271 [2024-04-16 23:04:12.241003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.271 [2024-04-16 23:04:12.241121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.271 [2024-04-16 23:04:12.241146] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.271 qpair failed and we were unable to recover it. 00:26:21.271 [2024-04-16 23:04:12.241306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.271 [2024-04-16 23:04:12.241462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.271 [2024-04-16 23:04:12.241504] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.271 qpair failed and we were unable to recover it. 00:26:21.271 [2024-04-16 23:04:12.241641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.271 [2024-04-16 23:04:12.241799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.271 [2024-04-16 23:04:12.241824] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.271 qpair failed and we were unable to recover it. 00:26:21.271 [2024-04-16 23:04:12.241933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.271 [2024-04-16 23:04:12.242077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.271 [2024-04-16 23:04:12.242102] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.271 qpair failed and we were unable to recover it. 00:26:21.271 [2024-04-16 23:04:12.242243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.271 [2024-04-16 23:04:12.242348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.271 [2024-04-16 23:04:12.242373] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.271 qpair failed and we were unable to recover it. 00:26:21.271 [2024-04-16 23:04:12.242493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.271 [2024-04-16 23:04:12.242633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.271 [2024-04-16 23:04:12.242659] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.271 qpair failed and we were unable to recover it. 00:26:21.271 [2024-04-16 23:04:12.242796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.271 [2024-04-16 23:04:12.242939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.271 [2024-04-16 23:04:12.242965] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.271 qpair failed and we were unable to recover it. 00:26:21.271 [2024-04-16 23:04:12.243105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.271 [2024-04-16 23:04:12.243224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.271 [2024-04-16 23:04:12.243249] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.271 qpair failed and we were unable to recover it. 00:26:21.271 [2024-04-16 23:04:12.243395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.271 [2024-04-16 23:04:12.243536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.271 [2024-04-16 23:04:12.243561] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.271 qpair failed and we were unable to recover it. 00:26:21.271 [2024-04-16 23:04:12.243700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.271 [2024-04-16 23:04:12.243842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.271 [2024-04-16 23:04:12.243867] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.271 qpair failed and we were unable to recover it. 00:26:21.271 [2024-04-16 23:04:12.244014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.271 [2024-04-16 23:04:12.244127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.271 [2024-04-16 23:04:12.244152] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.271 qpair failed and we were unable to recover it. 00:26:21.271 [2024-04-16 23:04:12.244328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.271 [2024-04-16 23:04:12.244503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.271 [2024-04-16 23:04:12.244546] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.271 qpair failed and we were unable to recover it. 00:26:21.271 [2024-04-16 23:04:12.244684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.271 [2024-04-16 23:04:12.244871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.271 [2024-04-16 23:04:12.244896] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.271 qpair failed and we were unable to recover it. 00:26:21.271 [2024-04-16 23:04:12.245010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.271 [2024-04-16 23:04:12.245114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.272 [2024-04-16 23:04:12.245139] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.272 qpair failed and we were unable to recover it. 00:26:21.272 [2024-04-16 23:04:12.245335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.272 [2024-04-16 23:04:12.245612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.272 [2024-04-16 23:04:12.245640] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.272 qpair failed and we were unable to recover it. 00:26:21.272 [2024-04-16 23:04:12.245849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.272 [2024-04-16 23:04:12.245980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.272 [2024-04-16 23:04:12.246004] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.272 qpair failed and we were unable to recover it. 00:26:21.272 [2024-04-16 23:04:12.246146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.272 [2024-04-16 23:04:12.246352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.272 [2024-04-16 23:04:12.246395] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.272 qpair failed and we were unable to recover it. 00:26:21.272 [2024-04-16 23:04:12.246558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.272 [2024-04-16 23:04:12.246681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.272 [2024-04-16 23:04:12.246707] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.272 qpair failed and we were unable to recover it. 00:26:21.272 [2024-04-16 23:04:12.246873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.272 [2024-04-16 23:04:12.247018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.272 [2024-04-16 23:04:12.247044] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.272 qpair failed and we were unable to recover it. 00:26:21.272 [2024-04-16 23:04:12.247188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.272 [2024-04-16 23:04:12.247324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.272 [2024-04-16 23:04:12.247349] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.272 qpair failed and we were unable to recover it. 00:26:21.272 [2024-04-16 23:04:12.247492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.272 [2024-04-16 23:04:12.247639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.272 [2024-04-16 23:04:12.247668] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.272 qpair failed and we were unable to recover it. 00:26:21.272 [2024-04-16 23:04:12.247813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.272 [2024-04-16 23:04:12.247932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.272 [2024-04-16 23:04:12.247958] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.272 qpair failed and we were unable to recover it. 00:26:21.272 [2024-04-16 23:04:12.248067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.272 [2024-04-16 23:04:12.248239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.272 [2024-04-16 23:04:12.248264] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.272 qpair failed and we were unable to recover it. 00:26:21.272 [2024-04-16 23:04:12.248403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.272 [2024-04-16 23:04:12.248540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.272 [2024-04-16 23:04:12.248565] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.272 qpair failed and we were unable to recover it. 00:26:21.272 [2024-04-16 23:04:12.248716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.272 [2024-04-16 23:04:12.248830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.272 [2024-04-16 23:04:12.248855] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.272 qpair failed and we were unable to recover it. 00:26:21.272 [2024-04-16 23:04:12.248995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.272 [2024-04-16 23:04:12.249104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.272 [2024-04-16 23:04:12.249129] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.272 qpair failed and we were unable to recover it. 00:26:21.272 [2024-04-16 23:04:12.249288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.272 [2024-04-16 23:04:12.249475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.272 [2024-04-16 23:04:12.249517] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.272 qpair failed and we were unable to recover it. 00:26:21.272 [2024-04-16 23:04:12.249646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.272 [2024-04-16 23:04:12.249807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.272 [2024-04-16 23:04:12.249832] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.272 qpair failed and we were unable to recover it. 00:26:21.272 [2024-04-16 23:04:12.249972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.272 [2024-04-16 23:04:12.250143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.272 [2024-04-16 23:04:12.250168] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.272 qpair failed and we were unable to recover it. 00:26:21.272 [2024-04-16 23:04:12.250323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.272 [2024-04-16 23:04:12.250482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.272 [2024-04-16 23:04:12.250507] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.272 qpair failed and we were unable to recover it. 00:26:21.272 [2024-04-16 23:04:12.250615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.272 [2024-04-16 23:04:12.250758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.272 [2024-04-16 23:04:12.250787] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.272 qpair failed and we were unable to recover it. 00:26:21.272 [2024-04-16 23:04:12.250922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.272 [2024-04-16 23:04:12.251074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.272 [2024-04-16 23:04:12.251101] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.272 qpair failed and we were unable to recover it. 00:26:21.272 [2024-04-16 23:04:12.251239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.272 [2024-04-16 23:04:12.251375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.272 [2024-04-16 23:04:12.251401] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.272 qpair failed and we were unable to recover it. 00:26:21.272 [2024-04-16 23:04:12.251513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.272 [2024-04-16 23:04:12.251678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.272 [2024-04-16 23:04:12.251703] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.272 qpair failed and we were unable to recover it. 00:26:21.272 [2024-04-16 23:04:12.251814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.272 [2024-04-16 23:04:12.251958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.272 [2024-04-16 23:04:12.251984] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.272 qpair failed and we were unable to recover it. 00:26:21.272 [2024-04-16 23:04:12.252120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.272 [2024-04-16 23:04:12.252275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.272 [2024-04-16 23:04:12.252300] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.272 qpair failed and we were unable to recover it. 00:26:21.272 [2024-04-16 23:04:12.252442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.272 [2024-04-16 23:04:12.252561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.273 [2024-04-16 23:04:12.252586] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.273 qpair failed and we were unable to recover it. 00:26:21.273 [2024-04-16 23:04:12.252730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.273 [2024-04-16 23:04:12.252848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.273 [2024-04-16 23:04:12.252873] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.273 qpair failed and we were unable to recover it. 00:26:21.273 [2024-04-16 23:04:12.253021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.273 [2024-04-16 23:04:12.253163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.273 [2024-04-16 23:04:12.253208] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.273 qpair failed and we were unable to recover it. 00:26:21.273 [2024-04-16 23:04:12.253334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.273 [2024-04-16 23:04:12.253499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.273 [2024-04-16 23:04:12.253544] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.273 qpair failed and we were unable to recover it. 00:26:21.273 [2024-04-16 23:04:12.253737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.273 [2024-04-16 23:04:12.253933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.273 [2024-04-16 23:04:12.253964] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.273 qpair failed and we were unable to recover it. 00:26:21.273 [2024-04-16 23:04:12.254116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.273 [2024-04-16 23:04:12.254249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.273 [2024-04-16 23:04:12.254293] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.273 qpair failed and we were unable to recover it. 00:26:21.273 [2024-04-16 23:04:12.254457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.273 [2024-04-16 23:04:12.254638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.273 [2024-04-16 23:04:12.254666] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.273 qpair failed and we were unable to recover it. 00:26:21.273 [2024-04-16 23:04:12.254847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.273 [2024-04-16 23:04:12.255041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.273 [2024-04-16 23:04:12.255066] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.273 qpair failed and we were unable to recover it. 00:26:21.273 [2024-04-16 23:04:12.255257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.273 [2024-04-16 23:04:12.255444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.273 [2024-04-16 23:04:12.255487] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.273 qpair failed and we were unable to recover it. 00:26:21.273 [2024-04-16 23:04:12.255624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.273 [2024-04-16 23:04:12.255806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.273 [2024-04-16 23:04:12.255849] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.273 qpair failed and we were unable to recover it. 00:26:21.273 [2024-04-16 23:04:12.255968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.273 [2024-04-16 23:04:12.256108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.273 [2024-04-16 23:04:12.256133] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.273 qpair failed and we were unable to recover it. 00:26:21.273 [2024-04-16 23:04:12.256286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.273 [2024-04-16 23:04:12.256433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.273 [2024-04-16 23:04:12.256458] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.273 qpair failed and we were unable to recover it. 00:26:21.273 [2024-04-16 23:04:12.256624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.273 [2024-04-16 23:04:12.256831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.273 [2024-04-16 23:04:12.256873] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.273 qpair failed and we were unable to recover it. 00:26:21.273 [2024-04-16 23:04:12.257018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.273 [2024-04-16 23:04:12.257164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.273 [2024-04-16 23:04:12.257208] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.273 qpair failed and we were unable to recover it. 00:26:21.273 [2024-04-16 23:04:12.257368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.273 [2024-04-16 23:04:12.257517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.273 [2024-04-16 23:04:12.257549] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.273 qpair failed and we were unable to recover it. 00:26:21.273 [2024-04-16 23:04:12.257723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.273 [2024-04-16 23:04:12.257869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.273 [2024-04-16 23:04:12.257911] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.273 qpair failed and we were unable to recover it. 00:26:21.273 [2024-04-16 23:04:12.258049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.273 [2024-04-16 23:04:12.258187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.273 [2024-04-16 23:04:12.258213] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.273 qpair failed and we were unable to recover it. 00:26:21.273 [2024-04-16 23:04:12.258342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.273 [2024-04-16 23:04:12.258563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.273 [2024-04-16 23:04:12.258610] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.273 qpair failed and we were unable to recover it. 00:26:21.273 [2024-04-16 23:04:12.258777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.273 [2024-04-16 23:04:12.258938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.273 [2024-04-16 23:04:12.258965] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.273 qpair failed and we were unable to recover it. 00:26:21.273 [2024-04-16 23:04:12.259083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.273 [2024-04-16 23:04:12.259241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.273 [2024-04-16 23:04:12.259288] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.273 qpair failed and we were unable to recover it. 00:26:21.273 [2024-04-16 23:04:12.259489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.273 [2024-04-16 23:04:12.259635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.273 [2024-04-16 23:04:12.259679] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.273 qpair failed and we were unable to recover it. 00:26:21.273 [2024-04-16 23:04:12.259823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.273 [2024-04-16 23:04:12.259997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.273 [2024-04-16 23:04:12.260022] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.273 qpair failed and we were unable to recover it. 00:26:21.273 [2024-04-16 23:04:12.260190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.273 [2024-04-16 23:04:12.260354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.273 [2024-04-16 23:04:12.260382] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.273 qpair failed and we were unable to recover it. 00:26:21.273 [2024-04-16 23:04:12.260605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.273 [2024-04-16 23:04:12.260815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.273 [2024-04-16 23:04:12.260858] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.273 qpair failed and we were unable to recover it. 00:26:21.273 [2024-04-16 23:04:12.260999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.273 [2024-04-16 23:04:12.261145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.273 [2024-04-16 23:04:12.261170] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.273 qpair failed and we were unable to recover it. 00:26:21.273 [2024-04-16 23:04:12.261375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.273 [2024-04-16 23:04:12.261511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.273 [2024-04-16 23:04:12.261555] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.273 qpair failed and we were unable to recover it. 00:26:21.273 [2024-04-16 23:04:12.261699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.273 [2024-04-16 23:04:12.261863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.273 [2024-04-16 23:04:12.261889] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.273 qpair failed and we were unable to recover it. 00:26:21.273 [2024-04-16 23:04:12.262027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.273 [2024-04-16 23:04:12.262190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.273 [2024-04-16 23:04:12.262233] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.274 qpair failed and we were unable to recover it. 00:26:21.274 [2024-04-16 23:04:12.262418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.274 [2024-04-16 23:04:12.262603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.274 [2024-04-16 23:04:12.262647] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.274 qpair failed and we were unable to recover it. 00:26:21.274 [2024-04-16 23:04:12.262767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.274 [2024-04-16 23:04:12.262908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.274 [2024-04-16 23:04:12.262934] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.274 qpair failed and we were unable to recover it. 00:26:21.274 [2024-04-16 23:04:12.263075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.274 [2024-04-16 23:04:12.263234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.274 [2024-04-16 23:04:12.263263] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.274 qpair failed and we were unable to recover it. 00:26:21.274 [2024-04-16 23:04:12.263423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.274 [2024-04-16 23:04:12.263602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.274 [2024-04-16 23:04:12.263646] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.274 qpair failed and we were unable to recover it. 00:26:21.274 [2024-04-16 23:04:12.263769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.274 [2024-04-16 23:04:12.263908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.274 [2024-04-16 23:04:12.263934] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.274 qpair failed and we were unable to recover it. 00:26:21.274 [2024-04-16 23:04:12.264106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.274 [2024-04-16 23:04:12.264255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.274 [2024-04-16 23:04:12.264304] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.274 qpair failed and we were unable to recover it. 00:26:21.274 [2024-04-16 23:04:12.264473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.274 [2024-04-16 23:04:12.264657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.274 [2024-04-16 23:04:12.264700] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.274 qpair failed and we were unable to recover it. 00:26:21.274 [2024-04-16 23:04:12.264815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.274 [2024-04-16 23:04:12.264934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.274 [2024-04-16 23:04:12.264960] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.274 qpair failed and we were unable to recover it. 00:26:21.274 [2024-04-16 23:04:12.265081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.274 [2024-04-16 23:04:12.265196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.274 [2024-04-16 23:04:12.265222] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.274 qpair failed and we were unable to recover it. 00:26:21.274 [2024-04-16 23:04:12.265385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.274 [2024-04-16 23:04:12.265571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.274 [2024-04-16 23:04:12.265614] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.274 qpair failed and we were unable to recover it. 00:26:21.274 [2024-04-16 23:04:12.265729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.274 [2024-04-16 23:04:12.265839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.274 [2024-04-16 23:04:12.265865] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.274 qpair failed and we were unable to recover it. 00:26:21.274 [2024-04-16 23:04:12.265986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.274 [2024-04-16 23:04:12.266126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.274 [2024-04-16 23:04:12.266152] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.274 qpair failed and we were unable to recover it. 00:26:21.274 [2024-04-16 23:04:12.266316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.274 [2024-04-16 23:04:12.266494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.274 [2024-04-16 23:04:12.266537] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.274 qpair failed and we were unable to recover it. 00:26:21.274 [2024-04-16 23:04:12.266705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.274 [2024-04-16 23:04:12.266865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.274 [2024-04-16 23:04:12.266891] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.274 qpair failed and we were unable to recover it. 00:26:21.274 [2024-04-16 23:04:12.267043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.274 [2024-04-16 23:04:12.267152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.274 [2024-04-16 23:04:12.267185] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.274 qpair failed and we were unable to recover it. 00:26:21.274 [2024-04-16 23:04:12.267322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.274 [2024-04-16 23:04:12.267512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.274 [2024-04-16 23:04:12.267554] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.274 qpair failed and we were unable to recover it. 00:26:21.274 [2024-04-16 23:04:12.267702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.274 [2024-04-16 23:04:12.267817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.274 [2024-04-16 23:04:12.267842] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.274 qpair failed and we were unable to recover it. 00:26:21.274 [2024-04-16 23:04:12.267984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.274 [2024-04-16 23:04:12.268117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.274 [2024-04-16 23:04:12.268142] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.274 qpair failed and we were unable to recover it. 00:26:21.274 [2024-04-16 23:04:12.268277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.274 [2024-04-16 23:04:12.268456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.274 [2024-04-16 23:04:12.268500] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.274 qpair failed and we were unable to recover it. 00:26:21.274 [2024-04-16 23:04:12.268643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.274 [2024-04-16 23:04:12.268781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.274 [2024-04-16 23:04:12.268806] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.274 qpair failed and we were unable to recover it. 00:26:21.274 [2024-04-16 23:04:12.268947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.274 [2024-04-16 23:04:12.269067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.274 [2024-04-16 23:04:12.269093] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.274 qpair failed and we were unable to recover it. 00:26:21.274 [2024-04-16 23:04:12.269269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.274 [2024-04-16 23:04:12.269462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.274 [2024-04-16 23:04:12.269506] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.274 qpair failed and we were unable to recover it. 00:26:21.274 [2024-04-16 23:04:12.269666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.274 [2024-04-16 23:04:12.269852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.274 [2024-04-16 23:04:12.269877] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.274 qpair failed and we were unable to recover it. 00:26:21.274 [2024-04-16 23:04:12.270021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.274 [2024-04-16 23:04:12.270165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.274 [2024-04-16 23:04:12.270197] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.274 qpair failed and we were unable to recover it. 00:26:21.274 [2024-04-16 23:04:12.270372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.274 [2024-04-16 23:04:12.270511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.274 [2024-04-16 23:04:12.270554] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.274 qpair failed and we were unable to recover it. 00:26:21.274 [2024-04-16 23:04:12.270749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.274 [2024-04-16 23:04:12.270968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.274 [2024-04-16 23:04:12.270994] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.274 qpair failed and we were unable to recover it. 00:26:21.274 [2024-04-16 23:04:12.271116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.274 [2024-04-16 23:04:12.271241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.275 [2024-04-16 23:04:12.271285] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.275 qpair failed and we were unable to recover it. 00:26:21.275 [2024-04-16 23:04:12.271462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.275 [2024-04-16 23:04:12.271633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.275 [2024-04-16 23:04:12.271658] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.275 qpair failed and we were unable to recover it. 00:26:21.275 [2024-04-16 23:04:12.271801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.275 [2024-04-16 23:04:12.271974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.275 [2024-04-16 23:04:12.271999] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.275 qpair failed and we were unable to recover it. 00:26:21.275 [2024-04-16 23:04:12.272113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.275 [2024-04-16 23:04:12.272286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.275 [2024-04-16 23:04:12.272311] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.275 qpair failed and we were unable to recover it. 00:26:21.275 [2024-04-16 23:04:12.272432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.275 [2024-04-16 23:04:12.272604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.275 [2024-04-16 23:04:12.272629] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.275 qpair failed and we were unable to recover it. 00:26:21.275 [2024-04-16 23:04:12.272743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.275 [2024-04-16 23:04:12.272872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.275 [2024-04-16 23:04:12.272897] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.275 qpair failed and we were unable to recover it. 00:26:21.275 [2024-04-16 23:04:12.273068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.275 [2024-04-16 23:04:12.273216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.275 [2024-04-16 23:04:12.273242] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.275 qpair failed and we were unable to recover it. 00:26:21.275 [2024-04-16 23:04:12.273380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.275 [2024-04-16 23:04:12.273563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.275 [2024-04-16 23:04:12.273606] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.275 qpair failed and we were unable to recover it. 00:26:21.275 [2024-04-16 23:04:12.273715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.275 [2024-04-16 23:04:12.273819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.275 [2024-04-16 23:04:12.273844] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.275 qpair failed and we were unable to recover it. 00:26:21.275 [2024-04-16 23:04:12.273954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.275 [2024-04-16 23:04:12.274097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.275 [2024-04-16 23:04:12.274123] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.275 qpair failed and we were unable to recover it. 00:26:21.275 [2024-04-16 23:04:12.274232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.275 [2024-04-16 23:04:12.274357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.275 [2024-04-16 23:04:12.274399] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.275 qpair failed and we were unable to recover it. 00:26:21.275 [2024-04-16 23:04:12.274602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.275 [2024-04-16 23:04:12.274737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.275 [2024-04-16 23:04:12.274762] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.275 qpair failed and we were unable to recover it. 00:26:21.275 [2024-04-16 23:04:12.274937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.275 [2024-04-16 23:04:12.275078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.275 [2024-04-16 23:04:12.275104] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.275 qpair failed and we were unable to recover it. 00:26:21.275 [2024-04-16 23:04:12.275279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.275 [2024-04-16 23:04:12.275415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.275 [2024-04-16 23:04:12.275440] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.275 qpair failed and we were unable to recover it. 00:26:21.275 [2024-04-16 23:04:12.275585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.275 [2024-04-16 23:04:12.275724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.275 [2024-04-16 23:04:12.275749] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.275 qpair failed and we were unable to recover it. 00:26:21.275 [2024-04-16 23:04:12.275887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.275 [2024-04-16 23:04:12.276033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.275 [2024-04-16 23:04:12.276059] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.275 qpair failed and we were unable to recover it. 00:26:21.275 [2024-04-16 23:04:12.276184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.275 [2024-04-16 23:04:12.276341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.275 [2024-04-16 23:04:12.276384] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.275 qpair failed and we were unable to recover it. 00:26:21.275 [2024-04-16 23:04:12.276528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.275 [2024-04-16 23:04:12.276653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.275 [2024-04-16 23:04:12.276678] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.275 qpair failed and we were unable to recover it. 00:26:21.275 [2024-04-16 23:04:12.276815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.275 [2024-04-16 23:04:12.276981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.275 [2024-04-16 23:04:12.277006] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.275 qpair failed and we were unable to recover it. 00:26:21.275 [2024-04-16 23:04:12.277141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.275 [2024-04-16 23:04:12.277280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.275 [2024-04-16 23:04:12.277327] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.275 qpair failed and we were unable to recover it. 00:26:21.275 [2024-04-16 23:04:12.277461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.275 [2024-04-16 23:04:12.277611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.275 [2024-04-16 23:04:12.277653] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.275 qpair failed and we were unable to recover it. 00:26:21.275 [2024-04-16 23:04:12.277774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.275 [2024-04-16 23:04:12.277912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.275 [2024-04-16 23:04:12.277937] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.275 qpair failed and we were unable to recover it. 00:26:21.275 [2024-04-16 23:04:12.278076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.275 [2024-04-16 23:04:12.278220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.275 [2024-04-16 23:04:12.278247] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.275 qpair failed and we were unable to recover it. 00:26:21.275 [2024-04-16 23:04:12.278358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.275 [2024-04-16 23:04:12.278474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.275 [2024-04-16 23:04:12.278500] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.275 qpair failed and we were unable to recover it. 00:26:21.275 [2024-04-16 23:04:12.278604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.275 [2024-04-16 23:04:12.278717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.275 [2024-04-16 23:04:12.278742] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.275 qpair failed and we were unable to recover it. 00:26:21.275 [2024-04-16 23:04:12.278877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.275 [2024-04-16 23:04:12.279028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.275 [2024-04-16 23:04:12.279056] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.275 qpair failed and we were unable to recover it. 00:26:21.275 [2024-04-16 23:04:12.279189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.275 [2024-04-16 23:04:12.279310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.275 [2024-04-16 23:04:12.279335] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.275 qpair failed and we were unable to recover it. 00:26:21.275 [2024-04-16 23:04:12.279450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.275 [2024-04-16 23:04:12.279589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.276 [2024-04-16 23:04:12.279614] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.276 qpair failed and we were unable to recover it. 00:26:21.276 [2024-04-16 23:04:12.279724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.276 [2024-04-16 23:04:12.279842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.276 [2024-04-16 23:04:12.279867] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.276 qpair failed and we were unable to recover it. 00:26:21.276 [2024-04-16 23:04:12.279983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.276 [2024-04-16 23:04:12.280120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.276 [2024-04-16 23:04:12.280144] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.276 qpair failed and we were unable to recover it. 00:26:21.276 [2024-04-16 23:04:12.280301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.276 [2024-04-16 23:04:12.280476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.276 [2024-04-16 23:04:12.280501] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.276 qpair failed and we were unable to recover it. 00:26:21.276 [2024-04-16 23:04:12.280647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.276 [2024-04-16 23:04:12.280786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.276 [2024-04-16 23:04:12.280811] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.276 qpair failed and we were unable to recover it. 00:26:21.276 [2024-04-16 23:04:12.280928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.276 [2024-04-16 23:04:12.281069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.276 [2024-04-16 23:04:12.281094] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.276 qpair failed and we were unable to recover it. 00:26:21.276 [2024-04-16 23:04:12.281220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.276 [2024-04-16 23:04:12.281417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.276 [2024-04-16 23:04:12.281459] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.276 qpair failed and we were unable to recover it. 00:26:21.276 [2024-04-16 23:04:12.281587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.276 [2024-04-16 23:04:12.281741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.276 [2024-04-16 23:04:12.281766] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.276 qpair failed and we were unable to recover it. 00:26:21.276 [2024-04-16 23:04:12.281905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.276 [2024-04-16 23:04:12.282016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.276 [2024-04-16 23:04:12.282041] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.276 qpair failed and we were unable to recover it. 00:26:21.276 [2024-04-16 23:04:12.282224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.276 [2024-04-16 23:04:12.282441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.276 [2024-04-16 23:04:12.282483] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.276 qpair failed and we were unable to recover it. 00:26:21.276 [2024-04-16 23:04:12.282607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.276 [2024-04-16 23:04:12.282735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.276 [2024-04-16 23:04:12.282760] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.276 qpair failed and we were unable to recover it. 00:26:21.276 [2024-04-16 23:04:12.282900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.276 [2024-04-16 23:04:12.283007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.276 [2024-04-16 23:04:12.283032] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.276 qpair failed and we were unable to recover it. 00:26:21.276 [2024-04-16 23:04:12.283150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.276 [2024-04-16 23:04:12.283274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.276 [2024-04-16 23:04:12.283301] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.276 qpair failed and we were unable to recover it. 00:26:21.276 [2024-04-16 23:04:12.283442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.276 [2024-04-16 23:04:12.283612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.276 [2024-04-16 23:04:12.283656] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.276 qpair failed and we were unable to recover it. 00:26:21.276 [2024-04-16 23:04:12.283810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.276 [2024-04-16 23:04:12.283949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.276 [2024-04-16 23:04:12.283974] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.276 qpair failed and we were unable to recover it. 00:26:21.276 [2024-04-16 23:04:12.284084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.276 [2024-04-16 23:04:12.284245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.276 [2024-04-16 23:04:12.284287] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.276 qpair failed and we were unable to recover it. 00:26:21.276 [2024-04-16 23:04:12.284419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.276 [2024-04-16 23:04:12.284600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.276 [2024-04-16 23:04:12.284642] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.276 qpair failed and we were unable to recover it. 00:26:21.276 [2024-04-16 23:04:12.284780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.276 [2024-04-16 23:04:12.284924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.276 [2024-04-16 23:04:12.284949] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.276 qpair failed and we were unable to recover it. 00:26:21.276 [2024-04-16 23:04:12.285089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.276 [2024-04-16 23:04:12.285223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.276 [2024-04-16 23:04:12.285251] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.276 qpair failed and we were unable to recover it. 00:26:21.276 [2024-04-16 23:04:12.285401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.276 [2024-04-16 23:04:12.285562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.276 [2024-04-16 23:04:12.285603] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.276 qpair failed and we were unable to recover it. 00:26:21.276 [2024-04-16 23:04:12.285752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.276 [2024-04-16 23:04:12.285910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.276 [2024-04-16 23:04:12.285935] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.276 qpair failed and we were unable to recover it. 00:26:21.276 [2024-04-16 23:04:12.286105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.276 [2024-04-16 23:04:12.286281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.276 [2024-04-16 23:04:12.286309] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.276 qpair failed and we were unable to recover it. 00:26:21.276 [2024-04-16 23:04:12.286475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.276 [2024-04-16 23:04:12.286621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.276 [2024-04-16 23:04:12.286649] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.276 qpair failed and we were unable to recover it. 00:26:21.276 [2024-04-16 23:04:12.286818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.276 [2024-04-16 23:04:12.286976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.276 [2024-04-16 23:04:12.287001] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.276 qpair failed and we were unable to recover it. 00:26:21.276 [2024-04-16 23:04:12.287111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.276 [2024-04-16 23:04:12.287238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.276 [2024-04-16 23:04:12.287268] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.276 qpair failed and we were unable to recover it. 00:26:21.276 [2024-04-16 23:04:12.287425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.276 [2024-04-16 23:04:12.287575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.276 [2024-04-16 23:04:12.287619] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.276 qpair failed and we were unable to recover it. 00:26:21.277 [2024-04-16 23:04:12.287780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.277 [2024-04-16 23:04:12.287905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.277 [2024-04-16 23:04:12.287930] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.277 qpair failed and we were unable to recover it. 00:26:21.277 [2024-04-16 23:04:12.288070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.277 [2024-04-16 23:04:12.288249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.277 [2024-04-16 23:04:12.288275] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.277 qpair failed and we were unable to recover it. 00:26:21.277 [2024-04-16 23:04:12.288383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.277 [2024-04-16 23:04:12.288534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.277 [2024-04-16 23:04:12.288559] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.277 qpair failed and we were unable to recover it. 00:26:21.277 [2024-04-16 23:04:12.288679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.277 [2024-04-16 23:04:12.288798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.277 [2024-04-16 23:04:12.288825] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.277 qpair failed and we were unable to recover it. 00:26:21.277 [2024-04-16 23:04:12.288961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.277 [2024-04-16 23:04:12.289071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.277 [2024-04-16 23:04:12.289097] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.277 qpair failed and we were unable to recover it. 00:26:21.277 [2024-04-16 23:04:12.289208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.277 [2024-04-16 23:04:12.289367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.277 [2024-04-16 23:04:12.289392] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.277 qpair failed and we were unable to recover it. 00:26:21.277 [2024-04-16 23:04:12.289531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.277 [2024-04-16 23:04:12.289739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.277 [2024-04-16 23:04:12.289767] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.277 qpair failed and we were unable to recover it. 00:26:21.277 [2024-04-16 23:04:12.289899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.277 [2024-04-16 23:04:12.290012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.277 [2024-04-16 23:04:12.290038] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.277 qpair failed and we were unable to recover it. 00:26:21.277 [2024-04-16 23:04:12.290158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.277 [2024-04-16 23:04:12.290359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.277 [2024-04-16 23:04:12.290403] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.277 qpair failed and we were unable to recover it. 00:26:21.277 [2024-04-16 23:04:12.290561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.277 [2024-04-16 23:04:12.290730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.277 [2024-04-16 23:04:12.290755] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.277 qpair failed and we were unable to recover it. 00:26:21.277 [2024-04-16 23:04:12.290868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.277 [2024-04-16 23:04:12.290986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.277 [2024-04-16 23:04:12.291012] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.277 qpair failed and we were unable to recover it. 00:26:21.277 [2024-04-16 23:04:12.291135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.277 [2024-04-16 23:04:12.291309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.277 [2024-04-16 23:04:12.291338] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.277 qpair failed and we were unable to recover it. 00:26:21.277 [2024-04-16 23:04:12.291521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.277 [2024-04-16 23:04:12.291702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.277 [2024-04-16 23:04:12.291730] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.277 qpair failed and we were unable to recover it. 00:26:21.277 [2024-04-16 23:04:12.291868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.277 [2024-04-16 23:04:12.292013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.277 [2024-04-16 23:04:12.292039] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.277 qpair failed and we were unable to recover it. 00:26:21.277 [2024-04-16 23:04:12.292190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.277 [2024-04-16 23:04:12.292322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.277 [2024-04-16 23:04:12.292350] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.277 qpair failed and we were unable to recover it. 00:26:21.277 [2024-04-16 23:04:12.292482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.277 [2024-04-16 23:04:12.292632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.277 [2024-04-16 23:04:12.292657] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.277 qpair failed and we were unable to recover it. 00:26:21.277 [2024-04-16 23:04:12.292776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.277 [2024-04-16 23:04:12.292892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.277 [2024-04-16 23:04:12.292919] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.277 qpair failed and we were unable to recover it. 00:26:21.277 [2024-04-16 23:04:12.293037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.277 [2024-04-16 23:04:12.293169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.277 [2024-04-16 23:04:12.293234] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.277 qpair failed and we were unable to recover it. 00:26:21.277 [2024-04-16 23:04:12.293381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.277 [2024-04-16 23:04:12.293544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.277 [2024-04-16 23:04:12.293571] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.278 qpair failed and we were unable to recover it. 00:26:21.278 [2024-04-16 23:04:12.293691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.278 [2024-04-16 23:04:12.293833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.278 [2024-04-16 23:04:12.293859] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.278 qpair failed and we were unable to recover it. 00:26:21.278 [2024-04-16 23:04:12.294026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.278 [2024-04-16 23:04:12.294170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.278 [2024-04-16 23:04:12.294202] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.278 qpair failed and we were unable to recover it. 00:26:21.278 [2024-04-16 23:04:12.294386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.278 [2024-04-16 23:04:12.294513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.278 [2024-04-16 23:04:12.294540] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.278 qpair failed and we were unable to recover it. 00:26:21.278 [2024-04-16 23:04:12.294738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.278 [2024-04-16 23:04:12.294905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.278 [2024-04-16 23:04:12.294931] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.278 qpair failed and we were unable to recover it. 00:26:21.278 [2024-04-16 23:04:12.295078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.278 [2024-04-16 23:04:12.295242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.278 [2024-04-16 23:04:12.295285] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.278 qpair failed and we were unable to recover it. 00:26:21.278 [2024-04-16 23:04:12.295477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.278 [2024-04-16 23:04:12.295656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.278 [2024-04-16 23:04:12.295698] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.278 qpair failed and we were unable to recover it. 00:26:21.278 [2024-04-16 23:04:12.295850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.278 [2024-04-16 23:04:12.295968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.278 [2024-04-16 23:04:12.295993] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.278 qpair failed and we were unable to recover it. 00:26:21.278 [2024-04-16 23:04:12.296106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.278 [2024-04-16 23:04:12.296249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.278 [2024-04-16 23:04:12.296295] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.278 qpair failed and we were unable to recover it. 00:26:21.278 [2024-04-16 23:04:12.296422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.278 [2024-04-16 23:04:12.296582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.278 [2024-04-16 23:04:12.296608] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.278 qpair failed and we were unable to recover it. 00:26:21.278 [2024-04-16 23:04:12.296753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.278 [2024-04-16 23:04:12.296872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.278 [2024-04-16 23:04:12.296899] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.278 qpair failed and we were unable to recover it. 00:26:21.278 [2024-04-16 23:04:12.297045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.278 [2024-04-16 23:04:12.297154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.278 [2024-04-16 23:04:12.297184] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.278 qpair failed and we were unable to recover it. 00:26:21.278 [2024-04-16 23:04:12.297314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.278 [2024-04-16 23:04:12.297508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.278 [2024-04-16 23:04:12.297550] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.278 qpair failed and we were unable to recover it. 00:26:21.278 [2024-04-16 23:04:12.297713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.278 [2024-04-16 23:04:12.297847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.278 [2024-04-16 23:04:12.297872] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.278 qpair failed and we were unable to recover it. 00:26:21.278 [2024-04-16 23:04:12.298020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.278 [2024-04-16 23:04:12.298139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.278 [2024-04-16 23:04:12.298164] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.278 qpair failed and we were unable to recover it. 00:26:21.278 [2024-04-16 23:04:12.298308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.278 [2024-04-16 23:04:12.298450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.278 [2024-04-16 23:04:12.298475] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.278 qpair failed and we were unable to recover it. 00:26:21.278 [2024-04-16 23:04:12.298620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.278 [2024-04-16 23:04:12.298756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.278 [2024-04-16 23:04:12.298798] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.278 qpair failed and we were unable to recover it. 00:26:21.278 [2024-04-16 23:04:12.298941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.278 [2024-04-16 23:04:12.299085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.278 [2024-04-16 23:04:12.299112] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.278 qpair failed and we were unable to recover it. 00:26:21.278 [2024-04-16 23:04:12.299252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.278 [2024-04-16 23:04:12.299463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.278 [2024-04-16 23:04:12.299491] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.278 qpair failed and we were unable to recover it. 00:26:21.278 [2024-04-16 23:04:12.299675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.278 [2024-04-16 23:04:12.299880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.278 [2024-04-16 23:04:12.299923] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.278 qpair failed and we were unable to recover it. 00:26:21.278 [2024-04-16 23:04:12.300061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.278 [2024-04-16 23:04:12.300180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.278 [2024-04-16 23:04:12.300210] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.278 qpair failed and we were unable to recover it. 00:26:21.278 [2024-04-16 23:04:12.300406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.278 [2024-04-16 23:04:12.300601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.278 [2024-04-16 23:04:12.300626] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.278 qpair failed and we were unable to recover it. 00:26:21.278 [2024-04-16 23:04:12.300803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.278 [2024-04-16 23:04:12.300956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.278 [2024-04-16 23:04:12.300982] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.278 qpair failed and we were unable to recover it. 00:26:21.278 [2024-04-16 23:04:12.301121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.278 [2024-04-16 23:04:12.301296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.278 [2024-04-16 23:04:12.301341] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.278 qpair failed and we were unable to recover it. 00:26:21.278 [2024-04-16 23:04:12.301508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.278 [2024-04-16 23:04:12.301665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.278 [2024-04-16 23:04:12.301707] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.278 qpair failed and we were unable to recover it. 00:26:21.278 [2024-04-16 23:04:12.301880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.278 [2024-04-16 23:04:12.302041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.278 [2024-04-16 23:04:12.302066] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.278 qpair failed and we were unable to recover it. 00:26:21.278 [2024-04-16 23:04:12.302219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.278 [2024-04-16 23:04:12.302403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.278 [2024-04-16 23:04:12.302446] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.278 qpair failed and we were unable to recover it. 00:26:21.278 [2024-04-16 23:04:12.302611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.278 [2024-04-16 23:04:12.302815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.278 [2024-04-16 23:04:12.302840] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.278 qpair failed and we were unable to recover it. 00:26:21.278 [2024-04-16 23:04:12.303008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.278 [2024-04-16 23:04:12.303138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.278 [2024-04-16 23:04:12.303165] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.278 qpair failed and we were unable to recover it. 00:26:21.279 [2024-04-16 23:04:12.303353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.279 [2024-04-16 23:04:12.303529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.279 [2024-04-16 23:04:12.303557] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.279 qpair failed and we were unable to recover it. 00:26:21.279 [2024-04-16 23:04:12.303732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.279 [2024-04-16 23:04:12.303937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.279 [2024-04-16 23:04:12.303983] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.279 qpair failed and we were unable to recover it. 00:26:21.279 [2024-04-16 23:04:12.304143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.279 [2024-04-16 23:04:12.304306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.279 [2024-04-16 23:04:12.304350] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.279 qpair failed and we were unable to recover it. 00:26:21.279 [2024-04-16 23:04:12.304532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.279 [2024-04-16 23:04:12.304713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.279 [2024-04-16 23:04:12.304741] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.279 qpair failed and we were unable to recover it. 00:26:21.279 [2024-04-16 23:04:12.304893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.279 [2024-04-16 23:04:12.305067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.279 [2024-04-16 23:04:12.305092] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.279 qpair failed and we were unable to recover it. 00:26:21.279 [2024-04-16 23:04:12.305234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.279 [2024-04-16 23:04:12.305427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.279 [2024-04-16 23:04:12.305452] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.279 qpair failed and we were unable to recover it. 00:26:21.279 [2024-04-16 23:04:12.305591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.279 [2024-04-16 23:04:12.305751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.279 [2024-04-16 23:04:12.305794] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.279 qpair failed and we were unable to recover it. 00:26:21.279 [2024-04-16 23:04:12.305905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.279 [2024-04-16 23:04:12.306013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.279 [2024-04-16 23:04:12.306040] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.279 qpair failed and we were unable to recover it. 00:26:21.279 [2024-04-16 23:04:12.306185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.279 [2024-04-16 23:04:12.306353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.279 [2024-04-16 23:04:12.306381] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.279 qpair failed and we were unable to recover it. 00:26:21.279 [2024-04-16 23:04:12.306536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.279 [2024-04-16 23:04:12.306761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.279 [2024-04-16 23:04:12.306786] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.279 qpair failed and we were unable to recover it. 00:26:21.279 [2024-04-16 23:04:12.306929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.279 [2024-04-16 23:04:12.307073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.279 [2024-04-16 23:04:12.307098] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.279 qpair failed and we were unable to recover it. 00:26:21.279 [2024-04-16 23:04:12.307267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.279 [2024-04-16 23:04:12.307454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.279 [2024-04-16 23:04:12.307500] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.279 qpair failed and we were unable to recover it. 00:26:21.279 [2024-04-16 23:04:12.307642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.279 [2024-04-16 23:04:12.307802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.279 [2024-04-16 23:04:12.307827] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.279 qpair failed and we were unable to recover it. 00:26:21.279 [2024-04-16 23:04:12.307965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.279 [2024-04-16 23:04:12.308070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.279 [2024-04-16 23:04:12.308095] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.279 qpair failed and we were unable to recover it. 00:26:21.279 [2024-04-16 23:04:12.308258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.279 [2024-04-16 23:04:12.308404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.279 [2024-04-16 23:04:12.308450] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.279 qpair failed and we were unable to recover it. 00:26:21.279 [2024-04-16 23:04:12.308651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.279 [2024-04-16 23:04:12.308804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.279 [2024-04-16 23:04:12.308830] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.279 qpair failed and we were unable to recover it. 00:26:21.279 [2024-04-16 23:04:12.308968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.279 [2024-04-16 23:04:12.309113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.279 [2024-04-16 23:04:12.309138] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.279 qpair failed and we were unable to recover it. 00:26:21.279 [2024-04-16 23:04:12.309318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.279 [2024-04-16 23:04:12.309500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.279 [2024-04-16 23:04:12.309543] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.279 qpair failed and we were unable to recover it. 00:26:21.279 [2024-04-16 23:04:12.309684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.279 [2024-04-16 23:04:12.309851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.279 [2024-04-16 23:04:12.309876] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.279 qpair failed and we were unable to recover it. 00:26:21.279 [2024-04-16 23:04:12.310010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.279 [2024-04-16 23:04:12.310148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.279 [2024-04-16 23:04:12.310172] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.279 qpair failed and we were unable to recover it. 00:26:21.279 [2024-04-16 23:04:12.310323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.279 [2024-04-16 23:04:12.310444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.279 [2024-04-16 23:04:12.310469] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.279 qpair failed and we were unable to recover it. 00:26:21.279 [2024-04-16 23:04:12.310635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.279 [2024-04-16 23:04:12.310824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.279 [2024-04-16 23:04:12.310872] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.279 qpair failed and we were unable to recover it. 00:26:21.279 [2024-04-16 23:04:12.310998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.279 [2024-04-16 23:04:12.311140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.279 [2024-04-16 23:04:12.311165] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.279 qpair failed and we were unable to recover it. 00:26:21.279 [2024-04-16 23:04:12.311334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.279 [2024-04-16 23:04:12.311492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.279 [2024-04-16 23:04:12.311537] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.279 qpair failed and we were unable to recover it. 00:26:21.279 [2024-04-16 23:04:12.311698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.279 [2024-04-16 23:04:12.311885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.280 [2024-04-16 23:04:12.311910] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.280 qpair failed and we were unable to recover it. 00:26:21.280 [2024-04-16 23:04:12.312045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.280 [2024-04-16 23:04:12.312187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.280 [2024-04-16 23:04:12.312213] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.280 qpair failed and we were unable to recover it. 00:26:21.280 [2024-04-16 23:04:12.312393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.280 [2024-04-16 23:04:12.312548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.280 [2024-04-16 23:04:12.312591] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.280 qpair failed and we were unable to recover it. 00:26:21.280 [2024-04-16 23:04:12.312735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.280 [2024-04-16 23:04:12.312883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.280 [2024-04-16 23:04:12.312908] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.280 qpair failed and we were unable to recover it. 00:26:21.280 [2024-04-16 23:04:12.313041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.280 [2024-04-16 23:04:12.313194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.280 [2024-04-16 23:04:12.313220] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.280 qpair failed and we were unable to recover it. 00:26:21.280 [2024-04-16 23:04:12.313332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.280 [2024-04-16 23:04:12.313477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.280 [2024-04-16 23:04:12.313502] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.280 qpair failed and we were unable to recover it. 00:26:21.280 [2024-04-16 23:04:12.313636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.280 [2024-04-16 23:04:12.313744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.280 [2024-04-16 23:04:12.313769] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.280 qpair failed and we were unable to recover it. 00:26:21.280 [2024-04-16 23:04:12.313918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.280 [2024-04-16 23:04:12.314031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.280 [2024-04-16 23:04:12.314057] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.280 qpair failed and we were unable to recover it. 00:26:21.280 [2024-04-16 23:04:12.314207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.280 [2024-04-16 23:04:12.314376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.280 [2024-04-16 23:04:12.314401] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.280 qpair failed and we were unable to recover it. 00:26:21.280 [2024-04-16 23:04:12.314599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.280 [2024-04-16 23:04:12.314766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.280 [2024-04-16 23:04:12.314791] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.280 qpair failed and we were unable to recover it. 00:26:21.280 [2024-04-16 23:04:12.314914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.280 [2024-04-16 23:04:12.315031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.280 [2024-04-16 23:04:12.315058] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.280 qpair failed and we were unable to recover it. 00:26:21.280 [2024-04-16 23:04:12.315174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.280 [2024-04-16 23:04:12.315337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.280 [2024-04-16 23:04:12.315382] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.280 qpair failed and we were unable to recover it. 00:26:21.280 [2024-04-16 23:04:12.315519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.280 [2024-04-16 23:04:12.315679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.280 [2024-04-16 23:04:12.315706] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.280 qpair failed and we were unable to recover it. 00:26:21.280 [2024-04-16 23:04:12.315881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.280 [2024-04-16 23:04:12.316020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.280 [2024-04-16 23:04:12.316045] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.280 qpair failed and we were unable to recover it. 00:26:21.280 [2024-04-16 23:04:12.316192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.280 [2024-04-16 23:04:12.316368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.280 [2024-04-16 23:04:12.316411] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.280 qpair failed and we were unable to recover it. 00:26:21.280 [2024-04-16 23:04:12.316611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.280 [2024-04-16 23:04:12.316771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.280 [2024-04-16 23:04:12.316796] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.280 qpair failed and we were unable to recover it. 00:26:21.280 [2024-04-16 23:04:12.316937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.280 [2024-04-16 23:04:12.317060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.280 [2024-04-16 23:04:12.317085] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.280 qpair failed and we were unable to recover it. 00:26:21.280 [2024-04-16 23:04:12.317240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.280 [2024-04-16 23:04:12.317445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.280 [2024-04-16 23:04:12.317471] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.280 qpair failed and we were unable to recover it. 00:26:21.280 [2024-04-16 23:04:12.317649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.280 [2024-04-16 23:04:12.317790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.280 [2024-04-16 23:04:12.317815] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.280 qpair failed and we were unable to recover it. 00:26:21.280 [2024-04-16 23:04:12.317931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.280 [2024-04-16 23:04:12.318041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.280 [2024-04-16 23:04:12.318066] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.280 qpair failed and we were unable to recover it. 00:26:21.280 [2024-04-16 23:04:12.318185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.280 [2024-04-16 23:04:12.318327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.280 [2024-04-16 23:04:12.318352] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.280 qpair failed and we were unable to recover it. 00:26:21.280 [2024-04-16 23:04:12.318489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.280 [2024-04-16 23:04:12.318599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.280 [2024-04-16 23:04:12.318624] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.280 qpair failed and we were unable to recover it. 00:26:21.280 [2024-04-16 23:04:12.318729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.280 [2024-04-16 23:04:12.318869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.280 [2024-04-16 23:04:12.318895] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.280 qpair failed and we were unable to recover it. 00:26:21.280 [2024-04-16 23:04:12.319010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.280 [2024-04-16 23:04:12.319186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.280 [2024-04-16 23:04:12.319212] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.280 qpair failed and we were unable to recover it. 00:26:21.280 [2024-04-16 23:04:12.319354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.280 [2024-04-16 23:04:12.319495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.280 [2024-04-16 23:04:12.319520] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.280 qpair failed and we were unable to recover it. 00:26:21.280 [2024-04-16 23:04:12.319625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.281 [2024-04-16 23:04:12.319738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.281 [2024-04-16 23:04:12.319763] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.281 qpair failed and we were unable to recover it. 00:26:21.281 [2024-04-16 23:04:12.319902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.281 [2024-04-16 23:04:12.320026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.281 [2024-04-16 23:04:12.320051] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.281 qpair failed and we were unable to recover it. 00:26:21.281 [2024-04-16 23:04:12.320186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.281 [2024-04-16 23:04:12.320340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.281 [2024-04-16 23:04:12.320383] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.281 qpair failed and we were unable to recover it. 00:26:21.281 [2024-04-16 23:04:12.320585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.281 [2024-04-16 23:04:12.320755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.281 [2024-04-16 23:04:12.320780] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.281 qpair failed and we were unable to recover it. 00:26:21.281 [2024-04-16 23:04:12.320949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.281 [2024-04-16 23:04:12.321105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.281 [2024-04-16 23:04:12.321130] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.281 qpair failed and we were unable to recover it. 00:26:21.281 [2024-04-16 23:04:12.321290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.281 [2024-04-16 23:04:12.321456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.281 [2024-04-16 23:04:12.321500] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.281 qpair failed and we were unable to recover it. 00:26:21.281 [2024-04-16 23:04:12.321622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.281 [2024-04-16 23:04:12.321794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.281 [2024-04-16 23:04:12.321822] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.281 qpair failed and we were unable to recover it. 00:26:21.281 [2024-04-16 23:04:12.321950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.281 [2024-04-16 23:04:12.322125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.281 [2024-04-16 23:04:12.322150] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.281 qpair failed and we were unable to recover it. 00:26:21.281 [2024-04-16 23:04:12.322340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.281 [2024-04-16 23:04:12.322488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.281 [2024-04-16 23:04:12.322512] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.281 qpair failed and we were unable to recover it. 00:26:21.281 [2024-04-16 23:04:12.322678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.281 [2024-04-16 23:04:12.322839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.281 [2024-04-16 23:04:12.322867] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.281 qpair failed and we were unable to recover it. 00:26:21.281 [2024-04-16 23:04:12.323054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.281 [2024-04-16 23:04:12.323163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.281 [2024-04-16 23:04:12.323195] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.281 qpair failed and we were unable to recover it. 00:26:21.281 [2024-04-16 23:04:12.323390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.281 [2024-04-16 23:04:12.323576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.281 [2024-04-16 23:04:12.323618] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.281 qpair failed and we were unable to recover it. 00:26:21.281 [2024-04-16 23:04:12.323759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.281 [2024-04-16 23:04:12.323875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.281 [2024-04-16 23:04:12.323900] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.281 qpair failed and we were unable to recover it. 00:26:21.281 [2024-04-16 23:04:12.324022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.281 [2024-04-16 23:04:12.324165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.281 [2024-04-16 23:04:12.324198] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.281 qpair failed and we were unable to recover it. 00:26:21.281 [2024-04-16 23:04:12.324344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.281 [2024-04-16 23:04:12.324501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.281 [2024-04-16 23:04:12.324526] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.281 qpair failed and we were unable to recover it. 00:26:21.281 [2024-04-16 23:04:12.324669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.281 [2024-04-16 23:04:12.324777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.281 [2024-04-16 23:04:12.324802] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.281 qpair failed and we were unable to recover it. 00:26:21.281 [2024-04-16 23:04:12.324943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.281 [2024-04-16 23:04:12.325111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.281 [2024-04-16 23:04:12.325136] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.281 qpair failed and we were unable to recover it. 00:26:21.281 [2024-04-16 23:04:12.325289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.281 [2024-04-16 23:04:12.325433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.281 [2024-04-16 23:04:12.325458] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.281 qpair failed and we were unable to recover it. 00:26:21.281 [2024-04-16 23:04:12.325604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.281 [2024-04-16 23:04:12.325768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.281 [2024-04-16 23:04:12.325812] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.281 qpair failed and we were unable to recover it. 00:26:21.281 [2024-04-16 23:04:12.325949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.281 [2024-04-16 23:04:12.326073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.281 [2024-04-16 23:04:12.326097] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.281 qpair failed and we were unable to recover it. 00:26:21.281 [2024-04-16 23:04:12.326281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.281 [2024-04-16 23:04:12.326424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.281 [2024-04-16 23:04:12.326452] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.281 qpair failed and we were unable to recover it. 00:26:21.281 [2024-04-16 23:04:12.326639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.281 [2024-04-16 23:04:12.326756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.281 [2024-04-16 23:04:12.326782] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.281 qpair failed and we were unable to recover it. 00:26:21.281 [2024-04-16 23:04:12.326949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.281 [2024-04-16 23:04:12.327082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.281 [2024-04-16 23:04:12.327107] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.281 qpair failed and we were unable to recover it. 00:26:21.281 [2024-04-16 23:04:12.327278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.281 [2024-04-16 23:04:12.327458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.281 [2024-04-16 23:04:12.327500] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.281 qpair failed and we were unable to recover it. 00:26:21.281 [2024-04-16 23:04:12.327673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.281 [2024-04-16 23:04:12.327804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.281 [2024-04-16 23:04:12.327831] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.281 qpair failed and we were unable to recover it. 00:26:21.281 [2024-04-16 23:04:12.327977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.281 [2024-04-16 23:04:12.328093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.281 [2024-04-16 23:04:12.328118] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.281 qpair failed and we were unable to recover it. 00:26:21.281 [2024-04-16 23:04:12.328249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.281 [2024-04-16 23:04:12.328433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.281 [2024-04-16 23:04:12.328476] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.281 qpair failed and we were unable to recover it. 00:26:21.281 [2024-04-16 23:04:12.328623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.281 [2024-04-16 23:04:12.328811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.281 [2024-04-16 23:04:12.328836] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.281 qpair failed and we were unable to recover it. 00:26:21.281 [2024-04-16 23:04:12.328953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.281 [2024-04-16 23:04:12.329099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.282 [2024-04-16 23:04:12.329124] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.282 qpair failed and we were unable to recover it. 00:26:21.282 [2024-04-16 23:04:12.329272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.282 [2024-04-16 23:04:12.329423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.282 [2024-04-16 23:04:12.329465] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.282 qpair failed and we were unable to recover it. 00:26:21.282 [2024-04-16 23:04:12.329660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.282 [2024-04-16 23:04:12.329825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.282 [2024-04-16 23:04:12.329851] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.282 qpair failed and we were unable to recover it. 00:26:21.282 [2024-04-16 23:04:12.329997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.282 [2024-04-16 23:04:12.330111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.282 [2024-04-16 23:04:12.330137] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.282 qpair failed and we were unable to recover it. 00:26:21.282 [2024-04-16 23:04:12.330304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.282 [2024-04-16 23:04:12.330456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.282 [2024-04-16 23:04:12.330502] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.282 qpair failed and we were unable to recover it. 00:26:21.282 [2024-04-16 23:04:12.330702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.282 [2024-04-16 23:04:12.330855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.282 [2024-04-16 23:04:12.330880] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.282 qpair failed and we were unable to recover it. 00:26:21.282 [2024-04-16 23:04:12.330995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.282 [2024-04-16 23:04:12.331116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.282 [2024-04-16 23:04:12.331141] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.282 qpair failed and we were unable to recover it. 00:26:21.282 [2024-04-16 23:04:12.331291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.282 [2024-04-16 23:04:12.331469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.282 [2024-04-16 23:04:12.331512] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.282 qpair failed and we were unable to recover it. 00:26:21.282 [2024-04-16 23:04:12.331646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.282 [2024-04-16 23:04:12.331808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.282 [2024-04-16 23:04:12.331833] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.282 qpair failed and we were unable to recover it. 00:26:21.282 [2024-04-16 23:04:12.331968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.282 [2024-04-16 23:04:12.332081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.282 [2024-04-16 23:04:12.332107] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.282 qpair failed and we were unable to recover it. 00:26:21.282 [2024-04-16 23:04:12.332255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.282 [2024-04-16 23:04:12.332412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.282 [2024-04-16 23:04:12.332456] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.282 qpair failed and we were unable to recover it. 00:26:21.282 [2024-04-16 23:04:12.332598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.282 [2024-04-16 23:04:12.332712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.282 [2024-04-16 23:04:12.332737] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.282 qpair failed and we were unable to recover it. 00:26:21.282 [2024-04-16 23:04:12.332888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.282 [2024-04-16 23:04:12.333005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.282 [2024-04-16 23:04:12.333031] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.282 qpair failed and we were unable to recover it. 00:26:21.282 [2024-04-16 23:04:12.333149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.282 [2024-04-16 23:04:12.333290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.282 [2024-04-16 23:04:12.333335] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.282 qpair failed and we were unable to recover it. 00:26:21.282 [2024-04-16 23:04:12.333500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.282 [2024-04-16 23:04:12.333639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.282 [2024-04-16 23:04:12.333666] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.282 qpair failed and we were unable to recover it. 00:26:21.282 [2024-04-16 23:04:12.333783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.282 [2024-04-16 23:04:12.333925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.282 [2024-04-16 23:04:12.333951] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.282 qpair failed and we were unable to recover it. 00:26:21.282 [2024-04-16 23:04:12.334070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.282 [2024-04-16 23:04:12.334196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.282 [2024-04-16 23:04:12.334221] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.282 qpair failed and we were unable to recover it. 00:26:21.282 [2024-04-16 23:04:12.334391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.282 [2024-04-16 23:04:12.334523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.282 [2024-04-16 23:04:12.334549] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.282 qpair failed and we were unable to recover it. 00:26:21.282 [2024-04-16 23:04:12.334690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.282 [2024-04-16 23:04:12.334832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.282 [2024-04-16 23:04:12.334857] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.282 qpair failed and we were unable to recover it. 00:26:21.282 [2024-04-16 23:04:12.335000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.282 [2024-04-16 23:04:12.335143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.283 [2024-04-16 23:04:12.335168] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.283 qpair failed and we were unable to recover it. 00:26:21.283 [2024-04-16 23:04:12.335338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.283 [2024-04-16 23:04:12.335521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.283 [2024-04-16 23:04:12.335549] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.283 qpair failed and we were unable to recover it. 00:26:21.283 [2024-04-16 23:04:12.335717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.283 [2024-04-16 23:04:12.335871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.283 [2024-04-16 23:04:12.335897] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.283 qpair failed and we were unable to recover it. 00:26:21.283 [2024-04-16 23:04:12.336041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.283 [2024-04-16 23:04:12.336147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.283 [2024-04-16 23:04:12.336172] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.283 qpair failed and we were unable to recover it. 00:26:21.283 [2024-04-16 23:04:12.336374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.283 [2024-04-16 23:04:12.336532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.283 [2024-04-16 23:04:12.336560] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.283 qpair failed and we were unable to recover it. 00:26:21.283 [2024-04-16 23:04:12.336739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.283 [2024-04-16 23:04:12.336856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.283 [2024-04-16 23:04:12.336882] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.283 qpair failed and we were unable to recover it. 00:26:21.283 [2024-04-16 23:04:12.337027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.283 [2024-04-16 23:04:12.337197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.283 [2024-04-16 23:04:12.337223] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.283 qpair failed and we were unable to recover it. 00:26:21.283 [2024-04-16 23:04:12.337361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.283 [2024-04-16 23:04:12.337498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.283 [2024-04-16 23:04:12.337523] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.283 qpair failed and we were unable to recover it. 00:26:21.283 [2024-04-16 23:04:12.337689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.283 [2024-04-16 23:04:12.337818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.283 [2024-04-16 23:04:12.337843] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.283 qpair failed and we were unable to recover it. 00:26:21.283 [2024-04-16 23:04:12.337982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.283 [2024-04-16 23:04:12.338098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.283 [2024-04-16 23:04:12.338123] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.283 qpair failed and we were unable to recover it. 00:26:21.283 [2024-04-16 23:04:12.338292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.283 [2024-04-16 23:04:12.338454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.283 [2024-04-16 23:04:12.338498] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.283 qpair failed and we were unable to recover it. 00:26:21.283 [2024-04-16 23:04:12.338691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.283 [2024-04-16 23:04:12.338849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.283 [2024-04-16 23:04:12.338874] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.283 qpair failed and we were unable to recover it. 00:26:21.283 [2024-04-16 23:04:12.339012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.283 [2024-04-16 23:04:12.339158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.283 [2024-04-16 23:04:12.339188] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.283 qpair failed and we were unable to recover it. 00:26:21.283 [2024-04-16 23:04:12.339365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.283 [2024-04-16 23:04:12.339577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.283 [2024-04-16 23:04:12.339619] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.283 qpair failed and we were unable to recover it. 00:26:21.283 [2024-04-16 23:04:12.339813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.283 [2024-04-16 23:04:12.339998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.283 [2024-04-16 23:04:12.340023] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.283 qpair failed and we were unable to recover it. 00:26:21.283 [2024-04-16 23:04:12.340168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.283 [2024-04-16 23:04:12.340335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.283 [2024-04-16 23:04:12.340382] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.283 qpair failed and we were unable to recover it. 00:26:21.283 [2024-04-16 23:04:12.340526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.283 [2024-04-16 23:04:12.340678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.283 [2024-04-16 23:04:12.340719] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.283 qpair failed and we were unable to recover it. 00:26:21.283 [2024-04-16 23:04:12.340859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.283 [2024-04-16 23:04:12.341053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.283 [2024-04-16 23:04:12.341078] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.283 qpair failed and we were unable to recover it. 00:26:21.283 [2024-04-16 23:04:12.341227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.283 [2024-04-16 23:04:12.341376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.283 [2024-04-16 23:04:12.341402] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.283 qpair failed and we were unable to recover it. 00:26:21.283 [2024-04-16 23:04:12.341541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.283 [2024-04-16 23:04:12.341655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.283 [2024-04-16 23:04:12.341680] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.283 qpair failed and we were unable to recover it. 00:26:21.283 [2024-04-16 23:04:12.341844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.283 [2024-04-16 23:04:12.341977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.283 [2024-04-16 23:04:12.342002] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.283 qpair failed and we were unable to recover it. 00:26:21.283 [2024-04-16 23:04:12.342141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.283 [2024-04-16 23:04:12.342295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.283 [2024-04-16 23:04:12.342321] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.283 qpair failed and we were unable to recover it. 00:26:21.283 [2024-04-16 23:04:12.342462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.283 [2024-04-16 23:04:12.342656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.283 [2024-04-16 23:04:12.342699] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.283 qpair failed and we were unable to recover it. 00:26:21.283 [2024-04-16 23:04:12.342814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.283 [2024-04-16 23:04:12.342956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.283 [2024-04-16 23:04:12.342982] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.283 qpair failed and we were unable to recover it. 00:26:21.283 [2024-04-16 23:04:12.343092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.283 [2024-04-16 23:04:12.343290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.283 [2024-04-16 23:04:12.343335] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.283 qpair failed and we were unable to recover it. 00:26:21.283 [2024-04-16 23:04:12.343502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.283 [2024-04-16 23:04:12.343655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.283 [2024-04-16 23:04:12.343698] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.283 qpair failed and we were unable to recover it. 00:26:21.283 [2024-04-16 23:04:12.343893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.283 [2024-04-16 23:04:12.344025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.283 [2024-04-16 23:04:12.344050] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.283 qpair failed and we were unable to recover it. 00:26:21.283 [2024-04-16 23:04:12.344189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.283 [2024-04-16 23:04:12.344319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.283 [2024-04-16 23:04:12.344362] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.283 qpair failed and we were unable to recover it. 00:26:21.284 [2024-04-16 23:04:12.344566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.284 [2024-04-16 23:04:12.344721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.284 [2024-04-16 23:04:12.344749] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.284 qpair failed and we were unable to recover it. 00:26:21.284 [2024-04-16 23:04:12.344912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.284 [2024-04-16 23:04:12.345049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.284 [2024-04-16 23:04:12.345074] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.284 qpair failed and we were unable to recover it. 00:26:21.284 [2024-04-16 23:04:12.345264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.284 [2024-04-16 23:04:12.345408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.284 [2024-04-16 23:04:12.345453] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.284 qpair failed and we were unable to recover it. 00:26:21.284 [2024-04-16 23:04:12.345562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.284 [2024-04-16 23:04:12.345698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.284 [2024-04-16 23:04:12.345723] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.284 qpair failed and we were unable to recover it. 00:26:21.284 [2024-04-16 23:04:12.345841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.284 [2024-04-16 23:04:12.345979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.284 [2024-04-16 23:04:12.346004] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.284 qpair failed and we were unable to recover it. 00:26:21.284 [2024-04-16 23:04:12.346140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.284 [2024-04-16 23:04:12.346296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.284 [2024-04-16 23:04:12.346322] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.284 qpair failed and we were unable to recover it. 00:26:21.284 [2024-04-16 23:04:12.346463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.284 [2024-04-16 23:04:12.346601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.284 [2024-04-16 23:04:12.346626] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.284 qpair failed and we were unable to recover it. 00:26:21.284 [2024-04-16 23:04:12.346769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.284 [2024-04-16 23:04:12.346886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.284 [2024-04-16 23:04:12.346911] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.284 qpair failed and we were unable to recover it. 00:26:21.284 [2024-04-16 23:04:12.347022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.284 [2024-04-16 23:04:12.347192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.284 [2024-04-16 23:04:12.347219] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.284 qpair failed and we were unable to recover it. 00:26:21.284 [2024-04-16 23:04:12.347363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.284 [2024-04-16 23:04:12.347549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.284 [2024-04-16 23:04:12.347590] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.284 qpair failed and we were unable to recover it. 00:26:21.284 [2024-04-16 23:04:12.347761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.284 [2024-04-16 23:04:12.347946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.284 [2024-04-16 23:04:12.347971] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.284 qpair failed and we were unable to recover it. 00:26:21.284 [2024-04-16 23:04:12.348150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.284 [2024-04-16 23:04:12.348321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.284 [2024-04-16 23:04:12.348365] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.284 qpair failed and we were unable to recover it. 00:26:21.284 [2024-04-16 23:04:12.348535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.284 [2024-04-16 23:04:12.348733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.284 [2024-04-16 23:04:12.348760] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.284 qpair failed and we were unable to recover it. 00:26:21.284 [2024-04-16 23:04:12.348895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.284 [2024-04-16 23:04:12.349040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.284 [2024-04-16 23:04:12.349066] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.284 qpair failed and we were unable to recover it. 00:26:21.284 [2024-04-16 23:04:12.349235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.284 [2024-04-16 23:04:12.349378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.284 [2024-04-16 23:04:12.349404] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.284 qpair failed and we were unable to recover it. 00:26:21.284 [2024-04-16 23:04:12.349563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.284 [2024-04-16 23:04:12.349745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.284 [2024-04-16 23:04:12.349771] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.284 qpair failed and we were unable to recover it. 00:26:21.284 [2024-04-16 23:04:12.349940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.284 [2024-04-16 23:04:12.350083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.284 [2024-04-16 23:04:12.350109] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.284 qpair failed and we were unable to recover it. 00:26:21.284 [2024-04-16 23:04:12.350276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.284 [2024-04-16 23:04:12.350406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.284 [2024-04-16 23:04:12.350449] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.284 qpair failed and we were unable to recover it. 00:26:21.284 [2024-04-16 23:04:12.350572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.284 [2024-04-16 23:04:12.350727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.284 [2024-04-16 23:04:12.350753] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.284 qpair failed and we were unable to recover it. 00:26:21.284 [2024-04-16 23:04:12.350888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.284 [2024-04-16 23:04:12.350998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.284 [2024-04-16 23:04:12.351024] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.284 qpair failed and we were unable to recover it. 00:26:21.284 [2024-04-16 23:04:12.351129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.284 [2024-04-16 23:04:12.351282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.284 [2024-04-16 23:04:12.351308] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.284 qpair failed and we were unable to recover it. 00:26:21.284 [2024-04-16 23:04:12.351443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.284 [2024-04-16 23:04:12.351575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.284 [2024-04-16 23:04:12.351603] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.284 qpair failed and we were unable to recover it. 00:26:21.284 [2024-04-16 23:04:12.351727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.284 [2024-04-16 23:04:12.351837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.284 [2024-04-16 23:04:12.351862] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.284 qpair failed and we were unable to recover it. 00:26:21.284 [2024-04-16 23:04:12.351999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.284 [2024-04-16 23:04:12.352103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.284 [2024-04-16 23:04:12.352128] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.284 qpair failed and we were unable to recover it. 00:26:21.284 [2024-04-16 23:04:12.352270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.284 [2024-04-16 23:04:12.352424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.284 [2024-04-16 23:04:12.352471] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.284 qpair failed and we were unable to recover it. 00:26:21.284 [2024-04-16 23:04:12.352580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.284 [2024-04-16 23:04:12.352693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.284 [2024-04-16 23:04:12.352719] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.284 qpair failed and we were unable to recover it. 00:26:21.284 [2024-04-16 23:04:12.352859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.284 [2024-04-16 23:04:12.353009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.284 [2024-04-16 23:04:12.353035] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.284 qpair failed and we were unable to recover it. 00:26:21.284 [2024-04-16 23:04:12.353146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.285 [2024-04-16 23:04:12.353293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.285 [2024-04-16 23:04:12.353319] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.285 qpair failed and we were unable to recover it. 00:26:21.285 [2024-04-16 23:04:12.353464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.285 [2024-04-16 23:04:12.353580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.285 [2024-04-16 23:04:12.353611] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.285 qpair failed and we were unable to recover it. 00:26:21.285 [2024-04-16 23:04:12.353717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.285 [2024-04-16 23:04:12.353858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.285 [2024-04-16 23:04:12.353883] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.285 qpair failed and we were unable to recover it. 00:26:21.285 [2024-04-16 23:04:12.354022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.285 [2024-04-16 23:04:12.354194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.285 [2024-04-16 23:04:12.354220] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.285 qpair failed and we were unable to recover it. 00:26:21.285 [2024-04-16 23:04:12.354356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.285 [2024-04-16 23:04:12.354511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.285 [2024-04-16 23:04:12.354553] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.285 qpair failed and we were unable to recover it. 00:26:21.285 [2024-04-16 23:04:12.354701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.285 [2024-04-16 23:04:12.354807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.285 [2024-04-16 23:04:12.354832] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.285 qpair failed and we were unable to recover it. 00:26:21.285 [2024-04-16 23:04:12.354968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.285 [2024-04-16 23:04:12.355104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.285 [2024-04-16 23:04:12.355129] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.285 qpair failed and we were unable to recover it. 00:26:21.285 [2024-04-16 23:04:12.355325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.285 [2024-04-16 23:04:12.355474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.285 [2024-04-16 23:04:12.355499] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.285 qpair failed and we were unable to recover it. 00:26:21.285 [2024-04-16 23:04:12.355639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.285 [2024-04-16 23:04:12.355753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.285 [2024-04-16 23:04:12.355779] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.285 qpair failed and we were unable to recover it. 00:26:21.285 [2024-04-16 23:04:12.355922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.285 [2024-04-16 23:04:12.356065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.285 [2024-04-16 23:04:12.356091] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.285 qpair failed and we were unable to recover it. 00:26:21.285 [2024-04-16 23:04:12.356242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.285 [2024-04-16 23:04:12.356358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.285 [2024-04-16 23:04:12.356385] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.285 qpair failed and we were unable to recover it. 00:26:21.285 [2024-04-16 23:04:12.356495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.285 [2024-04-16 23:04:12.356660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.285 [2024-04-16 23:04:12.356689] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.285 qpair failed and we were unable to recover it. 00:26:21.285 [2024-04-16 23:04:12.356833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.285 [2024-04-16 23:04:12.356941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.285 [2024-04-16 23:04:12.356966] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.285 qpair failed and we were unable to recover it. 00:26:21.285 [2024-04-16 23:04:12.357132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.285 [2024-04-16 23:04:12.357309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.285 [2024-04-16 23:04:12.357335] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.285 qpair failed and we were unable to recover it. 00:26:21.285 [2024-04-16 23:04:12.357449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.285 [2024-04-16 23:04:12.357587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.285 [2024-04-16 23:04:12.357611] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.285 qpair failed and we were unable to recover it. 00:26:21.285 [2024-04-16 23:04:12.357717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.285 [2024-04-16 23:04:12.357849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.285 [2024-04-16 23:04:12.357874] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.285 qpair failed and we were unable to recover it. 00:26:21.285 [2024-04-16 23:04:12.358018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.285 [2024-04-16 23:04:12.358196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.285 [2024-04-16 23:04:12.358222] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.285 qpair failed and we were unable to recover it. 00:26:21.285 [2024-04-16 23:04:12.358357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.285 [2024-04-16 23:04:12.358540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.285 [2024-04-16 23:04:12.358582] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.285 qpair failed and we were unable to recover it. 00:26:21.285 [2024-04-16 23:04:12.358745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.285 [2024-04-16 23:04:12.358870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.285 [2024-04-16 23:04:12.358895] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.285 qpair failed and we were unable to recover it. 00:26:21.285 [2024-04-16 23:04:12.359042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.285 [2024-04-16 23:04:12.359240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.285 [2024-04-16 23:04:12.359284] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.285 qpair failed and we were unable to recover it. 00:26:21.285 [2024-04-16 23:04:12.359475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.285 [2024-04-16 23:04:12.359607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.285 [2024-04-16 23:04:12.359633] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.285 qpair failed and we were unable to recover it. 00:26:21.285 [2024-04-16 23:04:12.359829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.285 [2024-04-16 23:04:12.359993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.285 [2024-04-16 23:04:12.360023] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.285 qpair failed and we were unable to recover it. 00:26:21.285 [2024-04-16 23:04:12.360198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.285 [2024-04-16 23:04:12.360388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.285 [2024-04-16 23:04:12.360431] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.285 qpair failed and we were unable to recover it. 00:26:21.285 [2024-04-16 23:04:12.360598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.285 [2024-04-16 23:04:12.360782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.285 [2024-04-16 23:04:12.360825] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.285 qpair failed and we were unable to recover it. 00:26:21.285 [2024-04-16 23:04:12.360941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.285 [2024-04-16 23:04:12.361062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.285 [2024-04-16 23:04:12.361087] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.285 qpair failed and we were unable to recover it. 00:26:21.285 [2024-04-16 23:04:12.361201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.285 [2024-04-16 23:04:12.361356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.285 [2024-04-16 23:04:12.361399] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.285 qpair failed and we were unable to recover it. 00:26:21.286 [2024-04-16 23:04:12.361567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.286 [2024-04-16 23:04:12.361727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.286 [2024-04-16 23:04:12.361752] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.286 qpair failed and we were unable to recover it. 00:26:21.286 [2024-04-16 23:04:12.361889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.286 [2024-04-16 23:04:12.362059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.286 [2024-04-16 23:04:12.362084] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.286 qpair failed and we were unable to recover it. 00:26:21.286 [2024-04-16 23:04:12.362196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.286 [2024-04-16 23:04:12.362368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.286 [2024-04-16 23:04:12.362414] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.286 qpair failed and we were unable to recover it. 00:26:21.286 [2024-04-16 23:04:12.362606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.286 [2024-04-16 23:04:12.362791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.286 [2024-04-16 23:04:12.362835] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.286 qpair failed and we were unable to recover it. 00:26:21.286 [2024-04-16 23:04:12.362973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.286 [2024-04-16 23:04:12.363106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.286 [2024-04-16 23:04:12.363131] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.286 qpair failed and we were unable to recover it. 00:26:21.564 [2024-04-16 23:04:12.363311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.564 [2024-04-16 23:04:12.363494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.564 [2024-04-16 23:04:12.363537] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.564 qpair failed and we were unable to recover it. 00:26:21.564 [2024-04-16 23:04:12.363726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.564 [2024-04-16 23:04:12.363867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.564 [2024-04-16 23:04:12.363892] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.564 qpair failed and we were unable to recover it. 00:26:21.564 [2024-04-16 23:04:12.364036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.564 [2024-04-16 23:04:12.364185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.564 [2024-04-16 23:04:12.364210] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.564 qpair failed and we were unable to recover it. 00:26:21.564 [2024-04-16 23:04:12.364389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.565 [2024-04-16 23:04:12.364568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.565 [2024-04-16 23:04:12.364611] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.565 qpair failed and we were unable to recover it. 00:26:21.565 [2024-04-16 23:04:12.364806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.565 [2024-04-16 23:04:12.364970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.565 [2024-04-16 23:04:12.364996] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.565 qpair failed and we were unable to recover it. 00:26:21.565 [2024-04-16 23:04:12.365111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.565 [2024-04-16 23:04:12.365264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.565 [2024-04-16 23:04:12.365307] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.565 qpair failed and we were unable to recover it. 00:26:21.565 [2024-04-16 23:04:12.365463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.565 [2024-04-16 23:04:12.365650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.565 [2024-04-16 23:04:12.365694] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.565 qpair failed and we were unable to recover it. 00:26:21.565 [2024-04-16 23:04:12.365818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.565 [2024-04-16 23:04:12.365935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.565 [2024-04-16 23:04:12.365962] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.565 qpair failed and we were unable to recover it. 00:26:21.565 [2024-04-16 23:04:12.366101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.565 [2024-04-16 23:04:12.366266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.565 [2024-04-16 23:04:12.366309] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.565 qpair failed and we were unable to recover it. 00:26:21.565 [2024-04-16 23:04:12.366475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.565 [2024-04-16 23:04:12.366617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.565 [2024-04-16 23:04:12.366660] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.565 qpair failed and we were unable to recover it. 00:26:21.565 [2024-04-16 23:04:12.366781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.565 [2024-04-16 23:04:12.366922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.565 [2024-04-16 23:04:12.366948] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.565 qpair failed and we were unable to recover it. 00:26:21.565 [2024-04-16 23:04:12.367069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.565 [2024-04-16 23:04:12.367258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.565 [2024-04-16 23:04:12.367302] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.565 qpair failed and we were unable to recover it. 00:26:21.565 [2024-04-16 23:04:12.367460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.565 [2024-04-16 23:04:12.367639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.565 [2024-04-16 23:04:12.367683] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.565 qpair failed and we were unable to recover it. 00:26:21.565 [2024-04-16 23:04:12.367825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.565 [2024-04-16 23:04:12.367964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.565 [2024-04-16 23:04:12.367989] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.565 qpair failed and we were unable to recover it. 00:26:21.565 [2024-04-16 23:04:12.368135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.565 [2024-04-16 23:04:12.368300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.565 [2024-04-16 23:04:12.368342] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.565 qpair failed and we were unable to recover it. 00:26:21.565 [2024-04-16 23:04:12.368486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.565 [2024-04-16 23:04:12.368676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.565 [2024-04-16 23:04:12.368718] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.565 qpair failed and we were unable to recover it. 00:26:21.565 [2024-04-16 23:04:12.368834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.565 [2024-04-16 23:04:12.368953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.565 [2024-04-16 23:04:12.368979] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.565 qpair failed and we were unable to recover it. 00:26:21.565 [2024-04-16 23:04:12.369089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.565 [2024-04-16 23:04:12.369216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.565 [2024-04-16 23:04:12.369242] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.565 qpair failed and we were unable to recover it. 00:26:21.565 [2024-04-16 23:04:12.369383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.565 [2024-04-16 23:04:12.369577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.565 [2024-04-16 23:04:12.369621] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.565 qpair failed and we were unable to recover it. 00:26:21.565 [2024-04-16 23:04:12.369737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.565 [2024-04-16 23:04:12.369879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.565 [2024-04-16 23:04:12.369905] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.565 qpair failed and we were unable to recover it. 00:26:21.565 [2024-04-16 23:04:12.370046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.565 [2024-04-16 23:04:12.370157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.565 [2024-04-16 23:04:12.370191] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.565 qpair failed and we were unable to recover it. 00:26:21.565 [2024-04-16 23:04:12.370362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.565 [2024-04-16 23:04:12.370491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.565 [2024-04-16 23:04:12.370517] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.565 qpair failed and we were unable to recover it. 00:26:21.565 [2024-04-16 23:04:12.370662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.565 [2024-04-16 23:04:12.370810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.565 [2024-04-16 23:04:12.370835] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.565 qpair failed and we were unable to recover it. 00:26:21.565 [2024-04-16 23:04:12.370976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.565 [2024-04-16 23:04:12.371087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.565 [2024-04-16 23:04:12.371113] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.565 qpair failed and we were unable to recover it. 00:26:21.565 [2024-04-16 23:04:12.371246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.565 [2024-04-16 23:04:12.371428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.565 [2024-04-16 23:04:12.371472] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.565 qpair failed and we were unable to recover it. 00:26:21.565 [2024-04-16 23:04:12.371618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.565 [2024-04-16 23:04:12.371738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.565 [2024-04-16 23:04:12.371765] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.565 qpair failed and we were unable to recover it. 00:26:21.565 [2024-04-16 23:04:12.371910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.565 [2024-04-16 23:04:12.372054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.565 [2024-04-16 23:04:12.372079] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.565 qpair failed and we were unable to recover it. 00:26:21.565 [2024-04-16 23:04:12.372191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.565 [2024-04-16 23:04:12.372330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.565 [2024-04-16 23:04:12.372356] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.566 qpair failed and we were unable to recover it. 00:26:21.566 [2024-04-16 23:04:12.372553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.566 [2024-04-16 23:04:12.372723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.566 [2024-04-16 23:04:12.372749] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.566 qpair failed and we were unable to recover it. 00:26:21.566 [2024-04-16 23:04:12.372917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.566 [2024-04-16 23:04:12.373026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.566 [2024-04-16 23:04:12.373053] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.566 qpair failed and we were unable to recover it. 00:26:21.566 [2024-04-16 23:04:12.373194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.566 [2024-04-16 23:04:12.373349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.566 [2024-04-16 23:04:12.373377] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.566 qpair failed and we were unable to recover it. 00:26:21.566 [2024-04-16 23:04:12.373515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.566 [2024-04-16 23:04:12.373683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.566 [2024-04-16 23:04:12.373708] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.566 qpair failed and we were unable to recover it. 00:26:21.566 [2024-04-16 23:04:12.373878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.566 [2024-04-16 23:04:12.373987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.566 [2024-04-16 23:04:12.374012] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.566 qpair failed and we were unable to recover it. 00:26:21.566 [2024-04-16 23:04:12.374125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.566 [2024-04-16 23:04:12.374283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.566 [2024-04-16 23:04:12.374327] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.566 qpair failed and we were unable to recover it. 00:26:21.566 [2024-04-16 23:04:12.374489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.566 [2024-04-16 23:04:12.374667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.566 [2024-04-16 23:04:12.374709] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.566 qpair failed and we were unable to recover it. 00:26:21.566 [2024-04-16 23:04:12.374853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.566 [2024-04-16 23:04:12.374959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.566 [2024-04-16 23:04:12.374984] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.566 qpair failed and we were unable to recover it. 00:26:21.566 [2024-04-16 23:04:12.375165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.566 [2024-04-16 23:04:12.375366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.566 [2024-04-16 23:04:12.375408] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.566 qpair failed and we were unable to recover it. 00:26:21.566 [2024-04-16 23:04:12.375558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.566 [2024-04-16 23:04:12.375703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.566 [2024-04-16 23:04:12.375728] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.566 qpair failed and we were unable to recover it. 00:26:21.566 [2024-04-16 23:04:12.375894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.566 [2024-04-16 23:04:12.376006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.566 [2024-04-16 23:04:12.376030] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.566 qpair failed and we were unable to recover it. 00:26:21.566 [2024-04-16 23:04:12.376138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.566 [2024-04-16 23:04:12.376279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.566 [2024-04-16 23:04:12.376305] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.566 qpair failed and we were unable to recover it. 00:26:21.566 [2024-04-16 23:04:12.376460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.566 [2024-04-16 23:04:12.376613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.566 [2024-04-16 23:04:12.376655] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.566 qpair failed and we were unable to recover it. 00:26:21.566 [2024-04-16 23:04:12.376777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.566 [2024-04-16 23:04:12.376954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.566 [2024-04-16 23:04:12.376979] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.566 qpair failed and we were unable to recover it. 00:26:21.566 [2024-04-16 23:04:12.377120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.566 [2024-04-16 23:04:12.377311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.566 [2024-04-16 23:04:12.377340] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.566 qpair failed and we were unable to recover it. 00:26:21.566 [2024-04-16 23:04:12.377540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.566 [2024-04-16 23:04:12.377723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.566 [2024-04-16 23:04:12.377764] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.566 qpair failed and we were unable to recover it. 00:26:21.566 [2024-04-16 23:04:12.377900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.566 [2024-04-16 23:04:12.378039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.566 [2024-04-16 23:04:12.378064] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.566 qpair failed and we were unable to recover it. 00:26:21.566 [2024-04-16 23:04:12.378258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.566 [2024-04-16 23:04:12.378440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.566 [2024-04-16 23:04:12.378482] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.566 qpair failed and we were unable to recover it. 00:26:21.566 [2024-04-16 23:04:12.378661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.566 [2024-04-16 23:04:12.378827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.566 [2024-04-16 23:04:12.378853] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.566 qpair failed and we were unable to recover it. 00:26:21.566 [2024-04-16 23:04:12.379015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.566 [2024-04-16 23:04:12.379126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.566 [2024-04-16 23:04:12.379151] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.566 qpair failed and we were unable to recover it. 00:26:21.566 [2024-04-16 23:04:12.379294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.566 [2024-04-16 23:04:12.379439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.566 [2024-04-16 23:04:12.379465] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.566 qpair failed and we were unable to recover it. 00:26:21.566 [2024-04-16 23:04:12.379635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.566 [2024-04-16 23:04:12.379768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.566 [2024-04-16 23:04:12.379809] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.566 qpair failed and we were unable to recover it. 00:26:21.566 [2024-04-16 23:04:12.379942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.566 [2024-04-16 23:04:12.380052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.566 [2024-04-16 23:04:12.380077] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.566 qpair failed and we were unable to recover it. 00:26:21.566 [2024-04-16 23:04:12.380191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.566 [2024-04-16 23:04:12.380386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.566 [2024-04-16 23:04:12.380429] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.566 qpair failed and we were unable to recover it. 00:26:21.566 [2024-04-16 23:04:12.380633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.566 [2024-04-16 23:04:12.380817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.566 [2024-04-16 23:04:12.380842] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.566 qpair failed and we were unable to recover it. 00:26:21.566 [2024-04-16 23:04:12.380991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.566 [2024-04-16 23:04:12.381159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.566 [2024-04-16 23:04:12.381200] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.566 qpair failed and we were unable to recover it. 00:26:21.566 [2024-04-16 23:04:12.381395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.566 [2024-04-16 23:04:12.381577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.566 [2024-04-16 23:04:12.381619] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.566 qpair failed and we were unable to recover it. 00:26:21.566 [2024-04-16 23:04:12.381756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.567 [2024-04-16 23:04:12.381901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.567 [2024-04-16 23:04:12.381943] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.567 qpair failed and we were unable to recover it. 00:26:21.567 [2024-04-16 23:04:12.382064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.567 [2024-04-16 23:04:12.382168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.567 [2024-04-16 23:04:12.382201] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.567 qpair failed and we were unable to recover it. 00:26:21.567 [2024-04-16 23:04:12.382317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.567 [2024-04-16 23:04:12.382436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.567 [2024-04-16 23:04:12.382461] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.567 qpair failed and we were unable to recover it. 00:26:21.567 [2024-04-16 23:04:12.382594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.567 [2024-04-16 23:04:12.382739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.567 [2024-04-16 23:04:12.382765] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.567 qpair failed and we were unable to recover it. 00:26:21.567 [2024-04-16 23:04:12.382942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.567 [2024-04-16 23:04:12.383087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.567 [2024-04-16 23:04:12.383112] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.567 qpair failed and we were unable to recover it. 00:26:21.567 [2024-04-16 23:04:12.383237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.567 [2024-04-16 23:04:12.383454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.567 [2024-04-16 23:04:12.383499] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.567 qpair failed and we were unable to recover it. 00:26:21.567 [2024-04-16 23:04:12.383650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.567 [2024-04-16 23:04:12.383861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.567 [2024-04-16 23:04:12.383903] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.567 qpair failed and we were unable to recover it. 00:26:21.567 [2024-04-16 23:04:12.384046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.567 [2024-04-16 23:04:12.384185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.567 [2024-04-16 23:04:12.384211] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.567 qpair failed and we were unable to recover it. 00:26:21.567 [2024-04-16 23:04:12.384375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.567 [2024-04-16 23:04:12.384558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.567 [2024-04-16 23:04:12.384601] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.567 qpair failed and we were unable to recover it. 00:26:21.567 [2024-04-16 23:04:12.384778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.567 [2024-04-16 23:04:12.384951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.567 [2024-04-16 23:04:12.384976] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.567 qpair failed and we were unable to recover it. 00:26:21.567 [2024-04-16 23:04:12.385140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.567 [2024-04-16 23:04:12.385317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.567 [2024-04-16 23:04:12.385360] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.567 qpair failed and we were unable to recover it. 00:26:21.567 [2024-04-16 23:04:12.385488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.567 [2024-04-16 23:04:12.385672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.567 [2024-04-16 23:04:12.385697] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.567 qpair failed and we were unable to recover it. 00:26:21.567 [2024-04-16 23:04:12.385866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.567 [2024-04-16 23:04:12.386010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.567 [2024-04-16 23:04:12.386035] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.567 qpair failed and we were unable to recover it. 00:26:21.567 [2024-04-16 23:04:12.386185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.567 [2024-04-16 23:04:12.386354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.567 [2024-04-16 23:04:12.386399] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.567 qpair failed and we were unable to recover it. 00:26:21.567 [2024-04-16 23:04:12.386566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.567 [2024-04-16 23:04:12.386697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.567 [2024-04-16 23:04:12.386725] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.567 qpair failed and we were unable to recover it. 00:26:21.567 [2024-04-16 23:04:12.386907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.567 [2024-04-16 23:04:12.387076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.567 [2024-04-16 23:04:12.387101] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.567 qpair failed and we were unable to recover it. 00:26:21.567 [2024-04-16 23:04:12.387275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.567 [2024-04-16 23:04:12.387418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.567 [2024-04-16 23:04:12.387466] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.567 qpair failed and we were unable to recover it. 00:26:21.567 [2024-04-16 23:04:12.387628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.567 [2024-04-16 23:04:12.387777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.567 [2024-04-16 23:04:12.387803] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.567 qpair failed and we were unable to recover it. 00:26:21.567 [2024-04-16 23:04:12.387911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.567 [2024-04-16 23:04:12.388078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.567 [2024-04-16 23:04:12.388103] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.567 qpair failed and we were unable to recover it. 00:26:21.567 [2024-04-16 23:04:12.388239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.567 [2024-04-16 23:04:12.388419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.567 [2024-04-16 23:04:12.388462] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.567 qpair failed and we were unable to recover it. 00:26:21.567 [2024-04-16 23:04:12.388632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.567 [2024-04-16 23:04:12.388766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.567 [2024-04-16 23:04:12.388791] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.567 qpair failed and we were unable to recover it. 00:26:21.567 [2024-04-16 23:04:12.388934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.567 [2024-04-16 23:04:12.389110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.567 [2024-04-16 23:04:12.389135] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.567 qpair failed and we were unable to recover it. 00:26:21.567 [2024-04-16 23:04:12.389260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.567 [2024-04-16 23:04:12.389404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.567 [2024-04-16 23:04:12.389431] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.567 qpair failed and we were unable to recover it. 00:26:21.567 [2024-04-16 23:04:12.389600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.567 [2024-04-16 23:04:12.389736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.567 [2024-04-16 23:04:12.389760] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.567 qpair failed and we were unable to recover it. 00:26:21.567 [2024-04-16 23:04:12.389937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.567 [2024-04-16 23:04:12.390051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.567 [2024-04-16 23:04:12.390076] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.567 qpair failed and we were unable to recover it. 00:26:21.567 [2024-04-16 23:04:12.390236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.567 [2024-04-16 23:04:12.390412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.567 [2024-04-16 23:04:12.390454] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.567 qpair failed and we were unable to recover it. 00:26:21.567 [2024-04-16 23:04:12.390643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.567 [2024-04-16 23:04:12.390805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.567 [2024-04-16 23:04:12.390830] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.567 qpair failed and we were unable to recover it. 00:26:21.567 [2024-04-16 23:04:12.390953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.567 [2024-04-16 23:04:12.391085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.567 [2024-04-16 23:04:12.391110] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.567 qpair failed and we were unable to recover it. 00:26:21.567 [2024-04-16 23:04:12.391276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.567 [2024-04-16 23:04:12.391501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.568 [2024-04-16 23:04:12.391527] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.568 qpair failed and we were unable to recover it. 00:26:21.568 [2024-04-16 23:04:12.391638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.568 [2024-04-16 23:04:12.391753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.568 [2024-04-16 23:04:12.391778] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.568 qpair failed and we were unable to recover it. 00:26:21.568 [2024-04-16 23:04:12.391891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.568 [2024-04-16 23:04:12.392002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.568 [2024-04-16 23:04:12.392029] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.568 qpair failed and we were unable to recover it. 00:26:21.568 [2024-04-16 23:04:12.392171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.568 [2024-04-16 23:04:12.392321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.568 [2024-04-16 23:04:12.392346] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.568 qpair failed and we were unable to recover it. 00:26:21.568 [2024-04-16 23:04:12.392483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.568 [2024-04-16 23:04:12.392630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.568 [2024-04-16 23:04:12.392656] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.568 qpair failed and we were unable to recover it. 00:26:21.568 [2024-04-16 23:04:12.392797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.568 [2024-04-16 23:04:12.392938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.568 [2024-04-16 23:04:12.392963] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.568 qpair failed and we were unable to recover it. 00:26:21.568 [2024-04-16 23:04:12.393105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.568 [2024-04-16 23:04:12.393308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.568 [2024-04-16 23:04:12.393351] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.568 qpair failed and we were unable to recover it. 00:26:21.568 [2024-04-16 23:04:12.393553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.568 [2024-04-16 23:04:12.393741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.568 [2024-04-16 23:04:12.393783] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.568 qpair failed and we were unable to recover it. 00:26:21.568 [2024-04-16 23:04:12.393930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.568 [2024-04-16 23:04:12.394046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.568 [2024-04-16 23:04:12.394071] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.568 qpair failed and we were unable to recover it. 00:26:21.568 [2024-04-16 23:04:12.394211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.568 [2024-04-16 23:04:12.394409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.568 [2024-04-16 23:04:12.394437] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.568 qpair failed and we were unable to recover it. 00:26:21.568 [2024-04-16 23:04:12.394604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.568 [2024-04-16 23:04:12.394728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.568 [2024-04-16 23:04:12.394755] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.568 qpair failed and we were unable to recover it. 00:26:21.568 [2024-04-16 23:04:12.394868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.568 [2024-04-16 23:04:12.395007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.568 [2024-04-16 23:04:12.395032] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.568 qpair failed and we were unable to recover it. 00:26:21.568 [2024-04-16 23:04:12.395145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.568 [2024-04-16 23:04:12.395306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.568 [2024-04-16 23:04:12.395349] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.568 qpair failed and we were unable to recover it. 00:26:21.568 [2024-04-16 23:04:12.395515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.568 [2024-04-16 23:04:12.395697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.568 [2024-04-16 23:04:12.395739] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.568 qpair failed and we were unable to recover it. 00:26:21.568 [2024-04-16 23:04:12.395875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.568 [2024-04-16 23:04:12.395982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.568 [2024-04-16 23:04:12.396007] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.568 qpair failed and we were unable to recover it. 00:26:21.568 [2024-04-16 23:04:12.396143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.568 [2024-04-16 23:04:12.396291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.568 [2024-04-16 23:04:12.396317] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.568 qpair failed and we were unable to recover it. 00:26:21.568 [2024-04-16 23:04:12.396478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.568 [2024-04-16 23:04:12.396653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.568 [2024-04-16 23:04:12.396695] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.568 qpair failed and we were unable to recover it. 00:26:21.568 [2024-04-16 23:04:12.396854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.568 [2024-04-16 23:04:12.397009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.568 [2024-04-16 23:04:12.397034] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.568 qpair failed and we were unable to recover it. 00:26:21.568 [2024-04-16 23:04:12.397173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.568 [2024-04-16 23:04:12.397354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.568 [2024-04-16 23:04:12.397396] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.568 qpair failed and we were unable to recover it. 00:26:21.568 [2024-04-16 23:04:12.397552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.568 [2024-04-16 23:04:12.397734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.568 [2024-04-16 23:04:12.397775] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.568 qpair failed and we were unable to recover it. 00:26:21.568 [2024-04-16 23:04:12.397945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.568 [2024-04-16 23:04:12.398056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.568 [2024-04-16 23:04:12.398081] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.568 qpair failed and we were unable to recover it. 00:26:21.568 [2024-04-16 23:04:12.398224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.568 [2024-04-16 23:04:12.398371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.568 [2024-04-16 23:04:12.398396] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.568 qpair failed and we were unable to recover it. 00:26:21.568 [2024-04-16 23:04:12.398526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.568 [2024-04-16 23:04:12.398697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.568 [2024-04-16 23:04:12.398737] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.568 qpair failed and we were unable to recover it. 00:26:21.568 [2024-04-16 23:04:12.398876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.568 [2024-04-16 23:04:12.399014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.568 [2024-04-16 23:04:12.399039] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.568 qpair failed and we were unable to recover it. 00:26:21.568 [2024-04-16 23:04:12.399189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.568 [2024-04-16 23:04:12.399350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.568 [2024-04-16 23:04:12.399393] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.568 qpair failed and we were unable to recover it. 00:26:21.568 [2024-04-16 23:04:12.399524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.569 [2024-04-16 23:04:12.399698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.569 [2024-04-16 23:04:12.399741] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.569 qpair failed and we were unable to recover it. 00:26:21.569 [2024-04-16 23:04:12.399847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.569 [2024-04-16 23:04:12.399984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.569 [2024-04-16 23:04:12.400009] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.569 qpair failed and we were unable to recover it. 00:26:21.569 [2024-04-16 23:04:12.400127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.569 [2024-04-16 23:04:12.400284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.569 [2024-04-16 23:04:12.400327] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.569 qpair failed and we were unable to recover it. 00:26:21.569 [2024-04-16 23:04:12.400490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.569 [2024-04-16 23:04:12.400648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.569 [2024-04-16 23:04:12.400673] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.569 qpair failed and we were unable to recover it. 00:26:21.569 [2024-04-16 23:04:12.400782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.569 [2024-04-16 23:04:12.400910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.569 [2024-04-16 23:04:12.400935] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.569 qpair failed and we were unable to recover it. 00:26:21.569 [2024-04-16 23:04:12.401053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.569 [2024-04-16 23:04:12.401223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.569 [2024-04-16 23:04:12.401249] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.569 qpair failed and we were unable to recover it. 00:26:21.569 [2024-04-16 23:04:12.401388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.569 [2024-04-16 23:04:12.401531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.569 [2024-04-16 23:04:12.401557] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.569 qpair failed and we were unable to recover it. 00:26:21.569 [2024-04-16 23:04:12.401673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.569 [2024-04-16 23:04:12.401821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.569 [2024-04-16 23:04:12.401846] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.569 qpair failed and we were unable to recover it. 00:26:21.569 [2024-04-16 23:04:12.401966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.569 [2024-04-16 23:04:12.402105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.569 [2024-04-16 23:04:12.402132] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.569 qpair failed and we were unable to recover it. 00:26:21.569 [2024-04-16 23:04:12.402346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.569 [2024-04-16 23:04:12.402536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.569 [2024-04-16 23:04:12.402580] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.569 qpair failed and we were unable to recover it. 00:26:21.569 [2024-04-16 23:04:12.402716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.569 [2024-04-16 23:04:12.402859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.569 [2024-04-16 23:04:12.402885] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.569 qpair failed and we were unable to recover it. 00:26:21.569 [2024-04-16 23:04:12.403025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.569 [2024-04-16 23:04:12.403168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.569 [2024-04-16 23:04:12.403202] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.569 qpair failed and we were unable to recover it. 00:26:21.569 [2024-04-16 23:04:12.403345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.569 [2024-04-16 23:04:12.403528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.569 [2024-04-16 23:04:12.403571] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.569 qpair failed and we were unable to recover it. 00:26:21.569 [2024-04-16 23:04:12.403715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.569 [2024-04-16 23:04:12.403825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.569 [2024-04-16 23:04:12.403855] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.569 qpair failed and we were unable to recover it. 00:26:21.569 [2024-04-16 23:04:12.403977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.569 [2024-04-16 23:04:12.404137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.569 [2024-04-16 23:04:12.404171] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.569 qpair failed and we were unable to recover it. 00:26:21.569 [2024-04-16 23:04:12.404353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.569 [2024-04-16 23:04:12.404505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.569 [2024-04-16 23:04:12.404533] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.569 qpair failed and we were unable to recover it. 00:26:21.569 [2024-04-16 23:04:12.404740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.569 [2024-04-16 23:04:12.404868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.569 [2024-04-16 23:04:12.404894] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.569 qpair failed and we were unable to recover it. 00:26:21.569 [2024-04-16 23:04:12.405047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.569 [2024-04-16 23:04:12.405161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.569 [2024-04-16 23:04:12.405198] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.569 qpair failed and we were unable to recover it. 00:26:21.569 [2024-04-16 23:04:12.405365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.569 [2024-04-16 23:04:12.405534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.569 [2024-04-16 23:04:12.405577] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.569 qpair failed and we were unable to recover it. 00:26:21.569 [2024-04-16 23:04:12.405699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.569 [2024-04-16 23:04:12.405845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.570 [2024-04-16 23:04:12.405871] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.570 qpair failed and we were unable to recover it. 00:26:21.570 [2024-04-16 23:04:12.406025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.570 [2024-04-16 23:04:12.406169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.570 [2024-04-16 23:04:12.406201] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.570 qpair failed and we were unable to recover it. 00:26:21.570 [2024-04-16 23:04:12.406359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.570 [2024-04-16 23:04:12.406568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.570 [2024-04-16 23:04:12.406610] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.570 qpair failed and we were unable to recover it. 00:26:21.570 [2024-04-16 23:04:12.406764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.570 [2024-04-16 23:04:12.406933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.570 [2024-04-16 23:04:12.406958] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.570 qpair failed and we were unable to recover it. 00:26:21.570 [2024-04-16 23:04:12.407100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.570 [2024-04-16 23:04:12.407263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.570 [2024-04-16 23:04:12.407311] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.570 qpair failed and we were unable to recover it. 00:26:21.570 [2024-04-16 23:04:12.407475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.570 [2024-04-16 23:04:12.407664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.570 [2024-04-16 23:04:12.407691] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.570 qpair failed and we were unable to recover it. 00:26:21.570 [2024-04-16 23:04:12.407827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.570 [2024-04-16 23:04:12.407967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.570 [2024-04-16 23:04:12.407993] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.570 qpair failed and we were unable to recover it. 00:26:21.570 [2024-04-16 23:04:12.408104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.570 [2024-04-16 23:04:12.408245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.570 [2024-04-16 23:04:12.408290] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.570 qpair failed and we were unable to recover it. 00:26:21.570 [2024-04-16 23:04:12.408444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.570 [2024-04-16 23:04:12.408618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.570 [2024-04-16 23:04:12.408662] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.570 qpair failed and we were unable to recover it. 00:26:21.570 [2024-04-16 23:04:12.408809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.570 [2024-04-16 23:04:12.408958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.570 [2024-04-16 23:04:12.408994] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.570 qpair failed and we were unable to recover it. 00:26:21.570 [2024-04-16 23:04:12.409173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.570 [2024-04-16 23:04:12.409352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.570 [2024-04-16 23:04:12.409401] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.570 qpair failed and we were unable to recover it. 00:26:21.570 [2024-04-16 23:04:12.409607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.570 [2024-04-16 23:04:12.409755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.570 [2024-04-16 23:04:12.409783] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.570 qpair failed and we were unable to recover it. 00:26:21.570 [2024-04-16 23:04:12.409949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.570 [2024-04-16 23:04:12.410121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.570 [2024-04-16 23:04:12.410146] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.570 qpair failed and we were unable to recover it. 00:26:21.570 [2024-04-16 23:04:12.410270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.570 [2024-04-16 23:04:12.410433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.570 [2024-04-16 23:04:12.410477] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.570 qpair failed and we were unable to recover it. 00:26:21.570 [2024-04-16 23:04:12.410612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.570 [2024-04-16 23:04:12.410797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.570 [2024-04-16 23:04:12.410827] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.570 qpair failed and we were unable to recover it. 00:26:21.570 [2024-04-16 23:04:12.410975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.570 [2024-04-16 23:04:12.411113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.570 [2024-04-16 23:04:12.411138] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.570 qpair failed and we were unable to recover it. 00:26:21.570 [2024-04-16 23:04:12.411298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.570 [2024-04-16 23:04:12.411471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.570 [2024-04-16 23:04:12.411514] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.570 qpair failed and we were unable to recover it. 00:26:21.570 [2024-04-16 23:04:12.411679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.570 [2024-04-16 23:04:12.411837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.570 [2024-04-16 23:04:12.411863] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.570 qpair failed and we were unable to recover it. 00:26:21.570 [2024-04-16 23:04:12.412014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.570 [2024-04-16 23:04:12.412148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.570 [2024-04-16 23:04:12.412200] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.570 qpair failed and we were unable to recover it. 00:26:21.570 [2024-04-16 23:04:12.412372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.570 [2024-04-16 23:04:12.412564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.570 [2024-04-16 23:04:12.412607] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.570 qpair failed and we were unable to recover it. 00:26:21.570 [2024-04-16 23:04:12.412729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.570 [2024-04-16 23:04:12.412875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.570 [2024-04-16 23:04:12.412900] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.570 qpair failed and we were unable to recover it. 00:26:21.570 [2024-04-16 23:04:12.413041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.570 [2024-04-16 23:04:12.413242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.570 [2024-04-16 23:04:12.413287] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.570 qpair failed and we were unable to recover it. 00:26:21.570 [2024-04-16 23:04:12.413424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.570 [2024-04-16 23:04:12.413605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.570 [2024-04-16 23:04:12.413648] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.570 qpair failed and we were unable to recover it. 00:26:21.570 [2024-04-16 23:04:12.413765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.570 [2024-04-16 23:04:12.413881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.570 [2024-04-16 23:04:12.413907] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.570 qpair failed and we were unable to recover it. 00:26:21.570 [2024-04-16 23:04:12.414048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.570 [2024-04-16 23:04:12.414245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.570 [2024-04-16 23:04:12.414295] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.570 qpair failed and we were unable to recover it. 00:26:21.570 [2024-04-16 23:04:12.414453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.570 [2024-04-16 23:04:12.414627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.570 [2024-04-16 23:04:12.414670] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.570 qpair failed and we were unable to recover it. 00:26:21.570 [2024-04-16 23:04:12.414815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.570 [2024-04-16 23:04:12.414932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.571 [2024-04-16 23:04:12.414957] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.571 qpair failed and we were unable to recover it. 00:26:21.571 [2024-04-16 23:04:12.415074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.571 [2024-04-16 23:04:12.415238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.571 [2024-04-16 23:04:12.415285] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.571 qpair failed and we were unable to recover it. 00:26:21.571 [2024-04-16 23:04:12.415424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.571 [2024-04-16 23:04:12.415638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.571 [2024-04-16 23:04:12.415679] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.571 qpair failed and we were unable to recover it. 00:26:21.571 [2024-04-16 23:04:12.415827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.571 [2024-04-16 23:04:12.415973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.571 [2024-04-16 23:04:12.415999] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.571 qpair failed and we were unable to recover it. 00:26:21.571 [2024-04-16 23:04:12.416111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.571 [2024-04-16 23:04:12.416261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.571 [2024-04-16 23:04:12.416306] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.571 qpair failed and we were unable to recover it. 00:26:21.571 [2024-04-16 23:04:12.416475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.571 [2024-04-16 23:04:12.416605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.571 [2024-04-16 23:04:12.416632] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.571 qpair failed and we were unable to recover it. 00:26:21.571 [2024-04-16 23:04:12.416753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.571 [2024-04-16 23:04:12.416924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.571 [2024-04-16 23:04:12.416949] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.571 qpair failed and we were unable to recover it. 00:26:21.571 [2024-04-16 23:04:12.417065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.571 [2024-04-16 23:04:12.417207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.571 [2024-04-16 23:04:12.417234] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.571 qpair failed and we were unable to recover it. 00:26:21.571 [2024-04-16 23:04:12.417377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.571 [2024-04-16 23:04:12.417540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.571 [2024-04-16 23:04:12.417584] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.571 qpair failed and we were unable to recover it. 00:26:21.571 [2024-04-16 23:04:12.417705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.571 [2024-04-16 23:04:12.417850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.571 [2024-04-16 23:04:12.417875] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.571 qpair failed and we were unable to recover it. 00:26:21.571 [2024-04-16 23:04:12.418025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.571 [2024-04-16 23:04:12.418138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.571 [2024-04-16 23:04:12.418165] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.571 qpair failed and we were unable to recover it. 00:26:21.571 [2024-04-16 23:04:12.418309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.571 [2024-04-16 23:04:12.418460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.571 [2024-04-16 23:04:12.418502] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.571 qpair failed and we were unable to recover it. 00:26:21.571 [2024-04-16 23:04:12.418626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.571 [2024-04-16 23:04:12.418770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.571 [2024-04-16 23:04:12.418795] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.571 qpair failed and we were unable to recover it. 00:26:21.571 [2024-04-16 23:04:12.418916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.571 [2024-04-16 23:04:12.419059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.571 [2024-04-16 23:04:12.419084] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.571 qpair failed and we were unable to recover it. 00:26:21.571 [2024-04-16 23:04:12.419218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.571 [2024-04-16 23:04:12.419409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.571 [2024-04-16 23:04:12.419452] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.571 qpair failed and we were unable to recover it. 00:26:21.571 [2024-04-16 23:04:12.419650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.571 [2024-04-16 23:04:12.419812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.571 [2024-04-16 23:04:12.419837] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.571 qpair failed and we were unable to recover it. 00:26:21.571 [2024-04-16 23:04:12.419983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.571 [2024-04-16 23:04:12.420133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.571 [2024-04-16 23:04:12.420158] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.571 qpair failed and we were unable to recover it. 00:26:21.571 [2024-04-16 23:04:12.420325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.571 [2024-04-16 23:04:12.420500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.571 [2024-04-16 23:04:12.420542] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.571 qpair failed and we were unable to recover it. 00:26:21.571 [2024-04-16 23:04:12.420715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.571 [2024-04-16 23:04:12.420904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.571 [2024-04-16 23:04:12.420929] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.571 qpair failed and we were unable to recover it. 00:26:21.571 [2024-04-16 23:04:12.421051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.571 [2024-04-16 23:04:12.421161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.571 [2024-04-16 23:04:12.421195] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.571 qpair failed and we were unable to recover it. 00:26:21.571 [2024-04-16 23:04:12.421363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.571 [2024-04-16 23:04:12.421503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.571 [2024-04-16 23:04:12.421530] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.571 qpair failed and we were unable to recover it. 00:26:21.571 [2024-04-16 23:04:12.421690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.571 [2024-04-16 23:04:12.421850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.571 [2024-04-16 23:04:12.421875] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.571 qpair failed and we were unable to recover it. 00:26:21.571 [2024-04-16 23:04:12.422012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.571 [2024-04-16 23:04:12.422149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.571 [2024-04-16 23:04:12.422174] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.571 qpair failed and we were unable to recover it. 00:26:21.571 [2024-04-16 23:04:12.422341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.571 [2024-04-16 23:04:12.422550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.571 [2024-04-16 23:04:12.422592] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.571 qpair failed and we were unable to recover it. 00:26:21.571 [2024-04-16 23:04:12.422746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.571 [2024-04-16 23:04:12.422907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.571 [2024-04-16 23:04:12.422932] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.571 qpair failed and we were unable to recover it. 00:26:21.571 [2024-04-16 23:04:12.423076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.571 [2024-04-16 23:04:12.423188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.571 [2024-04-16 23:04:12.423215] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.571 qpair failed and we were unable to recover it. 00:26:21.571 [2024-04-16 23:04:12.423358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.571 [2024-04-16 23:04:12.423528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.571 [2024-04-16 23:04:12.423573] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.571 qpair failed and we were unable to recover it. 00:26:21.571 [2024-04-16 23:04:12.423704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.571 [2024-04-16 23:04:12.423858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.571 [2024-04-16 23:04:12.423883] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.571 qpair failed and we were unable to recover it. 00:26:21.572 [2024-04-16 23:04:12.424050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.572 [2024-04-16 23:04:12.424203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.572 [2024-04-16 23:04:12.424230] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.572 qpair failed and we were unable to recover it. 00:26:21.572 [2024-04-16 23:04:12.424380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.572 [2024-04-16 23:04:12.424512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.572 [2024-04-16 23:04:12.424537] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.572 qpair failed and we were unable to recover it. 00:26:21.572 [2024-04-16 23:04:12.424681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.572 [2024-04-16 23:04:12.424807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.572 [2024-04-16 23:04:12.424850] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.572 qpair failed and we were unable to recover it. 00:26:21.572 [2024-04-16 23:04:12.424956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.572 [2024-04-16 23:04:12.425135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.572 [2024-04-16 23:04:12.425160] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.572 qpair failed and we were unable to recover it. 00:26:21.572 [2024-04-16 23:04:12.425357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.572 [2024-04-16 23:04:12.425551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.572 [2024-04-16 23:04:12.425593] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.572 qpair failed and we were unable to recover it. 00:26:21.572 [2024-04-16 23:04:12.425749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.572 [2024-04-16 23:04:12.425902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.572 [2024-04-16 23:04:12.425927] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.572 qpair failed and we were unable to recover it. 00:26:21.572 [2024-04-16 23:04:12.426066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.572 [2024-04-16 23:04:12.426220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.572 [2024-04-16 23:04:12.426249] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.572 qpair failed and we were unable to recover it. 00:26:21.572 [2024-04-16 23:04:12.426429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.572 [2024-04-16 23:04:12.426610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.572 [2024-04-16 23:04:12.426651] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.572 qpair failed and we were unable to recover it. 00:26:21.572 [2024-04-16 23:04:12.426843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.572 [2024-04-16 23:04:12.426997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.572 [2024-04-16 23:04:12.427021] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.572 qpair failed and we were unable to recover it. 00:26:21.572 [2024-04-16 23:04:12.427157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.572 [2024-04-16 23:04:12.427322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.572 [2024-04-16 23:04:12.427365] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.572 qpair failed and we were unable to recover it. 00:26:21.572 [2024-04-16 23:04:12.427506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.572 [2024-04-16 23:04:12.427684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.572 [2024-04-16 23:04:12.427727] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.572 qpair failed and we were unable to recover it. 00:26:21.572 [2024-04-16 23:04:12.427895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.572 [2024-04-16 23:04:12.428053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.572 [2024-04-16 23:04:12.428077] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.572 qpair failed and we were unable to recover it. 00:26:21.572 [2024-04-16 23:04:12.428239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.572 [2024-04-16 23:04:12.428427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.572 [2024-04-16 23:04:12.428468] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.572 qpair failed and we were unable to recover it. 00:26:21.572 [2024-04-16 23:04:12.428595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.572 [2024-04-16 23:04:12.428773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.572 [2024-04-16 23:04:12.428803] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.572 qpair failed and we were unable to recover it. 00:26:21.572 [2024-04-16 23:04:12.428987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.572 [2024-04-16 23:04:12.429131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.572 [2024-04-16 23:04:12.429156] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:21.572 qpair failed and we were unable to recover it. 00:26:21.572 [2024-04-16 23:04:12.429340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.572 [2024-04-16 23:04:12.429552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.572 [2024-04-16 23:04:12.429583] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:21.572 qpair failed and we were unable to recover it. 00:26:21.572 [2024-04-16 23:04:12.429736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.572 [2024-04-16 23:04:12.429865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.572 [2024-04-16 23:04:12.429893] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:21.572 qpair failed and we were unable to recover it. 00:26:21.572 [2024-04-16 23:04:12.430079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.572 [2024-04-16 23:04:12.430259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.572 [2024-04-16 23:04:12.430285] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:21.572 qpair failed and we were unable to recover it. 00:26:21.572 [2024-04-16 23:04:12.430424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.572 [2024-04-16 23:04:12.430595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.572 [2024-04-16 23:04:12.430625] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:21.572 qpair failed and we were unable to recover it. 00:26:21.572 [2024-04-16 23:04:12.430784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.572 [2024-04-16 23:04:12.430958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.572 [2024-04-16 23:04:12.430983] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:21.572 qpair failed and we were unable to recover it. 00:26:21.572 [2024-04-16 23:04:12.431123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.572 [2024-04-16 23:04:12.431281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.572 [2024-04-16 23:04:12.431306] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:21.572 qpair failed and we were unable to recover it. 00:26:21.572 [2024-04-16 23:04:12.431420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.572 [2024-04-16 23:04:12.431592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.572 [2024-04-16 23:04:12.431620] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:21.572 qpair failed and we were unable to recover it. 00:26:21.572 [2024-04-16 23:04:12.431777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.572 [2024-04-16 23:04:12.431923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.572 [2024-04-16 23:04:12.431950] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:21.572 qpair failed and we were unable to recover it. 00:26:21.572 [2024-04-16 23:04:12.432117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.572 [2024-04-16 23:04:12.432244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.572 [2024-04-16 23:04:12.432268] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:21.572 qpair failed and we were unable to recover it. 00:26:21.572 [2024-04-16 23:04:12.432405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.572 [2024-04-16 23:04:12.432612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.572 [2024-04-16 23:04:12.432637] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:21.572 qpair failed and we were unable to recover it. 00:26:21.572 [2024-04-16 23:04:12.432781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.572 [2024-04-16 23:04:12.432946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.572 [2024-04-16 23:04:12.432975] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:21.572 qpair failed and we were unable to recover it. 00:26:21.572 [2024-04-16 23:04:12.433141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.572 [2024-04-16 23:04:12.433285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.573 [2024-04-16 23:04:12.433311] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:21.573 qpair failed and we were unable to recover it. 00:26:21.573 [2024-04-16 23:04:12.433539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.573 [2024-04-16 23:04:12.433734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.573 [2024-04-16 23:04:12.433762] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:21.573 qpair failed and we were unable to recover it. 00:26:21.573 [2024-04-16 23:04:12.433914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.573 [2024-04-16 23:04:12.434083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.573 [2024-04-16 23:04:12.434109] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:21.573 qpair failed and we were unable to recover it. 00:26:21.573 [2024-04-16 23:04:12.434229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.573 [2024-04-16 23:04:12.434370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.573 [2024-04-16 23:04:12.434395] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:21.573 qpair failed and we were unable to recover it. 00:26:21.573 [2024-04-16 23:04:12.434560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.573 [2024-04-16 23:04:12.434691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.573 [2024-04-16 23:04:12.434720] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:21.573 qpair failed and we were unable to recover it. 00:26:21.573 [2024-04-16 23:04:12.434930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.573 [2024-04-16 23:04:12.435055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.573 [2024-04-16 23:04:12.435084] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:21.573 qpair failed and we were unable to recover it. 00:26:21.573 [2024-04-16 23:04:12.435252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.573 [2024-04-16 23:04:12.435400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.573 [2024-04-16 23:04:12.435425] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:21.573 qpair failed and we were unable to recover it. 00:26:21.573 [2024-04-16 23:04:12.435557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.573 [2024-04-16 23:04:12.435680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.573 [2024-04-16 23:04:12.435709] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:21.573 qpair failed and we were unable to recover it. 00:26:21.573 [2024-04-16 23:04:12.435876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.573 [2024-04-16 23:04:12.436040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.573 [2024-04-16 23:04:12.436068] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:21.573 qpair failed and we were unable to recover it. 00:26:21.573 [2024-04-16 23:04:12.436234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.573 [2024-04-16 23:04:12.436382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.573 [2024-04-16 23:04:12.436408] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:21.573 qpair failed and we were unable to recover it. 00:26:21.573 [2024-04-16 23:04:12.436596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.573 [2024-04-16 23:04:12.437472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.573 [2024-04-16 23:04:12.437504] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:21.573 qpair failed and we were unable to recover it. 00:26:21.573 [2024-04-16 23:04:12.437671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.573 [2024-04-16 23:04:12.437911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.573 [2024-04-16 23:04:12.437940] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:21.573 qpair failed and we were unable to recover it. 00:26:21.573 [2024-04-16 23:04:12.438097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.573 [2024-04-16 23:04:12.438276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.573 [2024-04-16 23:04:12.438302] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:21.573 qpair failed and we were unable to recover it. 00:26:21.573 [2024-04-16 23:04:12.438437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.573 [2024-04-16 23:04:12.438582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.573 [2024-04-16 23:04:12.438608] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:21.573 qpair failed and we were unable to recover it. 00:26:21.573 [2024-04-16 23:04:12.438762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.573 [2024-04-16 23:04:12.439431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.573 [2024-04-16 23:04:12.439481] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:21.573 qpair failed and we were unable to recover it. 00:26:21.573 [2024-04-16 23:04:12.439653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.573 [2024-04-16 23:04:12.439786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.573 [2024-04-16 23:04:12.439816] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:21.573 qpair failed and we were unable to recover it. 00:26:21.573 [2024-04-16 23:04:12.439938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.573 [2024-04-16 23:04:12.440111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.573 [2024-04-16 23:04:12.440136] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:21.573 qpair failed and we were unable to recover it. 00:26:21.573 [2024-04-16 23:04:12.440305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.573 [2024-04-16 23:04:12.440418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.573 [2024-04-16 23:04:12.440443] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:21.573 qpair failed and we were unable to recover it. 00:26:21.573 [2024-04-16 23:04:12.440573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.573 [2024-04-16 23:04:12.440709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.573 [2024-04-16 23:04:12.440738] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:21.573 qpair failed and we were unable to recover it. 00:26:21.573 [2024-04-16 23:04:12.440893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.573 [2024-04-16 23:04:12.441049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.573 [2024-04-16 23:04:12.441076] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:21.573 qpair failed and we were unable to recover it. 00:26:21.573 [2024-04-16 23:04:12.441222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.573 [2024-04-16 23:04:12.441364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.573 [2024-04-16 23:04:12.441392] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:21.573 qpair failed and we were unable to recover it. 00:26:21.573 [2024-04-16 23:04:12.441562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.573 [2024-04-16 23:04:12.441731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.573 [2024-04-16 23:04:12.441757] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:21.573 qpair failed and we were unable to recover it. 00:26:21.573 [2024-04-16 23:04:12.441901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.573 [2024-04-16 23:04:12.442066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.573 [2024-04-16 23:04:12.442095] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:21.573 qpair failed and we were unable to recover it. 00:26:21.573 [2024-04-16 23:04:12.442259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.573 [2024-04-16 23:04:12.442404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.573 [2024-04-16 23:04:12.442429] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:21.573 qpair failed and we were unable to recover it. 00:26:21.573 [2024-04-16 23:04:12.442555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.573 [2024-04-16 23:04:12.442765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.573 [2024-04-16 23:04:12.442790] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:21.573 qpair failed and we were unable to recover it. 00:26:21.573 [2024-04-16 23:04:12.442957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.573 [2024-04-16 23:04:12.443089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.573 [2024-04-16 23:04:12.443114] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:21.573 qpair failed and we were unable to recover it. 00:26:21.573 [2024-04-16 23:04:12.443275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.573 [2024-04-16 23:04:12.443420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.573 [2024-04-16 23:04:12.443445] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:21.573 qpair failed and we were unable to recover it. 00:26:21.573 [2024-04-16 23:04:12.443619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.573 [2024-04-16 23:04:12.443731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.573 [2024-04-16 23:04:12.443756] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:21.573 qpair failed and we were unable to recover it. 00:26:21.574 [2024-04-16 23:04:12.443867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.574 [2024-04-16 23:04:12.443985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.574 [2024-04-16 23:04:12.444009] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:21.574 qpair failed and we were unable to recover it. 00:26:21.574 [2024-04-16 23:04:12.444145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.574 [2024-04-16 23:04:12.444290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.574 [2024-04-16 23:04:12.444331] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:21.574 qpair failed and we were unable to recover it. 00:26:21.574 [2024-04-16 23:04:12.444500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.574 [2024-04-16 23:04:12.444650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.574 [2024-04-16 23:04:12.444689] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:21.574 qpair failed and we were unable to recover it. 00:26:21.574 [2024-04-16 23:04:12.444923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.574 [2024-04-16 23:04:12.445067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.574 [2024-04-16 23:04:12.445094] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:21.574 qpair failed and we were unable to recover it. 00:26:21.574 [2024-04-16 23:04:12.445252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.574 [2024-04-16 23:04:12.445388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.574 [2024-04-16 23:04:12.445418] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:21.574 qpair failed and we were unable to recover it. 00:26:21.574 [2024-04-16 23:04:12.445628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.574 [2024-04-16 23:04:12.445781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.574 [2024-04-16 23:04:12.445809] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:21.574 qpair failed and we were unable to recover it. 00:26:21.574 [2024-04-16 23:04:12.445957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.574 [2024-04-16 23:04:12.446087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.574 [2024-04-16 23:04:12.446117] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:21.574 qpair failed and we were unable to recover it. 00:26:21.574 [2024-04-16 23:04:12.446289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.574 [2024-04-16 23:04:12.446429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.574 [2024-04-16 23:04:12.446457] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:21.574 qpair failed and we were unable to recover it. 00:26:21.574 [2024-04-16 23:04:12.446644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.574 [2024-04-16 23:04:12.446767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.574 [2024-04-16 23:04:12.446795] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:21.574 qpair failed and we were unable to recover it. 00:26:21.574 [2024-04-16 23:04:12.446954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.574 [2024-04-16 23:04:12.447099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.574 [2024-04-16 23:04:12.447126] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:21.574 qpair failed and we were unable to recover it. 00:26:21.574 [2024-04-16 23:04:12.447342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.574 [2024-04-16 23:04:12.447452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.574 [2024-04-16 23:04:12.447486] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:21.574 qpair failed and we were unable to recover it. 00:26:21.574 [2024-04-16 23:04:12.447685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.574 [2024-04-16 23:04:12.447843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.574 [2024-04-16 23:04:12.447871] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:21.574 qpair failed and we were unable to recover it. 00:26:21.574 [2024-04-16 23:04:12.447993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.574 [2024-04-16 23:04:12.448157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.574 [2024-04-16 23:04:12.448187] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:21.574 qpair failed and we were unable to recover it. 00:26:21.574 [2024-04-16 23:04:12.448363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.574 [2024-04-16 23:04:12.448537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.574 [2024-04-16 23:04:12.448564] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:21.574 qpair failed and we were unable to recover it. 00:26:21.574 [2024-04-16 23:04:12.448716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.574 [2024-04-16 23:04:12.448868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.574 [2024-04-16 23:04:12.448895] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:21.574 qpair failed and we were unable to recover it. 00:26:21.574 [2024-04-16 23:04:12.449079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.574 [2024-04-16 23:04:12.449241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.574 [2024-04-16 23:04:12.449270] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:21.574 qpair failed and we were unable to recover it. 00:26:21.574 [2024-04-16 23:04:12.449427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.574 [2024-04-16 23:04:12.449559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.574 [2024-04-16 23:04:12.449588] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:21.574 qpair failed and we were unable to recover it. 00:26:21.574 [2024-04-16 23:04:12.449745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.574 [2024-04-16 23:04:12.449917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.574 [2024-04-16 23:04:12.449943] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:21.574 qpair failed and we were unable to recover it. 00:26:21.574 [2024-04-16 23:04:12.450126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.574 [2024-04-16 23:04:12.450282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.574 [2024-04-16 23:04:12.450310] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:21.574 qpair failed and we were unable to recover it. 00:26:21.574 [2024-04-16 23:04:12.450493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.574 [2024-04-16 23:04:12.450645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.574 [2024-04-16 23:04:12.450673] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:21.574 qpair failed and we were unable to recover it. 00:26:21.574 [2024-04-16 23:04:12.450874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.574 [2024-04-16 23:04:12.451012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.574 [2024-04-16 23:04:12.451044] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.574 qpair failed and we were unable to recover it. 00:26:21.574 [2024-04-16 23:04:12.451206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.574 [2024-04-16 23:04:12.451323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.574 [2024-04-16 23:04:12.451348] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.574 qpair failed and we were unable to recover it. 00:26:21.574 [2024-04-16 23:04:12.451533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.575 [2024-04-16 23:04:12.451649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.575 [2024-04-16 23:04:12.451674] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.575 qpair failed and we were unable to recover it. 00:26:21.575 [2024-04-16 23:04:12.451784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.575 [2024-04-16 23:04:12.451957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.575 [2024-04-16 23:04:12.451983] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.575 qpair failed and we were unable to recover it. 00:26:21.575 [2024-04-16 23:04:12.452183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.575 [2024-04-16 23:04:12.452315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.575 [2024-04-16 23:04:12.452340] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.575 qpair failed and we were unable to recover it. 00:26:21.575 [2024-04-16 23:04:12.452455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.575 [2024-04-16 23:04:12.452577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.575 [2024-04-16 23:04:12.452616] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.575 qpair failed and we were unable to recover it. 00:26:21.575 [2024-04-16 23:04:12.452806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.575 [2024-04-16 23:04:12.452960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.575 [2024-04-16 23:04:12.452987] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.575 qpair failed and we were unable to recover it. 00:26:21.575 [2024-04-16 23:04:12.453136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.575 [2024-04-16 23:04:12.453322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.575 [2024-04-16 23:04:12.453347] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.575 qpair failed and we were unable to recover it. 00:26:21.575 [2024-04-16 23:04:12.453508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.575 [2024-04-16 23:04:12.453633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.575 [2024-04-16 23:04:12.453662] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.575 qpair failed and we were unable to recover it. 00:26:21.575 [2024-04-16 23:04:12.453824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.575 [2024-04-16 23:04:12.453941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.575 [2024-04-16 23:04:12.453965] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.575 qpair failed and we were unable to recover it. 00:26:21.575 [2024-04-16 23:04:12.454125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.575 [2024-04-16 23:04:12.454303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.575 [2024-04-16 23:04:12.454328] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.575 qpair failed and we were unable to recover it. 00:26:21.575 [2024-04-16 23:04:12.454496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.575 [2024-04-16 23:04:12.454635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.575 [2024-04-16 23:04:12.454659] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.575 qpair failed and we were unable to recover it. 00:26:21.575 [2024-04-16 23:04:12.454803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.575 [2024-04-16 23:04:12.454948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.575 [2024-04-16 23:04:12.454973] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.575 qpair failed and we were unable to recover it. 00:26:21.575 [2024-04-16 23:04:12.455149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.575 [2024-04-16 23:04:12.455302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.575 [2024-04-16 23:04:12.455328] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.575 qpair failed and we were unable to recover it. 00:26:21.575 [2024-04-16 23:04:12.455469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.575 [2024-04-16 23:04:12.455670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.575 [2024-04-16 23:04:12.455695] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.575 qpair failed and we were unable to recover it. 00:26:21.575 [2024-04-16 23:04:12.455838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.575 [2024-04-16 23:04:12.456018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.575 [2024-04-16 23:04:12.456043] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.575 qpair failed and we were unable to recover it. 00:26:21.575 [2024-04-16 23:04:12.456186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.575 [2024-04-16 23:04:12.456330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.575 [2024-04-16 23:04:12.456355] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.575 qpair failed and we were unable to recover it. 00:26:21.575 [2024-04-16 23:04:12.456513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.575 [2024-04-16 23:04:12.456664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.575 [2024-04-16 23:04:12.456710] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.575 qpair failed and we were unable to recover it. 00:26:21.575 [2024-04-16 23:04:12.456903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.575 [2024-04-16 23:04:12.457020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.575 [2024-04-16 23:04:12.457046] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.575 qpair failed and we were unable to recover it. 00:26:21.575 [2024-04-16 23:04:12.457219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.575 [2024-04-16 23:04:12.457361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.575 [2024-04-16 23:04:12.457385] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.575 qpair failed and we were unable to recover it. 00:26:21.575 [2024-04-16 23:04:12.457563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.575 [2024-04-16 23:04:12.457722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.575 [2024-04-16 23:04:12.457747] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.575 qpair failed and we were unable to recover it. 00:26:21.575 [2024-04-16 23:04:12.457893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.575 [2024-04-16 23:04:12.458002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.575 [2024-04-16 23:04:12.458027] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.575 qpair failed and we were unable to recover it. 00:26:21.575 [2024-04-16 23:04:12.458170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.575 [2024-04-16 23:04:12.458314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.575 [2024-04-16 23:04:12.458339] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.575 qpair failed and we were unable to recover it. 00:26:21.575 [2024-04-16 23:04:12.458538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.575 [2024-04-16 23:04:12.458668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.575 [2024-04-16 23:04:12.458704] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.575 qpair failed and we were unable to recover it. 00:26:21.575 [2024-04-16 23:04:12.458865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.575 [2024-04-16 23:04:12.459025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.575 [2024-04-16 23:04:12.459050] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.575 qpair failed and we were unable to recover it. 00:26:21.575 [2024-04-16 23:04:12.459165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.575 [2024-04-16 23:04:12.459304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.575 [2024-04-16 23:04:12.459329] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.575 qpair failed and we were unable to recover it. 00:26:21.575 [2024-04-16 23:04:12.459443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.575 [2024-04-16 23:04:12.459618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.575 [2024-04-16 23:04:12.459647] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.575 qpair failed and we were unable to recover it. 00:26:21.575 [2024-04-16 23:04:12.459813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.575 [2024-04-16 23:04:12.459948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.575 [2024-04-16 23:04:12.459973] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.575 qpair failed and we were unable to recover it. 00:26:21.575 [2024-04-16 23:04:12.460114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.575 [2024-04-16 23:04:12.460287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.575 [2024-04-16 23:04:12.460312] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.575 qpair failed and we were unable to recover it. 00:26:21.575 [2024-04-16 23:04:12.460419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.575 [2024-04-16 23:04:12.460538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.575 [2024-04-16 23:04:12.460562] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.575 qpair failed and we were unable to recover it. 00:26:21.575 [2024-04-16 23:04:12.460729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.575 [2024-04-16 23:04:12.460861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.575 [2024-04-16 23:04:12.460889] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.576 qpair failed and we were unable to recover it. 00:26:21.576 [2024-04-16 23:04:12.461020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.576 [2024-04-16 23:04:12.461184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.576 [2024-04-16 23:04:12.461212] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.576 qpair failed and we were unable to recover it. 00:26:21.576 [2024-04-16 23:04:12.461351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.576 [2024-04-16 23:04:12.461493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.576 [2024-04-16 23:04:12.461518] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.576 qpair failed and we were unable to recover it. 00:26:21.576 [2024-04-16 23:04:12.461686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.576 [2024-04-16 23:04:12.461825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.576 [2024-04-16 23:04:12.461850] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.576 qpair failed and we were unable to recover it. 00:26:21.576 [2024-04-16 23:04:12.462033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.576 [2024-04-16 23:04:12.462184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.576 [2024-04-16 23:04:12.462213] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.576 qpair failed and we were unable to recover it. 00:26:21.576 [2024-04-16 23:04:12.462378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.576 [2024-04-16 23:04:12.462494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.576 [2024-04-16 23:04:12.462521] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.576 qpair failed and we were unable to recover it. 00:26:21.576 [2024-04-16 23:04:12.462746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.576 [2024-04-16 23:04:12.462933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.576 [2024-04-16 23:04:12.462958] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.576 qpair failed and we were unable to recover it. 00:26:21.576 [2024-04-16 23:04:12.463105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.576 [2024-04-16 23:04:12.463249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.576 [2024-04-16 23:04:12.463275] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.576 qpair failed and we were unable to recover it. 00:26:21.576 [2024-04-16 23:04:12.463392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.576 [2024-04-16 23:04:12.463553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.576 [2024-04-16 23:04:12.463581] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.576 qpair failed and we were unable to recover it. 00:26:21.576 [2024-04-16 23:04:12.463725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.576 [2024-04-16 23:04:12.463890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.576 [2024-04-16 23:04:12.463918] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.576 qpair failed and we were unable to recover it. 00:26:21.576 [2024-04-16 23:04:12.464062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.576 [2024-04-16 23:04:12.464240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.576 [2024-04-16 23:04:12.464265] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.576 qpair failed and we were unable to recover it. 00:26:21.576 [2024-04-16 23:04:12.464409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.576 [2024-04-16 23:04:12.464562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.576 [2024-04-16 23:04:12.464604] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.576 qpair failed and we were unable to recover it. 00:26:21.576 [2024-04-16 23:04:12.464757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.576 [2024-04-16 23:04:12.464939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.576 [2024-04-16 23:04:12.464966] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.576 qpair failed and we were unable to recover it. 00:26:21.576 [2024-04-16 23:04:12.465150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.576 [2024-04-16 23:04:12.465293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.576 [2024-04-16 23:04:12.465318] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.576 qpair failed and we were unable to recover it. 00:26:21.576 [2024-04-16 23:04:12.465475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.576 [2024-04-16 23:04:12.465657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.576 [2024-04-16 23:04:12.465685] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.576 qpair failed and we were unable to recover it. 00:26:21.576 [2024-04-16 23:04:12.465854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.576 [2024-04-16 23:04:12.466040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.576 [2024-04-16 23:04:12.466068] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.576 qpair failed and we were unable to recover it. 00:26:21.576 [2024-04-16 23:04:12.466271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.576 [2024-04-16 23:04:12.466421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.576 [2024-04-16 23:04:12.466447] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.576 qpair failed and we were unable to recover it. 00:26:21.576 [2024-04-16 23:04:12.466614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.576 [2024-04-16 23:04:12.466768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.576 [2024-04-16 23:04:12.466796] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.576 qpair failed and we were unable to recover it. 00:26:21.576 [2024-04-16 23:04:12.466975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.576 [2024-04-16 23:04:12.467158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.576 [2024-04-16 23:04:12.467198] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.576 qpair failed and we were unable to recover it. 00:26:21.576 [2024-04-16 23:04:12.467360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.576 [2024-04-16 23:04:12.467502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.576 [2024-04-16 23:04:12.467544] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.576 qpair failed and we were unable to recover it. 00:26:21.576 [2024-04-16 23:04:12.467727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.576 [2024-04-16 23:04:12.467887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.576 [2024-04-16 23:04:12.467911] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.576 qpair failed and we were unable to recover it. 00:26:21.576 [2024-04-16 23:04:12.468028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.576 [2024-04-16 23:04:12.468191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.576 [2024-04-16 23:04:12.468220] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.576 qpair failed and we were unable to recover it. 00:26:21.576 [2024-04-16 23:04:12.468343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.576 [2024-04-16 23:04:12.468488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.576 [2024-04-16 23:04:12.468516] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.576 qpair failed and we were unable to recover it. 00:26:21.576 [2024-04-16 23:04:12.468704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.576 [2024-04-16 23:04:12.468889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.576 [2024-04-16 23:04:12.468917] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.576 qpair failed and we were unable to recover it. 00:26:21.576 [2024-04-16 23:04:12.469100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.576 [2024-04-16 23:04:12.469254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.576 [2024-04-16 23:04:12.469282] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.576 qpair failed and we were unable to recover it. 00:26:21.576 [2024-04-16 23:04:12.469414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.576 [2024-04-16 23:04:12.469576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.576 [2024-04-16 23:04:12.469603] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.576 qpair failed and we were unable to recover it. 00:26:21.576 [2024-04-16 23:04:12.469722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.576 [2024-04-16 23:04:12.469904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.576 [2024-04-16 23:04:12.469931] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.576 qpair failed and we were unable to recover it. 00:26:21.576 [2024-04-16 23:04:12.470097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.577 [2024-04-16 23:04:12.470239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.577 [2024-04-16 23:04:12.470291] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.577 qpair failed and we were unable to recover it. 00:26:21.577 [2024-04-16 23:04:12.470416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.577 [2024-04-16 23:04:12.470542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.577 [2024-04-16 23:04:12.470570] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.577 qpair failed and we were unable to recover it. 00:26:21.577 [2024-04-16 23:04:12.470735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.577 [2024-04-16 23:04:12.470855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.577 [2024-04-16 23:04:12.470883] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.577 qpair failed and we were unable to recover it. 00:26:21.577 [2024-04-16 23:04:12.471071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.577 [2024-04-16 23:04:12.471192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.577 [2024-04-16 23:04:12.471220] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.577 qpair failed and we were unable to recover it. 00:26:21.577 [2024-04-16 23:04:12.471390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.577 [2024-04-16 23:04:12.471514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.577 [2024-04-16 23:04:12.471540] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.577 qpair failed and we were unable to recover it. 00:26:21.577 [2024-04-16 23:04:12.471731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.577 [2024-04-16 23:04:12.471860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.577 [2024-04-16 23:04:12.471887] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.577 qpair failed and we were unable to recover it. 00:26:21.577 [2024-04-16 23:04:12.472017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.577 [2024-04-16 23:04:12.472150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.577 [2024-04-16 23:04:12.472186] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.577 qpair failed and we were unable to recover it. 00:26:21.577 [2024-04-16 23:04:12.472315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.577 [2024-04-16 23:04:12.472496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.577 [2024-04-16 23:04:12.472524] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.577 qpair failed and we were unable to recover it. 00:26:21.577 [2024-04-16 23:04:12.472661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.577 [2024-04-16 23:04:12.472765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.577 [2024-04-16 23:04:12.472789] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.577 qpair failed and we were unable to recover it. 00:26:21.577 [2024-04-16 23:04:12.472952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.577 [2024-04-16 23:04:12.473111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.577 [2024-04-16 23:04:12.473140] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.577 qpair failed and we were unable to recover it. 00:26:21.577 [2024-04-16 23:04:12.473309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.577 [2024-04-16 23:04:12.473498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.577 [2024-04-16 23:04:12.473526] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.577 qpair failed and we were unable to recover it. 00:26:21.577 [2024-04-16 23:04:12.473682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.577 [2024-04-16 23:04:12.473839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.577 [2024-04-16 23:04:12.473870] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.577 qpair failed and we were unable to recover it. 00:26:21.577 [2024-04-16 23:04:12.474031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.577 [2024-04-16 23:04:12.474173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.577 [2024-04-16 23:04:12.474205] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.577 qpair failed and we were unable to recover it. 00:26:21.577 [2024-04-16 23:04:12.474361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.577 [2024-04-16 23:04:12.474511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.577 [2024-04-16 23:04:12.474536] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.577 qpair failed and we were unable to recover it. 00:26:21.577 [2024-04-16 23:04:12.474711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.577 [2024-04-16 23:04:12.474823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.577 [2024-04-16 23:04:12.474849] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.577 qpair failed and we were unable to recover it. 00:26:21.577 [2024-04-16 23:04:12.475008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.577 [2024-04-16 23:04:12.475185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.577 [2024-04-16 23:04:12.475212] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.577 qpair failed and we were unable to recover it. 00:26:21.577 [2024-04-16 23:04:12.475321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.577 [2024-04-16 23:04:12.475468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.577 [2024-04-16 23:04:12.475493] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.577 qpair failed and we were unable to recover it. 00:26:21.577 [2024-04-16 23:04:12.475634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.577 [2024-04-16 23:04:12.475822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.577 [2024-04-16 23:04:12.475847] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.577 qpair failed and we were unable to recover it. 00:26:21.577 [2024-04-16 23:04:12.475990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.577 [2024-04-16 23:04:12.476163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.577 [2024-04-16 23:04:12.476197] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.577 qpair failed and we were unable to recover it. 00:26:21.577 [2024-04-16 23:04:12.476388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.577 [2024-04-16 23:04:12.476568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.577 [2024-04-16 23:04:12.476592] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.577 qpair failed and we were unable to recover it. 00:26:21.577 [2024-04-16 23:04:12.476736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.577 [2024-04-16 23:04:12.476844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.577 [2024-04-16 23:04:12.476869] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.577 qpair failed and we were unable to recover it. 00:26:21.577 [2024-04-16 23:04:12.477008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.577 [2024-04-16 23:04:12.477200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.577 [2024-04-16 23:04:12.477229] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.577 qpair failed and we were unable to recover it. 00:26:21.577 [2024-04-16 23:04:12.477365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.577 [2024-04-16 23:04:12.477510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.577 [2024-04-16 23:04:12.477537] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.577 qpair failed and we were unable to recover it. 00:26:21.577 [2024-04-16 23:04:12.477704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.577 [2024-04-16 23:04:12.477880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.577 [2024-04-16 23:04:12.477904] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.577 qpair failed and we were unable to recover it. 00:26:21.577 [2024-04-16 23:04:12.478051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.577 [2024-04-16 23:04:12.478168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.577 [2024-04-16 23:04:12.478199] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.577 qpair failed and we were unable to recover it. 00:26:21.577 [2024-04-16 23:04:12.478332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.577 [2024-04-16 23:04:12.478507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.577 [2024-04-16 23:04:12.478531] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.577 qpair failed and we were unable to recover it. 00:26:21.577 [2024-04-16 23:04:12.478644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.577 [2024-04-16 23:04:12.478807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.577 [2024-04-16 23:04:12.478834] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.577 qpair failed and we were unable to recover it. 00:26:21.577 [2024-04-16 23:04:12.478995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.577 [2024-04-16 23:04:12.479141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.578 [2024-04-16 23:04:12.479168] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.578 qpair failed and we were unable to recover it. 00:26:21.578 [2024-04-16 23:04:12.479348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.578 [2024-04-16 23:04:12.479463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.578 [2024-04-16 23:04:12.479488] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.578 qpair failed and we were unable to recover it. 00:26:21.578 [2024-04-16 23:04:12.479660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.578 [2024-04-16 23:04:12.479840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.578 [2024-04-16 23:04:12.479865] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.578 qpair failed and we were unable to recover it. 00:26:21.578 [2024-04-16 23:04:12.479978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.578 [2024-04-16 23:04:12.480117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.578 [2024-04-16 23:04:12.480142] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.578 qpair failed and we were unable to recover it. 00:26:21.578 [2024-04-16 23:04:12.480285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.578 [2024-04-16 23:04:12.480437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.578 [2024-04-16 23:04:12.480462] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.578 qpair failed and we were unable to recover it. 00:26:21.578 [2024-04-16 23:04:12.480632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.578 [2024-04-16 23:04:12.480801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.578 [2024-04-16 23:04:12.480842] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.578 qpair failed and we were unable to recover it. 00:26:21.578 [2024-04-16 23:04:12.480968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.578 [2024-04-16 23:04:12.481149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.578 [2024-04-16 23:04:12.481190] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.578 qpair failed and we were unable to recover it. 00:26:21.578 [2024-04-16 23:04:12.481348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.578 [2024-04-16 23:04:12.481516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.578 [2024-04-16 23:04:12.481586] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.578 qpair failed and we were unable to recover it. 00:26:21.578 [2024-04-16 23:04:12.481749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.578 [2024-04-16 23:04:12.481901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.578 [2024-04-16 23:04:12.481930] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.578 qpair failed and we were unable to recover it. 00:26:21.578 [2024-04-16 23:04:12.482102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.578 [2024-04-16 23:04:12.482242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.578 [2024-04-16 23:04:12.482268] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.578 qpair failed and we were unable to recover it. 00:26:21.578 [2024-04-16 23:04:12.482485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.578 [2024-04-16 23:04:12.482626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.578 [2024-04-16 23:04:12.482652] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.578 qpair failed and we were unable to recover it. 00:26:21.578 [2024-04-16 23:04:12.482806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.578 [2024-04-16 23:04:12.482972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.578 [2024-04-16 23:04:12.482997] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.578 qpair failed and we were unable to recover it. 00:26:21.578 [2024-04-16 23:04:12.483112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.578 [2024-04-16 23:04:12.483223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.578 [2024-04-16 23:04:12.483248] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.578 qpair failed and we were unable to recover it. 00:26:21.578 [2024-04-16 23:04:12.483365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.578 [2024-04-16 23:04:12.483532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.578 [2024-04-16 23:04:12.483557] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.578 qpair failed and we were unable to recover it. 00:26:21.578 [2024-04-16 23:04:12.483752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.578 [2024-04-16 23:04:12.483878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.578 [2024-04-16 23:04:12.483905] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.578 qpair failed and we were unable to recover it. 00:26:21.578 [2024-04-16 23:04:12.484070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.578 [2024-04-16 23:04:12.484185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.578 [2024-04-16 23:04:12.484210] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.578 qpair failed and we were unable to recover it. 00:26:21.578 [2024-04-16 23:04:12.484378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.578 [2024-04-16 23:04:12.484554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.578 [2024-04-16 23:04:12.484581] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.578 qpair failed and we were unable to recover it. 00:26:21.578 [2024-04-16 23:04:12.484713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.578 [2024-04-16 23:04:12.484867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.578 [2024-04-16 23:04:12.484891] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.578 qpair failed and we were unable to recover it. 00:26:21.578 [2024-04-16 23:04:12.485028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.578 [2024-04-16 23:04:12.485200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.578 [2024-04-16 23:04:12.485228] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.578 qpair failed and we were unable to recover it. 00:26:21.578 [2024-04-16 23:04:12.485376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.578 [2024-04-16 23:04:12.485531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.578 [2024-04-16 23:04:12.485558] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.578 qpair failed and we were unable to recover it. 00:26:21.578 [2024-04-16 23:04:12.485691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.578 [2024-04-16 23:04:12.485830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.578 [2024-04-16 23:04:12.485855] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.578 qpair failed and we were unable to recover it. 00:26:21.578 [2024-04-16 23:04:12.485996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.578 [2024-04-16 23:04:12.486131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.578 [2024-04-16 23:04:12.486156] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.578 qpair failed and we were unable to recover it. 00:26:21.578 [2024-04-16 23:04:12.486344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.578 [2024-04-16 23:04:12.486491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.578 [2024-04-16 23:04:12.486518] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.578 qpair failed and we were unable to recover it. 00:26:21.578 [2024-04-16 23:04:12.486647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.578 [2024-04-16 23:04:12.486844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.578 [2024-04-16 23:04:12.486868] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.578 qpair failed and we were unable to recover it. 00:26:21.578 [2024-04-16 23:04:12.487020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.578 [2024-04-16 23:04:12.487171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.578 [2024-04-16 23:04:12.487206] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.578 qpair failed and we were unable to recover it. 00:26:21.578 [2024-04-16 23:04:12.487376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.578 [2024-04-16 23:04:12.487489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.578 [2024-04-16 23:04:12.487513] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.578 qpair failed and we were unable to recover it. 00:26:21.578 [2024-04-16 23:04:12.487684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.578 [2024-04-16 23:04:12.487852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.578 [2024-04-16 23:04:12.487876] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.578 qpair failed and we were unable to recover it. 00:26:21.578 [2024-04-16 23:04:12.488046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.578 [2024-04-16 23:04:12.488171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.578 [2024-04-16 23:04:12.488206] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.578 qpair failed and we were unable to recover it. 00:26:21.578 [2024-04-16 23:04:12.488341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.578 [2024-04-16 23:04:12.488496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.578 [2024-04-16 23:04:12.488523] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.578 qpair failed and we were unable to recover it. 00:26:21.578 [2024-04-16 23:04:12.488681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.578 [2024-04-16 23:04:12.488815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.578 [2024-04-16 23:04:12.488839] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.579 qpair failed and we were unable to recover it. 00:26:21.579 [2024-04-16 23:04:12.488980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.579 [2024-04-16 23:04:12.489168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.579 [2024-04-16 23:04:12.489202] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.579 qpair failed and we were unable to recover it. 00:26:21.579 [2024-04-16 23:04:12.489351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.579 [2024-04-16 23:04:12.489532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.579 [2024-04-16 23:04:12.489560] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.579 qpair failed and we were unable to recover it. 00:26:21.579 [2024-04-16 23:04:12.489763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.579 [2024-04-16 23:04:12.489945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.579 [2024-04-16 23:04:12.489972] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.579 qpair failed and we were unable to recover it. 00:26:21.579 [2024-04-16 23:04:12.490109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.579 [2024-04-16 23:04:12.490249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.579 [2024-04-16 23:04:12.490275] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.579 qpair failed and we were unable to recover it. 00:26:21.579 [2024-04-16 23:04:12.490445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.579 [2024-04-16 23:04:12.490566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.579 [2024-04-16 23:04:12.490595] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.579 qpair failed and we were unable to recover it. 00:26:21.579 [2024-04-16 23:04:12.490742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.579 [2024-04-16 23:04:12.490894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.579 [2024-04-16 23:04:12.490925] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.579 qpair failed and we were unable to recover it. 00:26:21.579 [2024-04-16 23:04:12.491074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.579 [2024-04-16 23:04:12.491266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.579 [2024-04-16 23:04:12.491294] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.579 qpair failed and we were unable to recover it. 00:26:21.579 [2024-04-16 23:04:12.491437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.579 [2024-04-16 23:04:12.491602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.579 [2024-04-16 23:04:12.491627] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.579 qpair failed and we were unable to recover it. 00:26:21.579 [2024-04-16 23:04:12.491806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.579 [2024-04-16 23:04:12.491939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.579 [2024-04-16 23:04:12.491964] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.579 qpair failed and we were unable to recover it. 00:26:21.579 [2024-04-16 23:04:12.492148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.579 [2024-04-16 23:04:12.492302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.579 [2024-04-16 23:04:12.492329] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.579 qpair failed and we were unable to recover it. 00:26:21.579 [2024-04-16 23:04:12.492452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.579 [2024-04-16 23:04:12.492583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.579 [2024-04-16 23:04:12.492611] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.579 qpair failed and we were unable to recover it. 00:26:21.579 [2024-04-16 23:04:12.492799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.579 [2024-04-16 23:04:12.492980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.579 [2024-04-16 23:04:12.493007] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.579 qpair failed and we were unable to recover it. 00:26:21.579 [2024-04-16 23:04:12.493140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.579 [2024-04-16 23:04:12.493282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.579 [2024-04-16 23:04:12.493312] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.579 qpair failed and we were unable to recover it. 00:26:21.579 [2024-04-16 23:04:12.493493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.579 [2024-04-16 23:04:12.493635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.579 [2024-04-16 23:04:12.493660] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.579 qpair failed and we were unable to recover it. 00:26:21.579 [2024-04-16 23:04:12.493812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.579 [2024-04-16 23:04:12.493965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.579 [2024-04-16 23:04:12.493993] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.579 qpair failed and we were unable to recover it. 00:26:21.579 [2024-04-16 23:04:12.494125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.579 [2024-04-16 23:04:12.494280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.579 [2024-04-16 23:04:12.494305] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.579 qpair failed and we were unable to recover it. 00:26:21.579 [2024-04-16 23:04:12.494460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.579 [2024-04-16 23:04:12.494666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.579 [2024-04-16 23:04:12.494698] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.579 qpair failed and we were unable to recover it. 00:26:21.579 [2024-04-16 23:04:12.494871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.579 [2024-04-16 23:04:12.495029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.579 [2024-04-16 23:04:12.495057] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.579 qpair failed and we were unable to recover it. 00:26:21.579 [2024-04-16 23:04:12.495241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.579 [2024-04-16 23:04:12.495373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.579 [2024-04-16 23:04:12.495401] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.579 qpair failed and we were unable to recover it. 00:26:21.580 [2024-04-16 23:04:12.495579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.580 [2024-04-16 23:04:12.495687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.580 [2024-04-16 23:04:12.495712] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.580 qpair failed and we were unable to recover it. 00:26:21.580 [2024-04-16 23:04:12.495900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.580 [2024-04-16 23:04:12.496056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.580 [2024-04-16 23:04:12.496083] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.580 qpair failed and we were unable to recover it. 00:26:21.580 [2024-04-16 23:04:12.496273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.580 [2024-04-16 23:04:12.496421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.580 [2024-04-16 23:04:12.496448] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.580 qpair failed and we were unable to recover it. 00:26:21.580 [2024-04-16 23:04:12.496638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.580 [2024-04-16 23:04:12.496770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.580 [2024-04-16 23:04:12.496794] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.580 qpair failed and we were unable to recover it. 00:26:21.580 [2024-04-16 23:04:12.496902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.580 [2024-04-16 23:04:12.497042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.580 [2024-04-16 23:04:12.497067] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.580 qpair failed and we were unable to recover it. 00:26:21.580 [2024-04-16 23:04:12.497196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.580 [2024-04-16 23:04:12.497383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.580 [2024-04-16 23:04:12.497411] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.580 qpair failed and we were unable to recover it. 00:26:21.580 [2024-04-16 23:04:12.497607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.580 [2024-04-16 23:04:12.497751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.580 [2024-04-16 23:04:12.497778] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.580 qpair failed and we were unable to recover it. 00:26:21.580 [2024-04-16 23:04:12.497969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.580 [2024-04-16 23:04:12.498129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.580 [2024-04-16 23:04:12.498157] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.580 qpair failed and we were unable to recover it. 00:26:21.580 [2024-04-16 23:04:12.498302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.580 [2024-04-16 23:04:12.498437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.580 [2024-04-16 23:04:12.498465] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.580 qpair failed and we were unable to recover it. 00:26:21.580 [2024-04-16 23:04:12.498612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.580 [2024-04-16 23:04:12.498796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.580 [2024-04-16 23:04:12.498823] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.580 qpair failed and we were unable to recover it. 00:26:21.580 [2024-04-16 23:04:12.498944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.580 [2024-04-16 23:04:12.499130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.580 [2024-04-16 23:04:12.499157] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.580 qpair failed and we were unable to recover it. 00:26:21.580 [2024-04-16 23:04:12.499309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.580 [2024-04-16 23:04:12.499499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.580 [2024-04-16 23:04:12.499526] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.580 qpair failed and we were unable to recover it. 00:26:21.580 [2024-04-16 23:04:12.499712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.580 [2024-04-16 23:04:12.499876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.580 [2024-04-16 23:04:12.499903] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.580 qpair failed and we were unable to recover it. 00:26:21.580 [2024-04-16 23:04:12.500051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.580 [2024-04-16 23:04:12.500202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.580 [2024-04-16 23:04:12.500230] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.580 qpair failed and we were unable to recover it. 00:26:21.580 [2024-04-16 23:04:12.500424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.580 [2024-04-16 23:04:12.500566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.580 [2024-04-16 23:04:12.500590] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.580 qpair failed and we were unable to recover it. 00:26:21.580 [2024-04-16 23:04:12.500732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.580 [2024-04-16 23:04:12.500870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.580 [2024-04-16 23:04:12.500898] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.580 qpair failed and we were unable to recover it. 00:26:21.580 [2024-04-16 23:04:12.501088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.580 [2024-04-16 23:04:12.501227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.580 [2024-04-16 23:04:12.501269] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.580 qpair failed and we were unable to recover it. 00:26:21.580 [2024-04-16 23:04:12.501435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.580 [2024-04-16 23:04:12.501639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.580 [2024-04-16 23:04:12.501699] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.580 qpair failed and we were unable to recover it. 00:26:21.580 [2024-04-16 23:04:12.501834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.580 [2024-04-16 23:04:12.501989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.580 [2024-04-16 23:04:12.502017] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.580 qpair failed and we were unable to recover it. 00:26:21.580 [2024-04-16 23:04:12.502168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.580 [2024-04-16 23:04:12.502328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.580 [2024-04-16 23:04:12.502356] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.580 qpair failed and we were unable to recover it. 00:26:21.580 [2024-04-16 23:04:12.502562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.580 [2024-04-16 23:04:12.502696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.580 [2024-04-16 23:04:12.502752] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.580 qpair failed and we were unable to recover it. 00:26:21.580 [2024-04-16 23:04:12.502914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.580 [2024-04-16 23:04:12.503076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.580 [2024-04-16 23:04:12.503100] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.580 qpair failed and we were unable to recover it. 00:26:21.580 [2024-04-16 23:04:12.503287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.580 [2024-04-16 23:04:12.503433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.580 [2024-04-16 23:04:12.503460] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.580 qpair failed and we were unable to recover it. 00:26:21.580 [2024-04-16 23:04:12.503586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.580 [2024-04-16 23:04:12.503776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.580 [2024-04-16 23:04:12.503803] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.580 qpair failed and we were unable to recover it. 00:26:21.580 [2024-04-16 23:04:12.503960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.580 [2024-04-16 23:04:12.504078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.580 [2024-04-16 23:04:12.504102] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.580 qpair failed and we were unable to recover it. 00:26:21.580 [2024-04-16 23:04:12.504278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.580 [2024-04-16 23:04:12.504443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.580 [2024-04-16 23:04:12.504470] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.580 qpair failed and we were unable to recover it. 00:26:21.580 [2024-04-16 23:04:12.504635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.580 [2024-04-16 23:04:12.504829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.580 [2024-04-16 23:04:12.504853] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.580 qpair failed and we were unable to recover it. 00:26:21.581 [2024-04-16 23:04:12.504973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.581 [2024-04-16 23:04:12.505204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.581 [2024-04-16 23:04:12.505231] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.581 qpair failed and we were unable to recover it. 00:26:21.581 [2024-04-16 23:04:12.505372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.581 [2024-04-16 23:04:12.505514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.581 [2024-04-16 23:04:12.505539] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.581 qpair failed and we were unable to recover it. 00:26:21.581 [2024-04-16 23:04:12.505722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.581 [2024-04-16 23:04:12.505868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.581 [2024-04-16 23:04:12.505895] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.581 qpair failed and we were unable to recover it. 00:26:21.581 [2024-04-16 23:04:12.506064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.581 [2024-04-16 23:04:12.506235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.581 [2024-04-16 23:04:12.506276] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.581 qpair failed and we were unable to recover it. 00:26:21.581 [2024-04-16 23:04:12.506469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.581 [2024-04-16 23:04:12.506585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.581 [2024-04-16 23:04:12.506610] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.581 qpair failed and we were unable to recover it. 00:26:21.581 [2024-04-16 23:04:12.506785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.581 [2024-04-16 23:04:12.506913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.581 [2024-04-16 23:04:12.506938] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.581 qpair failed and we were unable to recover it. 00:26:21.581 [2024-04-16 23:04:12.507068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.581 [2024-04-16 23:04:12.507185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.581 [2024-04-16 23:04:12.507210] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.581 qpair failed and we were unable to recover it. 00:26:21.581 [2024-04-16 23:04:12.507321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.581 [2024-04-16 23:04:12.507438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.581 [2024-04-16 23:04:12.507462] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.581 qpair failed and we were unable to recover it. 00:26:21.581 [2024-04-16 23:04:12.507639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.581 [2024-04-16 23:04:12.507748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.581 [2024-04-16 23:04:12.507772] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.581 qpair failed and we were unable to recover it. 00:26:21.581 [2024-04-16 23:04:12.507895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.581 [2024-04-16 23:04:12.508036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.581 [2024-04-16 23:04:12.508061] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.581 qpair failed and we were unable to recover it. 00:26:21.581 [2024-04-16 23:04:12.508188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.581 [2024-04-16 23:04:12.508362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.581 [2024-04-16 23:04:12.508391] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.581 qpair failed and we were unable to recover it. 00:26:21.581 [2024-04-16 23:04:12.508547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.581 [2024-04-16 23:04:12.508682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.581 [2024-04-16 23:04:12.508710] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.581 qpair failed and we were unable to recover it. 00:26:21.581 [2024-04-16 23:04:12.508861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.581 [2024-04-16 23:04:12.508995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.581 [2024-04-16 23:04:12.509022] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.581 qpair failed and we were unable to recover it. 00:26:21.581 [2024-04-16 23:04:12.509182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.581 [2024-04-16 23:04:12.509342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.581 [2024-04-16 23:04:12.509367] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.581 qpair failed and we were unable to recover it. 00:26:21.581 [2024-04-16 23:04:12.509523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.581 [2024-04-16 23:04:12.509693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.581 [2024-04-16 23:04:12.509760] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.581 qpair failed and we were unable to recover it. 00:26:21.581 [2024-04-16 23:04:12.509989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.581 [2024-04-16 23:04:12.510140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.581 [2024-04-16 23:04:12.510168] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.581 qpair failed and we were unable to recover it. 00:26:21.581 [2024-04-16 23:04:12.510341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.581 [2024-04-16 23:04:12.510481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.581 [2024-04-16 23:04:12.510510] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.581 qpair failed and we were unable to recover it. 00:26:21.581 [2024-04-16 23:04:12.510633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.581 [2024-04-16 23:04:12.510788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.581 [2024-04-16 23:04:12.510815] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.581 qpair failed and we were unable to recover it. 00:26:21.581 [2024-04-16 23:04:12.511003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.581 [2024-04-16 23:04:12.511163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.581 [2024-04-16 23:04:12.511201] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.581 qpair failed and we were unable to recover it. 00:26:21.581 [2024-04-16 23:04:12.511335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.581 [2024-04-16 23:04:12.511505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.581 [2024-04-16 23:04:12.511530] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.581 qpair failed and we were unable to recover it. 00:26:21.581 [2024-04-16 23:04:12.511710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.581 [2024-04-16 23:04:12.511906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.581 [2024-04-16 23:04:12.511957] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.581 qpair failed and we were unable to recover it. 00:26:21.581 [2024-04-16 23:04:12.512094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.581 [2024-04-16 23:04:12.512273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.581 [2024-04-16 23:04:12.512299] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.581 qpair failed and we were unable to recover it. 00:26:21.581 [2024-04-16 23:04:12.512413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.581 [2024-04-16 23:04:12.512523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.581 [2024-04-16 23:04:12.512551] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.581 qpair failed and we were unable to recover it. 00:26:21.581 [2024-04-16 23:04:12.512663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.581 [2024-04-16 23:04:12.512814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.581 [2024-04-16 23:04:12.512842] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.581 qpair failed and we were unable to recover it. 00:26:21.581 [2024-04-16 23:04:12.512981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.581 [2024-04-16 23:04:12.513135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.581 [2024-04-16 23:04:12.513163] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.581 qpair failed and we were unable to recover it. 00:26:21.581 [2024-04-16 23:04:12.513315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.581 [2024-04-16 23:04:12.513433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.581 [2024-04-16 23:04:12.513457] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.581 qpair failed and we were unable to recover it. 00:26:21.581 [2024-04-16 23:04:12.513597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.581 [2024-04-16 23:04:12.513786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.581 [2024-04-16 23:04:12.513813] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.581 qpair failed and we were unable to recover it. 00:26:21.581 [2024-04-16 23:04:12.513933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.582 [2024-04-16 23:04:12.514056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.582 [2024-04-16 23:04:12.514084] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.582 qpair failed and we were unable to recover it. 00:26:21.582 [2024-04-16 23:04:12.514241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.582 [2024-04-16 23:04:12.514359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.582 [2024-04-16 23:04:12.514384] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.582 qpair failed and we were unable to recover it. 00:26:21.582 [2024-04-16 23:04:12.514549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.582 [2024-04-16 23:04:12.514701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.582 [2024-04-16 23:04:12.514728] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.582 qpair failed and we were unable to recover it. 00:26:21.582 [2024-04-16 23:04:12.514942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.582 [2024-04-16 23:04:12.515085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.582 [2024-04-16 23:04:12.515112] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.582 qpair failed and we were unable to recover it. 00:26:21.582 [2024-04-16 23:04:12.515308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.582 [2024-04-16 23:04:12.515419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.582 [2024-04-16 23:04:12.515462] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.582 qpair failed and we were unable to recover it. 00:26:21.582 [2024-04-16 23:04:12.515595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.582 [2024-04-16 23:04:12.515707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.582 [2024-04-16 23:04:12.515734] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.582 qpair failed and we were unable to recover it. 00:26:21.582 [2024-04-16 23:04:12.515880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.582 [2024-04-16 23:04:12.516028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.582 [2024-04-16 23:04:12.516056] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.582 qpair failed and we were unable to recover it. 00:26:21.582 [2024-04-16 23:04:12.516198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.582 [2024-04-16 23:04:12.516331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.582 [2024-04-16 23:04:12.516356] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.582 qpair failed and we were unable to recover it. 00:26:21.582 [2024-04-16 23:04:12.516511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.582 [2024-04-16 23:04:12.516723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.582 [2024-04-16 23:04:12.516774] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.582 qpair failed and we were unable to recover it. 00:26:21.582 [2024-04-16 23:04:12.516895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.582 [2024-04-16 23:04:12.517022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.582 [2024-04-16 23:04:12.517050] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.582 qpair failed and we were unable to recover it. 00:26:21.582 [2024-04-16 23:04:12.517206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.582 [2024-04-16 23:04:12.517368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.582 [2024-04-16 23:04:12.517393] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.582 qpair failed and we were unable to recover it. 00:26:21.582 [2024-04-16 23:04:12.517505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.582 [2024-04-16 23:04:12.517680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.582 [2024-04-16 23:04:12.517722] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.582 qpair failed and we were unable to recover it. 00:26:21.582 [2024-04-16 23:04:12.517904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.582 [2024-04-16 23:04:12.518053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.582 [2024-04-16 23:04:12.518080] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.582 qpair failed and we were unable to recover it. 00:26:21.582 [2024-04-16 23:04:12.518236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.582 [2024-04-16 23:04:12.518374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.582 [2024-04-16 23:04:12.518399] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.582 qpair failed and we were unable to recover it. 00:26:21.582 [2024-04-16 23:04:12.518602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.582 [2024-04-16 23:04:12.518790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.582 [2024-04-16 23:04:12.518841] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.582 qpair failed and we were unable to recover it. 00:26:21.582 [2024-04-16 23:04:12.518972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.582 [2024-04-16 23:04:12.519169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.582 [2024-04-16 23:04:12.519217] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.582 qpair failed and we were unable to recover it. 00:26:21.582 [2024-04-16 23:04:12.519352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.582 [2024-04-16 23:04:12.519496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.582 [2024-04-16 23:04:12.519521] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.582 qpair failed and we were unable to recover it. 00:26:21.582 [2024-04-16 23:04:12.519659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.582 [2024-04-16 23:04:12.519811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.582 [2024-04-16 23:04:12.519838] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.582 qpair failed and we were unable to recover it. 00:26:21.582 [2024-04-16 23:04:12.520017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.582 [2024-04-16 23:04:12.520179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.582 [2024-04-16 23:04:12.520204] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.582 qpair failed and we were unable to recover it. 00:26:21.582 [2024-04-16 23:04:12.520322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.582 [2024-04-16 23:04:12.520492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.582 [2024-04-16 23:04:12.520517] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.582 qpair failed and we were unable to recover it. 00:26:21.582 [2024-04-16 23:04:12.520696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.582 [2024-04-16 23:04:12.520857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.582 [2024-04-16 23:04:12.520898] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.582 qpair failed and we were unable to recover it. 00:26:21.582 [2024-04-16 23:04:12.521055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.582 [2024-04-16 23:04:12.521232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.582 [2024-04-16 23:04:12.521258] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.582 qpair failed and we were unable to recover it. 00:26:21.582 [2024-04-16 23:04:12.521372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.582 [2024-04-16 23:04:12.521535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.582 [2024-04-16 23:04:12.521562] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.582 qpair failed and we were unable to recover it. 00:26:21.582 [2024-04-16 23:04:12.521829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.582 [2024-04-16 23:04:12.522007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.582 [2024-04-16 23:04:12.522034] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.582 qpair failed and we were unable to recover it. 00:26:21.582 [2024-04-16 23:04:12.522170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.582 [2024-04-16 23:04:12.522370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.582 [2024-04-16 23:04:12.522395] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.582 qpair failed and we were unable to recover it. 00:26:21.582 [2024-04-16 23:04:12.522549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.582 [2024-04-16 23:04:12.522739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.582 [2024-04-16 23:04:12.522779] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.582 qpair failed and we were unable to recover it. 00:26:21.582 [2024-04-16 23:04:12.522932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.582 [2024-04-16 23:04:12.523098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.582 [2024-04-16 23:04:12.523125] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.582 qpair failed and we were unable to recover it. 00:26:21.582 [2024-04-16 23:04:12.523285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.582 [2024-04-16 23:04:12.523425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.582 [2024-04-16 23:04:12.523450] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.582 qpair failed and we were unable to recover it. 00:26:21.583 [2024-04-16 23:04:12.523613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.583 [2024-04-16 23:04:12.523752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.583 [2024-04-16 23:04:12.523779] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.583 qpair failed and we were unable to recover it. 00:26:21.583 [2024-04-16 23:04:12.523931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.583 [2024-04-16 23:04:12.524077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.583 [2024-04-16 23:04:12.524105] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.583 qpair failed and we were unable to recover it. 00:26:21.583 [2024-04-16 23:04:12.524304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.583 [2024-04-16 23:04:12.524444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.583 [2024-04-16 23:04:12.524504] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.583 qpair failed and we were unable to recover it. 00:26:21.583 [2024-04-16 23:04:12.524728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.583 [2024-04-16 23:04:12.524904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.583 [2024-04-16 23:04:12.524931] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.583 qpair failed and we were unable to recover it. 00:26:21.583 [2024-04-16 23:04:12.525048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.583 [2024-04-16 23:04:12.525248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.583 [2024-04-16 23:04:12.525274] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.583 qpair failed and we were unable to recover it. 00:26:21.583 [2024-04-16 23:04:12.525415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.583 [2024-04-16 23:04:12.525532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.583 [2024-04-16 23:04:12.525557] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.583 qpair failed and we were unable to recover it. 00:26:21.583 [2024-04-16 23:04:12.525683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.583 [2024-04-16 23:04:12.525829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.583 [2024-04-16 23:04:12.525857] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.583 qpair failed and we were unable to recover it. 00:26:21.583 [2024-04-16 23:04:12.526095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.583 [2024-04-16 23:04:12.526287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.583 [2024-04-16 23:04:12.526312] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.583 qpair failed and we were unable to recover it. 00:26:21.583 [2024-04-16 23:04:12.526499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.583 [2024-04-16 23:04:12.526647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.583 [2024-04-16 23:04:12.526703] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.583 qpair failed and we were unable to recover it. 00:26:21.583 [2024-04-16 23:04:12.526862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.583 [2024-04-16 23:04:12.527004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.583 [2024-04-16 23:04:12.527032] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.583 qpair failed and we were unable to recover it. 00:26:21.583 [2024-04-16 23:04:12.527186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.583 [2024-04-16 23:04:12.527343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.583 [2024-04-16 23:04:12.527367] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.583 qpair failed and we were unable to recover it. 00:26:21.583 [2024-04-16 23:04:12.527483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.583 [2024-04-16 23:04:12.527612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.583 [2024-04-16 23:04:12.527636] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.583 qpair failed and we were unable to recover it. 00:26:21.583 [2024-04-16 23:04:12.527801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.583 [2024-04-16 23:04:12.527944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.583 [2024-04-16 23:04:12.527971] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.583 qpair failed and we were unable to recover it. 00:26:21.583 [2024-04-16 23:04:12.528103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.583 [2024-04-16 23:04:12.528253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.583 [2024-04-16 23:04:12.528279] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.583 qpair failed and we were unable to recover it. 00:26:21.583 [2024-04-16 23:04:12.528423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.583 [2024-04-16 23:04:12.528587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.583 [2024-04-16 23:04:12.528615] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.583 qpair failed and we were unable to recover it. 00:26:21.583 [2024-04-16 23:04:12.528789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.583 [2024-04-16 23:04:12.528963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.583 [2024-04-16 23:04:12.528997] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.583 qpair failed and we were unable to recover it. 00:26:21.583 [2024-04-16 23:04:12.529144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.583 [2024-04-16 23:04:12.529305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.583 [2024-04-16 23:04:12.529335] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.583 qpair failed and we were unable to recover it. 00:26:21.583 [2024-04-16 23:04:12.529466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.583 [2024-04-16 23:04:12.529605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.583 [2024-04-16 23:04:12.529630] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.583 qpair failed and we were unable to recover it. 00:26:21.583 [2024-04-16 23:04:12.529794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.583 [2024-04-16 23:04:12.529960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.583 [2024-04-16 23:04:12.529987] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.583 qpair failed and we were unable to recover it. 00:26:21.583 [2024-04-16 23:04:12.530186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.583 [2024-04-16 23:04:12.530304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.583 [2024-04-16 23:04:12.530329] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.583 qpair failed and we were unable to recover it. 00:26:21.583 [2024-04-16 23:04:12.530470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.583 [2024-04-16 23:04:12.530611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.583 [2024-04-16 23:04:12.530636] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.583 qpair failed and we were unable to recover it. 00:26:21.583 [2024-04-16 23:04:12.530808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.583 [2024-04-16 23:04:12.530958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.583 [2024-04-16 23:04:12.530985] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.583 qpair failed and we were unable to recover it. 00:26:21.583 [2024-04-16 23:04:12.531135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.583 [2024-04-16 23:04:12.531263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.583 [2024-04-16 23:04:12.531291] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.583 qpair failed and we were unable to recover it. 00:26:21.583 [2024-04-16 23:04:12.531417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.583 [2024-04-16 23:04:12.531569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.583 [2024-04-16 23:04:12.531594] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.583 qpair failed and we were unable to recover it. 00:26:21.583 [2024-04-16 23:04:12.531699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.583 [2024-04-16 23:04:12.531841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.583 [2024-04-16 23:04:12.531866] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.583 qpair failed and we were unable to recover it. 00:26:21.583 [2024-04-16 23:04:12.532023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.583 [2024-04-16 23:04:12.532140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.583 [2024-04-16 23:04:12.532167] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.583 qpair failed and we were unable to recover it. 00:26:21.584 [2024-04-16 23:04:12.532294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.584 [2024-04-16 23:04:12.532442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.584 [2024-04-16 23:04:12.532469] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.584 qpair failed and we were unable to recover it. 00:26:21.584 [2024-04-16 23:04:12.532663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.584 [2024-04-16 23:04:12.532811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.584 [2024-04-16 23:04:12.532836] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.584 qpair failed and we were unable to recover it. 00:26:21.584 [2024-04-16 23:04:12.533008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.584 [2024-04-16 23:04:12.533155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.584 [2024-04-16 23:04:12.533197] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.584 qpair failed and we were unable to recover it. 00:26:21.584 [2024-04-16 23:04:12.533351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.584 [2024-04-16 23:04:12.533514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.584 [2024-04-16 23:04:12.533546] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.584 qpair failed and we were unable to recover it. 00:26:21.584 [2024-04-16 23:04:12.533695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.584 [2024-04-16 23:04:12.533816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.584 [2024-04-16 23:04:12.533846] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.584 qpair failed and we were unable to recover it. 00:26:21.584 [2024-04-16 23:04:12.534031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.584 [2024-04-16 23:04:12.534164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.584 [2024-04-16 23:04:12.534215] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.584 qpair failed and we were unable to recover it. 00:26:21.584 [2024-04-16 23:04:12.534347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.584 [2024-04-16 23:04:12.534511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.584 [2024-04-16 23:04:12.534539] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.584 qpair failed and we were unable to recover it. 00:26:21.584 [2024-04-16 23:04:12.534659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.584 [2024-04-16 23:04:12.534814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.584 [2024-04-16 23:04:12.534841] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.584 qpair failed and we were unable to recover it. 00:26:21.584 [2024-04-16 23:04:12.534966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.584 [2024-04-16 23:04:12.535117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.584 [2024-04-16 23:04:12.535144] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.584 qpair failed and we were unable to recover it. 00:26:21.584 [2024-04-16 23:04:12.535325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.584 [2024-04-16 23:04:12.535432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.584 [2024-04-16 23:04:12.535457] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.584 qpair failed and we were unable to recover it. 00:26:21.584 [2024-04-16 23:04:12.535584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.584 [2024-04-16 23:04:12.535730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.584 [2024-04-16 23:04:12.535757] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.584 qpair failed and we were unable to recover it. 00:26:21.584 [2024-04-16 23:04:12.535890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.584 [2024-04-16 23:04:12.536042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.584 [2024-04-16 23:04:12.536070] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.584 qpair failed and we were unable to recover it. 00:26:21.584 [2024-04-16 23:04:12.536266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.584 [2024-04-16 23:04:12.536409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.584 [2024-04-16 23:04:12.536434] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.584 qpair failed and we were unable to recover it. 00:26:21.584 [2024-04-16 23:04:12.536575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.584 [2024-04-16 23:04:12.536712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.584 [2024-04-16 23:04:12.536737] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.584 qpair failed and we were unable to recover it. 00:26:21.584 [2024-04-16 23:04:12.536880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.584 [2024-04-16 23:04:12.537036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.584 [2024-04-16 23:04:12.537065] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.584 qpair failed and we were unable to recover it. 00:26:21.584 [2024-04-16 23:04:12.537204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.584 [2024-04-16 23:04:12.537354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.584 [2024-04-16 23:04:12.537382] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.584 qpair failed and we were unable to recover it. 00:26:21.584 [2024-04-16 23:04:12.537565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.584 [2024-04-16 23:04:12.537751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.584 [2024-04-16 23:04:12.537802] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.584 qpair failed and we were unable to recover it. 00:26:21.584 [2024-04-16 23:04:12.538002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.584 [2024-04-16 23:04:12.538111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.584 [2024-04-16 23:04:12.538135] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.584 qpair failed and we were unable to recover it. 00:26:21.584 [2024-04-16 23:04:12.538253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.584 [2024-04-16 23:04:12.538414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.584 [2024-04-16 23:04:12.538441] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.584 qpair failed and we were unable to recover it. 00:26:21.584 [2024-04-16 23:04:12.538564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.584 [2024-04-16 23:04:12.538744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.584 [2024-04-16 23:04:12.538772] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.584 qpair failed and we were unable to recover it. 00:26:21.584 [2024-04-16 23:04:12.538930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.584 [2024-04-16 23:04:12.539110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.584 [2024-04-16 23:04:12.539138] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.585 qpair failed and we were unable to recover it. 00:26:21.585 [2024-04-16 23:04:12.539343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.585 [2024-04-16 23:04:12.539501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.585 [2024-04-16 23:04:12.539530] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.585 qpair failed and we were unable to recover it. 00:26:21.585 [2024-04-16 23:04:12.539682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.585 [2024-04-16 23:04:12.539831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.585 [2024-04-16 23:04:12.539858] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.585 qpair failed and we were unable to recover it. 00:26:21.585 [2024-04-16 23:04:12.540012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.585 [2024-04-16 23:04:12.540159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.585 [2024-04-16 23:04:12.540194] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.585 qpair failed and we were unable to recover it. 00:26:21.585 [2024-04-16 23:04:12.540342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.585 [2024-04-16 23:04:12.540526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.585 [2024-04-16 23:04:12.540551] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.585 qpair failed and we were unable to recover it. 00:26:21.585 [2024-04-16 23:04:12.540663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.585 [2024-04-16 23:04:12.540768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.585 [2024-04-16 23:04:12.540793] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.585 qpair failed and we were unable to recover it. 00:26:21.585 [2024-04-16 23:04:12.540957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.585 [2024-04-16 23:04:12.541091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.585 [2024-04-16 23:04:12.541119] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.585 qpair failed and we were unable to recover it. 00:26:21.585 [2024-04-16 23:04:12.541263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.585 [2024-04-16 23:04:12.541439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.585 [2024-04-16 23:04:12.541464] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.585 qpair failed and we were unable to recover it. 00:26:21.585 [2024-04-16 23:04:12.541641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.585 [2024-04-16 23:04:12.541822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.585 [2024-04-16 23:04:12.541847] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.585 qpair failed and we were unable to recover it. 00:26:21.585 [2024-04-16 23:04:12.541961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.585 [2024-04-16 23:04:12.542077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.585 [2024-04-16 23:04:12.542103] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.585 qpair failed and we were unable to recover it. 00:26:21.585 [2024-04-16 23:04:12.542232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.585 [2024-04-16 23:04:12.542405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.585 [2024-04-16 23:04:12.542446] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.585 qpair failed and we were unable to recover it. 00:26:21.585 [2024-04-16 23:04:12.542602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.585 [2024-04-16 23:04:12.542732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.585 [2024-04-16 23:04:12.542760] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.585 qpair failed and we were unable to recover it. 00:26:21.585 [2024-04-16 23:04:12.542959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.585 [2024-04-16 23:04:12.543127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.585 [2024-04-16 23:04:12.543151] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.585 qpair failed and we were unable to recover it. 00:26:21.585 [2024-04-16 23:04:12.543321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.585 [2024-04-16 23:04:12.543430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.585 [2024-04-16 23:04:12.543454] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.585 qpair failed and we were unable to recover it. 00:26:21.585 [2024-04-16 23:04:12.543598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.585 [2024-04-16 23:04:12.543711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.585 [2024-04-16 23:04:12.543736] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.585 qpair failed and we were unable to recover it. 00:26:21.585 [2024-04-16 23:04:12.543870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.585 [2024-04-16 23:04:12.544001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.585 [2024-04-16 23:04:12.544026] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.585 qpair failed and we were unable to recover it. 00:26:21.585 [2024-04-16 23:04:12.544140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.585 [2024-04-16 23:04:12.544297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.585 [2024-04-16 23:04:12.544324] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.585 qpair failed and we were unable to recover it. 00:26:21.585 [2024-04-16 23:04:12.544490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.585 [2024-04-16 23:04:12.544675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.585 [2024-04-16 23:04:12.544703] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.585 qpair failed and we were unable to recover it. 00:26:21.585 [2024-04-16 23:04:12.544827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.585 [2024-04-16 23:04:12.544978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.585 [2024-04-16 23:04:12.545006] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.585 qpair failed and we were unable to recover it. 00:26:21.585 [2024-04-16 23:04:12.545206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.585 [2024-04-16 23:04:12.545329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.585 [2024-04-16 23:04:12.545358] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.585 qpair failed and we were unable to recover it. 00:26:21.585 [2024-04-16 23:04:12.545476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.585 [2024-04-16 23:04:12.545641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.585 [2024-04-16 23:04:12.545669] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.585 qpair failed and we were unable to recover it. 00:26:21.585 [2024-04-16 23:04:12.545816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.585 [2024-04-16 23:04:12.545930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.585 [2024-04-16 23:04:12.545961] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.585 qpair failed and we were unable to recover it. 00:26:21.585 [2024-04-16 23:04:12.546106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.585 [2024-04-16 23:04:12.546304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.585 [2024-04-16 23:04:12.546330] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.585 qpair failed and we were unable to recover it. 00:26:21.585 [2024-04-16 23:04:12.546476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.585 [2024-04-16 23:04:12.546678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.585 [2024-04-16 23:04:12.546702] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.585 qpair failed and we were unable to recover it. 00:26:21.585 [2024-04-16 23:04:12.546845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.585 [2024-04-16 23:04:12.547033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.585 [2024-04-16 23:04:12.547059] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.585 qpair failed and we were unable to recover it. 00:26:21.585 [2024-04-16 23:04:12.547167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.585 [2024-04-16 23:04:12.547310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.585 [2024-04-16 23:04:12.547334] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.585 qpair failed and we were unable to recover it. 00:26:21.585 [2024-04-16 23:04:12.547510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.585 [2024-04-16 23:04:12.547629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.585 [2024-04-16 23:04:12.547654] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.585 qpair failed and we were unable to recover it. 00:26:21.585 [2024-04-16 23:04:12.547811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.585 [2024-04-16 23:04:12.547969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.585 [2024-04-16 23:04:12.547994] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.586 qpair failed and we were unable to recover it. 00:26:21.586 [2024-04-16 23:04:12.548110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.586 [2024-04-16 23:04:12.548230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.586 [2024-04-16 23:04:12.548255] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.586 qpair failed and we were unable to recover it. 00:26:21.586 [2024-04-16 23:04:12.548394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.586 [2024-04-16 23:04:12.548560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.586 [2024-04-16 23:04:12.548601] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.586 qpair failed and we were unable to recover it. 00:26:21.586 [2024-04-16 23:04:12.548758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.586 [2024-04-16 23:04:12.548906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.586 [2024-04-16 23:04:12.548933] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.586 qpair failed and we were unable to recover it. 00:26:21.586 [2024-04-16 23:04:12.549099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.586 [2024-04-16 23:04:12.549235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.586 [2024-04-16 23:04:12.549269] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.586 qpair failed and we were unable to recover it. 00:26:21.586 [2024-04-16 23:04:12.549471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.586 [2024-04-16 23:04:12.549613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.586 [2024-04-16 23:04:12.549639] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.586 qpair failed and we were unable to recover it. 00:26:21.586 [2024-04-16 23:04:12.549820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.586 [2024-04-16 23:04:12.550008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.586 [2024-04-16 23:04:12.550036] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.586 qpair failed and we were unable to recover it. 00:26:21.586 [2024-04-16 23:04:12.550209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.586 [2024-04-16 23:04:12.550332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.586 [2024-04-16 23:04:12.550356] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.586 qpair failed and we were unable to recover it. 00:26:21.586 [2024-04-16 23:04:12.550524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.586 [2024-04-16 23:04:12.550705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.586 [2024-04-16 23:04:12.550733] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.586 qpair failed and we were unable to recover it. 00:26:21.586 [2024-04-16 23:04:12.550856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.586 [2024-04-16 23:04:12.550983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.586 [2024-04-16 23:04:12.551010] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.586 qpair failed and we were unable to recover it. 00:26:21.586 [2024-04-16 23:04:12.551167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.586 [2024-04-16 23:04:12.551301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.586 [2024-04-16 23:04:12.551326] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.586 qpair failed and we were unable to recover it. 00:26:21.586 [2024-04-16 23:04:12.551487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.586 [2024-04-16 23:04:12.551638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.586 [2024-04-16 23:04:12.551666] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.586 qpair failed and we were unable to recover it. 00:26:21.586 [2024-04-16 23:04:12.551816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.586 [2024-04-16 23:04:12.551934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.586 [2024-04-16 23:04:12.551962] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.586 qpair failed and we were unable to recover it. 00:26:21.586 [2024-04-16 23:04:12.552112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.586 [2024-04-16 23:04:12.552260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.586 [2024-04-16 23:04:12.552288] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.586 qpair failed and we were unable to recover it. 00:26:21.586 [2024-04-16 23:04:12.552447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.586 [2024-04-16 23:04:12.552592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.586 [2024-04-16 23:04:12.552632] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.586 qpair failed and we were unable to recover it. 00:26:21.586 [2024-04-16 23:04:12.552805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.586 [2024-04-16 23:04:12.552909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.586 [2024-04-16 23:04:12.552933] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.586 qpair failed and we were unable to recover it. 00:26:21.586 [2024-04-16 23:04:12.553104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.586 [2024-04-16 23:04:12.553233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.586 [2024-04-16 23:04:12.553275] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.586 qpair failed and we were unable to recover it. 00:26:21.586 [2024-04-16 23:04:12.553415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.586 [2024-04-16 23:04:12.553575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.586 [2024-04-16 23:04:12.553600] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.586 qpair failed and we were unable to recover it. 00:26:21.586 [2024-04-16 23:04:12.553741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.586 [2024-04-16 23:04:12.553882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.586 [2024-04-16 23:04:12.553907] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.586 qpair failed and we were unable to recover it. 00:26:21.586 [2024-04-16 23:04:12.554090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.586 [2024-04-16 23:04:12.554240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.586 [2024-04-16 23:04:12.554269] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.586 qpair failed and we were unable to recover it. 00:26:21.586 [2024-04-16 23:04:12.554390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.586 [2024-04-16 23:04:12.554542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.586 [2024-04-16 23:04:12.554569] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.586 qpair failed and we were unable to recover it. 00:26:21.586 [2024-04-16 23:04:12.554687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.586 [2024-04-16 23:04:12.554813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.586 [2024-04-16 23:04:12.554841] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.586 qpair failed and we were unable to recover it. 00:26:21.586 [2024-04-16 23:04:12.554981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.586 [2024-04-16 23:04:12.555113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.586 [2024-04-16 23:04:12.555138] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.586 qpair failed and we were unable to recover it. 00:26:21.586 [2024-04-16 23:04:12.555350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.586 [2024-04-16 23:04:12.555465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.586 [2024-04-16 23:04:12.555489] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.586 qpair failed and we were unable to recover it. 00:26:21.586 [2024-04-16 23:04:12.555598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.586 [2024-04-16 23:04:12.555761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.586 [2024-04-16 23:04:12.555788] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.586 qpair failed and we were unable to recover it. 00:26:21.586 [2024-04-16 23:04:12.555943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.586 [2024-04-16 23:04:12.556127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.586 [2024-04-16 23:04:12.556155] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.586 qpair failed and we were unable to recover it. 00:26:21.586 [2024-04-16 23:04:12.556327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.586 [2024-04-16 23:04:12.556474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.586 [2024-04-16 23:04:12.556498] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.586 qpair failed and we were unable to recover it. 00:26:21.586 [2024-04-16 23:04:12.556680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.586 [2024-04-16 23:04:12.556840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.586 [2024-04-16 23:04:12.556865] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.586 qpair failed and we were unable to recover it. 00:26:21.586 [2024-04-16 23:04:12.557021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.586 [2024-04-16 23:04:12.557166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.586 [2024-04-16 23:04:12.557198] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.586 qpair failed and we were unable to recover it. 00:26:21.586 [2024-04-16 23:04:12.557372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.587 [2024-04-16 23:04:12.557523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.587 [2024-04-16 23:04:12.557550] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.587 qpair failed and we were unable to recover it. 00:26:21.587 [2024-04-16 23:04:12.557691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.587 [2024-04-16 23:04:12.557829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.587 [2024-04-16 23:04:12.557854] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.587 qpair failed and we were unable to recover it. 00:26:21.587 [2024-04-16 23:04:12.557981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.587 [2024-04-16 23:04:12.558106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.587 [2024-04-16 23:04:12.558133] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.587 qpair failed and we were unable to recover it. 00:26:21.587 [2024-04-16 23:04:12.558307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.587 [2024-04-16 23:04:12.558462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.587 [2024-04-16 23:04:12.558487] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.587 qpair failed and we were unable to recover it. 00:26:21.587 [2024-04-16 23:04:12.558645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.587 [2024-04-16 23:04:12.558764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.587 [2024-04-16 23:04:12.558791] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.587 qpair failed and we were unable to recover it. 00:26:21.587 [2024-04-16 23:04:12.558980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.587 [2024-04-16 23:04:12.559147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.587 [2024-04-16 23:04:12.559172] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.587 qpair failed and we were unable to recover it. 00:26:21.587 [2024-04-16 23:04:12.559392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.587 [2024-04-16 23:04:12.559540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.587 [2024-04-16 23:04:12.559565] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.587 qpair failed and we were unable to recover it. 00:26:21.587 [2024-04-16 23:04:12.559744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.587 [2024-04-16 23:04:12.559854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.587 [2024-04-16 23:04:12.559879] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.587 qpair failed and we were unable to recover it. 00:26:21.587 [2024-04-16 23:04:12.560088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.587 [2024-04-16 23:04:12.560233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.587 [2024-04-16 23:04:12.560259] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.587 qpair failed and we were unable to recover it. 00:26:21.587 [2024-04-16 23:04:12.560369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.587 [2024-04-16 23:04:12.560501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.587 [2024-04-16 23:04:12.560526] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.587 qpair failed and we were unable to recover it. 00:26:21.587 [2024-04-16 23:04:12.560635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.587 [2024-04-16 23:04:12.560801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.587 [2024-04-16 23:04:12.560826] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.587 qpair failed and we were unable to recover it. 00:26:21.587 [2024-04-16 23:04:12.560986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.587 [2024-04-16 23:04:12.561156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.587 [2024-04-16 23:04:12.561191] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.587 qpair failed and we were unable to recover it. 00:26:21.587 [2024-04-16 23:04:12.561339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.587 [2024-04-16 23:04:12.561556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.587 [2024-04-16 23:04:12.561581] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.587 qpair failed and we were unable to recover it. 00:26:21.587 [2024-04-16 23:04:12.561747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.587 [2024-04-16 23:04:12.561911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.587 [2024-04-16 23:04:12.561936] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.587 qpair failed and we were unable to recover it. 00:26:21.587 [2024-04-16 23:04:12.562079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.587 [2024-04-16 23:04:12.562239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.587 [2024-04-16 23:04:12.562267] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.587 qpair failed and we were unable to recover it. 00:26:21.587 [2024-04-16 23:04:12.562423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.587 [2024-04-16 23:04:12.562567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.587 [2024-04-16 23:04:12.562594] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.587 qpair failed and we were unable to recover it. 00:26:21.587 [2024-04-16 23:04:12.562787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.587 [2024-04-16 23:04:12.562925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.587 [2024-04-16 23:04:12.562954] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.587 qpair failed and we were unable to recover it. 00:26:21.587 [2024-04-16 23:04:12.563121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.587 [2024-04-16 23:04:12.563270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.587 [2024-04-16 23:04:12.563296] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.587 qpair failed and we were unable to recover it. 00:26:21.587 [2024-04-16 23:04:12.563431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.587 [2024-04-16 23:04:12.563625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.587 [2024-04-16 23:04:12.563650] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.587 qpair failed and we were unable to recover it. 00:26:21.587 [2024-04-16 23:04:12.563767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.587 [2024-04-16 23:04:12.563935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.587 [2024-04-16 23:04:12.563963] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.587 qpair failed and we were unable to recover it. 00:26:21.587 [2024-04-16 23:04:12.564112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.587 [2024-04-16 23:04:12.564235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.587 [2024-04-16 23:04:12.564263] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.587 qpair failed and we were unable to recover it. 00:26:21.587 [2024-04-16 23:04:12.564465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.587 [2024-04-16 23:04:12.564579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.587 [2024-04-16 23:04:12.564603] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.587 qpair failed and we were unable to recover it. 00:26:21.587 [2024-04-16 23:04:12.564752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.587 [2024-04-16 23:04:12.564924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.587 [2024-04-16 23:04:12.564949] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.587 qpair failed and we were unable to recover it. 00:26:21.587 [2024-04-16 23:04:12.565064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.587 [2024-04-16 23:04:12.565225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.587 [2024-04-16 23:04:12.565252] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.587 qpair failed and we were unable to recover it. 00:26:21.587 [2024-04-16 23:04:12.565415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.587 [2024-04-16 23:04:12.565593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.587 [2024-04-16 23:04:12.565619] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.587 qpair failed and we were unable to recover it. 00:26:21.587 [2024-04-16 23:04:12.565790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.587 [2024-04-16 23:04:12.565938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.587 [2024-04-16 23:04:12.565965] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.587 qpair failed and we were unable to recover it. 00:26:21.587 [2024-04-16 23:04:12.566158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.587 [2024-04-16 23:04:12.566278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.587 [2024-04-16 23:04:12.566307] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.587 qpair failed and we were unable to recover it. 00:26:21.587 [2024-04-16 23:04:12.566450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.588 [2024-04-16 23:04:12.566578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.588 [2024-04-16 23:04:12.566605] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.588 qpair failed and we were unable to recover it. 00:26:21.588 [2024-04-16 23:04:12.566803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.588 [2024-04-16 23:04:12.566947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.588 [2024-04-16 23:04:12.566972] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.588 qpair failed and we were unable to recover it. 00:26:21.588 [2024-04-16 23:04:12.567135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.588 [2024-04-16 23:04:12.567294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.588 [2024-04-16 23:04:12.567319] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.588 qpair failed and we were unable to recover it. 00:26:21.588 [2024-04-16 23:04:12.567483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.588 [2024-04-16 23:04:12.567691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.588 [2024-04-16 23:04:12.567715] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.588 qpair failed and we were unable to recover it. 00:26:21.588 [2024-04-16 23:04:12.567862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.588 [2024-04-16 23:04:12.568033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.588 [2024-04-16 23:04:12.568062] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.588 qpair failed and we were unable to recover it. 00:26:21.588 [2024-04-16 23:04:12.568220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.588 [2024-04-16 23:04:12.568423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.588 [2024-04-16 23:04:12.568448] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.588 qpair failed and we were unable to recover it. 00:26:21.588 [2024-04-16 23:04:12.568618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.588 [2024-04-16 23:04:12.568761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.588 [2024-04-16 23:04:12.568786] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.588 qpair failed and we were unable to recover it. 00:26:21.588 [2024-04-16 23:04:12.568953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.588 [2024-04-16 23:04:12.569140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.588 [2024-04-16 23:04:12.569168] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.588 qpair failed and we were unable to recover it. 00:26:21.588 [2024-04-16 23:04:12.569365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.588 [2024-04-16 23:04:12.569537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.588 [2024-04-16 23:04:12.569596] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.588 qpair failed and we were unable to recover it. 00:26:21.588 [2024-04-16 23:04:12.569745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.588 [2024-04-16 23:04:12.569873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.588 [2024-04-16 23:04:12.569900] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.588 qpair failed and we were unable to recover it. 00:26:21.588 [2024-04-16 23:04:12.570077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.588 [2024-04-16 23:04:12.570210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.588 [2024-04-16 23:04:12.570235] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.588 qpair failed and we were unable to recover it. 00:26:21.588 [2024-04-16 23:04:12.570429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.588 [2024-04-16 23:04:12.570554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.588 [2024-04-16 23:04:12.570579] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.588 qpair failed and we were unable to recover it. 00:26:21.588 [2024-04-16 23:04:12.570768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.588 [2024-04-16 23:04:12.570913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.588 [2024-04-16 23:04:12.570937] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.588 qpair failed and we were unable to recover it. 00:26:21.588 [2024-04-16 23:04:12.571114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.588 [2024-04-16 23:04:12.571234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.588 [2024-04-16 23:04:12.571259] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.588 qpair failed and we were unable to recover it. 00:26:21.588 [2024-04-16 23:04:12.571371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.588 [2024-04-16 23:04:12.571547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.588 [2024-04-16 23:04:12.571572] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.588 qpair failed and we were unable to recover it. 00:26:21.588 [2024-04-16 23:04:12.571707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.588 [2024-04-16 23:04:12.571824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.588 [2024-04-16 23:04:12.571851] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.588 qpair failed and we were unable to recover it. 00:26:21.588 [2024-04-16 23:04:12.572039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.588 [2024-04-16 23:04:12.572187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.588 [2024-04-16 23:04:12.572212] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.588 qpair failed and we were unable to recover it. 00:26:21.588 [2024-04-16 23:04:12.572366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.588 [2024-04-16 23:04:12.572516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.588 [2024-04-16 23:04:12.572557] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.588 qpair failed and we were unable to recover it. 00:26:21.588 [2024-04-16 23:04:12.572691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.588 [2024-04-16 23:04:12.572824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.588 [2024-04-16 23:04:12.572849] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.588 qpair failed and we were unable to recover it. 00:26:21.588 [2024-04-16 23:04:12.573060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.588 [2024-04-16 23:04:12.573202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.588 [2024-04-16 23:04:12.573235] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.588 qpair failed and we were unable to recover it. 00:26:21.588 [2024-04-16 23:04:12.573413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.588 [2024-04-16 23:04:12.573529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.588 [2024-04-16 23:04:12.573554] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.588 qpair failed and we were unable to recover it. 00:26:21.588 [2024-04-16 23:04:12.573670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.588 [2024-04-16 23:04:12.573782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.588 [2024-04-16 23:04:12.573825] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.588 qpair failed and we were unable to recover it. 00:26:21.588 [2024-04-16 23:04:12.573958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.588 [2024-04-16 23:04:12.574065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.588 [2024-04-16 23:04:12.574089] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.588 qpair failed and we were unable to recover it. 00:26:21.588 [2024-04-16 23:04:12.574267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.588 [2024-04-16 23:04:12.574434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.588 [2024-04-16 23:04:12.574459] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.588 qpair failed and we were unable to recover it. 00:26:21.588 [2024-04-16 23:04:12.574649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.588 [2024-04-16 23:04:12.574815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.588 [2024-04-16 23:04:12.574839] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.588 qpair failed and we were unable to recover it. 00:26:21.588 [2024-04-16 23:04:12.575044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.588 [2024-04-16 23:04:12.575209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.588 [2024-04-16 23:04:12.575256] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.589 qpair failed and we were unable to recover it. 00:26:21.589 [2024-04-16 23:04:12.575420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.589 [2024-04-16 23:04:12.575594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.589 [2024-04-16 23:04:12.575618] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.589 qpair failed and we were unable to recover it. 00:26:21.589 [2024-04-16 23:04:12.575788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.589 [2024-04-16 23:04:12.575910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.589 [2024-04-16 23:04:12.575935] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.589 qpair failed and we were unable to recover it. 00:26:21.589 [2024-04-16 23:04:12.576096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.589 [2024-04-16 23:04:12.576260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.589 [2024-04-16 23:04:12.576285] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.589 qpair failed and we were unable to recover it. 00:26:21.589 [2024-04-16 23:04:12.576396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.589 [2024-04-16 23:04:12.576545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.589 [2024-04-16 23:04:12.576573] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.589 qpair failed and we were unable to recover it. 00:26:21.589 [2024-04-16 23:04:12.576757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.589 [2024-04-16 23:04:12.576928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.589 [2024-04-16 23:04:12.576953] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.589 qpair failed and we were unable to recover it. 00:26:21.589 [2024-04-16 23:04:12.577142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.589 [2024-04-16 23:04:12.577301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.589 [2024-04-16 23:04:12.577326] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.589 qpair failed and we were unable to recover it. 00:26:21.589 [2024-04-16 23:04:12.577478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.589 [2024-04-16 23:04:12.577600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.589 [2024-04-16 23:04:12.577630] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.589 qpair failed and we were unable to recover it. 00:26:21.589 [2024-04-16 23:04:12.577749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.589 [2024-04-16 23:04:12.577923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.589 [2024-04-16 23:04:12.577952] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.589 qpair failed and we were unable to recover it. 00:26:21.589 [2024-04-16 23:04:12.578120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.589 [2024-04-16 23:04:12.578276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.589 [2024-04-16 23:04:12.578304] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.589 qpair failed and we were unable to recover it. 00:26:21.589 [2024-04-16 23:04:12.578462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.589 [2024-04-16 23:04:12.578584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.589 [2024-04-16 23:04:12.578612] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.589 qpair failed and we were unable to recover it. 00:26:21.589 [2024-04-16 23:04:12.578794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.589 [2024-04-16 23:04:12.578947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.589 [2024-04-16 23:04:12.578974] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.589 qpair failed and we were unable to recover it. 00:26:21.589 [2024-04-16 23:04:12.579104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.589 [2024-04-16 23:04:12.579250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.589 [2024-04-16 23:04:12.579278] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.589 qpair failed and we were unable to recover it. 00:26:21.589 [2024-04-16 23:04:12.579431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.589 [2024-04-16 23:04:12.579574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.589 [2024-04-16 23:04:12.579598] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.589 qpair failed and we were unable to recover it. 00:26:21.589 [2024-04-16 23:04:12.579774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.589 [2024-04-16 23:04:12.579920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.589 [2024-04-16 23:04:12.579947] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.589 qpair failed and we were unable to recover it. 00:26:21.589 [2024-04-16 23:04:12.580065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.589 [2024-04-16 23:04:12.580239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.589 [2024-04-16 23:04:12.580275] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.589 qpair failed and we were unable to recover it. 00:26:21.589 [2024-04-16 23:04:12.580417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.589 [2024-04-16 23:04:12.580549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.589 [2024-04-16 23:04:12.580576] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.589 qpair failed and we were unable to recover it. 00:26:21.589 [2024-04-16 23:04:12.580750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.589 [2024-04-16 23:04:12.580857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.589 [2024-04-16 23:04:12.580881] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.589 qpair failed and we were unable to recover it. 00:26:21.589 [2024-04-16 23:04:12.581039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.589 [2024-04-16 23:04:12.581163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.589 [2024-04-16 23:04:12.581197] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.589 qpair failed and we were unable to recover it. 00:26:21.589 [2024-04-16 23:04:12.581354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.589 [2024-04-16 23:04:12.581506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.589 [2024-04-16 23:04:12.581533] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.589 qpair failed and we were unable to recover it. 00:26:21.589 [2024-04-16 23:04:12.581681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.589 [2024-04-16 23:04:12.581807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.589 [2024-04-16 23:04:12.581834] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.589 qpair failed and we were unable to recover it. 00:26:21.589 [2024-04-16 23:04:12.581989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.589 [2024-04-16 23:04:12.582126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.589 [2024-04-16 23:04:12.582150] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.589 qpair failed and we were unable to recover it. 00:26:21.589 [2024-04-16 23:04:12.582305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.589 [2024-04-16 23:04:12.582460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.589 [2024-04-16 23:04:12.582489] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.589 qpair failed and we were unable to recover it. 00:26:21.590 [2024-04-16 23:04:12.582627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.590 [2024-04-16 23:04:12.582768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.590 [2024-04-16 23:04:12.582793] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.590 qpair failed and we were unable to recover it. 00:26:21.590 [2024-04-16 23:04:12.582978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.590 [2024-04-16 23:04:12.583135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.590 [2024-04-16 23:04:12.583164] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.590 qpair failed and we were unable to recover it. 00:26:21.590 [2024-04-16 23:04:12.583308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.590 [2024-04-16 23:04:12.583445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.590 [2024-04-16 23:04:12.583474] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.590 qpair failed and we were unable to recover it. 00:26:21.590 [2024-04-16 23:04:12.583619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.590 [2024-04-16 23:04:12.583767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.590 [2024-04-16 23:04:12.583795] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.590 qpair failed and we were unable to recover it. 00:26:21.590 [2024-04-16 23:04:12.583950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.590 [2024-04-16 23:04:12.584131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.590 [2024-04-16 23:04:12.584159] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.590 qpair failed and we were unable to recover it. 00:26:21.590 [2024-04-16 23:04:12.584343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.590 [2024-04-16 23:04:12.584446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.590 [2024-04-16 23:04:12.584471] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.590 qpair failed and we were unable to recover it. 00:26:21.590 [2024-04-16 23:04:12.584575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.590 [2024-04-16 23:04:12.584701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.590 [2024-04-16 23:04:12.584726] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.590 qpair failed and we were unable to recover it. 00:26:21.590 [2024-04-16 23:04:12.584901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.590 [2024-04-16 23:04:12.585021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.590 [2024-04-16 23:04:12.585050] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.590 qpair failed and we were unable to recover it. 00:26:21.590 [2024-04-16 23:04:12.585200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.590 [2024-04-16 23:04:12.585434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.590 [2024-04-16 23:04:12.585487] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.590 qpair failed and we were unable to recover it. 00:26:21.590 [2024-04-16 23:04:12.585669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.590 [2024-04-16 23:04:12.585860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.590 [2024-04-16 23:04:12.585885] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.590 qpair failed and we were unable to recover it. 00:26:21.590 [2024-04-16 23:04:12.586020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.590 [2024-04-16 23:04:12.586129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.590 [2024-04-16 23:04:12.586154] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.590 qpair failed and we were unable to recover it. 00:26:21.590 [2024-04-16 23:04:12.586339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.590 [2024-04-16 23:04:12.586493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.590 [2024-04-16 23:04:12.586522] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.590 qpair failed and we were unable to recover it. 00:26:21.590 [2024-04-16 23:04:12.586677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.590 [2024-04-16 23:04:12.586833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.590 [2024-04-16 23:04:12.586861] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.590 qpair failed and we were unable to recover it. 00:26:21.590 [2024-04-16 23:04:12.586988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.590 [2024-04-16 23:04:12.587169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.590 [2024-04-16 23:04:12.587204] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.590 qpair failed and we were unable to recover it. 00:26:21.590 [2024-04-16 23:04:12.587366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.590 [2024-04-16 23:04:12.587484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.590 [2024-04-16 23:04:12.587508] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.590 qpair failed and we were unable to recover it. 00:26:21.590 [2024-04-16 23:04:12.587682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.590 [2024-04-16 23:04:12.587800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.590 [2024-04-16 23:04:12.587826] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.590 qpair failed and we were unable to recover it. 00:26:21.590 [2024-04-16 23:04:12.587967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.590 [2024-04-16 23:04:12.588104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.590 [2024-04-16 23:04:12.588129] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.590 qpair failed and we were unable to recover it. 00:26:21.590 [2024-04-16 23:04:12.588248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.590 [2024-04-16 23:04:12.588365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.590 [2024-04-16 23:04:12.588390] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.590 qpair failed and we were unable to recover it. 00:26:21.590 [2024-04-16 23:04:12.588512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.590 [2024-04-16 23:04:12.588614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.590 [2024-04-16 23:04:12.588638] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.590 qpair failed and we were unable to recover it. 00:26:21.590 [2024-04-16 23:04:12.588835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.590 [2024-04-16 23:04:12.588978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.590 [2024-04-16 23:04:12.589003] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.590 qpair failed and we were unable to recover it. 00:26:21.590 [2024-04-16 23:04:12.589210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.590 [2024-04-16 23:04:12.589320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.590 [2024-04-16 23:04:12.589345] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.590 qpair failed and we were unable to recover it. 00:26:21.590 [2024-04-16 23:04:12.589461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.590 [2024-04-16 23:04:12.589600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.590 [2024-04-16 23:04:12.589624] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.590 qpair failed and we were unable to recover it. 00:26:21.590 [2024-04-16 23:04:12.589763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.590 [2024-04-16 23:04:12.589905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.590 [2024-04-16 23:04:12.589930] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.590 qpair failed and we were unable to recover it. 00:26:21.590 [2024-04-16 23:04:12.590104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.590 [2024-04-16 23:04:12.590236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.590 [2024-04-16 23:04:12.590265] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.590 qpair failed and we were unable to recover it. 00:26:21.590 [2024-04-16 23:04:12.590434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.590 [2024-04-16 23:04:12.590554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.590 [2024-04-16 23:04:12.590578] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.590 qpair failed and we were unable to recover it. 00:26:21.590 [2024-04-16 23:04:12.590738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.590 [2024-04-16 23:04:12.590841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.590 [2024-04-16 23:04:12.590865] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.590 qpair failed and we were unable to recover it. 00:26:21.590 [2024-04-16 23:04:12.591009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.590 [2024-04-16 23:04:12.591117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.590 [2024-04-16 23:04:12.591141] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.590 qpair failed and we were unable to recover it. 00:26:21.590 [2024-04-16 23:04:12.591264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.590 [2024-04-16 23:04:12.591400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.591 [2024-04-16 23:04:12.591424] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.591 qpair failed and we were unable to recover it. 00:26:21.591 [2024-04-16 23:04:12.591565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.591 [2024-04-16 23:04:12.591703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.591 [2024-04-16 23:04:12.591730] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.591 qpair failed and we were unable to recover it. 00:26:21.591 [2024-04-16 23:04:12.591889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.591 [2024-04-16 23:04:12.592077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.591 [2024-04-16 23:04:12.592102] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.591 qpair failed and we were unable to recover it. 00:26:21.591 [2024-04-16 23:04:12.592243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.591 [2024-04-16 23:04:12.592359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.591 [2024-04-16 23:04:12.592384] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.591 qpair failed and we were unable to recover it. 00:26:21.591 [2024-04-16 23:04:12.592561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.591 [2024-04-16 23:04:12.592719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.591 [2024-04-16 23:04:12.592744] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.591 qpair failed and we were unable to recover it. 00:26:21.591 [2024-04-16 23:04:12.592888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.591 [2024-04-16 23:04:12.593015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.591 [2024-04-16 23:04:12.593042] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.591 qpair failed and we were unable to recover it. 00:26:21.591 [2024-04-16 23:04:12.593204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.591 [2024-04-16 23:04:12.593339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.591 [2024-04-16 23:04:12.593367] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.591 qpair failed and we were unable to recover it. 00:26:21.591 [2024-04-16 23:04:12.593557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.591 [2024-04-16 23:04:12.593663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.591 [2024-04-16 23:04:12.593688] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.591 qpair failed and we were unable to recover it. 00:26:21.591 [2024-04-16 23:04:12.593825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.591 [2024-04-16 23:04:12.593945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.591 [2024-04-16 23:04:12.593973] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.591 qpair failed and we were unable to recover it. 00:26:21.591 [2024-04-16 23:04:12.594138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.591 [2024-04-16 23:04:12.594287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.591 [2024-04-16 23:04:12.594313] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.591 qpair failed and we were unable to recover it. 00:26:21.591 [2024-04-16 23:04:12.594452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.591 [2024-04-16 23:04:12.594592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.591 [2024-04-16 23:04:12.594616] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.591 qpair failed and we were unable to recover it. 00:26:21.591 [2024-04-16 23:04:12.594786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.591 [2024-04-16 23:04:12.594925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.591 [2024-04-16 23:04:12.594965] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.591 qpair failed and we were unable to recover it. 00:26:21.591 [2024-04-16 23:04:12.595150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.591 [2024-04-16 23:04:12.595303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.591 [2024-04-16 23:04:12.595330] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.591 qpair failed and we were unable to recover it. 00:26:21.591 [2024-04-16 23:04:12.595478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.591 [2024-04-16 23:04:12.595644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.591 [2024-04-16 23:04:12.595668] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.591 qpair failed and we were unable to recover it. 00:26:21.591 [2024-04-16 23:04:12.595799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.591 [2024-04-16 23:04:12.595912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.591 [2024-04-16 23:04:12.595936] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.591 qpair failed and we were unable to recover it. 00:26:21.591 [2024-04-16 23:04:12.596072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.591 [2024-04-16 23:04:12.596213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.591 [2024-04-16 23:04:12.596243] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.591 qpair failed and we were unable to recover it. 00:26:21.591 [2024-04-16 23:04:12.596381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.591 [2024-04-16 23:04:12.596510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.591 [2024-04-16 23:04:12.596537] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.591 qpair failed and we were unable to recover it. 00:26:21.591 [2024-04-16 23:04:12.596725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.591 [2024-04-16 23:04:12.596907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.591 [2024-04-16 23:04:12.596934] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.591 qpair failed and we were unable to recover it. 00:26:21.591 [2024-04-16 23:04:12.597082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.591 [2024-04-16 23:04:12.597280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.591 [2024-04-16 23:04:12.597347] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.591 qpair failed and we were unable to recover it. 00:26:21.591 [2024-04-16 23:04:12.597538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.591 [2024-04-16 23:04:12.597669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.591 [2024-04-16 23:04:12.597711] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.591 qpair failed and we were unable to recover it. 00:26:21.591 [2024-04-16 23:04:12.597841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.591 [2024-04-16 23:04:12.597995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.591 [2024-04-16 23:04:12.598022] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.591 qpair failed and we were unable to recover it. 00:26:21.591 [2024-04-16 23:04:12.598202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.591 [2024-04-16 23:04:12.598351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.591 [2024-04-16 23:04:12.598379] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.591 qpair failed and we were unable to recover it. 00:26:21.591 [2024-04-16 23:04:12.598544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.591 [2024-04-16 23:04:12.598729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.591 [2024-04-16 23:04:12.598757] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.591 qpair failed and we were unable to recover it. 00:26:21.591 [2024-04-16 23:04:12.598917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.591 [2024-04-16 23:04:12.599024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.591 [2024-04-16 23:04:12.599048] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.591 qpair failed and we were unable to recover it. 00:26:21.591 [2024-04-16 23:04:12.599193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.591 [2024-04-16 23:04:12.599327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.591 [2024-04-16 23:04:12.599352] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.591 qpair failed and we were unable to recover it. 00:26:21.591 [2024-04-16 23:04:12.599486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.591 [2024-04-16 23:04:12.599631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.591 [2024-04-16 23:04:12.599658] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.592 qpair failed and we were unable to recover it. 00:26:21.592 [2024-04-16 23:04:12.599804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.592 [2024-04-16 23:04:12.599984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.592 [2024-04-16 23:04:12.600015] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.592 qpair failed and we were unable to recover it. 00:26:21.592 [2024-04-16 23:04:12.600208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.592 [2024-04-16 23:04:12.600364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.592 [2024-04-16 23:04:12.600426] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.592 qpair failed and we were unable to recover it. 00:26:21.592 [2024-04-16 23:04:12.600620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.592 [2024-04-16 23:04:12.600778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.592 [2024-04-16 23:04:12.600802] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.592 qpair failed and we were unable to recover it. 00:26:21.592 [2024-04-16 23:04:12.600920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.592 [2024-04-16 23:04:12.601034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.592 [2024-04-16 23:04:12.601059] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.592 qpair failed and we were unable to recover it. 00:26:21.592 [2024-04-16 23:04:12.601208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.592 [2024-04-16 23:04:12.601333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.592 [2024-04-16 23:04:12.601361] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.592 qpair failed and we were unable to recover it. 00:26:21.592 [2024-04-16 23:04:12.601550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.592 [2024-04-16 23:04:12.601696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.592 [2024-04-16 23:04:12.601720] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.592 qpair failed and we were unable to recover it. 00:26:21.592 [2024-04-16 23:04:12.601830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.592 [2024-04-16 23:04:12.601981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.592 [2024-04-16 23:04:12.602008] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.592 qpair failed and we were unable to recover it. 00:26:21.592 [2024-04-16 23:04:12.602166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.592 [2024-04-16 23:04:12.602305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.592 [2024-04-16 23:04:12.602332] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.592 qpair failed and we were unable to recover it. 00:26:21.592 [2024-04-16 23:04:12.602480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.592 [2024-04-16 23:04:12.602596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.592 [2024-04-16 23:04:12.602623] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.592 qpair failed and we were unable to recover it. 00:26:21.592 [2024-04-16 23:04:12.602813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.592 [2024-04-16 23:04:12.602972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.592 [2024-04-16 23:04:12.603000] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.592 qpair failed and we were unable to recover it. 00:26:21.592 [2024-04-16 23:04:12.603156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.592 [2024-04-16 23:04:12.603345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.592 [2024-04-16 23:04:12.603373] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.592 qpair failed and we were unable to recover it. 00:26:21.592 [2024-04-16 23:04:12.603571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.592 [2024-04-16 23:04:12.603691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.592 [2024-04-16 23:04:12.603718] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.592 qpair failed and we were unable to recover it. 00:26:21.592 [2024-04-16 23:04:12.603878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.592 [2024-04-16 23:04:12.604033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.592 [2024-04-16 23:04:12.604061] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.592 qpair failed and we were unable to recover it. 00:26:21.592 [2024-04-16 23:04:12.604221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.592 [2024-04-16 23:04:12.604332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.592 [2024-04-16 23:04:12.604357] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.592 qpair failed and we were unable to recover it. 00:26:21.592 [2024-04-16 23:04:12.604519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.592 [2024-04-16 23:04:12.604702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.592 [2024-04-16 23:04:12.604730] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.592 qpair failed and we were unable to recover it. 00:26:21.592 [2024-04-16 23:04:12.604877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.592 [2024-04-16 23:04:12.604990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.592 [2024-04-16 23:04:12.605018] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.592 qpair failed and we were unable to recover it. 00:26:21.592 [2024-04-16 23:04:12.605164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.592 [2024-04-16 23:04:12.605323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.592 [2024-04-16 23:04:12.605347] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.592 qpair failed and we were unable to recover it. 00:26:21.592 [2024-04-16 23:04:12.605469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.592 [2024-04-16 23:04:12.605611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.592 [2024-04-16 23:04:12.605635] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.592 qpair failed and we were unable to recover it. 00:26:21.592 [2024-04-16 23:04:12.605744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.592 [2024-04-16 23:04:12.605852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.592 [2024-04-16 23:04:12.605876] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.592 qpair failed and we were unable to recover it. 00:26:21.592 [2024-04-16 23:04:12.605999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.592 [2024-04-16 23:04:12.606156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.592 [2024-04-16 23:04:12.606192] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.592 qpair failed and we were unable to recover it. 00:26:21.592 [2024-04-16 23:04:12.606342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.592 [2024-04-16 23:04:12.606521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.592 [2024-04-16 23:04:12.606548] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.592 qpair failed and we were unable to recover it. 00:26:21.592 [2024-04-16 23:04:12.606714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.592 [2024-04-16 23:04:12.606852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.592 [2024-04-16 23:04:12.606876] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.592 qpair failed and we were unable to recover it. 00:26:21.592 [2024-04-16 23:04:12.607033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.592 [2024-04-16 23:04:12.607245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.592 [2024-04-16 23:04:12.607298] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.592 qpair failed and we were unable to recover it. 00:26:21.592 [2024-04-16 23:04:12.607429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.592 [2024-04-16 23:04:12.607587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.592 [2024-04-16 23:04:12.607614] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.592 qpair failed and we were unable to recover it. 00:26:21.592 [2024-04-16 23:04:12.607742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.592 [2024-04-16 23:04:12.607913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.593 [2024-04-16 23:04:12.607939] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.593 qpair failed and we were unable to recover it. 00:26:21.593 [2024-04-16 23:04:12.608057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.593 [2024-04-16 23:04:12.608189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.593 [2024-04-16 23:04:12.608215] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.593 qpair failed and we were unable to recover it. 00:26:21.593 [2024-04-16 23:04:12.608391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.593 [2024-04-16 23:04:12.608493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.593 [2024-04-16 23:04:12.608518] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.593 qpair failed and we were unable to recover it. 00:26:21.593 [2024-04-16 23:04:12.608650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.593 [2024-04-16 23:04:12.608756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.593 [2024-04-16 23:04:12.608780] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.593 qpair failed and we were unable to recover it. 00:26:21.593 [2024-04-16 23:04:12.608887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.593 [2024-04-16 23:04:12.608994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.593 [2024-04-16 23:04:12.609019] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.593 qpair failed and we were unable to recover it. 00:26:21.593 [2024-04-16 23:04:12.609187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.593 [2024-04-16 23:04:12.609326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.593 [2024-04-16 23:04:12.609351] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.593 qpair failed and we were unable to recover it. 00:26:21.593 [2024-04-16 23:04:12.609483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.593 [2024-04-16 23:04:12.609589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.593 [2024-04-16 23:04:12.609614] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.593 qpair failed and we were unable to recover it. 00:26:21.593 [2024-04-16 23:04:12.609742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.593 [2024-04-16 23:04:12.609892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.593 [2024-04-16 23:04:12.609918] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.593 qpair failed and we were unable to recover it. 00:26:21.593 [2024-04-16 23:04:12.610028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.593 [2024-04-16 23:04:12.610169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.593 [2024-04-16 23:04:12.610205] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.593 qpair failed and we were unable to recover it. 00:26:21.593 [2024-04-16 23:04:12.610315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.593 [2024-04-16 23:04:12.610451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.593 [2024-04-16 23:04:12.610475] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.593 qpair failed and we were unable to recover it. 00:26:21.593 [2024-04-16 23:04:12.610678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.593 [2024-04-16 23:04:12.610818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.593 [2024-04-16 23:04:12.610842] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.593 qpair failed and we were unable to recover it. 00:26:21.593 [2024-04-16 23:04:12.610983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.593 [2024-04-16 23:04:12.611185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.593 [2024-04-16 23:04:12.611210] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.593 qpair failed and we were unable to recover it. 00:26:21.593 [2024-04-16 23:04:12.611327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.593 [2024-04-16 23:04:12.611466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.593 [2024-04-16 23:04:12.611492] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.593 qpair failed and we were unable to recover it. 00:26:21.593 [2024-04-16 23:04:12.611632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.593 [2024-04-16 23:04:12.611746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.593 [2024-04-16 23:04:12.611770] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.593 qpair failed and we were unable to recover it. 00:26:21.593 [2024-04-16 23:04:12.611878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.593 [2024-04-16 23:04:12.612035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.593 [2024-04-16 23:04:12.612062] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.593 qpair failed and we were unable to recover it. 00:26:21.593 [2024-04-16 23:04:12.612232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.593 [2024-04-16 23:04:12.612369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.593 [2024-04-16 23:04:12.612394] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.593 qpair failed and we were unable to recover it. 00:26:21.593 [2024-04-16 23:04:12.612559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.593 [2024-04-16 23:04:12.612727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.593 [2024-04-16 23:04:12.612754] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.593 qpair failed and we were unable to recover it. 00:26:21.593 [2024-04-16 23:04:12.612925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.593 [2024-04-16 23:04:12.613116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.593 [2024-04-16 23:04:12.613143] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.593 qpair failed and we were unable to recover it. 00:26:21.593 [2024-04-16 23:04:12.613341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.593 [2024-04-16 23:04:12.613481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.593 [2024-04-16 23:04:12.613505] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.593 qpair failed and we were unable to recover it. 00:26:21.593 [2024-04-16 23:04:12.613669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.593 [2024-04-16 23:04:12.613836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.593 [2024-04-16 23:04:12.613860] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.593 qpair failed and we were unable to recover it. 00:26:21.593 [2024-04-16 23:04:12.614016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.593 [2024-04-16 23:04:12.614189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.593 [2024-04-16 23:04:12.614214] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.593 qpair failed and we were unable to recover it. 00:26:21.593 [2024-04-16 23:04:12.614387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.593 [2024-04-16 23:04:12.614544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.593 [2024-04-16 23:04:12.614571] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.593 qpair failed and we were unable to recover it. 00:26:21.593 [2024-04-16 23:04:12.614715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.593 [2024-04-16 23:04:12.614876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.593 [2024-04-16 23:04:12.614900] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.593 qpair failed and we were unable to recover it. 00:26:21.593 [2024-04-16 23:04:12.615014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.593 [2024-04-16 23:04:12.615166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.593 [2024-04-16 23:04:12.615200] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.593 qpair failed and we were unable to recover it. 00:26:21.593 [2024-04-16 23:04:12.615356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.593 [2024-04-16 23:04:12.615475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.593 [2024-04-16 23:04:12.615501] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.593 qpair failed and we were unable to recover it. 00:26:21.593 [2024-04-16 23:04:12.615646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.593 [2024-04-16 23:04:12.615753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.593 [2024-04-16 23:04:12.615777] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.593 qpair failed and we were unable to recover it. 00:26:21.593 [2024-04-16 23:04:12.615939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.593 [2024-04-16 23:04:12.616077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.593 [2024-04-16 23:04:12.616102] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.593 qpair failed and we were unable to recover it. 00:26:21.593 [2024-04-16 23:04:12.616218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.593 [2024-04-16 23:04:12.616331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.593 [2024-04-16 23:04:12.616360] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.593 qpair failed and we were unable to recover it. 00:26:21.594 [2024-04-16 23:04:12.616471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.594 [2024-04-16 23:04:12.616643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.594 [2024-04-16 23:04:12.616668] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.594 qpair failed and we were unable to recover it. 00:26:21.594 [2024-04-16 23:04:12.616777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.594 [2024-04-16 23:04:12.616885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.594 [2024-04-16 23:04:12.616909] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.594 qpair failed and we were unable to recover it. 00:26:21.594 [2024-04-16 23:04:12.617061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.594 [2024-04-16 23:04:12.617206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.594 [2024-04-16 23:04:12.617234] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.594 qpair failed and we were unable to recover it. 00:26:21.594 [2024-04-16 23:04:12.617358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.594 [2024-04-16 23:04:12.617511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.594 [2024-04-16 23:04:12.617539] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.594 qpair failed and we were unable to recover it. 00:26:21.594 [2024-04-16 23:04:12.617657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.594 [2024-04-16 23:04:12.617807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.594 [2024-04-16 23:04:12.617834] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.594 qpair failed and we were unable to recover it. 00:26:21.594 [2024-04-16 23:04:12.617990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.594 [2024-04-16 23:04:12.618129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.594 [2024-04-16 23:04:12.618171] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.594 qpair failed and we were unable to recover it. 00:26:21.594 [2024-04-16 23:04:12.618314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.594 [2024-04-16 23:04:12.618465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.594 [2024-04-16 23:04:12.618492] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.594 qpair failed and we were unable to recover it. 00:26:21.594 [2024-04-16 23:04:12.618636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.594 [2024-04-16 23:04:12.618784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.594 [2024-04-16 23:04:12.618812] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.594 qpair failed and we were unable to recover it. 00:26:21.594 [2024-04-16 23:04:12.618993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.594 [2024-04-16 23:04:12.619120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.594 [2024-04-16 23:04:12.619149] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.594 qpair failed and we were unable to recover it. 00:26:21.594 [2024-04-16 23:04:12.619313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.594 [2024-04-16 23:04:12.619461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.594 [2024-04-16 23:04:12.619486] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.594 qpair failed and we were unable to recover it. 00:26:21.594 [2024-04-16 23:04:12.619659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.594 [2024-04-16 23:04:12.619808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.594 [2024-04-16 23:04:12.619836] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.594 qpair failed and we were unable to recover it. 00:26:21.594 [2024-04-16 23:04:12.619956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.594 [2024-04-16 23:04:12.620095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.594 [2024-04-16 23:04:12.620120] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.594 qpair failed and we were unable to recover it. 00:26:21.594 [2024-04-16 23:04:12.620289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.594 [2024-04-16 23:04:12.620448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.594 [2024-04-16 23:04:12.620476] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.594 qpair failed and we were unable to recover it. 00:26:21.594 [2024-04-16 23:04:12.620632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.594 [2024-04-16 23:04:12.620771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.594 [2024-04-16 23:04:12.620795] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.594 qpair failed and we were unable to recover it. 00:26:21.594 [2024-04-16 23:04:12.620968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.594 [2024-04-16 23:04:12.621087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.594 [2024-04-16 23:04:12.621116] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.594 qpair failed and we were unable to recover it. 00:26:21.594 [2024-04-16 23:04:12.621238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.594 [2024-04-16 23:04:12.621397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.594 [2024-04-16 23:04:12.621424] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.594 qpair failed and we were unable to recover it. 00:26:21.594 [2024-04-16 23:04:12.621622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.594 [2024-04-16 23:04:12.621755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.594 [2024-04-16 23:04:12.621780] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.594 qpair failed and we were unable to recover it. 00:26:21.594 [2024-04-16 23:04:12.621914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.594 [2024-04-16 23:04:12.622023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.594 [2024-04-16 23:04:12.622048] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.594 qpair failed and we were unable to recover it. 00:26:21.594 [2024-04-16 23:04:12.622186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.594 [2024-04-16 23:04:12.622351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.594 [2024-04-16 23:04:12.622378] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.594 qpair failed and we were unable to recover it. 00:26:21.594 [2024-04-16 23:04:12.622532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.594 [2024-04-16 23:04:12.622656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.594 [2024-04-16 23:04:12.622683] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.594 qpair failed and we were unable to recover it. 00:26:21.594 [2024-04-16 23:04:12.622842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.594 [2024-04-16 23:04:12.622994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.594 [2024-04-16 23:04:12.623021] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.594 qpair failed and we were unable to recover it. 00:26:21.594 [2024-04-16 23:04:12.623152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.595 [2024-04-16 23:04:12.623303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.595 [2024-04-16 23:04:12.623328] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.595 qpair failed and we were unable to recover it. 00:26:21.595 [2024-04-16 23:04:12.623494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.595 [2024-04-16 23:04:12.623608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.595 [2024-04-16 23:04:12.623635] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.595 qpair failed and we were unable to recover it. 00:26:21.595 [2024-04-16 23:04:12.623819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.595 [2024-04-16 23:04:12.623935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.595 [2024-04-16 23:04:12.623962] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.595 qpair failed and we were unable to recover it. 00:26:21.595 [2024-04-16 23:04:12.624122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.595 [2024-04-16 23:04:12.624264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.595 [2024-04-16 23:04:12.624290] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.595 qpair failed and we were unable to recover it. 00:26:21.595 [2024-04-16 23:04:12.624399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.595 [2024-04-16 23:04:12.624508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.595 [2024-04-16 23:04:12.624532] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.595 qpair failed and we were unable to recover it. 00:26:21.595 [2024-04-16 23:04:12.624675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.595 [2024-04-16 23:04:12.624859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.595 [2024-04-16 23:04:12.624920] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.595 qpair failed and we were unable to recover it. 00:26:21.595 [2024-04-16 23:04:12.625079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.595 [2024-04-16 23:04:12.625224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.595 [2024-04-16 23:04:12.625250] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.595 qpair failed and we were unable to recover it. 00:26:21.595 [2024-04-16 23:04:12.625367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.595 [2024-04-16 23:04:12.625486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.595 [2024-04-16 23:04:12.625510] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.595 qpair failed and we were unable to recover it. 00:26:21.595 [2024-04-16 23:04:12.625683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.595 [2024-04-16 23:04:12.625821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.595 [2024-04-16 23:04:12.625845] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.595 qpair failed and we were unable to recover it. 00:26:21.595 [2024-04-16 23:04:12.625981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.595 [2024-04-16 23:04:12.626113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.595 [2024-04-16 23:04:12.626138] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.595 qpair failed and we were unable to recover it. 00:26:21.595 [2024-04-16 23:04:12.626293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.595 [2024-04-16 23:04:12.626440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.595 [2024-04-16 23:04:12.626464] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.595 qpair failed and we were unable to recover it. 00:26:21.595 [2024-04-16 23:04:12.626579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.595 [2024-04-16 23:04:12.626686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.595 [2024-04-16 23:04:12.626711] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.595 qpair failed and we were unable to recover it. 00:26:21.595 [2024-04-16 23:04:12.626905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.595 [2024-04-16 23:04:12.627013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.595 [2024-04-16 23:04:12.627038] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.595 qpair failed and we were unable to recover it. 00:26:21.595 [2024-04-16 23:04:12.627185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.595 [2024-04-16 23:04:12.627295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.595 [2024-04-16 23:04:12.627320] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.595 qpair failed and we were unable to recover it. 00:26:21.595 [2024-04-16 23:04:12.627483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.595 [2024-04-16 23:04:12.627673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.595 [2024-04-16 23:04:12.627697] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.595 qpair failed and we were unable to recover it. 00:26:21.595 [2024-04-16 23:04:12.627869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.595 [2024-04-16 23:04:12.627975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.595 [2024-04-16 23:04:12.628000] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.595 qpair failed and we were unable to recover it. 00:26:21.595 [2024-04-16 23:04:12.628121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.595 [2024-04-16 23:04:12.628266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.595 [2024-04-16 23:04:12.628292] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.595 qpair failed and we were unable to recover it. 00:26:21.595 [2024-04-16 23:04:12.628491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.595 [2024-04-16 23:04:12.628624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.595 [2024-04-16 23:04:12.628649] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.595 qpair failed and we were unable to recover it. 00:26:21.595 [2024-04-16 23:04:12.628764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.595 [2024-04-16 23:04:12.628964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.595 [2024-04-16 23:04:12.628989] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.595 qpair failed and we were unable to recover it. 00:26:21.595 [2024-04-16 23:04:12.629132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.595 [2024-04-16 23:04:12.629254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.595 [2024-04-16 23:04:12.629280] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.595 qpair failed and we were unable to recover it. 00:26:21.595 [2024-04-16 23:04:12.629399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.595 [2024-04-16 23:04:12.629515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.595 [2024-04-16 23:04:12.629541] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.595 qpair failed and we were unable to recover it. 00:26:21.595 [2024-04-16 23:04:12.629711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.595 [2024-04-16 23:04:12.629853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.595 [2024-04-16 23:04:12.629878] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.595 qpair failed and we were unable to recover it. 00:26:21.595 [2024-04-16 23:04:12.630025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.595 [2024-04-16 23:04:12.630183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.595 [2024-04-16 23:04:12.630212] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.595 qpair failed and we were unable to recover it. 00:26:21.595 [2024-04-16 23:04:12.630393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.595 [2024-04-16 23:04:12.630551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.595 [2024-04-16 23:04:12.630575] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.595 qpair failed and we were unable to recover it. 00:26:21.595 [2024-04-16 23:04:12.630739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.595 [2024-04-16 23:04:12.630872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.595 [2024-04-16 23:04:12.630897] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.595 qpair failed and we were unable to recover it. 00:26:21.595 [2024-04-16 23:04:12.631080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.595 [2024-04-16 23:04:12.631194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.595 [2024-04-16 23:04:12.631222] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.596 qpair failed and we were unable to recover it. 00:26:21.596 [2024-04-16 23:04:12.631412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.596 [2024-04-16 23:04:12.631568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.596 [2024-04-16 23:04:12.631610] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.596 qpair failed and we were unable to recover it. 00:26:21.596 [2024-04-16 23:04:12.631772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.596 [2024-04-16 23:04:12.631937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.596 [2024-04-16 23:04:12.631962] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.596 qpair failed and we were unable to recover it. 00:26:21.596 [2024-04-16 23:04:12.632118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.596 [2024-04-16 23:04:12.632257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.596 [2024-04-16 23:04:12.632283] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.596 qpair failed and we were unable to recover it. 00:26:21.596 [2024-04-16 23:04:12.632458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.596 [2024-04-16 23:04:12.632623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.596 [2024-04-16 23:04:12.632652] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.596 qpair failed and we were unable to recover it. 00:26:21.596 [2024-04-16 23:04:12.632787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.596 [2024-04-16 23:04:12.632929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.596 [2024-04-16 23:04:12.632956] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.596 qpair failed and we were unable to recover it. 00:26:21.596 [2024-04-16 23:04:12.633116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.596 [2024-04-16 23:04:12.633271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.596 [2024-04-16 23:04:12.633296] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.596 qpair failed and we were unable to recover it. 00:26:21.596 [2024-04-16 23:04:12.633410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.596 [2024-04-16 23:04:12.633557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.596 [2024-04-16 23:04:12.633582] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.596 qpair failed and we were unable to recover it. 00:26:21.596 [2024-04-16 23:04:12.633747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.596 [2024-04-16 23:04:12.633872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.596 [2024-04-16 23:04:12.633899] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.596 qpair failed and we were unable to recover it. 00:26:21.596 [2024-04-16 23:04:12.634055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.596 [2024-04-16 23:04:12.634202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.596 [2024-04-16 23:04:12.634230] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.596 qpair failed and we were unable to recover it. 00:26:21.596 [2024-04-16 23:04:12.634385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.596 [2024-04-16 23:04:12.634532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.596 [2024-04-16 23:04:12.634559] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.596 qpair failed and we were unable to recover it. 00:26:21.596 [2024-04-16 23:04:12.634696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.596 [2024-04-16 23:04:12.634832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.596 [2024-04-16 23:04:12.634856] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.596 qpair failed and we were unable to recover it. 00:26:21.596 [2024-04-16 23:04:12.635022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.596 [2024-04-16 23:04:12.635172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.596 [2024-04-16 23:04:12.635206] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.596 qpair failed and we were unable to recover it. 00:26:21.596 [2024-04-16 23:04:12.635357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.596 [2024-04-16 23:04:12.635534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.596 [2024-04-16 23:04:12.635561] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.596 qpair failed and we were unable to recover it. 00:26:21.596 [2024-04-16 23:04:12.635743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.596 [2024-04-16 23:04:12.635934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.596 [2024-04-16 23:04:12.635990] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.596 qpair failed and we were unable to recover it. 00:26:21.596 [2024-04-16 23:04:12.636154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.596 [2024-04-16 23:04:12.636307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.596 [2024-04-16 23:04:12.636348] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.596 qpair failed and we were unable to recover it. 00:26:21.596 [2024-04-16 23:04:12.636485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.596 [2024-04-16 23:04:12.636639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.596 [2024-04-16 23:04:12.636666] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.596 qpair failed and we were unable to recover it. 00:26:21.596 [2024-04-16 23:04:12.636819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.596 [2024-04-16 23:04:12.636972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.596 [2024-04-16 23:04:12.637001] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.596 qpair failed and we were unable to recover it. 00:26:21.596 [2024-04-16 23:04:12.637155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.596 [2024-04-16 23:04:12.637287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.596 [2024-04-16 23:04:12.637316] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.596 qpair failed and we were unable to recover it. 00:26:21.596 [2024-04-16 23:04:12.637488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.596 [2024-04-16 23:04:12.637635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.596 [2024-04-16 23:04:12.637660] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.596 qpair failed and we were unable to recover it. 00:26:21.596 [2024-04-16 23:04:12.637803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.596 [2024-04-16 23:04:12.637929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.596 [2024-04-16 23:04:12.637957] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.596 qpair failed and we were unable to recover it. 00:26:21.596 [2024-04-16 23:04:12.638116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.596 [2024-04-16 23:04:12.638282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.596 [2024-04-16 23:04:12.638311] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.596 qpair failed and we were unable to recover it. 00:26:21.596 [2024-04-16 23:04:12.638471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.596 [2024-04-16 23:04:12.638644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.596 [2024-04-16 23:04:12.638668] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.596 qpair failed and we were unable to recover it. 00:26:21.596 [2024-04-16 23:04:12.638803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.596 [2024-04-16 23:04:12.638948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.596 [2024-04-16 23:04:12.638989] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.596 qpair failed and we were unable to recover it. 00:26:21.596 [2024-04-16 23:04:12.639172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.596 [2024-04-16 23:04:12.639305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.596 [2024-04-16 23:04:12.639333] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.596 qpair failed and we were unable to recover it. 00:26:21.596 [2024-04-16 23:04:12.639495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.596 [2024-04-16 23:04:12.639688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.596 [2024-04-16 23:04:12.639713] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.596 qpair failed and we were unable to recover it. 00:26:21.596 [2024-04-16 23:04:12.639881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.596 [2024-04-16 23:04:12.640009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.596 [2024-04-16 23:04:12.640038] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.596 qpair failed and we were unable to recover it. 00:26:21.597 [2024-04-16 23:04:12.640232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.597 [2024-04-16 23:04:12.640401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.597 [2024-04-16 23:04:12.640459] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.597 qpair failed and we were unable to recover it. 00:26:21.597 [2024-04-16 23:04:12.640591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.597 [2024-04-16 23:04:12.640743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.597 [2024-04-16 23:04:12.640770] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.597 qpair failed and we were unable to recover it. 00:26:21.597 [2024-04-16 23:04:12.640930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.597 [2024-04-16 23:04:12.641097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.597 [2024-04-16 23:04:12.641122] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.597 qpair failed and we were unable to recover it. 00:26:21.597 [2024-04-16 23:04:12.641284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.597 [2024-04-16 23:04:12.641448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.597 [2024-04-16 23:04:12.641472] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.597 qpair failed and we were unable to recover it. 00:26:21.597 [2024-04-16 23:04:12.641589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.597 [2024-04-16 23:04:12.641755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.597 [2024-04-16 23:04:12.641795] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.597 qpair failed and we were unable to recover it. 00:26:21.597 [2024-04-16 23:04:12.641933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.597 [2024-04-16 23:04:12.642085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.597 [2024-04-16 23:04:12.642113] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.597 qpair failed and we were unable to recover it. 00:26:21.597 [2024-04-16 23:04:12.642234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.597 [2024-04-16 23:04:12.642365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.597 [2024-04-16 23:04:12.642392] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.597 qpair failed and we were unable to recover it. 00:26:21.597 [2024-04-16 23:04:12.642582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.597 [2024-04-16 23:04:12.642722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.597 [2024-04-16 23:04:12.642746] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.597 qpair failed and we were unable to recover it. 00:26:21.597 [2024-04-16 23:04:12.642914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.597 [2024-04-16 23:04:12.643072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.597 [2024-04-16 23:04:12.643099] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.597 qpair failed and we were unable to recover it. 00:26:21.597 [2024-04-16 23:04:12.643228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.597 [2024-04-16 23:04:12.643424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.597 [2024-04-16 23:04:12.643449] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.597 qpair failed and we were unable to recover it. 00:26:21.597 [2024-04-16 23:04:12.643591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.597 [2024-04-16 23:04:12.643791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.597 [2024-04-16 23:04:12.643818] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.597 qpair failed and we were unable to recover it. 00:26:21.597 [2024-04-16 23:04:12.643972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.597 [2024-04-16 23:04:12.644127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.597 [2024-04-16 23:04:12.644155] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.597 qpair failed and we were unable to recover it. 00:26:21.597 [2024-04-16 23:04:12.644325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.597 [2024-04-16 23:04:12.644437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.597 [2024-04-16 23:04:12.644461] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.597 qpair failed and we were unable to recover it. 00:26:21.597 [2024-04-16 23:04:12.644700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.597 [2024-04-16 23:04:12.644808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.597 [2024-04-16 23:04:12.644833] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.597 qpair failed and we were unable to recover it. 00:26:21.597 [2024-04-16 23:04:12.645054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.597 [2024-04-16 23:04:12.645215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.597 [2024-04-16 23:04:12.645244] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.597 qpair failed and we were unable to recover it. 00:26:21.597 [2024-04-16 23:04:12.645370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.597 [2024-04-16 23:04:12.645530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.597 [2024-04-16 23:04:12.645555] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.597 qpair failed and we were unable to recover it. 00:26:21.597 [2024-04-16 23:04:12.645670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.597 [2024-04-16 23:04:12.645780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.597 [2024-04-16 23:04:12.645804] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.597 qpair failed and we were unable to recover it. 00:26:21.597 [2024-04-16 23:04:12.645945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.597 [2024-04-16 23:04:12.646090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.597 [2024-04-16 23:04:12.646115] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.597 qpair failed and we were unable to recover it. 00:26:21.597 [2024-04-16 23:04:12.646306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.597 [2024-04-16 23:04:12.646499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.597 [2024-04-16 23:04:12.646526] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.597 qpair failed and we were unable to recover it. 00:26:21.597 [2024-04-16 23:04:12.646670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.597 [2024-04-16 23:04:12.646860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.597 [2024-04-16 23:04:12.646884] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.597 qpair failed and we were unable to recover it. 00:26:21.597 [2024-04-16 23:04:12.647028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.597 [2024-04-16 23:04:12.647139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.597 [2024-04-16 23:04:12.647163] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.597 qpair failed and we were unable to recover it. 00:26:21.597 [2024-04-16 23:04:12.647312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.597 [2024-04-16 23:04:12.647475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.597 [2024-04-16 23:04:12.647500] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.597 qpair failed and we were unable to recover it. 00:26:21.597 [2024-04-16 23:04:12.647643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.597 [2024-04-16 23:04:12.647763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.597 [2024-04-16 23:04:12.647787] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.597 qpair failed and we were unable to recover it. 00:26:21.597 [2024-04-16 23:04:12.647919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.597 [2024-04-16 23:04:12.648038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.597 [2024-04-16 23:04:12.648062] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.597 qpair failed and we were unable to recover it. 00:26:21.597 [2024-04-16 23:04:12.648202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.597 [2024-04-16 23:04:12.648345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.597 [2024-04-16 23:04:12.648369] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.597 qpair failed and we were unable to recover it. 00:26:21.597 [2024-04-16 23:04:12.648483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.597 [2024-04-16 23:04:12.648623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.597 [2024-04-16 23:04:12.648648] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.597 qpair failed and we were unable to recover it. 00:26:21.597 [2024-04-16 23:04:12.648784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.597 [2024-04-16 23:04:12.648947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.597 [2024-04-16 23:04:12.648972] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.597 qpair failed and we were unable to recover it. 00:26:21.597 [2024-04-16 23:04:12.649149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.597 [2024-04-16 23:04:12.649264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.598 [2024-04-16 23:04:12.649289] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.598 qpair failed and we were unable to recover it. 00:26:21.598 [2024-04-16 23:04:12.649457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.598 [2024-04-16 23:04:12.649612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.598 [2024-04-16 23:04:12.649639] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.598 qpair failed and we were unable to recover it. 00:26:21.598 [2024-04-16 23:04:12.649758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.598 [2024-04-16 23:04:12.649916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.598 [2024-04-16 23:04:12.649941] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.598 qpair failed and we were unable to recover it. 00:26:21.598 [2024-04-16 23:04:12.650085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.598 [2024-04-16 23:04:12.650251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.598 [2024-04-16 23:04:12.650279] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.598 qpair failed and we were unable to recover it. 00:26:21.598 [2024-04-16 23:04:12.650404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.598 [2024-04-16 23:04:12.650562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.598 [2024-04-16 23:04:12.650589] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.598 qpair failed and we were unable to recover it. 00:26:21.598 [2024-04-16 23:04:12.650746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.598 [2024-04-16 23:04:12.650884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.598 [2024-04-16 23:04:12.650909] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.598 qpair failed and we were unable to recover it. 00:26:21.598 [2024-04-16 23:04:12.651048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.598 [2024-04-16 23:04:12.651190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.598 [2024-04-16 23:04:12.651215] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.598 qpair failed and we were unable to recover it. 00:26:21.598 [2024-04-16 23:04:12.651387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.598 [2024-04-16 23:04:12.651530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.598 [2024-04-16 23:04:12.651554] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.598 qpair failed and we were unable to recover it. 00:26:21.598 [2024-04-16 23:04:12.651721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.598 [2024-04-16 23:04:12.651925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.598 [2024-04-16 23:04:12.651950] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.598 qpair failed and we were unable to recover it. 00:26:21.598 [2024-04-16 23:04:12.652065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.598 [2024-04-16 23:04:12.652184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.598 [2024-04-16 23:04:12.652210] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.598 qpair failed and we were unable to recover it. 00:26:21.598 [2024-04-16 23:04:12.652355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.598 [2024-04-16 23:04:12.652507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.598 [2024-04-16 23:04:12.652535] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.598 qpair failed and we were unable to recover it. 00:26:21.598 [2024-04-16 23:04:12.652725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.598 [2024-04-16 23:04:12.652881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.598 [2024-04-16 23:04:12.652912] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.598 qpair failed and we were unable to recover it. 00:26:21.598 [2024-04-16 23:04:12.653080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.598 [2024-04-16 23:04:12.653238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.598 [2024-04-16 23:04:12.653275] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.598 qpair failed and we were unable to recover it. 00:26:21.598 [2024-04-16 23:04:12.653470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.598 [2024-04-16 23:04:12.653625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.598 [2024-04-16 23:04:12.653650] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.598 qpair failed and we were unable to recover it. 00:26:21.598 [2024-04-16 23:04:12.653808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.598 [2024-04-16 23:04:12.653976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.598 [2024-04-16 23:04:12.654000] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.598 qpair failed and we were unable to recover it. 00:26:21.598 [2024-04-16 23:04:12.654114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.598 [2024-04-16 23:04:12.654250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.598 [2024-04-16 23:04:12.654276] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.598 qpair failed and we were unable to recover it. 00:26:21.598 [2024-04-16 23:04:12.654403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.598 [2024-04-16 23:04:12.654529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.598 [2024-04-16 23:04:12.654556] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.598 qpair failed and we were unable to recover it. 00:26:21.598 [2024-04-16 23:04:12.654691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.598 [2024-04-16 23:04:12.654832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.598 [2024-04-16 23:04:12.654856] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.598 qpair failed and we were unable to recover it. 00:26:21.598 [2024-04-16 23:04:12.655038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.598 [2024-04-16 23:04:12.655216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.598 [2024-04-16 23:04:12.655244] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.598 qpair failed and we were unable to recover it. 00:26:21.598 [2024-04-16 23:04:12.655399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.598 [2024-04-16 23:04:12.655548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.598 [2024-04-16 23:04:12.655575] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.598 qpair failed and we were unable to recover it. 00:26:21.598 [2024-04-16 23:04:12.655719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.598 [2024-04-16 23:04:12.655863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.598 [2024-04-16 23:04:12.655890] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.598 qpair failed and we were unable to recover it. 00:26:21.598 [2024-04-16 23:04:12.656015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.598 [2024-04-16 23:04:12.656153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.598 [2024-04-16 23:04:12.656185] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.598 qpair failed and we were unable to recover it. 00:26:21.598 [2024-04-16 23:04:12.656362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.598 [2024-04-16 23:04:12.656571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.598 [2024-04-16 23:04:12.656630] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.598 qpair failed and we were unable to recover it. 00:26:21.598 [2024-04-16 23:04:12.656781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.598 [2024-04-16 23:04:12.656927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.598 [2024-04-16 23:04:12.656955] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.598 qpair failed and we were unable to recover it. 00:26:21.598 [2024-04-16 23:04:12.657091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.598 [2024-04-16 23:04:12.657273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.598 [2024-04-16 23:04:12.657301] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.598 qpair failed and we were unable to recover it. 00:26:21.598 [2024-04-16 23:04:12.657431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.598 [2024-04-16 23:04:12.657572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.598 [2024-04-16 23:04:12.657597] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.598 qpair failed and we were unable to recover it. 00:26:21.598 [2024-04-16 23:04:12.657762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.598 [2024-04-16 23:04:12.657935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.598 [2024-04-16 23:04:12.657961] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.598 qpair failed and we were unable to recover it. 00:26:21.598 [2024-04-16 23:04:12.658085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.598 [2024-04-16 23:04:12.658255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.598 [2024-04-16 23:04:12.658280] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.598 qpair failed and we were unable to recover it. 00:26:21.598 [2024-04-16 23:04:12.658458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.598 [2024-04-16 23:04:12.658616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.598 [2024-04-16 23:04:12.658644] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.598 qpair failed and we were unable to recover it. 00:26:21.599 [2024-04-16 23:04:12.658832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.599 [2024-04-16 23:04:12.658966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.599 [2024-04-16 23:04:12.659008] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.599 qpair failed and we were unable to recover it. 00:26:21.599 [2024-04-16 23:04:12.659135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.599 [2024-04-16 23:04:12.659292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.599 [2024-04-16 23:04:12.659320] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.599 qpair failed and we were unable to recover it. 00:26:21.599 [2024-04-16 23:04:12.659488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.599 [2024-04-16 23:04:12.659614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.599 [2024-04-16 23:04:12.659641] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.599 qpair failed and we were unable to recover it. 00:26:21.599 [2024-04-16 23:04:12.659798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.599 [2024-04-16 23:04:12.659951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.599 [2024-04-16 23:04:12.659978] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.599 qpair failed and we were unable to recover it. 00:26:21.599 [2024-04-16 23:04:12.660163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.599 [2024-04-16 23:04:12.660312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.599 [2024-04-16 23:04:12.660354] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.599 qpair failed and we were unable to recover it. 00:26:21.599 [2024-04-16 23:04:12.660475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.599 [2024-04-16 23:04:12.660660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.599 [2024-04-16 23:04:12.660687] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.599 qpair failed and we were unable to recover it. 00:26:21.599 [2024-04-16 23:04:12.660834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.599 [2024-04-16 23:04:12.660983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.599 [2024-04-16 23:04:12.661011] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.599 qpair failed and we were unable to recover it. 00:26:21.599 [2024-04-16 23:04:12.661131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.599 [2024-04-16 23:04:12.661305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.599 [2024-04-16 23:04:12.661333] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.599 qpair failed and we were unable to recover it. 00:26:21.599 [2024-04-16 23:04:12.661491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.599 [2024-04-16 23:04:12.661646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.599 [2024-04-16 23:04:12.661671] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.599 qpair failed and we were unable to recover it. 00:26:21.599 [2024-04-16 23:04:12.661871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.599 [2024-04-16 23:04:12.662016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.599 [2024-04-16 23:04:12.662044] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.599 qpair failed and we were unable to recover it. 00:26:21.599 [2024-04-16 23:04:12.662200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.599 [2024-04-16 23:04:12.662318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.599 [2024-04-16 23:04:12.662346] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.599 qpair failed and we were unable to recover it. 00:26:21.599 [2024-04-16 23:04:12.662510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.599 [2024-04-16 23:04:12.662620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.599 [2024-04-16 23:04:12.662645] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.599 qpair failed and we were unable to recover it. 00:26:21.599 [2024-04-16 23:04:12.662786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.599 [2024-04-16 23:04:12.662932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.599 [2024-04-16 23:04:12.662957] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.599 qpair failed and we were unable to recover it. 00:26:21.599 [2024-04-16 23:04:12.663100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.599 [2024-04-16 23:04:12.663231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.599 [2024-04-16 23:04:12.663260] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.599 qpair failed and we were unable to recover it. 00:26:21.599 [2024-04-16 23:04:12.663405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.599 [2024-04-16 23:04:12.663561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.599 [2024-04-16 23:04:12.663589] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.599 qpair failed and we were unable to recover it. 00:26:21.599 [2024-04-16 23:04:12.663744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.599 [2024-04-16 23:04:12.663927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.599 [2024-04-16 23:04:12.663954] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.599 qpair failed and we were unable to recover it. 00:26:21.599 [2024-04-16 23:04:12.664084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.599 [2024-04-16 23:04:12.664206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.599 [2024-04-16 23:04:12.664231] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.599 qpair failed and we were unable to recover it. 00:26:21.599 [2024-04-16 23:04:12.664403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.599 [2024-04-16 23:04:12.664581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.599 [2024-04-16 23:04:12.664640] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.599 qpair failed and we were unable to recover it. 00:26:21.599 [2024-04-16 23:04:12.664757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.599 [2024-04-16 23:04:12.664901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.599 [2024-04-16 23:04:12.664926] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.599 qpair failed and we were unable to recover it. 00:26:21.599 [2024-04-16 23:04:12.665082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.599 [2024-04-16 23:04:12.665265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.599 [2024-04-16 23:04:12.665290] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.599 qpair failed and we were unable to recover it. 00:26:21.599 [2024-04-16 23:04:12.665430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.599 [2024-04-16 23:04:12.665565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.599 [2024-04-16 23:04:12.665605] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.599 qpair failed and we were unable to recover it. 00:26:21.599 [2024-04-16 23:04:12.665752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.599 [2024-04-16 23:04:12.665916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.599 [2024-04-16 23:04:12.665944] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.599 qpair failed and we were unable to recover it. 00:26:21.599 [2024-04-16 23:04:12.666113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.599 [2024-04-16 23:04:12.666283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.599 [2024-04-16 23:04:12.666308] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.600 qpair failed and we were unable to recover it. 00:26:21.600 [2024-04-16 23:04:12.666466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.600 [2024-04-16 23:04:12.666591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.600 [2024-04-16 23:04:12.666620] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.600 qpair failed and we were unable to recover it. 00:26:21.600 [2024-04-16 23:04:12.666747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.600 [2024-04-16 23:04:12.666866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.600 [2024-04-16 23:04:12.666892] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.600 qpair failed and we were unable to recover it. 00:26:21.600 [2024-04-16 23:04:12.667027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.600 [2024-04-16 23:04:12.667180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.600 [2024-04-16 23:04:12.667206] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.600 qpair failed and we were unable to recover it. 00:26:21.600 [2024-04-16 23:04:12.667345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.600 [2024-04-16 23:04:12.667526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.600 [2024-04-16 23:04:12.667553] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.600 qpair failed and we were unable to recover it. 00:26:21.600 [2024-04-16 23:04:12.667710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.600 [2024-04-16 23:04:12.667859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.600 [2024-04-16 23:04:12.667889] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.600 qpair failed and we were unable to recover it. 00:26:21.600 [2024-04-16 23:04:12.668042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.600 [2024-04-16 23:04:12.668152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.600 [2024-04-16 23:04:12.668184] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.600 qpair failed and we were unable to recover it. 00:26:21.600 [2024-04-16 23:04:12.668324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.600 [2024-04-16 23:04:12.668493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.600 [2024-04-16 23:04:12.668517] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.600 qpair failed and we were unable to recover it. 00:26:21.600 [2024-04-16 23:04:12.668636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.600 [2024-04-16 23:04:12.668759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.600 [2024-04-16 23:04:12.668786] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.600 qpair failed and we were unable to recover it. 00:26:21.600 [2024-04-16 23:04:12.668908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.600 [2024-04-16 23:04:12.669056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.600 [2024-04-16 23:04:12.669084] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.600 qpair failed and we were unable to recover it. 00:26:21.600 [2024-04-16 23:04:12.669250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.600 [2024-04-16 23:04:12.669396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.600 [2024-04-16 23:04:12.669420] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.600 qpair failed and we were unable to recover it. 00:26:21.600 [2024-04-16 23:04:12.669549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.600 [2024-04-16 23:04:12.669744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.600 [2024-04-16 23:04:12.669776] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.600 qpair failed and we were unable to recover it. 00:26:21.600 [2024-04-16 23:04:12.669941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.600 [2024-04-16 23:04:12.670091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.600 [2024-04-16 23:04:12.670118] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.600 qpair failed and we were unable to recover it. 00:26:21.600 [2024-04-16 23:04:12.670277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.600 [2024-04-16 23:04:12.670443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.600 [2024-04-16 23:04:12.670471] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.600 qpair failed and we were unable to recover it. 00:26:21.600 [2024-04-16 23:04:12.670635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.600 [2024-04-16 23:04:12.670782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.600 [2024-04-16 23:04:12.670815] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.600 qpair failed and we were unable to recover it. 00:26:21.600 [2024-04-16 23:04:12.670958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.600 [2024-04-16 23:04:12.671075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.600 [2024-04-16 23:04:12.671100] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.600 qpair failed and we were unable to recover it. 00:26:21.600 [2024-04-16 23:04:12.671263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.600 [2024-04-16 23:04:12.671410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.600 [2024-04-16 23:04:12.671438] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.600 qpair failed and we were unable to recover it. 00:26:21.600 [2024-04-16 23:04:12.671556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.600 [2024-04-16 23:04:12.671702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.600 [2024-04-16 23:04:12.671729] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.600 qpair failed and we were unable to recover it. 00:26:21.600 [2024-04-16 23:04:12.671901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.600 [2024-04-16 23:04:12.672003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.600 [2024-04-16 23:04:12.672029] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.600 qpair failed and we were unable to recover it. 00:26:21.600 [2024-04-16 23:04:12.672214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.600 [2024-04-16 23:04:12.672372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.600 [2024-04-16 23:04:12.672399] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.600 qpair failed and we were unable to recover it. 00:26:21.600 [2024-04-16 23:04:12.672520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.600 [2024-04-16 23:04:12.672669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.600 [2024-04-16 23:04:12.672696] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.600 qpair failed and we were unable to recover it. 00:26:21.600 [2024-04-16 23:04:12.672855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.600 [2024-04-16 23:04:12.672971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.600 [2024-04-16 23:04:12.672997] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.600 qpair failed and we were unable to recover it. 00:26:21.600 [2024-04-16 23:04:12.673150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.600 [2024-04-16 23:04:12.673272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.600 [2024-04-16 23:04:12.673298] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.600 qpair failed and we were unable to recover it. 00:26:21.600 [2024-04-16 23:04:12.673445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.600 [2024-04-16 23:04:12.673627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.600 [2024-04-16 23:04:12.673654] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.600 qpair failed and we were unable to recover it. 00:26:21.600 [2024-04-16 23:04:12.673820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.882 [2024-04-16 23:04:12.673983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.882 [2024-04-16 23:04:12.674009] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.882 qpair failed and we were unable to recover it. 00:26:21.882 [2024-04-16 23:04:12.674170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.882 [2024-04-16 23:04:12.674336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.882 [2024-04-16 23:04:12.674365] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.882 qpair failed and we were unable to recover it. 00:26:21.882 [2024-04-16 23:04:12.674547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.882 [2024-04-16 23:04:12.674659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.882 [2024-04-16 23:04:12.674684] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.882 qpair failed and we were unable to recover it. 00:26:21.882 [2024-04-16 23:04:12.674789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.882 [2024-04-16 23:04:12.674954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.882 [2024-04-16 23:04:12.674981] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.882 qpair failed and we were unable to recover it. 00:26:21.882 [2024-04-16 23:04:12.675143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.882 [2024-04-16 23:04:12.675259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.882 [2024-04-16 23:04:12.675285] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.882 qpair failed and we were unable to recover it. 00:26:21.882 [2024-04-16 23:04:12.675434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.882 [2024-04-16 23:04:12.675614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.882 [2024-04-16 23:04:12.675641] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.882 qpair failed and we were unable to recover it. 00:26:21.882 [2024-04-16 23:04:12.675795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.882 [2024-04-16 23:04:12.675936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.882 [2024-04-16 23:04:12.675964] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.882 qpair failed and we were unable to recover it. 00:26:21.882 [2024-04-16 23:04:12.676087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.882 [2024-04-16 23:04:12.676225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.882 [2024-04-16 23:04:12.676252] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.882 qpair failed and we were unable to recover it. 00:26:21.882 [2024-04-16 23:04:12.676366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.882 [2024-04-16 23:04:12.676507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.882 [2024-04-16 23:04:12.676531] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.882 qpair failed and we were unable to recover it. 00:26:21.882 [2024-04-16 23:04:12.676639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.882 [2024-04-16 23:04:12.676780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.882 [2024-04-16 23:04:12.676804] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.882 qpair failed and we were unable to recover it. 00:26:21.882 [2024-04-16 23:04:12.676942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.882 [2024-04-16 23:04:12.677053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.882 [2024-04-16 23:04:12.677078] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.882 qpair failed and we were unable to recover it. 00:26:21.882 [2024-04-16 23:04:12.677223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.882 [2024-04-16 23:04:12.677384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.882 [2024-04-16 23:04:12.677419] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.882 qpair failed and we were unable to recover it. 00:26:21.882 [2024-04-16 23:04:12.677593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.882 [2024-04-16 23:04:12.677724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.882 [2024-04-16 23:04:12.677749] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.882 qpair failed and we were unable to recover it. 00:26:21.882 [2024-04-16 23:04:12.677858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.882 [2024-04-16 23:04:12.677997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.882 [2024-04-16 23:04:12.678021] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.882 qpair failed and we were unable to recover it. 00:26:21.882 [2024-04-16 23:04:12.678161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.882 [2024-04-16 23:04:12.678351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.882 [2024-04-16 23:04:12.678377] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.882 qpair failed and we were unable to recover it. 00:26:21.882 [2024-04-16 23:04:12.678546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.882 [2024-04-16 23:04:12.678670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.882 [2024-04-16 23:04:12.678696] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.882 qpair failed and we were unable to recover it. 00:26:21.882 [2024-04-16 23:04:12.678871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.882 [2024-04-16 23:04:12.679036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.883 [2024-04-16 23:04:12.679060] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.883 qpair failed and we were unable to recover it. 00:26:21.883 [2024-04-16 23:04:12.679182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.883 [2024-04-16 23:04:12.679367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.883 [2024-04-16 23:04:12.679393] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.883 qpair failed and we were unable to recover it. 00:26:21.883 [2024-04-16 23:04:12.679541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.883 [2024-04-16 23:04:12.679648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.883 [2024-04-16 23:04:12.679672] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.883 qpair failed and we were unable to recover it. 00:26:21.883 [2024-04-16 23:04:12.679839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.883 [2024-04-16 23:04:12.679986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.883 [2024-04-16 23:04:12.680013] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.883 qpair failed and we were unable to recover it. 00:26:21.883 [2024-04-16 23:04:12.680200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.883 [2024-04-16 23:04:12.680370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.883 [2024-04-16 23:04:12.680394] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.883 qpair failed and we were unable to recover it. 00:26:21.883 [2024-04-16 23:04:12.680538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.883 [2024-04-16 23:04:12.680649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.883 [2024-04-16 23:04:12.680673] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.883 qpair failed and we were unable to recover it. 00:26:21.883 [2024-04-16 23:04:12.680819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.883 [2024-04-16 23:04:12.680935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.883 [2024-04-16 23:04:12.680960] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.883 qpair failed and we were unable to recover it. 00:26:21.883 [2024-04-16 23:04:12.681139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.883 [2024-04-16 23:04:12.681280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.883 [2024-04-16 23:04:12.681305] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.883 qpair failed and we were unable to recover it. 00:26:21.883 [2024-04-16 23:04:12.681425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.883 [2024-04-16 23:04:12.681587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.883 [2024-04-16 23:04:12.681615] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.883 qpair failed and we were unable to recover it. 00:26:21.883 [2024-04-16 23:04:12.681768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.883 [2024-04-16 23:04:12.681919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.883 [2024-04-16 23:04:12.681946] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.883 qpair failed and we were unable to recover it. 00:26:21.883 [2024-04-16 23:04:12.682084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.883 [2024-04-16 23:04:12.682241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.883 [2024-04-16 23:04:12.682266] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.883 qpair failed and we were unable to recover it. 00:26:21.883 [2024-04-16 23:04:12.682437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.883 [2024-04-16 23:04:12.682593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.883 [2024-04-16 23:04:12.682620] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.883 qpair failed and we were unable to recover it. 00:26:21.883 [2024-04-16 23:04:12.682780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.883 [2024-04-16 23:04:12.682971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.883 [2024-04-16 23:04:12.682998] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.883 qpair failed and we were unable to recover it. 00:26:21.883 [2024-04-16 23:04:12.683115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.883 [2024-04-16 23:04:12.683239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.883 [2024-04-16 23:04:12.683267] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.883 qpair failed and we were unable to recover it. 00:26:21.883 [2024-04-16 23:04:12.683412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.883 [2024-04-16 23:04:12.683526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.883 [2024-04-16 23:04:12.683551] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.883 qpair failed and we were unable to recover it. 00:26:21.883 [2024-04-16 23:04:12.683689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.883 [2024-04-16 23:04:12.683840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.883 [2024-04-16 23:04:12.683867] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.883 qpair failed and we were unable to recover it. 00:26:21.883 [2024-04-16 23:04:12.684011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.883 [2024-04-16 23:04:12.684188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.883 [2024-04-16 23:04:12.684213] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.883 qpair failed and we were unable to recover it. 00:26:21.883 [2024-04-16 23:04:12.684354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.883 [2024-04-16 23:04:12.684485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.883 [2024-04-16 23:04:12.684513] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.883 qpair failed and we were unable to recover it. 00:26:21.883 [2024-04-16 23:04:12.684647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.883 [2024-04-16 23:04:12.684796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.883 [2024-04-16 23:04:12.684822] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.883 qpair failed and we were unable to recover it. 00:26:21.883 [2024-04-16 23:04:12.684934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.883 [2024-04-16 23:04:12.685101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.883 [2024-04-16 23:04:12.685126] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.883 qpair failed and we were unable to recover it. 00:26:21.883 [2024-04-16 23:04:12.685284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.883 [2024-04-16 23:04:12.685406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.883 [2024-04-16 23:04:12.685430] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.883 qpair failed and we were unable to recover it. 00:26:21.883 [2024-04-16 23:04:12.685626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.883 [2024-04-16 23:04:12.685776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.883 [2024-04-16 23:04:12.685800] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.883 qpair failed and we were unable to recover it. 00:26:21.883 [2024-04-16 23:04:12.685934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.883 [2024-04-16 23:04:12.686080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.883 [2024-04-16 23:04:12.686110] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.883 qpair failed and we were unable to recover it. 00:26:21.883 [2024-04-16 23:04:12.686252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.883 [2024-04-16 23:04:12.686434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.883 [2024-04-16 23:04:12.686462] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.883 qpair failed and we were unable to recover it. 00:26:21.883 [2024-04-16 23:04:12.686630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.883 [2024-04-16 23:04:12.686766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.884 [2024-04-16 23:04:12.686791] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.884 qpair failed and we were unable to recover it. 00:26:21.884 [2024-04-16 23:04:12.686935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.884 [2024-04-16 23:04:12.687112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.884 [2024-04-16 23:04:12.687139] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.884 qpair failed and we were unable to recover it. 00:26:21.884 [2024-04-16 23:04:12.687291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.884 [2024-04-16 23:04:12.687437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.884 [2024-04-16 23:04:12.687461] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.884 qpair failed and we were unable to recover it. 00:26:21.884 [2024-04-16 23:04:12.687581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.884 [2024-04-16 23:04:12.687755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.884 [2024-04-16 23:04:12.687783] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.884 qpair failed and we were unable to recover it. 00:26:21.884 [2024-04-16 23:04:12.687947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.884 [2024-04-16 23:04:12.688118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.884 [2024-04-16 23:04:12.688142] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.884 qpair failed and we were unable to recover it. 00:26:21.884 [2024-04-16 23:04:12.688324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.884 [2024-04-16 23:04:12.688442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.884 [2024-04-16 23:04:12.688469] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.884 qpair failed and we were unable to recover it. 00:26:21.884 [2024-04-16 23:04:12.688628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.884 [2024-04-16 23:04:12.688739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.884 [2024-04-16 23:04:12.688763] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.884 qpair failed and we were unable to recover it. 00:26:21.884 [2024-04-16 23:04:12.688908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.884 [2024-04-16 23:04:12.689036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.884 [2024-04-16 23:04:12.689063] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.884 qpair failed and we were unable to recover it. 00:26:21.884 [2024-04-16 23:04:12.689235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.884 [2024-04-16 23:04:12.689348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.884 [2024-04-16 23:04:12.689376] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.884 qpair failed and we were unable to recover it. 00:26:21.884 [2024-04-16 23:04:12.689486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.884 [2024-04-16 23:04:12.689625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.884 [2024-04-16 23:04:12.689650] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.884 qpair failed and we were unable to recover it. 00:26:21.884 [2024-04-16 23:04:12.689816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.884 [2024-04-16 23:04:12.689920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.884 [2024-04-16 23:04:12.689944] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.884 qpair failed and we were unable to recover it. 00:26:21.884 [2024-04-16 23:04:12.690116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.884 [2024-04-16 23:04:12.690299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.884 [2024-04-16 23:04:12.690328] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.884 qpair failed and we were unable to recover it. 00:26:21.884 [2024-04-16 23:04:12.690476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.884 [2024-04-16 23:04:12.690644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.884 [2024-04-16 23:04:12.690705] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.884 qpair failed and we were unable to recover it. 00:26:21.884 [2024-04-16 23:04:12.690886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.884 [2024-04-16 23:04:12.691072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.884 [2024-04-16 23:04:12.691100] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.884 qpair failed and we were unable to recover it. 00:26:21.884 [2024-04-16 23:04:12.691250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.884 [2024-04-16 23:04:12.691394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.884 [2024-04-16 23:04:12.691435] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.884 qpair failed and we were unable to recover it. 00:26:21.884 [2024-04-16 23:04:12.691588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.884 [2024-04-16 23:04:12.691749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.884 [2024-04-16 23:04:12.691776] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.884 qpair failed and we were unable to recover it. 00:26:21.884 [2024-04-16 23:04:12.691910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.884 [2024-04-16 23:04:12.692063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.884 [2024-04-16 23:04:12.692090] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.884 qpair failed and we were unable to recover it. 00:26:21.884 [2024-04-16 23:04:12.692249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.884 [2024-04-16 23:04:12.692405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.884 [2024-04-16 23:04:12.692432] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.884 qpair failed and we were unable to recover it. 00:26:21.884 [2024-04-16 23:04:12.692596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.884 [2024-04-16 23:04:12.692741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.884 [2024-04-16 23:04:12.692766] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.884 qpair failed and we were unable to recover it. 00:26:21.884 [2024-04-16 23:04:12.692912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.884 [2024-04-16 23:04:12.693079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.884 [2024-04-16 23:04:12.693106] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.884 qpair failed and we were unable to recover it. 00:26:21.884 [2024-04-16 23:04:12.693252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.884 [2024-04-16 23:04:12.693375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.884 [2024-04-16 23:04:12.693402] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.884 qpair failed and we were unable to recover it. 00:26:21.884 [2024-04-16 23:04:12.693556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.884 [2024-04-16 23:04:12.693702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.884 [2024-04-16 23:04:12.693729] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.884 qpair failed and we were unable to recover it. 00:26:21.884 [2024-04-16 23:04:12.693885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.884 [2024-04-16 23:04:12.694028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.884 [2024-04-16 23:04:12.694053] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.884 qpair failed and we were unable to recover it. 00:26:21.884 [2024-04-16 23:04:12.694192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.884 [2024-04-16 23:04:12.694347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.884 [2024-04-16 23:04:12.694374] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.884 qpair failed and we were unable to recover it. 00:26:21.884 [2024-04-16 23:04:12.694502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.884 [2024-04-16 23:04:12.694647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.884 [2024-04-16 23:04:12.694674] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.884 qpair failed and we were unable to recover it. 00:26:21.884 [2024-04-16 23:04:12.694822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.884 [2024-04-16 23:04:12.694939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.884 [2024-04-16 23:04:12.694968] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.884 qpair failed and we were unable to recover it. 00:26:21.884 [2024-04-16 23:04:12.695123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.884 [2024-04-16 23:04:12.695291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.884 [2024-04-16 23:04:12.695334] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.884 qpair failed and we were unable to recover it. 00:26:21.884 [2024-04-16 23:04:12.695516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.884 [2024-04-16 23:04:12.695635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.885 [2024-04-16 23:04:12.695662] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.885 qpair failed and we were unable to recover it. 00:26:21.885 [2024-04-16 23:04:12.695780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.885 [2024-04-16 23:04:12.695953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.885 [2024-04-16 23:04:12.695978] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.885 qpair failed and we were unable to recover it. 00:26:21.885 [2024-04-16 23:04:12.696129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.885 [2024-04-16 23:04:12.696305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.885 [2024-04-16 23:04:12.696333] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.885 qpair failed and we were unable to recover it. 00:26:21.885 [2024-04-16 23:04:12.696490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.885 [2024-04-16 23:04:12.696654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.885 [2024-04-16 23:04:12.696696] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.885 qpair failed and we were unable to recover it. 00:26:21.885 [2024-04-16 23:04:12.696850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.885 [2024-04-16 23:04:12.696980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.885 [2024-04-16 23:04:12.697007] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.885 qpair failed and we were unable to recover it. 00:26:21.885 [2024-04-16 23:04:12.697193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.885 [2024-04-16 23:04:12.697337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.885 [2024-04-16 23:04:12.697399] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.885 qpair failed and we were unable to recover it. 00:26:21.885 [2024-04-16 23:04:12.697579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.885 [2024-04-16 23:04:12.697696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.885 [2024-04-16 23:04:12.697723] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.885 qpair failed and we were unable to recover it. 00:26:21.885 [2024-04-16 23:04:12.697847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.885 [2024-04-16 23:04:12.697952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.885 [2024-04-16 23:04:12.697977] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.885 qpair failed and we were unable to recover it. 00:26:21.885 [2024-04-16 23:04:12.698127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.885 [2024-04-16 23:04:12.698253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.885 [2024-04-16 23:04:12.698281] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.885 qpair failed and we were unable to recover it. 00:26:21.885 [2024-04-16 23:04:12.698472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.885 [2024-04-16 23:04:12.698641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.885 [2024-04-16 23:04:12.698665] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.885 qpair failed and we were unable to recover it. 00:26:21.885 [2024-04-16 23:04:12.698824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.885 [2024-04-16 23:04:12.698946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.885 [2024-04-16 23:04:12.698975] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.885 qpair failed and we were unable to recover it. 00:26:21.885 [2024-04-16 23:04:12.699130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.885 [2024-04-16 23:04:12.699272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.885 [2024-04-16 23:04:12.699298] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.885 qpair failed and we were unable to recover it. 00:26:21.885 [2024-04-16 23:04:12.699432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.885 [2024-04-16 23:04:12.699573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.885 [2024-04-16 23:04:12.699598] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.885 qpair failed and we were unable to recover it. 00:26:21.885 [2024-04-16 23:04:12.699754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.885 [2024-04-16 23:04:12.699873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.885 [2024-04-16 23:04:12.699900] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.885 qpair failed and we were unable to recover it. 00:26:21.885 [2024-04-16 23:04:12.700014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.885 [2024-04-16 23:04:12.700170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.885 [2024-04-16 23:04:12.700204] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.885 qpair failed and we were unable to recover it. 00:26:21.885 [2024-04-16 23:04:12.700336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.885 [2024-04-16 23:04:12.700502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.885 [2024-04-16 23:04:12.700527] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.885 qpair failed and we were unable to recover it. 00:26:21.885 [2024-04-16 23:04:12.700673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.885 [2024-04-16 23:04:12.700802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.885 [2024-04-16 23:04:12.700829] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.885 qpair failed and we were unable to recover it. 00:26:21.885 [2024-04-16 23:04:12.700978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.885 [2024-04-16 23:04:12.701186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.885 [2024-04-16 23:04:12.701211] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.885 qpair failed and we were unable to recover it. 00:26:21.885 [2024-04-16 23:04:12.701353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.885 [2024-04-16 23:04:12.701501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.885 [2024-04-16 23:04:12.701528] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.885 qpair failed and we were unable to recover it. 00:26:21.885 [2024-04-16 23:04:12.701693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.885 [2024-04-16 23:04:12.701857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.885 [2024-04-16 23:04:12.701881] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.885 qpair failed and we were unable to recover it. 00:26:21.885 [2024-04-16 23:04:12.701990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.885 [2024-04-16 23:04:12.702131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.885 [2024-04-16 23:04:12.702155] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.885 qpair failed and we were unable to recover it. 00:26:21.885 [2024-04-16 23:04:12.702311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.885 [2024-04-16 23:04:12.702460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.885 [2024-04-16 23:04:12.702487] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.885 qpair failed and we were unable to recover it. 00:26:21.885 [2024-04-16 23:04:12.702645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.885 [2024-04-16 23:04:12.702775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.885 [2024-04-16 23:04:12.702804] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.885 qpair failed and we were unable to recover it. 00:26:21.885 [2024-04-16 23:04:12.702960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.885 [2024-04-16 23:04:12.703103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.885 [2024-04-16 23:04:12.703127] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.885 qpair failed and we were unable to recover it. 00:26:21.885 [2024-04-16 23:04:12.703272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.885 [2024-04-16 23:04:12.703413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.885 [2024-04-16 23:04:12.703442] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.885 qpair failed and we were unable to recover it. 00:26:21.885 [2024-04-16 23:04:12.703592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.885 [2024-04-16 23:04:12.703742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.885 [2024-04-16 23:04:12.703769] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.885 qpair failed and we were unable to recover it. 00:26:21.885 [2024-04-16 23:04:12.703925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.885 [2024-04-16 23:04:12.704119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.885 [2024-04-16 23:04:12.704144] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.885 qpair failed and we were unable to recover it. 00:26:21.886 [2024-04-16 23:04:12.704295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.886 [2024-04-16 23:04:12.704410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.886 [2024-04-16 23:04:12.704435] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.886 qpair failed and we were unable to recover it. 00:26:21.886 [2024-04-16 23:04:12.704612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.886 [2024-04-16 23:04:12.704742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.886 [2024-04-16 23:04:12.704766] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.886 qpair failed and we were unable to recover it. 00:26:21.886 [2024-04-16 23:04:12.704933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.886 [2024-04-16 23:04:12.705089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.886 [2024-04-16 23:04:12.705116] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.886 qpair failed and we were unable to recover it. 00:26:21.886 [2024-04-16 23:04:12.705285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.886 [2024-04-16 23:04:12.705393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.886 [2024-04-16 23:04:12.705418] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.886 qpair failed and we were unable to recover it. 00:26:21.886 [2024-04-16 23:04:12.705527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.886 [2024-04-16 23:04:12.705642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.886 [2024-04-16 23:04:12.705666] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.886 qpair failed and we were unable to recover it. 00:26:21.886 [2024-04-16 23:04:12.705838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.886 [2024-04-16 23:04:12.705968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.886 [2024-04-16 23:04:12.705999] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.886 qpair failed and we were unable to recover it. 00:26:21.886 [2024-04-16 23:04:12.706123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.886 [2024-04-16 23:04:12.706283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.886 [2024-04-16 23:04:12.706311] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.886 qpair failed and we were unable to recover it. 00:26:21.886 [2024-04-16 23:04:12.706441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.886 [2024-04-16 23:04:12.706574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.886 [2024-04-16 23:04:12.706602] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.886 qpair failed and we were unable to recover it. 00:26:21.886 [2024-04-16 23:04:12.706764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.886 [2024-04-16 23:04:12.706904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.886 [2024-04-16 23:04:12.706928] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.886 qpair failed and we were unable to recover it. 00:26:21.886 [2024-04-16 23:04:12.707063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.886 [2024-04-16 23:04:12.707248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.886 [2024-04-16 23:04:12.707275] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.886 qpair failed and we were unable to recover it. 00:26:21.886 [2024-04-16 23:04:12.707417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.886 [2024-04-16 23:04:12.707575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.886 [2024-04-16 23:04:12.707602] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.886 qpair failed and we were unable to recover it. 00:26:21.886 [2024-04-16 23:04:12.707759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.886 [2024-04-16 23:04:12.707879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.886 [2024-04-16 23:04:12.707906] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.886 qpair failed and we were unable to recover it. 00:26:21.886 [2024-04-16 23:04:12.708071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.886 [2024-04-16 23:04:12.708208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.886 [2024-04-16 23:04:12.708233] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.886 qpair failed and we were unable to recover it. 00:26:21.886 [2024-04-16 23:04:12.708398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.886 [2024-04-16 23:04:12.708517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.886 [2024-04-16 23:04:12.708544] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.886 qpair failed and we were unable to recover it. 00:26:21.886 [2024-04-16 23:04:12.708697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.886 [2024-04-16 23:04:12.708845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.886 [2024-04-16 23:04:12.708872] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.886 qpair failed and we were unable to recover it. 00:26:21.886 [2024-04-16 23:04:12.709000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.886 [2024-04-16 23:04:12.709126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.886 [2024-04-16 23:04:12.709153] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.886 qpair failed and we were unable to recover it. 00:26:21.886 [2024-04-16 23:04:12.709295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.886 [2024-04-16 23:04:12.709434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.886 [2024-04-16 23:04:12.709458] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.886 qpair failed and we were unable to recover it. 00:26:21.886 [2024-04-16 23:04:12.709624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.886 [2024-04-16 23:04:12.709751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.886 [2024-04-16 23:04:12.709778] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.886 qpair failed and we were unable to recover it. 00:26:21.886 [2024-04-16 23:04:12.709936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.886 [2024-04-16 23:04:12.710051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.886 [2024-04-16 23:04:12.710078] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.886 qpair failed and we were unable to recover it. 00:26:21.886 [2024-04-16 23:04:12.710203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.886 [2024-04-16 23:04:12.710362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.886 [2024-04-16 23:04:12.710387] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.886 qpair failed and we were unable to recover it. 00:26:21.886 [2024-04-16 23:04:12.710561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.886 [2024-04-16 23:04:12.710668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.886 [2024-04-16 23:04:12.710708] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.886 qpair failed and we were unable to recover it. 00:26:21.886 [2024-04-16 23:04:12.710852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.886 [2024-04-16 23:04:12.710996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.886 [2024-04-16 23:04:12.711023] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.886 qpair failed and we were unable to recover it. 00:26:21.886 [2024-04-16 23:04:12.711168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.886 [2024-04-16 23:04:12.711297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.886 [2024-04-16 23:04:12.711324] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.886 qpair failed and we were unable to recover it. 00:26:21.886 [2024-04-16 23:04:12.711473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.886 [2024-04-16 23:04:12.711637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.886 [2024-04-16 23:04:12.711700] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.886 qpair failed and we were unable to recover it. 00:26:21.886 [2024-04-16 23:04:12.711864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.886 [2024-04-16 23:04:12.711974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.886 [2024-04-16 23:04:12.711999] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.886 qpair failed and we were unable to recover it. 00:26:21.886 [2024-04-16 23:04:12.712137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.886 [2024-04-16 23:04:12.712298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.886 [2024-04-16 23:04:12.712326] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.886 qpair failed and we were unable to recover it. 00:26:21.886 [2024-04-16 23:04:12.712447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.887 [2024-04-16 23:04:12.712578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.887 [2024-04-16 23:04:12.712603] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.887 qpair failed and we were unable to recover it. 00:26:21.887 [2024-04-16 23:04:12.712759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.887 [2024-04-16 23:04:12.712892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.887 [2024-04-16 23:04:12.712919] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.887 qpair failed and we were unable to recover it. 00:26:21.887 [2024-04-16 23:04:12.713073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.887 [2024-04-16 23:04:12.713238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.887 [2024-04-16 23:04:12.713281] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.887 qpair failed and we were unable to recover it. 00:26:21.887 [2024-04-16 23:04:12.713429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.887 [2024-04-16 23:04:12.713583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.887 [2024-04-16 23:04:12.713610] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.887 qpair failed and we were unable to recover it. 00:26:21.887 [2024-04-16 23:04:12.713763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.887 [2024-04-16 23:04:12.713879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.887 [2024-04-16 23:04:12.713907] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.887 qpair failed and we were unable to recover it. 00:26:21.887 [2024-04-16 23:04:12.714029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.887 [2024-04-16 23:04:12.714146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.887 [2024-04-16 23:04:12.714180] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.887 qpair failed and we were unable to recover it. 00:26:21.887 [2024-04-16 23:04:12.714315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.887 [2024-04-16 23:04:12.714432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.887 [2024-04-16 23:04:12.714457] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.887 qpair failed and we were unable to recover it. 00:26:21.887 [2024-04-16 23:04:12.714603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.887 [2024-04-16 23:04:12.714758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.887 [2024-04-16 23:04:12.714786] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.887 qpair failed and we were unable to recover it. 00:26:21.887 [2024-04-16 23:04:12.714910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.887 [2024-04-16 23:04:12.715103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.887 [2024-04-16 23:04:12.715130] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.887 qpair failed and we were unable to recover it. 00:26:21.887 [2024-04-16 23:04:12.715265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.887 [2024-04-16 23:04:12.715412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.887 [2024-04-16 23:04:12.715437] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.887 qpair failed and we were unable to recover it. 00:26:21.887 [2024-04-16 23:04:12.715556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.887 [2024-04-16 23:04:12.715695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.887 [2024-04-16 23:04:12.715720] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.887 qpair failed and we were unable to recover it. 00:26:21.887 [2024-04-16 23:04:12.715916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.887 [2024-04-16 23:04:12.716039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.887 [2024-04-16 23:04:12.716066] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.887 qpair failed and we were unable to recover it. 00:26:21.887 [2024-04-16 23:04:12.716197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.887 [2024-04-16 23:04:12.716382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.887 [2024-04-16 23:04:12.716410] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.887 qpair failed and we were unable to recover it. 00:26:21.887 [2024-04-16 23:04:12.716544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.887 [2024-04-16 23:04:12.716685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.887 [2024-04-16 23:04:12.716709] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.887 qpair failed and we were unable to recover it. 00:26:21.887 [2024-04-16 23:04:12.716852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.887 [2024-04-16 23:04:12.717021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.887 [2024-04-16 23:04:12.717045] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.887 qpair failed and we were unable to recover it. 00:26:21.887 [2024-04-16 23:04:12.717171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.887 [2024-04-16 23:04:12.717309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.887 [2024-04-16 23:04:12.717336] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.887 qpair failed and we were unable to recover it. 00:26:21.887 [2024-04-16 23:04:12.717517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.887 [2024-04-16 23:04:12.717675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.887 [2024-04-16 23:04:12.717702] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.887 qpair failed and we were unable to recover it. 00:26:21.887 [2024-04-16 23:04:12.717882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.887 [2024-04-16 23:04:12.717995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.887 [2024-04-16 23:04:12.718023] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.887 qpair failed and we were unable to recover it. 00:26:21.887 [2024-04-16 23:04:12.718198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.887 [2024-04-16 23:04:12.718344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.887 [2024-04-16 23:04:12.718388] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.887 qpair failed and we were unable to recover it. 00:26:21.887 [2024-04-16 23:04:12.718522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.887 [2024-04-16 23:04:12.718643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.887 [2024-04-16 23:04:12.718670] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.887 qpair failed and we were unable to recover it. 00:26:21.887 [2024-04-16 23:04:12.718801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.887 [2024-04-16 23:04:12.718987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.887 [2024-04-16 23:04:12.719015] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.887 qpair failed and we were unable to recover it. 00:26:21.887 [2024-04-16 23:04:12.719148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.887 [2024-04-16 23:04:12.719319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.887 [2024-04-16 23:04:12.719348] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.887 qpair failed and we were unable to recover it. 00:26:21.887 [2024-04-16 23:04:12.719517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.887 [2024-04-16 23:04:12.719643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.888 [2024-04-16 23:04:12.719667] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.888 qpair failed and we were unable to recover it. 00:26:21.888 [2024-04-16 23:04:12.719806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.888 [2024-04-16 23:04:12.719960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.888 [2024-04-16 23:04:12.719987] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.888 qpair failed and we were unable to recover it. 00:26:21.888 [2024-04-16 23:04:12.720138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.888 [2024-04-16 23:04:12.720290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.888 [2024-04-16 23:04:12.720318] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.888 qpair failed and we were unable to recover it. 00:26:21.888 [2024-04-16 23:04:12.720497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.888 [2024-04-16 23:04:12.720620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.888 [2024-04-16 23:04:12.720649] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.888 qpair failed and we were unable to recover it. 00:26:21.888 [2024-04-16 23:04:12.720780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.888 [2024-04-16 23:04:12.720926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.888 [2024-04-16 23:04:12.720950] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.888 qpair failed and we were unable to recover it. 00:26:21.888 [2024-04-16 23:04:12.721092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.888 [2024-04-16 23:04:12.721204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.888 [2024-04-16 23:04:12.721229] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.888 qpair failed and we were unable to recover it. 00:26:21.888 [2024-04-16 23:04:12.721335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.888 [2024-04-16 23:04:12.721493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.888 [2024-04-16 23:04:12.721521] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.888 qpair failed and we were unable to recover it. 00:26:21.888 [2024-04-16 23:04:12.721682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.888 [2024-04-16 23:04:12.721838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.888 [2024-04-16 23:04:12.721865] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.888 qpair failed and we were unable to recover it. 00:26:21.888 [2024-04-16 23:04:12.721999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.888 [2024-04-16 23:04:12.722144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.888 [2024-04-16 23:04:12.722172] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.888 qpair failed and we were unable to recover it. 00:26:21.888 [2024-04-16 23:04:12.722377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.888 [2024-04-16 23:04:12.722515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.888 [2024-04-16 23:04:12.722541] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.888 qpair failed and we were unable to recover it. 00:26:21.888 [2024-04-16 23:04:12.722701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.888 [2024-04-16 23:04:12.722840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.888 [2024-04-16 23:04:12.722868] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.888 qpair failed and we were unable to recover it. 00:26:21.888 [2024-04-16 23:04:12.723049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.888 [2024-04-16 23:04:12.723162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.888 [2024-04-16 23:04:12.723199] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.888 qpair failed and we were unable to recover it. 00:26:21.888 [2024-04-16 23:04:12.723368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.888 [2024-04-16 23:04:12.723555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.888 [2024-04-16 23:04:12.723616] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.888 qpair failed and we were unable to recover it. 00:26:21.888 [2024-04-16 23:04:12.723744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.888 [2024-04-16 23:04:12.723892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.888 [2024-04-16 23:04:12.723920] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.888 qpair failed and we were unable to recover it. 00:26:21.888 [2024-04-16 23:04:12.724040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.888 [2024-04-16 23:04:12.724232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.888 [2024-04-16 23:04:12.724258] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.888 qpair failed and we were unable to recover it. 00:26:21.888 [2024-04-16 23:04:12.724403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.888 [2024-04-16 23:04:12.724567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.888 [2024-04-16 23:04:12.724594] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.888 qpair failed and we were unable to recover it. 00:26:21.888 [2024-04-16 23:04:12.724730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.888 [2024-04-16 23:04:12.724905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.888 [2024-04-16 23:04:12.724929] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.888 qpair failed and we were unable to recover it. 00:26:21.888 [2024-04-16 23:04:12.725064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.888 [2024-04-16 23:04:12.725189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.888 [2024-04-16 23:04:12.725217] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.888 qpair failed and we were unable to recover it. 00:26:21.888 [2024-04-16 23:04:12.725385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.888 [2024-04-16 23:04:12.725525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.888 [2024-04-16 23:04:12.725550] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.888 qpair failed and we were unable to recover it. 00:26:21.888 [2024-04-16 23:04:12.725703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.888 [2024-04-16 23:04:12.725845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.888 [2024-04-16 23:04:12.725869] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.888 qpair failed and we were unable to recover it. 00:26:21.888 [2024-04-16 23:04:12.725982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.888 [2024-04-16 23:04:12.726122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.888 [2024-04-16 23:04:12.726146] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.888 qpair failed and we were unable to recover it. 00:26:21.888 [2024-04-16 23:04:12.726367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.888 [2024-04-16 23:04:12.726473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.888 [2024-04-16 23:04:12.726498] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.888 qpair failed and we were unable to recover it. 00:26:21.888 [2024-04-16 23:04:12.726655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.888 [2024-04-16 23:04:12.726802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.888 [2024-04-16 23:04:12.726829] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.888 qpair failed and we were unable to recover it. 00:26:21.888 [2024-04-16 23:04:12.727013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.888 [2024-04-16 23:04:12.727187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.888 [2024-04-16 23:04:12.727213] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.888 qpair failed and we were unable to recover it. 00:26:21.888 [2024-04-16 23:04:12.727359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.888 [2024-04-16 23:04:12.727471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.888 [2024-04-16 23:04:12.727496] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.888 qpair failed and we were unable to recover it. 00:26:21.888 [2024-04-16 23:04:12.727638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.888 [2024-04-16 23:04:12.727769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.888 [2024-04-16 23:04:12.727794] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.888 qpair failed and we were unable to recover it. 00:26:21.889 [2024-04-16 23:04:12.727934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.889 [2024-04-16 23:04:12.728067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.889 [2024-04-16 23:04:12.728092] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.889 qpair failed and we were unable to recover it. 00:26:21.889 [2024-04-16 23:04:12.728215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.889 [2024-04-16 23:04:12.728351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.889 [2024-04-16 23:04:12.728379] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.889 qpair failed and we were unable to recover it. 00:26:21.889 [2024-04-16 23:04:12.728543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.889 [2024-04-16 23:04:12.728685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.889 [2024-04-16 23:04:12.728710] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.889 qpair failed and we were unable to recover it. 00:26:21.889 [2024-04-16 23:04:12.728851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.889 [2024-04-16 23:04:12.729031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.889 [2024-04-16 23:04:12.729059] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.889 qpair failed and we were unable to recover it. 00:26:21.889 [2024-04-16 23:04:12.729207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.889 [2024-04-16 23:04:12.729379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.889 [2024-04-16 23:04:12.729403] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.889 qpair failed and we were unable to recover it. 00:26:21.889 [2024-04-16 23:04:12.729507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.889 [2024-04-16 23:04:12.729616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.889 [2024-04-16 23:04:12.729643] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.889 qpair failed and we were unable to recover it. 00:26:21.889 [2024-04-16 23:04:12.729757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.889 [2024-04-16 23:04:12.729914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.889 [2024-04-16 23:04:12.729940] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.889 qpair failed and we were unable to recover it. 00:26:21.889 [2024-04-16 23:04:12.730048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.889 [2024-04-16 23:04:12.730203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.889 [2024-04-16 23:04:12.730229] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.889 qpair failed and we were unable to recover it. 00:26:21.889 [2024-04-16 23:04:12.730367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.889 [2024-04-16 23:04:12.730534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.889 [2024-04-16 23:04:12.730564] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.889 qpair failed and we were unable to recover it. 00:26:21.889 [2024-04-16 23:04:12.730732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.889 [2024-04-16 23:04:12.730853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.889 [2024-04-16 23:04:12.730881] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.889 qpair failed and we were unable to recover it. 00:26:21.889 [2024-04-16 23:04:12.731040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.889 [2024-04-16 23:04:12.731210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.889 [2024-04-16 23:04:12.731236] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.889 qpair failed and we were unable to recover it. 00:26:21.889 [2024-04-16 23:04:12.731401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.889 [2024-04-16 23:04:12.731551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.889 [2024-04-16 23:04:12.731580] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.889 qpair failed and we were unable to recover it. 00:26:21.889 [2024-04-16 23:04:12.731780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.889 [2024-04-16 23:04:12.731918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.889 [2024-04-16 23:04:12.731943] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.889 qpair failed and we were unable to recover it. 00:26:21.889 [2024-04-16 23:04:12.732093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.889 [2024-04-16 23:04:12.732245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.889 [2024-04-16 23:04:12.732273] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.889 qpair failed and we were unable to recover it. 00:26:21.889 [2024-04-16 23:04:12.732433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.889 [2024-04-16 23:04:12.732545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.889 [2024-04-16 23:04:12.732569] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.889 qpair failed and we were unable to recover it. 00:26:21.889 [2024-04-16 23:04:12.732729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.889 [2024-04-16 23:04:12.732887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.889 [2024-04-16 23:04:12.732915] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.889 qpair failed and we were unable to recover it. 00:26:21.889 [2024-04-16 23:04:12.733114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.889 [2024-04-16 23:04:12.733257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.889 [2024-04-16 23:04:12.733284] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.889 qpair failed and we were unable to recover it. 00:26:21.889 [2024-04-16 23:04:12.733496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.889 [2024-04-16 23:04:12.733661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.889 [2024-04-16 23:04:12.733701] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.889 qpair failed and we were unable to recover it. 00:26:21.889 [2024-04-16 23:04:12.733866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.889 [2024-04-16 23:04:12.734010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.889 [2024-04-16 23:04:12.734036] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.889 qpair failed and we were unable to recover it. 00:26:21.889 [2024-04-16 23:04:12.734210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.889 [2024-04-16 23:04:12.734356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.889 [2024-04-16 23:04:12.734380] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.889 qpair failed and we were unable to recover it. 00:26:21.889 [2024-04-16 23:04:12.734523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.889 [2024-04-16 23:04:12.734693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.889 [2024-04-16 23:04:12.734717] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.889 qpair failed and we were unable to recover it. 00:26:21.889 [2024-04-16 23:04:12.734913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.889 [2024-04-16 23:04:12.735031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.889 [2024-04-16 23:04:12.735055] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.889 qpair failed and we were unable to recover it. 00:26:21.889 [2024-04-16 23:04:12.735191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.889 [2024-04-16 23:04:12.735326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.889 [2024-04-16 23:04:12.735367] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.889 qpair failed and we were unable to recover it. 00:26:21.889 [2024-04-16 23:04:12.735530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.889 [2024-04-16 23:04:12.735679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.889 [2024-04-16 23:04:12.735707] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.889 qpair failed and we were unable to recover it. 00:26:21.889 [2024-04-16 23:04:12.735858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.889 [2024-04-16 23:04:12.736012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.889 [2024-04-16 23:04:12.736039] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.889 qpair failed and we were unable to recover it. 00:26:21.889 [2024-04-16 23:04:12.736220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.889 [2024-04-16 23:04:12.736389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.889 [2024-04-16 23:04:12.736413] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.889 qpair failed and we were unable to recover it. 00:26:21.890 [2024-04-16 23:04:12.736557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.890 [2024-04-16 23:04:12.736700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.890 [2024-04-16 23:04:12.736741] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.890 qpair failed and we were unable to recover it. 00:26:21.890 [2024-04-16 23:04:12.736932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.890 [2024-04-16 23:04:12.737035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.890 [2024-04-16 23:04:12.737059] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.890 qpair failed and we were unable to recover it. 00:26:21.890 [2024-04-16 23:04:12.737166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.890 [2024-04-16 23:04:12.737341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.890 [2024-04-16 23:04:12.737366] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.890 qpair failed and we were unable to recover it. 00:26:21.890 [2024-04-16 23:04:12.737541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.890 [2024-04-16 23:04:12.737713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.890 [2024-04-16 23:04:12.737739] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.890 qpair failed and we were unable to recover it. 00:26:21.890 [2024-04-16 23:04:12.737882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.890 [2024-04-16 23:04:12.738018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.890 [2024-04-16 23:04:12.738042] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.890 qpair failed and we were unable to recover it. 00:26:21.890 [2024-04-16 23:04:12.738209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.890 [2024-04-16 23:04:12.738349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.890 [2024-04-16 23:04:12.738377] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.890 qpair failed and we were unable to recover it. 00:26:21.890 [2024-04-16 23:04:12.738499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.890 [2024-04-16 23:04:12.738648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.890 [2024-04-16 23:04:12.738676] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.890 qpair failed and we were unable to recover it. 00:26:21.890 [2024-04-16 23:04:12.738833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.890 [2024-04-16 23:04:12.738990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.890 [2024-04-16 23:04:12.739023] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.890 qpair failed and we were unable to recover it. 00:26:21.890 [2024-04-16 23:04:12.739191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.890 [2024-04-16 23:04:12.739310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.890 [2024-04-16 23:04:12.739335] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.890 qpair failed and we were unable to recover it. 00:26:21.890 [2024-04-16 23:04:12.739470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.890 [2024-04-16 23:04:12.739656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.890 [2024-04-16 23:04:12.739683] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.890 qpair failed and we were unable to recover it. 00:26:21.890 [2024-04-16 23:04:12.739826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.890 [2024-04-16 23:04:12.739968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.890 [2024-04-16 23:04:12.739993] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.890 qpair failed and we were unable to recover it. 00:26:21.890 [2024-04-16 23:04:12.740127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.890 [2024-04-16 23:04:12.740258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.890 [2024-04-16 23:04:12.740286] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.890 qpair failed and we were unable to recover it. 00:26:21.890 [2024-04-16 23:04:12.740422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.890 [2024-04-16 23:04:12.740564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.890 [2024-04-16 23:04:12.740589] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.890 qpair failed and we were unable to recover it. 00:26:21.890 [2024-04-16 23:04:12.740692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.890 [2024-04-16 23:04:12.740828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.890 [2024-04-16 23:04:12.740852] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.890 qpair failed and we were unable to recover it. 00:26:21.890 [2024-04-16 23:04:12.741015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.890 [2024-04-16 23:04:12.741129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.890 [2024-04-16 23:04:12.741157] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.890 qpair failed and we were unable to recover it. 00:26:21.890 [2024-04-16 23:04:12.741313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.890 [2024-04-16 23:04:12.741425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.890 [2024-04-16 23:04:12.741451] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.890 qpair failed and we were unable to recover it. 00:26:21.890 [2024-04-16 23:04:12.741586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.890 [2024-04-16 23:04:12.741751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.890 [2024-04-16 23:04:12.741793] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.890 qpair failed and we were unable to recover it. 00:26:21.890 [2024-04-16 23:04:12.741939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.890 [2024-04-16 23:04:12.742104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.890 [2024-04-16 23:04:12.742129] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.890 qpair failed and we were unable to recover it. 00:26:21.890 [2024-04-16 23:04:12.742261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.890 [2024-04-16 23:04:12.742370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.890 [2024-04-16 23:04:12.742396] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.890 qpair failed and we were unable to recover it. 00:26:21.890 [2024-04-16 23:04:12.742535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.890 [2024-04-16 23:04:12.742687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.890 [2024-04-16 23:04:12.742717] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.890 qpair failed and we were unable to recover it. 00:26:21.890 [2024-04-16 23:04:12.742881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.890 [2024-04-16 23:04:12.742992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.890 [2024-04-16 23:04:12.743017] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.890 qpair failed and we were unable to recover it. 00:26:21.890 [2024-04-16 23:04:12.743154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.890 [2024-04-16 23:04:12.743358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.890 [2024-04-16 23:04:12.743386] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.890 qpair failed and we were unable to recover it. 00:26:21.890 [2024-04-16 23:04:12.743546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.890 [2024-04-16 23:04:12.743668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.890 [2024-04-16 23:04:12.743696] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.890 qpair failed and we were unable to recover it. 00:26:21.890 [2024-04-16 23:04:12.743859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.890 [2024-04-16 23:04:12.743978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.890 [2024-04-16 23:04:12.744004] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.890 qpair failed and we were unable to recover it. 00:26:21.890 [2024-04-16 23:04:12.744113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.890 [2024-04-16 23:04:12.744262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.890 [2024-04-16 23:04:12.744287] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.890 qpair failed and we were unable to recover it. 00:26:21.890 [2024-04-16 23:04:12.744433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.890 [2024-04-16 23:04:12.744642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.890 [2024-04-16 23:04:12.744667] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.890 qpair failed and we were unable to recover it. 00:26:21.890 [2024-04-16 23:04:12.744778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.890 [2024-04-16 23:04:12.744890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.890 [2024-04-16 23:04:12.744931] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.890 qpair failed and we were unable to recover it. 00:26:21.890 [2024-04-16 23:04:12.745116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.891 [2024-04-16 23:04:12.745275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.891 [2024-04-16 23:04:12.745303] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.891 qpair failed and we were unable to recover it. 00:26:21.891 [2024-04-16 23:04:12.745464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.891 [2024-04-16 23:04:12.745612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.891 [2024-04-16 23:04:12.745654] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.891 qpair failed and we were unable to recover it. 00:26:21.891 [2024-04-16 23:04:12.745807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.891 [2024-04-16 23:04:12.745943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.891 [2024-04-16 23:04:12.745968] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.891 qpair failed and we were unable to recover it. 00:26:21.891 [2024-04-16 23:04:12.746085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.891 [2024-04-16 23:04:12.746224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.891 [2024-04-16 23:04:12.746252] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.891 qpair failed and we were unable to recover it. 00:26:21.891 [2024-04-16 23:04:12.746445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.891 [2024-04-16 23:04:12.746580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.891 [2024-04-16 23:04:12.746605] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.891 qpair failed and we were unable to recover it. 00:26:21.891 [2024-04-16 23:04:12.746713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.891 [2024-04-16 23:04:12.746827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.891 [2024-04-16 23:04:12.746852] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.891 qpair failed and we were unable to recover it. 00:26:21.891 [2024-04-16 23:04:12.746994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.891 [2024-04-16 23:04:12.747160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.891 [2024-04-16 23:04:12.747191] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.891 qpair failed and we were unable to recover it. 00:26:21.891 [2024-04-16 23:04:12.747311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.891 [2024-04-16 23:04:12.747450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.891 [2024-04-16 23:04:12.747475] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.891 qpair failed and we were unable to recover it. 00:26:21.891 [2024-04-16 23:04:12.747586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.891 [2024-04-16 23:04:12.747703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.891 [2024-04-16 23:04:12.747727] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.891 qpair failed and we were unable to recover it. 00:26:21.891 [2024-04-16 23:04:12.747863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.891 [2024-04-16 23:04:12.747994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.891 [2024-04-16 23:04:12.748019] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.891 qpair failed and we were unable to recover it. 00:26:21.891 [2024-04-16 23:04:12.748133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.891 [2024-04-16 23:04:12.748250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.891 [2024-04-16 23:04:12.748276] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.891 qpair failed and we were unable to recover it. 00:26:21.891 [2024-04-16 23:04:12.748457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.891 [2024-04-16 23:04:12.748591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.891 [2024-04-16 23:04:12.748616] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.891 qpair failed and we were unable to recover it. 00:26:21.891 [2024-04-16 23:04:12.748797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.891 [2024-04-16 23:04:12.748962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.891 [2024-04-16 23:04:12.748987] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.891 qpair failed and we were unable to recover it. 00:26:21.891 [2024-04-16 23:04:12.749095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.891 [2024-04-16 23:04:12.749230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.891 [2024-04-16 23:04:12.749258] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.891 qpair failed and we were unable to recover it. 00:26:21.891 [2024-04-16 23:04:12.749377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.891 [2024-04-16 23:04:12.749489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.891 [2024-04-16 23:04:12.749514] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.891 qpair failed and we were unable to recover it. 00:26:21.891 [2024-04-16 23:04:12.749621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.891 [2024-04-16 23:04:12.749747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.891 [2024-04-16 23:04:12.749774] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.891 qpair failed and we were unable to recover it. 00:26:21.891 [2024-04-16 23:04:12.749938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.891 [2024-04-16 23:04:12.750058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.891 [2024-04-16 23:04:12.750082] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.891 qpair failed and we were unable to recover it. 00:26:21.891 [2024-04-16 23:04:12.750203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.891 [2024-04-16 23:04:12.750323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.891 [2024-04-16 23:04:12.750348] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.891 qpair failed and we were unable to recover it. 00:26:21.891 [2024-04-16 23:04:12.750486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.891 [2024-04-16 23:04:12.750654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.891 [2024-04-16 23:04:12.750679] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.891 qpair failed and we were unable to recover it. 00:26:21.891 [2024-04-16 23:04:12.750795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.891 [2024-04-16 23:04:12.750939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.891 [2024-04-16 23:04:12.750963] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.891 qpair failed and we were unable to recover it. 00:26:21.891 [2024-04-16 23:04:12.751133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.891 [2024-04-16 23:04:12.751284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.891 [2024-04-16 23:04:12.751309] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.891 qpair failed and we were unable to recover it. 00:26:21.891 [2024-04-16 23:04:12.751452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.891 [2024-04-16 23:04:12.751600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.891 [2024-04-16 23:04:12.751644] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.891 qpair failed and we were unable to recover it. 00:26:21.891 [2024-04-16 23:04:12.751836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.891 [2024-04-16 23:04:12.751972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.891 [2024-04-16 23:04:12.751996] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.891 qpair failed and we were unable to recover it. 00:26:21.891 [2024-04-16 23:04:12.752113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.891 [2024-04-16 23:04:12.752248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.891 [2024-04-16 23:04:12.752278] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.891 qpair failed and we were unable to recover it. 00:26:21.891 [2024-04-16 23:04:12.752467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.891 [2024-04-16 23:04:12.752635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.891 [2024-04-16 23:04:12.752677] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.892 qpair failed and we were unable to recover it. 00:26:21.892 [2024-04-16 23:04:12.752829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.892 [2024-04-16 23:04:12.752944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.892 [2024-04-16 23:04:12.752969] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.892 qpair failed and we were unable to recover it. 00:26:21.892 [2024-04-16 23:04:12.753088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.892 [2024-04-16 23:04:12.753280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.892 [2024-04-16 23:04:12.753308] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.892 qpair failed and we were unable to recover it. 00:26:21.892 [2024-04-16 23:04:12.753425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.892 [2024-04-16 23:04:12.753594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.892 [2024-04-16 23:04:12.753619] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.892 qpair failed and we were unable to recover it. 00:26:21.892 [2024-04-16 23:04:12.753810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.892 [2024-04-16 23:04:12.753933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.892 [2024-04-16 23:04:12.753960] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.892 qpair failed and we were unable to recover it. 00:26:21.892 [2024-04-16 23:04:12.754103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.892 [2024-04-16 23:04:12.754244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.892 [2024-04-16 23:04:12.754270] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.892 qpair failed and we were unable to recover it. 00:26:21.892 [2024-04-16 23:04:12.754402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.892 [2024-04-16 23:04:12.754528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.892 [2024-04-16 23:04:12.754557] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.892 qpair failed and we were unable to recover it. 00:26:21.892 [2024-04-16 23:04:12.754715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.892 [2024-04-16 23:04:12.754838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.892 [2024-04-16 23:04:12.754872] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.892 qpair failed and we were unable to recover it. 00:26:21.892 [2024-04-16 23:04:12.755006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.892 [2024-04-16 23:04:12.755159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.892 [2024-04-16 23:04:12.755194] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.892 qpair failed and we were unable to recover it. 00:26:21.892 [2024-04-16 23:04:12.755328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.892 [2024-04-16 23:04:12.755467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.892 [2024-04-16 23:04:12.755492] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.892 qpair failed and we were unable to recover it. 00:26:21.892 [2024-04-16 23:04:12.755638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.892 [2024-04-16 23:04:12.755765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.892 [2024-04-16 23:04:12.755794] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.892 qpair failed and we were unable to recover it. 00:26:21.892 [2024-04-16 23:04:12.755917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.892 [2024-04-16 23:04:12.756075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.892 [2024-04-16 23:04:12.756100] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.892 qpair failed and we were unable to recover it. 00:26:21.892 [2024-04-16 23:04:12.756241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.892 [2024-04-16 23:04:12.756366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.892 [2024-04-16 23:04:12.756393] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.892 qpair failed and we were unable to recover it. 00:26:21.892 [2024-04-16 23:04:12.756549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.892 [2024-04-16 23:04:12.756687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.892 [2024-04-16 23:04:12.756711] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.892 qpair failed and we were unable to recover it. 00:26:21.892 [2024-04-16 23:04:12.756846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.892 [2024-04-16 23:04:12.756996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.892 [2024-04-16 23:04:12.757023] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.892 qpair failed and we were unable to recover it. 00:26:21.892 [2024-04-16 23:04:12.757147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.892 [2024-04-16 23:04:12.757300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.892 [2024-04-16 23:04:12.757335] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.892 qpair failed and we were unable to recover it. 00:26:21.892 [2024-04-16 23:04:12.757461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.892 [2024-04-16 23:04:12.757611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.892 [2024-04-16 23:04:12.757639] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.892 qpair failed and we were unable to recover it. 00:26:21.892 [2024-04-16 23:04:12.757769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.892 [2024-04-16 23:04:12.757906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.892 [2024-04-16 23:04:12.757935] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.892 qpair failed and we were unable to recover it. 00:26:21.892 [2024-04-16 23:04:12.758070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.892 [2024-04-16 23:04:12.758198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.892 [2024-04-16 23:04:12.758226] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.892 qpair failed and we were unable to recover it. 00:26:21.892 [2024-04-16 23:04:12.758352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.892 [2024-04-16 23:04:12.758466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.892 [2024-04-16 23:04:12.758493] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.892 qpair failed and we were unable to recover it. 00:26:21.892 [2024-04-16 23:04:12.758621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.892 [2024-04-16 23:04:12.758741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.892 [2024-04-16 23:04:12.758769] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.892 qpair failed and we were unable to recover it. 00:26:21.892 [2024-04-16 23:04:12.758913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.892 [2024-04-16 23:04:12.759075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.892 [2024-04-16 23:04:12.759118] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.892 qpair failed and we were unable to recover it. 00:26:21.892 [2024-04-16 23:04:12.759248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.892 [2024-04-16 23:04:12.759373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.892 [2024-04-16 23:04:12.759400] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.892 qpair failed and we were unable to recover it. 00:26:21.892 [2024-04-16 23:04:12.759553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.892 [2024-04-16 23:04:12.759674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.892 [2024-04-16 23:04:12.759701] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.893 qpair failed and we were unable to recover it. 00:26:21.893 [2024-04-16 23:04:12.759851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.893 [2024-04-16 23:04:12.759981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.893 [2024-04-16 23:04:12.760008] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.893 qpair failed and we were unable to recover it. 00:26:21.893 [2024-04-16 23:04:12.760146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.893 [2024-04-16 23:04:12.760298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.893 [2024-04-16 23:04:12.760323] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.893 qpair failed and we were unable to recover it. 00:26:21.893 [2024-04-16 23:04:12.760496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.893 [2024-04-16 23:04:12.760642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.893 [2024-04-16 23:04:12.760668] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.893 qpair failed and we were unable to recover it. 00:26:21.893 [2024-04-16 23:04:12.760792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.893 [2024-04-16 23:04:12.760907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.893 [2024-04-16 23:04:12.760935] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.893 qpair failed and we were unable to recover it. 00:26:21.893 [2024-04-16 23:04:12.761089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.893 [2024-04-16 23:04:12.761243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.893 [2024-04-16 23:04:12.761271] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.893 qpair failed and we were unable to recover it. 00:26:21.893 [2024-04-16 23:04:12.761435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.893 [2024-04-16 23:04:12.761572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.893 [2024-04-16 23:04:12.761596] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.893 qpair failed and we were unable to recover it. 00:26:21.893 [2024-04-16 23:04:12.761735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.893 [2024-04-16 23:04:12.761870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.893 [2024-04-16 23:04:12.761898] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.893 qpair failed and we were unable to recover it. 00:26:21.893 [2024-04-16 23:04:12.762049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.893 [2024-04-16 23:04:12.762196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.893 [2024-04-16 23:04:12.762224] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.893 qpair failed and we were unable to recover it. 00:26:21.893 [2024-04-16 23:04:12.762384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.893 [2024-04-16 23:04:12.762520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.893 [2024-04-16 23:04:12.762545] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.893 qpair failed and we were unable to recover it. 00:26:21.893 [2024-04-16 23:04:12.762659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.893 [2024-04-16 23:04:12.762830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.893 [2024-04-16 23:04:12.762870] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.893 qpair failed and we were unable to recover it. 00:26:21.893 [2024-04-16 23:04:12.763019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.893 [2024-04-16 23:04:12.763200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.893 [2024-04-16 23:04:12.763228] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.893 qpair failed and we were unable to recover it. 00:26:21.893 [2024-04-16 23:04:12.763396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.893 [2024-04-16 23:04:12.763514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.893 [2024-04-16 23:04:12.763538] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.893 qpair failed and we were unable to recover it. 00:26:21.893 [2024-04-16 23:04:12.763690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.893 [2024-04-16 23:04:12.763838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.893 [2024-04-16 23:04:12.763865] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.893 qpair failed and we were unable to recover it. 00:26:21.893 [2024-04-16 23:04:12.764029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.893 [2024-04-16 23:04:12.764200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.893 [2024-04-16 23:04:12.764225] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.893 qpair failed and we were unable to recover it. 00:26:21.893 [2024-04-16 23:04:12.764344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.893 [2024-04-16 23:04:12.764485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.893 [2024-04-16 23:04:12.764510] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.893 qpair failed and we were unable to recover it. 00:26:21.893 [2024-04-16 23:04:12.764650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.893 [2024-04-16 23:04:12.764776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.893 [2024-04-16 23:04:12.764803] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.893 qpair failed and we were unable to recover it. 00:26:21.893 [2024-04-16 23:04:12.764986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.893 [2024-04-16 23:04:12.765186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.893 [2024-04-16 23:04:12.765211] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.893 qpair failed and we were unable to recover it. 00:26:21.893 [2024-04-16 23:04:12.765359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.893 [2024-04-16 23:04:12.765471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.893 [2024-04-16 23:04:12.765495] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.893 qpair failed and we were unable to recover it. 00:26:21.893 [2024-04-16 23:04:12.765629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.893 [2024-04-16 23:04:12.765772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.893 [2024-04-16 23:04:12.765796] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.893 qpair failed and we were unable to recover it. 00:26:21.893 [2024-04-16 23:04:12.765909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.893 [2024-04-16 23:04:12.766079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.893 [2024-04-16 23:04:12.766104] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.893 qpair failed and we were unable to recover it. 00:26:21.893 [2024-04-16 23:04:12.766259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.893 [2024-04-16 23:04:12.766386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.893 [2024-04-16 23:04:12.766414] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.893 qpair failed and we were unable to recover it. 00:26:21.893 [2024-04-16 23:04:12.766575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.893 [2024-04-16 23:04:12.766680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.893 [2024-04-16 23:04:12.766704] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.893 qpair failed and we were unable to recover it. 00:26:21.893 [2024-04-16 23:04:12.766865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.893 [2024-04-16 23:04:12.767025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.893 [2024-04-16 23:04:12.767053] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.893 qpair failed and we were unable to recover it. 00:26:21.893 [2024-04-16 23:04:12.767234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.893 [2024-04-16 23:04:12.767381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.893 [2024-04-16 23:04:12.767406] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.893 qpair failed and we were unable to recover it. 00:26:21.893 [2024-04-16 23:04:12.767622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.893 [2024-04-16 23:04:12.767767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.893 [2024-04-16 23:04:12.767792] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.893 qpair failed and we were unable to recover it. 00:26:21.893 [2024-04-16 23:04:12.767956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.893 [2024-04-16 23:04:12.768124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.893 [2024-04-16 23:04:12.768149] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.893 qpair failed and we were unable to recover it. 00:26:21.893 [2024-04-16 23:04:12.768303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.894 [2024-04-16 23:04:12.768442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.894 [2024-04-16 23:04:12.768467] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.894 qpair failed and we were unable to recover it. 00:26:21.894 [2024-04-16 23:04:12.768598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.894 [2024-04-16 23:04:12.768739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.894 [2024-04-16 23:04:12.768763] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.894 qpair failed and we were unable to recover it. 00:26:21.894 [2024-04-16 23:04:12.768939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.894 [2024-04-16 23:04:12.769050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.894 [2024-04-16 23:04:12.769075] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.894 qpair failed and we were unable to recover it. 00:26:21.894 [2024-04-16 23:04:12.769218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.894 [2024-04-16 23:04:12.769385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.894 [2024-04-16 23:04:12.769409] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.894 qpair failed and we were unable to recover it. 00:26:21.894 [2024-04-16 23:04:12.769520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.894 [2024-04-16 23:04:12.769628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.894 [2024-04-16 23:04:12.769652] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.894 qpair failed and we were unable to recover it. 00:26:21.894 [2024-04-16 23:04:12.769798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.894 [2024-04-16 23:04:12.769921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.894 [2024-04-16 23:04:12.769948] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.894 qpair failed and we were unable to recover it. 00:26:21.894 [2024-04-16 23:04:12.770094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.894 [2024-04-16 23:04:12.770266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.894 [2024-04-16 23:04:12.770291] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.894 qpair failed and we were unable to recover it. 00:26:21.894 [2024-04-16 23:04:12.770425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.894 [2024-04-16 23:04:12.770529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.894 [2024-04-16 23:04:12.770554] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.894 qpair failed and we were unable to recover it. 00:26:21.894 [2024-04-16 23:04:12.770720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.894 [2024-04-16 23:04:12.770893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.894 [2024-04-16 23:04:12.770918] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.894 qpair failed and we were unable to recover it. 00:26:21.894 [2024-04-16 23:04:12.771032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.894 [2024-04-16 23:04:12.771234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.894 [2024-04-16 23:04:12.771259] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.894 qpair failed and we were unable to recover it. 00:26:21.894 [2024-04-16 23:04:12.771373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.894 [2024-04-16 23:04:12.771527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.894 [2024-04-16 23:04:12.771554] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.894 qpair failed and we were unable to recover it. 00:26:21.894 [2024-04-16 23:04:12.771719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.894 [2024-04-16 23:04:12.771859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.894 [2024-04-16 23:04:12.771884] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.894 qpair failed and we were unable to recover it. 00:26:21.894 [2024-04-16 23:04:12.772025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.894 [2024-04-16 23:04:12.772214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.894 [2024-04-16 23:04:12.772242] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.894 qpair failed and we were unable to recover it. 00:26:21.894 [2024-04-16 23:04:12.772424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.894 [2024-04-16 23:04:12.772538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.894 [2024-04-16 23:04:12.772565] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.894 qpair failed and we were unable to recover it. 00:26:21.894 [2024-04-16 23:04:12.772699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.894 [2024-04-16 23:04:12.772863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.894 [2024-04-16 23:04:12.772887] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.894 qpair failed and we were unable to recover it. 00:26:21.894 [2024-04-16 23:04:12.773020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.894 [2024-04-16 23:04:12.773128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.894 [2024-04-16 23:04:12.773152] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.894 qpair failed and we were unable to recover it. 00:26:21.894 [2024-04-16 23:04:12.773355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.894 [2024-04-16 23:04:12.773592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.894 [2024-04-16 23:04:12.773644] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.894 qpair failed and we were unable to recover it. 00:26:21.894 [2024-04-16 23:04:12.773814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.894 [2024-04-16 23:04:12.773971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.894 [2024-04-16 23:04:12.773999] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.894 qpair failed and we were unable to recover it. 00:26:21.894 [2024-04-16 23:04:12.774145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.894 [2024-04-16 23:04:12.774309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.894 [2024-04-16 23:04:12.774344] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.894 qpair failed and we were unable to recover it. 00:26:21.894 [2024-04-16 23:04:12.774480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.894 [2024-04-16 23:04:12.774657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.894 [2024-04-16 23:04:12.774698] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.894 qpair failed and we were unable to recover it. 00:26:21.894 [2024-04-16 23:04:12.774822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.894 [2024-04-16 23:04:12.775012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.894 [2024-04-16 23:04:12.775037] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.894 qpair failed and we were unable to recover it. 00:26:21.894 [2024-04-16 23:04:12.775205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.894 [2024-04-16 23:04:12.775368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.894 [2024-04-16 23:04:12.775395] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.894 qpair failed and we were unable to recover it. 00:26:21.894 [2024-04-16 23:04:12.775554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.894 [2024-04-16 23:04:12.775753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.894 [2024-04-16 23:04:12.775778] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.894 qpair failed and we were unable to recover it. 00:26:21.894 [2024-04-16 23:04:12.775922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.894 [2024-04-16 23:04:12.776058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.894 [2024-04-16 23:04:12.776099] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.894 qpair failed and we were unable to recover it. 00:26:21.894 [2024-04-16 23:04:12.776273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.894 [2024-04-16 23:04:12.776386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.894 [2024-04-16 23:04:12.776411] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.894 qpair failed and we were unable to recover it. 00:26:21.894 [2024-04-16 23:04:12.776616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.894 [2024-04-16 23:04:12.776780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.894 [2024-04-16 23:04:12.776805] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.894 qpair failed and we were unable to recover it. 00:26:21.894 [2024-04-16 23:04:12.776981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.894 [2024-04-16 23:04:12.777144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.894 [2024-04-16 23:04:12.777173] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.894 qpair failed and we were unable to recover it. 00:26:21.894 [2024-04-16 23:04:12.777346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.894 [2024-04-16 23:04:12.777524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.894 [2024-04-16 23:04:12.777549] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.894 qpair failed and we were unable to recover it. 00:26:21.894 [2024-04-16 23:04:12.777717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.894 [2024-04-16 23:04:12.777980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.894 [2024-04-16 23:04:12.778011] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.894 qpair failed and we were unable to recover it. 00:26:21.895 [2024-04-16 23:04:12.778187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.895 [2024-04-16 23:04:12.778313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.895 [2024-04-16 23:04:12.778341] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.895 qpair failed and we were unable to recover it. 00:26:21.895 [2024-04-16 23:04:12.778497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.895 [2024-04-16 23:04:12.778614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.895 [2024-04-16 23:04:12.778641] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.895 qpair failed and we were unable to recover it. 00:26:21.895 [2024-04-16 23:04:12.778829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.895 [2024-04-16 23:04:12.779012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.895 [2024-04-16 23:04:12.779039] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.895 qpair failed and we were unable to recover it. 00:26:21.895 [2024-04-16 23:04:12.779198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.895 [2024-04-16 23:04:12.779329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.895 [2024-04-16 23:04:12.779356] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.895 qpair failed and we were unable to recover it. 00:26:21.895 [2024-04-16 23:04:12.779554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.895 [2024-04-16 23:04:12.779669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.895 [2024-04-16 23:04:12.779696] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.895 qpair failed and we were unable to recover it. 00:26:21.895 [2024-04-16 23:04:12.779843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.895 [2024-04-16 23:04:12.779993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.895 [2024-04-16 23:04:12.780021] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.895 qpair failed and we were unable to recover it. 00:26:21.895 [2024-04-16 23:04:12.780209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.895 [2024-04-16 23:04:12.780371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.895 [2024-04-16 23:04:12.780399] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.895 qpair failed and we were unable to recover it. 00:26:21.895 [2024-04-16 23:04:12.780581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.895 [2024-04-16 23:04:12.780706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.895 [2024-04-16 23:04:12.780734] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.895 qpair failed and we were unable to recover it. 00:26:21.895 [2024-04-16 23:04:12.780881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.895 [2024-04-16 23:04:12.781024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.895 [2024-04-16 23:04:12.781052] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.895 qpair failed and we were unable to recover it. 00:26:21.895 [2024-04-16 23:04:12.781173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.895 [2024-04-16 23:04:12.781371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.895 [2024-04-16 23:04:12.781399] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.895 qpair failed and we were unable to recover it. 00:26:21.895 [2024-04-16 23:04:12.781576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.895 [2024-04-16 23:04:12.781710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.895 [2024-04-16 23:04:12.781735] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.895 qpair failed and we were unable to recover it. 00:26:21.895 [2024-04-16 23:04:12.781898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.895 [2024-04-16 23:04:12.782015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.895 [2024-04-16 23:04:12.782042] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.895 qpair failed and we were unable to recover it. 00:26:21.895 [2024-04-16 23:04:12.782226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.895 [2024-04-16 23:04:12.782373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.895 [2024-04-16 23:04:12.782401] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.895 qpair failed and we were unable to recover it. 00:26:21.895 [2024-04-16 23:04:12.782599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.895 [2024-04-16 23:04:12.782736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.895 [2024-04-16 23:04:12.782760] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.895 qpair failed and we were unable to recover it. 00:26:21.895 [2024-04-16 23:04:12.782869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.895 [2024-04-16 23:04:12.783002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.895 [2024-04-16 23:04:12.783027] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.895 qpair failed and we were unable to recover it. 00:26:21.895 [2024-04-16 23:04:12.783204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.895 [2024-04-16 23:04:12.783371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.895 [2024-04-16 23:04:12.783399] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.895 qpair failed and we were unable to recover it. 00:26:21.895 [2024-04-16 23:04:12.783582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.895 [2024-04-16 23:04:12.783736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.895 [2024-04-16 23:04:12.783763] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.895 qpair failed and we were unable to recover it. 00:26:21.895 [2024-04-16 23:04:12.783949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.895 [2024-04-16 23:04:12.784071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.895 [2024-04-16 23:04:12.784095] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.895 qpair failed and we were unable to recover it. 00:26:21.895 [2024-04-16 23:04:12.784241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.895 [2024-04-16 23:04:12.784355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.895 [2024-04-16 23:04:12.784380] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.895 qpair failed and we were unable to recover it. 00:26:21.895 [2024-04-16 23:04:12.784492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.895 [2024-04-16 23:04:12.784596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.895 [2024-04-16 23:04:12.784621] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.895 qpair failed and we were unable to recover it. 00:26:21.895 [2024-04-16 23:04:12.784758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.895 [2024-04-16 23:04:12.784898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.895 [2024-04-16 23:04:12.784927] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.895 qpair failed and we were unable to recover it. 00:26:21.895 [2024-04-16 23:04:12.785094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.895 [2024-04-16 23:04:12.785237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.895 [2024-04-16 23:04:12.785262] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.895 qpair failed and we were unable to recover it. 00:26:21.895 [2024-04-16 23:04:12.785402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.895 [2024-04-16 23:04:12.785525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.895 [2024-04-16 23:04:12.785549] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.895 qpair failed and we were unable to recover it. 00:26:21.895 [2024-04-16 23:04:12.785712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.895 [2024-04-16 23:04:12.785832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.895 [2024-04-16 23:04:12.785859] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.895 qpair failed and we were unable to recover it. 00:26:21.895 [2024-04-16 23:04:12.786048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.895 [2024-04-16 23:04:12.786230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.895 [2024-04-16 23:04:12.786258] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.895 qpair failed and we were unable to recover it. 00:26:21.895 [2024-04-16 23:04:12.786373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.895 [2024-04-16 23:04:12.786543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.895 [2024-04-16 23:04:12.786570] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.895 qpair failed and we were unable to recover it. 00:26:21.895 [2024-04-16 23:04:12.786757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.895 [2024-04-16 23:04:12.786900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.895 [2024-04-16 23:04:12.786925] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.895 qpair failed and we were unable to recover it. 00:26:21.896 [2024-04-16 23:04:12.787070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.896 [2024-04-16 23:04:12.787242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.896 [2024-04-16 23:04:12.787267] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.896 qpair failed and we were unable to recover it. 00:26:21.896 [2024-04-16 23:04:12.787415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.896 [2024-04-16 23:04:12.787596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.896 [2024-04-16 23:04:12.787627] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.896 qpair failed and we were unable to recover it. 00:26:21.896 [2024-04-16 23:04:12.787787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.896 [2024-04-16 23:04:12.787896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.896 [2024-04-16 23:04:12.787921] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.896 qpair failed and we were unable to recover it. 00:26:21.896 [2024-04-16 23:04:12.788059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.896 [2024-04-16 23:04:12.788190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.896 [2024-04-16 23:04:12.788216] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.896 qpair failed and we were unable to recover it. 00:26:21.896 [2024-04-16 23:04:12.788345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.896 [2024-04-16 23:04:12.788475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.896 [2024-04-16 23:04:12.788503] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.896 qpair failed and we were unable to recover it. 00:26:21.896 [2024-04-16 23:04:12.788661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.896 [2024-04-16 23:04:12.788821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.896 [2024-04-16 23:04:12.788846] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.896 qpair failed and we were unable to recover it. 00:26:21.896 [2024-04-16 23:04:12.788967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.896 [2024-04-16 23:04:12.789110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.896 [2024-04-16 23:04:12.789137] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.896 qpair failed and we were unable to recover it. 00:26:21.896 [2024-04-16 23:04:12.789340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.896 [2024-04-16 23:04:12.789498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.896 [2024-04-16 23:04:12.789525] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.896 qpair failed and we were unable to recover it. 00:26:21.896 [2024-04-16 23:04:12.789709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.896 [2024-04-16 23:04:12.789839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.896 [2024-04-16 23:04:12.789869] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.896 qpair failed and we were unable to recover it. 00:26:21.896 [2024-04-16 23:04:12.790066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.896 [2024-04-16 23:04:12.790215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.896 [2024-04-16 23:04:12.790242] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.896 qpair failed and we were unable to recover it. 00:26:21.896 [2024-04-16 23:04:12.790449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.896 [2024-04-16 23:04:12.790559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.896 [2024-04-16 23:04:12.790584] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.896 qpair failed and we were unable to recover it. 00:26:21.896 [2024-04-16 23:04:12.790718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.896 [2024-04-16 23:04:12.790834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.896 [2024-04-16 23:04:12.790858] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.896 qpair failed and we were unable to recover it. 00:26:21.896 [2024-04-16 23:04:12.791055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.896 [2024-04-16 23:04:12.791202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.896 [2024-04-16 23:04:12.791230] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.896 qpair failed and we were unable to recover it. 00:26:21.896 [2024-04-16 23:04:12.791336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.896 [2024-04-16 23:04:12.791468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.896 [2024-04-16 23:04:12.791497] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.896 qpair failed and we were unable to recover it. 00:26:21.896 [2024-04-16 23:04:12.791613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.896 [2024-04-16 23:04:12.791715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.896 [2024-04-16 23:04:12.791740] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.896 qpair failed and we were unable to recover it. 00:26:21.896 [2024-04-16 23:04:12.791906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.896 [2024-04-16 23:04:12.792060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.896 [2024-04-16 23:04:12.792087] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.896 qpair failed and we were unable to recover it. 00:26:21.896 [2024-04-16 23:04:12.792236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.896 [2024-04-16 23:04:12.792395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.896 [2024-04-16 23:04:12.792421] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.896 qpair failed and we were unable to recover it. 00:26:21.896 [2024-04-16 23:04:12.792551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.896 [2024-04-16 23:04:12.792709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.896 [2024-04-16 23:04:12.792734] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.896 qpair failed and we were unable to recover it. 00:26:21.896 [2024-04-16 23:04:12.792866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.896 [2024-04-16 23:04:12.793028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.896 [2024-04-16 23:04:12.793053] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.896 qpair failed and we were unable to recover it. 00:26:21.896 [2024-04-16 23:04:12.793198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.896 [2024-04-16 23:04:12.793333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.896 [2024-04-16 23:04:12.793373] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.896 qpair failed and we were unable to recover it. 00:26:21.896 [2024-04-16 23:04:12.793547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.896 [2024-04-16 23:04:12.793691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.896 [2024-04-16 23:04:12.793717] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.896 qpair failed and we were unable to recover it. 00:26:21.896 [2024-04-16 23:04:12.793891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.896 [2024-04-16 23:04:12.794040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.896 [2024-04-16 23:04:12.794068] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.896 qpair failed and we were unable to recover it. 00:26:21.896 [2024-04-16 23:04:12.794241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.896 [2024-04-16 23:04:12.794380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.896 [2024-04-16 23:04:12.794405] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.896 qpair failed and we were unable to recover it. 00:26:21.896 [2024-04-16 23:04:12.794553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.896 [2024-04-16 23:04:12.794690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.896 [2024-04-16 23:04:12.794715] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.896 qpair failed and we were unable to recover it. 00:26:21.896 [2024-04-16 23:04:12.794840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.896 [2024-04-16 23:04:12.794979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.896 [2024-04-16 23:04:12.795004] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.896 qpair failed and we were unable to recover it. 00:26:21.896 [2024-04-16 23:04:12.795143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.896 [2024-04-16 23:04:12.795307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.896 [2024-04-16 23:04:12.795335] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.896 qpair failed and we were unable to recover it. 00:26:21.896 [2024-04-16 23:04:12.795485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.896 [2024-04-16 23:04:12.795655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.896 [2024-04-16 23:04:12.795680] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.896 qpair failed and we were unable to recover it. 00:26:21.896 [2024-04-16 23:04:12.795819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.896 [2024-04-16 23:04:12.795985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.896 [2024-04-16 23:04:12.796025] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.896 qpair failed and we were unable to recover it. 00:26:21.896 [2024-04-16 23:04:12.796144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.897 [2024-04-16 23:04:12.796282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.897 [2024-04-16 23:04:12.796310] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.897 qpair failed and we were unable to recover it. 00:26:21.897 [2024-04-16 23:04:12.796470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.897 [2024-04-16 23:04:12.796582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.897 [2024-04-16 23:04:12.796606] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.897 qpair failed and we were unable to recover it. 00:26:21.897 [2024-04-16 23:04:12.796785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.897 [2024-04-16 23:04:12.796928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.897 [2024-04-16 23:04:12.796953] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.897 qpair failed and we were unable to recover it. 00:26:21.897 [2024-04-16 23:04:12.797098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.897 [2024-04-16 23:04:12.797298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.897 [2024-04-16 23:04:12.797326] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.897 qpair failed and we were unable to recover it. 00:26:21.897 [2024-04-16 23:04:12.797473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.897 [2024-04-16 23:04:12.797594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.897 [2024-04-16 23:04:12.797622] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.897 qpair failed and we were unable to recover it. 00:26:21.897 [2024-04-16 23:04:12.797806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.897 [2024-04-16 23:04:12.797932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.897 [2024-04-16 23:04:12.797960] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.897 qpair failed and we were unable to recover it. 00:26:21.897 [2024-04-16 23:04:12.798145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.897 [2024-04-16 23:04:12.798290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.897 [2024-04-16 23:04:12.798315] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.897 qpair failed and we were unable to recover it. 00:26:21.897 [2024-04-16 23:04:12.798522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.897 [2024-04-16 23:04:12.798667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.897 [2024-04-16 23:04:12.798692] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.897 qpair failed and we were unable to recover it. 00:26:21.897 [2024-04-16 23:04:12.798859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.897 [2024-04-16 23:04:12.799001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.897 [2024-04-16 23:04:12.799025] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.897 qpair failed and we were unable to recover it. 00:26:21.897 [2024-04-16 23:04:12.799206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.897 [2024-04-16 23:04:12.799319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.897 [2024-04-16 23:04:12.799344] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.897 qpair failed and we were unable to recover it. 00:26:21.897 [2024-04-16 23:04:12.799450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.897 [2024-04-16 23:04:12.799613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.897 [2024-04-16 23:04:12.799638] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.897 qpair failed and we were unable to recover it. 00:26:21.897 [2024-04-16 23:04:12.799813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.897 [2024-04-16 23:04:12.799994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.897 [2024-04-16 23:04:12.800021] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.897 qpair failed and we were unable to recover it. 00:26:21.897 [2024-04-16 23:04:12.800182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.897 [2024-04-16 23:04:12.800363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.897 [2024-04-16 23:04:12.800390] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.897 qpair failed and we were unable to recover it. 00:26:21.897 [2024-04-16 23:04:12.800589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.897 [2024-04-16 23:04:12.800696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.897 [2024-04-16 23:04:12.800722] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.897 qpair failed and we were unable to recover it. 00:26:21.897 [2024-04-16 23:04:12.800830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.897 [2024-04-16 23:04:12.800969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.897 [2024-04-16 23:04:12.800994] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.897 qpair failed and we were unable to recover it. 00:26:21.897 [2024-04-16 23:04:12.801134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.897 [2024-04-16 23:04:12.801287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.897 [2024-04-16 23:04:12.801313] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.897 qpair failed and we were unable to recover it. 00:26:21.897 [2024-04-16 23:04:12.801432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.897 [2024-04-16 23:04:12.801604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.897 [2024-04-16 23:04:12.801632] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.897 qpair failed and we were unable to recover it. 00:26:21.897 [2024-04-16 23:04:12.801784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.897 [2024-04-16 23:04:12.801905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.897 [2024-04-16 23:04:12.801933] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.897 qpair failed and we were unable to recover it. 00:26:21.897 [2024-04-16 23:04:12.802057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.897 [2024-04-16 23:04:12.802203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.897 [2024-04-16 23:04:12.802234] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.897 qpair failed and we were unable to recover it. 00:26:21.897 [2024-04-16 23:04:12.802370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.897 [2024-04-16 23:04:12.802483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.897 [2024-04-16 23:04:12.802509] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.897 qpair failed and we were unable to recover it. 00:26:21.897 [2024-04-16 23:04:12.802654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.897 [2024-04-16 23:04:12.802816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.897 [2024-04-16 23:04:12.802843] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.897 qpair failed and we were unable to recover it. 00:26:21.897 [2024-04-16 23:04:12.802995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.898 [2024-04-16 23:04:12.803143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.898 [2024-04-16 23:04:12.803170] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.898 qpair failed and we were unable to recover it. 00:26:21.898 [2024-04-16 23:04:12.803302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.898 [2024-04-16 23:04:12.803453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.898 [2024-04-16 23:04:12.803480] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.898 qpair failed and we were unable to recover it. 00:26:21.898 [2024-04-16 23:04:12.803636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.898 [2024-04-16 23:04:12.803740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.898 [2024-04-16 23:04:12.803764] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.898 qpair failed and we were unable to recover it. 00:26:21.898 [2024-04-16 23:04:12.803898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.898 [2024-04-16 23:04:12.804049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.898 [2024-04-16 23:04:12.804076] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.898 qpair failed and we were unable to recover it. 00:26:21.898 [2024-04-16 23:04:12.804196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.898 [2024-04-16 23:04:12.804327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.898 [2024-04-16 23:04:12.804354] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.898 qpair failed and we were unable to recover it. 00:26:21.898 [2024-04-16 23:04:12.804506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.898 [2024-04-16 23:04:12.804669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.898 [2024-04-16 23:04:12.804696] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.898 qpair failed and we were unable to recover it. 00:26:21.898 [2024-04-16 23:04:12.804826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.898 [2024-04-16 23:04:12.804968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.898 [2024-04-16 23:04:12.804993] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.898 qpair failed and we were unable to recover it. 00:26:21.898 [2024-04-16 23:04:12.805129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.898 [2024-04-16 23:04:12.805256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.898 [2024-04-16 23:04:12.805284] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.898 qpair failed and we were unable to recover it. 00:26:21.898 [2024-04-16 23:04:12.805405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.898 [2024-04-16 23:04:12.805557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.898 [2024-04-16 23:04:12.805585] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.898 qpair failed and we were unable to recover it. 00:26:21.898 [2024-04-16 23:04:12.805782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.898 [2024-04-16 23:04:12.805921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.898 [2024-04-16 23:04:12.805945] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.898 qpair failed and we were unable to recover it. 00:26:21.898 [2024-04-16 23:04:12.806082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.898 [2024-04-16 23:04:12.806186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.898 [2024-04-16 23:04:12.806211] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.898 qpair failed and we were unable to recover it. 00:26:21.898 [2024-04-16 23:04:12.806358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.898 [2024-04-16 23:04:12.806473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.898 [2024-04-16 23:04:12.806501] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.898 qpair failed and we were unable to recover it. 00:26:21.898 [2024-04-16 23:04:12.806653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.898 [2024-04-16 23:04:12.806796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.898 [2024-04-16 23:04:12.806823] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.898 qpair failed and we were unable to recover it. 00:26:21.898 [2024-04-16 23:04:12.807018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.898 [2024-04-16 23:04:12.807129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.898 [2024-04-16 23:04:12.807154] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.898 qpair failed and we were unable to recover it. 00:26:21.898 [2024-04-16 23:04:12.807275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.898 [2024-04-16 23:04:12.807440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.898 [2024-04-16 23:04:12.807482] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.898 qpair failed and we were unable to recover it. 00:26:21.898 [2024-04-16 23:04:12.807629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.898 [2024-04-16 23:04:12.807805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.898 [2024-04-16 23:04:12.807837] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.898 qpair failed and we were unable to recover it. 00:26:21.898 [2024-04-16 23:04:12.807968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.898 [2024-04-16 23:04:12.808089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.898 [2024-04-16 23:04:12.808116] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.898 qpair failed and we were unable to recover it. 00:26:21.898 [2024-04-16 23:04:12.808259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.898 [2024-04-16 23:04:12.808381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.898 [2024-04-16 23:04:12.808410] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.898 qpair failed and we were unable to recover it. 00:26:21.898 [2024-04-16 23:04:12.808578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.898 [2024-04-16 23:04:12.808691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.898 [2024-04-16 23:04:12.808716] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.898 qpair failed and we were unable to recover it. 00:26:21.898 [2024-04-16 23:04:12.808866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.898 [2024-04-16 23:04:12.809043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.898 [2024-04-16 23:04:12.809071] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.898 qpair failed and we were unable to recover it. 00:26:21.898 [2024-04-16 23:04:12.809193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.898 [2024-04-16 23:04:12.809346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.898 [2024-04-16 23:04:12.809373] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.898 qpair failed and we were unable to recover it. 00:26:21.898 [2024-04-16 23:04:12.809500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.898 [2024-04-16 23:04:12.809684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.898 [2024-04-16 23:04:12.809712] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.898 qpair failed and we were unable to recover it. 00:26:21.898 [2024-04-16 23:04:12.809868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.898 [2024-04-16 23:04:12.810004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.898 [2024-04-16 23:04:12.810029] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.898 qpair failed and we were unable to recover it. 00:26:21.898 [2024-04-16 23:04:12.810200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.898 [2024-04-16 23:04:12.810360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.898 [2024-04-16 23:04:12.810387] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.898 qpair failed and we were unable to recover it. 00:26:21.898 [2024-04-16 23:04:12.810542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.898 [2024-04-16 23:04:12.810687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.898 [2024-04-16 23:04:12.810713] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.898 qpair failed and we were unable to recover it. 00:26:21.898 [2024-04-16 23:04:12.810842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.898 [2024-04-16 23:04:12.811023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.898 [2024-04-16 23:04:12.811052] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.898 qpair failed and we were unable to recover it. 00:26:21.898 [2024-04-16 23:04:12.811192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.898 [2024-04-16 23:04:12.811345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.899 [2024-04-16 23:04:12.811386] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.899 qpair failed and we were unable to recover it. 00:26:21.899 [2024-04-16 23:04:12.811519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.899 [2024-04-16 23:04:12.811685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.899 [2024-04-16 23:04:12.811709] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.899 qpair failed and we were unable to recover it. 00:26:21.899 [2024-04-16 23:04:12.811838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.899 [2024-04-16 23:04:12.811978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.899 [2024-04-16 23:04:12.812003] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.899 qpair failed and we were unable to recover it. 00:26:21.899 [2024-04-16 23:04:12.812190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.899 [2024-04-16 23:04:12.812309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.899 [2024-04-16 23:04:12.812334] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.899 qpair failed and we were unable to recover it. 00:26:21.899 [2024-04-16 23:04:12.812445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.899 [2024-04-16 23:04:12.812561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.899 [2024-04-16 23:04:12.812586] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.899 qpair failed and we were unable to recover it. 00:26:21.899 [2024-04-16 23:04:12.812736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.899 [2024-04-16 23:04:12.812896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.899 [2024-04-16 23:04:12.812924] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.899 qpair failed and we were unable to recover it. 00:26:21.899 [2024-04-16 23:04:12.813102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.899 [2024-04-16 23:04:12.813250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.899 [2024-04-16 23:04:12.813279] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.899 qpair failed and we were unable to recover it. 00:26:21.899 [2024-04-16 23:04:12.813442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.899 [2024-04-16 23:04:12.813552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.899 [2024-04-16 23:04:12.813577] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.899 qpair failed and we were unable to recover it. 00:26:21.899 [2024-04-16 23:04:12.813725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.899 [2024-04-16 23:04:12.813863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.899 [2024-04-16 23:04:12.813903] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.899 qpair failed and we were unable to recover it. 00:26:21.899 [2024-04-16 23:04:12.814049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.899 [2024-04-16 23:04:12.814240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.899 [2024-04-16 23:04:12.814265] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.899 qpair failed and we were unable to recover it. 00:26:21.899 [2024-04-16 23:04:12.814414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.899 [2024-04-16 23:04:12.814556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.899 [2024-04-16 23:04:12.814583] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.899 qpair failed and we were unable to recover it. 00:26:21.899 [2024-04-16 23:04:12.814751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.899 [2024-04-16 23:04:12.814869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.899 [2024-04-16 23:04:12.814893] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.899 qpair failed and we were unable to recover it. 00:26:21.899 [2024-04-16 23:04:12.815032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.899 [2024-04-16 23:04:12.815137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.899 [2024-04-16 23:04:12.815161] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.899 qpair failed and we were unable to recover it. 00:26:21.899 [2024-04-16 23:04:12.815303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.899 [2024-04-16 23:04:12.815438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.899 [2024-04-16 23:04:12.815462] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.899 qpair failed and we were unable to recover it. 00:26:21.899 [2024-04-16 23:04:12.815618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.899 [2024-04-16 23:04:12.815794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.899 [2024-04-16 23:04:12.815819] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.899 qpair failed and we were unable to recover it. 00:26:21.899 [2024-04-16 23:04:12.815968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.899 [2024-04-16 23:04:12.816102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.899 [2024-04-16 23:04:12.816129] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.899 qpair failed and we were unable to recover it. 00:26:21.899 [2024-04-16 23:04:12.816335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.899 [2024-04-16 23:04:12.816449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.899 [2024-04-16 23:04:12.816474] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.899 qpair failed and we were unable to recover it. 00:26:21.899 [2024-04-16 23:04:12.816658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.899 [2024-04-16 23:04:12.816809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.899 [2024-04-16 23:04:12.816834] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.899 qpair failed and we were unable to recover it. 00:26:21.899 [2024-04-16 23:04:12.817003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.899 [2024-04-16 23:04:12.817163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.899 [2024-04-16 23:04:12.817196] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.899 qpair failed and we were unable to recover it. 00:26:21.899 [2024-04-16 23:04:12.817314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.899 [2024-04-16 23:04:12.817458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.899 [2024-04-16 23:04:12.817482] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.899 qpair failed and we were unable to recover it. 00:26:21.899 [2024-04-16 23:04:12.817600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.899 [2024-04-16 23:04:12.817714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.899 [2024-04-16 23:04:12.817738] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.899 qpair failed and we were unable to recover it. 00:26:21.899 [2024-04-16 23:04:12.817860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.899 [2024-04-16 23:04:12.817971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.899 [2024-04-16 23:04:12.817996] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.899 qpair failed and we were unable to recover it. 00:26:21.899 [2024-04-16 23:04:12.818117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.899 [2024-04-16 23:04:12.818274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.899 [2024-04-16 23:04:12.818303] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.899 qpair failed and we were unable to recover it. 00:26:21.899 [2024-04-16 23:04:12.818436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.899 [2024-04-16 23:04:12.818591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.899 [2024-04-16 23:04:12.818618] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.899 qpair failed and we were unable to recover it. 00:26:21.899 [2024-04-16 23:04:12.818755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.899 [2024-04-16 23:04:12.818923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.899 [2024-04-16 23:04:12.818948] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.899 qpair failed and we were unable to recover it. 00:26:21.899 [2024-04-16 23:04:12.819093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.899 [2024-04-16 23:04:12.819252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.899 [2024-04-16 23:04:12.819281] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.899 qpair failed and we were unable to recover it. 00:26:21.899 [2024-04-16 23:04:12.819462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.899 [2024-04-16 23:04:12.819618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.899 [2024-04-16 23:04:12.819645] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.899 qpair failed and we were unable to recover it. 00:26:21.899 [2024-04-16 23:04:12.819759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.899 [2024-04-16 23:04:12.819901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.899 [2024-04-16 23:04:12.819928] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.899 qpair failed and we were unable to recover it. 00:26:21.899 [2024-04-16 23:04:12.820118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.899 [2024-04-16 23:04:12.820231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.899 [2024-04-16 23:04:12.820256] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.900 qpair failed and we were unable to recover it. 00:26:21.900 [2024-04-16 23:04:12.820403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.900 [2024-04-16 23:04:12.820564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.900 [2024-04-16 23:04:12.820592] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.900 qpair failed and we were unable to recover it. 00:26:21.900 [2024-04-16 23:04:12.820761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.900 [2024-04-16 23:04:12.820898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.900 [2024-04-16 23:04:12.820923] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.900 qpair failed and we were unable to recover it. 00:26:21.900 [2024-04-16 23:04:12.821110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.900 [2024-04-16 23:04:12.821289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.900 [2024-04-16 23:04:12.821317] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.900 qpair failed and we were unable to recover it. 00:26:21.900 [2024-04-16 23:04:12.821485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.900 [2024-04-16 23:04:12.821633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.900 [2024-04-16 23:04:12.821657] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.900 qpair failed and we were unable to recover it. 00:26:21.900 [2024-04-16 23:04:12.821781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.900 [2024-04-16 23:04:12.821938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.900 [2024-04-16 23:04:12.821965] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.900 qpair failed and we were unable to recover it. 00:26:21.900 [2024-04-16 23:04:12.822084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.900 [2024-04-16 23:04:12.822209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.900 [2024-04-16 23:04:12.822237] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.900 qpair failed and we were unable to recover it. 00:26:21.900 [2024-04-16 23:04:12.822441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.900 [2024-04-16 23:04:12.822585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.900 [2024-04-16 23:04:12.822609] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.900 qpair failed and we were unable to recover it. 00:26:21.900 [2024-04-16 23:04:12.822778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.900 [2024-04-16 23:04:12.822932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.900 [2024-04-16 23:04:12.822960] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.900 qpair failed and we were unable to recover it. 00:26:21.900 [2024-04-16 23:04:12.823123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.900 [2024-04-16 23:04:12.823276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.900 [2024-04-16 23:04:12.823304] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.900 qpair failed and we were unable to recover it. 00:26:21.900 [2024-04-16 23:04:12.823461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.900 [2024-04-16 23:04:12.823592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.900 [2024-04-16 23:04:12.823617] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.900 qpair failed and we were unable to recover it. 00:26:21.900 [2024-04-16 23:04:12.823770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.900 [2024-04-16 23:04:12.823918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.900 [2024-04-16 23:04:12.823946] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.900 qpair failed and we were unable to recover it. 00:26:21.900 [2024-04-16 23:04:12.824074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.900 [2024-04-16 23:04:12.824220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.900 [2024-04-16 23:04:12.824246] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.900 qpair failed and we were unable to recover it. 00:26:21.900 [2024-04-16 23:04:12.824441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.900 [2024-04-16 23:04:12.824597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.900 [2024-04-16 23:04:12.824624] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.900 qpair failed and we were unable to recover it. 00:26:21.900 [2024-04-16 23:04:12.824801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.900 [2024-04-16 23:04:12.824981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.900 [2024-04-16 23:04:12.825008] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.900 qpair failed and we were unable to recover it. 00:26:21.900 [2024-04-16 23:04:12.825123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.900 [2024-04-16 23:04:12.825281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.900 [2024-04-16 23:04:12.825309] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.900 qpair failed and we were unable to recover it. 00:26:21.900 [2024-04-16 23:04:12.825440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.900 [2024-04-16 23:04:12.825603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.900 [2024-04-16 23:04:12.825627] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.900 qpair failed and we were unable to recover it. 00:26:21.900 [2024-04-16 23:04:12.825831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.900 [2024-04-16 23:04:12.825954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.900 [2024-04-16 23:04:12.825983] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.900 qpair failed and we were unable to recover it. 00:26:21.900 [2024-04-16 23:04:12.826141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.900 [2024-04-16 23:04:12.826306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.900 [2024-04-16 23:04:12.826331] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.900 qpair failed and we were unable to recover it. 00:26:21.900 [2024-04-16 23:04:12.826472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.900 [2024-04-16 23:04:12.826614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.900 [2024-04-16 23:04:12.826640] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.900 qpair failed and we were unable to recover it. 00:26:21.900 [2024-04-16 23:04:12.826776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.900 [2024-04-16 23:04:12.826913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.900 [2024-04-16 23:04:12.826937] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.900 qpair failed and we were unable to recover it. 00:26:21.900 [2024-04-16 23:04:12.827080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.900 [2024-04-16 23:04:12.827237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.900 [2024-04-16 23:04:12.827266] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.900 qpair failed and we were unable to recover it. 00:26:21.900 [2024-04-16 23:04:12.827396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.900 [2024-04-16 23:04:12.827573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.900 [2024-04-16 23:04:12.827607] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.900 qpair failed and we were unable to recover it. 00:26:21.900 [2024-04-16 23:04:12.827790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.900 [2024-04-16 23:04:12.827946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.900 [2024-04-16 23:04:12.827975] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.900 qpair failed and we were unable to recover it. 00:26:21.900 [2024-04-16 23:04:12.828142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.900 [2024-04-16 23:04:12.828338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.900 [2024-04-16 23:04:12.828366] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.900 qpair failed and we were unable to recover it. 00:26:21.900 [2024-04-16 23:04:12.828496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.900 [2024-04-16 23:04:12.828690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.900 [2024-04-16 23:04:12.828715] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.900 qpair failed and we were unable to recover it. 00:26:21.900 [2024-04-16 23:04:12.828886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.900 [2024-04-16 23:04:12.829086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.901 [2024-04-16 23:04:12.829110] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.901 qpair failed and we were unable to recover it. 00:26:21.901 [2024-04-16 23:04:12.829255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.901 [2024-04-16 23:04:12.829385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.901 [2024-04-16 23:04:12.829412] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.901 qpair failed and we were unable to recover it. 00:26:21.901 [2024-04-16 23:04:12.829575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.901 [2024-04-16 23:04:12.829720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.901 [2024-04-16 23:04:12.829762] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.901 qpair failed and we were unable to recover it. 00:26:21.901 [2024-04-16 23:04:12.829966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.901 [2024-04-16 23:04:12.830130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.901 [2024-04-16 23:04:12.830154] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.901 qpair failed and we were unable to recover it. 00:26:21.901 [2024-04-16 23:04:12.830411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.901 [2024-04-16 23:04:12.830522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.901 [2024-04-16 23:04:12.830547] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.901 qpair failed and we were unable to recover it. 00:26:21.901 [2024-04-16 23:04:12.830706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.901 [2024-04-16 23:04:12.830874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.901 [2024-04-16 23:04:12.830898] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.901 qpair failed and we were unable to recover it. 00:26:21.901 [2024-04-16 23:04:12.831029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.901 [2024-04-16 23:04:12.831137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.901 [2024-04-16 23:04:12.831161] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.901 qpair failed and we were unable to recover it. 00:26:21.901 [2024-04-16 23:04:12.831315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.901 [2024-04-16 23:04:12.831461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.901 [2024-04-16 23:04:12.831488] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.901 qpair failed and we were unable to recover it. 00:26:21.901 [2024-04-16 23:04:12.831678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.901 [2024-04-16 23:04:12.831812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.901 [2024-04-16 23:04:12.831837] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.901 qpair failed and we were unable to recover it. 00:26:21.901 [2024-04-16 23:04:12.831978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.901 [2024-04-16 23:04:12.832138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.901 [2024-04-16 23:04:12.832165] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.901 qpair failed and we were unable to recover it. 00:26:21.901 [2024-04-16 23:04:12.832304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.901 [2024-04-16 23:04:12.832476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.901 [2024-04-16 23:04:12.832501] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.901 qpair failed and we were unable to recover it. 00:26:21.901 [2024-04-16 23:04:12.832637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.901 [2024-04-16 23:04:12.832803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.901 [2024-04-16 23:04:12.832843] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.901 qpair failed and we were unable to recover it. 00:26:21.901 [2024-04-16 23:04:12.832967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.901 [2024-04-16 23:04:12.833144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.901 [2024-04-16 23:04:12.833172] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.901 qpair failed and we were unable to recover it. 00:26:21.901 [2024-04-16 23:04:12.833301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.901 [2024-04-16 23:04:12.833475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.901 [2024-04-16 23:04:12.833502] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.901 qpair failed and we were unable to recover it. 00:26:21.901 [2024-04-16 23:04:12.833664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.901 [2024-04-16 23:04:12.833773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.901 [2024-04-16 23:04:12.833797] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.901 qpair failed and we were unable to recover it. 00:26:21.901 [2024-04-16 23:04:12.833967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.901 [2024-04-16 23:04:12.834101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.901 [2024-04-16 23:04:12.834125] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.901 qpair failed and we were unable to recover it. 00:26:21.901 [2024-04-16 23:04:12.834274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.901 [2024-04-16 23:04:12.834385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.901 [2024-04-16 23:04:12.834410] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.901 qpair failed and we were unable to recover it. 00:26:21.901 [2024-04-16 23:04:12.834563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.901 [2024-04-16 23:04:12.834740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.901 [2024-04-16 23:04:12.834780] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.901 qpair failed and we were unable to recover it. 00:26:21.901 [2024-04-16 23:04:12.834914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.901 [2024-04-16 23:04:12.835056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.901 [2024-04-16 23:04:12.835083] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.901 qpair failed and we were unable to recover it. 00:26:21.901 [2024-04-16 23:04:12.835219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.901 [2024-04-16 23:04:12.835347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.901 [2024-04-16 23:04:12.835375] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.901 qpair failed and we were unable to recover it. 00:26:21.901 [2024-04-16 23:04:12.835521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.901 [2024-04-16 23:04:12.835664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.901 [2024-04-16 23:04:12.835688] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.901 qpair failed and we were unable to recover it. 00:26:21.901 [2024-04-16 23:04:12.835831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.901 [2024-04-16 23:04:12.835939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.901 [2024-04-16 23:04:12.835963] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.901 qpair failed and we were unable to recover it. 00:26:21.901 [2024-04-16 23:04:12.836097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.901 [2024-04-16 23:04:12.836273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.901 [2024-04-16 23:04:12.836315] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.901 qpair failed and we were unable to recover it. 00:26:21.901 [2024-04-16 23:04:12.836493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.901 [2024-04-16 23:04:12.836673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.901 [2024-04-16 23:04:12.836700] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.901 qpair failed and we were unable to recover it. 00:26:21.901 [2024-04-16 23:04:12.836886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.901 [2024-04-16 23:04:12.837002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.901 [2024-04-16 23:04:12.837029] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.901 qpair failed and we were unable to recover it. 00:26:21.901 [2024-04-16 23:04:12.837173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.901 [2024-04-16 23:04:12.837339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.901 [2024-04-16 23:04:12.837367] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.901 qpair failed and we were unable to recover it. 00:26:21.901 [2024-04-16 23:04:12.837531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.901 [2024-04-16 23:04:12.837678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.901 [2024-04-16 23:04:12.837703] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.901 qpair failed and we were unable to recover it. 00:26:21.901 [2024-04-16 23:04:12.837873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.901 [2024-04-16 23:04:12.838008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.901 [2024-04-16 23:04:12.838032] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.901 qpair failed and we were unable to recover it. 00:26:21.902 [2024-04-16 23:04:12.838184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.902 [2024-04-16 23:04:12.838356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.902 [2024-04-16 23:04:12.838384] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.902 qpair failed and we were unable to recover it. 00:26:21.902 [2024-04-16 23:04:12.838537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.902 [2024-04-16 23:04:12.838655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.902 [2024-04-16 23:04:12.838682] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.902 qpair failed and we were unable to recover it. 00:26:21.902 [2024-04-16 23:04:12.838839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.902 [2024-04-16 23:04:12.838959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.902 [2024-04-16 23:04:12.838984] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.902 qpair failed and we were unable to recover it. 00:26:21.902 [2024-04-16 23:04:12.839142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.902 [2024-04-16 23:04:12.839348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.902 [2024-04-16 23:04:12.839376] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.902 qpair failed and we were unable to recover it. 00:26:21.902 [2024-04-16 23:04:12.839523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.902 [2024-04-16 23:04:12.839676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.902 [2024-04-16 23:04:12.839704] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.902 qpair failed and we were unable to recover it. 00:26:21.902 [2024-04-16 23:04:12.839850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.902 [2024-04-16 23:04:12.839971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.902 [2024-04-16 23:04:12.839998] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.902 qpair failed and we were unable to recover it. 00:26:21.902 [2024-04-16 23:04:12.840155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.902 [2024-04-16 23:04:12.840332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.902 [2024-04-16 23:04:12.840374] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.902 qpair failed and we were unable to recover it. 00:26:21.902 [2024-04-16 23:04:12.840535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.902 [2024-04-16 23:04:12.840717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.902 [2024-04-16 23:04:12.840745] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.902 qpair failed and we were unable to recover it. 00:26:21.902 [2024-04-16 23:04:12.840905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.902 [2024-04-16 23:04:12.841061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.902 [2024-04-16 23:04:12.841088] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.902 qpair failed and we were unable to recover it. 00:26:21.902 [2024-04-16 23:04:12.841280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.902 [2024-04-16 23:04:12.841391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.902 [2024-04-16 23:04:12.841416] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.902 qpair failed and we were unable to recover it. 00:26:21.902 [2024-04-16 23:04:12.841587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.902 [2024-04-16 23:04:12.841742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.902 [2024-04-16 23:04:12.841769] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.902 qpair failed and we were unable to recover it. 00:26:21.902 [2024-04-16 23:04:12.841920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.902 [2024-04-16 23:04:12.842100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.902 [2024-04-16 23:04:12.842127] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.902 qpair failed and we were unable to recover it. 00:26:21.902 [2024-04-16 23:04:12.842288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.902 [2024-04-16 23:04:12.842394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.902 [2024-04-16 23:04:12.842419] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.902 qpair failed and we were unable to recover it. 00:26:21.902 [2024-04-16 23:04:12.842595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.902 [2024-04-16 23:04:12.842727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.902 [2024-04-16 23:04:12.842754] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.902 qpair failed and we were unable to recover it. 00:26:21.902 [2024-04-16 23:04:12.842952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.902 [2024-04-16 23:04:12.843110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.902 [2024-04-16 23:04:12.843139] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.902 qpair failed and we were unable to recover it. 00:26:21.902 [2024-04-16 23:04:12.843302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.902 [2024-04-16 23:04:12.843427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.902 [2024-04-16 23:04:12.843454] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.902 qpair failed and we were unable to recover it. 00:26:21.902 [2024-04-16 23:04:12.843640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.902 [2024-04-16 23:04:12.843815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.902 [2024-04-16 23:04:12.843846] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.902 qpair failed and we were unable to recover it. 00:26:21.902 [2024-04-16 23:04:12.844020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.902 [2024-04-16 23:04:12.844185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.902 [2024-04-16 23:04:12.844213] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.902 qpair failed and we were unable to recover it. 00:26:21.902 [2024-04-16 23:04:12.844400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.902 [2024-04-16 23:04:12.844543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.902 [2024-04-16 23:04:12.844568] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.902 qpair failed and we were unable to recover it. 00:26:21.902 [2024-04-16 23:04:12.844736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.902 [2024-04-16 23:04:12.844906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.902 [2024-04-16 23:04:12.844938] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.902 qpair failed and we were unable to recover it. 00:26:21.902 [2024-04-16 23:04:12.845087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.902 [2024-04-16 23:04:12.845231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.902 [2024-04-16 23:04:12.845259] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.902 qpair failed and we were unable to recover it. 00:26:21.902 [2024-04-16 23:04:12.845410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.902 [2024-04-16 23:04:12.845537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.902 [2024-04-16 23:04:12.845564] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.902 qpair failed and we were unable to recover it. 00:26:21.902 [2024-04-16 23:04:12.845728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.902 [2024-04-16 23:04:12.845868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.902 [2024-04-16 23:04:12.845892] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.902 qpair failed and we were unable to recover it. 00:26:21.902 [2024-04-16 23:04:12.846063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.903 [2024-04-16 23:04:12.846188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.903 [2024-04-16 23:04:12.846216] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.903 qpair failed and we were unable to recover it. 00:26:21.903 [2024-04-16 23:04:12.846338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.903 [2024-04-16 23:04:12.846486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.903 [2024-04-16 23:04:12.846513] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.903 qpair failed and we were unable to recover it. 00:26:21.903 [2024-04-16 23:04:12.846642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.903 [2024-04-16 23:04:12.846756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.903 [2024-04-16 23:04:12.846784] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.903 qpair failed and we were unable to recover it. 00:26:21.903 [2024-04-16 23:04:12.846952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.903 [2024-04-16 23:04:12.847092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.903 [2024-04-16 23:04:12.847118] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.903 qpair failed and we were unable to recover it. 00:26:21.903 [2024-04-16 23:04:12.847280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.903 [2024-04-16 23:04:12.847404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.903 [2024-04-16 23:04:12.847432] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.903 qpair failed and we were unable to recover it. 00:26:21.903 [2024-04-16 23:04:12.847612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.903 [2024-04-16 23:04:12.847806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.903 [2024-04-16 23:04:12.847831] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.903 qpair failed and we were unable to recover it. 00:26:21.903 [2024-04-16 23:04:12.847935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.903 [2024-04-16 23:04:12.848102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.903 [2024-04-16 23:04:12.848131] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.903 qpair failed and we were unable to recover it. 00:26:21.903 [2024-04-16 23:04:12.848282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.903 [2024-04-16 23:04:12.848429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.903 [2024-04-16 23:04:12.848455] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.903 qpair failed and we were unable to recover it. 00:26:21.903 [2024-04-16 23:04:12.848586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.903 [2024-04-16 23:04:12.848711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.903 [2024-04-16 23:04:12.848738] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.903 qpair failed and we were unable to recover it. 00:26:21.903 [2024-04-16 23:04:12.848908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.903 [2024-04-16 23:04:12.849053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.903 [2024-04-16 23:04:12.849078] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.903 qpair failed and we were unable to recover it. 00:26:21.903 [2024-04-16 23:04:12.849193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.903 [2024-04-16 23:04:12.849336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.903 [2024-04-16 23:04:12.849360] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.903 qpair failed and we were unable to recover it. 00:26:21.903 [2024-04-16 23:04:12.849477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.903 [2024-04-16 23:04:12.849624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.903 [2024-04-16 23:04:12.849649] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.903 qpair failed and we were unable to recover it. 00:26:21.903 [2024-04-16 23:04:12.849821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.903 [2024-04-16 23:04:12.849930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.903 [2024-04-16 23:04:12.849954] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.903 qpair failed and we were unable to recover it. 00:26:21.903 [2024-04-16 23:04:12.850123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.903 [2024-04-16 23:04:12.850268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.903 [2024-04-16 23:04:12.850296] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.903 qpair failed and we were unable to recover it. 00:26:21.903 [2024-04-16 23:04:12.850459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.903 [2024-04-16 23:04:12.850578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.903 [2024-04-16 23:04:12.850602] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.903 qpair failed and we were unable to recover it. 00:26:21.903 [2024-04-16 23:04:12.850741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.903 [2024-04-16 23:04:12.850856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.903 [2024-04-16 23:04:12.850881] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.903 qpair failed and we were unable to recover it. 00:26:21.903 [2024-04-16 23:04:12.851014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.903 [2024-04-16 23:04:12.851144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.903 [2024-04-16 23:04:12.851172] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.903 qpair failed and we were unable to recover it. 00:26:21.903 [2024-04-16 23:04:12.851343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.903 [2024-04-16 23:04:12.851525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.903 [2024-04-16 23:04:12.851550] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.903 qpair failed and we were unable to recover it. 00:26:21.903 [2024-04-16 23:04:12.851692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.903 [2024-04-16 23:04:12.851869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.903 [2024-04-16 23:04:12.851895] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.903 qpair failed and we were unable to recover it. 00:26:21.903 [2024-04-16 23:04:12.852011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.903 [2024-04-16 23:04:12.852132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.903 [2024-04-16 23:04:12.852157] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.903 qpair failed and we were unable to recover it. 00:26:21.903 [2024-04-16 23:04:12.852331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.903 [2024-04-16 23:04:12.852512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.903 [2024-04-16 23:04:12.852537] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.903 qpair failed and we were unable to recover it. 00:26:21.903 [2024-04-16 23:04:12.852685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.903 [2024-04-16 23:04:12.852861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.903 [2024-04-16 23:04:12.852887] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.903 qpair failed and we were unable to recover it. 00:26:21.903 [2024-04-16 23:04:12.853006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.903 [2024-04-16 23:04:12.853190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.903 [2024-04-16 23:04:12.853219] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.903 qpair failed and we were unable to recover it. 00:26:21.903 [2024-04-16 23:04:12.853355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.903 [2024-04-16 23:04:12.853475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.903 [2024-04-16 23:04:12.853500] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.903 qpair failed and we were unable to recover it. 00:26:21.903 [2024-04-16 23:04:12.853644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.903 [2024-04-16 23:04:12.853808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.903 [2024-04-16 23:04:12.853835] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.903 qpair failed and we were unable to recover it. 00:26:21.903 [2024-04-16 23:04:12.854001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.903 [2024-04-16 23:04:12.854139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.903 [2024-04-16 23:04:12.854163] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.903 qpair failed and we were unable to recover it. 00:26:21.903 [2024-04-16 23:04:12.854339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.903 [2024-04-16 23:04:12.854521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.903 [2024-04-16 23:04:12.854574] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.904 qpair failed and we were unable to recover it. 00:26:21.904 [2024-04-16 23:04:12.854720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.904 [2024-04-16 23:04:12.854836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.904 [2024-04-16 23:04:12.854862] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.904 qpair failed and we were unable to recover it. 00:26:21.904 [2024-04-16 23:04:12.855000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.904 [2024-04-16 23:04:12.855160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.904 [2024-04-16 23:04:12.855205] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.904 qpair failed and we were unable to recover it. 00:26:21.904 [2024-04-16 23:04:12.855336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.904 [2024-04-16 23:04:12.855488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.904 [2024-04-16 23:04:12.855515] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.904 qpair failed and we were unable to recover it. 00:26:21.904 [2024-04-16 23:04:12.855704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.904 [2024-04-16 23:04:12.855844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.904 [2024-04-16 23:04:12.855868] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.904 qpair failed and we were unable to recover it. 00:26:21.904 [2024-04-16 23:04:12.856068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.904 [2024-04-16 23:04:12.856236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.904 [2024-04-16 23:04:12.856261] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.904 qpair failed and we were unable to recover it. 00:26:21.904 [2024-04-16 23:04:12.856398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.904 [2024-04-16 23:04:12.856559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.904 [2024-04-16 23:04:12.856587] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.904 qpair failed and we were unable to recover it. 00:26:21.904 [2024-04-16 23:04:12.856724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.904 [2024-04-16 23:04:12.856906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.904 [2024-04-16 23:04:12.856933] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.904 qpair failed and we were unable to recover it. 00:26:21.904 [2024-04-16 23:04:12.857056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.904 [2024-04-16 23:04:12.857173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.904 [2024-04-16 23:04:12.857209] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.904 qpair failed and we were unable to recover it. 00:26:21.904 [2024-04-16 23:04:12.857377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.904 [2024-04-16 23:04:12.857489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.904 [2024-04-16 23:04:12.857514] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.904 qpair failed and we were unable to recover it. 00:26:21.904 [2024-04-16 23:04:12.857670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.904 [2024-04-16 23:04:12.857822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.904 [2024-04-16 23:04:12.857850] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.904 qpair failed and we were unable to recover it. 00:26:21.904 [2024-04-16 23:04:12.857981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.904 [2024-04-16 23:04:12.858133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.904 [2024-04-16 23:04:12.858161] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.904 qpair failed and we were unable to recover it. 00:26:21.904 [2024-04-16 23:04:12.858327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.904 [2024-04-16 23:04:12.858453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.904 [2024-04-16 23:04:12.858480] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.904 qpair failed and we were unable to recover it. 00:26:21.904 [2024-04-16 23:04:12.858614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.904 [2024-04-16 23:04:12.858753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.904 [2024-04-16 23:04:12.858778] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.904 qpair failed and we were unable to recover it. 00:26:21.904 [2024-04-16 23:04:12.858906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.904 [2024-04-16 23:04:12.859053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.904 [2024-04-16 23:04:12.859080] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.904 qpair failed and we were unable to recover it. 00:26:21.904 [2024-04-16 23:04:12.859235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.904 [2024-04-16 23:04:12.859389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.904 [2024-04-16 23:04:12.859416] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.904 qpair failed and we were unable to recover it. 00:26:21.904 [2024-04-16 23:04:12.859537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.904 [2024-04-16 23:04:12.859728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.904 [2024-04-16 23:04:12.859756] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.904 qpair failed and we were unable to recover it. 00:26:21.904 [2024-04-16 23:04:12.859907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.904 [2024-04-16 23:04:12.860023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.904 [2024-04-16 23:04:12.860047] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.904 qpair failed and we were unable to recover it. 00:26:21.904 [2024-04-16 23:04:12.860239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.904 [2024-04-16 23:04:12.860361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.904 [2024-04-16 23:04:12.860388] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.904 qpair failed and we were unable to recover it. 00:26:21.904 [2024-04-16 23:04:12.860539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.904 [2024-04-16 23:04:12.860659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.904 [2024-04-16 23:04:12.860686] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.904 qpair failed and we were unable to recover it. 00:26:21.904 [2024-04-16 23:04:12.860839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.904 [2024-04-16 23:04:12.860965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.904 [2024-04-16 23:04:12.860992] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.904 qpair failed and we were unable to recover it. 00:26:21.904 [2024-04-16 23:04:12.861150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.904 [2024-04-16 23:04:12.861311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.904 [2024-04-16 23:04:12.861358] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.904 qpair failed and we were unable to recover it. 00:26:21.904 [2024-04-16 23:04:12.861494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.904 [2024-04-16 23:04:12.861646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.904 [2024-04-16 23:04:12.861673] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.904 qpair failed and we were unable to recover it. 00:26:21.904 [2024-04-16 23:04:12.861828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.904 [2024-04-16 23:04:12.861976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.904 [2024-04-16 23:04:12.862003] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.904 qpair failed and we were unable to recover it. 00:26:21.904 [2024-04-16 23:04:12.862123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.904 [2024-04-16 23:04:12.862251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.904 [2024-04-16 23:04:12.862279] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.904 qpair failed and we were unable to recover it. 00:26:21.904 [2024-04-16 23:04:12.862443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.904 [2024-04-16 23:04:12.862559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.904 [2024-04-16 23:04:12.862584] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.904 qpair failed and we were unable to recover it. 00:26:21.904 [2024-04-16 23:04:12.862719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.904 [2024-04-16 23:04:12.862881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.904 [2024-04-16 23:04:12.862908] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.904 qpair failed and we were unable to recover it. 00:26:21.904 [2024-04-16 23:04:12.863031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.904 [2024-04-16 23:04:12.863185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.905 [2024-04-16 23:04:12.863214] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.905 qpair failed and we were unable to recover it. 00:26:21.905 [2024-04-16 23:04:12.863332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.905 [2024-04-16 23:04:12.863497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.905 [2024-04-16 23:04:12.863522] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.905 qpair failed and we were unable to recover it. 00:26:21.905 [2024-04-16 23:04:12.863663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.905 [2024-04-16 23:04:12.863798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.905 [2024-04-16 23:04:12.863822] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.905 qpair failed and we were unable to recover it. 00:26:21.905 [2024-04-16 23:04:12.863994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.905 [2024-04-16 23:04:12.864108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.905 [2024-04-16 23:04:12.864135] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.905 qpair failed and we were unable to recover it. 00:26:21.905 [2024-04-16 23:04:12.864281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.905 [2024-04-16 23:04:12.864425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.905 [2024-04-16 23:04:12.864451] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.905 qpair failed and we were unable to recover it. 00:26:21.905 [2024-04-16 23:04:12.864601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.905 [2024-04-16 23:04:12.864782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.905 [2024-04-16 23:04:12.864810] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.905 qpair failed and we were unable to recover it. 00:26:21.905 [2024-04-16 23:04:12.864946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.905 [2024-04-16 23:04:12.865057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.905 [2024-04-16 23:04:12.865081] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.905 qpair failed and we were unable to recover it. 00:26:21.905 [2024-04-16 23:04:12.865234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.905 [2024-04-16 23:04:12.865386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.905 [2024-04-16 23:04:12.865414] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.905 qpair failed and we were unable to recover it. 00:26:21.905 [2024-04-16 23:04:12.865566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.905 [2024-04-16 23:04:12.865686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.905 [2024-04-16 23:04:12.865715] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.905 qpair failed and we were unable to recover it. 00:26:21.905 [2024-04-16 23:04:12.865898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.905 [2024-04-16 23:04:12.866021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.905 [2024-04-16 23:04:12.866049] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.905 qpair failed and we were unable to recover it. 00:26:21.905 [2024-04-16 23:04:12.866207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.905 [2024-04-16 23:04:12.866378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.905 [2024-04-16 23:04:12.866419] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.905 qpair failed and we were unable to recover it. 00:26:21.905 [2024-04-16 23:04:12.866586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.905 [2024-04-16 23:04:12.866726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.905 [2024-04-16 23:04:12.866751] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.905 qpair failed and we were unable to recover it. 00:26:21.905 [2024-04-16 23:04:12.866903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.905 [2024-04-16 23:04:12.867096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.905 [2024-04-16 23:04:12.867123] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.905 qpair failed and we were unable to recover it. 00:26:21.905 [2024-04-16 23:04:12.867256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.905 [2024-04-16 23:04:12.867365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.905 [2024-04-16 23:04:12.867391] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.905 qpair failed and we were unable to recover it. 00:26:21.905 [2024-04-16 23:04:12.867509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.905 [2024-04-16 23:04:12.867651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.905 [2024-04-16 23:04:12.867676] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.905 qpair failed and we were unable to recover it. 00:26:21.905 [2024-04-16 23:04:12.867841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.905 [2024-04-16 23:04:12.867950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.905 [2024-04-16 23:04:12.867976] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.905 qpair failed and we were unable to recover it. 00:26:21.905 [2024-04-16 23:04:12.868112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.905 [2024-04-16 23:04:12.868277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.905 [2024-04-16 23:04:12.868318] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.905 qpair failed and we were unable to recover it. 00:26:21.905 [2024-04-16 23:04:12.868445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.905 [2024-04-16 23:04:12.868560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.905 [2024-04-16 23:04:12.868587] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.905 qpair failed and we were unable to recover it. 00:26:21.905 [2024-04-16 23:04:12.868744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.905 [2024-04-16 23:04:12.868884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.905 [2024-04-16 23:04:12.868909] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.905 qpair failed and we were unable to recover it. 00:26:21.905 [2024-04-16 23:04:12.869071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.905 [2024-04-16 23:04:12.869200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.905 [2024-04-16 23:04:12.869229] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.905 qpair failed and we were unable to recover it. 00:26:21.905 [2024-04-16 23:04:12.869356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.905 [2024-04-16 23:04:12.869518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.905 [2024-04-16 23:04:12.869543] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.905 qpair failed and we were unable to recover it. 00:26:21.905 [2024-04-16 23:04:12.869700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.905 [2024-04-16 23:04:12.869843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.905 [2024-04-16 23:04:12.869867] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.905 qpair failed and we were unable to recover it. 00:26:21.905 [2024-04-16 23:04:12.870004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.905 [2024-04-16 23:04:12.870138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.905 [2024-04-16 23:04:12.870163] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.905 qpair failed and we were unable to recover it. 00:26:21.905 [2024-04-16 23:04:12.870353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.905 [2024-04-16 23:04:12.870466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.905 [2024-04-16 23:04:12.870490] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.905 qpair failed and we were unable to recover it. 00:26:21.905 [2024-04-16 23:04:12.870598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.905 [2024-04-16 23:04:12.870733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.905 [2024-04-16 23:04:12.870758] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.905 qpair failed and we were unable to recover it. 00:26:21.905 [2024-04-16 23:04:12.870901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.905 [2024-04-16 23:04:12.871031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.905 [2024-04-16 23:04:12.871059] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.905 qpair failed and we were unable to recover it. 00:26:21.905 [2024-04-16 23:04:12.871215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.906 [2024-04-16 23:04:12.871355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.906 [2024-04-16 23:04:12.871380] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.906 qpair failed and we were unable to recover it. 00:26:21.906 [2024-04-16 23:04:12.871495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.906 [2024-04-16 23:04:12.871658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.906 [2024-04-16 23:04:12.871683] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.906 qpair failed and we were unable to recover it. 00:26:21.906 [2024-04-16 23:04:12.871848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.906 [2024-04-16 23:04:12.871987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.906 [2024-04-16 23:04:12.872011] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.906 qpair failed and we were unable to recover it. 00:26:21.906 [2024-04-16 23:04:12.872185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.906 [2024-04-16 23:04:12.872335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.906 [2024-04-16 23:04:12.872363] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.906 qpair failed and we were unable to recover it. 00:26:21.906 [2024-04-16 23:04:12.872493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.906 [2024-04-16 23:04:12.872642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.906 [2024-04-16 23:04:12.872666] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.906 qpair failed and we were unable to recover it. 00:26:21.906 [2024-04-16 23:04:12.872834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.906 [2024-04-16 23:04:12.873014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.906 [2024-04-16 23:04:12.873039] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.906 qpair failed and we were unable to recover it. 00:26:21.906 [2024-04-16 23:04:12.873188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.906 [2024-04-16 23:04:12.873350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.906 [2024-04-16 23:04:12.873377] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.906 qpair failed and we were unable to recover it. 00:26:21.906 [2024-04-16 23:04:12.873507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.906 [2024-04-16 23:04:12.873674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.906 [2024-04-16 23:04:12.873698] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.906 qpair failed and we were unable to recover it. 00:26:21.906 [2024-04-16 23:04:12.873864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.906 [2024-04-16 23:04:12.873998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.906 [2024-04-16 23:04:12.874039] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.906 qpair failed and we were unable to recover it. 00:26:21.906 [2024-04-16 23:04:12.874190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.906 [2024-04-16 23:04:12.874313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.906 [2024-04-16 23:04:12.874341] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.906 qpair failed and we were unable to recover it. 00:26:21.906 [2024-04-16 23:04:12.874499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.906 [2024-04-16 23:04:12.874673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.906 [2024-04-16 23:04:12.874698] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.906 qpair failed and we were unable to recover it. 00:26:21.906 [2024-04-16 23:04:12.874845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.906 [2024-04-16 23:04:12.875021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.906 [2024-04-16 23:04:12.875045] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.906 qpair failed and we were unable to recover it. 00:26:21.906 [2024-04-16 23:04:12.875218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.906 [2024-04-16 23:04:12.875341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.906 [2024-04-16 23:04:12.875384] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.906 qpair failed and we were unable to recover it. 00:26:21.906 [2024-04-16 23:04:12.875549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.906 [2024-04-16 23:04:12.875680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.906 [2024-04-16 23:04:12.875707] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.906 qpair failed and we were unable to recover it. 00:26:21.906 [2024-04-16 23:04:12.875863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.906 [2024-04-16 23:04:12.876044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.906 [2024-04-16 23:04:12.876071] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.906 qpair failed and we were unable to recover it. 00:26:21.906 [2024-04-16 23:04:12.876254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.906 [2024-04-16 23:04:12.876438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.906 [2024-04-16 23:04:12.876465] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.906 qpair failed and we were unable to recover it. 00:26:21.906 [2024-04-16 23:04:12.876630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.906 [2024-04-16 23:04:12.876734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.906 [2024-04-16 23:04:12.876759] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.906 qpair failed and we were unable to recover it. 00:26:21.906 [2024-04-16 23:04:12.876906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.906 [2024-04-16 23:04:12.877060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.906 [2024-04-16 23:04:12.877088] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.906 qpair failed and we were unable to recover it. 00:26:21.906 [2024-04-16 23:04:12.877268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.906 [2024-04-16 23:04:12.877425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.906 [2024-04-16 23:04:12.877453] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.906 qpair failed and we were unable to recover it. 00:26:21.906 [2024-04-16 23:04:12.877580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.906 [2024-04-16 23:04:12.877762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.906 [2024-04-16 23:04:12.877796] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.906 qpair failed and we were unable to recover it. 00:26:21.906 [2024-04-16 23:04:12.877954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.906 [2024-04-16 23:04:12.878096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.906 [2024-04-16 23:04:12.878121] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.906 qpair failed and we were unable to recover it. 00:26:21.906 [2024-04-16 23:04:12.878324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.906 [2024-04-16 23:04:12.878444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.906 [2024-04-16 23:04:12.878473] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.906 qpair failed and we were unable to recover it. 00:26:21.906 [2024-04-16 23:04:12.878663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.906 [2024-04-16 23:04:12.878817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.906 [2024-04-16 23:04:12.878844] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.906 qpair failed and we were unable to recover it. 00:26:21.906 [2024-04-16 23:04:12.879037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.906 [2024-04-16 23:04:12.879190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.906 [2024-04-16 23:04:12.879219] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.906 qpair failed and we were unable to recover it. 00:26:21.906 [2024-04-16 23:04:12.879355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.906 [2024-04-16 23:04:12.879491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.906 [2024-04-16 23:04:12.879516] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.906 qpair failed and we were unable to recover it. 00:26:21.906 [2024-04-16 23:04:12.879711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.906 [2024-04-16 23:04:12.879868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.906 [2024-04-16 23:04:12.879893] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.906 qpair failed and we were unable to recover it. 00:26:21.906 [2024-04-16 23:04:12.880062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.906 [2024-04-16 23:04:12.880262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.906 [2024-04-16 23:04:12.880290] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.906 qpair failed and we were unable to recover it. 00:26:21.906 [2024-04-16 23:04:12.880406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.906 [2024-04-16 23:04:12.880560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.906 [2024-04-16 23:04:12.880587] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.906 qpair failed and we were unable to recover it. 00:26:21.907 [2024-04-16 23:04:12.880715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.907 [2024-04-16 23:04:12.880857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.907 [2024-04-16 23:04:12.880882] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.907 qpair failed and we were unable to recover it. 00:26:21.907 [2024-04-16 23:04:12.881010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.907 [2024-04-16 23:04:12.881136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.907 [2024-04-16 23:04:12.881170] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.907 qpair failed and we were unable to recover it. 00:26:21.907 [2024-04-16 23:04:12.881329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.907 [2024-04-16 23:04:12.881513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.907 [2024-04-16 23:04:12.881541] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.907 qpair failed and we were unable to recover it. 00:26:21.907 [2024-04-16 23:04:12.881698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.907 [2024-04-16 23:04:12.881881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.907 [2024-04-16 23:04:12.881909] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.907 qpair failed and we were unable to recover it. 00:26:21.907 [2024-04-16 23:04:12.882074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.907 [2024-04-16 23:04:12.882214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.907 [2024-04-16 23:04:12.882256] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.907 qpair failed and we were unable to recover it. 00:26:21.907 [2024-04-16 23:04:12.882414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.907 [2024-04-16 23:04:12.882565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.907 [2024-04-16 23:04:12.882592] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.907 qpair failed and we were unable to recover it. 00:26:21.907 [2024-04-16 23:04:12.882708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.907 [2024-04-16 23:04:12.882890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.907 [2024-04-16 23:04:12.882917] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.907 qpair failed and we were unable to recover it. 00:26:21.907 [2024-04-16 23:04:12.883098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.907 [2024-04-16 23:04:12.883275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.907 [2024-04-16 23:04:12.883304] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.907 qpair failed and we were unable to recover it. 00:26:21.907 [2024-04-16 23:04:12.883462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.907 [2024-04-16 23:04:12.883632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.907 [2024-04-16 23:04:12.883675] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.907 qpair failed and we were unable to recover it. 00:26:21.907 [2024-04-16 23:04:12.883865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.907 [2024-04-16 23:04:12.883991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.907 [2024-04-16 23:04:12.884018] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.907 qpair failed and we were unable to recover it. 00:26:21.907 [2024-04-16 23:04:12.884181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.907 [2024-04-16 23:04:12.884330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.907 [2024-04-16 23:04:12.884357] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.907 qpair failed and we were unable to recover it. 00:26:21.907 [2024-04-16 23:04:12.884546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.907 [2024-04-16 23:04:12.884720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.907 [2024-04-16 23:04:12.884744] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.907 qpair failed and we were unable to recover it. 00:26:21.907 [2024-04-16 23:04:12.884859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.907 [2024-04-16 23:04:12.884996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.907 [2024-04-16 23:04:12.885021] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.907 qpair failed and we were unable to recover it. 00:26:21.907 [2024-04-16 23:04:12.885193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.907 [2024-04-16 23:04:12.885323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.907 [2024-04-16 23:04:12.885350] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.907 qpair failed and we were unable to recover it. 00:26:21.907 [2024-04-16 23:04:12.885482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.907 [2024-04-16 23:04:12.885640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.907 [2024-04-16 23:04:12.885668] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.907 qpair failed and we were unable to recover it. 00:26:21.907 [2024-04-16 23:04:12.885790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.907 [2024-04-16 23:04:12.885936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.907 [2024-04-16 23:04:12.885963] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.907 qpair failed and we were unable to recover it. 00:26:21.907 [2024-04-16 23:04:12.886122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.907 [2024-04-16 23:04:12.886227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.907 [2024-04-16 23:04:12.886253] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.907 qpair failed and we were unable to recover it. 00:26:21.907 [2024-04-16 23:04:12.886389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.907 [2024-04-16 23:04:12.886573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.907 [2024-04-16 23:04:12.886597] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.907 qpair failed and we were unable to recover it. 00:26:21.907 [2024-04-16 23:04:12.886719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.907 [2024-04-16 23:04:12.886914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.907 [2024-04-16 23:04:12.886941] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.907 qpair failed and we were unable to recover it. 00:26:21.907 [2024-04-16 23:04:12.887065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.907 [2024-04-16 23:04:12.887213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.907 [2024-04-16 23:04:12.887242] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.907 qpair failed and we were unable to recover it. 00:26:21.907 [2024-04-16 23:04:12.887406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.907 [2024-04-16 23:04:12.887550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.907 [2024-04-16 23:04:12.887575] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.907 qpair failed and we were unable to recover it. 00:26:21.907 [2024-04-16 23:04:12.887706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.907 [2024-04-16 23:04:12.887828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.907 [2024-04-16 23:04:12.887855] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.907 qpair failed and we were unable to recover it. 00:26:21.907 [2024-04-16 23:04:12.888019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.907 [2024-04-16 23:04:12.888214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.908 [2024-04-16 23:04:12.888239] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.908 qpair failed and we were unable to recover it. 00:26:21.908 [2024-04-16 23:04:12.888361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.908 [2024-04-16 23:04:12.888500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.908 [2024-04-16 23:04:12.888525] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.908 qpair failed and we were unable to recover it. 00:26:21.908 [2024-04-16 23:04:12.888663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.908 [2024-04-16 23:04:12.888779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.908 [2024-04-16 23:04:12.888803] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.908 qpair failed and we were unable to recover it. 00:26:21.908 [2024-04-16 23:04:12.889006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.908 [2024-04-16 23:04:12.889116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.908 [2024-04-16 23:04:12.889143] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.908 qpair failed and we were unable to recover it. 00:26:21.908 [2024-04-16 23:04:12.889289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.908 [2024-04-16 23:04:12.889401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.908 [2024-04-16 23:04:12.889426] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.908 qpair failed and we were unable to recover it. 00:26:21.908 [2024-04-16 23:04:12.889569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.908 [2024-04-16 23:04:12.889749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.908 [2024-04-16 23:04:12.889774] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.908 qpair failed and we were unable to recover it. 00:26:21.908 [2024-04-16 23:04:12.889892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.908 [2024-04-16 23:04:12.890044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.908 [2024-04-16 23:04:12.890069] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.908 qpair failed and we were unable to recover it. 00:26:21.908 [2024-04-16 23:04:12.890259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.908 [2024-04-16 23:04:12.890375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.908 [2024-04-16 23:04:12.890402] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.908 qpair failed and we were unable to recover it. 00:26:21.908 [2024-04-16 23:04:12.890559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.908 [2024-04-16 23:04:12.890723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.908 [2024-04-16 23:04:12.890748] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.908 qpair failed and we were unable to recover it. 00:26:21.908 [2024-04-16 23:04:12.890887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.908 [2024-04-16 23:04:12.891061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.908 [2024-04-16 23:04:12.891086] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.908 qpair failed and we were unable to recover it. 00:26:21.908 [2024-04-16 23:04:12.891220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.908 [2024-04-16 23:04:12.891347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.908 [2024-04-16 23:04:12.891372] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.908 qpair failed and we were unable to recover it. 00:26:21.908 [2024-04-16 23:04:12.891508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.908 [2024-04-16 23:04:12.891652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.908 [2024-04-16 23:04:12.891676] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.908 qpair failed and we were unable to recover it. 00:26:21.908 [2024-04-16 23:04:12.891838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.908 [2024-04-16 23:04:12.891996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.908 [2024-04-16 23:04:12.892024] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.908 qpair failed and we were unable to recover it. 00:26:21.908 [2024-04-16 23:04:12.892153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.908 [2024-04-16 23:04:12.892339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.908 [2024-04-16 23:04:12.892367] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.908 qpair failed and we were unable to recover it. 00:26:21.908 [2024-04-16 23:04:12.892501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.908 [2024-04-16 23:04:12.892616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.908 [2024-04-16 23:04:12.892640] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.908 qpair failed and we were unable to recover it. 00:26:21.908 [2024-04-16 23:04:12.892775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.908 [2024-04-16 23:04:12.892959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.908 [2024-04-16 23:04:12.892984] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.908 qpair failed and we were unable to recover it. 00:26:21.908 [2024-04-16 23:04:12.893133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.908 [2024-04-16 23:04:12.893272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.908 [2024-04-16 23:04:12.893301] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.908 qpair failed and we were unable to recover it. 00:26:21.908 [2024-04-16 23:04:12.893457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.908 [2024-04-16 23:04:12.893622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.908 [2024-04-16 23:04:12.893646] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.908 qpair failed and we were unable to recover it. 00:26:21.908 [2024-04-16 23:04:12.893788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.908 [2024-04-16 23:04:12.893903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.908 [2024-04-16 23:04:12.893929] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.908 qpair failed and we were unable to recover it. 00:26:21.908 [2024-04-16 23:04:12.894110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.908 [2024-04-16 23:04:12.894217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.908 [2024-04-16 23:04:12.894243] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.908 qpair failed and we were unable to recover it. 00:26:21.908 [2024-04-16 23:04:12.894384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.908 [2024-04-16 23:04:12.894528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.908 [2024-04-16 23:04:12.894556] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.908 qpair failed and we were unable to recover it. 00:26:21.908 [2024-04-16 23:04:12.894745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.908 [2024-04-16 23:04:12.894852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.908 [2024-04-16 23:04:12.894877] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.908 qpair failed and we were unable to recover it. 00:26:21.908 [2024-04-16 23:04:12.894994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.908 [2024-04-16 23:04:12.895140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.908 [2024-04-16 23:04:12.895166] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.908 qpair failed and we were unable to recover it. 00:26:21.908 [2024-04-16 23:04:12.895365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.908 [2024-04-16 23:04:12.895535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.908 [2024-04-16 23:04:12.895560] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.908 qpair failed and we were unable to recover it. 00:26:21.908 [2024-04-16 23:04:12.895701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.908 [2024-04-16 23:04:12.895894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.908 [2024-04-16 23:04:12.895921] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.908 qpair failed and we were unable to recover it. 00:26:21.908 [2024-04-16 23:04:12.896040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.908 [2024-04-16 23:04:12.896196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.908 [2024-04-16 23:04:12.896225] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.908 qpair failed and we were unable to recover it. 00:26:21.908 [2024-04-16 23:04:12.896373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.908 [2024-04-16 23:04:12.896484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.908 [2024-04-16 23:04:12.896508] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.908 qpair failed and we were unable to recover it. 00:26:21.908 [2024-04-16 23:04:12.896639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.908 [2024-04-16 23:04:12.896762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.909 [2024-04-16 23:04:12.896789] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.909 qpair failed and we were unable to recover it. 00:26:21.909 [2024-04-16 23:04:12.896942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.909 [2024-04-16 23:04:12.897091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.909 [2024-04-16 23:04:12.897118] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.909 qpair failed and we were unable to recover it. 00:26:21.909 [2024-04-16 23:04:12.897265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.909 [2024-04-16 23:04:12.897449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.909 [2024-04-16 23:04:12.897476] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.909 qpair failed and we were unable to recover it. 00:26:21.909 [2024-04-16 23:04:12.897606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.909 [2024-04-16 23:04:12.897707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.909 [2024-04-16 23:04:12.897735] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.909 qpair failed and we were unable to recover it. 00:26:21.909 [2024-04-16 23:04:12.897848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.909 [2024-04-16 23:04:12.898010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.909 [2024-04-16 23:04:12.898038] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.909 qpair failed and we were unable to recover it. 00:26:21.909 [2024-04-16 23:04:12.898189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.909 [2024-04-16 23:04:12.898342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.909 [2024-04-16 23:04:12.898369] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.909 qpair failed and we were unable to recover it. 00:26:21.909 [2024-04-16 23:04:12.898525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.909 [2024-04-16 23:04:12.898650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.909 [2024-04-16 23:04:12.898679] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.909 qpair failed and we were unable to recover it. 00:26:21.909 [2024-04-16 23:04:12.898873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.909 [2024-04-16 23:04:12.899031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.909 [2024-04-16 23:04:12.899058] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.909 qpair failed and we were unable to recover it. 00:26:21.909 [2024-04-16 23:04:12.899208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.909 [2024-04-16 23:04:12.899352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.909 [2024-04-16 23:04:12.899380] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.909 qpair failed and we were unable to recover it. 00:26:21.909 [2024-04-16 23:04:12.899566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.909 [2024-04-16 23:04:12.899714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.909 [2024-04-16 23:04:12.899741] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.909 qpair failed and we were unable to recover it. 00:26:21.909 [2024-04-16 23:04:12.899920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.909 [2024-04-16 23:04:12.900076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.909 [2024-04-16 23:04:12.900103] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.909 qpair failed and we were unable to recover it. 00:26:21.909 [2024-04-16 23:04:12.900267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.909 [2024-04-16 23:04:12.900408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.909 [2024-04-16 23:04:12.900452] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.909 qpair failed and we were unable to recover it. 00:26:21.909 [2024-04-16 23:04:12.900583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.909 [2024-04-16 23:04:12.900699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.909 [2024-04-16 23:04:12.900726] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.909 qpair failed and we were unable to recover it. 00:26:21.909 [2024-04-16 23:04:12.900907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.909 [2024-04-16 23:04:12.901053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.909 [2024-04-16 23:04:12.901081] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.909 qpair failed and we were unable to recover it. 00:26:21.909 [2024-04-16 23:04:12.901278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.909 [2024-04-16 23:04:12.901401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.909 [2024-04-16 23:04:12.901429] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.909 qpair failed and we were unable to recover it. 00:26:21.909 [2024-04-16 23:04:12.901617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.909 [2024-04-16 23:04:12.901751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.909 [2024-04-16 23:04:12.901792] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.909 qpair failed and we were unable to recover it. 00:26:21.909 [2024-04-16 23:04:12.901947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.909 [2024-04-16 23:04:12.902072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.909 [2024-04-16 23:04:12.902101] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.909 qpair failed and we were unable to recover it. 00:26:21.909 [2024-04-16 23:04:12.902283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.909 [2024-04-16 23:04:12.902430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.909 [2024-04-16 23:04:12.902456] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.909 qpair failed and we were unable to recover it. 00:26:21.909 [2024-04-16 23:04:12.902605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.909 [2024-04-16 23:04:12.902765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.909 [2024-04-16 23:04:12.902789] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.909 qpair failed and we were unable to recover it. 00:26:21.909 [2024-04-16 23:04:12.902925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.909 [2024-04-16 23:04:12.903036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.909 [2024-04-16 23:04:12.903060] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.909 qpair failed and we were unable to recover it. 00:26:21.909 [2024-04-16 23:04:12.903206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.909 [2024-04-16 23:04:12.903340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.909 [2024-04-16 23:04:12.903366] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.909 qpair failed and we were unable to recover it. 00:26:21.909 [2024-04-16 23:04:12.903519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.909 [2024-04-16 23:04:12.903708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.909 [2024-04-16 23:04:12.903758] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.909 qpair failed and we were unable to recover it. 00:26:21.909 [2024-04-16 23:04:12.903912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.909 [2024-04-16 23:04:12.904033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.909 [2024-04-16 23:04:12.904061] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.909 qpair failed and we were unable to recover it. 00:26:21.909 [2024-04-16 23:04:12.904191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.909 [2024-04-16 23:04:12.904335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.909 [2024-04-16 23:04:12.904361] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.909 qpair failed and we were unable to recover it. 00:26:21.909 [2024-04-16 23:04:12.904508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.909 [2024-04-16 23:04:12.904658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.909 [2024-04-16 23:04:12.904686] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.909 qpair failed and we were unable to recover it. 00:26:21.909 [2024-04-16 23:04:12.904854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.909 [2024-04-16 23:04:12.904967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.909 [2024-04-16 23:04:12.904992] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.909 qpair failed and we were unable to recover it. 00:26:21.909 [2024-04-16 23:04:12.905135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.909 [2024-04-16 23:04:12.905280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.909 [2024-04-16 23:04:12.905309] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.909 qpair failed and we were unable to recover it. 00:26:21.909 [2024-04-16 23:04:12.905448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.909 [2024-04-16 23:04:12.905581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.909 [2024-04-16 23:04:12.905605] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.909 qpair failed and we were unable to recover it. 00:26:21.910 [2024-04-16 23:04:12.905776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.910 [2024-04-16 23:04:12.905915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.910 [2024-04-16 23:04:12.905940] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.910 qpair failed and we were unable to recover it. 00:26:21.910 [2024-04-16 23:04:12.906098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.910 [2024-04-16 23:04:12.906261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.910 [2024-04-16 23:04:12.906289] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.910 qpair failed and we were unable to recover it. 00:26:21.910 [2024-04-16 23:04:12.906431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.910 [2024-04-16 23:04:12.906588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.910 [2024-04-16 23:04:12.906615] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.910 qpair failed and we were unable to recover it. 00:26:21.910 [2024-04-16 23:04:12.906774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.910 [2024-04-16 23:04:12.906919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.910 [2024-04-16 23:04:12.906944] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.910 qpair failed and we were unable to recover it. 00:26:21.910 [2024-04-16 23:04:12.907111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.910 [2024-04-16 23:04:12.907269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.910 [2024-04-16 23:04:12.907310] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.910 qpair failed and we were unable to recover it. 00:26:21.910 [2024-04-16 23:04:12.907486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.910 [2024-04-16 23:04:12.907651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.910 [2024-04-16 23:04:12.907678] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.910 qpair failed and we were unable to recover it. 00:26:21.910 [2024-04-16 23:04:12.907861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.910 [2024-04-16 23:04:12.908043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.910 [2024-04-16 23:04:12.908071] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.910 qpair failed and we were unable to recover it. 00:26:21.910 [2024-04-16 23:04:12.908234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.910 [2024-04-16 23:04:12.908353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.910 [2024-04-16 23:04:12.908377] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.910 qpair failed and we were unable to recover it. 00:26:21.910 [2024-04-16 23:04:12.908513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.910 [2024-04-16 23:04:12.908685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.910 [2024-04-16 23:04:12.908712] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.910 qpair failed and we were unable to recover it. 00:26:21.910 [2024-04-16 23:04:12.908848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.910 [2024-04-16 23:04:12.908960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.910 [2024-04-16 23:04:12.908985] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.910 qpair failed and we were unable to recover it. 00:26:21.910 [2024-04-16 23:04:12.909152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.910 [2024-04-16 23:04:12.909323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.910 [2024-04-16 23:04:12.909351] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.910 qpair failed and we were unable to recover it. 00:26:21.910 [2024-04-16 23:04:12.909512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.910 [2024-04-16 23:04:12.909614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.910 [2024-04-16 23:04:12.909638] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.910 qpair failed and we were unable to recover it. 00:26:21.910 [2024-04-16 23:04:12.909796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.910 [2024-04-16 23:04:12.909940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.910 [2024-04-16 23:04:12.909968] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.910 qpair failed and we were unable to recover it. 00:26:21.910 [2024-04-16 23:04:12.910171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.910 [2024-04-16 23:04:12.910288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.910 [2024-04-16 23:04:12.910312] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.910 qpair failed and we were unable to recover it. 00:26:21.910 [2024-04-16 23:04:12.910447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.910 [2024-04-16 23:04:12.910575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.910 [2024-04-16 23:04:12.910604] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.910 qpair failed and we were unable to recover it. 00:26:21.910 [2024-04-16 23:04:12.910748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.910 [2024-04-16 23:04:12.910859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.910 [2024-04-16 23:04:12.910885] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.910 qpair failed and we were unable to recover it. 00:26:21.910 [2024-04-16 23:04:12.911042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.910 [2024-04-16 23:04:12.911231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.910 [2024-04-16 23:04:12.911259] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.910 qpair failed and we were unable to recover it. 00:26:21.910 [2024-04-16 23:04:12.911457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.910 [2024-04-16 23:04:12.911597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.910 [2024-04-16 23:04:12.911622] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.910 qpair failed and we were unable to recover it. 00:26:21.910 [2024-04-16 23:04:12.911759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.910 [2024-04-16 23:04:12.911864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.910 [2024-04-16 23:04:12.911888] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.910 qpair failed and we were unable to recover it. 00:26:21.910 [2024-04-16 23:04:12.912021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.910 [2024-04-16 23:04:12.912158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.910 [2024-04-16 23:04:12.912191] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.910 qpair failed and we were unable to recover it. 00:26:21.910 [2024-04-16 23:04:12.912362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.910 [2024-04-16 23:04:12.912499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.910 [2024-04-16 23:04:12.912523] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.910 qpair failed and we were unable to recover it. 00:26:21.910 [2024-04-16 23:04:12.912716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.910 [2024-04-16 23:04:12.912861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.910 [2024-04-16 23:04:12.912889] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.910 qpair failed and we were unable to recover it. 00:26:21.910 [2024-04-16 23:04:12.913041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.910 [2024-04-16 23:04:12.913217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.910 [2024-04-16 23:04:12.913246] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.910 qpair failed and we were unable to recover it. 00:26:21.910 [2024-04-16 23:04:12.913432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.910 [2024-04-16 23:04:12.913616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.910 [2024-04-16 23:04:12.913644] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.910 qpair failed and we were unable to recover it. 00:26:21.910 [2024-04-16 23:04:12.913836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.910 [2024-04-16 23:04:12.914004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.910 [2024-04-16 23:04:12.914029] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.910 qpair failed and we were unable to recover it. 00:26:21.910 [2024-04-16 23:04:12.914236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.910 [2024-04-16 23:04:12.914404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.910 [2024-04-16 23:04:12.914429] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.910 qpair failed and we were unable to recover it. 00:26:21.910 [2024-04-16 23:04:12.914589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.910 [2024-04-16 23:04:12.914743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.910 [2024-04-16 23:04:12.914775] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.910 qpair failed and we were unable to recover it. 00:26:21.910 [2024-04-16 23:04:12.914908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.910 [2024-04-16 23:04:12.915050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.910 [2024-04-16 23:04:12.915074] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.910 qpair failed and we were unable to recover it. 00:26:21.910 [2024-04-16 23:04:12.915228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.910 [2024-04-16 23:04:12.915382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.911 [2024-04-16 23:04:12.915409] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.911 qpair failed and we were unable to recover it. 00:26:21.911 [2024-04-16 23:04:12.915546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.911 [2024-04-16 23:04:12.915660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.911 [2024-04-16 23:04:12.915687] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.911 qpair failed and we were unable to recover it. 00:26:21.911 [2024-04-16 23:04:12.915843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.911 [2024-04-16 23:04:12.915989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.911 [2024-04-16 23:04:12.916016] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.911 qpair failed and we were unable to recover it. 00:26:21.911 [2024-04-16 23:04:12.916191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.911 [2024-04-16 23:04:12.916328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.911 [2024-04-16 23:04:12.916369] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.911 qpair failed and we were unable to recover it. 00:26:21.911 [2024-04-16 23:04:12.916533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.911 [2024-04-16 23:04:12.916690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.911 [2024-04-16 23:04:12.916714] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.911 qpair failed and we were unable to recover it. 00:26:21.911 [2024-04-16 23:04:12.916854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.911 [2024-04-16 23:04:12.917019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.911 [2024-04-16 23:04:12.917046] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.911 qpair failed and we were unable to recover it. 00:26:21.911 [2024-04-16 23:04:12.917199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.911 [2024-04-16 23:04:12.917350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.911 [2024-04-16 23:04:12.917376] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.911 qpair failed and we were unable to recover it. 00:26:21.911 [2024-04-16 23:04:12.917533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.911 [2024-04-16 23:04:12.917676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.911 [2024-04-16 23:04:12.917701] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.911 qpair failed and we were unable to recover it. 00:26:21.911 [2024-04-16 23:04:12.917871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.911 [2024-04-16 23:04:12.918001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.911 [2024-04-16 23:04:12.918028] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.911 qpair failed and we were unable to recover it. 00:26:21.911 [2024-04-16 23:04:12.918188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.911 [2024-04-16 23:04:12.918312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.911 [2024-04-16 23:04:12.918340] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.911 qpair failed and we were unable to recover it. 00:26:21.911 [2024-04-16 23:04:12.918490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.911 [2024-04-16 23:04:12.918606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.911 [2024-04-16 23:04:12.918633] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.911 qpair failed and we were unable to recover it. 00:26:21.911 [2024-04-16 23:04:12.918819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.911 [2024-04-16 23:04:12.918928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.911 [2024-04-16 23:04:12.918953] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.911 qpair failed and we were unable to recover it. 00:26:21.911 [2024-04-16 23:04:12.919134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.911 [2024-04-16 23:04:12.919280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.911 [2024-04-16 23:04:12.919306] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.911 qpair failed and we were unable to recover it. 00:26:21.911 [2024-04-16 23:04:12.919443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.911 [2024-04-16 23:04:12.919566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.911 [2024-04-16 23:04:12.919593] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.911 qpair failed and we were unable to recover it. 00:26:21.911 [2024-04-16 23:04:12.919776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.911 [2024-04-16 23:04:12.919901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.911 [2024-04-16 23:04:12.919928] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.911 qpair failed and we were unable to recover it. 00:26:21.911 [2024-04-16 23:04:12.920092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.911 [2024-04-16 23:04:12.920209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.911 [2024-04-16 23:04:12.920235] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.911 qpair failed and we were unable to recover it. 00:26:21.911 [2024-04-16 23:04:12.920409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.911 [2024-04-16 23:04:12.920527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.911 [2024-04-16 23:04:12.920554] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.911 qpair failed and we were unable to recover it. 00:26:21.911 [2024-04-16 23:04:12.920734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.911 [2024-04-16 23:04:12.920886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.911 [2024-04-16 23:04:12.920914] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.911 qpair failed and we were unable to recover it. 00:26:21.911 [2024-04-16 23:04:12.921099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.911 [2024-04-16 23:04:12.921245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.911 [2024-04-16 23:04:12.921274] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.911 qpair failed and we were unable to recover it. 00:26:21.911 [2024-04-16 23:04:12.921411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.911 [2024-04-16 23:04:12.921524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.911 [2024-04-16 23:04:12.921548] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.911 qpair failed and we were unable to recover it. 00:26:21.911 [2024-04-16 23:04:12.921708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.911 [2024-04-16 23:04:12.921831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.911 [2024-04-16 23:04:12.921859] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.911 qpair failed and we were unable to recover it. 00:26:21.911 [2024-04-16 23:04:12.922010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.911 [2024-04-16 23:04:12.922131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.911 [2024-04-16 23:04:12.922159] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.911 qpair failed and we were unable to recover it. 00:26:21.911 [2024-04-16 23:04:12.922358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.911 [2024-04-16 23:04:12.922483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.911 [2024-04-16 23:04:12.922511] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.911 qpair failed and we were unable to recover it. 00:26:21.911 [2024-04-16 23:04:12.922638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.911 [2024-04-16 23:04:12.922806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.911 [2024-04-16 23:04:12.922830] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.911 qpair failed and we were unable to recover it. 00:26:21.911 [2024-04-16 23:04:12.922995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.911 [2024-04-16 23:04:12.923124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.911 [2024-04-16 23:04:12.923153] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.911 qpair failed and we were unable to recover it. 00:26:21.911 [2024-04-16 23:04:12.923329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.911 [2024-04-16 23:04:12.923462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.911 [2024-04-16 23:04:12.923487] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.911 qpair failed and we were unable to recover it. 00:26:21.911 [2024-04-16 23:04:12.923595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.911 [2024-04-16 23:04:12.923731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.912 [2024-04-16 23:04:12.923756] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.912 qpair failed and we were unable to recover it. 00:26:21.912 [2024-04-16 23:04:12.923868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.912 [2024-04-16 23:04:12.923981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.912 [2024-04-16 23:04:12.924005] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.912 qpair failed and we were unable to recover it. 00:26:21.912 [2024-04-16 23:04:12.924145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.912 [2024-04-16 23:04:12.924323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.912 [2024-04-16 23:04:12.924351] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.912 qpair failed and we were unable to recover it. 00:26:21.912 [2024-04-16 23:04:12.924472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.912 [2024-04-16 23:04:12.924629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.912 [2024-04-16 23:04:12.924656] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.912 qpair failed and we were unable to recover it. 00:26:21.912 [2024-04-16 23:04:12.924846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.912 [2024-04-16 23:04:12.924956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.912 [2024-04-16 23:04:12.924980] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.912 qpair failed and we were unable to recover it. 00:26:21.912 [2024-04-16 23:04:12.925094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.912 [2024-04-16 23:04:12.925234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.912 [2024-04-16 23:04:12.925260] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.912 qpair failed and we were unable to recover it. 00:26:21.912 [2024-04-16 23:04:12.925398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.912 [2024-04-16 23:04:12.925514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.912 [2024-04-16 23:04:12.925539] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.912 qpair failed and we were unable to recover it. 00:26:21.912 [2024-04-16 23:04:12.925677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.912 [2024-04-16 23:04:12.925783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.912 [2024-04-16 23:04:12.925807] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.912 qpair failed and we were unable to recover it. 00:26:21.912 [2024-04-16 23:04:12.925939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.912 [2024-04-16 23:04:12.926052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.912 [2024-04-16 23:04:12.926079] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.912 qpair failed and we were unable to recover it. 00:26:21.912 [2024-04-16 23:04:12.926202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.912 [2024-04-16 23:04:12.926346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.912 [2024-04-16 23:04:12.926371] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.912 qpair failed and we were unable to recover it. 00:26:21.912 [2024-04-16 23:04:12.926564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.912 [2024-04-16 23:04:12.926717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.912 [2024-04-16 23:04:12.926745] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.912 qpair failed and we were unable to recover it. 00:26:21.912 [2024-04-16 23:04:12.926896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.912 [2024-04-16 23:04:12.927056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.912 [2024-04-16 23:04:12.927081] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.912 qpair failed and we were unable to recover it. 00:26:21.912 [2024-04-16 23:04:12.927192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.912 [2024-04-16 23:04:12.927312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.912 [2024-04-16 23:04:12.927336] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.912 qpair failed and we were unable to recover it. 00:26:21.912 [2024-04-16 23:04:12.927478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.912 [2024-04-16 23:04:12.927596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.912 [2024-04-16 23:04:12.927621] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.912 qpair failed and we were unable to recover it. 00:26:21.912 [2024-04-16 23:04:12.927763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.912 [2024-04-16 23:04:12.927897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.912 [2024-04-16 23:04:12.927926] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.912 qpair failed and we were unable to recover it. 00:26:21.912 [2024-04-16 23:04:12.928095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.912 [2024-04-16 23:04:12.928241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.912 [2024-04-16 23:04:12.928267] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.912 qpair failed and we were unable to recover it. 00:26:21.912 [2024-04-16 23:04:12.928384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.912 [2024-04-16 23:04:12.928544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.912 [2024-04-16 23:04:12.928572] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.912 qpair failed and we were unable to recover it. 00:26:21.912 [2024-04-16 23:04:12.928742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.912 [2024-04-16 23:04:12.928878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.912 [2024-04-16 23:04:12.928903] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.912 qpair failed and we were unable to recover it. 00:26:21.912 [2024-04-16 23:04:12.929046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.912 [2024-04-16 23:04:12.929236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.912 [2024-04-16 23:04:12.929266] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.912 qpair failed and we were unable to recover it. 00:26:21.912 [2024-04-16 23:04:12.929437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.912 [2024-04-16 23:04:12.929559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.912 [2024-04-16 23:04:12.929584] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.912 qpair failed and we were unable to recover it. 00:26:21.912 [2024-04-16 23:04:12.929748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.912 [2024-04-16 23:04:12.929915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.912 [2024-04-16 23:04:12.929940] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.912 qpair failed and we were unable to recover it. 00:26:21.912 [2024-04-16 23:04:12.930058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.912 [2024-04-16 23:04:12.930201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.912 [2024-04-16 23:04:12.930226] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.912 qpair failed and we were unable to recover it. 00:26:21.912 [2024-04-16 23:04:12.930361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.912 [2024-04-16 23:04:12.930552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.912 [2024-04-16 23:04:12.930577] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.912 qpair failed and we were unable to recover it. 00:26:21.912 [2024-04-16 23:04:12.930762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.912 [2024-04-16 23:04:12.930880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.913 [2024-04-16 23:04:12.930912] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.913 qpair failed and we were unable to recover it. 00:26:21.913 [2024-04-16 23:04:12.931044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.913 [2024-04-16 23:04:12.931170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.913 [2024-04-16 23:04:12.931207] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.913 qpair failed and we were unable to recover it. 00:26:21.913 [2024-04-16 23:04:12.931337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.913 [2024-04-16 23:04:12.931440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.913 [2024-04-16 23:04:12.931465] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.913 qpair failed and we were unable to recover it. 00:26:21.913 [2024-04-16 23:04:12.931616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.913 [2024-04-16 23:04:12.931772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.913 [2024-04-16 23:04:12.931799] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.913 qpair failed and we were unable to recover it. 00:26:21.913 [2024-04-16 23:04:12.931948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.913 [2024-04-16 23:04:12.932076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.913 [2024-04-16 23:04:12.932103] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.913 qpair failed and we were unable to recover it. 00:26:21.913 [2024-04-16 23:04:12.932272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.913 [2024-04-16 23:04:12.932416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.913 [2024-04-16 23:04:12.932441] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.913 qpair failed and we were unable to recover it. 00:26:21.913 [2024-04-16 23:04:12.932582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.913 [2024-04-16 23:04:12.932715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.913 [2024-04-16 23:04:12.932756] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.913 qpair failed and we were unable to recover it. 00:26:21.913 [2024-04-16 23:04:12.932921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.913 [2024-04-16 23:04:12.933065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.913 [2024-04-16 23:04:12.933089] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.913 qpair failed and we were unable to recover it. 00:26:21.913 [2024-04-16 23:04:12.933254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.913 [2024-04-16 23:04:12.933407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.913 [2024-04-16 23:04:12.933432] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.913 qpair failed and we were unable to recover it. 00:26:21.913 [2024-04-16 23:04:12.933577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.913 [2024-04-16 23:04:12.933763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.913 [2024-04-16 23:04:12.933788] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.913 qpair failed and we were unable to recover it. 00:26:21.913 [2024-04-16 23:04:12.933900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.913 [2024-04-16 23:04:12.934037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.913 [2024-04-16 23:04:12.934066] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.913 qpair failed and we were unable to recover it. 00:26:21.913 [2024-04-16 23:04:12.934183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.913 [2024-04-16 23:04:12.934296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.913 [2024-04-16 23:04:12.934321] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.913 qpair failed and we were unable to recover it. 00:26:21.913 [2024-04-16 23:04:12.934467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.913 [2024-04-16 23:04:12.934607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.913 [2024-04-16 23:04:12.934634] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.913 qpair failed and we were unable to recover it. 00:26:21.913 [2024-04-16 23:04:12.934822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.913 [2024-04-16 23:04:12.934960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.913 [2024-04-16 23:04:12.934985] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.913 qpair failed and we were unable to recover it. 00:26:21.913 [2024-04-16 23:04:12.935096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.913 [2024-04-16 23:04:12.935240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.913 [2024-04-16 23:04:12.935266] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.913 qpair failed and we were unable to recover it. 00:26:21.913 [2024-04-16 23:04:12.935417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.913 [2024-04-16 23:04:12.935564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.913 [2024-04-16 23:04:12.935591] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.913 qpair failed and we were unable to recover it. 00:26:21.913 [2024-04-16 23:04:12.935711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.913 [2024-04-16 23:04:12.935829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.913 [2024-04-16 23:04:12.935856] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.913 qpair failed and we were unable to recover it. 00:26:21.913 [2024-04-16 23:04:12.935984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.913 [2024-04-16 23:04:12.936113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.913 [2024-04-16 23:04:12.936141] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.913 qpair failed and we were unable to recover it. 00:26:21.913 [2024-04-16 23:04:12.936312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.913 [2024-04-16 23:04:12.936449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.913 [2024-04-16 23:04:12.936474] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.913 qpair failed and we were unable to recover it. 00:26:21.913 [2024-04-16 23:04:12.936621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.913 [2024-04-16 23:04:12.936765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.913 [2024-04-16 23:04:12.936790] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.913 qpair failed and we were unable to recover it. 00:26:21.913 [2024-04-16 23:04:12.936962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.913 [2024-04-16 23:04:12.937143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.913 [2024-04-16 23:04:12.937170] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.913 qpair failed and we were unable to recover it. 00:26:21.913 [2024-04-16 23:04:12.937353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.913 [2024-04-16 23:04:12.937499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.913 [2024-04-16 23:04:12.937524] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.913 qpair failed and we were unable to recover it. 00:26:21.913 [2024-04-16 23:04:12.937640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.913 [2024-04-16 23:04:12.937782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.913 [2024-04-16 23:04:12.937806] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.913 qpair failed and we were unable to recover it. 00:26:21.913 [2024-04-16 23:04:12.937972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.913 [2024-04-16 23:04:12.938123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.913 [2024-04-16 23:04:12.938151] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.913 qpair failed and we were unable to recover it. 00:26:21.913 [2024-04-16 23:04:12.938315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.913 [2024-04-16 23:04:12.938426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.913 [2024-04-16 23:04:12.938450] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.913 qpair failed and we were unable to recover it. 00:26:21.913 [2024-04-16 23:04:12.938591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.913 [2024-04-16 23:04:12.938753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.913 [2024-04-16 23:04:12.938781] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.913 qpair failed and we were unable to recover it. 00:26:21.913 [2024-04-16 23:04:12.938940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.913 [2024-04-16 23:04:12.939082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.913 [2024-04-16 23:04:12.939107] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.913 qpair failed and we were unable to recover it. 00:26:21.913 [2024-04-16 23:04:12.939285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.913 [2024-04-16 23:04:12.939416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.913 [2024-04-16 23:04:12.939444] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.913 qpair failed and we were unable to recover it. 00:26:21.914 [2024-04-16 23:04:12.939607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.914 [2024-04-16 23:04:12.939760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.914 [2024-04-16 23:04:12.939785] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.914 qpair failed and we were unable to recover it. 00:26:21.914 [2024-04-16 23:04:12.939926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.914 [2024-04-16 23:04:12.940041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.914 [2024-04-16 23:04:12.940068] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.914 qpair failed and we were unable to recover it. 00:26:21.914 [2024-04-16 23:04:12.940187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.914 [2024-04-16 23:04:12.940299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.914 [2024-04-16 23:04:12.940324] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.914 qpair failed and we were unable to recover it. 00:26:21.914 [2024-04-16 23:04:12.940518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.914 [2024-04-16 23:04:12.940663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.914 [2024-04-16 23:04:12.940691] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.914 qpair failed and we were unable to recover it. 00:26:21.914 [2024-04-16 23:04:12.940880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.914 [2024-04-16 23:04:12.940981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.914 [2024-04-16 23:04:12.941005] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.914 qpair failed and we were unable to recover it. 00:26:21.914 [2024-04-16 23:04:12.941148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.914 [2024-04-16 23:04:12.941352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.914 [2024-04-16 23:04:12.941381] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.914 qpair failed and we were unable to recover it. 00:26:21.914 [2024-04-16 23:04:12.941542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.914 [2024-04-16 23:04:12.941652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.914 [2024-04-16 23:04:12.941678] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.914 qpair failed and we were unable to recover it. 00:26:21.914 [2024-04-16 23:04:12.941817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.914 [2024-04-16 23:04:12.941945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.914 [2024-04-16 23:04:12.941974] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.914 qpair failed and we were unable to recover it. 00:26:21.914 [2024-04-16 23:04:12.942167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.914 [2024-04-16 23:04:12.942309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.914 [2024-04-16 23:04:12.942334] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.914 qpair failed and we were unable to recover it. 00:26:21.914 [2024-04-16 23:04:12.942518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.914 [2024-04-16 23:04:12.942670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.914 [2024-04-16 23:04:12.942699] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.914 qpair failed and we were unable to recover it. 00:26:21.914 [2024-04-16 23:04:12.942895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.914 [2024-04-16 23:04:12.943086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.914 [2024-04-16 23:04:12.943113] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.914 qpair failed and we were unable to recover it. 00:26:21.914 [2024-04-16 23:04:12.943270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.914 [2024-04-16 23:04:12.943470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.914 [2024-04-16 23:04:12.943496] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.914 qpair failed and we were unable to recover it. 00:26:21.914 [2024-04-16 23:04:12.943661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.914 [2024-04-16 23:04:12.943792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.914 [2024-04-16 23:04:12.943819] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.914 qpair failed and we were unable to recover it. 00:26:21.914 [2024-04-16 23:04:12.943978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.914 [2024-04-16 23:04:12.944114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.914 [2024-04-16 23:04:12.944139] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.914 qpair failed and we were unable to recover it. 00:26:21.914 [2024-04-16 23:04:12.944252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.914 [2024-04-16 23:04:12.944367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.914 [2024-04-16 23:04:12.944392] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.914 qpair failed and we were unable to recover it. 00:26:21.914 [2024-04-16 23:04:12.944509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.914 [2024-04-16 23:04:12.944658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.914 [2024-04-16 23:04:12.944686] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.914 qpair failed and we were unable to recover it. 00:26:21.914 [2024-04-16 23:04:12.944798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.914 [2024-04-16 23:04:12.944942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.914 [2024-04-16 23:04:12.944970] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.914 qpair failed and we were unable to recover it. 00:26:21.914 [2024-04-16 23:04:12.945092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.914 [2024-04-16 23:04:12.945241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.914 [2024-04-16 23:04:12.945269] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.914 qpair failed and we were unable to recover it. 00:26:21.914 [2024-04-16 23:04:12.945429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.914 [2024-04-16 23:04:12.945533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.914 [2024-04-16 23:04:12.945557] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.914 qpair failed and we were unable to recover it. 00:26:21.914 [2024-04-16 23:04:12.945724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.914 [2024-04-16 23:04:12.945882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.914 [2024-04-16 23:04:12.945909] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.914 qpair failed and we were unable to recover it. 00:26:21.914 [2024-04-16 23:04:12.946059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.914 [2024-04-16 23:04:12.946242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.914 [2024-04-16 23:04:12.946270] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.914 qpair failed and we were unable to recover it. 00:26:21.914 [2024-04-16 23:04:12.946452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.914 [2024-04-16 23:04:12.946611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.914 [2024-04-16 23:04:12.946638] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.914 qpair failed and we were unable to recover it. 00:26:21.914 [2024-04-16 23:04:12.946780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.914 [2024-04-16 23:04:12.946917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.914 [2024-04-16 23:04:12.946941] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.914 qpair failed and we were unable to recover it. 00:26:21.914 [2024-04-16 23:04:12.947104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.914 [2024-04-16 23:04:12.947293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.914 [2024-04-16 23:04:12.947321] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.914 qpair failed and we were unable to recover it. 00:26:21.914 [2024-04-16 23:04:12.947479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.914 [2024-04-16 23:04:12.947602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.914 [2024-04-16 23:04:12.947629] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.914 qpair failed and we were unable to recover it. 00:26:21.914 [2024-04-16 23:04:12.947781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.914 [2024-04-16 23:04:12.947935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.914 [2024-04-16 23:04:12.947964] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.914 qpair failed and we were unable to recover it. 00:26:21.914 [2024-04-16 23:04:12.948117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.914 [2024-04-16 23:04:12.948222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.914 [2024-04-16 23:04:12.948247] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.914 qpair failed and we were unable to recover it. 00:26:21.914 [2024-04-16 23:04:12.948429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.914 [2024-04-16 23:04:12.948596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.915 [2024-04-16 23:04:12.948621] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.915 qpair failed and we were unable to recover it. 00:26:21.915 [2024-04-16 23:04:12.948811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.915 [2024-04-16 23:04:12.948989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.915 [2024-04-16 23:04:12.949016] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.915 qpair failed and we were unable to recover it. 00:26:21.915 [2024-04-16 23:04:12.949167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.915 [2024-04-16 23:04:12.949333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.915 [2024-04-16 23:04:12.949361] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.915 qpair failed and we were unable to recover it. 00:26:21.915 [2024-04-16 23:04:12.949560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.915 [2024-04-16 23:04:12.949705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.915 [2024-04-16 23:04:12.949730] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.915 qpair failed and we were unable to recover it. 00:26:21.915 [2024-04-16 23:04:12.949898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.915 [2024-04-16 23:04:12.950059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.915 [2024-04-16 23:04:12.950087] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.915 qpair failed and we were unable to recover it. 00:26:21.915 [2024-04-16 23:04:12.950209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.915 [2024-04-16 23:04:12.950363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.915 [2024-04-16 23:04:12.950391] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.915 qpair failed and we were unable to recover it. 00:26:21.915 [2024-04-16 23:04:12.950537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.915 [2024-04-16 23:04:12.950666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.915 [2024-04-16 23:04:12.950698] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.915 qpair failed and we were unable to recover it. 00:26:21.915 [2024-04-16 23:04:12.950851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.915 [2024-04-16 23:04:12.950991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.915 [2024-04-16 23:04:12.951016] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.915 qpair failed and we were unable to recover it. 00:26:21.915 [2024-04-16 23:04:12.951165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.915 [2024-04-16 23:04:12.951329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.915 [2024-04-16 23:04:12.951357] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.915 qpair failed and we were unable to recover it. 00:26:21.915 [2024-04-16 23:04:12.951514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.915 [2024-04-16 23:04:12.951630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.915 [2024-04-16 23:04:12.951658] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.915 qpair failed and we were unable to recover it. 00:26:21.915 [2024-04-16 23:04:12.951812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.915 [2024-04-16 23:04:12.952010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.915 [2024-04-16 23:04:12.952035] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.915 qpair failed and we were unable to recover it. 00:26:21.915 [2024-04-16 23:04:12.952169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.915 [2024-04-16 23:04:12.952285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.915 [2024-04-16 23:04:12.952310] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.915 qpair failed and we were unable to recover it. 00:26:21.915 [2024-04-16 23:04:12.952434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.915 [2024-04-16 23:04:12.952586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.915 [2024-04-16 23:04:12.952611] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.915 qpair failed and we were unable to recover it. 00:26:21.915 [2024-04-16 23:04:12.952749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.915 [2024-04-16 23:04:12.952893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.915 [2024-04-16 23:04:12.952917] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.915 qpair failed and we were unable to recover it. 00:26:21.915 [2024-04-16 23:04:12.953036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.915 [2024-04-16 23:04:12.953226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.915 [2024-04-16 23:04:12.953254] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.915 qpair failed and we were unable to recover it. 00:26:21.915 [2024-04-16 23:04:12.953407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.915 [2024-04-16 23:04:12.953547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.915 [2024-04-16 23:04:12.953572] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.915 qpair failed and we were unable to recover it. 00:26:21.915 [2024-04-16 23:04:12.953707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.915 [2024-04-16 23:04:12.953852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.915 [2024-04-16 23:04:12.953876] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.915 qpair failed and we were unable to recover it. 00:26:21.915 [2024-04-16 23:04:12.954013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.915 [2024-04-16 23:04:12.954168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.915 [2024-04-16 23:04:12.954205] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.915 qpair failed and we were unable to recover it. 00:26:21.915 [2024-04-16 23:04:12.954334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.915 [2024-04-16 23:04:12.954520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.915 [2024-04-16 23:04:12.954548] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.915 qpair failed and we were unable to recover it. 00:26:21.915 [2024-04-16 23:04:12.954710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.915 [2024-04-16 23:04:12.954878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.915 [2024-04-16 23:04:12.954903] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.915 qpair failed and we were unable to recover it. 00:26:21.915 [2024-04-16 23:04:12.955020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.915 [2024-04-16 23:04:12.955154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.915 [2024-04-16 23:04:12.955188] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.915 qpair failed and we were unable to recover it. 00:26:21.915 [2024-04-16 23:04:12.955312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.915 [2024-04-16 23:04:12.955438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.915 [2024-04-16 23:04:12.955465] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.915 qpair failed and we were unable to recover it. 00:26:21.915 [2024-04-16 23:04:12.955607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.915 [2024-04-16 23:04:12.955749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.915 [2024-04-16 23:04:12.955774] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.915 qpair failed and we were unable to recover it. 00:26:21.915 [2024-04-16 23:04:12.955922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.915 [2024-04-16 23:04:12.956060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.915 [2024-04-16 23:04:12.956086] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.915 qpair failed and we were unable to recover it. 00:26:21.915 [2024-04-16 23:04:12.956243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.915 [2024-04-16 23:04:12.956390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.915 [2024-04-16 23:04:12.956417] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.915 qpair failed and we were unable to recover it. 00:26:21.915 [2024-04-16 23:04:12.956574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.915 [2024-04-16 23:04:12.956734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.915 [2024-04-16 23:04:12.956758] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.915 qpair failed and we were unable to recover it. 00:26:21.915 [2024-04-16 23:04:12.956895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.915 [2024-04-16 23:04:12.957005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.915 [2024-04-16 23:04:12.957029] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.915 qpair failed and we were unable to recover it. 00:26:21.915 [2024-04-16 23:04:12.957147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.915 [2024-04-16 23:04:12.957291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.916 [2024-04-16 23:04:12.957316] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.916 qpair failed and we were unable to recover it. 00:26:21.916 [2024-04-16 23:04:12.957451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.916 [2024-04-16 23:04:12.957611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.916 [2024-04-16 23:04:12.957639] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.916 qpair failed and we were unable to recover it. 00:26:21.916 [2024-04-16 23:04:12.957795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.916 [2024-04-16 23:04:12.957922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.916 [2024-04-16 23:04:12.957951] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.916 qpair failed and we were unable to recover it. 00:26:21.916 [2024-04-16 23:04:12.958091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.916 [2024-04-16 23:04:12.958230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.916 [2024-04-16 23:04:12.958256] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.916 qpair failed and we were unable to recover it. 00:26:21.916 [2024-04-16 23:04:12.958398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.916 [2024-04-16 23:04:12.958511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.916 [2024-04-16 23:04:12.958537] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.916 qpair failed and we were unable to recover it. 00:26:21.916 [2024-04-16 23:04:12.958696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.916 [2024-04-16 23:04:12.958815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.916 [2024-04-16 23:04:12.958843] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.916 qpair failed and we were unable to recover it. 00:26:21.916 [2024-04-16 23:04:12.959005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.916 [2024-04-16 23:04:12.959203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.916 [2024-04-16 23:04:12.959229] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.916 qpair failed and we were unable to recover it. 00:26:21.916 [2024-04-16 23:04:12.959346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.916 [2024-04-16 23:04:12.959457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.916 [2024-04-16 23:04:12.959483] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.916 qpair failed and we were unable to recover it. 00:26:21.916 [2024-04-16 23:04:12.959618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.916 [2024-04-16 23:04:12.959723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.916 [2024-04-16 23:04:12.959748] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.916 qpair failed and we were unable to recover it. 00:26:21.916 [2024-04-16 23:04:12.959913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.916 [2024-04-16 23:04:12.960037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.916 [2024-04-16 23:04:12.960064] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.916 qpair failed and we were unable to recover it. 00:26:21.916 [2024-04-16 23:04:12.960217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.916 [2024-04-16 23:04:12.960339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.916 [2024-04-16 23:04:12.960366] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.916 qpair failed and we were unable to recover it. 00:26:21.916 [2024-04-16 23:04:12.960553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.916 [2024-04-16 23:04:12.960709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.916 [2024-04-16 23:04:12.960736] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.916 qpair failed and we were unable to recover it. 00:26:21.916 [2024-04-16 23:04:12.960863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.916 [2024-04-16 23:04:12.961011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.916 [2024-04-16 23:04:12.961036] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.916 qpair failed and we were unable to recover it. 00:26:21.916 [2024-04-16 23:04:12.961173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.916 [2024-04-16 23:04:12.961331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.916 [2024-04-16 23:04:12.961359] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.916 qpair failed and we were unable to recover it. 00:26:21.916 [2024-04-16 23:04:12.961517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.916 [2024-04-16 23:04:12.961635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.916 [2024-04-16 23:04:12.961663] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.916 qpair failed and we were unable to recover it. 00:26:21.916 [2024-04-16 23:04:12.961817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.916 [2024-04-16 23:04:12.962006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.916 [2024-04-16 23:04:12.962034] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.916 qpair failed and we were unable to recover it. 00:26:21.916 [2024-04-16 23:04:12.962162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.916 [2024-04-16 23:04:12.962307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.916 [2024-04-16 23:04:12.962332] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.916 qpair failed and we were unable to recover it. 00:26:21.916 [2024-04-16 23:04:12.962463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.916 [2024-04-16 23:04:12.962625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.916 [2024-04-16 23:04:12.962649] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.916 qpair failed and we were unable to recover it. 00:26:21.916 [2024-04-16 23:04:12.962758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.916 [2024-04-16 23:04:12.962911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.916 [2024-04-16 23:04:12.962938] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.916 qpair failed and we were unable to recover it. 00:26:21.916 [2024-04-16 23:04:12.963121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.916 [2024-04-16 23:04:12.963245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.916 [2024-04-16 23:04:12.963273] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.916 qpair failed and we were unable to recover it. 00:26:21.916 [2024-04-16 23:04:12.963405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.916 [2024-04-16 23:04:12.963564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.916 [2024-04-16 23:04:12.963588] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.916 qpair failed and we were unable to recover it. 00:26:21.916 [2024-04-16 23:04:12.963801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.916 [2024-04-16 23:04:12.963977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.916 [2024-04-16 23:04:12.964005] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.916 qpair failed and we were unable to recover it. 00:26:21.916 [2024-04-16 23:04:12.964168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.916 [2024-04-16 23:04:12.964325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.916 [2024-04-16 23:04:12.964353] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.916 qpair failed and we were unable to recover it. 00:26:21.916 [2024-04-16 23:04:12.964486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.916 [2024-04-16 23:04:12.964651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.916 [2024-04-16 23:04:12.964675] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.916 qpair failed and we were unable to recover it. 00:26:21.916 [2024-04-16 23:04:12.964817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.916 [2024-04-16 23:04:12.964950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.916 [2024-04-16 23:04:12.964975] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.916 qpair failed and we were unable to recover it. 00:26:21.916 [2024-04-16 23:04:12.965153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.916 [2024-04-16 23:04:12.965343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.916 [2024-04-16 23:04:12.965372] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.917 qpair failed and we were unable to recover it. 00:26:21.917 [2024-04-16 23:04:12.965491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.917 [2024-04-16 23:04:12.965637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.917 [2024-04-16 23:04:12.965665] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.917 qpair failed and we were unable to recover it. 00:26:21.917 [2024-04-16 23:04:12.965816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.917 [2024-04-16 23:04:12.965932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.917 [2024-04-16 23:04:12.965959] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.917 qpair failed and we were unable to recover it. 00:26:21.917 [2024-04-16 23:04:12.966117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.917 [2024-04-16 23:04:12.966260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.917 [2024-04-16 23:04:12.966301] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.917 qpair failed and we were unable to recover it. 00:26:21.917 [2024-04-16 23:04:12.966424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.917 [2024-04-16 23:04:12.966572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.917 [2024-04-16 23:04:12.966599] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.917 qpair failed and we were unable to recover it. 00:26:21.917 [2024-04-16 23:04:12.966713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.917 [2024-04-16 23:04:12.966878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.917 [2024-04-16 23:04:12.966910] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.917 qpair failed and we were unable to recover it. 00:26:21.917 [2024-04-16 23:04:12.967095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.917 [2024-04-16 23:04:12.967247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.917 [2024-04-16 23:04:12.967275] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.917 qpair failed and we were unable to recover it. 00:26:21.917 [2024-04-16 23:04:12.967412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.917 [2024-04-16 23:04:12.967549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.917 [2024-04-16 23:04:12.967574] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.917 qpair failed and we were unable to recover it. 00:26:21.917 [2024-04-16 23:04:12.967698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.917 [2024-04-16 23:04:12.967882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.917 [2024-04-16 23:04:12.967909] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.917 qpair failed and we were unable to recover it. 00:26:21.917 [2024-04-16 23:04:12.968034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.917 [2024-04-16 23:04:12.968184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.917 [2024-04-16 23:04:12.968212] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.917 qpair failed and we were unable to recover it. 00:26:21.917 [2024-04-16 23:04:12.968365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.917 [2024-04-16 23:04:12.968521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.917 [2024-04-16 23:04:12.968548] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.917 qpair failed and we were unable to recover it. 00:26:21.917 [2024-04-16 23:04:12.968706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.917 [2024-04-16 23:04:12.968811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.917 [2024-04-16 23:04:12.968835] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.917 qpair failed and we were unable to recover it. 00:26:21.917 [2024-04-16 23:04:12.968988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.917 [2024-04-16 23:04:12.969115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.917 [2024-04-16 23:04:12.969147] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.917 qpair failed and we were unable to recover it. 00:26:21.917 [2024-04-16 23:04:12.969291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.917 [2024-04-16 23:04:12.969435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.917 [2024-04-16 23:04:12.969460] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.917 qpair failed and we were unable to recover it. 00:26:21.917 [2024-04-16 23:04:12.969630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.917 [2024-04-16 23:04:12.969808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.917 [2024-04-16 23:04:12.969835] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.917 qpair failed and we were unable to recover it. 00:26:21.917 [2024-04-16 23:04:12.969991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.917 [2024-04-16 23:04:12.970125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.917 [2024-04-16 23:04:12.970166] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.917 qpair failed and we were unable to recover it. 00:26:21.917 [2024-04-16 23:04:12.970350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.917 [2024-04-16 23:04:12.970493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.917 [2024-04-16 23:04:12.970518] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.917 qpair failed and we were unable to recover it. 00:26:21.917 [2024-04-16 23:04:12.970684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.917 [2024-04-16 23:04:12.970843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.917 [2024-04-16 23:04:12.970868] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.917 qpair failed and we were unable to recover it. 00:26:21.917 [2024-04-16 23:04:12.971010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.917 [2024-04-16 23:04:12.971205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.917 [2024-04-16 23:04:12.971233] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.917 qpair failed and we were unable to recover it. 00:26:21.917 [2024-04-16 23:04:12.971396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.917 [2024-04-16 23:04:12.971519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.917 [2024-04-16 23:04:12.971545] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.917 qpair failed and we were unable to recover it. 00:26:21.917 [2024-04-16 23:04:12.971685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.917 [2024-04-16 23:04:12.971860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.917 [2024-04-16 23:04:12.971888] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.917 qpair failed and we were unable to recover it. 00:26:21.917 [2024-04-16 23:04:12.972075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.917 [2024-04-16 23:04:12.972208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.917 [2024-04-16 23:04:12.972234] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.917 qpair failed and we were unable to recover it. 00:26:21.917 [2024-04-16 23:04:12.972381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.917 [2024-04-16 23:04:12.972517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.917 [2024-04-16 23:04:12.972544] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.917 qpair failed and we were unable to recover it. 00:26:21.918 [2024-04-16 23:04:12.972685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.918 [2024-04-16 23:04:12.972904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.918 [2024-04-16 23:04:12.972928] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.918 qpair failed and we were unable to recover it. 00:26:21.918 [2024-04-16 23:04:12.973109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.918 [2024-04-16 23:04:12.973254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.918 [2024-04-16 23:04:12.973279] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.918 qpair failed and we were unable to recover it. 00:26:21.918 [2024-04-16 23:04:12.973451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.918 [2024-04-16 23:04:12.973639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.918 [2024-04-16 23:04:12.973663] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.918 qpair failed and we were unable to recover it. 00:26:21.918 [2024-04-16 23:04:12.973802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.918 [2024-04-16 23:04:12.973944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.918 [2024-04-16 23:04:12.973969] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.918 qpair failed and we were unable to recover it. 00:26:21.918 [2024-04-16 23:04:12.974121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.918 [2024-04-16 23:04:12.974268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.918 [2024-04-16 23:04:12.974294] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.918 qpair failed and we were unable to recover it. 00:26:21.918 [2024-04-16 23:04:12.974503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.918 [2024-04-16 23:04:12.974612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.918 [2024-04-16 23:04:12.974637] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.918 qpair failed and we were unable to recover it. 00:26:21.918 [2024-04-16 23:04:12.974779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.918 [2024-04-16 23:04:12.974899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.918 [2024-04-16 23:04:12.974923] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.918 qpair failed and we were unable to recover it. 00:26:21.918 [2024-04-16 23:04:12.975033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.918 [2024-04-16 23:04:12.975146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.918 [2024-04-16 23:04:12.975171] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.918 qpair failed and we were unable to recover it. 00:26:21.918 [2024-04-16 23:04:12.975324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.918 [2024-04-16 23:04:12.975546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.918 [2024-04-16 23:04:12.975571] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.918 qpair failed and we were unable to recover it. 00:26:21.918 [2024-04-16 23:04:12.975727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.918 [2024-04-16 23:04:12.975909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.918 [2024-04-16 23:04:12.975936] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.918 qpair failed and we were unable to recover it. 00:26:21.918 [2024-04-16 23:04:12.976065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.918 [2024-04-16 23:04:12.976189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.918 [2024-04-16 23:04:12.976217] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.918 qpair failed and we were unable to recover it. 00:26:21.918 [2024-04-16 23:04:12.976376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.918 [2024-04-16 23:04:12.976566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.918 [2024-04-16 23:04:12.976590] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.918 qpair failed and we were unable to recover it. 00:26:21.918 [2024-04-16 23:04:12.976744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.918 [2024-04-16 23:04:12.976858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.918 [2024-04-16 23:04:12.976883] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.918 qpair failed and we were unable to recover it. 00:26:21.918 [2024-04-16 23:04:12.977103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.918 [2024-04-16 23:04:12.977244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.918 [2024-04-16 23:04:12.977270] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.918 qpair failed and we were unable to recover it. 00:26:21.918 [2024-04-16 23:04:12.977421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.918 [2024-04-16 23:04:12.977536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.918 [2024-04-16 23:04:12.977563] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.918 qpair failed and we were unable to recover it. 00:26:21.918 [2024-04-16 23:04:12.977734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.918 [2024-04-16 23:04:12.977879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.918 [2024-04-16 23:04:12.977903] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.918 qpair failed and we were unable to recover it. 00:26:21.918 [2024-04-16 23:04:12.978015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.918 [2024-04-16 23:04:12.978158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.918 [2024-04-16 23:04:12.978196] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.918 qpair failed and we were unable to recover it. 00:26:21.918 [2024-04-16 23:04:12.978344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.918 [2024-04-16 23:04:12.978476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.918 [2024-04-16 23:04:12.978503] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.918 qpair failed and we were unable to recover it. 00:26:21.918 [2024-04-16 23:04:12.978690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.918 [2024-04-16 23:04:12.978830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.918 [2024-04-16 23:04:12.978855] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.918 qpair failed and we were unable to recover it. 00:26:21.918 [2024-04-16 23:04:12.978996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.918 [2024-04-16 23:04:12.979120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.918 [2024-04-16 23:04:12.979146] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.918 qpair failed and we were unable to recover it. 00:26:21.918 [2024-04-16 23:04:12.979293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.918 [2024-04-16 23:04:12.979431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.918 [2024-04-16 23:04:12.979455] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.918 qpair failed and we were unable to recover it. 00:26:21.918 [2024-04-16 23:04:12.979656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.918 [2024-04-16 23:04:12.979792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.918 [2024-04-16 23:04:12.979817] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.918 qpair failed and we were unable to recover it. 00:26:21.918 [2024-04-16 23:04:12.979980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.918 [2024-04-16 23:04:12.980149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.918 [2024-04-16 23:04:12.980173] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.918 qpair failed and we were unable to recover it. 00:26:21.918 [2024-04-16 23:04:12.980329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.918 [2024-04-16 23:04:12.980480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.918 [2024-04-16 23:04:12.980508] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.918 qpair failed and we were unable to recover it. 00:26:21.918 [2024-04-16 23:04:12.980693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.918 [2024-04-16 23:04:12.980871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.918 [2024-04-16 23:04:12.980899] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.918 qpair failed and we were unable to recover it. 00:26:21.918 [2024-04-16 23:04:12.981059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.918 [2024-04-16 23:04:12.981231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.918 [2024-04-16 23:04:12.981261] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.918 qpair failed and we were unable to recover it. 00:26:21.918 [2024-04-16 23:04:12.981386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.918 [2024-04-16 23:04:12.981517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.918 [2024-04-16 23:04:12.981544] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.918 qpair failed and we were unable to recover it. 00:26:21.918 [2024-04-16 23:04:12.981675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.918 [2024-04-16 23:04:12.981824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.918 [2024-04-16 23:04:12.981851] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.918 qpair failed and we were unable to recover it. 00:26:21.919 [2024-04-16 23:04:12.982036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.919 [2024-04-16 23:04:12.982219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.919 [2024-04-16 23:04:12.982249] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.919 qpair failed and we were unable to recover it. 00:26:21.919 [2024-04-16 23:04:12.982370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.919 [2024-04-16 23:04:12.982564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.919 [2024-04-16 23:04:12.982589] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.919 qpair failed and we were unable to recover it. 00:26:21.919 [2024-04-16 23:04:12.982703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.919 [2024-04-16 23:04:12.982863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.919 [2024-04-16 23:04:12.982892] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.919 qpair failed and we were unable to recover it. 00:26:21.919 [2024-04-16 23:04:12.983039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.919 [2024-04-16 23:04:12.983190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.919 [2024-04-16 23:04:12.983219] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.919 qpair failed and we were unable to recover it. 00:26:21.919 [2024-04-16 23:04:12.983367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.919 [2024-04-16 23:04:12.983496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.919 [2024-04-16 23:04:12.983522] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.919 qpair failed and we were unable to recover it. 00:26:21.919 [2024-04-16 23:04:12.983668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.919 [2024-04-16 23:04:12.983831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.919 [2024-04-16 23:04:12.983860] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.919 qpair failed and we were unable to recover it. 00:26:21.919 [2024-04-16 23:04:12.984031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.919 [2024-04-16 23:04:12.984189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.919 [2024-04-16 23:04:12.984217] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.919 qpair failed and we were unable to recover it. 00:26:21.919 [2024-04-16 23:04:12.984406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.919 [2024-04-16 23:04:12.984560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.919 [2024-04-16 23:04:12.984589] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.919 qpair failed and we were unable to recover it. 00:26:21.919 [2024-04-16 23:04:12.984751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.919 [2024-04-16 23:04:12.984939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.919 [2024-04-16 23:04:12.984966] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.919 qpair failed and we were unable to recover it. 00:26:21.919 [2024-04-16 23:04:12.985114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.919 [2024-04-16 23:04:12.985259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.919 [2024-04-16 23:04:12.985287] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.919 qpair failed and we were unable to recover it. 00:26:21.919 [2024-04-16 23:04:12.985469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.919 [2024-04-16 23:04:12.985657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.919 [2024-04-16 23:04:12.985704] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.919 qpair failed and we were unable to recover it. 00:26:21.919 [2024-04-16 23:04:12.985890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.919 [2024-04-16 23:04:12.986023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.919 [2024-04-16 23:04:12.986052] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.919 qpair failed and we were unable to recover it. 00:26:21.919 [2024-04-16 23:04:12.986235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.919 [2024-04-16 23:04:12.986386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.919 [2024-04-16 23:04:12.986414] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.919 qpair failed and we were unable to recover it. 00:26:21.919 [2024-04-16 23:04:12.986596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.919 [2024-04-16 23:04:12.986798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.919 [2024-04-16 23:04:12.986842] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.919 qpair failed and we were unable to recover it. 00:26:21.919 [2024-04-16 23:04:12.986988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.919 [2024-04-16 23:04:12.987111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.919 [2024-04-16 23:04:12.987138] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.919 qpair failed and we were unable to recover it. 00:26:21.919 [2024-04-16 23:04:12.987328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.919 [2024-04-16 23:04:12.987451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.919 [2024-04-16 23:04:12.987483] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.919 qpair failed and we were unable to recover it. 00:26:21.919 [2024-04-16 23:04:12.987641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.919 [2024-04-16 23:04:12.987771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.919 [2024-04-16 23:04:12.987796] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.919 qpair failed and we were unable to recover it. 00:26:21.919 [2024-04-16 23:04:12.988001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.919 [2024-04-16 23:04:12.988199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.919 [2024-04-16 23:04:12.988226] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.919 qpair failed and we were unable to recover it. 00:26:21.919 [2024-04-16 23:04:12.988362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.919 [2024-04-16 23:04:12.988472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.919 [2024-04-16 23:04:12.988497] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.919 qpair failed and we were unable to recover it. 00:26:21.919 [2024-04-16 23:04:12.988682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.919 [2024-04-16 23:04:12.988803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:21.919 [2024-04-16 23:04:12.988831] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:21.919 qpair failed and we were unable to recover it. 00:26:21.919 [2024-04-16 23:04:12.988990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.199 [2024-04-16 23:04:12.989124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.199 [2024-04-16 23:04:12.989150] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.199 qpair failed and we were unable to recover it. 00:26:22.199 [2024-04-16 23:04:12.989374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.199 [2024-04-16 23:04:12.989495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.199 [2024-04-16 23:04:12.989523] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.199 qpair failed and we were unable to recover it. 00:26:22.199 [2024-04-16 23:04:12.989676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.199 [2024-04-16 23:04:12.989807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.199 [2024-04-16 23:04:12.989836] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.199 qpair failed and we were unable to recover it. 00:26:22.199 [2024-04-16 23:04:12.989963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.199 [2024-04-16 23:04:12.990142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.199 [2024-04-16 23:04:12.990170] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.199 qpair failed and we were unable to recover it. 00:26:22.199 [2024-04-16 23:04:12.990326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.199 [2024-04-16 23:04:12.990463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.199 [2024-04-16 23:04:12.990488] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.199 qpair failed and we were unable to recover it. 00:26:22.199 [2024-04-16 23:04:12.990649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.199 [2024-04-16 23:04:12.990808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.199 [2024-04-16 23:04:12.990837] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.199 qpair failed and we were unable to recover it. 00:26:22.199 [2024-04-16 23:04:12.990964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.199 [2024-04-16 23:04:12.991140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.199 [2024-04-16 23:04:12.991167] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.199 qpair failed and we were unable to recover it. 00:26:22.199 [2024-04-16 23:04:12.991325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.199 [2024-04-16 23:04:12.991463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.199 [2024-04-16 23:04:12.991488] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.199 qpair failed and we were unable to recover it. 00:26:22.199 [2024-04-16 23:04:12.991620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.199 [2024-04-16 23:04:12.991730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.199 [2024-04-16 23:04:12.991755] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.199 qpair failed and we were unable to recover it. 00:26:22.199 [2024-04-16 23:04:12.991910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.199 [2024-04-16 23:04:12.992022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.199 [2024-04-16 23:04:12.992047] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.199 qpair failed and we were unable to recover it. 00:26:22.199 [2024-04-16 23:04:12.992152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.199 [2024-04-16 23:04:12.992305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.199 [2024-04-16 23:04:12.992331] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.199 qpair failed and we were unable to recover it. 00:26:22.199 [2024-04-16 23:04:12.992439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.199 [2024-04-16 23:04:12.992570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.199 [2024-04-16 23:04:12.992597] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.199 qpair failed and we were unable to recover it. 00:26:22.199 [2024-04-16 23:04:12.992733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.199 [2024-04-16 23:04:12.992873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.199 [2024-04-16 23:04:12.992897] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.199 qpair failed and we were unable to recover it. 00:26:22.199 [2024-04-16 23:04:12.993041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.199 [2024-04-16 23:04:12.993150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.199 [2024-04-16 23:04:12.993184] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.199 qpair failed and we were unable to recover it. 00:26:22.200 [2024-04-16 23:04:12.993356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.200 [2024-04-16 23:04:12.993498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.200 [2024-04-16 23:04:12.993524] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.200 qpair failed and we were unable to recover it. 00:26:22.200 [2024-04-16 23:04:12.993668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.200 [2024-04-16 23:04:12.993774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.200 [2024-04-16 23:04:12.993799] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.200 qpair failed and we were unable to recover it. 00:26:22.200 [2024-04-16 23:04:12.993909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.200 [2024-04-16 23:04:12.994075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.200 [2024-04-16 23:04:12.994101] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.200 qpair failed and we were unable to recover it. 00:26:22.200 [2024-04-16 23:04:12.994339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.200 [2024-04-16 23:04:12.994560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.200 [2024-04-16 23:04:12.994585] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.200 qpair failed and we were unable to recover it. 00:26:22.200 [2024-04-16 23:04:12.994781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.200 [2024-04-16 23:04:12.994963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.200 [2024-04-16 23:04:12.994990] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.200 qpair failed and we were unable to recover it. 00:26:22.200 [2024-04-16 23:04:12.995148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.200 [2024-04-16 23:04:12.995385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.200 [2024-04-16 23:04:12.995411] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.200 qpair failed and we were unable to recover it. 00:26:22.200 [2024-04-16 23:04:12.995521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.200 [2024-04-16 23:04:12.995697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.200 [2024-04-16 23:04:12.995729] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.200 qpair failed and we were unable to recover it. 00:26:22.200 [2024-04-16 23:04:12.995892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.200 [2024-04-16 23:04:12.996098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.200 [2024-04-16 23:04:12.996123] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.200 qpair failed and we were unable to recover it. 00:26:22.200 [2024-04-16 23:04:12.996293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.200 [2024-04-16 23:04:12.996402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.200 [2024-04-16 23:04:12.996427] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.200 qpair failed and we were unable to recover it. 00:26:22.200 [2024-04-16 23:04:12.996569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.200 [2024-04-16 23:04:12.996809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.200 [2024-04-16 23:04:12.996834] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.200 qpair failed and we were unable to recover it. 00:26:22.200 [2024-04-16 23:04:12.997008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.200 [2024-04-16 23:04:12.997169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.200 [2024-04-16 23:04:12.997211] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.200 qpair failed and we were unable to recover it. 00:26:22.200 [2024-04-16 23:04:12.997367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.200 [2024-04-16 23:04:12.997493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.200 [2024-04-16 23:04:12.997518] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.200 qpair failed and we were unable to recover it. 00:26:22.200 [2024-04-16 23:04:12.997661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.200 [2024-04-16 23:04:12.997814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.200 [2024-04-16 23:04:12.997842] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.200 qpair failed and we were unable to recover it. 00:26:22.200 [2024-04-16 23:04:12.998005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.200 [2024-04-16 23:04:12.998148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.200 [2024-04-16 23:04:12.998173] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.200 qpair failed and we were unable to recover it. 00:26:22.200 [2024-04-16 23:04:12.998374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.200 [2024-04-16 23:04:12.998505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.200 [2024-04-16 23:04:12.998530] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.200 qpair failed and we were unable to recover it. 00:26:22.200 [2024-04-16 23:04:12.998670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.200 [2024-04-16 23:04:12.998802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.200 [2024-04-16 23:04:12.998830] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.200 qpair failed and we were unable to recover it. 00:26:22.200 [2024-04-16 23:04:12.998998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.200 [2024-04-16 23:04:12.999154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.200 [2024-04-16 23:04:12.999186] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.200 qpair failed and we were unable to recover it. 00:26:22.200 [2024-04-16 23:04:12.999377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.200 [2024-04-16 23:04:12.999516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.200 [2024-04-16 23:04:12.999542] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.200 qpair failed and we were unable to recover it. 00:26:22.200 [2024-04-16 23:04:12.999686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.200 [2024-04-16 23:04:12.999853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.200 [2024-04-16 23:04:12.999878] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.200 qpair failed and we were unable to recover it. 00:26:22.200 [2024-04-16 23:04:13.000012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.200 [2024-04-16 23:04:13.000160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.200 [2024-04-16 23:04:13.000193] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.200 qpair failed and we were unable to recover it. 00:26:22.200 [2024-04-16 23:04:13.000338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.200 [2024-04-16 23:04:13.000505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.200 [2024-04-16 23:04:13.000530] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.200 qpair failed and we were unable to recover it. 00:26:22.200 [2024-04-16 23:04:13.000773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.200 [2024-04-16 23:04:13.000964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.200 [2024-04-16 23:04:13.001012] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.200 qpair failed and we were unable to recover it. 00:26:22.200 [2024-04-16 23:04:13.001138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.200 [2024-04-16 23:04:13.001313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.200 [2024-04-16 23:04:13.001359] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.200 qpair failed and we were unable to recover it. 00:26:22.200 [2024-04-16 23:04:13.001530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.200 [2024-04-16 23:04:13.001666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.200 [2024-04-16 23:04:13.001691] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.200 qpair failed and we were unable to recover it. 00:26:22.200 [2024-04-16 23:04:13.001852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.200 [2024-04-16 23:04:13.002035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.200 [2024-04-16 23:04:13.002063] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.200 qpair failed and we were unable to recover it. 00:26:22.200 [2024-04-16 23:04:13.002223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.200 [2024-04-16 23:04:13.002407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.200 [2024-04-16 23:04:13.002435] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.200 qpair failed and we were unable to recover it. 00:26:22.200 [2024-04-16 23:04:13.002598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.200 [2024-04-16 23:04:13.002763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.200 [2024-04-16 23:04:13.002805] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.200 qpair failed and we were unable to recover it. 00:26:22.200 [2024-04-16 23:04:13.002974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.200 [2024-04-16 23:04:13.003084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.201 [2024-04-16 23:04:13.003109] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.201 qpair failed and we were unable to recover it. 00:26:22.201 [2024-04-16 23:04:13.003302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.201 [2024-04-16 23:04:13.003450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.201 [2024-04-16 23:04:13.003478] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.201 qpair failed and we were unable to recover it. 00:26:22.201 [2024-04-16 23:04:13.003602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.201 [2024-04-16 23:04:13.003782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.201 [2024-04-16 23:04:13.003809] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.201 qpair failed and we were unable to recover it. 00:26:22.201 [2024-04-16 23:04:13.004000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.201 [2024-04-16 23:04:13.004145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.201 [2024-04-16 23:04:13.004170] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.201 qpair failed and we were unable to recover it. 00:26:22.201 [2024-04-16 23:04:13.004326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.201 [2024-04-16 23:04:13.004517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.201 [2024-04-16 23:04:13.004545] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.201 qpair failed and we were unable to recover it. 00:26:22.201 [2024-04-16 23:04:13.004722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.201 [2024-04-16 23:04:13.004907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.201 [2024-04-16 23:04:13.004971] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.201 qpair failed and we were unable to recover it. 00:26:22.201 [2024-04-16 23:04:13.005155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.201 [2024-04-16 23:04:13.005322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.201 [2024-04-16 23:04:13.005349] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.201 qpair failed and we were unable to recover it. 00:26:22.201 [2024-04-16 23:04:13.005490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.201 [2024-04-16 23:04:13.005674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.201 [2024-04-16 23:04:13.005702] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.201 qpair failed and we were unable to recover it. 00:26:22.201 [2024-04-16 23:04:13.005888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.201 [2024-04-16 23:04:13.006031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.201 [2024-04-16 23:04:13.006059] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.201 qpair failed and we were unable to recover it. 00:26:22.201 [2024-04-16 23:04:13.006241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.201 [2024-04-16 23:04:13.006365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.201 [2024-04-16 23:04:13.006392] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.201 qpair failed and we were unable to recover it. 00:26:22.201 [2024-04-16 23:04:13.006507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.201 [2024-04-16 23:04:13.006662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.201 [2024-04-16 23:04:13.006691] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.201 qpair failed and we were unable to recover it. 00:26:22.201 [2024-04-16 23:04:13.006857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.201 [2024-04-16 23:04:13.006996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.201 [2024-04-16 23:04:13.007038] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.201 qpair failed and we were unable to recover it. 00:26:22.201 [2024-04-16 23:04:13.007202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.201 [2024-04-16 23:04:13.007340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.201 [2024-04-16 23:04:13.007368] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.201 qpair failed and we were unable to recover it. 00:26:22.201 [2024-04-16 23:04:13.007491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.201 [2024-04-16 23:04:13.007669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.201 [2024-04-16 23:04:13.007697] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.201 qpair failed and we were unable to recover it. 00:26:22.201 [2024-04-16 23:04:13.007813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.201 [2024-04-16 23:04:13.007933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.201 [2024-04-16 23:04:13.007961] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.201 qpair failed and we were unable to recover it. 00:26:22.201 [2024-04-16 23:04:13.008093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.201 [2024-04-16 23:04:13.008234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.201 [2024-04-16 23:04:13.008260] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.201 qpair failed and we were unable to recover it. 00:26:22.201 [2024-04-16 23:04:13.008396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.201 [2024-04-16 23:04:13.008533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.201 [2024-04-16 23:04:13.008560] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.201 qpair failed and we were unable to recover it. 00:26:22.201 [2024-04-16 23:04:13.008726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.201 [2024-04-16 23:04:13.008837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.201 [2024-04-16 23:04:13.008862] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.201 qpair failed and we were unable to recover it. 00:26:22.201 [2024-04-16 23:04:13.008972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.201 [2024-04-16 23:04:13.009166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.201 [2024-04-16 23:04:13.009215] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.201 qpair failed and we were unable to recover it. 00:26:22.201 [2024-04-16 23:04:13.009377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.201 [2024-04-16 23:04:13.009524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.201 [2024-04-16 23:04:13.009550] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.201 qpair failed and we were unable to recover it. 00:26:22.201 [2024-04-16 23:04:13.009687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.201 [2024-04-16 23:04:13.009842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.201 [2024-04-16 23:04:13.009870] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.201 qpair failed and we were unable to recover it. 00:26:22.201 [2024-04-16 23:04:13.010036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.201 [2024-04-16 23:04:13.010203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.201 [2024-04-16 23:04:13.010229] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.201 qpair failed and we were unable to recover it. 00:26:22.201 [2024-04-16 23:04:13.010391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.201 [2024-04-16 23:04:13.010545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.201 [2024-04-16 23:04:13.010573] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.201 qpair failed and we were unable to recover it. 00:26:22.201 [2024-04-16 23:04:13.010766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.201 [2024-04-16 23:04:13.010870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.201 [2024-04-16 23:04:13.010895] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.201 qpair failed and we were unable to recover it. 00:26:22.201 [2024-04-16 23:04:13.011064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.201 [2024-04-16 23:04:13.011236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.201 [2024-04-16 23:04:13.011261] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.201 qpair failed and we were unable to recover it. 00:26:22.201 [2024-04-16 23:04:13.011430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.201 [2024-04-16 23:04:13.011597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.202 [2024-04-16 23:04:13.011624] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.202 qpair failed and we were unable to recover it. 00:26:22.202 [2024-04-16 23:04:13.011786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.202 [2024-04-16 23:04:13.011941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.202 [2024-04-16 23:04:13.011969] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.202 qpair failed and we were unable to recover it. 00:26:22.202 [2024-04-16 23:04:13.012136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.202 [2024-04-16 23:04:13.012287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.202 [2024-04-16 23:04:13.012313] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.202 qpair failed and we were unable to recover it. 00:26:22.202 [2024-04-16 23:04:13.012453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.202 [2024-04-16 23:04:13.012573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.202 [2024-04-16 23:04:13.012600] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.202 qpair failed and we were unable to recover it. 00:26:22.202 [2024-04-16 23:04:13.012730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.202 [2024-04-16 23:04:13.012877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.202 [2024-04-16 23:04:13.012904] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.202 qpair failed and we were unable to recover it. 00:26:22.202 [2024-04-16 23:04:13.013087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.202 [2024-04-16 23:04:13.013269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.202 [2024-04-16 23:04:13.013297] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.202 qpair failed and we were unable to recover it. 00:26:22.202 [2024-04-16 23:04:13.013461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.202 [2024-04-16 23:04:13.013617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.202 [2024-04-16 23:04:13.013645] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.202 qpair failed and we were unable to recover it. 00:26:22.202 [2024-04-16 23:04:13.013877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.202 [2024-04-16 23:04:13.014057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.202 [2024-04-16 23:04:13.014085] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.202 qpair failed and we were unable to recover it. 00:26:22.202 [2024-04-16 23:04:13.014271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.202 [2024-04-16 23:04:13.014388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.202 [2024-04-16 23:04:13.014415] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.202 qpair failed and we were unable to recover it. 00:26:22.202 [2024-04-16 23:04:13.014546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.202 [2024-04-16 23:04:13.014702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.202 [2024-04-16 23:04:13.014731] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.202 qpair failed and we were unable to recover it. 00:26:22.202 [2024-04-16 23:04:13.014900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.202 [2024-04-16 23:04:13.015008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.202 [2024-04-16 23:04:13.015033] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.202 qpair failed and we were unable to recover it. 00:26:22.202 [2024-04-16 23:04:13.015141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.202 [2024-04-16 23:04:13.015263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.202 [2024-04-16 23:04:13.015289] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.202 qpair failed and we were unable to recover it. 00:26:22.202 [2024-04-16 23:04:13.015450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.202 [2024-04-16 23:04:13.015609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.202 [2024-04-16 23:04:13.015637] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.202 qpair failed and we were unable to recover it. 00:26:22.202 [2024-04-16 23:04:13.015784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.202 [2024-04-16 23:04:13.015906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.202 [2024-04-16 23:04:13.015933] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.202 qpair failed and we were unable to recover it. 00:26:22.202 [2024-04-16 23:04:13.016095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.202 [2024-04-16 23:04:13.016217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.202 [2024-04-16 23:04:13.016243] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.202 qpair failed and we were unable to recover it. 00:26:22.202 [2024-04-16 23:04:13.016401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.202 [2024-04-16 23:04:13.016566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.202 [2024-04-16 23:04:13.016593] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.202 qpair failed and we were unable to recover it. 00:26:22.202 [2024-04-16 23:04:13.016726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.202 [2024-04-16 23:04:13.016878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.202 [2024-04-16 23:04:13.016905] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.202 qpair failed and we were unable to recover it. 00:26:22.202 [2024-04-16 23:04:13.017030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.202 [2024-04-16 23:04:13.017184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.202 [2024-04-16 23:04:13.017213] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.202 qpair failed and we were unable to recover it. 00:26:22.202 [2024-04-16 23:04:13.017341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.202 [2024-04-16 23:04:13.017513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.202 [2024-04-16 23:04:13.017555] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.202 qpair failed and we were unable to recover it. 00:26:22.202 [2024-04-16 23:04:13.017712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.202 [2024-04-16 23:04:13.017870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.202 [2024-04-16 23:04:13.017898] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.202 qpair failed and we were unable to recover it. 00:26:22.202 [2024-04-16 23:04:13.018053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.202 [2024-04-16 23:04:13.018196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.202 [2024-04-16 23:04:13.018239] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.202 qpair failed and we were unable to recover it. 00:26:22.202 [2024-04-16 23:04:13.018385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.202 [2024-04-16 23:04:13.018528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.202 [2024-04-16 23:04:13.018553] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.202 qpair failed and we were unable to recover it. 00:26:22.202 [2024-04-16 23:04:13.018687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.202 [2024-04-16 23:04:13.018797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.202 [2024-04-16 23:04:13.018822] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.202 qpair failed and we were unable to recover it. 00:26:22.202 [2024-04-16 23:04:13.018977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.202 [2024-04-16 23:04:13.019162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.202 [2024-04-16 23:04:13.019200] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.202 qpair failed and we were unable to recover it. 00:26:22.202 [2024-04-16 23:04:13.019391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.202 [2024-04-16 23:04:13.019533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.202 [2024-04-16 23:04:13.019560] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.202 qpair failed and we were unable to recover it. 00:26:22.202 [2024-04-16 23:04:13.019719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.202 [2024-04-16 23:04:13.019883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.202 [2024-04-16 23:04:13.019910] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.202 qpair failed and we were unable to recover it. 00:26:22.202 [2024-04-16 23:04:13.020077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.202 [2024-04-16 23:04:13.020213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.202 [2024-04-16 23:04:13.020239] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.202 qpair failed and we were unable to recover it. 00:26:22.202 [2024-04-16 23:04:13.020357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.202 [2024-04-16 23:04:13.020521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.202 [2024-04-16 23:04:13.020548] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.202 qpair failed and we were unable to recover it. 00:26:22.202 [2024-04-16 23:04:13.020715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.202 [2024-04-16 23:04:13.020889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.203 [2024-04-16 23:04:13.020913] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.203 qpair failed and we were unable to recover it. 00:26:22.203 [2024-04-16 23:04:13.021029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.203 [2024-04-16 23:04:13.021188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.203 [2024-04-16 23:04:13.021213] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.203 qpair failed and we were unable to recover it. 00:26:22.203 [2024-04-16 23:04:13.021361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.203 [2024-04-16 23:04:13.021521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.203 [2024-04-16 23:04:13.021547] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.203 qpair failed and we were unable to recover it. 00:26:22.203 [2024-04-16 23:04:13.021741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.203 [2024-04-16 23:04:13.021888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.203 [2024-04-16 23:04:13.021920] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.203 qpair failed and we were unable to recover it. 00:26:22.203 [2024-04-16 23:04:13.022066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.203 [2024-04-16 23:04:13.022220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.203 [2024-04-16 23:04:13.022249] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.203 qpair failed and we were unable to recover it. 00:26:22.203 [2024-04-16 23:04:13.022405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.203 [2024-04-16 23:04:13.022552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.203 [2024-04-16 23:04:13.022580] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.203 qpair failed and we were unable to recover it. 00:26:22.203 [2024-04-16 23:04:13.022715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.203 [2024-04-16 23:04:13.022829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.203 [2024-04-16 23:04:13.022854] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.203 qpair failed and we were unable to recover it. 00:26:22.203 [2024-04-16 23:04:13.022996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.203 [2024-04-16 23:04:13.023165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.203 [2024-04-16 23:04:13.023197] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.203 qpair failed and we were unable to recover it. 00:26:22.203 [2024-04-16 23:04:13.023301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.203 [2024-04-16 23:04:13.023445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.203 [2024-04-16 23:04:13.023470] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.203 qpair failed and we were unable to recover it. 00:26:22.203 [2024-04-16 23:04:13.023610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.203 [2024-04-16 23:04:13.023727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.203 [2024-04-16 23:04:13.023752] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.203 qpair failed and we were unable to recover it. 00:26:22.203 [2024-04-16 23:04:13.023888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.203 [2024-04-16 23:04:13.024031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.203 [2024-04-16 23:04:13.024056] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.203 qpair failed and we were unable to recover it. 00:26:22.203 [2024-04-16 23:04:13.024238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.203 [2024-04-16 23:04:13.024352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.203 [2024-04-16 23:04:13.024376] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.203 qpair failed and we were unable to recover it. 00:26:22.203 [2024-04-16 23:04:13.024531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.203 [2024-04-16 23:04:13.024694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.203 [2024-04-16 23:04:13.024718] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.203 qpair failed and we were unable to recover it. 00:26:22.203 [2024-04-16 23:04:13.024841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.203 [2024-04-16 23:04:13.024969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.203 [2024-04-16 23:04:13.024997] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.203 qpair failed and we were unable to recover it. 00:26:22.203 [2024-04-16 23:04:13.025141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.203 [2024-04-16 23:04:13.025316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.203 [2024-04-16 23:04:13.025357] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.203 qpair failed and we were unable to recover it. 00:26:22.203 [2024-04-16 23:04:13.025487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.203 [2024-04-16 23:04:13.025670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.203 [2024-04-16 23:04:13.025698] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.203 qpair failed and we were unable to recover it. 00:26:22.203 [2024-04-16 23:04:13.025882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.203 [2024-04-16 23:04:13.025995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.203 [2024-04-16 23:04:13.026020] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.203 qpair failed and we were unable to recover it. 00:26:22.203 [2024-04-16 23:04:13.026163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.203 [2024-04-16 23:04:13.026334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.203 [2024-04-16 23:04:13.026362] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.203 qpair failed and we were unable to recover it. 00:26:22.203 [2024-04-16 23:04:13.026489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.203 [2024-04-16 23:04:13.026643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.203 [2024-04-16 23:04:13.026667] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.203 qpair failed and we were unable to recover it. 00:26:22.203 [2024-04-16 23:04:13.026836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.203 [2024-04-16 23:04:13.026956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.203 [2024-04-16 23:04:13.026983] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.203 qpair failed and we were unable to recover it. 00:26:22.203 [2024-04-16 23:04:13.027146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.203 [2024-04-16 23:04:13.027265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.203 [2024-04-16 23:04:13.027291] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.203 qpair failed and we were unable to recover it. 00:26:22.203 [2024-04-16 23:04:13.027465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.203 [2024-04-16 23:04:13.027617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.203 [2024-04-16 23:04:13.027645] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.203 qpair failed and we were unable to recover it. 00:26:22.203 [2024-04-16 23:04:13.027813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.203 [2024-04-16 23:04:13.027955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.203 [2024-04-16 23:04:13.027979] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.203 qpair failed and we were unable to recover it. 00:26:22.203 [2024-04-16 23:04:13.028101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.203 [2024-04-16 23:04:13.028219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.203 [2024-04-16 23:04:13.028245] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.203 qpair failed and we were unable to recover it. 00:26:22.203 [2024-04-16 23:04:13.028370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.203 [2024-04-16 23:04:13.028479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.203 [2024-04-16 23:04:13.028504] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.203 qpair failed and we were unable to recover it. 00:26:22.203 [2024-04-16 23:04:13.028611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.203 [2024-04-16 23:04:13.028755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.203 [2024-04-16 23:04:13.028779] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.203 qpair failed and we were unable to recover it. 00:26:22.203 [2024-04-16 23:04:13.028921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.203 [2024-04-16 23:04:13.029111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.204 [2024-04-16 23:04:13.029138] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.204 qpair failed and we were unable to recover it. 00:26:22.204 [2024-04-16 23:04:13.029313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.204 [2024-04-16 23:04:13.029429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.204 [2024-04-16 23:04:13.029454] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.204 qpair failed and we were unable to recover it. 00:26:22.204 [2024-04-16 23:04:13.029588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.204 [2024-04-16 23:04:13.029754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.204 [2024-04-16 23:04:13.029795] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.204 qpair failed and we were unable to recover it. 00:26:22.204 [2024-04-16 23:04:13.029951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.204 [2024-04-16 23:04:13.030108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.204 [2024-04-16 23:04:13.030133] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.204 qpair failed and we were unable to recover it. 00:26:22.204 [2024-04-16 23:04:13.030301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.204 [2024-04-16 23:04:13.030442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.204 [2024-04-16 23:04:13.030467] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.204 qpair failed and we were unable to recover it. 00:26:22.204 [2024-04-16 23:04:13.030574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.204 [2024-04-16 23:04:13.030719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.204 [2024-04-16 23:04:13.030743] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.204 qpair failed and we were unable to recover it. 00:26:22.204 [2024-04-16 23:04:13.030871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.204 [2024-04-16 23:04:13.031055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.204 [2024-04-16 23:04:13.031083] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.204 qpair failed and we were unable to recover it. 00:26:22.204 [2024-04-16 23:04:13.031243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.204 [2024-04-16 23:04:13.031429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.204 [2024-04-16 23:04:13.031457] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.204 qpair failed and we were unable to recover it. 00:26:22.204 [2024-04-16 23:04:13.031591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.204 [2024-04-16 23:04:13.031735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.204 [2024-04-16 23:04:13.031760] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.204 qpair failed and we were unable to recover it. 00:26:22.204 [2024-04-16 23:04:13.031888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.204 [2024-04-16 23:04:13.032050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.204 [2024-04-16 23:04:13.032077] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.204 qpair failed and we were unable to recover it. 00:26:22.204 [2024-04-16 23:04:13.032231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.204 [2024-04-16 23:04:13.032384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.204 [2024-04-16 23:04:13.032412] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.204 qpair failed and we were unable to recover it. 00:26:22.204 [2024-04-16 23:04:13.032558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.204 [2024-04-16 23:04:13.032679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.204 [2024-04-16 23:04:13.032707] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.204 qpair failed and we were unable to recover it. 00:26:22.204 [2024-04-16 23:04:13.032838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.204 [2024-04-16 23:04:13.032973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.204 [2024-04-16 23:04:13.032997] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.204 qpair failed and we were unable to recover it. 00:26:22.204 [2024-04-16 23:04:13.033160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.204 [2024-04-16 23:04:13.033301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.204 [2024-04-16 23:04:13.033329] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.204 qpair failed and we were unable to recover it. 00:26:22.204 [2024-04-16 23:04:13.033478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.204 [2024-04-16 23:04:13.033595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.204 [2024-04-16 23:04:13.033623] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.204 qpair failed and we were unable to recover it. 00:26:22.204 [2024-04-16 23:04:13.033770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.204 [2024-04-16 23:04:13.033951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.204 [2024-04-16 23:04:13.033979] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.204 qpair failed and we were unable to recover it. 00:26:22.204 [2024-04-16 23:04:13.034140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.204 [2024-04-16 23:04:13.034309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.204 [2024-04-16 23:04:13.034338] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.204 qpair failed and we were unable to recover it. 00:26:22.204 [2024-04-16 23:04:13.034486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.204 [2024-04-16 23:04:13.034645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.204 [2024-04-16 23:04:13.034672] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.204 qpair failed and we were unable to recover it. 00:26:22.204 [2024-04-16 23:04:13.034825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.204 [2024-04-16 23:04:13.034996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.204 [2024-04-16 23:04:13.035021] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.204 qpair failed and we were unable to recover it. 00:26:22.204 [2024-04-16 23:04:13.035162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.204 [2024-04-16 23:04:13.035329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.204 [2024-04-16 23:04:13.035357] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.204 qpair failed and we were unable to recover it. 00:26:22.204 [2024-04-16 23:04:13.035490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.204 [2024-04-16 23:04:13.035631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.204 [2024-04-16 23:04:13.035659] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.204 qpair failed and we were unable to recover it. 00:26:22.204 [2024-04-16 23:04:13.035822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.204 [2024-04-16 23:04:13.035942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.204 [2024-04-16 23:04:13.035969] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.204 qpair failed and we were unable to recover it. 00:26:22.204 [2024-04-16 23:04:13.036104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.204 [2024-04-16 23:04:13.036254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.204 [2024-04-16 23:04:13.036283] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.204 qpair failed and we were unable to recover it. 00:26:22.205 [2024-04-16 23:04:13.036394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.205 [2024-04-16 23:04:13.036542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.205 [2024-04-16 23:04:13.036569] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.205 qpair failed and we were unable to recover it. 00:26:22.205 [2024-04-16 23:04:13.036707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.205 [2024-04-16 23:04:13.036838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.205 [2024-04-16 23:04:13.036863] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.205 qpair failed and we were unable to recover it. 00:26:22.205 [2024-04-16 23:04:13.037009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.205 [2024-04-16 23:04:13.037113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.205 [2024-04-16 23:04:13.037138] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.205 qpair failed and we were unable to recover it. 00:26:22.205 [2024-04-16 23:04:13.037342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.205 [2024-04-16 23:04:13.037464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.205 [2024-04-16 23:04:13.037491] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.205 qpair failed and we were unable to recover it. 00:26:22.205 [2024-04-16 23:04:13.037674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.205 [2024-04-16 23:04:13.037798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.205 [2024-04-16 23:04:13.037826] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.205 qpair failed and we were unable to recover it. 00:26:22.205 [2024-04-16 23:04:13.037992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.205 [2024-04-16 23:04:13.038141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.205 [2024-04-16 23:04:13.038171] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.205 qpair failed and we were unable to recover it. 00:26:22.205 [2024-04-16 23:04:13.038330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.205 [2024-04-16 23:04:13.038483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.205 [2024-04-16 23:04:13.038511] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.205 qpair failed and we were unable to recover it. 00:26:22.205 [2024-04-16 23:04:13.038679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.205 [2024-04-16 23:04:13.038816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.205 [2024-04-16 23:04:13.038841] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.205 qpair failed and we were unable to recover it. 00:26:22.205 [2024-04-16 23:04:13.038976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.205 [2024-04-16 23:04:13.039084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.205 [2024-04-16 23:04:13.039108] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.205 qpair failed and we were unable to recover it. 00:26:22.205 [2024-04-16 23:04:13.039254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.205 [2024-04-16 23:04:13.039420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.205 [2024-04-16 23:04:13.039445] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.205 qpair failed and we were unable to recover it. 00:26:22.205 [2024-04-16 23:04:13.039580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.205 [2024-04-16 23:04:13.039741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.205 [2024-04-16 23:04:13.039768] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.205 qpair failed and we were unable to recover it. 00:26:22.205 [2024-04-16 23:04:13.039919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.205 [2024-04-16 23:04:13.040108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.205 [2024-04-16 23:04:13.040136] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.205 qpair failed and we were unable to recover it. 00:26:22.205 [2024-04-16 23:04:13.040312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.205 [2024-04-16 23:04:13.040426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.205 [2024-04-16 23:04:13.040451] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.205 qpair failed and we were unable to recover it. 00:26:22.205 [2024-04-16 23:04:13.040594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.205 [2024-04-16 23:04:13.040731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.205 [2024-04-16 23:04:13.040756] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.205 qpair failed and we were unable to recover it. 00:26:22.205 [2024-04-16 23:04:13.040923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.205 [2024-04-16 23:04:13.041059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.205 [2024-04-16 23:04:13.041084] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.205 qpair failed and we were unable to recover it. 00:26:22.205 [2024-04-16 23:04:13.041218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.205 [2024-04-16 23:04:13.041324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.205 [2024-04-16 23:04:13.041349] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.205 qpair failed and we were unable to recover it. 00:26:22.205 [2024-04-16 23:04:13.041501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.205 [2024-04-16 23:04:13.041611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.205 [2024-04-16 23:04:13.041636] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.205 qpair failed and we were unable to recover it. 00:26:22.205 [2024-04-16 23:04:13.041771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.205 [2024-04-16 23:04:13.041929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.205 [2024-04-16 23:04:13.041953] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.205 qpair failed and we were unable to recover it. 00:26:22.205 [2024-04-16 23:04:13.042095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.205 [2024-04-16 23:04:13.042269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.205 [2024-04-16 23:04:13.042294] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.205 qpair failed and we were unable to recover it. 00:26:22.205 [2024-04-16 23:04:13.042472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.205 [2024-04-16 23:04:13.042604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.205 [2024-04-16 23:04:13.042629] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.205 qpair failed and we were unable to recover it. 00:26:22.205 [2024-04-16 23:04:13.042761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.205 [2024-04-16 23:04:13.042929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.205 [2024-04-16 23:04:13.042954] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.205 qpair failed and we were unable to recover it. 00:26:22.205 [2024-04-16 23:04:13.043066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.205 [2024-04-16 23:04:13.043189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.205 [2024-04-16 23:04:13.043216] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.205 qpair failed and we were unable to recover it. 00:26:22.205 [2024-04-16 23:04:13.043359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.205 [2024-04-16 23:04:13.043547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.205 [2024-04-16 23:04:13.043572] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.205 qpair failed and we were unable to recover it. 00:26:22.205 [2024-04-16 23:04:13.043717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.205 [2024-04-16 23:04:13.043825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.205 [2024-04-16 23:04:13.043850] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.205 qpair failed and we were unable to recover it. 00:26:22.205 [2024-04-16 23:04:13.044015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.205 [2024-04-16 23:04:13.044131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.205 [2024-04-16 23:04:13.044156] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.205 qpair failed and we were unable to recover it. 00:26:22.205 [2024-04-16 23:04:13.044304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.205 [2024-04-16 23:04:13.044442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.205 [2024-04-16 23:04:13.044467] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.205 qpair failed and we were unable to recover it. 00:26:22.205 [2024-04-16 23:04:13.044661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.205 [2024-04-16 23:04:13.044831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.205 [2024-04-16 23:04:13.044856] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.205 qpair failed and we were unable to recover it. 00:26:22.205 [2024-04-16 23:04:13.045012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.205 [2024-04-16 23:04:13.045147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.205 [2024-04-16 23:04:13.045172] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.205 qpair failed and we were unable to recover it. 00:26:22.206 [2024-04-16 23:04:13.045336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.206 [2024-04-16 23:04:13.045467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.206 [2024-04-16 23:04:13.045495] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.206 qpair failed and we were unable to recover it. 00:26:22.206 [2024-04-16 23:04:13.045682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.206 [2024-04-16 23:04:13.045852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.206 [2024-04-16 23:04:13.045879] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.206 qpair failed and we were unable to recover it. 00:26:22.206 [2024-04-16 23:04:13.046023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.206 [2024-04-16 23:04:13.046209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.206 [2024-04-16 23:04:13.046235] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.206 qpair failed and we were unable to recover it. 00:26:22.206 [2024-04-16 23:04:13.046376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.206 [2024-04-16 23:04:13.046526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.206 [2024-04-16 23:04:13.046551] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.206 qpair failed and we were unable to recover it. 00:26:22.206 [2024-04-16 23:04:13.046725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.206 [2024-04-16 23:04:13.046895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.206 [2024-04-16 23:04:13.046922] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.206 qpair failed and we were unable to recover it. 00:26:22.206 [2024-04-16 23:04:13.047087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.206 [2024-04-16 23:04:13.047275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.206 [2024-04-16 23:04:13.047304] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.206 qpair failed and we were unable to recover it. 00:26:22.206 [2024-04-16 23:04:13.047431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.206 [2024-04-16 23:04:13.047597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.206 [2024-04-16 23:04:13.047622] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.206 qpair failed and we were unable to recover it. 00:26:22.206 [2024-04-16 23:04:13.047764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.206 [2024-04-16 23:04:13.047912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.206 [2024-04-16 23:04:13.047937] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.206 qpair failed and we were unable to recover it. 00:26:22.206 [2024-04-16 23:04:13.048086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.206 [2024-04-16 23:04:13.048300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.206 [2024-04-16 23:04:13.048325] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.206 qpair failed and we were unable to recover it. 00:26:22.206 [2024-04-16 23:04:13.048436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.206 [2024-04-16 23:04:13.048568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.206 [2024-04-16 23:04:13.048598] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.206 qpair failed and we were unable to recover it. 00:26:22.206 [2024-04-16 23:04:13.048744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.206 [2024-04-16 23:04:13.048866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.206 [2024-04-16 23:04:13.048894] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.206 qpair failed and we were unable to recover it. 00:26:22.206 [2024-04-16 23:04:13.049078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.206 [2024-04-16 23:04:13.049211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.206 [2024-04-16 23:04:13.049241] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.206 qpair failed and we were unable to recover it. 00:26:22.206 [2024-04-16 23:04:13.049441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.206 [2024-04-16 23:04:13.049592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.206 [2024-04-16 23:04:13.049622] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.206 qpair failed and we were unable to recover it. 00:26:22.206 [2024-04-16 23:04:13.049778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.206 [2024-04-16 23:04:13.049920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.206 [2024-04-16 23:04:13.049962] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.206 qpair failed and we were unable to recover it. 00:26:22.206 [2024-04-16 23:04:13.050089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.206 [2024-04-16 23:04:13.050207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.206 [2024-04-16 23:04:13.050236] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.206 qpair failed and we were unable to recover it. 00:26:22.206 [2024-04-16 23:04:13.050359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.206 [2024-04-16 23:04:13.050528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.206 [2024-04-16 23:04:13.050553] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.206 qpair failed and we were unable to recover it. 00:26:22.206 [2024-04-16 23:04:13.050694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.206 [2024-04-16 23:04:13.050832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.206 [2024-04-16 23:04:13.050857] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.206 qpair failed and we were unable to recover it. 00:26:22.206 [2024-04-16 23:04:13.051031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.206 [2024-04-16 23:04:13.051266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.206 [2024-04-16 23:04:13.051295] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.206 qpair failed and we were unable to recover it. 00:26:22.206 [2024-04-16 23:04:13.051417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.206 [2024-04-16 23:04:13.051582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.206 [2024-04-16 23:04:13.051610] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.206 qpair failed and we were unable to recover it. 00:26:22.206 [2024-04-16 23:04:13.051758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.206 [2024-04-16 23:04:13.051910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.206 [2024-04-16 23:04:13.051938] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.206 qpair failed and we were unable to recover it. 00:26:22.206 [2024-04-16 23:04:13.052066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.206 [2024-04-16 23:04:13.052219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.206 [2024-04-16 23:04:13.052247] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.206 qpair failed and we were unable to recover it. 00:26:22.206 [2024-04-16 23:04:13.052425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.206 [2024-04-16 23:04:13.052616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.206 [2024-04-16 23:04:13.052644] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.206 qpair failed and we were unable to recover it. 00:26:22.206 [2024-04-16 23:04:13.052811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.206 [2024-04-16 23:04:13.052931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.206 [2024-04-16 23:04:13.052957] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.206 qpair failed and we were unable to recover it. 00:26:22.206 [2024-04-16 23:04:13.053119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.206 [2024-04-16 23:04:13.053279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.206 [2024-04-16 23:04:13.053308] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.206 qpair failed and we were unable to recover it. 00:26:22.206 [2024-04-16 23:04:13.053440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.206 [2024-04-16 23:04:13.053618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.206 [2024-04-16 23:04:13.053645] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.206 qpair failed and we were unable to recover it. 00:26:22.206 [2024-04-16 23:04:13.053836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.206 [2024-04-16 23:04:13.054022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.206 [2024-04-16 23:04:13.054049] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.206 qpair failed and we were unable to recover it. 00:26:22.207 [2024-04-16 23:04:13.054208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.207 [2024-04-16 23:04:13.054399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.207 [2024-04-16 23:04:13.054427] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.207 qpair failed and we were unable to recover it. 00:26:22.207 [2024-04-16 23:04:13.054553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.207 [2024-04-16 23:04:13.054706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.207 [2024-04-16 23:04:13.054734] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.207 qpair failed and we were unable to recover it. 00:26:22.207 [2024-04-16 23:04:13.054912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.207 [2024-04-16 23:04:13.055061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.207 [2024-04-16 23:04:13.055093] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.207 qpair failed and we were unable to recover it. 00:26:22.207 [2024-04-16 23:04:13.055280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.207 [2024-04-16 23:04:13.055467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.207 [2024-04-16 23:04:13.055494] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.207 qpair failed and we were unable to recover it. 00:26:22.207 [2024-04-16 23:04:13.055642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.207 [2024-04-16 23:04:13.055758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.207 [2024-04-16 23:04:13.055786] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.207 qpair failed and we were unable to recover it. 00:26:22.207 [2024-04-16 23:04:13.055942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.207 [2024-04-16 23:04:13.056104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.207 [2024-04-16 23:04:13.056132] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.207 qpair failed and we were unable to recover it. 00:26:22.207 [2024-04-16 23:04:13.056295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.207 [2024-04-16 23:04:13.056488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.207 [2024-04-16 23:04:13.056513] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.207 qpair failed and we were unable to recover it. 00:26:22.207 [2024-04-16 23:04:13.056620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.207 [2024-04-16 23:04:13.056727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.207 [2024-04-16 23:04:13.056752] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.207 qpair failed and we were unable to recover it. 00:26:22.207 [2024-04-16 23:04:13.056917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.207 [2024-04-16 23:04:13.057101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.207 [2024-04-16 23:04:13.057128] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.207 qpair failed and we were unable to recover it. 00:26:22.207 [2024-04-16 23:04:13.057296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.207 [2024-04-16 23:04:13.057413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.207 [2024-04-16 23:04:13.057438] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.207 qpair failed and we were unable to recover it. 00:26:22.207 [2024-04-16 23:04:13.057626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.207 [2024-04-16 23:04:13.057791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.207 [2024-04-16 23:04:13.057816] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.207 qpair failed and we were unable to recover it. 00:26:22.207 [2024-04-16 23:04:13.057934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.207 [2024-04-16 23:04:13.058047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.207 [2024-04-16 23:04:13.058071] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.207 qpair failed and we were unable to recover it. 00:26:22.207 [2024-04-16 23:04:13.058219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.207 [2024-04-16 23:04:13.058412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.207 [2024-04-16 23:04:13.058445] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.207 qpair failed and we were unable to recover it. 00:26:22.207 [2024-04-16 23:04:13.058560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.207 [2024-04-16 23:04:13.058714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.207 [2024-04-16 23:04:13.058742] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.207 qpair failed and we were unable to recover it. 00:26:22.207 [2024-04-16 23:04:13.058896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.207 [2024-04-16 23:04:13.059061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.207 [2024-04-16 23:04:13.059086] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.207 qpair failed and we were unable to recover it. 00:26:22.207 [2024-04-16 23:04:13.059229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.207 [2024-04-16 23:04:13.059369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.207 [2024-04-16 23:04:13.059394] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.207 qpair failed and we were unable to recover it. 00:26:22.207 [2024-04-16 23:04:13.059526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.207 [2024-04-16 23:04:13.059637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.207 [2024-04-16 23:04:13.059662] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.207 qpair failed and we were unable to recover it. 00:26:22.207 [2024-04-16 23:04:13.059841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.207 [2024-04-16 23:04:13.059951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.207 [2024-04-16 23:04:13.059976] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.207 qpair failed and we were unable to recover it. 00:26:22.207 [2024-04-16 23:04:13.060114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.207 [2024-04-16 23:04:13.060300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.207 [2024-04-16 23:04:13.060326] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.207 qpair failed and we were unable to recover it. 00:26:22.207 [2024-04-16 23:04:13.060470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.207 [2024-04-16 23:04:13.060585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.207 [2024-04-16 23:04:13.060610] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.207 qpair failed and we were unable to recover it. 00:26:22.207 [2024-04-16 23:04:13.060774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.207 [2024-04-16 23:04:13.060966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.207 [2024-04-16 23:04:13.060991] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.207 qpair failed and we were unable to recover it. 00:26:22.207 [2024-04-16 23:04:13.061128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.207 [2024-04-16 23:04:13.061324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.207 [2024-04-16 23:04:13.061350] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.207 qpair failed and we were unable to recover it. 00:26:22.207 [2024-04-16 23:04:13.061517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.207 [2024-04-16 23:04:13.061686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.207 [2024-04-16 23:04:13.061713] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.207 qpair failed and we were unable to recover it. 00:26:22.207 [2024-04-16 23:04:13.061890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.207 [2024-04-16 23:04:13.062034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.207 [2024-04-16 23:04:13.062058] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.207 qpair failed and we were unable to recover it. 00:26:22.207 [2024-04-16 23:04:13.062168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.207 [2024-04-16 23:04:13.062284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.207 [2024-04-16 23:04:13.062310] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.207 qpair failed and we were unable to recover it. 00:26:22.207 [2024-04-16 23:04:13.062419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.207 [2024-04-16 23:04:13.062552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.207 [2024-04-16 23:04:13.062577] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.207 qpair failed and we were unable to recover it. 00:26:22.207 [2024-04-16 23:04:13.062721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.207 [2024-04-16 23:04:13.062922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.207 [2024-04-16 23:04:13.062947] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.207 qpair failed and we were unable to recover it. 00:26:22.207 [2024-04-16 23:04:13.063090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.207 [2024-04-16 23:04:13.063228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.207 [2024-04-16 23:04:13.063254] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.207 qpair failed and we were unable to recover it. 00:26:22.207 [2024-04-16 23:04:13.063365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.207 [2024-04-16 23:04:13.063501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.207 [2024-04-16 23:04:13.063526] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.208 qpair failed and we were unable to recover it. 00:26:22.208 [2024-04-16 23:04:13.063671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.208 [2024-04-16 23:04:13.063885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.208 [2024-04-16 23:04:13.063910] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.208 qpair failed and we were unable to recover it. 00:26:22.208 [2024-04-16 23:04:13.064053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.208 [2024-04-16 23:04:13.064229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.208 [2024-04-16 23:04:13.064258] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.208 qpair failed and we were unable to recover it. 00:26:22.208 [2024-04-16 23:04:13.064447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.208 [2024-04-16 23:04:13.064565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.208 [2024-04-16 23:04:13.064591] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.208 qpair failed and we were unable to recover it. 00:26:22.208 [2024-04-16 23:04:13.064712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.208 [2024-04-16 23:04:13.064878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.208 [2024-04-16 23:04:13.064903] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.208 qpair failed and we were unable to recover it. 00:26:22.208 [2024-04-16 23:04:13.065085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.208 [2024-04-16 23:04:13.065200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.208 [2024-04-16 23:04:13.065225] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.208 qpair failed and we were unable to recover it. 00:26:22.208 [2024-04-16 23:04:13.065368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.208 [2024-04-16 23:04:13.065511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.208 [2024-04-16 23:04:13.065535] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.208 qpair failed and we were unable to recover it. 00:26:22.208 [2024-04-16 23:04:13.065703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.208 [2024-04-16 23:04:13.065842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.208 [2024-04-16 23:04:13.065866] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.208 qpair failed and we were unable to recover it. 00:26:22.208 [2024-04-16 23:04:13.066033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.208 [2024-04-16 23:04:13.066194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.208 [2024-04-16 23:04:13.066222] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.208 qpair failed and we were unable to recover it. 00:26:22.208 [2024-04-16 23:04:13.066348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.208 [2024-04-16 23:04:13.066504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.208 [2024-04-16 23:04:13.066531] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.208 qpair failed and we were unable to recover it. 00:26:22.208 [2024-04-16 23:04:13.066715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.208 [2024-04-16 23:04:13.066856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.208 [2024-04-16 23:04:13.066881] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.208 qpair failed and we were unable to recover it. 00:26:22.208 [2024-04-16 23:04:13.067073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.208 [2024-04-16 23:04:13.067187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.208 [2024-04-16 23:04:13.067213] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.208 qpair failed and we were unable to recover it. 00:26:22.208 [2024-04-16 23:04:13.067357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.208 [2024-04-16 23:04:13.067476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.208 [2024-04-16 23:04:13.067503] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.208 qpair failed and we were unable to recover it. 00:26:22.208 [2024-04-16 23:04:13.067620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.208 [2024-04-16 23:04:13.067743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.208 [2024-04-16 23:04:13.067771] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.208 qpair failed and we were unable to recover it. 00:26:22.208 [2024-04-16 23:04:13.067922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.208 [2024-04-16 23:04:13.068082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.208 [2024-04-16 23:04:13.068109] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.208 qpair failed and we were unable to recover it. 00:26:22.208 [2024-04-16 23:04:13.068298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.208 [2024-04-16 23:04:13.068414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.208 [2024-04-16 23:04:13.068439] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.208 qpair failed and we were unable to recover it. 00:26:22.208 [2024-04-16 23:04:13.068565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.208 [2024-04-16 23:04:13.068712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.208 [2024-04-16 23:04:13.068739] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.208 qpair failed and we were unable to recover it. 00:26:22.208 [2024-04-16 23:04:13.068888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.208 [2024-04-16 23:04:13.069021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.208 [2024-04-16 23:04:13.069048] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.208 qpair failed and we were unable to recover it. 00:26:22.208 [2024-04-16 23:04:13.069201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.208 [2024-04-16 23:04:13.069333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.208 [2024-04-16 23:04:13.069363] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.208 qpair failed and we were unable to recover it. 00:26:22.208 [2024-04-16 23:04:13.069530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.208 [2024-04-16 23:04:13.069643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.208 [2024-04-16 23:04:13.069668] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.208 qpair failed and we were unable to recover it. 00:26:22.208 [2024-04-16 23:04:13.069801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.208 [2024-04-16 23:04:13.069958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.208 [2024-04-16 23:04:13.069986] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.208 qpair failed and we were unable to recover it. 00:26:22.208 [2024-04-16 23:04:13.070132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.208 [2024-04-16 23:04:13.070270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.208 [2024-04-16 23:04:13.070299] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.208 qpair failed and we were unable to recover it. 00:26:22.208 [2024-04-16 23:04:13.070453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.208 [2024-04-16 23:04:13.070608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.208 [2024-04-16 23:04:13.070635] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.208 qpair failed and we were unable to recover it. 00:26:22.208 [2024-04-16 23:04:13.070791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.208 [2024-04-16 23:04:13.070904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.208 [2024-04-16 23:04:13.070929] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.208 qpair failed and we were unable to recover it. 00:26:22.208 [2024-04-16 23:04:13.071068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.208 [2024-04-16 23:04:13.071190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.208 [2024-04-16 23:04:13.071218] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.208 qpair failed and we were unable to recover it. 00:26:22.208 [2024-04-16 23:04:13.071386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.208 [2024-04-16 23:04:13.071518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.208 [2024-04-16 23:04:13.071545] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.208 qpair failed and we were unable to recover it. 00:26:22.208 [2024-04-16 23:04:13.071689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.208 [2024-04-16 23:04:13.071841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.208 [2024-04-16 23:04:13.071868] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.208 qpair failed and we were unable to recover it. 00:26:22.208 [2024-04-16 23:04:13.072028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.208 [2024-04-16 23:04:13.072130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.208 [2024-04-16 23:04:13.072154] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.209 qpair failed and we were unable to recover it. 00:26:22.209 [2024-04-16 23:04:13.072300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.209 [2024-04-16 23:04:13.072427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.209 [2024-04-16 23:04:13.072456] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.209 qpair failed and we were unable to recover it. 00:26:22.209 [2024-04-16 23:04:13.072584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.209 [2024-04-16 23:04:13.072743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.209 [2024-04-16 23:04:13.072768] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.209 qpair failed and we were unable to recover it. 00:26:22.209 [2024-04-16 23:04:13.072874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.209 [2024-04-16 23:04:13.073076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.209 [2024-04-16 23:04:13.073101] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.209 qpair failed and we were unable to recover it. 00:26:22.209 [2024-04-16 23:04:13.073221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.209 [2024-04-16 23:04:13.073356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.209 [2024-04-16 23:04:13.073381] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.209 qpair failed and we were unable to recover it. 00:26:22.209 [2024-04-16 23:04:13.073573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.209 [2024-04-16 23:04:13.073734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.209 [2024-04-16 23:04:13.073762] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.209 qpair failed and we were unable to recover it. 00:26:22.209 [2024-04-16 23:04:13.073880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.209 [2024-04-16 23:04:13.074025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.209 [2024-04-16 23:04:13.074053] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.209 qpair failed and we were unable to recover it. 00:26:22.209 [2024-04-16 23:04:13.074187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.209 [2024-04-16 23:04:13.074338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.209 [2024-04-16 23:04:13.074366] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.209 qpair failed and we were unable to recover it. 00:26:22.209 [2024-04-16 23:04:13.074491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.209 [2024-04-16 23:04:13.074604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.209 [2024-04-16 23:04:13.074634] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.209 qpair failed and we were unable to recover it. 00:26:22.209 [2024-04-16 23:04:13.074827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.209 [2024-04-16 23:04:13.074981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.209 [2024-04-16 23:04:13.075009] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.209 qpair failed and we were unable to recover it. 00:26:22.209 [2024-04-16 23:04:13.075163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.209 [2024-04-16 23:04:13.075295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.209 [2024-04-16 23:04:13.075325] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.209 qpair failed and we were unable to recover it. 00:26:22.209 [2024-04-16 23:04:13.075480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.209 [2024-04-16 23:04:13.075595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.209 [2024-04-16 23:04:13.075622] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.209 qpair failed and we were unable to recover it. 00:26:22.209 [2024-04-16 23:04:13.075811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.209 [2024-04-16 23:04:13.075945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.209 [2024-04-16 23:04:13.075969] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.209 qpair failed and we were unable to recover it. 00:26:22.209 [2024-04-16 23:04:13.076111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.209 [2024-04-16 23:04:13.076222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.209 [2024-04-16 23:04:13.076247] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.209 qpair failed and we were unable to recover it. 00:26:22.209 [2024-04-16 23:04:13.076378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.209 [2024-04-16 23:04:13.076541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.209 [2024-04-16 23:04:13.076569] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.209 qpair failed and we were unable to recover it. 00:26:22.209 [2024-04-16 23:04:13.076730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.209 [2024-04-16 23:04:13.076896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.209 [2024-04-16 23:04:13.076921] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.209 qpair failed and we were unable to recover it. 00:26:22.209 [2024-04-16 23:04:13.077063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.209 [2024-04-16 23:04:13.077203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.209 [2024-04-16 23:04:13.077230] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.209 qpair failed and we were unable to recover it. 00:26:22.209 [2024-04-16 23:04:13.077343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.209 [2024-04-16 23:04:13.077478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.209 [2024-04-16 23:04:13.077506] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.209 qpair failed and we were unable to recover it. 00:26:22.209 [2024-04-16 23:04:13.077671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.209 [2024-04-16 23:04:13.077778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.209 [2024-04-16 23:04:13.077804] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.209 qpair failed and we were unable to recover it. 00:26:22.209 [2024-04-16 23:04:13.077951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.209 [2024-04-16 23:04:13.078085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.209 [2024-04-16 23:04:13.078127] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.209 qpair failed and we were unable to recover it. 00:26:22.209 [2024-04-16 23:04:13.078321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.209 [2024-04-16 23:04:13.078492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.209 [2024-04-16 23:04:13.078517] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.209 qpair failed and we were unable to recover it. 00:26:22.209 [2024-04-16 23:04:13.078656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.209 [2024-04-16 23:04:13.078819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.209 [2024-04-16 23:04:13.078847] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.209 qpair failed and we were unable to recover it. 00:26:22.209 [2024-04-16 23:04:13.079016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.209 [2024-04-16 23:04:13.079148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.209 [2024-04-16 23:04:13.079173] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.209 qpair failed and we were unable to recover it. 00:26:22.209 [2024-04-16 23:04:13.079318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.209 [2024-04-16 23:04:13.079504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.209 [2024-04-16 23:04:13.079531] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.210 qpair failed and we were unable to recover it. 00:26:22.210 [2024-04-16 23:04:13.079660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.210 [2024-04-16 23:04:13.079799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.210 [2024-04-16 23:04:13.079823] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.210 qpair failed and we were unable to recover it. 00:26:22.210 [2024-04-16 23:04:13.079967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.210 [2024-04-16 23:04:13.080104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.210 [2024-04-16 23:04:13.080129] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.210 qpair failed and we were unable to recover it. 00:26:22.210 [2024-04-16 23:04:13.080320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.210 [2024-04-16 23:04:13.080488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.210 [2024-04-16 23:04:13.080529] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.210 qpair failed and we were unable to recover it. 00:26:22.210 [2024-04-16 23:04:13.080643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.210 [2024-04-16 23:04:13.080785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.210 [2024-04-16 23:04:13.080810] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.210 qpair failed and we were unable to recover it. 00:26:22.210 [2024-04-16 23:04:13.080947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.210 [2024-04-16 23:04:13.081114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.210 [2024-04-16 23:04:13.081139] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.210 qpair failed and we were unable to recover it. 00:26:22.210 [2024-04-16 23:04:13.081275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.210 [2024-04-16 23:04:13.081440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.210 [2024-04-16 23:04:13.081465] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.210 qpair failed and we were unable to recover it. 00:26:22.210 [2024-04-16 23:04:13.081578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.210 [2024-04-16 23:04:13.081745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.210 [2024-04-16 23:04:13.081772] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.210 qpair failed and we were unable to recover it. 00:26:22.210 [2024-04-16 23:04:13.081886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.210 [2024-04-16 23:04:13.082044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.210 [2024-04-16 23:04:13.082072] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.210 qpair failed and we were unable to recover it. 00:26:22.210 [2024-04-16 23:04:13.082256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.210 [2024-04-16 23:04:13.082368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.210 [2024-04-16 23:04:13.082394] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.210 qpair failed and we were unable to recover it. 00:26:22.210 [2024-04-16 23:04:13.082579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.210 [2024-04-16 23:04:13.082742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.210 [2024-04-16 23:04:13.082767] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.210 qpair failed and we were unable to recover it. 00:26:22.210 [2024-04-16 23:04:13.082899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.210 [2024-04-16 23:04:13.083078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.210 [2024-04-16 23:04:13.083105] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.210 qpair failed and we were unable to recover it. 00:26:22.210 [2024-04-16 23:04:13.083287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.210 [2024-04-16 23:04:13.083428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.210 [2024-04-16 23:04:13.083454] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.210 qpair failed and we were unable to recover it. 00:26:22.210 [2024-04-16 23:04:13.083659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.210 [2024-04-16 23:04:13.083794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.210 [2024-04-16 23:04:13.083836] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.210 qpair failed and we were unable to recover it. 00:26:22.210 [2024-04-16 23:04:13.083985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.210 [2024-04-16 23:04:13.084139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.210 [2024-04-16 23:04:13.084168] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.210 qpair failed and we were unable to recover it. 00:26:22.210 [2024-04-16 23:04:13.084336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.210 [2024-04-16 23:04:13.084472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.210 [2024-04-16 23:04:13.084497] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.210 qpair failed and we were unable to recover it. 00:26:22.210 [2024-04-16 23:04:13.084662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.210 [2024-04-16 23:04:13.084793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.210 [2024-04-16 23:04:13.084818] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.210 qpair failed and we were unable to recover it. 00:26:22.210 [2024-04-16 23:04:13.084958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.210 [2024-04-16 23:04:13.085097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.210 [2024-04-16 23:04:13.085137] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.210 qpair failed and we were unable to recover it. 00:26:22.210 [2024-04-16 23:04:13.085288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.210 [2024-04-16 23:04:13.085460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.210 [2024-04-16 23:04:13.085485] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.210 qpair failed and we were unable to recover it. 00:26:22.210 [2024-04-16 23:04:13.085653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.210 [2024-04-16 23:04:13.085859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.210 [2024-04-16 23:04:13.085884] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.210 qpair failed and we were unable to recover it. 00:26:22.210 [2024-04-16 23:04:13.086003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.210 [2024-04-16 23:04:13.086168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.210 [2024-04-16 23:04:13.086203] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.210 qpair failed and we were unable to recover it. 00:26:22.210 [2024-04-16 23:04:13.086308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.210 [2024-04-16 23:04:13.086447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.210 [2024-04-16 23:04:13.086473] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.210 qpair failed and we were unable to recover it. 00:26:22.210 [2024-04-16 23:04:13.086608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.210 [2024-04-16 23:04:13.086784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.210 [2024-04-16 23:04:13.086811] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.210 qpair failed and we were unable to recover it. 00:26:22.210 [2024-04-16 23:04:13.086930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.210 [2024-04-16 23:04:13.087123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.210 [2024-04-16 23:04:13.087148] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.210 qpair failed and we were unable to recover it. 00:26:22.210 [2024-04-16 23:04:13.087299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.210 [2024-04-16 23:04:13.087404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.210 [2024-04-16 23:04:13.087429] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.210 qpair failed and we were unable to recover it. 00:26:22.210 [2024-04-16 23:04:13.087568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.210 [2024-04-16 23:04:13.087734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.210 [2024-04-16 23:04:13.087759] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.210 qpair failed and we were unable to recover it. 00:26:22.210 [2024-04-16 23:04:13.087870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.210 [2024-04-16 23:04:13.088043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.210 [2024-04-16 23:04:13.088085] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.210 qpair failed and we were unable to recover it. 00:26:22.210 [2024-04-16 23:04:13.088243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.210 [2024-04-16 23:04:13.088402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.210 [2024-04-16 23:04:13.088427] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.210 qpair failed and we were unable to recover it. 00:26:22.210 [2024-04-16 23:04:13.088563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.210 [2024-04-16 23:04:13.088738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.210 [2024-04-16 23:04:13.088763] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.210 qpair failed and we were unable to recover it. 00:26:22.210 [2024-04-16 23:04:13.088929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.210 [2024-04-16 23:04:13.089063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.211 [2024-04-16 23:04:13.089105] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.211 qpair failed and we were unable to recover it. 00:26:22.211 [2024-04-16 23:04:13.089302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.211 [2024-04-16 23:04:13.089447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.211 [2024-04-16 23:04:13.089472] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.211 qpair failed and we were unable to recover it. 00:26:22.211 [2024-04-16 23:04:13.089585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.211 [2024-04-16 23:04:13.089736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.211 [2024-04-16 23:04:13.089764] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.211 qpair failed and we were unable to recover it. 00:26:22.211 [2024-04-16 23:04:13.089933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.211 [2024-04-16 23:04:13.090069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.211 [2024-04-16 23:04:13.090094] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.211 qpair failed and we were unable to recover it. 00:26:22.211 [2024-04-16 23:04:13.090208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.211 [2024-04-16 23:04:13.090350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.211 [2024-04-16 23:04:13.090375] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.211 qpair failed and we were unable to recover it. 00:26:22.211 [2024-04-16 23:04:13.090534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.211 [2024-04-16 23:04:13.090725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.211 [2024-04-16 23:04:13.090750] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.211 qpair failed and we were unable to recover it. 00:26:22.211 [2024-04-16 23:04:13.090910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.211 [2024-04-16 23:04:13.091085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.211 [2024-04-16 23:04:13.091109] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.211 qpair failed and we were unable to recover it. 00:26:22.211 [2024-04-16 23:04:13.091245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.211 [2024-04-16 23:04:13.091424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.211 [2024-04-16 23:04:13.091453] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.211 qpair failed and we were unable to recover it. 00:26:22.211 [2024-04-16 23:04:13.091623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.211 [2024-04-16 23:04:13.091735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.211 [2024-04-16 23:04:13.091778] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.211 qpair failed and we were unable to recover it. 00:26:22.211 [2024-04-16 23:04:13.091936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.211 [2024-04-16 23:04:13.092132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.211 [2024-04-16 23:04:13.092157] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.211 qpair failed and we were unable to recover it. 00:26:22.211 [2024-04-16 23:04:13.092308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.211 [2024-04-16 23:04:13.092444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.211 [2024-04-16 23:04:13.092469] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.211 qpair failed and we were unable to recover it. 00:26:22.211 [2024-04-16 23:04:13.092605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.211 [2024-04-16 23:04:13.092789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.211 [2024-04-16 23:04:13.092817] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.211 qpair failed and we were unable to recover it. 00:26:22.211 [2024-04-16 23:04:13.092981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.211 [2024-04-16 23:04:13.093147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.211 [2024-04-16 23:04:13.093172] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.211 qpair failed and we were unable to recover it. 00:26:22.211 [2024-04-16 23:04:13.093309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.211 [2024-04-16 23:04:13.093443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.211 [2024-04-16 23:04:13.093472] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.211 qpair failed and we were unable to recover it. 00:26:22.211 [2024-04-16 23:04:13.093651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.211 [2024-04-16 23:04:13.093806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.211 [2024-04-16 23:04:13.093834] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.211 qpair failed and we were unable to recover it. 00:26:22.211 [2024-04-16 23:04:13.093959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.211 [2024-04-16 23:04:13.094088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.211 [2024-04-16 23:04:13.094116] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.211 qpair failed and we were unable to recover it. 00:26:22.211 [2024-04-16 23:04:13.094273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.211 [2024-04-16 23:04:13.094445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.211 [2024-04-16 23:04:13.094488] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.211 qpair failed and we were unable to recover it. 00:26:22.211 [2024-04-16 23:04:13.094635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.211 [2024-04-16 23:04:13.094778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.211 [2024-04-16 23:04:13.094806] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.211 qpair failed and we were unable to recover it. 00:26:22.211 [2024-04-16 23:04:13.094948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.211 [2024-04-16 23:04:13.095073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.211 [2024-04-16 23:04:13.095100] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.211 qpair failed and we were unable to recover it. 00:26:22.211 [2024-04-16 23:04:13.095286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.211 [2024-04-16 23:04:13.095475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.211 [2024-04-16 23:04:13.095499] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.211 qpair failed and we were unable to recover it. 00:26:22.211 [2024-04-16 23:04:13.095642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.211 [2024-04-16 23:04:13.095778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.211 [2024-04-16 23:04:13.095818] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.211 qpair failed and we were unable to recover it. 00:26:22.211 [2024-04-16 23:04:13.095954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.211 [2024-04-16 23:04:13.096110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.211 [2024-04-16 23:04:13.096138] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.211 qpair failed and we were unable to recover it. 00:26:22.211 [2024-04-16 23:04:13.096272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.211 [2024-04-16 23:04:13.096452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.211 [2024-04-16 23:04:13.096479] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.211 qpair failed and we were unable to recover it. 00:26:22.211 [2024-04-16 23:04:13.096665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.211 [2024-04-16 23:04:13.096895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.211 [2024-04-16 23:04:13.096953] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.211 qpair failed and we were unable to recover it. 00:26:22.211 [2024-04-16 23:04:13.097144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.211 [2024-04-16 23:04:13.097306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.211 [2024-04-16 23:04:13.097334] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.211 qpair failed and we were unable to recover it. 00:26:22.211 [2024-04-16 23:04:13.097483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.211 [2024-04-16 23:04:13.097636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.212 [2024-04-16 23:04:13.097664] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.212 qpair failed and we were unable to recover it. 00:26:22.212 [2024-04-16 23:04:13.097909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.212 [2024-04-16 23:04:13.098020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.212 [2024-04-16 23:04:13.098045] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.212 qpair failed and we were unable to recover it. 00:26:22.212 [2024-04-16 23:04:13.098186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.212 [2024-04-16 23:04:13.098330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.212 [2024-04-16 23:04:13.098355] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.212 qpair failed and we were unable to recover it. 00:26:22.212 [2024-04-16 23:04:13.098467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.212 [2024-04-16 23:04:13.098613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.212 [2024-04-16 23:04:13.098638] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.212 qpair failed and we were unable to recover it. 00:26:22.212 [2024-04-16 23:04:13.098779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.212 [2024-04-16 23:04:13.098967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.212 [2024-04-16 23:04:13.098995] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.212 qpair failed and we were unable to recover it. 00:26:22.212 [2024-04-16 23:04:13.099152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.212 [2024-04-16 23:04:13.099306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.212 [2024-04-16 23:04:13.099334] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.212 qpair failed and we were unable to recover it. 00:26:22.212 [2024-04-16 23:04:13.099488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.212 [2024-04-16 23:04:13.099667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.212 [2024-04-16 23:04:13.099694] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.212 qpair failed and we were unable to recover it. 00:26:22.212 [2024-04-16 23:04:13.099827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.212 [2024-04-16 23:04:13.099996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.212 [2024-04-16 23:04:13.100020] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.212 qpair failed and we were unable to recover it. 00:26:22.212 [2024-04-16 23:04:13.100164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.212 [2024-04-16 23:04:13.100339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.212 [2024-04-16 23:04:13.100367] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.212 qpair failed and we were unable to recover it. 00:26:22.212 [2024-04-16 23:04:13.100518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.212 [2024-04-16 23:04:13.100677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.212 [2024-04-16 23:04:13.100705] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.212 qpair failed and we were unable to recover it. 00:26:22.212 [2024-04-16 23:04:13.100858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.212 [2024-04-16 23:04:13.101006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.212 [2024-04-16 23:04:13.101034] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.212 qpair failed and we were unable to recover it. 00:26:22.212 [2024-04-16 23:04:13.101167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.212 [2024-04-16 23:04:13.101353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.212 [2024-04-16 23:04:13.101396] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.212 qpair failed and we were unable to recover it. 00:26:22.212 [2024-04-16 23:04:13.101549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.212 [2024-04-16 23:04:13.101669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.212 [2024-04-16 23:04:13.101696] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.212 qpair failed and we were unable to recover it. 00:26:22.212 [2024-04-16 23:04:13.101858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.212 [2024-04-16 23:04:13.102036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.212 [2024-04-16 23:04:13.102064] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.212 qpair failed and we were unable to recover it. 00:26:22.212 [2024-04-16 23:04:13.102221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.212 [2024-04-16 23:04:13.102377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.212 [2024-04-16 23:04:13.102407] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.212 qpair failed and we were unable to recover it. 00:26:22.212 [2024-04-16 23:04:13.102573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.212 [2024-04-16 23:04:13.102737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.212 [2024-04-16 23:04:13.102762] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.212 qpair failed and we were unable to recover it. 00:26:22.212 [2024-04-16 23:04:13.102875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.212 [2024-04-16 23:04:13.102991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.212 [2024-04-16 23:04:13.103016] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.212 qpair failed and we were unable to recover it. 00:26:22.212 [2024-04-16 23:04:13.103125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.212 [2024-04-16 23:04:13.103232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.212 [2024-04-16 23:04:13.103273] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.212 qpair failed and we were unable to recover it. 00:26:22.212 [2024-04-16 23:04:13.103401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.212 [2024-04-16 23:04:13.103561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.212 [2024-04-16 23:04:13.103586] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.212 qpair failed and we were unable to recover it. 00:26:22.212 [2024-04-16 23:04:13.103700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.212 [2024-04-16 23:04:13.103861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.212 [2024-04-16 23:04:13.103886] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.212 qpair failed and we were unable to recover it. 00:26:22.212 [2024-04-16 23:04:13.104017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.212 [2024-04-16 23:04:13.104128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.212 [2024-04-16 23:04:13.104155] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.212 qpair failed and we were unable to recover it. 00:26:22.212 [2024-04-16 23:04:13.104285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.212 [2024-04-16 23:04:13.104427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.212 [2024-04-16 23:04:13.104451] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.212 qpair failed and we were unable to recover it. 00:26:22.212 [2024-04-16 23:04:13.104595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.212 [2024-04-16 23:04:13.104795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.212 [2024-04-16 23:04:13.104820] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.212 qpair failed and we were unable to recover it. 00:26:22.212 [2024-04-16 23:04:13.104995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.212 [2024-04-16 23:04:13.105107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.212 [2024-04-16 23:04:13.105150] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.212 qpair failed and we were unable to recover it. 00:26:22.212 [2024-04-16 23:04:13.105317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.212 [2024-04-16 23:04:13.105505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.212 [2024-04-16 23:04:13.105530] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.212 qpair failed and we were unable to recover it. 00:26:22.212 [2024-04-16 23:04:13.105664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.212 [2024-04-16 23:04:13.105773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.212 [2024-04-16 23:04:13.105798] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.212 qpair failed and we were unable to recover it. 00:26:22.212 [2024-04-16 23:04:13.105936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.212 [2024-04-16 23:04:13.106148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.213 [2024-04-16 23:04:13.106172] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.213 qpair failed and we were unable to recover it. 00:26:22.213 [2024-04-16 23:04:13.106326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.213 [2024-04-16 23:04:13.106467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.213 [2024-04-16 23:04:13.106492] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.213 qpair failed and we were unable to recover it. 00:26:22.213 [2024-04-16 23:04:13.106680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.213 [2024-04-16 23:04:13.106827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.213 [2024-04-16 23:04:13.106854] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.213 qpair failed and we were unable to recover it. 00:26:22.213 [2024-04-16 23:04:13.107022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.213 [2024-04-16 23:04:13.107131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.213 [2024-04-16 23:04:13.107156] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.213 qpair failed and we were unable to recover it. 00:26:22.213 [2024-04-16 23:04:13.107281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.213 [2024-04-16 23:04:13.107423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.213 [2024-04-16 23:04:13.107447] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.213 qpair failed and we were unable to recover it. 00:26:22.213 [2024-04-16 23:04:13.107590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.213 [2024-04-16 23:04:13.107706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.213 [2024-04-16 23:04:13.107732] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.213 qpair failed and we were unable to recover it. 00:26:22.213 [2024-04-16 23:04:13.107872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.213 [2024-04-16 23:04:13.107999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.213 [2024-04-16 23:04:13.108027] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.213 qpair failed and we were unable to recover it. 00:26:22.213 [2024-04-16 23:04:13.108161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.213 [2024-04-16 23:04:13.108326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.213 [2024-04-16 23:04:13.108359] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.213 qpair failed and we were unable to recover it. 00:26:22.213 [2024-04-16 23:04:13.108524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.213 [2024-04-16 23:04:13.108663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.213 [2024-04-16 23:04:13.108688] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.213 qpair failed and we were unable to recover it. 00:26:22.213 [2024-04-16 23:04:13.108803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.213 [2024-04-16 23:04:13.108924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.213 [2024-04-16 23:04:13.108950] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.213 qpair failed and we were unable to recover it. 00:26:22.213 [2024-04-16 23:04:13.109112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.213 [2024-04-16 23:04:13.109283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.213 [2024-04-16 23:04:13.109309] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.213 qpair failed and we were unable to recover it. 00:26:22.213 [2024-04-16 23:04:13.109458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.213 [2024-04-16 23:04:13.109700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.213 [2024-04-16 23:04:13.109727] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.213 qpair failed and we were unable to recover it. 00:26:22.213 [2024-04-16 23:04:13.109893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.213 [2024-04-16 23:04:13.110034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.213 [2024-04-16 23:04:13.110059] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.213 qpair failed and we were unable to recover it. 00:26:22.213 [2024-04-16 23:04:13.110212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.213 [2024-04-16 23:04:13.110358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.213 [2024-04-16 23:04:13.110383] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.213 qpair failed and we were unable to recover it. 00:26:22.213 [2024-04-16 23:04:13.110518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.213 [2024-04-16 23:04:13.110696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.213 [2024-04-16 23:04:13.110724] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.213 qpair failed and we were unable to recover it. 00:26:22.213 [2024-04-16 23:04:13.110912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.213 [2024-04-16 23:04:13.111052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.213 [2024-04-16 23:04:13.111076] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.213 qpair failed and we were unable to recover it. 00:26:22.213 [2024-04-16 23:04:13.111221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.213 [2024-04-16 23:04:13.111407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.213 [2024-04-16 23:04:13.111432] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.213 qpair failed and we were unable to recover it. 00:26:22.213 [2024-04-16 23:04:13.111545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.213 [2024-04-16 23:04:13.111689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.213 [2024-04-16 23:04:13.111717] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.213 qpair failed and we were unable to recover it. 00:26:22.213 [2024-04-16 23:04:13.111908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.213 [2024-04-16 23:04:13.112021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.213 [2024-04-16 23:04:13.112048] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.213 qpair failed and we were unable to recover it. 00:26:22.213 [2024-04-16 23:04:13.112259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.213 [2024-04-16 23:04:13.112409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.213 [2024-04-16 23:04:13.112434] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.213 qpair failed and we were unable to recover it. 00:26:22.213 [2024-04-16 23:04:13.112645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.213 [2024-04-16 23:04:13.112764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.213 [2024-04-16 23:04:13.112791] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.213 qpair failed and we were unable to recover it. 00:26:22.213 [2024-04-16 23:04:13.112978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.213 [2024-04-16 23:04:13.113164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.213 [2024-04-16 23:04:13.113201] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.213 qpair failed and we were unable to recover it. 00:26:22.213 [2024-04-16 23:04:13.113331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.213 [2024-04-16 23:04:13.113468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.213 [2024-04-16 23:04:13.113495] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.213 qpair failed and we were unable to recover it. 00:26:22.213 [2024-04-16 23:04:13.113649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.213 [2024-04-16 23:04:13.113878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.213 [2024-04-16 23:04:13.113927] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.213 qpair failed and we were unable to recover it. 00:26:22.213 [2024-04-16 23:04:13.114078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.213 [2024-04-16 23:04:13.114233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.213 [2024-04-16 23:04:13.114262] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.214 qpair failed and we were unable to recover it. 00:26:22.214 [2024-04-16 23:04:13.114458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.214 [2024-04-16 23:04:13.114647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.214 [2024-04-16 23:04:13.114674] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.214 qpair failed and we were unable to recover it. 00:26:22.214 [2024-04-16 23:04:13.114831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.214 [2024-04-16 23:04:13.114978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.214 [2024-04-16 23:04:13.115005] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.214 qpair failed and we were unable to recover it. 00:26:22.214 [2024-04-16 23:04:13.115151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.214 [2024-04-16 23:04:13.115318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.214 [2024-04-16 23:04:13.115346] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.214 qpair failed and we were unable to recover it. 00:26:22.214 [2024-04-16 23:04:13.115501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.214 [2024-04-16 23:04:13.115626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.214 [2024-04-16 23:04:13.115653] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.214 qpair failed and we were unable to recover it. 00:26:22.214 [2024-04-16 23:04:13.115813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.214 [2024-04-16 23:04:13.115925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.214 [2024-04-16 23:04:13.115951] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.214 qpair failed and we were unable to recover it. 00:26:22.214 [2024-04-16 23:04:13.116084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.214 [2024-04-16 23:04:13.116243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.214 [2024-04-16 23:04:13.116271] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.214 qpair failed and we were unable to recover it. 00:26:22.214 [2024-04-16 23:04:13.116400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.214 [2024-04-16 23:04:13.116582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.214 [2024-04-16 23:04:13.116610] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.214 qpair failed and we were unable to recover it. 00:26:22.214 [2024-04-16 23:04:13.116768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.214 [2024-04-16 23:04:13.116890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.214 [2024-04-16 23:04:13.116917] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.214 qpair failed and we were unable to recover it. 00:26:22.214 [2024-04-16 23:04:13.117075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.214 [2024-04-16 23:04:13.117202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.214 [2024-04-16 23:04:13.117229] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.214 qpair failed and we were unable to recover it. 00:26:22.214 [2024-04-16 23:04:13.117403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.214 [2024-04-16 23:04:13.117537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.214 [2024-04-16 23:04:13.117566] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.214 qpair failed and we were unable to recover it. 00:26:22.214 [2024-04-16 23:04:13.117725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.214 [2024-04-16 23:04:13.117888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.214 [2024-04-16 23:04:13.117912] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.214 qpair failed and we were unable to recover it. 00:26:22.214 [2024-04-16 23:04:13.118055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.214 [2024-04-16 23:04:13.118255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.214 [2024-04-16 23:04:13.118284] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.214 qpair failed and we were unable to recover it. 00:26:22.214 [2024-04-16 23:04:13.118446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.214 [2024-04-16 23:04:13.118585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.214 [2024-04-16 23:04:13.118610] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.214 qpair failed and we were unable to recover it. 00:26:22.214 [2024-04-16 23:04:13.118753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.214 [2024-04-16 23:04:13.118905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.214 [2024-04-16 23:04:13.118933] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.214 qpair failed and we were unable to recover it. 00:26:22.214 [2024-04-16 23:04:13.119080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.214 [2024-04-16 23:04:13.119235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.214 [2024-04-16 23:04:13.119261] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.214 qpair failed and we were unable to recover it. 00:26:22.214 [2024-04-16 23:04:13.119421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.214 [2024-04-16 23:04:13.119550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.214 [2024-04-16 23:04:13.119577] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.214 qpair failed and we were unable to recover it. 00:26:22.214 [2024-04-16 23:04:13.119742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.214 [2024-04-16 23:04:13.119880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.214 [2024-04-16 23:04:13.119905] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.214 qpair failed and we were unable to recover it. 00:26:22.214 [2024-04-16 23:04:13.120065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.214 [2024-04-16 23:04:13.120213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.214 [2024-04-16 23:04:13.120241] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.214 qpair failed and we were unable to recover it. 00:26:22.214 [2024-04-16 23:04:13.120388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.214 [2024-04-16 23:04:13.120539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.214 [2024-04-16 23:04:13.120566] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.214 qpair failed and we were unable to recover it. 00:26:22.214 [2024-04-16 23:04:13.120758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.214 [2024-04-16 23:04:13.120888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.214 [2024-04-16 23:04:13.120915] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.214 qpair failed and we were unable to recover it. 00:26:22.214 [2024-04-16 23:04:13.121082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.214 [2024-04-16 23:04:13.121231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.215 [2024-04-16 23:04:13.121272] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.215 qpair failed and we were unable to recover it. 00:26:22.215 [2024-04-16 23:04:13.121434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.215 [2024-04-16 23:04:13.121617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.215 [2024-04-16 23:04:13.121645] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.215 qpair failed and we were unable to recover it. 00:26:22.215 [2024-04-16 23:04:13.121829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.215 [2024-04-16 23:04:13.121947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.215 [2024-04-16 23:04:13.121977] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.215 qpair failed and we were unable to recover it. 00:26:22.215 [2024-04-16 23:04:13.122130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.215 [2024-04-16 23:04:13.122340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.215 [2024-04-16 23:04:13.122365] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.215 qpair failed and we were unable to recover it. 00:26:22.215 [2024-04-16 23:04:13.122536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.215 [2024-04-16 23:04:13.122645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.215 [2024-04-16 23:04:13.122670] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.215 qpair failed and we were unable to recover it. 00:26:22.215 [2024-04-16 23:04:13.122834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.215 [2024-04-16 23:04:13.122973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.215 [2024-04-16 23:04:13.122999] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.215 qpair failed and we were unable to recover it. 00:26:22.215 [2024-04-16 23:04:13.123145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.215 [2024-04-16 23:04:13.123348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.215 [2024-04-16 23:04:13.123374] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.215 qpair failed and we were unable to recover it. 00:26:22.215 [2024-04-16 23:04:13.123491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.215 [2024-04-16 23:04:13.123641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.215 [2024-04-16 23:04:13.123668] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.215 qpair failed and we were unable to recover it. 00:26:22.215 [2024-04-16 23:04:13.123820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.215 [2024-04-16 23:04:13.123937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.215 [2024-04-16 23:04:13.123961] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.215 qpair failed and we were unable to recover it. 00:26:22.215 [2024-04-16 23:04:13.124098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.215 [2024-04-16 23:04:13.124233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.215 [2024-04-16 23:04:13.124261] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.215 qpair failed and we were unable to recover it. 00:26:22.215 [2024-04-16 23:04:13.124413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.215 [2024-04-16 23:04:13.124581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.215 [2024-04-16 23:04:13.124629] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.215 qpair failed and we were unable to recover it. 00:26:22.215 [2024-04-16 23:04:13.124802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.215 [2024-04-16 23:04:13.124970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.215 [2024-04-16 23:04:13.124995] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.215 qpair failed and we were unable to recover it. 00:26:22.215 [2024-04-16 23:04:13.125171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.215 [2024-04-16 23:04:13.125298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.215 [2024-04-16 23:04:13.125323] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.215 qpair failed and we were unable to recover it. 00:26:22.215 [2024-04-16 23:04:13.125518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.215 [2024-04-16 23:04:13.125663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.215 [2024-04-16 23:04:13.125688] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.215 qpair failed and we were unable to recover it. 00:26:22.215 [2024-04-16 23:04:13.125834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.215 [2024-04-16 23:04:13.126011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.215 [2024-04-16 23:04:13.126036] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.215 qpair failed and we were unable to recover it. 00:26:22.215 [2024-04-16 23:04:13.126184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.215 [2024-04-16 23:04:13.126367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.215 [2024-04-16 23:04:13.126392] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.215 qpair failed and we were unable to recover it. 00:26:22.215 [2024-04-16 23:04:13.126534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.215 [2024-04-16 23:04:13.126636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.215 [2024-04-16 23:04:13.126661] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.215 qpair failed and we were unable to recover it. 00:26:22.215 [2024-04-16 23:04:13.126799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.215 [2024-04-16 23:04:13.126944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.215 [2024-04-16 23:04:13.126969] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.215 qpair failed and we were unable to recover it. 00:26:22.215 [2024-04-16 23:04:13.127143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.215 [2024-04-16 23:04:13.127294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.215 [2024-04-16 23:04:13.127339] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.215 qpair failed and we were unable to recover it. 00:26:22.215 [2024-04-16 23:04:13.127537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.215 [2024-04-16 23:04:13.127649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.215 [2024-04-16 23:04:13.127673] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.215 qpair failed and we were unable to recover it. 00:26:22.215 [2024-04-16 23:04:13.127789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.215 [2024-04-16 23:04:13.127895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.215 [2024-04-16 23:04:13.127920] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.215 qpair failed and we were unable to recover it. 00:26:22.215 [2024-04-16 23:04:13.128073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.215 [2024-04-16 23:04:13.128200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.215 [2024-04-16 23:04:13.128230] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.215 qpair failed and we were unable to recover it. 00:26:22.215 [2024-04-16 23:04:13.128349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.215 [2024-04-16 23:04:13.128501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.215 [2024-04-16 23:04:13.128528] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.215 qpair failed and we were unable to recover it. 00:26:22.215 [2024-04-16 23:04:13.128681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.215 [2024-04-16 23:04:13.128826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.215 [2024-04-16 23:04:13.128860] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.215 qpair failed and we were unable to recover it. 00:26:22.215 [2024-04-16 23:04:13.129017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.215 [2024-04-16 23:04:13.129199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.215 [2024-04-16 23:04:13.129240] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.215 qpair failed and we were unable to recover it. 00:26:22.215 [2024-04-16 23:04:13.129435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.215 [2024-04-16 23:04:13.129574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.215 [2024-04-16 23:04:13.129599] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.215 qpair failed and we were unable to recover it. 00:26:22.215 [2024-04-16 23:04:13.129730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.215 [2024-04-16 23:04:13.129899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.215 [2024-04-16 23:04:13.129926] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.215 qpair failed and we were unable to recover it. 00:26:22.215 [2024-04-16 23:04:13.130070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.215 [2024-04-16 23:04:13.130252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.215 [2024-04-16 23:04:13.130281] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.215 qpair failed and we were unable to recover it. 00:26:22.216 [2024-04-16 23:04:13.130417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.216 [2024-04-16 23:04:13.130556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.216 [2024-04-16 23:04:13.130581] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.216 qpair failed and we were unable to recover it. 00:26:22.216 [2024-04-16 23:04:13.130770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.216 [2024-04-16 23:04:13.130896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.216 [2024-04-16 23:04:13.130924] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.216 qpair failed and we were unable to recover it. 00:26:22.216 [2024-04-16 23:04:13.131048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.216 [2024-04-16 23:04:13.131195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.216 [2024-04-16 23:04:13.131223] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.216 qpair failed and we were unable to recover it. 00:26:22.216 [2024-04-16 23:04:13.131349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.216 [2024-04-16 23:04:13.131489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.216 [2024-04-16 23:04:13.131515] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.216 qpair failed and we were unable to recover it. 00:26:22.216 [2024-04-16 23:04:13.131652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.216 [2024-04-16 23:04:13.131796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.216 [2024-04-16 23:04:13.131836] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.216 qpair failed and we were unable to recover it. 00:26:22.216 [2024-04-16 23:04:13.131989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.216 [2024-04-16 23:04:13.132145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.216 [2024-04-16 23:04:13.132172] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.216 qpair failed and we were unable to recover it. 00:26:22.216 [2024-04-16 23:04:13.132309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.216 [2024-04-16 23:04:13.132441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.216 [2024-04-16 23:04:13.132468] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.216 qpair failed and we were unable to recover it. 00:26:22.216 [2024-04-16 23:04:13.132592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.216 [2024-04-16 23:04:13.132769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.216 [2024-04-16 23:04:13.132797] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.216 qpair failed and we were unable to recover it. 00:26:22.216 [2024-04-16 23:04:13.132946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.216 [2024-04-16 23:04:13.133083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.216 [2024-04-16 23:04:13.133108] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.216 qpair failed and we were unable to recover it. 00:26:22.216 [2024-04-16 23:04:13.133270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.216 [2024-04-16 23:04:13.133397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.216 [2024-04-16 23:04:13.133425] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.216 qpair failed and we were unable to recover it. 00:26:22.216 [2024-04-16 23:04:13.133579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.216 [2024-04-16 23:04:13.133731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.216 [2024-04-16 23:04:13.133758] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.216 qpair failed and we were unable to recover it. 00:26:22.216 [2024-04-16 23:04:13.133903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.216 [2024-04-16 23:04:13.134048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.216 [2024-04-16 23:04:13.134076] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.216 qpair failed and we were unable to recover it. 00:26:22.216 [2024-04-16 23:04:13.134212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.216 [2024-04-16 23:04:13.134323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.216 [2024-04-16 23:04:13.134348] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.216 qpair failed and we were unable to recover it. 00:26:22.216 [2024-04-16 23:04:13.134501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.216 [2024-04-16 23:04:13.134656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.216 [2024-04-16 23:04:13.134684] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.216 qpair failed and we were unable to recover it. 00:26:22.216 [2024-04-16 23:04:13.134853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.216 [2024-04-16 23:04:13.134991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.216 [2024-04-16 23:04:13.135016] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.216 qpair failed and we were unable to recover it. 00:26:22.216 [2024-04-16 23:04:13.135124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.216 [2024-04-16 23:04:13.135230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.216 [2024-04-16 23:04:13.135257] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.216 qpair failed and we were unable to recover it. 00:26:22.216 [2024-04-16 23:04:13.135380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.216 [2024-04-16 23:04:13.135492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.216 [2024-04-16 23:04:13.135517] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.216 qpair failed and we were unable to recover it. 00:26:22.216 [2024-04-16 23:04:13.135650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.216 [2024-04-16 23:04:13.135783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.216 [2024-04-16 23:04:13.135811] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.216 qpair failed and we were unable to recover it. 00:26:22.216 [2024-04-16 23:04:13.135931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.216 [2024-04-16 23:04:13.136056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.216 [2024-04-16 23:04:13.136084] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.216 qpair failed and we were unable to recover it. 00:26:22.216 [2024-04-16 23:04:13.136209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.216 [2024-04-16 23:04:13.136363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.216 [2024-04-16 23:04:13.136391] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.216 qpair failed and we were unable to recover it. 00:26:22.216 [2024-04-16 23:04:13.136541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.216 [2024-04-16 23:04:13.136682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.216 [2024-04-16 23:04:13.136723] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.216 qpair failed and we were unable to recover it. 00:26:22.216 [2024-04-16 23:04:13.136880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.216 [2024-04-16 23:04:13.136999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.216 [2024-04-16 23:04:13.137026] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.216 qpair failed and we were unable to recover it. 00:26:22.216 [2024-04-16 23:04:13.137198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.216 [2024-04-16 23:04:13.137323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.216 [2024-04-16 23:04:13.137351] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.216 qpair failed and we were unable to recover it. 00:26:22.216 [2024-04-16 23:04:13.137500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.216 [2024-04-16 23:04:13.137651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.216 [2024-04-16 23:04:13.137678] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.216 qpair failed and we were unable to recover it. 00:26:22.216 [2024-04-16 23:04:13.137839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.216 [2024-04-16 23:04:13.137981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.217 [2024-04-16 23:04:13.138024] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.217 qpair failed and we were unable to recover it. 00:26:22.217 [2024-04-16 23:04:13.138141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.217 [2024-04-16 23:04:13.138300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.217 [2024-04-16 23:04:13.138328] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.217 qpair failed and we were unable to recover it. 00:26:22.217 [2024-04-16 23:04:13.138455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.217 [2024-04-16 23:04:13.138625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.217 [2024-04-16 23:04:13.138653] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.217 qpair failed and we were unable to recover it. 00:26:22.217 [2024-04-16 23:04:13.138768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.217 [2024-04-16 23:04:13.138929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.217 [2024-04-16 23:04:13.138954] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.217 qpair failed and we were unable to recover it. 00:26:22.217 [2024-04-16 23:04:13.139098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.217 [2024-04-16 23:04:13.139234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.217 [2024-04-16 23:04:13.139276] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.217 qpair failed and we were unable to recover it. 00:26:22.217 [2024-04-16 23:04:13.139412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.217 [2024-04-16 23:04:13.139552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.217 [2024-04-16 23:04:13.139576] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.217 qpair failed and we were unable to recover it. 00:26:22.217 [2024-04-16 23:04:13.139702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.217 [2024-04-16 23:04:13.139851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.217 [2024-04-16 23:04:13.139879] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.217 qpair failed and we were unable to recover it. 00:26:22.217 [2024-04-16 23:04:13.140031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.217 [2024-04-16 23:04:13.140214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.217 [2024-04-16 23:04:13.140242] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.217 qpair failed and we were unable to recover it. 00:26:22.217 [2024-04-16 23:04:13.140384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.217 [2024-04-16 23:04:13.140525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.217 [2024-04-16 23:04:13.140550] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.217 qpair failed and we were unable to recover it. 00:26:22.217 [2024-04-16 23:04:13.140682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.217 [2024-04-16 23:04:13.140834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.217 [2024-04-16 23:04:13.140862] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.217 qpair failed and we were unable to recover it. 00:26:22.217 [2024-04-16 23:04:13.141044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.217 [2024-04-16 23:04:13.141146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.217 [2024-04-16 23:04:13.141171] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.217 qpair failed and we were unable to recover it. 00:26:22.217 [2024-04-16 23:04:13.141319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.217 [2024-04-16 23:04:13.141460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.217 [2024-04-16 23:04:13.141487] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.217 qpair failed and we were unable to recover it. 00:26:22.217 [2024-04-16 23:04:13.141676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.217 [2024-04-16 23:04:13.141804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.217 [2024-04-16 23:04:13.141829] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.217 qpair failed and we were unable to recover it. 00:26:22.217 [2024-04-16 23:04:13.141972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.217 [2024-04-16 23:04:13.142141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.217 [2024-04-16 23:04:13.142169] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.217 qpair failed and we were unable to recover it. 00:26:22.217 [2024-04-16 23:04:13.142335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.217 [2024-04-16 23:04:13.142514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.217 [2024-04-16 23:04:13.142541] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.217 qpair failed and we were unable to recover it. 00:26:22.217 [2024-04-16 23:04:13.142690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.217 [2024-04-16 23:04:13.142854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.217 [2024-04-16 23:04:13.142881] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.217 qpair failed and we were unable to recover it. 00:26:22.217 [2024-04-16 23:04:13.143021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.217 [2024-04-16 23:04:13.143156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.217 [2024-04-16 23:04:13.143189] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.217 qpair failed and we were unable to recover it. 00:26:22.217 [2024-04-16 23:04:13.143337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.217 [2024-04-16 23:04:13.143542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.217 [2024-04-16 23:04:13.143567] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.217 qpair failed and we were unable to recover it. 00:26:22.217 [2024-04-16 23:04:13.143710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.217 [2024-04-16 23:04:13.143885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.217 [2024-04-16 23:04:13.143910] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.217 qpair failed and we were unable to recover it. 00:26:22.217 [2024-04-16 23:04:13.144045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.217 [2024-04-16 23:04:13.144212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.217 [2024-04-16 23:04:13.144238] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.217 qpair failed and we were unable to recover it. 00:26:22.217 [2024-04-16 23:04:13.144374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.217 [2024-04-16 23:04:13.144493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.217 [2024-04-16 23:04:13.144519] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.217 qpair failed and we were unable to recover it. 00:26:22.217 [2024-04-16 23:04:13.144724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.217 [2024-04-16 23:04:13.144913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.217 [2024-04-16 23:04:13.144937] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.217 qpair failed and we were unable to recover it. 00:26:22.217 [2024-04-16 23:04:13.145082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.217 [2024-04-16 23:04:13.145229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.217 [2024-04-16 23:04:13.145262] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.217 qpair failed and we were unable to recover it. 00:26:22.217 [2024-04-16 23:04:13.145425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.217 [2024-04-16 23:04:13.145594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.217 [2024-04-16 23:04:13.145619] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.217 qpair failed and we were unable to recover it. 00:26:22.217 [2024-04-16 23:04:13.145735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.217 [2024-04-16 23:04:13.145847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.217 [2024-04-16 23:04:13.145872] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.217 qpair failed and we were unable to recover it. 00:26:22.217 [2024-04-16 23:04:13.145986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.217 [2024-04-16 23:04:13.146096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.217 [2024-04-16 23:04:13.146121] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.217 qpair failed and we were unable to recover it. 00:26:22.217 [2024-04-16 23:04:13.146236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.217 [2024-04-16 23:04:13.146353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.218 [2024-04-16 23:04:13.146378] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.218 qpair failed and we were unable to recover it. 00:26:22.218 [2024-04-16 23:04:13.146493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.218 [2024-04-16 23:04:13.146635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.218 [2024-04-16 23:04:13.146660] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.218 qpair failed and we were unable to recover it. 00:26:22.218 [2024-04-16 23:04:13.146773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.218 [2024-04-16 23:04:13.146886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.218 [2024-04-16 23:04:13.146910] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.218 qpair failed and we were unable to recover it. 00:26:22.218 [2024-04-16 23:04:13.147053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.218 [2024-04-16 23:04:13.147228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.218 [2024-04-16 23:04:13.147253] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.218 qpair failed and we were unable to recover it. 00:26:22.218 [2024-04-16 23:04:13.147367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.218 [2024-04-16 23:04:13.147559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.218 [2024-04-16 23:04:13.147587] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.218 qpair failed and we were unable to recover it. 00:26:22.218 [2024-04-16 23:04:13.147745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.218 [2024-04-16 23:04:13.147892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.218 [2024-04-16 23:04:13.147916] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.218 qpair failed and we were unable to recover it. 00:26:22.218 [2024-04-16 23:04:13.148071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.218 [2024-04-16 23:04:13.148239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.218 [2024-04-16 23:04:13.148265] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.218 qpair failed and we were unable to recover it. 00:26:22.218 [2024-04-16 23:04:13.148403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.218 [2024-04-16 23:04:13.148538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.218 [2024-04-16 23:04:13.148566] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.218 qpair failed and we were unable to recover it. 00:26:22.218 [2024-04-16 23:04:13.148751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.218 [2024-04-16 23:04:13.148888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.218 [2024-04-16 23:04:13.148913] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.218 qpair failed and we were unable to recover it. 00:26:22.218 [2024-04-16 23:04:13.149052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.218 [2024-04-16 23:04:13.149233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.218 [2024-04-16 23:04:13.149261] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.218 qpair failed and we were unable to recover it. 00:26:22.218 [2024-04-16 23:04:13.149388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.218 [2024-04-16 23:04:13.149532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.218 [2024-04-16 23:04:13.149558] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.218 qpair failed and we were unable to recover it. 00:26:22.218 [2024-04-16 23:04:13.149728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.218 [2024-04-16 23:04:13.149929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.218 [2024-04-16 23:04:13.149954] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.218 qpair failed and we were unable to recover it. 00:26:22.218 [2024-04-16 23:04:13.150129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.218 [2024-04-16 23:04:13.150293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.218 [2024-04-16 23:04:13.150321] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.218 qpair failed and we were unable to recover it. 00:26:22.218 [2024-04-16 23:04:13.150440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.218 [2024-04-16 23:04:13.150553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.218 [2024-04-16 23:04:13.150581] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.218 qpair failed and we were unable to recover it. 00:26:22.218 [2024-04-16 23:04:13.150727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.218 [2024-04-16 23:04:13.150833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.218 [2024-04-16 23:04:13.150858] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.218 qpair failed and we were unable to recover it. 00:26:22.218 [2024-04-16 23:04:13.151017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.218 [2024-04-16 23:04:13.151183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.218 [2024-04-16 23:04:13.151211] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.218 qpair failed and we were unable to recover it. 00:26:22.218 [2024-04-16 23:04:13.151377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.218 [2024-04-16 23:04:13.151561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.218 [2024-04-16 23:04:13.151613] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.218 qpair failed and we were unable to recover it. 00:26:22.218 [2024-04-16 23:04:13.151773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.218 [2024-04-16 23:04:13.151917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.218 [2024-04-16 23:04:13.151941] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.218 qpair failed and we were unable to recover it. 00:26:22.218 [2024-04-16 23:04:13.152050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.218 [2024-04-16 23:04:13.152191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.218 [2024-04-16 23:04:13.152217] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.218 qpair failed and we were unable to recover it. 00:26:22.218 [2024-04-16 23:04:13.152351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.218 [2024-04-16 23:04:13.152498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.218 [2024-04-16 23:04:13.152526] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.218 qpair failed and we were unable to recover it. 00:26:22.218 [2024-04-16 23:04:13.152729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.218 [2024-04-16 23:04:13.152883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.218 [2024-04-16 23:04:13.152911] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.218 qpair failed and we were unable to recover it. 00:26:22.218 [2024-04-16 23:04:13.153034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.218 [2024-04-16 23:04:13.153198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.218 [2024-04-16 23:04:13.153227] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.218 qpair failed and we were unable to recover it. 00:26:22.218 [2024-04-16 23:04:13.153386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.218 [2024-04-16 23:04:13.153501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.218 [2024-04-16 23:04:13.153528] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.218 qpair failed and we were unable to recover it. 00:26:22.218 [2024-04-16 23:04:13.153653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.218 [2024-04-16 23:04:13.153772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.218 [2024-04-16 23:04:13.153799] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.218 qpair failed and we were unable to recover it. 00:26:22.218 [2024-04-16 23:04:13.153926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.218 [2024-04-16 23:04:13.154076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.218 [2024-04-16 23:04:13.154103] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.218 qpair failed and we were unable to recover it. 00:26:22.218 [2024-04-16 23:04:13.154249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.218 [2024-04-16 23:04:13.154395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.218 [2024-04-16 23:04:13.154423] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.218 qpair failed and we were unable to recover it. 00:26:22.218 [2024-04-16 23:04:13.154565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.218 [2024-04-16 23:04:13.154713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.218 [2024-04-16 23:04:13.154738] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.218 qpair failed and we were unable to recover it. 00:26:22.218 [2024-04-16 23:04:13.154852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.218 [2024-04-16 23:04:13.155011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.218 [2024-04-16 23:04:13.155039] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.218 qpair failed and we were unable to recover it. 00:26:22.218 [2024-04-16 23:04:13.155221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.218 [2024-04-16 23:04:13.155349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.218 [2024-04-16 23:04:13.155377] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.218 qpair failed and we were unable to recover it. 00:26:22.218 [2024-04-16 23:04:13.155542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.219 [2024-04-16 23:04:13.155705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.219 [2024-04-16 23:04:13.155730] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.219 qpair failed and we were unable to recover it. 00:26:22.219 [2024-04-16 23:04:13.155866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.219 [2024-04-16 23:04:13.156008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.219 [2024-04-16 23:04:13.156033] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.219 qpair failed and we were unable to recover it. 00:26:22.219 [2024-04-16 23:04:13.156195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.219 [2024-04-16 23:04:13.156324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.219 [2024-04-16 23:04:13.156352] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.219 qpair failed and we were unable to recover it. 00:26:22.219 [2024-04-16 23:04:13.156515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.219 [2024-04-16 23:04:13.156768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.219 [2024-04-16 23:04:13.156820] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.219 qpair failed and we were unable to recover it. 00:26:22.219 [2024-04-16 23:04:13.156998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.219 [2024-04-16 23:04:13.157158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.219 [2024-04-16 23:04:13.157194] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.219 qpair failed and we were unable to recover it. 00:26:22.219 [2024-04-16 23:04:13.157356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.219 [2024-04-16 23:04:13.157501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.219 [2024-04-16 23:04:13.157544] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.219 qpair failed and we were unable to recover it. 00:26:22.219 [2024-04-16 23:04:13.157694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.219 [2024-04-16 23:04:13.157848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.219 [2024-04-16 23:04:13.157876] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.219 qpair failed and we were unable to recover it. 00:26:22.219 [2024-04-16 23:04:13.157992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.219 [2024-04-16 23:04:13.158141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.219 [2024-04-16 23:04:13.158168] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.219 qpair failed and we were unable to recover it. 00:26:22.219 [2024-04-16 23:04:13.158294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.219 [2024-04-16 23:04:13.158412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.219 [2024-04-16 23:04:13.158437] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.219 qpair failed and we were unable to recover it. 00:26:22.219 [2024-04-16 23:04:13.158579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.219 [2024-04-16 23:04:13.158688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.219 [2024-04-16 23:04:13.158714] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.219 qpair failed and we were unable to recover it. 00:26:22.219 [2024-04-16 23:04:13.158816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.219 [2024-04-16 23:04:13.158931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.219 [2024-04-16 23:04:13.158958] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.219 qpair failed and we were unable to recover it. 00:26:22.219 [2024-04-16 23:04:13.159098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.219 [2024-04-16 23:04:13.159247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.219 [2024-04-16 23:04:13.159272] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.219 qpair failed and we were unable to recover it. 00:26:22.219 [2024-04-16 23:04:13.159445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.219 [2024-04-16 23:04:13.159562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.219 [2024-04-16 23:04:13.159587] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.219 qpair failed and we were unable to recover it. 00:26:22.219 [2024-04-16 23:04:13.159733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.219 [2024-04-16 23:04:13.159838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.219 [2024-04-16 23:04:13.159863] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.219 qpair failed and we were unable to recover it. 00:26:22.219 [2024-04-16 23:04:13.159975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.219 [2024-04-16 23:04:13.160092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.219 [2024-04-16 23:04:13.160116] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.219 qpair failed and we were unable to recover it. 00:26:22.219 [2024-04-16 23:04:13.160297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.219 [2024-04-16 23:04:13.160442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.219 [2024-04-16 23:04:13.160467] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.219 qpair failed and we were unable to recover it. 00:26:22.219 [2024-04-16 23:04:13.160585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.219 [2024-04-16 23:04:13.160753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.219 [2024-04-16 23:04:13.160778] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.219 qpair failed and we were unable to recover it. 00:26:22.219 [2024-04-16 23:04:13.160917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.219 [2024-04-16 23:04:13.161032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.219 [2024-04-16 23:04:13.161057] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.219 qpair failed and we were unable to recover it. 00:26:22.219 [2024-04-16 23:04:13.161235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.219 [2024-04-16 23:04:13.161380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.219 [2024-04-16 23:04:13.161410] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.219 qpair failed and we were unable to recover it. 00:26:22.219 [2024-04-16 23:04:13.161580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.219 [2024-04-16 23:04:13.161774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.219 [2024-04-16 23:04:13.161799] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.219 qpair failed and we were unable to recover it. 00:26:22.219 [2024-04-16 23:04:13.161962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.219 [2024-04-16 23:04:13.162084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.219 [2024-04-16 23:04:13.162112] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.219 qpair failed and we were unable to recover it. 00:26:22.219 [2024-04-16 23:04:13.162268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.219 [2024-04-16 23:04:13.162383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.219 [2024-04-16 23:04:13.162408] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.219 qpair failed and we were unable to recover it. 00:26:22.219 [2024-04-16 23:04:13.162568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.219 [2024-04-16 23:04:13.162722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.219 [2024-04-16 23:04:13.162749] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.220 qpair failed and we were unable to recover it. 00:26:22.220 [2024-04-16 23:04:13.162931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.220 [2024-04-16 23:04:13.163099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.220 [2024-04-16 23:04:13.163124] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.220 qpair failed and we were unable to recover it. 00:26:22.220 [2024-04-16 23:04:13.163302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.220 [2024-04-16 23:04:13.163446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.220 [2024-04-16 23:04:13.163488] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.220 qpair failed and we were unable to recover it. 00:26:22.220 [2024-04-16 23:04:13.163630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.220 [2024-04-16 23:04:13.163808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.220 [2024-04-16 23:04:13.163832] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.220 qpair failed and we were unable to recover it. 00:26:22.220 [2024-04-16 23:04:13.163976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.220 [2024-04-16 23:04:13.164139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.220 [2024-04-16 23:04:13.164163] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.220 qpair failed and we were unable to recover it. 00:26:22.220 [2024-04-16 23:04:13.164320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.220 [2024-04-16 23:04:13.164494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.220 [2024-04-16 23:04:13.164519] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.220 qpair failed and we were unable to recover it. 00:26:22.220 [2024-04-16 23:04:13.164663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.220 [2024-04-16 23:04:13.164803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.220 [2024-04-16 23:04:13.164828] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.220 qpair failed and we were unable to recover it. 00:26:22.220 [2024-04-16 23:04:13.164995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.220 [2024-04-16 23:04:13.165138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.220 [2024-04-16 23:04:13.165163] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.220 qpair failed and we were unable to recover it. 00:26:22.220 [2024-04-16 23:04:13.165326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.220 [2024-04-16 23:04:13.165494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.220 [2024-04-16 23:04:13.165519] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.220 qpair failed and we were unable to recover it. 00:26:22.220 [2024-04-16 23:04:13.165640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.220 [2024-04-16 23:04:13.165841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.220 [2024-04-16 23:04:13.165866] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.220 qpair failed and we were unable to recover it. 00:26:22.220 [2024-04-16 23:04:13.165977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.220 [2024-04-16 23:04:13.166142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.220 [2024-04-16 23:04:13.166170] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.220 qpair failed and we were unable to recover it. 00:26:22.220 [2024-04-16 23:04:13.166327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.220 [2024-04-16 23:04:13.166472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.220 [2024-04-16 23:04:13.166498] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.220 qpair failed and we were unable to recover it. 00:26:22.220 [2024-04-16 23:04:13.166669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.220 [2024-04-16 23:04:13.166795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.220 [2024-04-16 23:04:13.166822] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.220 qpair failed and we were unable to recover it. 00:26:22.220 [2024-04-16 23:04:13.166978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.220 [2024-04-16 23:04:13.167161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.220 [2024-04-16 23:04:13.167198] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.220 qpair failed and we were unable to recover it. 00:26:22.220 [2024-04-16 23:04:13.167360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.220 [2024-04-16 23:04:13.167518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.220 [2024-04-16 23:04:13.167545] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.220 qpair failed and we were unable to recover it. 00:26:22.220 [2024-04-16 23:04:13.167675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.220 [2024-04-16 23:04:13.167812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.220 [2024-04-16 23:04:13.167837] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.220 qpair failed and we were unable to recover it. 00:26:22.220 [2024-04-16 23:04:13.167996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.220 [2024-04-16 23:04:13.168152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.220 [2024-04-16 23:04:13.168188] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.220 qpair failed and we were unable to recover it. 00:26:22.220 [2024-04-16 23:04:13.168344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.220 [2024-04-16 23:04:13.168497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.220 [2024-04-16 23:04:13.168524] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.220 qpair failed and we were unable to recover it. 00:26:22.220 [2024-04-16 23:04:13.168686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.220 [2024-04-16 23:04:13.168841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.220 [2024-04-16 23:04:13.168868] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.220 qpair failed and we were unable to recover it. 00:26:22.220 [2024-04-16 23:04:13.169026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.220 [2024-04-16 23:04:13.169135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.220 [2024-04-16 23:04:13.169160] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.220 qpair failed and we were unable to recover it. 00:26:22.220 [2024-04-16 23:04:13.169356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.220 [2024-04-16 23:04:13.169500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.220 [2024-04-16 23:04:13.169529] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.220 qpair failed and we were unable to recover it. 00:26:22.220 [2024-04-16 23:04:13.169682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.220 [2024-04-16 23:04:13.169864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.220 [2024-04-16 23:04:13.169892] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.220 qpair failed and we were unable to recover it. 00:26:22.220 [2024-04-16 23:04:13.170074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.220 [2024-04-16 23:04:13.170218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.220 [2024-04-16 23:04:13.170247] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.220 qpair failed and we were unable to recover it. 00:26:22.220 [2024-04-16 23:04:13.170390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.220 [2024-04-16 23:04:13.170557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.220 [2024-04-16 23:04:13.170599] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.220 qpair failed and we were unable to recover it. 00:26:22.220 [2024-04-16 23:04:13.170781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.220 [2024-04-16 23:04:13.170959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.220 [2024-04-16 23:04:13.170987] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.220 qpair failed and we were unable to recover it. 00:26:22.220 [2024-04-16 23:04:13.171104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.220 [2024-04-16 23:04:13.171243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.220 [2024-04-16 23:04:13.171271] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.220 qpair failed and we were unable to recover it. 00:26:22.220 [2024-04-16 23:04:13.171452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.220 [2024-04-16 23:04:13.171595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.220 [2024-04-16 23:04:13.171622] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.220 qpair failed and we were unable to recover it. 00:26:22.220 [2024-04-16 23:04:13.171779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.220 [2024-04-16 23:04:13.171943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.220 [2024-04-16 23:04:13.171984] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.220 qpair failed and we were unable to recover it. 00:26:22.221 [2024-04-16 23:04:13.172135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.221 [2024-04-16 23:04:13.172328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.221 [2024-04-16 23:04:13.172357] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.221 qpair failed and we were unable to recover it. 00:26:22.221 [2024-04-16 23:04:13.172480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.221 [2024-04-16 23:04:13.172626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.221 [2024-04-16 23:04:13.172654] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.221 qpair failed and we were unable to recover it. 00:26:22.221 [2024-04-16 23:04:13.172821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.221 [2024-04-16 23:04:13.172934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.221 [2024-04-16 23:04:13.172959] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.221 qpair failed and we were unable to recover it. 00:26:22.221 [2024-04-16 23:04:13.173101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.221 [2024-04-16 23:04:13.173211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.221 [2024-04-16 23:04:13.173237] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.221 qpair failed and we were unable to recover it. 00:26:22.221 [2024-04-16 23:04:13.173409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.221 [2024-04-16 23:04:13.173569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.221 [2024-04-16 23:04:13.173596] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.221 qpair failed and we were unable to recover it. 00:26:22.221 [2024-04-16 23:04:13.173779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.221 [2024-04-16 23:04:13.173900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.221 [2024-04-16 23:04:13.173928] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.221 qpair failed and we were unable to recover it. 00:26:22.221 [2024-04-16 23:04:13.174048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.221 [2024-04-16 23:04:13.174233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.221 [2024-04-16 23:04:13.174262] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.221 qpair failed and we were unable to recover it. 00:26:22.221 [2024-04-16 23:04:13.174394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.221 [2024-04-16 23:04:13.174540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.221 [2024-04-16 23:04:13.174565] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.221 qpair failed and we were unable to recover it. 00:26:22.221 [2024-04-16 23:04:13.174714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.221 [2024-04-16 23:04:13.174821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.221 [2024-04-16 23:04:13.174846] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.221 qpair failed and we were unable to recover it. 00:26:22.221 [2024-04-16 23:04:13.174957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.221 [2024-04-16 23:04:13.175099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.221 [2024-04-16 23:04:13.175124] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.221 qpair failed and we were unable to recover it. 00:26:22.221 [2024-04-16 23:04:13.175235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.221 [2024-04-16 23:04:13.175343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.221 [2024-04-16 23:04:13.175368] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.221 qpair failed and we were unable to recover it. 00:26:22.221 [2024-04-16 23:04:13.175477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.221 [2024-04-16 23:04:13.175644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.221 [2024-04-16 23:04:13.175669] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.221 qpair failed and we were unable to recover it. 00:26:22.221 [2024-04-16 23:04:13.175800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.221 [2024-04-16 23:04:13.175936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.221 [2024-04-16 23:04:13.175961] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.221 qpair failed and we were unable to recover it. 00:26:22.221 [2024-04-16 23:04:13.176134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.221 [2024-04-16 23:04:13.176247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.221 [2024-04-16 23:04:13.176273] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.221 qpair failed and we were unable to recover it. 00:26:22.221 [2024-04-16 23:04:13.176481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.221 [2024-04-16 23:04:13.176648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.221 [2024-04-16 23:04:13.176688] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.221 qpair failed and we were unable to recover it. 00:26:22.221 [2024-04-16 23:04:13.176850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.221 [2024-04-16 23:04:13.176986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.221 [2024-04-16 23:04:13.177011] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.221 qpair failed and we were unable to recover it. 00:26:22.221 [2024-04-16 23:04:13.177147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.221 [2024-04-16 23:04:13.177333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.221 [2024-04-16 23:04:13.177359] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.221 qpair failed and we were unable to recover it. 00:26:22.221 [2024-04-16 23:04:13.177570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.221 [2024-04-16 23:04:13.177704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.221 [2024-04-16 23:04:13.177728] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.221 qpair failed and we were unable to recover it. 00:26:22.221 [2024-04-16 23:04:13.177879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.221 [2024-04-16 23:04:13.178031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.221 [2024-04-16 23:04:13.178059] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.221 qpair failed and we were unable to recover it. 00:26:22.221 [2024-04-16 23:04:13.178246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.221 [2024-04-16 23:04:13.178437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.221 [2024-04-16 23:04:13.178471] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.221 qpair failed and we were unable to recover it. 00:26:22.221 [2024-04-16 23:04:13.178665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.221 [2024-04-16 23:04:13.178798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.221 [2024-04-16 23:04:13.178822] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.221 qpair failed and we were unable to recover it. 00:26:22.221 [2024-04-16 23:04:13.178988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.221 [2024-04-16 23:04:13.179151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.221 [2024-04-16 23:04:13.179202] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.221 qpair failed and we were unable to recover it. 00:26:22.221 [2024-04-16 23:04:13.179336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.221 [2024-04-16 23:04:13.179442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.221 [2024-04-16 23:04:13.179467] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.221 qpair failed and we were unable to recover it. 00:26:22.221 [2024-04-16 23:04:13.179599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.221 [2024-04-16 23:04:13.179734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.221 [2024-04-16 23:04:13.179759] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.221 qpair failed and we were unable to recover it. 00:26:22.221 [2024-04-16 23:04:13.179921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.221 [2024-04-16 23:04:13.180091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.222 [2024-04-16 23:04:13.180115] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.222 qpair failed and we were unable to recover it. 00:26:22.222 [2024-04-16 23:04:13.180265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.222 [2024-04-16 23:04:13.180434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.222 [2024-04-16 23:04:13.180462] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.222 qpair failed and we were unable to recover it. 00:26:22.222 [2024-04-16 23:04:13.180627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.222 [2024-04-16 23:04:13.180759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.222 [2024-04-16 23:04:13.180783] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.222 qpair failed and we were unable to recover it. 00:26:22.222 [2024-04-16 23:04:13.180898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.222 [2024-04-16 23:04:13.181063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.222 [2024-04-16 23:04:13.181088] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.222 qpair failed and we were unable to recover it. 00:26:22.222 [2024-04-16 23:04:13.181197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.222 [2024-04-16 23:04:13.181340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.222 [2024-04-16 23:04:13.181366] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.222 qpair failed and we were unable to recover it. 00:26:22.222 [2024-04-16 23:04:13.181626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.222 [2024-04-16 23:04:13.181863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.222 [2024-04-16 23:04:13.181918] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.222 qpair failed and we were unable to recover it. 00:26:22.222 [2024-04-16 23:04:13.182094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.222 [2024-04-16 23:04:13.182204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.222 [2024-04-16 23:04:13.182230] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.222 qpair failed and we were unable to recover it. 00:26:22.222 [2024-04-16 23:04:13.182353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.222 [2024-04-16 23:04:13.182509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.222 [2024-04-16 23:04:13.182534] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.222 qpair failed and we were unable to recover it. 00:26:22.222 [2024-04-16 23:04:13.182650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.222 [2024-04-16 23:04:13.182792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.222 [2024-04-16 23:04:13.182817] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.222 qpair failed and we were unable to recover it. 00:26:22.222 [2024-04-16 23:04:13.182950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.222 [2024-04-16 23:04:13.183086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.222 [2024-04-16 23:04:13.183111] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.222 qpair failed and we were unable to recover it. 00:26:22.222 [2024-04-16 23:04:13.183267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.222 [2024-04-16 23:04:13.183388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.222 [2024-04-16 23:04:13.183415] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.222 qpair failed and we were unable to recover it. 00:26:22.222 [2024-04-16 23:04:13.183613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.222 [2024-04-16 23:04:13.183725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.222 [2024-04-16 23:04:13.183750] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.222 qpair failed and we were unable to recover it. 00:26:22.222 [2024-04-16 23:04:13.183926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.222 [2024-04-16 23:04:13.184053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.222 [2024-04-16 23:04:13.184081] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.222 qpair failed and we were unable to recover it. 00:26:22.222 [2024-04-16 23:04:13.184227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.222 [2024-04-16 23:04:13.184384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.222 [2024-04-16 23:04:13.184412] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.222 qpair failed and we were unable to recover it. 00:26:22.222 [2024-04-16 23:04:13.184552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.222 [2024-04-16 23:04:13.184669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.222 [2024-04-16 23:04:13.184695] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.222 qpair failed and we were unable to recover it. 00:26:22.222 [2024-04-16 23:04:13.184815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.222 [2024-04-16 23:04:13.184952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.222 [2024-04-16 23:04:13.184977] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.222 qpair failed and we were unable to recover it. 00:26:22.222 [2024-04-16 23:04:13.185112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.222 [2024-04-16 23:04:13.185267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.222 [2024-04-16 23:04:13.185295] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.222 qpair failed and we were unable to recover it. 00:26:22.222 [2024-04-16 23:04:13.185444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.222 [2024-04-16 23:04:13.185678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.222 [2024-04-16 23:04:13.185705] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.222 qpair failed and we were unable to recover it. 00:26:22.222 [2024-04-16 23:04:13.185900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.222 [2024-04-16 23:04:13.186003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.222 [2024-04-16 23:04:13.186028] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.222 qpair failed and we were unable to recover it. 00:26:22.222 [2024-04-16 23:04:13.186171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.222 [2024-04-16 23:04:13.186293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.222 [2024-04-16 23:04:13.186318] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.222 qpair failed and we were unable to recover it. 00:26:22.222 [2024-04-16 23:04:13.186430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.222 [2024-04-16 23:04:13.186627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.222 [2024-04-16 23:04:13.186655] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.222 qpair failed and we were unable to recover it. 00:26:22.222 [2024-04-16 23:04:13.186835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.222 [2024-04-16 23:04:13.186984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.222 [2024-04-16 23:04:13.187012] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.222 qpair failed and we were unable to recover it. 00:26:22.222 [2024-04-16 23:04:13.187171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.222 [2024-04-16 23:04:13.187314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.222 [2024-04-16 23:04:13.187339] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.222 qpair failed and we were unable to recover it. 00:26:22.222 [2024-04-16 23:04:13.187487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.222 [2024-04-16 23:04:13.187635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.222 [2024-04-16 23:04:13.187661] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.222 qpair failed and we were unable to recover it. 00:26:22.222 [2024-04-16 23:04:13.187842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.222 [2024-04-16 23:04:13.187955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.222 [2024-04-16 23:04:13.187980] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.222 qpair failed and we were unable to recover it. 00:26:22.222 [2024-04-16 23:04:13.188140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.222 [2024-04-16 23:04:13.188328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.222 [2024-04-16 23:04:13.188356] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.222 qpair failed and we were unable to recover it. 00:26:22.222 [2024-04-16 23:04:13.188514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.222 [2024-04-16 23:04:13.188673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.222 [2024-04-16 23:04:13.188701] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.222 qpair failed and we were unable to recover it. 00:26:22.222 [2024-04-16 23:04:13.188859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.222 [2024-04-16 23:04:13.188995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.222 [2024-04-16 23:04:13.189020] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.222 qpair failed and we were unable to recover it. 00:26:22.222 [2024-04-16 23:04:13.189222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.222 [2024-04-16 23:04:13.189381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.222 [2024-04-16 23:04:13.189410] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.222 qpair failed and we were unable to recover it. 00:26:22.223 [2024-04-16 23:04:13.189555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.223 [2024-04-16 23:04:13.189730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.223 [2024-04-16 23:04:13.189758] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.223 qpair failed and we were unable to recover it. 00:26:22.223 [2024-04-16 23:04:13.189917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.223 [2024-04-16 23:04:13.190062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.223 [2024-04-16 23:04:13.190087] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.223 qpair failed and we were unable to recover it. 00:26:22.223 [2024-04-16 23:04:13.190199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.223 [2024-04-16 23:04:13.190367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.223 [2024-04-16 23:04:13.190408] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.223 qpair failed and we were unable to recover it. 00:26:22.223 [2024-04-16 23:04:13.190568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.223 [2024-04-16 23:04:13.190690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.223 [2024-04-16 23:04:13.190718] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.223 qpair failed and we were unable to recover it. 00:26:22.223 [2024-04-16 23:04:13.190871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.223 [2024-04-16 23:04:13.191062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.223 [2024-04-16 23:04:13.191087] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.223 qpair failed and we were unable to recover it. 00:26:22.223 [2024-04-16 23:04:13.191196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.223 [2024-04-16 23:04:13.191346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.223 [2024-04-16 23:04:13.191370] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.223 qpair failed and we were unable to recover it. 00:26:22.223 [2024-04-16 23:04:13.191537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.223 [2024-04-16 23:04:13.191642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.223 [2024-04-16 23:04:13.191667] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.223 qpair failed and we were unable to recover it. 00:26:22.223 [2024-04-16 23:04:13.191807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.223 [2024-04-16 23:04:13.191991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.223 [2024-04-16 23:04:13.192019] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.223 qpair failed and we were unable to recover it. 00:26:22.223 [2024-04-16 23:04:13.192141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.223 [2024-04-16 23:04:13.192309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.223 [2024-04-16 23:04:13.192338] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.223 qpair failed and we were unable to recover it. 00:26:22.223 [2024-04-16 23:04:13.192518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.223 [2024-04-16 23:04:13.192713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.223 [2024-04-16 23:04:13.192758] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.223 qpair failed and we were unable to recover it. 00:26:22.223 [2024-04-16 23:04:13.192923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.223 [2024-04-16 23:04:13.193030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.223 [2024-04-16 23:04:13.193055] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.223 qpair failed and we were unable to recover it. 00:26:22.223 [2024-04-16 23:04:13.193205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.223 [2024-04-16 23:04:13.193325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.223 [2024-04-16 23:04:13.193353] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.223 qpair failed and we were unable to recover it. 00:26:22.223 [2024-04-16 23:04:13.193532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.223 [2024-04-16 23:04:13.193698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.223 [2024-04-16 23:04:13.193748] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.223 qpair failed and we were unable to recover it. 00:26:22.223 [2024-04-16 23:04:13.193892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.223 [2024-04-16 23:04:13.194008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.223 [2024-04-16 23:04:13.194033] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.223 qpair failed and we were unable to recover it. 00:26:22.223 [2024-04-16 23:04:13.194182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.223 [2024-04-16 23:04:13.194321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.223 [2024-04-16 23:04:13.194346] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.223 qpair failed and we were unable to recover it. 00:26:22.223 [2024-04-16 23:04:13.194490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.223 [2024-04-16 23:04:13.194660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.223 [2024-04-16 23:04:13.194688] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.223 qpair failed and we were unable to recover it. 00:26:22.223 [2024-04-16 23:04:13.194871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.223 [2024-04-16 23:04:13.194988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.223 [2024-04-16 23:04:13.195013] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.223 qpair failed and we were unable to recover it. 00:26:22.223 [2024-04-16 23:04:13.195228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.223 [2024-04-16 23:04:13.195347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.223 [2024-04-16 23:04:13.195372] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.223 qpair failed and we were unable to recover it. 00:26:22.223 [2024-04-16 23:04:13.195515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.223 [2024-04-16 23:04:13.195631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.223 [2024-04-16 23:04:13.195656] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.223 qpair failed and we were unable to recover it. 00:26:22.223 [2024-04-16 23:04:13.195769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.223 [2024-04-16 23:04:13.195939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.223 [2024-04-16 23:04:13.195964] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.223 qpair failed and we were unable to recover it. 00:26:22.223 [2024-04-16 23:04:13.196142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.223 [2024-04-16 23:04:13.196322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.223 [2024-04-16 23:04:13.196348] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.223 qpair failed and we were unable to recover it. 00:26:22.223 [2024-04-16 23:04:13.196488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.223 [2024-04-16 23:04:13.196621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.223 [2024-04-16 23:04:13.196648] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.223 qpair failed and we were unable to recover it. 00:26:22.223 [2024-04-16 23:04:13.196808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.223 [2024-04-16 23:04:13.196947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.223 [2024-04-16 23:04:13.196972] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.223 qpair failed and we were unable to recover it. 00:26:22.223 [2024-04-16 23:04:13.197146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.223 [2024-04-16 23:04:13.197320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.223 [2024-04-16 23:04:13.197346] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.223 qpair failed and we were unable to recover it. 00:26:22.223 [2024-04-16 23:04:13.197462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.223 [2024-04-16 23:04:13.197637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.223 [2024-04-16 23:04:13.197663] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.223 qpair failed and we were unable to recover it. 00:26:22.223 [2024-04-16 23:04:13.197828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.223 [2024-04-16 23:04:13.197961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.223 [2024-04-16 23:04:13.197988] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.223 qpair failed and we were unable to recover it. 00:26:22.223 [2024-04-16 23:04:13.198136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.223 [2024-04-16 23:04:13.198264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.223 [2024-04-16 23:04:13.198289] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.223 qpair failed and we were unable to recover it. 00:26:22.223 [2024-04-16 23:04:13.198430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.223 [2024-04-16 23:04:13.198542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.223 [2024-04-16 23:04:13.198572] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.223 qpair failed and we were unable to recover it. 00:26:22.223 [2024-04-16 23:04:13.198718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.223 [2024-04-16 23:04:13.198831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.223 [2024-04-16 23:04:13.198856] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.223 qpair failed and we were unable to recover it. 00:26:22.224 [2024-04-16 23:04:13.198996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.224 [2024-04-16 23:04:13.199156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.224 [2024-04-16 23:04:13.199193] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.224 qpair failed and we were unable to recover it. 00:26:22.224 [2024-04-16 23:04:13.199359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.224 [2024-04-16 23:04:13.199500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.224 [2024-04-16 23:04:13.199526] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.224 qpair failed and we were unable to recover it. 00:26:22.224 [2024-04-16 23:04:13.199697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.224 [2024-04-16 23:04:13.199892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.224 [2024-04-16 23:04:13.199917] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.224 qpair failed and we were unable to recover it. 00:26:22.224 [2024-04-16 23:04:13.200084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.224 [2024-04-16 23:04:13.200238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.224 [2024-04-16 23:04:13.200267] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.224 qpair failed and we were unable to recover it. 00:26:22.224 [2024-04-16 23:04:13.200431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.224 [2024-04-16 23:04:13.200577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.224 [2024-04-16 23:04:13.200602] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.224 qpair failed and we were unable to recover it. 00:26:22.224 [2024-04-16 23:04:13.200710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.224 [2024-04-16 23:04:13.200859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.224 [2024-04-16 23:04:13.200884] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.224 qpair failed and we were unable to recover it. 00:26:22.224 [2024-04-16 23:04:13.201021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.224 [2024-04-16 23:04:13.201133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.224 [2024-04-16 23:04:13.201158] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.224 qpair failed and we were unable to recover it. 00:26:22.224 [2024-04-16 23:04:13.201324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.224 [2024-04-16 23:04:13.201436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.224 [2024-04-16 23:04:13.201462] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.224 qpair failed and we were unable to recover it. 00:26:22.224 [2024-04-16 23:04:13.201572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.224 [2024-04-16 23:04:13.201681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.224 [2024-04-16 23:04:13.201706] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.224 qpair failed and we were unable to recover it. 00:26:22.224 [2024-04-16 23:04:13.201858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.224 [2024-04-16 23:04:13.201970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.224 [2024-04-16 23:04:13.201995] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.224 qpair failed and we were unable to recover it. 00:26:22.224 [2024-04-16 23:04:13.202173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.224 [2024-04-16 23:04:13.202306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.224 [2024-04-16 23:04:13.202331] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.224 qpair failed and we were unable to recover it. 00:26:22.224 [2024-04-16 23:04:13.202459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.224 [2024-04-16 23:04:13.202615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.224 [2024-04-16 23:04:13.202640] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.224 qpair failed and we were unable to recover it. 00:26:22.224 [2024-04-16 23:04:13.202807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.224 [2024-04-16 23:04:13.202980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.224 [2024-04-16 23:04:13.203007] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.224 qpair failed and we were unable to recover it. 00:26:22.224 [2024-04-16 23:04:13.203186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.224 [2024-04-16 23:04:13.203327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.224 [2024-04-16 23:04:13.203370] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.224 qpair failed and we were unable to recover it. 00:26:22.224 [2024-04-16 23:04:13.203506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.224 [2024-04-16 23:04:13.203628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.224 [2024-04-16 23:04:13.203656] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.224 qpair failed and we were unable to recover it. 00:26:22.224 [2024-04-16 23:04:13.203810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.224 [2024-04-16 23:04:13.203963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.224 [2024-04-16 23:04:13.203990] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.224 qpair failed and we were unable to recover it. 00:26:22.224 [2024-04-16 23:04:13.204172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.224 [2024-04-16 23:04:13.204376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.224 [2024-04-16 23:04:13.204401] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.224 qpair failed and we were unable to recover it. 00:26:22.224 [2024-04-16 23:04:13.204509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.224 [2024-04-16 23:04:13.204676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.224 [2024-04-16 23:04:13.204700] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.224 qpair failed and we were unable to recover it. 00:26:22.224 [2024-04-16 23:04:13.204863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.224 [2024-04-16 23:04:13.204984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.224 [2024-04-16 23:04:13.205014] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.224 qpair failed and we were unable to recover it. 00:26:22.224 [2024-04-16 23:04:13.205141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.224 [2024-04-16 23:04:13.205338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.224 [2024-04-16 23:04:13.205367] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.224 qpair failed and we were unable to recover it. 00:26:22.224 [2024-04-16 23:04:13.205523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.224 [2024-04-16 23:04:13.205706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.224 [2024-04-16 23:04:13.205733] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.224 qpair failed and we were unable to recover it. 00:26:22.224 [2024-04-16 23:04:13.205897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.224 [2024-04-16 23:04:13.206076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.224 [2024-04-16 23:04:13.206104] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.224 qpair failed and we were unable to recover it. 00:26:22.225 [2024-04-16 23:04:13.206237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.225 [2024-04-16 23:04:13.206388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.225 [2024-04-16 23:04:13.206415] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.225 qpair failed and we were unable to recover it. 00:26:22.225 [2024-04-16 23:04:13.206579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.225 [2024-04-16 23:04:13.206751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.225 [2024-04-16 23:04:13.206800] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.225 qpair failed and we were unable to recover it. 00:26:22.225 [2024-04-16 23:04:13.206981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.225 [2024-04-16 23:04:13.207157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.225 [2024-04-16 23:04:13.207194] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.225 qpair failed and we were unable to recover it. 00:26:22.225 [2024-04-16 23:04:13.207354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.225 [2024-04-16 23:04:13.207522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.225 [2024-04-16 23:04:13.207564] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.225 qpair failed and we were unable to recover it. 00:26:22.225 [2024-04-16 23:04:13.207681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.225 [2024-04-16 23:04:13.207864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.225 [2024-04-16 23:04:13.207891] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.225 qpair failed and we were unable to recover it. 00:26:22.225 [2024-04-16 23:04:13.208050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.225 [2024-04-16 23:04:13.208185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.225 [2024-04-16 23:04:13.208213] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.225 qpair failed and we were unable to recover it. 00:26:22.225 [2024-04-16 23:04:13.208395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.225 [2024-04-16 23:04:13.208583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.225 [2024-04-16 23:04:13.208611] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.225 qpair failed and we were unable to recover it. 00:26:22.225 [2024-04-16 23:04:13.209888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.225 [2024-04-16 23:04:13.210084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.225 [2024-04-16 23:04:13.210114] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.225 qpair failed and we were unable to recover it. 00:26:22.225 [2024-04-16 23:04:13.210273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.225 [2024-04-16 23:04:13.210430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.225 [2024-04-16 23:04:13.210466] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.225 qpair failed and we were unable to recover it. 00:26:22.225 [2024-04-16 23:04:13.210710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.225 [2024-04-16 23:04:13.210819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.225 [2024-04-16 23:04:13.210844] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.225 qpair failed and we were unable to recover it. 00:26:22.225 [2024-04-16 23:04:13.211462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.225 [2024-04-16 23:04:13.211713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.225 [2024-04-16 23:04:13.211766] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.225 qpair failed and we were unable to recover it. 00:26:22.225 [2024-04-16 23:04:13.211973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.225 [2024-04-16 23:04:13.212124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.225 [2024-04-16 23:04:13.212152] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.225 qpair failed and we were unable to recover it. 00:26:22.225 [2024-04-16 23:04:13.212312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.225 [2024-04-16 23:04:13.212469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.225 [2024-04-16 23:04:13.212497] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.225 qpair failed and we were unable to recover it. 00:26:22.225 [2024-04-16 23:04:13.212698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.225 [2024-04-16 23:04:13.212915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.225 [2024-04-16 23:04:13.212944] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.225 qpair failed and we were unable to recover it. 00:26:22.225 [2024-04-16 23:04:13.213148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.225 [2024-04-16 23:04:13.213292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.225 [2024-04-16 23:04:13.213318] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.225 qpair failed and we were unable to recover it. 00:26:22.225 [2024-04-16 23:04:13.213473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.225 [2024-04-16 23:04:13.213609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.225 [2024-04-16 23:04:13.213634] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.225 qpair failed and we were unable to recover it. 00:26:22.225 [2024-04-16 23:04:13.213758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.225 [2024-04-16 23:04:13.213904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.225 [2024-04-16 23:04:13.213931] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.225 qpair failed and we were unable to recover it. 00:26:22.225 [2024-04-16 23:04:13.214055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.225 [2024-04-16 23:04:13.214264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.225 [2024-04-16 23:04:13.214291] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.225 qpair failed and we were unable to recover it. 00:26:22.225 [2024-04-16 23:04:13.214440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.225 [2024-04-16 23:04:13.214577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.225 [2024-04-16 23:04:13.214606] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.225 qpair failed and we were unable to recover it. 00:26:22.225 [2024-04-16 23:04:13.214799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.225 [2024-04-16 23:04:13.214965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.225 [2024-04-16 23:04:13.214990] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.225 qpair failed and we were unable to recover it. 00:26:22.225 [2024-04-16 23:04:13.215212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.225 [2024-04-16 23:04:13.215358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.225 [2024-04-16 23:04:13.215383] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.225 qpair failed and we were unable to recover it. 00:26:22.225 [2024-04-16 23:04:13.215551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.225 [2024-04-16 23:04:13.215678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.225 [2024-04-16 23:04:13.215703] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.225 qpair failed and we were unable to recover it. 00:26:22.225 [2024-04-16 23:04:13.215812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.225 [2024-04-16 23:04:13.215961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.225 [2024-04-16 23:04:13.215985] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.225 qpair failed and we were unable to recover it. 00:26:22.225 [2024-04-16 23:04:13.216121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.225 [2024-04-16 23:04:13.216262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.225 [2024-04-16 23:04:13.216287] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.225 qpair failed and we were unable to recover it. 00:26:22.225 [2024-04-16 23:04:13.216462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.225 [2024-04-16 23:04:13.216575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.225 [2024-04-16 23:04:13.216602] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.225 qpair failed and we were unable to recover it. 00:26:22.225 [2024-04-16 23:04:13.216754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.225 [2024-04-16 23:04:13.216947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.225 [2024-04-16 23:04:13.216971] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.225 qpair failed and we were unable to recover it. 00:26:22.225 [2024-04-16 23:04:13.217093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.225 [2024-04-16 23:04:13.217204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.225 [2024-04-16 23:04:13.217230] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.225 qpair failed and we were unable to recover it. 00:26:22.225 [2024-04-16 23:04:13.217395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.225 [2024-04-16 23:04:13.217512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.225 [2024-04-16 23:04:13.217541] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.225 qpair failed and we were unable to recover it. 00:26:22.225 [2024-04-16 23:04:13.217684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.225 [2024-04-16 23:04:13.217861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.225 [2024-04-16 23:04:13.217886] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.226 qpair failed and we were unable to recover it. 00:26:22.226 [2024-04-16 23:04:13.218023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.226 [2024-04-16 23:04:13.218234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.226 [2024-04-16 23:04:13.218260] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.226 qpair failed and we were unable to recover it. 00:26:22.226 [2024-04-16 23:04:13.218401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.226 [2024-04-16 23:04:13.218535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.226 [2024-04-16 23:04:13.218562] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.226 qpair failed and we were unable to recover it. 00:26:22.226 [2024-04-16 23:04:13.218722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.226 [2024-04-16 23:04:13.218857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.226 [2024-04-16 23:04:13.218882] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.226 qpair failed and we were unable to recover it. 00:26:22.226 [2024-04-16 23:04:13.219056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.226 [2024-04-16 23:04:13.219211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.226 [2024-04-16 23:04:13.219239] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.226 qpair failed and we were unable to recover it. 00:26:22.226 [2024-04-16 23:04:13.219371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.226 [2024-04-16 23:04:13.219487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.226 [2024-04-16 23:04:13.219514] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.226 qpair failed and we were unable to recover it. 00:26:22.226 [2024-04-16 23:04:13.219699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.226 [2024-04-16 23:04:13.219827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.226 [2024-04-16 23:04:13.219867] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.226 qpair failed and we were unable to recover it. 00:26:22.226 [2024-04-16 23:04:13.219979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.226 [2024-04-16 23:04:13.220148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.226 [2024-04-16 23:04:13.220173] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.226 qpair failed and we were unable to recover it. 00:26:22.226 [2024-04-16 23:04:13.220332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.226 [2024-04-16 23:04:13.220546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.226 [2024-04-16 23:04:13.220571] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.226 qpair failed and we were unable to recover it. 00:26:22.226 [2024-04-16 23:04:13.220678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.226 [2024-04-16 23:04:13.220789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.226 [2024-04-16 23:04:13.220814] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.226 qpair failed and we were unable to recover it. 00:26:22.226 [2024-04-16 23:04:13.220927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.226 [2024-04-16 23:04:13.221041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.226 [2024-04-16 23:04:13.221066] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.226 qpair failed and we were unable to recover it. 00:26:22.226 [2024-04-16 23:04:13.221234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.226 [2024-04-16 23:04:13.221403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.226 [2024-04-16 23:04:13.221428] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.226 qpair failed and we were unable to recover it. 00:26:22.226 [2024-04-16 23:04:13.221574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.226 [2024-04-16 23:04:13.221751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.226 [2024-04-16 23:04:13.221776] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.226 qpair failed and we were unable to recover it. 00:26:22.226 [2024-04-16 23:04:13.221943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.226 [2024-04-16 23:04:13.222128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.226 [2024-04-16 23:04:13.222156] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.226 qpair failed and we were unable to recover it. 00:26:22.226 [2024-04-16 23:04:13.222308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.226 [2024-04-16 23:04:13.222419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.226 [2024-04-16 23:04:13.222445] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.226 qpair failed and we were unable to recover it. 00:26:22.226 [2024-04-16 23:04:13.222590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.226 [2024-04-16 23:04:13.222754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.226 [2024-04-16 23:04:13.222783] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.226 qpair failed and we were unable to recover it. 00:26:22.226 [2024-04-16 23:04:13.222932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.226 [2024-04-16 23:04:13.223113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.226 [2024-04-16 23:04:13.223141] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.226 qpair failed and we were unable to recover it. 00:26:22.226 [2024-04-16 23:04:13.223310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.226 [2024-04-16 23:04:13.223443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.226 [2024-04-16 23:04:13.223468] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.226 qpair failed and we were unable to recover it. 00:26:22.226 [2024-04-16 23:04:13.223632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.226 [2024-04-16 23:04:13.223749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.226 [2024-04-16 23:04:13.223776] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.226 qpair failed and we were unable to recover it. 00:26:22.226 [2024-04-16 23:04:13.223932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.226 [2024-04-16 23:04:13.224087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.226 [2024-04-16 23:04:13.224114] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.226 qpair failed and we were unable to recover it. 00:26:22.226 [2024-04-16 23:04:13.224296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.226 [2024-04-16 23:04:13.224407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.226 [2024-04-16 23:04:13.224434] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.226 qpair failed and we were unable to recover it. 00:26:22.226 [2024-04-16 23:04:13.224661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.226 [2024-04-16 23:04:13.224808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.226 [2024-04-16 23:04:13.224835] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.226 qpair failed and we were unable to recover it. 00:26:22.226 [2024-04-16 23:04:13.224963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.226 [2024-04-16 23:04:13.225107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.226 [2024-04-16 23:04:13.225134] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.226 qpair failed and we were unable to recover it. 00:26:22.226 [2024-04-16 23:04:13.225299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.226 [2024-04-16 23:04:13.225424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.226 [2024-04-16 23:04:13.225468] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.226 qpair failed and we were unable to recover it. 00:26:22.226 [2024-04-16 23:04:13.225599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.226 [2024-04-16 23:04:13.225729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.226 [2024-04-16 23:04:13.225756] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.226 qpair failed and we were unable to recover it. 00:26:22.226 [2024-04-16 23:04:13.225938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.226 [2024-04-16 23:04:13.226064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.226 [2024-04-16 23:04:13.226092] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.226 qpair failed and we were unable to recover it. 00:26:22.226 [2024-04-16 23:04:13.226206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.226 [2024-04-16 23:04:13.226338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.226 [2024-04-16 23:04:13.226362] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.226 qpair failed and we were unable to recover it. 00:26:22.227 [2024-04-16 23:04:13.226504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.227 [2024-04-16 23:04:13.226623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.227 [2024-04-16 23:04:13.226648] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.227 qpair failed and we were unable to recover it. 00:26:22.227 [2024-04-16 23:04:13.226826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.227 [2024-04-16 23:04:13.226985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.227 [2024-04-16 23:04:13.227013] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.227 qpair failed and we were unable to recover it. 00:26:22.227 [2024-04-16 23:04:13.227163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.227 [2024-04-16 23:04:13.227325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.227 [2024-04-16 23:04:13.227351] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.227 qpair failed and we were unable to recover it. 00:26:22.227 [2024-04-16 23:04:13.227518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.227 [2024-04-16 23:04:13.227665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.227 [2024-04-16 23:04:13.227694] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.227 qpair failed and we were unable to recover it. 00:26:22.227 [2024-04-16 23:04:13.227948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.227 [2024-04-16 23:04:13.228581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.227 [2024-04-16 23:04:13.228612] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.227 qpair failed and we were unable to recover it. 00:26:22.227 [2024-04-16 23:04:13.228795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.227 [2024-04-16 23:04:13.228956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.227 [2024-04-16 23:04:13.228984] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.227 qpair failed and we were unable to recover it. 00:26:22.227 [2024-04-16 23:04:13.229120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.227 [2024-04-16 23:04:13.229298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.227 [2024-04-16 23:04:13.229324] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.227 qpair failed and we were unable to recover it. 00:26:22.227 [2024-04-16 23:04:13.229437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.227 [2024-04-16 23:04:13.229587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.227 [2024-04-16 23:04:13.229614] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.227 qpair failed and we were unable to recover it. 00:26:22.227 [2024-04-16 23:04:13.229783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.227 [2024-04-16 23:04:13.229914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.227 [2024-04-16 23:04:13.229942] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.227 qpair failed and we were unable to recover it. 00:26:22.227 [2024-04-16 23:04:13.230054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.227 [2024-04-16 23:04:13.230185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.227 [2024-04-16 23:04:13.230214] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.227 qpair failed and we were unable to recover it. 00:26:22.227 [2024-04-16 23:04:13.230376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.227 [2024-04-16 23:04:13.230508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.227 [2024-04-16 23:04:13.230536] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.227 qpair failed and we were unable to recover it. 00:26:22.227 [2024-04-16 23:04:13.230696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.227 [2024-04-16 23:04:13.230811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.227 [2024-04-16 23:04:13.230839] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.227 qpair failed and we were unable to recover it. 00:26:22.227 [2024-04-16 23:04:13.230971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.227 [2024-04-16 23:04:13.231142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.227 [2024-04-16 23:04:13.231170] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.227 qpair failed and we were unable to recover it. 00:26:22.227 [2024-04-16 23:04:13.231344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.227 [2024-04-16 23:04:13.231525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.227 [2024-04-16 23:04:13.231552] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.227 qpair failed and we were unable to recover it. 00:26:22.227 [2024-04-16 23:04:13.231722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.227 [2024-04-16 23:04:13.231951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.227 [2024-04-16 23:04:13.232000] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.227 qpair failed and we were unable to recover it. 00:26:22.227 [2024-04-16 23:04:13.232155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.227 [2024-04-16 23:04:13.232325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.227 [2024-04-16 23:04:13.232351] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.227 qpair failed and we were unable to recover it. 00:26:22.227 [2024-04-16 23:04:13.232472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.227 [2024-04-16 23:04:13.232609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.227 [2024-04-16 23:04:13.232634] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.227 qpair failed and we were unable to recover it. 00:26:22.227 [2024-04-16 23:04:13.232773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.227 [2024-04-16 23:04:13.232930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.227 [2024-04-16 23:04:13.232959] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.227 qpair failed and we were unable to recover it. 00:26:22.227 [2024-04-16 23:04:13.233116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.227 [2024-04-16 23:04:13.233265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.227 [2024-04-16 23:04:13.233291] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.227 qpair failed and we were unable to recover it. 00:26:22.227 [2024-04-16 23:04:13.233397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.227 [2024-04-16 23:04:13.233528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.227 [2024-04-16 23:04:13.233554] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.227 qpair failed and we were unable to recover it. 00:26:22.227 [2024-04-16 23:04:13.233686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.227 [2024-04-16 23:04:13.233834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.227 [2024-04-16 23:04:13.233862] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.227 qpair failed and we were unable to recover it. 00:26:22.227 [2024-04-16 23:04:13.234045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.227 [2024-04-16 23:04:13.234212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.227 [2024-04-16 23:04:13.234254] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.227 qpair failed and we were unable to recover it. 00:26:22.227 [2024-04-16 23:04:13.234402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.227 [2024-04-16 23:04:13.234574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.227 [2024-04-16 23:04:13.234602] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.227 qpair failed and we were unable to recover it. 00:26:22.227 [2024-04-16 23:04:13.234721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.227 [2024-04-16 23:04:13.234902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.227 [2024-04-16 23:04:13.234934] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.227 qpair failed and we were unable to recover it. 00:26:22.227 [2024-04-16 23:04:13.235110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.227 [2024-04-16 23:04:13.235252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.227 [2024-04-16 23:04:13.235277] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.227 qpair failed and we were unable to recover it. 00:26:22.227 [2024-04-16 23:04:13.235420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.227 [2024-04-16 23:04:13.235595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.227 [2024-04-16 23:04:13.235624] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.227 qpair failed and we were unable to recover it. 00:26:22.227 [2024-04-16 23:04:13.235747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.227 [2024-04-16 23:04:13.235859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.227 [2024-04-16 23:04:13.235886] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.227 qpair failed and we were unable to recover it. 00:26:22.227 [2024-04-16 23:04:13.236011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.227 [2024-04-16 23:04:13.236190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.228 [2024-04-16 23:04:13.236232] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.228 qpair failed and we were unable to recover it. 00:26:22.228 [2024-04-16 23:04:13.236374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.228 [2024-04-16 23:04:13.236490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.228 [2024-04-16 23:04:13.236515] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.228 qpair failed and we were unable to recover it. 00:26:22.228 [2024-04-16 23:04:13.236654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.228 [2024-04-16 23:04:13.236834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.228 [2024-04-16 23:04:13.236861] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.228 qpair failed and we were unable to recover it. 00:26:22.228 [2024-04-16 23:04:13.237036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.228 [2024-04-16 23:04:13.237188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.228 [2024-04-16 23:04:13.237214] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.228 qpair failed and we were unable to recover it. 00:26:22.228 [2024-04-16 23:04:13.237330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.228 [2024-04-16 23:04:13.237442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.228 [2024-04-16 23:04:13.237467] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.228 qpair failed and we were unable to recover it. 00:26:22.228 [2024-04-16 23:04:13.237636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.228 [2024-04-16 23:04:13.237751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.228 [2024-04-16 23:04:13.237794] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.228 qpair failed and we were unable to recover it. 00:26:22.228 [2024-04-16 23:04:13.237909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.228 [2024-04-16 23:04:13.238043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.228 [2024-04-16 23:04:13.238074] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.228 qpair failed and we were unable to recover it. 00:26:22.228 [2024-04-16 23:04:13.238250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.228 [2024-04-16 23:04:13.238370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.228 [2024-04-16 23:04:13.238395] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.228 qpair failed and we were unable to recover it. 00:26:22.228 [2024-04-16 23:04:13.238555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.228 [2024-04-16 23:04:13.238735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.228 [2024-04-16 23:04:13.238762] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.228 qpair failed and we were unable to recover it. 00:26:22.228 [2024-04-16 23:04:13.238932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.228 [2024-04-16 23:04:13.239073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.228 [2024-04-16 23:04:13.239098] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.228 qpair failed and we were unable to recover it. 00:26:22.228 [2024-04-16 23:04:13.239237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.228 [2024-04-16 23:04:13.239353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.228 [2024-04-16 23:04:13.239378] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.228 qpair failed and we were unable to recover it. 00:26:22.228 [2024-04-16 23:04:13.239539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.228 [2024-04-16 23:04:13.239681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.228 [2024-04-16 23:04:13.239706] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.228 qpair failed and we were unable to recover it. 00:26:22.228 [2024-04-16 23:04:13.239844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.228 [2024-04-16 23:04:13.239949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.228 [2024-04-16 23:04:13.239974] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.228 qpair failed and we were unable to recover it. 00:26:22.228 [2024-04-16 23:04:13.240111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.228 [2024-04-16 23:04:13.240262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.228 [2024-04-16 23:04:13.240287] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.228 qpair failed and we were unable to recover it. 00:26:22.228 [2024-04-16 23:04:13.240403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.228 [2024-04-16 23:04:13.240515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.228 [2024-04-16 23:04:13.240540] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.228 qpair failed and we were unable to recover it. 00:26:22.228 [2024-04-16 23:04:13.240682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.228 [2024-04-16 23:04:13.240837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.228 [2024-04-16 23:04:13.240864] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.228 qpair failed and we were unable to recover it. 00:26:22.228 [2024-04-16 23:04:13.241009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.228 [2024-04-16 23:04:13.241154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.228 [2024-04-16 23:04:13.241198] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.228 qpair failed and we were unable to recover it. 00:26:22.228 [2024-04-16 23:04:13.241356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.228 [2024-04-16 23:04:13.241464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.228 [2024-04-16 23:04:13.241489] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.228 qpair failed and we were unable to recover it. 00:26:22.228 [2024-04-16 23:04:13.241641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.228 [2024-04-16 23:04:13.241772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.228 [2024-04-16 23:04:13.241800] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.228 qpair failed and we were unable to recover it. 00:26:22.228 [2024-04-16 23:04:13.241930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.228 [2024-04-16 23:04:13.242063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.228 [2024-04-16 23:04:13.242091] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.228 qpair failed and we were unable to recover it. 00:26:22.228 [2024-04-16 23:04:13.242262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.228 [2024-04-16 23:04:13.242380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.228 [2024-04-16 23:04:13.242405] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.228 qpair failed and we were unable to recover it. 00:26:22.228 [2024-04-16 23:04:13.242596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.228 [2024-04-16 23:04:13.242718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.228 [2024-04-16 23:04:13.242745] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.228 qpair failed and we were unable to recover it. 00:26:22.228 [2024-04-16 23:04:13.242883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.228 [2024-04-16 23:04:13.243041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.228 [2024-04-16 23:04:13.243070] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.228 qpair failed and we were unable to recover it. 00:26:22.228 [2024-04-16 23:04:13.243238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.228 [2024-04-16 23:04:13.243351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.228 [2024-04-16 23:04:13.243376] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.228 qpair failed and we were unable to recover it. 00:26:22.228 [2024-04-16 23:04:13.243498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.228 [2024-04-16 23:04:13.243640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.228 [2024-04-16 23:04:13.243668] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.228 qpair failed and we were unable to recover it. 00:26:22.228 [2024-04-16 23:04:13.243827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.228 [2024-04-16 23:04:13.243980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.229 [2024-04-16 23:04:13.244008] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.229 qpair failed and we were unable to recover it. 00:26:22.229 [2024-04-16 23:04:13.244190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.229 [2024-04-16 23:04:13.244319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.229 [2024-04-16 23:04:13.244345] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.229 qpair failed and we were unable to recover it. 00:26:22.229 [2024-04-16 23:04:13.244459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.229 [2024-04-16 23:04:13.244594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.229 [2024-04-16 23:04:13.244618] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.229 qpair failed and we were unable to recover it. 00:26:22.229 [2024-04-16 23:04:13.244808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.229 [2024-04-16 23:04:13.244978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.229 [2024-04-16 23:04:13.245006] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.229 qpair failed and we were unable to recover it. 00:26:22.229 [2024-04-16 23:04:13.245188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.229 [2024-04-16 23:04:13.245350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.229 [2024-04-16 23:04:13.245374] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.229 qpair failed and we were unable to recover it. 00:26:22.229 [2024-04-16 23:04:13.245546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.229 [2024-04-16 23:04:13.245720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.229 [2024-04-16 23:04:13.245772] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.229 qpair failed and we were unable to recover it. 00:26:22.229 [2024-04-16 23:04:13.245922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.229 [2024-04-16 23:04:13.246084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.229 [2024-04-16 23:04:13.246109] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.229 qpair failed and we were unable to recover it. 00:26:22.229 [2024-04-16 23:04:13.246256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.229 [2024-04-16 23:04:13.246372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.229 [2024-04-16 23:04:13.246397] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.229 qpair failed and we were unable to recover it. 00:26:22.229 [2024-04-16 23:04:13.246563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.229 [2024-04-16 23:04:13.246680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.229 [2024-04-16 23:04:13.246708] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.229 qpair failed and we were unable to recover it. 00:26:22.229 [2024-04-16 23:04:13.246875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.229 [2024-04-16 23:04:13.247015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.229 [2024-04-16 23:04:13.247040] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.229 qpair failed and we were unable to recover it. 00:26:22.229 [2024-04-16 23:04:13.247143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.229 [2024-04-16 23:04:13.247282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.229 [2024-04-16 23:04:13.247311] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.229 qpair failed and we were unable to recover it. 00:26:22.229 [2024-04-16 23:04:13.247489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.229 [2024-04-16 23:04:13.247608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.229 [2024-04-16 23:04:13.247637] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.229 qpair failed and we were unable to recover it. 00:26:22.229 [2024-04-16 23:04:13.247792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.229 [2024-04-16 23:04:13.247942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.229 [2024-04-16 23:04:13.247970] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.229 qpair failed and we were unable to recover it. 00:26:22.229 [2024-04-16 23:04:13.248090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.229 [2024-04-16 23:04:13.248255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.229 [2024-04-16 23:04:13.248281] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.229 qpair failed and we were unable to recover it. 00:26:22.229 [2024-04-16 23:04:13.248395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.229 [2024-04-16 23:04:13.248559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.229 [2024-04-16 23:04:13.248608] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.229 qpair failed and we were unable to recover it. 00:26:22.229 [2024-04-16 23:04:13.248762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.229 [2024-04-16 23:04:13.248905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.229 [2024-04-16 23:04:13.248933] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.229 qpair failed and we were unable to recover it. 00:26:22.229 [2024-04-16 23:04:13.249085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.229 [2024-04-16 23:04:13.249228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.229 [2024-04-16 23:04:13.249255] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.229 qpair failed and we were unable to recover it. 00:26:22.229 [2024-04-16 23:04:13.249400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.229 [2024-04-16 23:04:13.249608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.229 [2024-04-16 23:04:13.249662] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.229 qpair failed and we were unable to recover it. 00:26:22.229 [2024-04-16 23:04:13.249872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.229 [2024-04-16 23:04:13.249996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.229 [2024-04-16 23:04:13.250024] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.229 qpair failed and we were unable to recover it. 00:26:22.229 [2024-04-16 23:04:13.250186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.229 [2024-04-16 23:04:13.250343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.229 [2024-04-16 23:04:13.250367] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.229 qpair failed and we were unable to recover it. 00:26:22.229 [2024-04-16 23:04:13.250534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.229 [2024-04-16 23:04:13.250689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.229 [2024-04-16 23:04:13.250717] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.229 qpair failed and we were unable to recover it. 00:26:22.229 [2024-04-16 23:04:13.250891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.229 [2024-04-16 23:04:13.251095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.229 [2024-04-16 23:04:13.251123] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.229 qpair failed and we were unable to recover it. 00:26:22.230 [2024-04-16 23:04:13.251262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.230 [2024-04-16 23:04:13.251410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.230 [2024-04-16 23:04:13.251434] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.230 qpair failed and we were unable to recover it. 00:26:22.230 [2024-04-16 23:04:13.251576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.230 [2024-04-16 23:04:13.251745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.230 [2024-04-16 23:04:13.251773] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.230 qpair failed and we were unable to recover it. 00:26:22.230 [2024-04-16 23:04:13.252013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.230 [2024-04-16 23:04:13.252154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.230 [2024-04-16 23:04:13.252187] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.230 qpair failed and we were unable to recover it. 00:26:22.230 [2024-04-16 23:04:13.252298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.230 [2024-04-16 23:04:13.252443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.230 [2024-04-16 23:04:13.252468] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.230 qpair failed and we were unable to recover it. 00:26:22.230 [2024-04-16 23:04:13.252608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.230 [2024-04-16 23:04:13.252732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.230 [2024-04-16 23:04:13.252760] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.230 qpair failed and we were unable to recover it. 00:26:22.230 [2024-04-16 23:04:13.252906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.230 [2024-04-16 23:04:13.253061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.230 [2024-04-16 23:04:13.253089] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.230 qpair failed and we were unable to recover it. 00:26:22.230 [2024-04-16 23:04:13.253271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.230 [2024-04-16 23:04:13.253391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.230 [2024-04-16 23:04:13.253415] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.230 qpair failed and we were unable to recover it. 00:26:22.230 [2024-04-16 23:04:13.253578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.230 [2024-04-16 23:04:13.253760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.230 [2024-04-16 23:04:13.253787] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.230 qpair failed and we were unable to recover it. 00:26:22.230 [2024-04-16 23:04:13.253965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.230 [2024-04-16 23:04:13.254122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.230 [2024-04-16 23:04:13.254151] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.230 qpair failed and we were unable to recover it. 00:26:22.230 [2024-04-16 23:04:13.254304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.230 [2024-04-16 23:04:13.254444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.230 [2024-04-16 23:04:13.254469] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.230 qpair failed and we were unable to recover it. 00:26:22.230 [2024-04-16 23:04:13.254617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.230 [2024-04-16 23:04:13.254835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.230 [2024-04-16 23:04:13.254892] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.230 qpair failed and we were unable to recover it. 00:26:22.230 [2024-04-16 23:04:13.255049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.230 [2024-04-16 23:04:13.255221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.230 [2024-04-16 23:04:13.255247] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.230 qpair failed and we were unable to recover it. 00:26:22.230 [2024-04-16 23:04:13.255405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.230 [2024-04-16 23:04:13.255560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.230 [2024-04-16 23:04:13.255588] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.230 qpair failed and we were unable to recover it. 00:26:22.230 [2024-04-16 23:04:13.255717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.230 [2024-04-16 23:04:13.255873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.230 [2024-04-16 23:04:13.255901] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.230 qpair failed and we were unable to recover it. 00:26:22.230 [2024-04-16 23:04:13.256051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.230 [2024-04-16 23:04:13.256226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.230 [2024-04-16 23:04:13.256252] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.230 qpair failed and we were unable to recover it. 00:26:22.230 [2024-04-16 23:04:13.256387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.230 [2024-04-16 23:04:13.256517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.230 [2024-04-16 23:04:13.256544] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.230 qpair failed and we were unable to recover it. 00:26:22.230 [2024-04-16 23:04:13.256689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.230 [2024-04-16 23:04:13.256883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.230 [2024-04-16 23:04:13.256924] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.230 qpair failed and we were unable to recover it. 00:26:22.230 [2024-04-16 23:04:13.257092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.230 [2024-04-16 23:04:13.257238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.230 [2024-04-16 23:04:13.257263] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.230 qpair failed and we were unable to recover it. 00:26:22.230 [2024-04-16 23:04:13.257374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.230 [2024-04-16 23:04:13.257489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.230 [2024-04-16 23:04:13.257513] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.230 qpair failed and we were unable to recover it. 00:26:22.230 [2024-04-16 23:04:13.257674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.230 [2024-04-16 23:04:13.257827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.230 [2024-04-16 23:04:13.257854] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.230 qpair failed and we were unable to recover it. 00:26:22.230 [2024-04-16 23:04:13.258008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.230 [2024-04-16 23:04:13.258162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.230 [2024-04-16 23:04:13.258216] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.230 qpair failed and we were unable to recover it. 00:26:22.230 [2024-04-16 23:04:13.258335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.230 [2024-04-16 23:04:13.258496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.230 [2024-04-16 23:04:13.258523] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.230 qpair failed and we were unable to recover it. 00:26:22.230 [2024-04-16 23:04:13.258687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.230 [2024-04-16 23:04:13.258873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.230 [2024-04-16 23:04:13.258901] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.230 qpair failed and we were unable to recover it. 00:26:22.230 [2024-04-16 23:04:13.259030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.230 [2024-04-16 23:04:13.259148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.230 [2024-04-16 23:04:13.259184] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.230 qpair failed and we were unable to recover it. 00:26:22.230 [2024-04-16 23:04:13.259324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.230 [2024-04-16 23:04:13.259436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.230 [2024-04-16 23:04:13.259461] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.230 qpair failed and we were unable to recover it. 00:26:22.230 [2024-04-16 23:04:13.259564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.230 [2024-04-16 23:04:13.259674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.230 [2024-04-16 23:04:13.259716] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.230 qpair failed and we were unable to recover it. 00:26:22.230 [2024-04-16 23:04:13.259883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.230 [2024-04-16 23:04:13.260043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.230 [2024-04-16 23:04:13.260071] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.230 qpair failed and we were unable to recover it. 00:26:22.230 [2024-04-16 23:04:13.260270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.230 [2024-04-16 23:04:13.260413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.231 [2024-04-16 23:04:13.260437] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.231 qpair failed and we were unable to recover it. 00:26:22.231 [2024-04-16 23:04:13.260601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.231 [2024-04-16 23:04:13.260772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.231 [2024-04-16 23:04:13.260823] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.231 qpair failed and we were unable to recover it. 00:26:22.231 [2024-04-16 23:04:13.260952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.231 [2024-04-16 23:04:13.261076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.231 [2024-04-16 23:04:13.261102] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.231 qpair failed and we were unable to recover it. 00:26:22.231 [2024-04-16 23:04:13.261264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.231 [2024-04-16 23:04:13.261405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.231 [2024-04-16 23:04:13.261430] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.231 qpair failed and we were unable to recover it. 00:26:22.231 [2024-04-16 23:04:13.261599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.231 [2024-04-16 23:04:13.261755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.231 [2024-04-16 23:04:13.261782] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.231 qpair failed and we were unable to recover it. 00:26:22.231 [2024-04-16 23:04:13.261896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.231 [2024-04-16 23:04:13.262071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.231 [2024-04-16 23:04:13.262099] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.231 qpair failed and we were unable to recover it. 00:26:22.231 [2024-04-16 23:04:13.262295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.231 [2024-04-16 23:04:13.262415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.231 [2024-04-16 23:04:13.262458] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.231 qpair failed and we were unable to recover it. 00:26:22.231 [2024-04-16 23:04:13.262623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.231 [2024-04-16 23:04:13.262771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.231 [2024-04-16 23:04:13.262814] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.231 qpair failed and we were unable to recover it. 00:26:22.231 [2024-04-16 23:04:13.262997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.231 [2024-04-16 23:04:13.263161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.231 [2024-04-16 23:04:13.263193] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.231 qpair failed and we were unable to recover it. 00:26:22.231 [2024-04-16 23:04:13.263309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.231 [2024-04-16 23:04:13.263444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.231 [2024-04-16 23:04:13.263468] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.231 qpair failed and we were unable to recover it. 00:26:22.231 [2024-04-16 23:04:13.263578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.231 [2024-04-16 23:04:13.263691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.231 [2024-04-16 23:04:13.263734] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.231 qpair failed and we were unable to recover it. 00:26:22.231 [2024-04-16 23:04:13.263905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.231 [2024-04-16 23:04:13.264050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.231 [2024-04-16 23:04:13.264093] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.231 qpair failed and we were unable to recover it. 00:26:22.231 [2024-04-16 23:04:13.264295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.231 [2024-04-16 23:04:13.264405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.231 [2024-04-16 23:04:13.264431] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.231 qpair failed and we were unable to recover it. 00:26:22.231 [2024-04-16 23:04:13.264622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.231 [2024-04-16 23:04:13.264773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.231 [2024-04-16 23:04:13.264828] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.231 qpair failed and we were unable to recover it. 00:26:22.231 [2024-04-16 23:04:13.264984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.231 [2024-04-16 23:04:13.265134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.231 [2024-04-16 23:04:13.265162] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.231 qpair failed and we were unable to recover it. 00:26:22.231 [2024-04-16 23:04:13.265330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.231 [2024-04-16 23:04:13.265469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.231 [2024-04-16 23:04:13.265510] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.231 qpair failed and we were unable to recover it. 00:26:22.231 [2024-04-16 23:04:13.265659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.231 [2024-04-16 23:04:13.265809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.231 [2024-04-16 23:04:13.265839] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.231 qpair failed and we were unable to recover it. 00:26:22.231 [2024-04-16 23:04:13.266020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.231 [2024-04-16 23:04:13.266827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.231 [2024-04-16 23:04:13.266860] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.231 qpair failed and we were unable to recover it. 00:26:22.231 [2024-04-16 23:04:13.267025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.231 [2024-04-16 23:04:13.267146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.231 [2024-04-16 23:04:13.267184] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.231 qpair failed and we were unable to recover it. 00:26:22.231 [2024-04-16 23:04:13.267342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.231 [2024-04-16 23:04:13.267454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.231 [2024-04-16 23:04:13.267479] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.231 qpair failed and we were unable to recover it. 00:26:22.231 [2024-04-16 23:04:13.267622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.231 [2024-04-16 23:04:13.267741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.231 [2024-04-16 23:04:13.267766] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.231 qpair failed and we were unable to recover it. 00:26:22.231 [2024-04-16 23:04:13.267877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.231 [2024-04-16 23:04:13.268010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.231 [2024-04-16 23:04:13.268035] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.231 qpair failed and we were unable to recover it. 00:26:22.231 [2024-04-16 23:04:13.268227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.231 [2024-04-16 23:04:13.268413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.231 [2024-04-16 23:04:13.268441] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.231 qpair failed and we were unable to recover it. 00:26:22.231 [2024-04-16 23:04:13.268585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.231 [2024-04-16 23:04:13.268724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.231 [2024-04-16 23:04:13.268750] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.231 qpair failed and we were unable to recover it. 00:26:22.231 [2024-04-16 23:04:13.268888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.231 [2024-04-16 23:04:13.269063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.231 [2024-04-16 23:04:13.269088] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.231 qpair failed and we were unable to recover it. 00:26:22.231 [2024-04-16 23:04:13.269251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.231 [2024-04-16 23:04:13.269416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.231 [2024-04-16 23:04:13.269442] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.231 qpair failed and we were unable to recover it. 00:26:22.231 [2024-04-16 23:04:13.269584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.231 [2024-04-16 23:04:13.269740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.231 [2024-04-16 23:04:13.269767] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.231 qpair failed and we were unable to recover it. 00:26:22.231 [2024-04-16 23:04:13.269925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.231 [2024-04-16 23:04:13.270073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.232 [2024-04-16 23:04:13.270097] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.232 qpair failed and we were unable to recover it. 00:26:22.232 [2024-04-16 23:04:13.270245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.232 [2024-04-16 23:04:13.270455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.232 [2024-04-16 23:04:13.270480] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.232 qpair failed and we were unable to recover it. 00:26:22.232 [2024-04-16 23:04:13.270642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.232 [2024-04-16 23:04:13.270804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.232 [2024-04-16 23:04:13.270829] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.232 qpair failed and we were unable to recover it. 00:26:22.232 [2024-04-16 23:04:13.270947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.232 [2024-04-16 23:04:13.271095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.232 [2024-04-16 23:04:13.271123] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.232 qpair failed and we were unable to recover it. 00:26:22.232 [2024-04-16 23:04:13.271273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.232 [2024-04-16 23:04:13.271387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.232 [2024-04-16 23:04:13.271413] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.232 qpair failed and we were unable to recover it. 00:26:22.232 [2024-04-16 23:04:13.271583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.232 [2024-04-16 23:04:13.271743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.232 [2024-04-16 23:04:13.271771] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.232 qpair failed and we were unable to recover it. 00:26:22.232 [2024-04-16 23:04:13.271935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.232 [2024-04-16 23:04:13.272102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.232 [2024-04-16 23:04:13.272126] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.232 qpair failed and we were unable to recover it. 00:26:22.232 [2024-04-16 23:04:13.272268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.232 [2024-04-16 23:04:13.272417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.232 [2024-04-16 23:04:13.272445] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.232 qpair failed and we were unable to recover it. 00:26:22.232 [2024-04-16 23:04:13.272585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.232 [2024-04-16 23:04:13.272699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.232 [2024-04-16 23:04:13.272724] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.232 qpair failed and we were unable to recover it. 00:26:22.232 [2024-04-16 23:04:13.272894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.232 [2024-04-16 23:04:13.273039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.232 [2024-04-16 23:04:13.273065] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.232 qpair failed and we were unable to recover it. 00:26:22.232 [2024-04-16 23:04:13.273213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.232 [2024-04-16 23:04:13.273373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.232 [2024-04-16 23:04:13.273401] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.232 qpair failed and we were unable to recover it. 00:26:22.232 [2024-04-16 23:04:13.273530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.232 [2024-04-16 23:04:13.273678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.232 [2024-04-16 23:04:13.273706] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.232 qpair failed and we were unable to recover it. 00:26:22.232 [2024-04-16 23:04:13.273864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.232 [2024-04-16 23:04:13.273977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.232 [2024-04-16 23:04:13.274002] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.232 qpair failed and we were unable to recover it. 00:26:22.232 [2024-04-16 23:04:13.274155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.232 [2024-04-16 23:04:13.274295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.232 [2024-04-16 23:04:13.274323] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.232 qpair failed and we were unable to recover it. 00:26:22.232 [2024-04-16 23:04:13.274443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.232 [2024-04-16 23:04:13.274626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.232 [2024-04-16 23:04:13.274653] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.232 qpair failed and we were unable to recover it. 00:26:22.232 [2024-04-16 23:04:13.274820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.232 [2024-04-16 23:04:13.274927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.232 [2024-04-16 23:04:13.274952] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.232 qpair failed and we were unable to recover it. 00:26:22.232 [2024-04-16 23:04:13.275059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.232 [2024-04-16 23:04:13.275169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.232 [2024-04-16 23:04:13.275201] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.232 qpair failed and we were unable to recover it. 00:26:22.232 [2024-04-16 23:04:13.275312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.232 [2024-04-16 23:04:13.275416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.232 [2024-04-16 23:04:13.275458] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.232 qpair failed and we were unable to recover it. 00:26:22.232 [2024-04-16 23:04:13.275611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.232 [2024-04-16 23:04:13.275756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.232 [2024-04-16 23:04:13.275785] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.232 qpair failed and we were unable to recover it. 00:26:22.232 [2024-04-16 23:04:13.275941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.232 [2024-04-16 23:04:13.276087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.232 [2024-04-16 23:04:13.276115] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.232 qpair failed and we were unable to recover it. 00:26:22.232 [2024-04-16 23:04:13.276283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.232 [2024-04-16 23:04:13.276423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.232 [2024-04-16 23:04:13.276448] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.232 qpair failed and we were unable to recover it. 00:26:22.232 [2024-04-16 23:04:13.276622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.232 [2024-04-16 23:04:13.276769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.232 [2024-04-16 23:04:13.276798] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.232 qpair failed and we were unable to recover it. 00:26:22.232 [2024-04-16 23:04:13.276946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.232 [2024-04-16 23:04:13.277064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.232 [2024-04-16 23:04:13.277092] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.232 qpair failed and we were unable to recover it. 00:26:22.232 [2024-04-16 23:04:13.277249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.232 [2024-04-16 23:04:13.277393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.232 [2024-04-16 23:04:13.277421] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.232 qpair failed and we were unable to recover it. 00:26:22.232 [2024-04-16 23:04:13.277583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.232 [2024-04-16 23:04:13.277720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.232 [2024-04-16 23:04:13.277745] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.232 qpair failed and we were unable to recover it. 00:26:22.232 [2024-04-16 23:04:13.277924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.232 [2024-04-16 23:04:13.278058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.232 [2024-04-16 23:04:13.278083] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.232 qpair failed and we were unable to recover it. 00:26:22.232 [2024-04-16 23:04:13.278249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.232 [2024-04-16 23:04:13.278404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.232 [2024-04-16 23:04:13.278431] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.232 qpair failed and we were unable to recover it. 00:26:22.232 [2024-04-16 23:04:13.278612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.232 [2024-04-16 23:04:13.278732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.232 [2024-04-16 23:04:13.278760] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.232 qpair failed and we were unable to recover it. 00:26:22.232 [2024-04-16 23:04:13.278894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.232 [2024-04-16 23:04:13.279028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.233 [2024-04-16 23:04:13.279055] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.233 qpair failed and we were unable to recover it. 00:26:22.233 [2024-04-16 23:04:13.279200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.233 [2024-04-16 23:04:13.279357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.233 [2024-04-16 23:04:13.279385] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.233 qpair failed and we were unable to recover it. 00:26:22.233 [2024-04-16 23:04:13.279522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.233 [2024-04-16 23:04:13.279679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.233 [2024-04-16 23:04:13.279707] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.233 qpair failed and we were unable to recover it. 00:26:22.233 [2024-04-16 23:04:13.279855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.233 [2024-04-16 23:04:13.279999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.233 [2024-04-16 23:04:13.280026] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.233 qpair failed and we were unable to recover it. 00:26:22.233 [2024-04-16 23:04:13.280189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.233 [2024-04-16 23:04:13.280366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.233 [2024-04-16 23:04:13.280391] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.233 qpair failed and we were unable to recover it. 00:26:22.233 [2024-04-16 23:04:13.280543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.233 [2024-04-16 23:04:13.280659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.233 [2024-04-16 23:04:13.280687] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.233 qpair failed and we were unable to recover it. 00:26:22.233 [2024-04-16 23:04:13.280807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.233 [2024-04-16 23:04:13.280951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.233 [2024-04-16 23:04:13.280979] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.233 qpair failed and we were unable to recover it. 00:26:22.233 [2024-04-16 23:04:13.281134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.233 [2024-04-16 23:04:13.281283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.233 [2024-04-16 23:04:13.281312] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.233 qpair failed and we were unable to recover it. 00:26:22.233 [2024-04-16 23:04:13.281475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.233 [2024-04-16 23:04:13.281583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.233 [2024-04-16 23:04:13.281608] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.233 qpair failed and we were unable to recover it. 00:26:22.233 [2024-04-16 23:04:13.281772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.233 [2024-04-16 23:04:13.281891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.233 [2024-04-16 23:04:13.281920] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.233 qpair failed and we were unable to recover it. 00:26:22.233 [2024-04-16 23:04:13.282111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.233 [2024-04-16 23:04:13.282280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.233 [2024-04-16 23:04:13.282305] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.233 qpair failed and we were unable to recover it. 00:26:22.233 [2024-04-16 23:04:13.282417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.233 [2024-04-16 23:04:13.282580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.233 [2024-04-16 23:04:13.282609] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.233 qpair failed and we were unable to recover it. 00:26:22.233 [2024-04-16 23:04:13.282743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.233 [2024-04-16 23:04:13.282875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.233 [2024-04-16 23:04:13.282900] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.233 qpair failed and we were unable to recover it. 00:26:22.233 [2024-04-16 23:04:13.283027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.233 [2024-04-16 23:04:13.283217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.233 [2024-04-16 23:04:13.283246] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.233 qpair failed and we were unable to recover it. 00:26:22.233 [2024-04-16 23:04:13.283392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.233 [2024-04-16 23:04:13.283525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.233 [2024-04-16 23:04:13.283567] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.233 qpair failed and we were unable to recover it. 00:26:22.233 [2024-04-16 23:04:13.283703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.233 [2024-04-16 23:04:13.283841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.233 [2024-04-16 23:04:13.283869] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.233 qpair failed and we were unable to recover it. 00:26:22.233 [2024-04-16 23:04:13.284028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.233 [2024-04-16 23:04:13.284206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.233 [2024-04-16 23:04:13.284249] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.233 qpair failed and we were unable to recover it. 00:26:22.233 [2024-04-16 23:04:13.284411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.233 [2024-04-16 23:04:13.284526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.233 [2024-04-16 23:04:13.284550] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.233 qpair failed and we were unable to recover it. 00:26:22.233 [2024-04-16 23:04:13.284739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.233 [2024-04-16 23:04:13.284852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.233 [2024-04-16 23:04:13.284877] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.233 qpair failed and we were unable to recover it. 00:26:22.233 [2024-04-16 23:04:13.285016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.233 [2024-04-16 23:04:13.285148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.233 [2024-04-16 23:04:13.285183] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.233 qpair failed and we were unable to recover it. 00:26:22.233 [2024-04-16 23:04:13.285373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.233 [2024-04-16 23:04:13.285492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.233 [2024-04-16 23:04:13.285518] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.233 qpair failed and we were unable to recover it. 00:26:22.233 [2024-04-16 23:04:13.285692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.233 [2024-04-16 23:04:13.285860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.233 [2024-04-16 23:04:13.285885] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.233 qpair failed and we were unable to recover it. 00:26:22.233 [2024-04-16 23:04:13.286093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.233 [2024-04-16 23:04:13.286206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.233 [2024-04-16 23:04:13.286232] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.233 qpair failed and we were unable to recover it. 00:26:22.233 [2024-04-16 23:04:13.286341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.233 [2024-04-16 23:04:13.286517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.233 [2024-04-16 23:04:13.286542] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.233 qpair failed and we were unable to recover it. 00:26:22.233 [2024-04-16 23:04:13.286742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.233 [2024-04-16 23:04:13.286907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.233 [2024-04-16 23:04:13.286932] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.233 qpair failed and we were unable to recover it. 00:26:22.233 [2024-04-16 23:04:13.287079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.233 [2024-04-16 23:04:13.287248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.233 [2024-04-16 23:04:13.287276] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.233 qpair failed and we were unable to recover it. 00:26:22.233 [2024-04-16 23:04:13.287397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.233 [2024-04-16 23:04:13.287549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.233 [2024-04-16 23:04:13.287578] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.233 qpair failed and we were unable to recover it. 00:26:22.233 [2024-04-16 23:04:13.287731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.233 [2024-04-16 23:04:13.287911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.233 [2024-04-16 23:04:13.287939] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.234 qpair failed and we were unable to recover it. 00:26:22.234 [2024-04-16 23:04:13.288106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.234 [2024-04-16 23:04:13.288252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.234 [2024-04-16 23:04:13.288278] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.234 qpair failed and we were unable to recover it. 00:26:22.234 [2024-04-16 23:04:13.288397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.234 [2024-04-16 23:04:13.288545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.234 [2024-04-16 23:04:13.288569] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.234 qpair failed and we were unable to recover it. 00:26:22.234 [2024-04-16 23:04:13.288712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.234 [2024-04-16 23:04:13.288870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.234 [2024-04-16 23:04:13.288901] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.234 qpair failed and we were unable to recover it. 00:26:22.234 [2024-04-16 23:04:13.289029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.234 [2024-04-16 23:04:13.289226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.234 [2024-04-16 23:04:13.289253] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.234 qpair failed and we were unable to recover it. 00:26:22.234 [2024-04-16 23:04:13.289362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.234 [2024-04-16 23:04:13.289478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.234 [2024-04-16 23:04:13.289504] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.234 qpair failed and we were unable to recover it. 00:26:22.234 [2024-04-16 23:04:13.289651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.234 [2024-04-16 23:04:13.289788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.234 [2024-04-16 23:04:13.289813] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.234 qpair failed and we were unable to recover it. 00:26:22.234 [2024-04-16 23:04:13.289947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.234 [2024-04-16 23:04:13.290056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.234 [2024-04-16 23:04:13.290082] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.234 qpair failed and we were unable to recover it. 00:26:22.234 [2024-04-16 23:04:13.290203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.234 [2024-04-16 23:04:13.290340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.234 [2024-04-16 23:04:13.290365] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.234 qpair failed and we were unable to recover it. 00:26:22.234 [2024-04-16 23:04:13.290557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.234 [2024-04-16 23:04:13.290705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.234 [2024-04-16 23:04:13.290733] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.234 qpair failed and we were unable to recover it. 00:26:22.234 [2024-04-16 23:04:13.290855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.234 [2024-04-16 23:04:13.290999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.234 [2024-04-16 23:04:13.291027] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.234 qpair failed and we were unable to recover it. 00:26:22.234 [2024-04-16 23:04:13.291153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.234 [2024-04-16 23:04:13.291300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.234 [2024-04-16 23:04:13.291326] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.234 qpair failed and we were unable to recover it. 00:26:22.234 [2024-04-16 23:04:13.291481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.234 [2024-04-16 23:04:13.291630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.234 [2024-04-16 23:04:13.291658] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.234 qpair failed and we were unable to recover it. 00:26:22.234 [2024-04-16 23:04:13.291809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.234 [2024-04-16 23:04:13.291956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.234 [2024-04-16 23:04:13.291983] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.234 qpair failed and we were unable to recover it. 00:26:22.234 [2024-04-16 23:04:13.292145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.234 [2024-04-16 23:04:13.292298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.234 [2024-04-16 23:04:13.292325] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.234 qpair failed and we were unable to recover it. 00:26:22.234 [2024-04-16 23:04:13.292485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.234 [2024-04-16 23:04:13.292616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.234 [2024-04-16 23:04:13.292641] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.234 qpair failed and we were unable to recover it. 00:26:22.234 [2024-04-16 23:04:13.292806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.234 [2024-04-16 23:04:13.292959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.234 [2024-04-16 23:04:13.292987] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.234 qpair failed and we were unable to recover it. 00:26:22.234 [2024-04-16 23:04:13.293122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.234 [2024-04-16 23:04:13.293294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.234 [2024-04-16 23:04:13.293320] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.234 qpair failed and we were unable to recover it. 00:26:22.234 [2024-04-16 23:04:13.293475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.234 [2024-04-16 23:04:13.293595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.234 [2024-04-16 23:04:13.293622] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.234 qpair failed and we were unable to recover it. 00:26:22.234 [2024-04-16 23:04:13.293773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.234 [2024-04-16 23:04:13.293939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.234 [2024-04-16 23:04:13.293967] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.234 qpair failed and we were unable to recover it. 00:26:22.234 [2024-04-16 23:04:13.294084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.234 [2024-04-16 23:04:13.294256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.234 [2024-04-16 23:04:13.294287] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.234 qpair failed and we were unable to recover it. 00:26:22.234 [2024-04-16 23:04:13.294439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.234 [2024-04-16 23:04:13.294575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.234 [2024-04-16 23:04:13.294617] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.234 qpair failed and we were unable to recover it. 00:26:22.234 [2024-04-16 23:04:13.294747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.234 [2024-04-16 23:04:13.294892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.234 [2024-04-16 23:04:13.294919] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.234 qpair failed and we were unable to recover it. 00:26:22.234 [2024-04-16 23:04:13.295043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.234 [2024-04-16 23:04:13.295195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.234 [2024-04-16 23:04:13.295239] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.234 qpair failed and we were unable to recover it. 00:26:22.234 [2024-04-16 23:04:13.295366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.234 [2024-04-16 23:04:13.295494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.234 [2024-04-16 23:04:13.295523] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.234 qpair failed and we were unable to recover it. 00:26:22.235 [2024-04-16 23:04:13.295663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.235 [2024-04-16 23:04:13.295801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.235 [2024-04-16 23:04:13.295826] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.235 qpair failed and we were unable to recover it. 00:26:22.235 [2024-04-16 23:04:13.295990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.235 [2024-04-16 23:04:13.296152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.235 [2024-04-16 23:04:13.296187] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.235 qpair failed and we were unable to recover it. 00:26:22.235 [2024-04-16 23:04:13.296346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.235 [2024-04-16 23:04:13.296498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.235 [2024-04-16 23:04:13.296526] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.235 qpair failed and we were unable to recover it. 00:26:22.235 [2024-04-16 23:04:13.296678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.235 [2024-04-16 23:04:13.296830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.235 [2024-04-16 23:04:13.296858] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.235 qpair failed and we were unable to recover it. 00:26:22.235 [2024-04-16 23:04:13.297035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.235 [2024-04-16 23:04:13.297232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.235 [2024-04-16 23:04:13.297258] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.235 qpair failed and we were unable to recover it. 00:26:22.235 [2024-04-16 23:04:13.297399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.235 [2024-04-16 23:04:13.297569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.235 [2024-04-16 23:04:13.297596] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.235 qpair failed and we were unable to recover it. 00:26:22.235 [2024-04-16 23:04:13.297747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.235 [2024-04-16 23:04:13.297861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.235 [2024-04-16 23:04:13.297888] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.235 qpair failed and we were unable to recover it. 00:26:22.235 [2024-04-16 23:04:13.298041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.235 [2024-04-16 23:04:13.298195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.235 [2024-04-16 23:04:13.298240] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.235 qpair failed and we were unable to recover it. 00:26:22.235 [2024-04-16 23:04:13.298356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.235 [2024-04-16 23:04:13.298468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.235 [2024-04-16 23:04:13.298492] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.235 qpair failed and we were unable to recover it. 00:26:22.235 [2024-04-16 23:04:13.298641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.235 [2024-04-16 23:04:13.298802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.235 [2024-04-16 23:04:13.298829] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.235 qpair failed and we were unable to recover it. 00:26:22.235 [2024-04-16 23:04:13.299013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.235 [2024-04-16 23:04:13.299133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.235 [2024-04-16 23:04:13.299160] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.235 qpair failed and we were unable to recover it. 00:26:22.235 [2024-04-16 23:04:13.299331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.235 [2024-04-16 23:04:13.299445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.235 [2024-04-16 23:04:13.299489] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.235 qpair failed and we were unable to recover it. 00:26:22.235 [2024-04-16 23:04:13.299645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.235 [2024-04-16 23:04:13.299799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.235 [2024-04-16 23:04:13.299839] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.235 qpair failed and we were unable to recover it. 00:26:22.235 [2024-04-16 23:04:13.299987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.235 [2024-04-16 23:04:13.300130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.235 [2024-04-16 23:04:13.300158] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.235 qpair failed and we were unable to recover it. 00:26:22.235 [2024-04-16 23:04:13.300304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.235 [2024-04-16 23:04:13.300415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.235 [2024-04-16 23:04:13.300441] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.235 qpair failed and we were unable to recover it. 00:26:22.235 [2024-04-16 23:04:13.300632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.235 [2024-04-16 23:04:13.300818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.235 [2024-04-16 23:04:13.300864] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.235 qpair failed and we were unable to recover it. 00:26:22.235 [2024-04-16 23:04:13.301075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.235 [2024-04-16 23:04:13.301270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.235 [2024-04-16 23:04:13.301296] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.235 qpair failed and we were unable to recover it. 00:26:22.235 [2024-04-16 23:04:13.301436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.235 [2024-04-16 23:04:13.301609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.235 [2024-04-16 23:04:13.301635] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.235 qpair failed and we were unable to recover it. 00:26:22.235 [2024-04-16 23:04:13.301777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.235 [2024-04-16 23:04:13.301945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.235 [2024-04-16 23:04:13.301971] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.235 qpair failed and we were unable to recover it. 00:26:22.235 [2024-04-16 23:04:13.302166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.235 [2024-04-16 23:04:13.302359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.235 [2024-04-16 23:04:13.302387] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.235 qpair failed and we were unable to recover it. 00:26:22.235 [2024-04-16 23:04:13.302517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.235 [2024-04-16 23:04:13.302642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.235 [2024-04-16 23:04:13.302667] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.235 qpair failed and we were unable to recover it. 00:26:22.235 [2024-04-16 23:04:13.302778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.235 [2024-04-16 23:04:13.302948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.235 [2024-04-16 23:04:13.302973] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.235 qpair failed and we were unable to recover it. 00:26:22.235 [2024-04-16 23:04:13.303089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.235 [2024-04-16 23:04:13.303228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.235 [2024-04-16 23:04:13.303253] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.235 qpair failed and we were unable to recover it. 00:26:22.235 [2024-04-16 23:04:13.303398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.235 [2024-04-16 23:04:13.303567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.235 [2024-04-16 23:04:13.303595] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.235 qpair failed and we were unable to recover it. 00:26:22.235 [2024-04-16 23:04:13.303754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.235 [2024-04-16 23:04:13.303918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.235 [2024-04-16 23:04:13.303943] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.235 qpair failed and we were unable to recover it. 00:26:22.235 [2024-04-16 23:04:13.304952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.235 [2024-04-16 23:04:13.305136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.235 [2024-04-16 23:04:13.305162] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.235 qpair failed and we were unable to recover it. 00:26:22.235 [2024-04-16 23:04:13.305388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.235 [2024-04-16 23:04:13.305630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.235 [2024-04-16 23:04:13.305681] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.235 qpair failed and we were unable to recover it. 00:26:22.235 [2024-04-16 23:04:13.305849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.235 [2024-04-16 23:04:13.305971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.235 [2024-04-16 23:04:13.305997] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.235 qpair failed and we were unable to recover it. 00:26:22.235 [2024-04-16 23:04:13.306146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.235 [2024-04-16 23:04:13.306279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.235 [2024-04-16 23:04:13.306331] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.235 qpair failed and we were unable to recover it. 00:26:22.235 [2024-04-16 23:04:13.306504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.235 [2024-04-16 23:04:13.306662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.236 [2024-04-16 23:04:13.306694] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.236 qpair failed and we were unable to recover it. 00:26:22.514 [2024-04-16 23:04:13.306878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.514 [2024-04-16 23:04:13.307015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.514 [2024-04-16 23:04:13.307042] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.514 qpair failed and we were unable to recover it. 00:26:22.514 [2024-04-16 23:04:13.307230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.514 [2024-04-16 23:04:13.307423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.514 [2024-04-16 23:04:13.307448] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.514 qpair failed and we were unable to recover it. 00:26:22.514 [2024-04-16 23:04:13.307565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.514 [2024-04-16 23:04:13.307735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.514 [2024-04-16 23:04:13.307760] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.514 qpair failed and we were unable to recover it. 00:26:22.514 [2024-04-16 23:04:13.307868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.514 [2024-04-16 23:04:13.307997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.514 [2024-04-16 23:04:13.308022] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.514 qpair failed and we were unable to recover it. 00:26:22.514 [2024-04-16 23:04:13.308164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.514 [2024-04-16 23:04:13.308327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.514 [2024-04-16 23:04:13.308363] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.514 qpair failed and we were unable to recover it. 00:26:22.514 [2024-04-16 23:04:13.308511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.514 [2024-04-16 23:04:13.308628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.514 [2024-04-16 23:04:13.308655] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.514 qpair failed and we were unable to recover it. 00:26:22.514 [2024-04-16 23:04:13.308830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.514 [2024-04-16 23:04:13.308950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.514 [2024-04-16 23:04:13.308976] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.514 qpair failed and we were unable to recover it. 00:26:22.514 [2024-04-16 23:04:13.309121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.514 [2024-04-16 23:04:13.309256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.514 [2024-04-16 23:04:13.309281] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.514 qpair failed and we were unable to recover it. 00:26:22.514 [2024-04-16 23:04:13.309408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.514 [2024-04-16 23:04:13.309543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.514 [2024-04-16 23:04:13.309570] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.514 qpair failed and we were unable to recover it. 00:26:22.514 [2024-04-16 23:04:13.309712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.514 [2024-04-16 23:04:13.309851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.514 [2024-04-16 23:04:13.309883] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.514 qpair failed and we were unable to recover it. 00:26:22.514 [2024-04-16 23:04:13.310022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.514 [2024-04-16 23:04:13.310153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.514 [2024-04-16 23:04:13.310188] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.514 qpair failed and we were unable to recover it. 00:26:22.514 [2024-04-16 23:04:13.310309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.514 [2024-04-16 23:04:13.310555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.514 [2024-04-16 23:04:13.310587] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.514 qpair failed and we were unable to recover it. 00:26:22.514 [2024-04-16 23:04:13.310843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.514 [2024-04-16 23:04:13.311017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.514 [2024-04-16 23:04:13.311045] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.514 qpair failed and we were unable to recover it. 00:26:22.514 [2024-04-16 23:04:13.311169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.514 [2024-04-16 23:04:13.311396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.514 [2024-04-16 23:04:13.311421] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.514 qpair failed and we were unable to recover it. 00:26:22.514 [2024-04-16 23:04:13.311641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.514 [2024-04-16 23:04:13.311799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.514 [2024-04-16 23:04:13.311838] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.514 qpair failed and we were unable to recover it. 00:26:22.514 [2024-04-16 23:04:13.311979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.514 [2024-04-16 23:04:13.312128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.514 [2024-04-16 23:04:13.312156] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.514 qpair failed and we were unable to recover it. 00:26:22.514 [2024-04-16 23:04:13.312332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.514 [2024-04-16 23:04:13.312495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.514 [2024-04-16 23:04:13.312523] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.514 qpair failed and we were unable to recover it. 00:26:22.514 [2024-04-16 23:04:13.312708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.514 [2024-04-16 23:04:13.312876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.514 [2024-04-16 23:04:13.312901] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.514 qpair failed and we were unable to recover it. 00:26:22.514 [2024-04-16 23:04:13.313132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.514 [2024-04-16 23:04:13.313250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.514 [2024-04-16 23:04:13.313276] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.514 qpair failed and we were unable to recover it. 00:26:22.514 [2024-04-16 23:04:13.313404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.514 [2024-04-16 23:04:13.313560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.514 [2024-04-16 23:04:13.313587] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.514 qpair failed and we were unable to recover it. 00:26:22.514 [2024-04-16 23:04:13.313832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.514 [2024-04-16 23:04:13.314027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.514 [2024-04-16 23:04:13.314055] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.514 qpair failed and we were unable to recover it. 00:26:22.514 [2024-04-16 23:04:13.314226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.514 [2024-04-16 23:04:13.314335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.514 [2024-04-16 23:04:13.314360] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.514 qpair failed and we were unable to recover it. 00:26:22.514 [2024-04-16 23:04:13.314585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.514 [2024-04-16 23:04:13.314841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.514 [2024-04-16 23:04:13.314869] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.514 qpair failed and we were unable to recover it. 00:26:22.514 [2024-04-16 23:04:13.315051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.514 [2024-04-16 23:04:13.315206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.514 [2024-04-16 23:04:13.315251] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.514 qpair failed and we were unable to recover it. 00:26:22.514 [2024-04-16 23:04:13.315362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.514 [2024-04-16 23:04:13.315500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.514 [2024-04-16 23:04:13.315527] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.514 qpair failed and we were unable to recover it. 00:26:22.514 [2024-04-16 23:04:13.315660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.514 [2024-04-16 23:04:13.315786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.514 [2024-04-16 23:04:13.315814] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.514 qpair failed and we were unable to recover it. 00:26:22.514 [2024-04-16 23:04:13.315942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.514 [2024-04-16 23:04:13.316136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.515 [2024-04-16 23:04:13.316161] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.515 qpair failed and we were unable to recover it. 00:26:22.515 [2024-04-16 23:04:13.316281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.515 [2024-04-16 23:04:13.316401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.515 [2024-04-16 23:04:13.316426] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.515 qpair failed and we were unable to recover it. 00:26:22.515 [2024-04-16 23:04:13.316568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.515 [2024-04-16 23:04:13.316727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.515 [2024-04-16 23:04:13.316754] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.515 qpair failed and we were unable to recover it. 00:26:22.515 [2024-04-16 23:04:13.316874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.515 [2024-04-16 23:04:13.316998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.515 [2024-04-16 23:04:13.317025] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.515 qpair failed and we were unable to recover it. 00:26:22.515 [2024-04-16 23:04:13.317198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.515 [2024-04-16 23:04:13.317377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.515 [2024-04-16 23:04:13.317405] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.515 qpair failed and we were unable to recover it. 00:26:22.515 [2024-04-16 23:04:13.317575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.515 [2024-04-16 23:04:13.317757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.515 [2024-04-16 23:04:13.317785] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.515 qpair failed and we were unable to recover it. 00:26:22.515 [2024-04-16 23:04:13.317938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.515 [2024-04-16 23:04:13.318092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.515 [2024-04-16 23:04:13.318120] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.515 qpair failed and we were unable to recover it. 00:26:22.515 [2024-04-16 23:04:13.318261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.515 [2024-04-16 23:04:13.319025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.515 [2024-04-16 23:04:13.319057] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.515 qpair failed and we were unable to recover it. 00:26:22.515 [2024-04-16 23:04:13.319245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.515 [2024-04-16 23:04:13.319358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.515 [2024-04-16 23:04:13.319384] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.515 qpair failed and we were unable to recover it. 00:26:22.515 [2024-04-16 23:04:13.319526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.515 [2024-04-16 23:04:13.319687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.515 [2024-04-16 23:04:13.319715] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.515 qpair failed and we were unable to recover it. 00:26:22.515 [2024-04-16 23:04:13.319875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.515 [2024-04-16 23:04:13.319998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.515 [2024-04-16 23:04:13.320028] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.515 qpair failed and we were unable to recover it. 00:26:22.515 [2024-04-16 23:04:13.320191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.515 [2024-04-16 23:04:13.320313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.515 [2024-04-16 23:04:13.320338] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.515 qpair failed and we were unable to recover it. 00:26:22.515 [2024-04-16 23:04:13.320475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.515 [2024-04-16 23:04:13.320586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.515 [2024-04-16 23:04:13.320611] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.515 qpair failed and we were unable to recover it. 00:26:22.515 [2024-04-16 23:04:13.320756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.515 [2024-04-16 23:04:13.320921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.515 [2024-04-16 23:04:13.320949] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.515 qpair failed and we were unable to recover it. 00:26:22.515 [2024-04-16 23:04:13.321113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.515 [2024-04-16 23:04:13.321227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.515 [2024-04-16 23:04:13.321252] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.515 qpair failed and we were unable to recover it. 00:26:22.515 [2024-04-16 23:04:13.321418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.515 [2024-04-16 23:04:13.321578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.515 [2024-04-16 23:04:13.321605] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.515 qpair failed and we were unable to recover it. 00:26:22.515 [2024-04-16 23:04:13.321726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.515 [2024-04-16 23:04:13.321872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.515 [2024-04-16 23:04:13.321900] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.515 qpair failed and we were unable to recover it. 00:26:22.515 [2024-04-16 23:04:13.322037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.515 [2024-04-16 23:04:13.322189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.515 [2024-04-16 23:04:13.322233] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.515 qpair failed and we were unable to recover it. 00:26:22.515 [2024-04-16 23:04:13.322375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.515 [2024-04-16 23:04:13.322514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.515 [2024-04-16 23:04:13.322539] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.515 qpair failed and we were unable to recover it. 00:26:22.515 [2024-04-16 23:04:13.322716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.515 [2024-04-16 23:04:13.322833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.515 [2024-04-16 23:04:13.322860] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.515 qpair failed and we were unable to recover it. 00:26:22.515 [2024-04-16 23:04:13.322997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.515 [2024-04-16 23:04:13.323125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.515 [2024-04-16 23:04:13.323152] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.515 qpair failed and we were unable to recover it. 00:26:22.515 [2024-04-16 23:04:13.323348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.515 [2024-04-16 23:04:13.323459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.515 [2024-04-16 23:04:13.323485] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.515 qpair failed and we were unable to recover it. 00:26:22.515 [2024-04-16 23:04:13.323599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.515 [2024-04-16 23:04:13.323819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.515 [2024-04-16 23:04:13.323847] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.515 qpair failed and we were unable to recover it. 00:26:22.515 [2024-04-16 23:04:13.324031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.515 [2024-04-16 23:04:13.324143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.515 [2024-04-16 23:04:13.324167] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.515 qpair failed and we were unable to recover it. 00:26:22.515 [2024-04-16 23:04:13.324293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.515 [2024-04-16 23:04:13.324464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.515 [2024-04-16 23:04:13.324490] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.515 qpair failed and we were unable to recover it. 00:26:22.515 [2024-04-16 23:04:13.324598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.515 [2024-04-16 23:04:13.324741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.515 [2024-04-16 23:04:13.324766] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.515 qpair failed and we were unable to recover it. 00:26:22.515 [2024-04-16 23:04:13.324965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.515 [2024-04-16 23:04:13.325119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.515 [2024-04-16 23:04:13.325162] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.515 qpair failed and we were unable to recover it. 00:26:22.515 [2024-04-16 23:04:13.325316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.515 [2024-04-16 23:04:13.325457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.515 [2024-04-16 23:04:13.325482] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.515 qpair failed and we were unable to recover it. 00:26:22.515 [2024-04-16 23:04:13.325594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.515 [2024-04-16 23:04:13.325701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.515 [2024-04-16 23:04:13.325726] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.515 qpair failed and we were unable to recover it. 00:26:22.515 [2024-04-16 23:04:13.325895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.516 [2024-04-16 23:04:13.326030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.516 [2024-04-16 23:04:13.326059] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.516 qpair failed and we were unable to recover it. 00:26:22.516 [2024-04-16 23:04:13.326250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.516 [2024-04-16 23:04:13.326360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.516 [2024-04-16 23:04:13.326385] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.516 qpair failed and we were unable to recover it. 00:26:22.516 [2024-04-16 23:04:13.326557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.516 [2024-04-16 23:04:13.326698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.516 [2024-04-16 23:04:13.326723] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.516 qpair failed and we were unable to recover it. 00:26:22.516 [2024-04-16 23:04:13.326862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.516 [2024-04-16 23:04:13.326995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.516 [2024-04-16 23:04:13.327025] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.516 qpair failed and we were unable to recover it. 00:26:22.516 [2024-04-16 23:04:13.327156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.516 [2024-04-16 23:04:13.327299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.516 [2024-04-16 23:04:13.327325] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.516 qpair failed and we were unable to recover it. 00:26:22.516 [2024-04-16 23:04:13.327435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.516 [2024-04-16 23:04:13.327600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.516 [2024-04-16 23:04:13.327628] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.516 qpair failed and we were unable to recover it. 00:26:22.516 [2024-04-16 23:04:13.327776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.516 [2024-04-16 23:04:13.327959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.516 [2024-04-16 23:04:13.327984] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.516 qpair failed and we were unable to recover it. 00:26:22.516 [2024-04-16 23:04:13.328091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.516 [2024-04-16 23:04:13.328229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.516 [2024-04-16 23:04:13.328255] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.516 qpair failed and we were unable to recover it. 00:26:22.516 [2024-04-16 23:04:13.328388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.516 [2024-04-16 23:04:13.328521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.516 [2024-04-16 23:04:13.328545] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.516 qpair failed and we were unable to recover it. 00:26:22.516 [2024-04-16 23:04:13.328687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.516 [2024-04-16 23:04:13.328819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.516 [2024-04-16 23:04:13.328844] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.516 qpair failed and we were unable to recover it. 00:26:22.516 [2024-04-16 23:04:13.328976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.516 [2024-04-16 23:04:13.329140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.516 [2024-04-16 23:04:13.329195] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.516 qpair failed and we were unable to recover it. 00:26:22.516 [2024-04-16 23:04:13.329323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.516 [2024-04-16 23:04:13.329432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.516 [2024-04-16 23:04:13.329457] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.516 qpair failed and we were unable to recover it. 00:26:22.516 [2024-04-16 23:04:13.329679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.516 [2024-04-16 23:04:13.329784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.516 [2024-04-16 23:04:13.329809] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.516 qpair failed and we were unable to recover it. 00:26:22.516 [2024-04-16 23:04:13.329930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.516 [2024-04-16 23:04:13.330046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.516 [2024-04-16 23:04:13.330071] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.516 qpair failed and we were unable to recover it. 00:26:22.516 [2024-04-16 23:04:13.330190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.516 [2024-04-16 23:04:13.330305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.516 [2024-04-16 23:04:13.330329] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.516 qpair failed and we were unable to recover it. 00:26:22.516 [2024-04-16 23:04:13.330502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.516 [2024-04-16 23:04:13.330737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.516 [2024-04-16 23:04:13.330764] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.516 qpair failed and we were unable to recover it. 00:26:22.516 [2024-04-16 23:04:13.330935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.516 [2024-04-16 23:04:13.331046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.516 [2024-04-16 23:04:13.331071] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.516 qpair failed and we were unable to recover it. 00:26:22.516 [2024-04-16 23:04:13.331228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.516 [2024-04-16 23:04:13.331368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.516 [2024-04-16 23:04:13.331392] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.516 qpair failed and we were unable to recover it. 00:26:22.516 [2024-04-16 23:04:13.331554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.516 [2024-04-16 23:04:13.331825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.516 [2024-04-16 23:04:13.331874] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.516 qpair failed and we were unable to recover it. 00:26:22.516 [2024-04-16 23:04:13.332116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.516 [2024-04-16 23:04:13.332272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.516 [2024-04-16 23:04:13.332297] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.516 qpair failed and we were unable to recover it. 00:26:22.516 [2024-04-16 23:04:13.332406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.516 [2024-04-16 23:04:13.332570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.516 [2024-04-16 23:04:13.332594] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.516 qpair failed and we were unable to recover it. 00:26:22.516 [2024-04-16 23:04:13.332719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.516 [2024-04-16 23:04:13.332906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.516 [2024-04-16 23:04:13.332934] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.516 qpair failed and we were unable to recover it. 00:26:22.516 [2024-04-16 23:04:13.333060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.516 [2024-04-16 23:04:13.333213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.516 [2024-04-16 23:04:13.333239] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.516 qpair failed and we were unable to recover it. 00:26:22.516 [2024-04-16 23:04:13.333379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.516 [2024-04-16 23:04:13.333535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.516 [2024-04-16 23:04:13.333584] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.516 qpair failed and we were unable to recover it. 00:26:22.516 [2024-04-16 23:04:13.333768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.516 [2024-04-16 23:04:13.333913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.516 [2024-04-16 23:04:13.333940] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.516 qpair failed and we were unable to recover it. 00:26:22.516 [2024-04-16 23:04:13.334124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.516 [2024-04-16 23:04:13.334263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.516 [2024-04-16 23:04:13.334289] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.516 qpair failed and we were unable to recover it. 00:26:22.516 [2024-04-16 23:04:13.334405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.516 [2024-04-16 23:04:13.334552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.516 [2024-04-16 23:04:13.334577] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.516 qpair failed and we were unable to recover it. 00:26:22.516 [2024-04-16 23:04:13.334799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.516 [2024-04-16 23:04:13.335000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.516 [2024-04-16 23:04:13.335027] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.516 qpair failed and we were unable to recover it. 00:26:22.516 [2024-04-16 23:04:13.335189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.516 [2024-04-16 23:04:13.335332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.516 [2024-04-16 23:04:13.335358] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.516 qpair failed and we were unable to recover it. 00:26:22.516 [2024-04-16 23:04:13.335489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.516 [2024-04-16 23:04:13.335721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.517 [2024-04-16 23:04:13.335748] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.517 qpair failed and we were unable to recover it. 00:26:22.517 [2024-04-16 23:04:13.335866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.517 [2024-04-16 23:04:13.336070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.517 [2024-04-16 23:04:13.336095] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.517 qpair failed and we were unable to recover it. 00:26:22.517 [2024-04-16 23:04:13.336220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.517 [2024-04-16 23:04:13.336367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.517 [2024-04-16 23:04:13.336392] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.517 qpair failed and we were unable to recover it. 00:26:22.517 [2024-04-16 23:04:13.336531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.517 [2024-04-16 23:04:13.336675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.517 [2024-04-16 23:04:13.336700] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.517 qpair failed and we were unable to recover it. 00:26:22.517 [2024-04-16 23:04:13.336839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.517 [2024-04-16 23:04:13.336953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.517 [2024-04-16 23:04:13.336978] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.517 qpair failed and we were unable to recover it. 00:26:22.517 [2024-04-16 23:04:13.337087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.517 [2024-04-16 23:04:13.337229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.517 [2024-04-16 23:04:13.337255] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.517 qpair failed and we were unable to recover it. 00:26:22.517 [2024-04-16 23:04:13.337371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.517 [2024-04-16 23:04:13.337482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.517 [2024-04-16 23:04:13.337507] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.517 qpair failed and we were unable to recover it. 00:26:22.517 [2024-04-16 23:04:13.337654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.517 [2024-04-16 23:04:13.337835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.517 [2024-04-16 23:04:13.337862] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.517 qpair failed and we were unable to recover it. 00:26:22.517 [2024-04-16 23:04:13.337987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.517 [2024-04-16 23:04:13.338151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.517 [2024-04-16 23:04:13.338183] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.517 qpair failed and we were unable to recover it. 00:26:22.517 [2024-04-16 23:04:13.338325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.517 [2024-04-16 23:04:13.338429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.517 [2024-04-16 23:04:13.338454] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.517 qpair failed and we were unable to recover it. 00:26:22.517 [2024-04-16 23:04:13.338622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.517 [2024-04-16 23:04:13.338759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.517 [2024-04-16 23:04:13.338784] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.517 qpair failed and we were unable to recover it. 00:26:22.517 [2024-04-16 23:04:13.338930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.517 [2024-04-16 23:04:13.339075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.517 [2024-04-16 23:04:13.339100] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.517 qpair failed and we were unable to recover it. 00:26:22.517 [2024-04-16 23:04:13.339245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.517 [2024-04-16 23:04:13.339382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.517 [2024-04-16 23:04:13.339406] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.517 qpair failed and we were unable to recover it. 00:26:22.517 [2024-04-16 23:04:13.339548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.517 [2024-04-16 23:04:13.339738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.517 [2024-04-16 23:04:13.339770] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.517 qpair failed and we were unable to recover it. 00:26:22.517 [2024-04-16 23:04:13.339943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.517 [2024-04-16 23:04:13.340090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.517 [2024-04-16 23:04:13.340117] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.517 qpair failed and we were unable to recover it. 00:26:22.517 [2024-04-16 23:04:13.340257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.517 [2024-04-16 23:04:13.340391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.517 [2024-04-16 23:04:13.340415] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.517 qpair failed and we were unable to recover it. 00:26:22.517 [2024-04-16 23:04:13.340557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.517 [2024-04-16 23:04:13.340741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.517 [2024-04-16 23:04:13.340791] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.517 qpair failed and we were unable to recover it. 00:26:22.517 [2024-04-16 23:04:13.340917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.517 [2024-04-16 23:04:13.341093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.517 [2024-04-16 23:04:13.341118] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.517 qpair failed and we were unable to recover it. 00:26:22.517 [2024-04-16 23:04:13.341258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.517 [2024-04-16 23:04:13.341377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.517 [2024-04-16 23:04:13.341402] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.517 qpair failed and we were unable to recover it. 00:26:22.517 [2024-04-16 23:04:13.341568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.517 [2024-04-16 23:04:13.341703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.517 [2024-04-16 23:04:13.341730] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.517 qpair failed and we were unable to recover it. 00:26:22.517 [2024-04-16 23:04:13.341897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.517 [2024-04-16 23:04:13.342016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.517 [2024-04-16 23:04:13.342041] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.517 qpair failed and we were unable to recover it. 00:26:22.517 [2024-04-16 23:04:13.342199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.517 [2024-04-16 23:04:13.342339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.517 [2024-04-16 23:04:13.342365] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.517 qpair failed and we were unable to recover it. 00:26:22.517 [2024-04-16 23:04:13.342523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.517 [2024-04-16 23:04:13.342655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.517 [2024-04-16 23:04:13.342680] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.517 qpair failed and we were unable to recover it. 00:26:22.517 [2024-04-16 23:04:13.342806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.517 [2024-04-16 23:04:13.342940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.517 [2024-04-16 23:04:13.342967] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.517 qpair failed and we were unable to recover it. 00:26:22.517 [2024-04-16 23:04:13.343100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.517 [2024-04-16 23:04:13.343218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.517 [2024-04-16 23:04:13.343244] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.517 qpair failed and we were unable to recover it. 00:26:22.517 [2024-04-16 23:04:13.343369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.517 [2024-04-16 23:04:13.343506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.517 [2024-04-16 23:04:13.343531] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.517 qpair failed and we were unable to recover it. 00:26:22.517 [2024-04-16 23:04:13.343647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.517 [2024-04-16 23:04:13.343839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.517 [2024-04-16 23:04:13.343867] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.517 qpair failed and we were unable to recover it. 00:26:22.517 [2024-04-16 23:04:13.344005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.517 [2024-04-16 23:04:13.344159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.517 [2024-04-16 23:04:13.344199] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.517 qpair failed and we were unable to recover it. 00:26:22.517 [2024-04-16 23:04:13.344354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.517 [2024-04-16 23:04:13.344500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.517 [2024-04-16 23:04:13.344547] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.517 qpair failed and we were unable to recover it. 00:26:22.518 [2024-04-16 23:04:13.344705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.518 [2024-04-16 23:04:13.344888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.518 [2024-04-16 23:04:13.344915] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.518 qpair failed and we were unable to recover it. 00:26:22.518 [2024-04-16 23:04:13.345045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.518 [2024-04-16 23:04:13.345248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.518 [2024-04-16 23:04:13.345274] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.518 qpair failed and we were unable to recover it. 00:26:22.518 [2024-04-16 23:04:13.345383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.518 [2024-04-16 23:04:13.345555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.518 [2024-04-16 23:04:13.345582] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.518 qpair failed and we were unable to recover it. 00:26:22.518 [2024-04-16 23:04:13.345709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.518 [2024-04-16 23:04:13.345860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.518 [2024-04-16 23:04:13.345888] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.518 qpair failed and we were unable to recover it. 00:26:22.518 [2024-04-16 23:04:13.346012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.518 [2024-04-16 23:04:13.346160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.518 [2024-04-16 23:04:13.346195] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.518 qpair failed and we were unable to recover it. 00:26:22.518 [2024-04-16 23:04:13.346362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.518 [2024-04-16 23:04:13.346496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.518 [2024-04-16 23:04:13.346521] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.518 qpair failed and we were unable to recover it. 00:26:22.518 [2024-04-16 23:04:13.346685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.518 [2024-04-16 23:04:13.346816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.518 [2024-04-16 23:04:13.346844] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.518 qpair failed and we were unable to recover it. 00:26:22.518 [2024-04-16 23:04:13.347035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.518 [2024-04-16 23:04:13.347185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.518 [2024-04-16 23:04:13.347212] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.518 qpair failed and we were unable to recover it. 00:26:22.518 [2024-04-16 23:04:13.347361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.518 [2024-04-16 23:04:13.347589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.518 [2024-04-16 23:04:13.347617] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.518 qpair failed and we were unable to recover it. 00:26:22.518 [2024-04-16 23:04:13.347784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.518 [2024-04-16 23:04:13.347928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.518 [2024-04-16 23:04:13.347955] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.518 qpair failed and we were unable to recover it. 00:26:22.518 [2024-04-16 23:04:13.348069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.518 [2024-04-16 23:04:13.348243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.518 [2024-04-16 23:04:13.348270] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.518 qpair failed and we were unable to recover it. 00:26:22.518 [2024-04-16 23:04:13.348442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.518 [2024-04-16 23:04:13.348638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.518 [2024-04-16 23:04:13.348666] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.518 qpair failed and we were unable to recover it. 00:26:22.518 [2024-04-16 23:04:13.348850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.518 [2024-04-16 23:04:13.348997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.518 [2024-04-16 23:04:13.349025] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.518 qpair failed and we were unable to recover it. 00:26:22.518 [2024-04-16 23:04:13.349196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.518 [2024-04-16 23:04:13.349349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.518 [2024-04-16 23:04:13.349375] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.518 qpair failed and we were unable to recover it. 00:26:22.518 [2024-04-16 23:04:13.349520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.518 [2024-04-16 23:04:13.349631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.518 [2024-04-16 23:04:13.349655] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.518 qpair failed and we were unable to recover it. 00:26:22.518 [2024-04-16 23:04:13.349806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.518 [2024-04-16 23:04:13.349935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.518 [2024-04-16 23:04:13.349962] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.518 qpair failed and we were unable to recover it. 00:26:22.518 [2024-04-16 23:04:13.350104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.518 [2024-04-16 23:04:13.350239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.518 [2024-04-16 23:04:13.350265] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.518 qpair failed and we were unable to recover it. 00:26:22.518 [2024-04-16 23:04:13.350405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.518 [2024-04-16 23:04:13.350555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.518 [2024-04-16 23:04:13.350598] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.518 qpair failed and we were unable to recover it. 00:26:22.518 [2024-04-16 23:04:13.350826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.518 [2024-04-16 23:04:13.351015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.518 [2024-04-16 23:04:13.351056] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.518 qpair failed and we were unable to recover it. 00:26:22.518 [2024-04-16 23:04:13.351255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.518 [2024-04-16 23:04:13.351396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.518 [2024-04-16 23:04:13.351421] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.518 qpair failed and we were unable to recover it. 00:26:22.518 [2024-04-16 23:04:13.351546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.518 [2024-04-16 23:04:13.351701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.518 [2024-04-16 23:04:13.351728] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.518 qpair failed and we were unable to recover it. 00:26:22.518 [2024-04-16 23:04:13.351903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.518 [2024-04-16 23:04:13.352087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.518 [2024-04-16 23:04:13.352115] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.518 qpair failed and we were unable to recover it. 00:26:22.518 [2024-04-16 23:04:13.352278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.518 [2024-04-16 23:04:13.352382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.518 [2024-04-16 23:04:13.352407] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.518 qpair failed and we were unable to recover it. 00:26:22.518 [2024-04-16 23:04:13.352598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.518 [2024-04-16 23:04:13.352824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.519 [2024-04-16 23:04:13.352875] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.519 qpair failed and we were unable to recover it. 00:26:22.519 [2024-04-16 23:04:13.353005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.519 [2024-04-16 23:04:13.353170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.519 [2024-04-16 23:04:13.353223] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.519 qpair failed and we were unable to recover it. 00:26:22.519 [2024-04-16 23:04:13.353359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.519 [2024-04-16 23:04:13.353486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.519 [2024-04-16 23:04:13.353511] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.519 qpair failed and we were unable to recover it. 00:26:22.519 [2024-04-16 23:04:13.353626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.519 [2024-04-16 23:04:13.353827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.519 [2024-04-16 23:04:13.353854] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.519 qpair failed and we were unable to recover it. 00:26:22.519 [2024-04-16 23:04:13.354038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.519 [2024-04-16 23:04:13.354188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.519 [2024-04-16 23:04:13.354239] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.519 qpair failed and we were unable to recover it. 00:26:22.519 [2024-04-16 23:04:13.354348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.519 [2024-04-16 23:04:13.354453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.519 [2024-04-16 23:04:13.354496] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.519 qpair failed and we were unable to recover it. 00:26:22.519 [2024-04-16 23:04:13.354670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.519 [2024-04-16 23:04:13.354808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.519 [2024-04-16 23:04:13.354854] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.519 qpair failed and we were unable to recover it. 00:26:22.519 [2024-04-16 23:04:13.355012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.519 [2024-04-16 23:04:13.355187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.519 [2024-04-16 23:04:13.355212] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.519 qpair failed and we were unable to recover it. 00:26:22.519 [2024-04-16 23:04:13.355383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.519 [2024-04-16 23:04:13.355536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.519 [2024-04-16 23:04:13.355568] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.519 qpair failed and we were unable to recover it. 00:26:22.519 [2024-04-16 23:04:13.355730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.519 [2024-04-16 23:04:13.355872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.519 [2024-04-16 23:04:13.355897] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.519 qpair failed and we were unable to recover it. 00:26:22.519 [2024-04-16 23:04:13.356060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.519 [2024-04-16 23:04:13.356207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.519 [2024-04-16 23:04:13.356250] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.519 qpair failed and we were unable to recover it. 00:26:22.519 [2024-04-16 23:04:13.356371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.519 [2024-04-16 23:04:13.356504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.519 [2024-04-16 23:04:13.356531] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.519 qpair failed and we were unable to recover it. 00:26:22.519 [2024-04-16 23:04:13.356702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.519 [2024-04-16 23:04:13.356897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.519 [2024-04-16 23:04:13.356925] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.519 qpair failed and we were unable to recover it. 00:26:22.519 [2024-04-16 23:04:13.357083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.519 [2024-04-16 23:04:13.357250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.519 [2024-04-16 23:04:13.357276] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.519 qpair failed and we were unable to recover it. 00:26:22.519 [2024-04-16 23:04:13.357384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.519 [2024-04-16 23:04:13.357499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.519 [2024-04-16 23:04:13.357523] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.519 qpair failed and we were unable to recover it. 00:26:22.519 [2024-04-16 23:04:13.357655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.519 [2024-04-16 23:04:13.357789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.519 [2024-04-16 23:04:13.357830] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.519 qpair failed and we were unable to recover it. 00:26:22.519 [2024-04-16 23:04:13.357947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.519 [2024-04-16 23:04:13.358101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.519 [2024-04-16 23:04:13.358129] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.519 qpair failed and we were unable to recover it. 00:26:22.519 [2024-04-16 23:04:13.358272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.519 [2024-04-16 23:04:13.358410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.519 [2024-04-16 23:04:13.358435] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.519 qpair failed and we were unable to recover it. 00:26:22.519 [2024-04-16 23:04:13.358571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.519 [2024-04-16 23:04:13.358785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.519 [2024-04-16 23:04:13.358832] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.519 qpair failed and we were unable to recover it. 00:26:22.519 [2024-04-16 23:04:13.358990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.519 [2024-04-16 23:04:13.359226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.519 [2024-04-16 23:04:13.359251] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.519 qpair failed and we were unable to recover it. 00:26:22.519 [2024-04-16 23:04:13.359378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.519 [2024-04-16 23:04:13.359542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.519 [2024-04-16 23:04:13.359569] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.519 qpair failed and we were unable to recover it. 00:26:22.519 [2024-04-16 23:04:13.359754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.519 [2024-04-16 23:04:13.359912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.519 [2024-04-16 23:04:13.359939] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.519 qpair failed and we were unable to recover it. 00:26:22.519 [2024-04-16 23:04:13.360172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.519 [2024-04-16 23:04:13.360355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.519 [2024-04-16 23:04:13.360380] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.519 qpair failed and we were unable to recover it. 00:26:22.519 [2024-04-16 23:04:13.360548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.519 [2024-04-16 23:04:13.360664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.519 [2024-04-16 23:04:13.360692] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.519 qpair failed and we were unable to recover it. 00:26:22.519 [2024-04-16 23:04:13.360900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.519 [2024-04-16 23:04:13.361038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.519 [2024-04-16 23:04:13.361066] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.519 qpair failed and we were unable to recover it. 00:26:22.519 [2024-04-16 23:04:13.361257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.519 [2024-04-16 23:04:13.361403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.519 [2024-04-16 23:04:13.361428] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.519 qpair failed and we were unable to recover it. 00:26:22.519 [2024-04-16 23:04:13.361569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.519 [2024-04-16 23:04:13.361695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.519 [2024-04-16 23:04:13.361728] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.519 qpair failed and we were unable to recover it. 00:26:22.519 [2024-04-16 23:04:13.361875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.519 [2024-04-16 23:04:13.362055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.519 [2024-04-16 23:04:13.362082] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.519 qpair failed and we were unable to recover it. 00:26:22.519 [2024-04-16 23:04:13.362248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.519 [2024-04-16 23:04:13.362358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.519 [2024-04-16 23:04:13.362385] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.519 qpair failed and we were unable to recover it. 00:26:22.519 [2024-04-16 23:04:13.362579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.519 [2024-04-16 23:04:13.362759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.520 [2024-04-16 23:04:13.362786] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.520 qpair failed and we were unable to recover it. 00:26:22.520 [2024-04-16 23:04:13.362993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.520 [2024-04-16 23:04:13.363181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.520 [2024-04-16 23:04:13.363225] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.520 qpair failed and we were unable to recover it. 00:26:22.520 [2024-04-16 23:04:13.363365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.520 [2024-04-16 23:04:13.363590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.520 [2024-04-16 23:04:13.363618] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.520 qpair failed and we were unable to recover it. 00:26:22.520 [2024-04-16 23:04:13.363880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.520 [2024-04-16 23:04:13.364095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.520 [2024-04-16 23:04:13.364122] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.520 qpair failed and we were unable to recover it. 00:26:22.520 [2024-04-16 23:04:13.364286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.520 [2024-04-16 23:04:13.364431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.520 [2024-04-16 23:04:13.364457] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.520 qpair failed and we were unable to recover it. 00:26:22.520 [2024-04-16 23:04:13.364590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.520 [2024-04-16 23:04:13.364732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.520 [2024-04-16 23:04:13.364773] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.520 qpair failed and we were unable to recover it. 00:26:22.520 [2024-04-16 23:04:13.364934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.520 [2024-04-16 23:04:13.365099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.520 [2024-04-16 23:04:13.365129] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.520 qpair failed and we were unable to recover it. 00:26:22.520 [2024-04-16 23:04:13.365295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.520 [2024-04-16 23:04:13.365442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.520 [2024-04-16 23:04:13.365492] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.520 qpair failed and we were unable to recover it. 00:26:22.520 [2024-04-16 23:04:13.365653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.520 [2024-04-16 23:04:13.365828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.520 [2024-04-16 23:04:13.365858] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.520 qpair failed and we were unable to recover it. 00:26:22.520 [2024-04-16 23:04:13.366084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.520 [2024-04-16 23:04:13.366253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.520 [2024-04-16 23:04:13.366278] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.520 qpair failed and we were unable to recover it. 00:26:22.520 [2024-04-16 23:04:13.366400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.520 [2024-04-16 23:04:13.366572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.520 [2024-04-16 23:04:13.366600] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.520 qpair failed and we were unable to recover it. 00:26:22.520 [2024-04-16 23:04:13.366761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.520 [2024-04-16 23:04:13.366929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.520 [2024-04-16 23:04:13.366969] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.520 qpair failed and we were unable to recover it. 00:26:22.520 [2024-04-16 23:04:13.367124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.520 [2024-04-16 23:04:13.367290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.520 [2024-04-16 23:04:13.367316] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.520 qpair failed and we were unable to recover it. 00:26:22.520 [2024-04-16 23:04:13.367422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.520 [2024-04-16 23:04:13.367564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.520 [2024-04-16 23:04:13.367589] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.520 qpair failed and we were unable to recover it. 00:26:22.520 [2024-04-16 23:04:13.367745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.520 [2024-04-16 23:04:13.367895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.520 [2024-04-16 23:04:13.367922] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.520 qpair failed and we were unable to recover it. 00:26:22.520 [2024-04-16 23:04:13.368151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.520 [2024-04-16 23:04:13.368323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.520 [2024-04-16 23:04:13.368349] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.520 qpair failed and we were unable to recover it. 00:26:22.520 [2024-04-16 23:04:13.368513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.520 [2024-04-16 23:04:13.368659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.520 [2024-04-16 23:04:13.368687] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.520 qpair failed and we were unable to recover it. 00:26:22.520 [2024-04-16 23:04:13.368860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.520 [2024-04-16 23:04:13.369005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.520 [2024-04-16 23:04:13.369033] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.520 qpair failed and we were unable to recover it. 00:26:22.520 [2024-04-16 23:04:13.369224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.520 [2024-04-16 23:04:13.369445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.520 [2024-04-16 23:04:13.369486] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.520 qpair failed and we were unable to recover it. 00:26:22.520 [2024-04-16 23:04:13.369679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.520 [2024-04-16 23:04:13.369922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.520 [2024-04-16 23:04:13.369947] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.520 qpair failed and we were unable to recover it. 00:26:22.520 [2024-04-16 23:04:13.370118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.520 [2024-04-16 23:04:13.370289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.520 [2024-04-16 23:04:13.370315] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.520 qpair failed and we were unable to recover it. 00:26:22.520 [2024-04-16 23:04:13.370431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.520 [2024-04-16 23:04:13.370570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.520 [2024-04-16 23:04:13.370595] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.520 qpair failed and we were unable to recover it. 00:26:22.520 [2024-04-16 23:04:13.370733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.520 [2024-04-16 23:04:13.370903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.520 [2024-04-16 23:04:13.370927] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.520 qpair failed and we were unable to recover it. 00:26:22.520 [2024-04-16 23:04:13.371047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.520 [2024-04-16 23:04:13.371234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.520 [2024-04-16 23:04:13.371263] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.520 qpair failed and we were unable to recover it. 00:26:22.520 [2024-04-16 23:04:13.371418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.520 [2024-04-16 23:04:13.371608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.520 [2024-04-16 23:04:13.371633] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.520 qpair failed and we were unable to recover it. 00:26:22.520 [2024-04-16 23:04:13.371800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.520 [2024-04-16 23:04:13.371910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.520 [2024-04-16 23:04:13.371951] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.520 qpair failed and we were unable to recover it. 00:26:22.520 [2024-04-16 23:04:13.372120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.520 [2024-04-16 23:04:13.372257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.520 [2024-04-16 23:04:13.372282] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.520 qpair failed and we were unable to recover it. 00:26:22.520 [2024-04-16 23:04:13.372416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.520 [2024-04-16 23:04:13.372582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.520 [2024-04-16 23:04:13.372608] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.520 qpair failed and we were unable to recover it. 00:26:22.520 [2024-04-16 23:04:13.372848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.520 [2024-04-16 23:04:13.373004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.520 [2024-04-16 23:04:13.373031] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.520 qpair failed and we were unable to recover it. 00:26:22.520 [2024-04-16 23:04:13.373202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.520 [2024-04-16 23:04:13.373321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.520 [2024-04-16 23:04:13.373346] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.521 qpair failed and we were unable to recover it. 00:26:22.521 [2024-04-16 23:04:13.373485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.521 [2024-04-16 23:04:13.373599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.521 [2024-04-16 23:04:13.373624] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.521 qpair failed and we were unable to recover it. 00:26:22.521 [2024-04-16 23:04:13.373741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.521 [2024-04-16 23:04:13.373881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.521 [2024-04-16 23:04:13.373905] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.521 qpair failed and we were unable to recover it. 00:26:22.521 [2024-04-16 23:04:13.374068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.521 [2024-04-16 23:04:13.374226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.521 [2024-04-16 23:04:13.374254] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.521 qpair failed and we were unable to recover it. 00:26:22.521 [2024-04-16 23:04:13.374397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.521 [2024-04-16 23:04:13.374566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.521 [2024-04-16 23:04:13.374592] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.521 qpair failed and we were unable to recover it. 00:26:22.521 [2024-04-16 23:04:13.374755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.521 [2024-04-16 23:04:13.374905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.521 [2024-04-16 23:04:13.374932] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.521 qpair failed and we were unable to recover it. 00:26:22.521 [2024-04-16 23:04:13.375092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.521 [2024-04-16 23:04:13.375203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.521 [2024-04-16 23:04:13.375241] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.521 qpair failed and we were unable to recover it. 00:26:22.521 [2024-04-16 23:04:13.375483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.521 [2024-04-16 23:04:13.375633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.521 [2024-04-16 23:04:13.375691] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.521 qpair failed and we were unable to recover it. 00:26:22.521 [2024-04-16 23:04:13.375824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.521 [2024-04-16 23:04:13.375990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.521 [2024-04-16 23:04:13.376015] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.521 qpair failed and we were unable to recover it. 00:26:22.521 [2024-04-16 23:04:13.376184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.521 [2024-04-16 23:04:13.376386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.521 [2024-04-16 23:04:13.376412] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.521 qpair failed and we were unable to recover it. 00:26:22.521 [2024-04-16 23:04:13.376602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.521 [2024-04-16 23:04:13.376728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.521 [2024-04-16 23:04:13.376755] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.521 qpair failed and we were unable to recover it. 00:26:22.521 [2024-04-16 23:04:13.376946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.521 [2024-04-16 23:04:13.377062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.521 [2024-04-16 23:04:13.377087] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.521 qpair failed and we were unable to recover it. 00:26:22.521 [2024-04-16 23:04:13.377263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.521 [2024-04-16 23:04:13.377384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.521 [2024-04-16 23:04:13.377408] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.521 qpair failed and we were unable to recover it. 00:26:22.521 [2024-04-16 23:04:13.377511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.521 [2024-04-16 23:04:13.377654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.521 [2024-04-16 23:04:13.377678] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.521 qpair failed and we were unable to recover it. 00:26:22.521 [2024-04-16 23:04:13.377828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.521 [2024-04-16 23:04:13.377988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.521 [2024-04-16 23:04:13.378013] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.521 qpair failed and we were unable to recover it. 00:26:22.521 [2024-04-16 23:04:13.378151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.521 [2024-04-16 23:04:13.378299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.521 [2024-04-16 23:04:13.378328] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.521 qpair failed and we were unable to recover it. 00:26:22.521 [2024-04-16 23:04:13.378552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.521 [2024-04-16 23:04:13.378687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.521 [2024-04-16 23:04:13.378712] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.521 qpair failed and we were unable to recover it. 00:26:22.521 [2024-04-16 23:04:13.378853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.521 [2024-04-16 23:04:13.379051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.521 [2024-04-16 23:04:13.379076] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.521 qpair failed and we were unable to recover it. 00:26:22.521 [2024-04-16 23:04:13.379232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.521 [2024-04-16 23:04:13.379428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.521 [2024-04-16 23:04:13.379453] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.521 qpair failed and we were unable to recover it. 00:26:22.521 [2024-04-16 23:04:13.379605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.521 [2024-04-16 23:04:13.379744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.521 [2024-04-16 23:04:13.379772] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.521 qpair failed and we were unable to recover it. 00:26:22.521 [2024-04-16 23:04:13.379905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.521 [2024-04-16 23:04:13.380022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.521 [2024-04-16 23:04:13.380047] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.521 qpair failed and we were unable to recover it. 00:26:22.521 [2024-04-16 23:04:13.380156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.521 [2024-04-16 23:04:13.380283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.521 [2024-04-16 23:04:13.380309] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.521 qpair failed and we were unable to recover it. 00:26:22.521 [2024-04-16 23:04:13.380501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.521 [2024-04-16 23:04:13.380628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.521 [2024-04-16 23:04:13.380655] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.521 qpair failed and we were unable to recover it. 00:26:22.521 [2024-04-16 23:04:13.380845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.521 [2024-04-16 23:04:13.381072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.521 [2024-04-16 23:04:13.381099] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.521 qpair failed and we were unable to recover it. 00:26:22.521 [2024-04-16 23:04:13.381263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.521 [2024-04-16 23:04:13.381401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.521 [2024-04-16 23:04:13.381442] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.521 qpair failed and we were unable to recover it. 00:26:22.521 [2024-04-16 23:04:13.381602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.521 [2024-04-16 23:04:13.381768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.521 [2024-04-16 23:04:13.381793] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.521 qpair failed and we were unable to recover it. 00:26:22.521 [2024-04-16 23:04:13.381926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.521 [2024-04-16 23:04:13.382111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.521 [2024-04-16 23:04:13.382139] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.521 qpair failed and we were unable to recover it. 00:26:22.521 [2024-04-16 23:04:13.382287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.521 [2024-04-16 23:04:13.382404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.521 [2024-04-16 23:04:13.382429] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.521 qpair failed and we were unable to recover it. 00:26:22.521 [2024-04-16 23:04:13.382597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.521 [2024-04-16 23:04:13.382746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.521 [2024-04-16 23:04:13.382773] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.521 qpair failed and we were unable to recover it. 00:26:22.521 [2024-04-16 23:04:13.382925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.521 [2024-04-16 23:04:13.383070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.521 [2024-04-16 23:04:13.383102] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.521 qpair failed and we were unable to recover it. 00:26:22.522 [2024-04-16 23:04:13.383250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.522 [2024-04-16 23:04:13.383380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.522 [2024-04-16 23:04:13.383408] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.522 qpair failed and we were unable to recover it. 00:26:22.522 [2024-04-16 23:04:13.383532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.522 [2024-04-16 23:04:13.383679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.522 [2024-04-16 23:04:13.383707] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.522 qpair failed and we were unable to recover it. 00:26:22.522 [2024-04-16 23:04:13.383864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.522 [2024-04-16 23:04:13.384100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.522 [2024-04-16 23:04:13.384127] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.522 qpair failed and we were unable to recover it. 00:26:22.522 [2024-04-16 23:04:13.384250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.522 [2024-04-16 23:04:13.384371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.522 [2024-04-16 23:04:13.384399] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.522 qpair failed and we were unable to recover it. 00:26:22.522 [2024-04-16 23:04:13.384563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.522 [2024-04-16 23:04:13.384787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.522 [2024-04-16 23:04:13.384839] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.522 qpair failed and we were unable to recover it. 00:26:22.522 [2024-04-16 23:04:13.384993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.522 [2024-04-16 23:04:13.385223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.522 [2024-04-16 23:04:13.385251] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.522 qpair failed and we were unable to recover it. 00:26:22.522 [2024-04-16 23:04:13.385418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.522 [2024-04-16 23:04:13.385560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.522 [2024-04-16 23:04:13.385602] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.522 qpair failed and we were unable to recover it. 00:26:22.522 [2024-04-16 23:04:13.385735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.522 [2024-04-16 23:04:13.385880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.522 [2024-04-16 23:04:13.385908] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.522 qpair failed and we were unable to recover it. 00:26:22.522 [2024-04-16 23:04:13.386041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.522 [2024-04-16 23:04:13.386188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.522 [2024-04-16 23:04:13.386217] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.522 qpair failed and we were unable to recover it. 00:26:22.522 [2024-04-16 23:04:13.386338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.522 [2024-04-16 23:04:13.386468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.522 [2024-04-16 23:04:13.386495] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.522 qpair failed and we were unable to recover it. 00:26:22.522 [2024-04-16 23:04:13.386656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.522 [2024-04-16 23:04:13.386769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.522 [2024-04-16 23:04:13.386795] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.522 qpair failed and we were unable to recover it. 00:26:22.522 [2024-04-16 23:04:13.386942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.522 [2024-04-16 23:04:13.387061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.522 [2024-04-16 23:04:13.387088] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.522 qpair failed and we were unable to recover it. 00:26:22.522 [2024-04-16 23:04:13.387240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.522 [2024-04-16 23:04:13.387396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.522 [2024-04-16 23:04:13.387423] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.522 qpair failed and we were unable to recover it. 00:26:22.522 [2024-04-16 23:04:13.387572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.522 [2024-04-16 23:04:13.387694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.522 [2024-04-16 23:04:13.387723] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.522 qpair failed and we were unable to recover it. 00:26:22.522 [2024-04-16 23:04:13.387867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.522 [2024-04-16 23:04:13.387975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.522 [2024-04-16 23:04:13.388001] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.522 qpair failed and we were unable to recover it. 00:26:22.522 [2024-04-16 23:04:13.388173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.522 [2024-04-16 23:04:13.388310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.522 [2024-04-16 23:04:13.388338] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.522 qpair failed and we were unable to recover it. 00:26:22.522 [2024-04-16 23:04:13.388462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.522 [2024-04-16 23:04:13.388588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.522 [2024-04-16 23:04:13.388615] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.522 qpair failed and we were unable to recover it. 00:26:22.522 [2024-04-16 23:04:13.388763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.522 [2024-04-16 23:04:13.388893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.522 [2024-04-16 23:04:13.388920] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.522 qpair failed and we were unable to recover it. 00:26:22.522 [2024-04-16 23:04:13.389052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.522 [2024-04-16 23:04:13.389199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.522 [2024-04-16 23:04:13.389225] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.522 qpair failed and we were unable to recover it. 00:26:22.522 [2024-04-16 23:04:13.389402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.522 [2024-04-16 23:04:13.389553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.522 [2024-04-16 23:04:13.389580] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.522 qpair failed and we were unable to recover it. 00:26:22.522 [2024-04-16 23:04:13.389814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.522 [2024-04-16 23:04:13.389934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.522 [2024-04-16 23:04:13.389962] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.522 qpair failed and we were unable to recover it. 00:26:22.522 [2024-04-16 23:04:13.390082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.522 [2024-04-16 23:04:13.390233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.522 [2024-04-16 23:04:13.390261] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.522 qpair failed and we were unable to recover it. 00:26:22.522 [2024-04-16 23:04:13.390399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.522 [2024-04-16 23:04:13.390569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.522 [2024-04-16 23:04:13.390594] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.522 qpair failed and we were unable to recover it. 00:26:22.522 [2024-04-16 23:04:13.390700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.522 [2024-04-16 23:04:13.390806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.522 [2024-04-16 23:04:13.390831] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.522 qpair failed and we were unable to recover it. 00:26:22.522 [2024-04-16 23:04:13.390971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.522 [2024-04-16 23:04:13.391137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.522 [2024-04-16 23:04:13.391162] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.522 qpair failed and we were unable to recover it. 00:26:22.522 [2024-04-16 23:04:13.391294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.522 [2024-04-16 23:04:13.391429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.522 [2024-04-16 23:04:13.391456] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.522 qpair failed and we were unable to recover it. 00:26:22.522 [2024-04-16 23:04:13.391614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.522 [2024-04-16 23:04:13.391759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.522 [2024-04-16 23:04:13.391799] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.522 qpair failed and we were unable to recover it. 00:26:22.522 [2024-04-16 23:04:13.391924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.522 [2024-04-16 23:04:13.392077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.522 [2024-04-16 23:04:13.392105] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.522 qpair failed and we were unable to recover it. 00:26:22.522 [2024-04-16 23:04:13.392227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.522 [2024-04-16 23:04:13.392417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.522 [2024-04-16 23:04:13.392441] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.522 qpair failed and we were unable to recover it. 00:26:22.522 [2024-04-16 23:04:13.392617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.523 [2024-04-16 23:04:13.392743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.523 [2024-04-16 23:04:13.392771] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.523 qpair failed and we were unable to recover it. 00:26:22.523 [2024-04-16 23:04:13.392940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.523 [2024-04-16 23:04:13.393079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.523 [2024-04-16 23:04:13.393104] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.523 qpair failed and we were unable to recover it. 00:26:22.523 [2024-04-16 23:04:13.393236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.523 [2024-04-16 23:04:13.393405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.523 [2024-04-16 23:04:13.393445] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.523 qpair failed and we were unable to recover it. 00:26:22.523 [2024-04-16 23:04:13.393739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.523 [2024-04-16 23:04:13.393966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.523 [2024-04-16 23:04:13.393993] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.523 qpair failed and we were unable to recover it. 00:26:22.523 [2024-04-16 23:04:13.394116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.523 [2024-04-16 23:04:13.394314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.523 [2024-04-16 23:04:13.394339] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.523 qpair failed and we were unable to recover it. 00:26:22.523 [2024-04-16 23:04:13.394450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.523 [2024-04-16 23:04:13.394586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.523 [2024-04-16 23:04:13.394610] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.523 qpair failed and we were unable to recover it. 00:26:22.523 [2024-04-16 23:04:13.394775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.523 [2024-04-16 23:04:13.394942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.523 [2024-04-16 23:04:13.394967] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.523 qpair failed and we were unable to recover it. 00:26:22.523 [2024-04-16 23:04:13.395110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.523 [2024-04-16 23:04:13.395278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.523 [2024-04-16 23:04:13.395304] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.523 qpair failed and we were unable to recover it. 00:26:22.523 [2024-04-16 23:04:13.395441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.523 [2024-04-16 23:04:13.395548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.523 [2024-04-16 23:04:13.395574] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.523 qpair failed and we were unable to recover it. 00:26:22.523 [2024-04-16 23:04:13.395714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.523 [2024-04-16 23:04:13.395899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.523 [2024-04-16 23:04:13.395927] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.523 qpair failed and we were unable to recover it. 00:26:22.523 [2024-04-16 23:04:13.396076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.523 [2024-04-16 23:04:13.396187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.523 [2024-04-16 23:04:13.396213] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.523 qpair failed and we were unable to recover it. 00:26:22.523 [2024-04-16 23:04:13.396333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.523 [2024-04-16 23:04:13.396469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.523 [2024-04-16 23:04:13.396497] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.523 qpair failed and we were unable to recover it. 00:26:22.523 [2024-04-16 23:04:13.396669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.523 [2024-04-16 23:04:13.396807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.523 [2024-04-16 23:04:13.396831] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.523 qpair failed and we were unable to recover it. 00:26:22.523 [2024-04-16 23:04:13.396938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.523 [2024-04-16 23:04:13.397050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.523 [2024-04-16 23:04:13.397076] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.523 qpair failed and we were unable to recover it. 00:26:22.523 [2024-04-16 23:04:13.397228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.523 [2024-04-16 23:04:13.397369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.523 [2024-04-16 23:04:13.397394] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.523 qpair failed and we were unable to recover it. 00:26:22.523 [2024-04-16 23:04:13.397525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.523 [2024-04-16 23:04:13.397717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.523 [2024-04-16 23:04:13.397742] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.523 qpair failed and we were unable to recover it. 00:26:22.523 [2024-04-16 23:04:13.397882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.523 [2024-04-16 23:04:13.398001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.523 [2024-04-16 23:04:13.398028] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.523 qpair failed and we were unable to recover it. 00:26:22.523 [2024-04-16 23:04:13.398222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.523 [2024-04-16 23:04:13.398332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.523 [2024-04-16 23:04:13.398356] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.523 qpair failed and we were unable to recover it. 00:26:22.523 [2024-04-16 23:04:13.398498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.523 [2024-04-16 23:04:13.398662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.523 [2024-04-16 23:04:13.398690] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.523 qpair failed and we were unable to recover it. 00:26:22.523 [2024-04-16 23:04:13.398839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.523 [2024-04-16 23:04:13.399032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.523 [2024-04-16 23:04:13.399057] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.523 qpair failed and we were unable to recover it. 00:26:22.523 [2024-04-16 23:04:13.399166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.523 [2024-04-16 23:04:13.399295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.523 [2024-04-16 23:04:13.399320] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.523 qpair failed and we were unable to recover it. 00:26:22.523 [2024-04-16 23:04:13.399492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.523 [2024-04-16 23:04:13.399730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.523 [2024-04-16 23:04:13.399762] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.523 qpair failed and we were unable to recover it. 00:26:22.523 [2024-04-16 23:04:13.399955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.523 [2024-04-16 23:04:13.400128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.523 [2024-04-16 23:04:13.400152] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.523 qpair failed and we were unable to recover it. 00:26:22.523 [2024-04-16 23:04:13.400300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.523 [2024-04-16 23:04:13.400449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.523 [2024-04-16 23:04:13.400476] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.523 qpair failed and we were unable to recover it. 00:26:22.523 [2024-04-16 23:04:13.400592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.523 [2024-04-16 23:04:13.400709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.523 [2024-04-16 23:04:13.400738] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.523 qpair failed and we were unable to recover it. 00:26:22.523 [2024-04-16 23:04:13.400908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.524 [2024-04-16 23:04:13.401051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.524 [2024-04-16 23:04:13.401076] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.524 qpair failed and we were unable to recover it. 00:26:22.524 [2024-04-16 23:04:13.401210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.524 [2024-04-16 23:04:13.401365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.524 [2024-04-16 23:04:13.401393] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.524 qpair failed and we were unable to recover it. 00:26:22.524 [2024-04-16 23:04:13.401512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.524 [2024-04-16 23:04:13.401628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.524 [2024-04-16 23:04:13.401656] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.524 qpair failed and we were unable to recover it. 00:26:22.524 [2024-04-16 23:04:13.401771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.524 [2024-04-16 23:04:13.401959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.524 [2024-04-16 23:04:13.401987] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.524 qpair failed and we were unable to recover it. 00:26:22.524 [2024-04-16 23:04:13.402143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.524 [2024-04-16 23:04:13.402292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.524 [2024-04-16 23:04:13.402333] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.524 qpair failed and we were unable to recover it. 00:26:22.524 [2024-04-16 23:04:13.402525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.524 [2024-04-16 23:04:13.402650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.524 [2024-04-16 23:04:13.402677] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.524 qpair failed and we were unable to recover it. 00:26:22.524 [2024-04-16 23:04:13.402807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.524 [2024-04-16 23:04:13.402968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.524 [2024-04-16 23:04:13.402993] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.524 qpair failed and we were unable to recover it. 00:26:22.524 [2024-04-16 23:04:13.403138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.524 [2024-04-16 23:04:13.403307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.524 [2024-04-16 23:04:13.403336] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.524 qpair failed and we were unable to recover it. 00:26:22.524 [2024-04-16 23:04:13.403500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.524 [2024-04-16 23:04:13.403642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.524 [2024-04-16 23:04:13.403682] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.524 qpair failed and we were unable to recover it. 00:26:22.524 [2024-04-16 23:04:13.403913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.524 [2024-04-16 23:04:13.404090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.524 [2024-04-16 23:04:13.404118] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.524 qpair failed and we were unable to recover it. 00:26:22.524 [2024-04-16 23:04:13.404315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.524 [2024-04-16 23:04:13.404453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.524 [2024-04-16 23:04:13.404481] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.524 qpair failed and we were unable to recover it. 00:26:22.524 [2024-04-16 23:04:13.404664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.524 [2024-04-16 23:04:13.404838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.524 [2024-04-16 23:04:13.404889] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.524 qpair failed and we were unable to recover it. 00:26:22.524 [2024-04-16 23:04:13.405023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.524 [2024-04-16 23:04:13.405166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.524 [2024-04-16 23:04:13.405225] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.524 qpair failed and we were unable to recover it. 00:26:22.524 [2024-04-16 23:04:13.405389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.524 [2024-04-16 23:04:13.405501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.524 [2024-04-16 23:04:13.405525] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.524 qpair failed and we were unable to recover it. 00:26:22.524 [2024-04-16 23:04:13.405668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.524 [2024-04-16 23:04:13.405792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.524 [2024-04-16 23:04:13.405819] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.524 qpair failed and we were unable to recover it. 00:26:22.524 [2024-04-16 23:04:13.405940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.524 [2024-04-16 23:04:13.406068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.524 [2024-04-16 23:04:13.406095] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.524 qpair failed and we were unable to recover it. 00:26:22.524 [2024-04-16 23:04:13.406258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.524 [2024-04-16 23:04:13.406403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.524 [2024-04-16 23:04:13.406442] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.524 qpair failed and we were unable to recover it. 00:26:22.524 [2024-04-16 23:04:13.406608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.524 [2024-04-16 23:04:13.406756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.524 [2024-04-16 23:04:13.406783] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.524 qpair failed and we were unable to recover it. 00:26:22.524 [2024-04-16 23:04:13.406902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.524 [2024-04-16 23:04:13.407017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.524 [2024-04-16 23:04:13.407045] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.524 qpair failed and we were unable to recover it. 00:26:22.524 [2024-04-16 23:04:13.407210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.524 [2024-04-16 23:04:13.407335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.524 [2024-04-16 23:04:13.407362] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.524 qpair failed and we were unable to recover it. 00:26:22.524 [2024-04-16 23:04:13.407548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.524 [2024-04-16 23:04:13.407741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.524 [2024-04-16 23:04:13.407769] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.524 qpair failed and we were unable to recover it. 00:26:22.524 [2024-04-16 23:04:13.407896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.524 [2024-04-16 23:04:13.408053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.524 [2024-04-16 23:04:13.408081] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.524 qpair failed and we were unable to recover it. 00:26:22.524 [2024-04-16 23:04:13.408231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.524 [2024-04-16 23:04:13.408382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.524 [2024-04-16 23:04:13.408410] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.524 qpair failed and we were unable to recover it. 00:26:22.524 [2024-04-16 23:04:13.408532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.524 [2024-04-16 23:04:13.408658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.524 [2024-04-16 23:04:13.408686] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.524 qpair failed and we were unable to recover it. 00:26:22.524 [2024-04-16 23:04:13.408843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.524 [2024-04-16 23:04:13.408952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.524 [2024-04-16 23:04:13.408978] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.524 qpair failed and we were unable to recover it. 00:26:22.524 [2024-04-16 23:04:13.409172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.524 [2024-04-16 23:04:13.409335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.524 [2024-04-16 23:04:13.409360] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.524 qpair failed and we were unable to recover it. 00:26:22.524 [2024-04-16 23:04:13.409523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.524 [2024-04-16 23:04:13.409690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.524 [2024-04-16 23:04:13.409717] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.524 qpair failed and we were unable to recover it. 00:26:22.524 [2024-04-16 23:04:13.409868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.524 [2024-04-16 23:04:13.410047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.524 [2024-04-16 23:04:13.410074] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.524 qpair failed and we were unable to recover it. 00:26:22.524 [2024-04-16 23:04:13.410258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.524 [2024-04-16 23:04:13.410448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.524 [2024-04-16 23:04:13.410475] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.524 qpair failed and we were unable to recover it. 00:26:22.524 [2024-04-16 23:04:13.410608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.524 [2024-04-16 23:04:13.410792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.525 [2024-04-16 23:04:13.410817] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.525 qpair failed and we were unable to recover it. 00:26:22.525 [2024-04-16 23:04:13.410935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.525 [2024-04-16 23:04:13.411127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.525 [2024-04-16 23:04:13.411152] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.525 qpair failed and we were unable to recover it. 00:26:22.525 [2024-04-16 23:04:13.411326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.525 [2024-04-16 23:04:13.411444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.525 [2024-04-16 23:04:13.411485] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.525 qpair failed and we were unable to recover it. 00:26:22.525 [2024-04-16 23:04:13.411615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.525 [2024-04-16 23:04:13.411750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.525 [2024-04-16 23:04:13.411774] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.525 qpair failed and we were unable to recover it. 00:26:22.525 [2024-04-16 23:04:13.411966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.525 [2024-04-16 23:04:13.412081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.525 [2024-04-16 23:04:13.412106] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.525 qpair failed and we were unable to recover it. 00:26:22.525 [2024-04-16 23:04:13.412312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.525 [2024-04-16 23:04:13.412459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.525 [2024-04-16 23:04:13.412499] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.525 qpair failed and we were unable to recover it. 00:26:22.525 [2024-04-16 23:04:13.412658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.525 [2024-04-16 23:04:13.412845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.525 [2024-04-16 23:04:13.412870] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.525 qpair failed and we were unable to recover it. 00:26:22.525 [2024-04-16 23:04:13.413008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.525 [2024-04-16 23:04:13.413111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.525 [2024-04-16 23:04:13.413136] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.525 qpair failed and we were unable to recover it. 00:26:22.525 [2024-04-16 23:04:13.413257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.525 [2024-04-16 23:04:13.413382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.525 [2024-04-16 23:04:13.413407] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.525 qpair failed and we were unable to recover it. 00:26:22.525 [2024-04-16 23:04:13.413574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.525 [2024-04-16 23:04:13.413718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.525 [2024-04-16 23:04:13.413744] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.525 qpair failed and we were unable to recover it. 00:26:22.525 [2024-04-16 23:04:13.413890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.525 [2024-04-16 23:04:13.414059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.525 [2024-04-16 23:04:13.414083] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.525 qpair failed and we were unable to recover it. 00:26:22.525 [2024-04-16 23:04:13.414226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.525 [2024-04-16 23:04:13.414339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.525 [2024-04-16 23:04:13.414364] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.525 qpair failed and we were unable to recover it. 00:26:22.525 [2024-04-16 23:04:13.414546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.525 [2024-04-16 23:04:13.414655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.525 [2024-04-16 23:04:13.414679] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.525 qpair failed and we were unable to recover it. 00:26:22.525 [2024-04-16 23:04:13.414800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.525 [2024-04-16 23:04:13.414979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.525 [2024-04-16 23:04:13.415007] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.525 qpair failed and we were unable to recover it. 00:26:22.525 [2024-04-16 23:04:13.415200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.525 [2024-04-16 23:04:13.415315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.525 [2024-04-16 23:04:13.415341] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.525 qpair failed and we were unable to recover it. 00:26:22.525 [2024-04-16 23:04:13.415502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.525 [2024-04-16 23:04:13.415641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.525 [2024-04-16 23:04:13.415666] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.525 qpair failed and we were unable to recover it. 00:26:22.525 [2024-04-16 23:04:13.415820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.525 [2024-04-16 23:04:13.415953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.525 [2024-04-16 23:04:13.415982] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.525 qpair failed and we were unable to recover it. 00:26:22.525 [2024-04-16 23:04:13.416167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.525 [2024-04-16 23:04:13.416343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.525 [2024-04-16 23:04:13.416369] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.525 qpair failed and we were unable to recover it. 00:26:22.525 [2024-04-16 23:04:13.416475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.525 [2024-04-16 23:04:13.416600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.525 [2024-04-16 23:04:13.416629] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.525 qpair failed and we were unable to recover it. 00:26:22.525 [2024-04-16 23:04:13.416772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.525 [2024-04-16 23:04:13.416914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.525 [2024-04-16 23:04:13.416939] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.525 qpair failed and we were unable to recover it. 00:26:22.525 [2024-04-16 23:04:13.417074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.525 [2024-04-16 23:04:13.417296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.525 [2024-04-16 23:04:13.417321] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.525 qpair failed and we were unable to recover it. 00:26:22.525 [2024-04-16 23:04:13.417436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.525 [2024-04-16 23:04:13.417557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.525 [2024-04-16 23:04:13.417582] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.525 qpair failed and we were unable to recover it. 00:26:22.525 [2024-04-16 23:04:13.417765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.525 [2024-04-16 23:04:13.417899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.525 [2024-04-16 23:04:13.417924] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.525 qpair failed and we were unable to recover it. 00:26:22.525 [2024-04-16 23:04:13.418060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.525 [2024-04-16 23:04:13.418184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.525 [2024-04-16 23:04:13.418210] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.525 qpair failed and we were unable to recover it. 00:26:22.525 [2024-04-16 23:04:13.418349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.525 [2024-04-16 23:04:13.418453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.525 [2024-04-16 23:04:13.418478] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.525 qpair failed and we were unable to recover it. 00:26:22.525 [2024-04-16 23:04:13.418593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.525 [2024-04-16 23:04:13.418703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.525 [2024-04-16 23:04:13.418729] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.525 qpair failed and we were unable to recover it. 00:26:22.525 [2024-04-16 23:04:13.418850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.525 [2024-04-16 23:04:13.418993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.525 [2024-04-16 23:04:13.419019] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.525 qpair failed and we were unable to recover it. 00:26:22.525 [2024-04-16 23:04:13.419135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.525 [2024-04-16 23:04:13.419287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.525 [2024-04-16 23:04:13.419313] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.525 qpair failed and we were unable to recover it. 00:26:22.525 [2024-04-16 23:04:13.419420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.525 [2024-04-16 23:04:13.419543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.525 [2024-04-16 23:04:13.419569] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.525 qpair failed and we were unable to recover it. 00:26:22.525 [2024-04-16 23:04:13.419849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.525 [2024-04-16 23:04:13.420026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.526 [2024-04-16 23:04:13.420055] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.526 qpair failed and we were unable to recover it. 00:26:22.526 [2024-04-16 23:04:13.420220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.526 [2024-04-16 23:04:13.420342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.526 [2024-04-16 23:04:13.420368] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.526 qpair failed and we were unable to recover it. 00:26:22.526 [2024-04-16 23:04:13.420512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.526 [2024-04-16 23:04:13.420627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.526 [2024-04-16 23:04:13.420652] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.526 qpair failed and we were unable to recover it. 00:26:22.526 [2024-04-16 23:04:13.420784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.526 [2024-04-16 23:04:13.420938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.526 [2024-04-16 23:04:13.420967] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.526 qpair failed and we were unable to recover it. 00:26:22.526 [2024-04-16 23:04:13.421123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.526 [2024-04-16 23:04:13.421259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.526 [2024-04-16 23:04:13.421284] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.526 qpair failed and we were unable to recover it. 00:26:22.526 [2024-04-16 23:04:13.421396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.526 [2024-04-16 23:04:13.421582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.526 [2024-04-16 23:04:13.421607] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.526 qpair failed and we were unable to recover it. 00:26:22.526 [2024-04-16 23:04:13.421725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.526 [2024-04-16 23:04:13.421893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.526 [2024-04-16 23:04:13.421935] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.526 qpair failed and we were unable to recover it. 00:26:22.526 [2024-04-16 23:04:13.422086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.526 [2024-04-16 23:04:13.422217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.526 [2024-04-16 23:04:13.422242] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.526 qpair failed and we were unable to recover it. 00:26:22.526 [2024-04-16 23:04:13.422390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.526 [2024-04-16 23:04:13.422545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.526 [2024-04-16 23:04:13.422569] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.526 qpair failed and we were unable to recover it. 00:26:22.526 [2024-04-16 23:04:13.422710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.526 [2024-04-16 23:04:13.422851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.526 [2024-04-16 23:04:13.422878] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.526 qpair failed and we were unable to recover it. 00:26:22.526 [2024-04-16 23:04:13.423021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.526 [2024-04-16 23:04:13.423189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.526 [2024-04-16 23:04:13.423215] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.526 qpair failed and we were unable to recover it. 00:26:22.526 [2024-04-16 23:04:13.423342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.526 [2024-04-16 23:04:13.423480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.526 [2024-04-16 23:04:13.423505] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.526 qpair failed and we were unable to recover it. 00:26:22.526 [2024-04-16 23:04:13.423680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.526 [2024-04-16 23:04:13.423921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.526 [2024-04-16 23:04:13.423952] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.526 qpair failed and we were unable to recover it. 00:26:22.526 [2024-04-16 23:04:13.424122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.526 [2024-04-16 23:04:13.424290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.526 [2024-04-16 23:04:13.424316] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.526 qpair failed and we were unable to recover it. 00:26:22.526 [2024-04-16 23:04:13.424435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.526 [2024-04-16 23:04:13.424569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.526 [2024-04-16 23:04:13.424594] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.526 qpair failed and we were unable to recover it. 00:26:22.526 [2024-04-16 23:04:13.424735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.526 [2024-04-16 23:04:13.424918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.526 [2024-04-16 23:04:13.424945] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.526 qpair failed and we were unable to recover it. 00:26:22.526 [2024-04-16 23:04:13.425081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.526 [2024-04-16 23:04:13.425232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.526 [2024-04-16 23:04:13.425258] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.526 qpair failed and we were unable to recover it. 00:26:22.526 [2024-04-16 23:04:13.425403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.526 [2024-04-16 23:04:13.425540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.526 [2024-04-16 23:04:13.425568] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.526 qpair failed and we were unable to recover it. 00:26:22.526 [2024-04-16 23:04:13.425730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.526 [2024-04-16 23:04:13.425896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.526 [2024-04-16 23:04:13.425939] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.526 qpair failed and we were unable to recover it. 00:26:22.526 [2024-04-16 23:04:13.426127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.526 [2024-04-16 23:04:13.426266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.526 [2024-04-16 23:04:13.426292] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.526 qpair failed and we were unable to recover it. 00:26:22.526 [2024-04-16 23:04:13.426407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.526 [2024-04-16 23:04:13.426544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.526 [2024-04-16 23:04:13.426571] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.526 qpair failed and we were unable to recover it. 00:26:22.526 [2024-04-16 23:04:13.426707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.526 [2024-04-16 23:04:13.426835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.526 [2024-04-16 23:04:13.426864] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.526 qpair failed and we were unable to recover it. 00:26:22.526 [2024-04-16 23:04:13.427004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.526 [2024-04-16 23:04:13.427173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.526 [2024-04-16 23:04:13.427205] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.526 qpair failed and we were unable to recover it. 00:26:22.526 [2024-04-16 23:04:13.427342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.526 [2024-04-16 23:04:13.427449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.526 [2024-04-16 23:04:13.427492] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.526 qpair failed and we were unable to recover it. 00:26:22.526 [2024-04-16 23:04:13.427649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.526 [2024-04-16 23:04:13.427827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.526 [2024-04-16 23:04:13.427852] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.526 qpair failed and we were unable to recover it. 00:26:22.526 [2024-04-16 23:04:13.428017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.526 [2024-04-16 23:04:13.428167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.526 [2024-04-16 23:04:13.428200] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.526 qpair failed and we were unable to recover it. 00:26:22.526 [2024-04-16 23:04:13.428336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.526 [2024-04-16 23:04:13.428453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.526 [2024-04-16 23:04:13.428478] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.526 qpair failed and we were unable to recover it. 00:26:22.526 [2024-04-16 23:04:13.428621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.526 [2024-04-16 23:04:13.428771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.526 [2024-04-16 23:04:13.428799] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.526 qpair failed and we were unable to recover it. 00:26:22.526 [2024-04-16 23:04:13.428929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.526 [2024-04-16 23:04:13.429087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.526 [2024-04-16 23:04:13.429115] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.526 qpair failed and we were unable to recover it. 00:26:22.526 [2024-04-16 23:04:13.429270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.526 [2024-04-16 23:04:13.429410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.527 [2024-04-16 23:04:13.429435] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.527 qpair failed and we were unable to recover it. 00:26:22.527 [2024-04-16 23:04:13.429580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.527 [2024-04-16 23:04:13.429724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.527 [2024-04-16 23:04:13.429749] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.527 qpair failed and we were unable to recover it. 00:26:22.527 [2024-04-16 23:04:13.429890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.527 [2024-04-16 23:04:13.430086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.527 [2024-04-16 23:04:13.430111] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.527 qpair failed and we were unable to recover it. 00:26:22.527 [2024-04-16 23:04:13.430253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.527 [2024-04-16 23:04:13.430364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.527 [2024-04-16 23:04:13.430388] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.527 qpair failed and we were unable to recover it. 00:26:22.527 [2024-04-16 23:04:13.430607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.527 [2024-04-16 23:04:13.430742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.527 [2024-04-16 23:04:13.430766] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.527 qpair failed and we were unable to recover it. 00:26:22.527 [2024-04-16 23:04:13.430868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.527 [2024-04-16 23:04:13.431011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.527 [2024-04-16 23:04:13.431035] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.527 qpair failed and we were unable to recover it. 00:26:22.527 [2024-04-16 23:04:13.431172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.527 [2024-04-16 23:04:13.431325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.527 [2024-04-16 23:04:13.431350] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.527 qpair failed and we were unable to recover it. 00:26:22.527 [2024-04-16 23:04:13.431508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.527 [2024-04-16 23:04:13.431673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.527 [2024-04-16 23:04:13.431700] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.527 qpair failed and we were unable to recover it. 00:26:22.527 [2024-04-16 23:04:13.431875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.527 [2024-04-16 23:04:13.431984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.527 [2024-04-16 23:04:13.432009] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.527 qpair failed and we were unable to recover it. 00:26:22.527 [2024-04-16 23:04:13.432124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.527 [2024-04-16 23:04:13.432237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.527 [2024-04-16 23:04:13.432263] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.527 qpair failed and we were unable to recover it. 00:26:22.527 [2024-04-16 23:04:13.432371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.527 [2024-04-16 23:04:13.432483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.527 [2024-04-16 23:04:13.432507] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.527 qpair failed and we were unable to recover it. 00:26:22.527 [2024-04-16 23:04:13.432650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.527 [2024-04-16 23:04:13.432785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.527 [2024-04-16 23:04:13.432817] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.527 qpair failed and we were unable to recover it. 00:26:22.527 [2024-04-16 23:04:13.432933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.527 [2024-04-16 23:04:13.433079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.527 [2024-04-16 23:04:13.433107] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.527 qpair failed and we were unable to recover it. 00:26:22.527 [2024-04-16 23:04:13.433271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.527 [2024-04-16 23:04:13.433411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.527 [2024-04-16 23:04:13.433436] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.527 qpair failed and we were unable to recover it. 00:26:22.527 [2024-04-16 23:04:13.433612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.527 [2024-04-16 23:04:13.433786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.527 [2024-04-16 23:04:13.433817] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.527 qpair failed and we were unable to recover it. 00:26:22.527 [2024-04-16 23:04:13.433926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.527 [2024-04-16 23:04:13.434063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.527 [2024-04-16 23:04:13.434088] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.527 qpair failed and we were unable to recover it. 00:26:22.527 [2024-04-16 23:04:13.434253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.527 [2024-04-16 23:04:13.434379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.527 [2024-04-16 23:04:13.434403] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.527 qpair failed and we were unable to recover it. 00:26:22.527 [2024-04-16 23:04:13.434545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.527 [2024-04-16 23:04:13.434653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.527 [2024-04-16 23:04:13.434679] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.527 qpair failed and we were unable to recover it. 00:26:22.527 [2024-04-16 23:04:13.434837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.527 [2024-04-16 23:04:13.435005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.527 [2024-04-16 23:04:13.435029] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.527 qpair failed and we were unable to recover it. 00:26:22.527 [2024-04-16 23:04:13.435198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.527 [2024-04-16 23:04:13.435310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.527 [2024-04-16 23:04:13.435336] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.527 qpair failed and we were unable to recover it. 00:26:22.527 [2024-04-16 23:04:13.435493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.527 [2024-04-16 23:04:13.435654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.527 [2024-04-16 23:04:13.435679] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.527 qpair failed and we were unable to recover it. 00:26:22.527 [2024-04-16 23:04:13.435815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.527 [2024-04-16 23:04:13.435964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.527 [2024-04-16 23:04:13.435992] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.527 qpair failed and we were unable to recover it. 00:26:22.527 [2024-04-16 23:04:13.436140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.527 [2024-04-16 23:04:13.436290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.527 [2024-04-16 23:04:13.436316] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.527 qpair failed and we were unable to recover it. 00:26:22.527 [2024-04-16 23:04:13.436472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.527 [2024-04-16 23:04:13.436687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.527 [2024-04-16 23:04:13.436712] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.527 qpair failed and we were unable to recover it. 00:26:22.527 [2024-04-16 23:04:13.436846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.527 [2024-04-16 23:04:13.436952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.527 [2024-04-16 23:04:13.436977] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.527 qpair failed and we were unable to recover it. 00:26:22.527 [2024-04-16 23:04:13.437139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.528 [2024-04-16 23:04:13.437294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.528 [2024-04-16 23:04:13.437319] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.528 qpair failed and we were unable to recover it. 00:26:22.528 [2024-04-16 23:04:13.437538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.528 [2024-04-16 23:04:13.437666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.528 [2024-04-16 23:04:13.437693] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.528 qpair failed and we were unable to recover it. 00:26:22.528 [2024-04-16 23:04:13.437841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.528 [2024-04-16 23:04:13.437986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.528 [2024-04-16 23:04:13.438014] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.528 qpair failed and we were unable to recover it. 00:26:22.528 [2024-04-16 23:04:13.438142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.528 [2024-04-16 23:04:13.438329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.528 [2024-04-16 23:04:13.438356] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.528 qpair failed and we were unable to recover it. 00:26:22.528 [2024-04-16 23:04:13.438467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.528 [2024-04-16 23:04:13.438605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.528 [2024-04-16 23:04:13.438630] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.528 qpair failed and we were unable to recover it. 00:26:22.528 [2024-04-16 23:04:13.438803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.528 [2024-04-16 23:04:13.438946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.528 [2024-04-16 23:04:13.438971] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.528 qpair failed and we were unable to recover it. 00:26:22.528 [2024-04-16 23:04:13.439113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.528 [2024-04-16 23:04:13.439257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.528 [2024-04-16 23:04:13.439284] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.528 qpair failed and we were unable to recover it. 00:26:22.528 [2024-04-16 23:04:13.439397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.528 [2024-04-16 23:04:13.439542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.528 [2024-04-16 23:04:13.439566] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.528 qpair failed and we were unable to recover it. 00:26:22.528 [2024-04-16 23:04:13.439674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.528 [2024-04-16 23:04:13.439791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.528 [2024-04-16 23:04:13.439817] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.528 qpair failed and we were unable to recover it. 00:26:22.528 [2024-04-16 23:04:13.439999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.528 [2024-04-16 23:04:13.440141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.528 [2024-04-16 23:04:13.440166] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.528 qpair failed and we were unable to recover it. 00:26:22.528 [2024-04-16 23:04:13.440362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.528 [2024-04-16 23:04:13.440512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.528 [2024-04-16 23:04:13.440540] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.528 qpair failed and we were unable to recover it. 00:26:22.528 [2024-04-16 23:04:13.440703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.528 [2024-04-16 23:04:13.440853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.528 [2024-04-16 23:04:13.440881] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.528 qpair failed and we were unable to recover it. 00:26:22.528 [2024-04-16 23:04:13.441013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.528 [2024-04-16 23:04:13.441123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.528 [2024-04-16 23:04:13.441148] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.528 qpair failed and we were unable to recover it. 00:26:22.528 [2024-04-16 23:04:13.441293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.528 [2024-04-16 23:04:13.441407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.528 [2024-04-16 23:04:13.441432] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.528 qpair failed and we were unable to recover it. 00:26:22.528 [2024-04-16 23:04:13.441599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.528 [2024-04-16 23:04:13.441712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.528 [2024-04-16 23:04:13.441737] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.528 qpair failed and we were unable to recover it. 00:26:22.528 [2024-04-16 23:04:13.441917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.528 [2024-04-16 23:04:13.442034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.528 [2024-04-16 23:04:13.442058] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.528 qpair failed and we were unable to recover it. 00:26:22.528 [2024-04-16 23:04:13.442168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.528 [2024-04-16 23:04:13.442291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.528 [2024-04-16 23:04:13.442316] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.528 qpair failed and we were unable to recover it. 00:26:22.528 [2024-04-16 23:04:13.442464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.528 [2024-04-16 23:04:13.442586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.528 [2024-04-16 23:04:13.442613] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.528 qpair failed and we were unable to recover it. 00:26:22.528 [2024-04-16 23:04:13.442760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.528 [2024-04-16 23:04:13.442925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.528 [2024-04-16 23:04:13.442949] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.528 qpair failed and we were unable to recover it. 00:26:22.528 [2024-04-16 23:04:13.443059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.528 [2024-04-16 23:04:13.443188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.528 [2024-04-16 23:04:13.443213] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.528 qpair failed and we were unable to recover it. 00:26:22.528 [2024-04-16 23:04:13.443331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.528 [2024-04-16 23:04:13.443448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.528 [2024-04-16 23:04:13.443473] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.528 qpair failed and we were unable to recover it. 00:26:22.528 [2024-04-16 23:04:13.443606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.528 [2024-04-16 23:04:13.443835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.528 [2024-04-16 23:04:13.443862] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.528 qpair failed and we were unable to recover it. 00:26:22.528 [2024-04-16 23:04:13.444015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.528 [2024-04-16 23:04:13.444198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.528 [2024-04-16 23:04:13.444226] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.528 qpair failed and we were unable to recover it. 00:26:22.528 [2024-04-16 23:04:13.444420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.528 [2024-04-16 23:04:13.444600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.528 [2024-04-16 23:04:13.444624] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.528 qpair failed and we were unable to recover it. 00:26:22.528 [2024-04-16 23:04:13.444759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.528 [2024-04-16 23:04:13.444878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.528 [2024-04-16 23:04:13.444903] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.528 qpair failed and we were unable to recover it. 00:26:22.528 [2024-04-16 23:04:13.445037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.528 [2024-04-16 23:04:13.445165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.528 [2024-04-16 23:04:13.445224] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.528 qpair failed and we were unable to recover it. 00:26:22.528 [2024-04-16 23:04:13.445350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.528 [2024-04-16 23:04:13.445564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.528 [2024-04-16 23:04:13.445589] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.528 qpair failed and we were unable to recover it. 00:26:22.528 [2024-04-16 23:04:13.445776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.528 [2024-04-16 23:04:13.445957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.528 [2024-04-16 23:04:13.445982] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.528 qpair failed and we were unable to recover it. 00:26:22.528 [2024-04-16 23:04:13.446101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.528 [2024-04-16 23:04:13.446241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.528 [2024-04-16 23:04:13.446266] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.528 qpair failed and we were unable to recover it. 00:26:22.528 [2024-04-16 23:04:13.446404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.528 [2024-04-16 23:04:13.446521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.529 [2024-04-16 23:04:13.446546] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.529 qpair failed and we were unable to recover it. 00:26:22.529 [2024-04-16 23:04:13.446657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.529 [2024-04-16 23:04:13.446884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.529 [2024-04-16 23:04:13.446912] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.529 qpair failed and we were unable to recover it. 00:26:22.529 [2024-04-16 23:04:13.447110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.529 [2024-04-16 23:04:13.447256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.529 [2024-04-16 23:04:13.447282] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.529 qpair failed and we were unable to recover it. 00:26:22.529 [2024-04-16 23:04:13.447396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.529 [2024-04-16 23:04:13.447539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.529 [2024-04-16 23:04:13.447564] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.529 qpair failed and we were unable to recover it. 00:26:22.529 [2024-04-16 23:04:13.447704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.529 [2024-04-16 23:04:13.447811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.529 [2024-04-16 23:04:13.447837] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.529 qpair failed and we were unable to recover it. 00:26:22.529 [2024-04-16 23:04:13.448018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.529 [2024-04-16 23:04:13.448153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.529 [2024-04-16 23:04:13.448187] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.529 qpair failed and we were unable to recover it. 00:26:22.529 [2024-04-16 23:04:13.448370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.529 [2024-04-16 23:04:13.448515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.529 [2024-04-16 23:04:13.448540] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.529 qpair failed and we were unable to recover it. 00:26:22.529 [2024-04-16 23:04:13.448715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.529 [2024-04-16 23:04:13.448851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.529 [2024-04-16 23:04:13.448876] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.529 qpair failed and we were unable to recover it. 00:26:22.529 [2024-04-16 23:04:13.449018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.529 [2024-04-16 23:04:13.449187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.529 [2024-04-16 23:04:13.449224] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.529 qpair failed and we were unable to recover it. 00:26:22.529 [2024-04-16 23:04:13.449375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.529 [2024-04-16 23:04:13.449532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.529 [2024-04-16 23:04:13.449559] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.529 qpair failed and we were unable to recover it. 00:26:22.529 [2024-04-16 23:04:13.449719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.529 [2024-04-16 23:04:13.449831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.529 [2024-04-16 23:04:13.449856] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.529 qpair failed and we were unable to recover it. 00:26:22.529 [2024-04-16 23:04:13.450026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.529 [2024-04-16 23:04:13.450164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.529 [2024-04-16 23:04:13.450196] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.529 qpair failed and we were unable to recover it. 00:26:22.529 [2024-04-16 23:04:13.450343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.529 [2024-04-16 23:04:13.450509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.529 [2024-04-16 23:04:13.450537] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.529 qpair failed and we were unable to recover it. 00:26:22.529 [2024-04-16 23:04:13.450713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.529 [2024-04-16 23:04:13.450871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.529 [2024-04-16 23:04:13.450923] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.529 qpair failed and we were unable to recover it. 00:26:22.529 [2024-04-16 23:04:13.451114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.529 [2024-04-16 23:04:13.451283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.529 [2024-04-16 23:04:13.451326] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.529 qpair failed and we were unable to recover it. 00:26:22.529 [2024-04-16 23:04:13.451458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.529 [2024-04-16 23:04:13.451579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.529 [2024-04-16 23:04:13.451605] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.529 qpair failed and we were unable to recover it. 00:26:22.529 [2024-04-16 23:04:13.451741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.529 [2024-04-16 23:04:13.451849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.529 [2024-04-16 23:04:13.451875] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.529 qpair failed and we were unable to recover it. 00:26:22.529 [2024-04-16 23:04:13.452048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.529 [2024-04-16 23:04:13.452221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.529 [2024-04-16 23:04:13.452265] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.529 qpair failed and we were unable to recover it. 00:26:22.529 [2024-04-16 23:04:13.452442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.529 [2024-04-16 23:04:13.452629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.529 [2024-04-16 23:04:13.452661] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.529 qpair failed and we were unable to recover it. 00:26:22.529 [2024-04-16 23:04:13.452785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.529 [2024-04-16 23:04:13.452930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.529 [2024-04-16 23:04:13.452956] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.529 qpair failed and we were unable to recover it. 00:26:22.529 [2024-04-16 23:04:13.453136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.529 [2024-04-16 23:04:13.453280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.529 [2024-04-16 23:04:13.453306] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.529 qpair failed and we were unable to recover it. 00:26:22.529 [2024-04-16 23:04:13.453525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.529 [2024-04-16 23:04:13.453659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.529 [2024-04-16 23:04:13.453684] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.529 qpair failed and we were unable to recover it. 00:26:22.529 [2024-04-16 23:04:13.453852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.529 [2024-04-16 23:04:13.453962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.529 [2024-04-16 23:04:13.453986] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.529 qpair failed and we were unable to recover it. 00:26:22.529 [2024-04-16 23:04:13.454155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.529 [2024-04-16 23:04:13.454291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.529 [2024-04-16 23:04:13.454316] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.529 qpair failed and we were unable to recover it. 00:26:22.529 [2024-04-16 23:04:13.454459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.529 [2024-04-16 23:04:13.454627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.529 [2024-04-16 23:04:13.454654] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.529 qpair failed and we were unable to recover it. 00:26:22.529 [2024-04-16 23:04:13.454818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.529 [2024-04-16 23:04:13.454954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.529 [2024-04-16 23:04:13.454978] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.529 qpair failed and we were unable to recover it. 00:26:22.529 [2024-04-16 23:04:13.455111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.529 [2024-04-16 23:04:13.455316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.529 [2024-04-16 23:04:13.455342] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.529 qpair failed and we were unable to recover it. 00:26:22.529 [2024-04-16 23:04:13.455459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.529 [2024-04-16 23:04:13.455602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.529 [2024-04-16 23:04:13.455626] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.529 qpair failed and we were unable to recover it. 00:26:22.529 [2024-04-16 23:04:13.455820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.529 [2024-04-16 23:04:13.455990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.529 [2024-04-16 23:04:13.456033] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.529 qpair failed and we were unable to recover it. 00:26:22.529 [2024-04-16 23:04:13.456188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.529 [2024-04-16 23:04:13.456372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.530 [2024-04-16 23:04:13.456397] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.530 qpair failed and we were unable to recover it. 00:26:22.530 [2024-04-16 23:04:13.456563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.530 [2024-04-16 23:04:13.456741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.530 [2024-04-16 23:04:13.456766] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.530 qpair failed and we were unable to recover it. 00:26:22.530 [2024-04-16 23:04:13.456939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.530 [2024-04-16 23:04:13.457110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.530 [2024-04-16 23:04:13.457157] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.530 qpair failed and we were unable to recover it. 00:26:22.530 [2024-04-16 23:04:13.457371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.530 [2024-04-16 23:04:13.457512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.530 [2024-04-16 23:04:13.457565] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.530 qpair failed and we were unable to recover it. 00:26:22.530 [2024-04-16 23:04:13.457757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.530 [2024-04-16 23:04:13.457868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.530 [2024-04-16 23:04:13.457893] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.530 qpair failed and we were unable to recover it. 00:26:22.530 [2024-04-16 23:04:13.458037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.530 [2024-04-16 23:04:13.458159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.530 [2024-04-16 23:04:13.458195] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.530 qpair failed and we were unable to recover it. 00:26:22.530 [2024-04-16 23:04:13.458363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.530 [2024-04-16 23:04:13.458514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.530 [2024-04-16 23:04:13.458539] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.530 qpair failed and we were unable to recover it. 00:26:22.530 [2024-04-16 23:04:13.458684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.530 [2024-04-16 23:04:13.458794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.530 [2024-04-16 23:04:13.458820] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.530 qpair failed and we were unable to recover it. 00:26:22.530 [2024-04-16 23:04:13.458963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.530 [2024-04-16 23:04:13.459128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.530 [2024-04-16 23:04:13.459156] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.530 qpair failed and we were unable to recover it. 00:26:22.530 [2024-04-16 23:04:13.459320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.530 [2024-04-16 23:04:13.459509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.530 [2024-04-16 23:04:13.459534] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.530 qpair failed and we were unable to recover it. 00:26:22.530 [2024-04-16 23:04:13.459647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.530 [2024-04-16 23:04:13.459756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.530 [2024-04-16 23:04:13.459780] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.530 qpair failed and we were unable to recover it. 00:26:22.530 [2024-04-16 23:04:13.459948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.530 [2024-04-16 23:04:13.460088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.530 [2024-04-16 23:04:13.460116] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.530 qpair failed and we were unable to recover it. 00:26:22.530 [2024-04-16 23:04:13.460274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.530 [2024-04-16 23:04:13.460387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.530 [2024-04-16 23:04:13.460412] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.530 qpair failed and we were unable to recover it. 00:26:22.530 [2024-04-16 23:04:13.460567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.530 [2024-04-16 23:04:13.460710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.530 [2024-04-16 23:04:13.460734] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.530 qpair failed and we were unable to recover it. 00:26:22.530 [2024-04-16 23:04:13.460843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.530 [2024-04-16 23:04:13.461004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.530 [2024-04-16 23:04:13.461029] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.530 qpair failed and we were unable to recover it. 00:26:22.530 [2024-04-16 23:04:13.461233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.530 [2024-04-16 23:04:13.461359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.530 [2024-04-16 23:04:13.461387] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.530 qpair failed and we were unable to recover it. 00:26:22.530 [2024-04-16 23:04:13.461542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.530 [2024-04-16 23:04:13.461694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.530 [2024-04-16 23:04:13.461721] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.530 qpair failed and we were unable to recover it. 00:26:22.530 [2024-04-16 23:04:13.461917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.530 [2024-04-16 23:04:13.462052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.530 [2024-04-16 23:04:13.462077] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.530 qpair failed and we were unable to recover it. 00:26:22.530 [2024-04-16 23:04:13.462192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.530 [2024-04-16 23:04:13.462359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.530 [2024-04-16 23:04:13.462383] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.530 qpair failed and we were unable to recover it. 00:26:22.530 [2024-04-16 23:04:13.462558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.530 [2024-04-16 23:04:13.462705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.530 [2024-04-16 23:04:13.462732] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.530 qpair failed and we were unable to recover it. 00:26:22.530 [2024-04-16 23:04:13.462902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.530 [2024-04-16 23:04:13.463055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.530 [2024-04-16 23:04:13.463082] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.530 qpair failed and we were unable to recover it. 00:26:22.530 [2024-04-16 23:04:13.463272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.530 [2024-04-16 23:04:13.463408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.530 [2024-04-16 23:04:13.463433] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.530 qpair failed and we were unable to recover it. 00:26:22.530 [2024-04-16 23:04:13.463609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.530 [2024-04-16 23:04:13.463769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.530 [2024-04-16 23:04:13.463796] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.530 qpair failed and we were unable to recover it. 00:26:22.530 [2024-04-16 23:04:13.463914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.530 [2024-04-16 23:04:13.464099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.530 [2024-04-16 23:04:13.464124] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.530 qpair failed and we were unable to recover it. 00:26:22.530 [2024-04-16 23:04:13.464267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.530 [2024-04-16 23:04:13.464376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.530 [2024-04-16 23:04:13.464401] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.530 qpair failed and we were unable to recover it. 00:26:22.530 [2024-04-16 23:04:13.464519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.530 [2024-04-16 23:04:13.464671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.530 [2024-04-16 23:04:13.464699] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.530 qpair failed and we were unable to recover it. 00:26:22.530 [2024-04-16 23:04:13.464828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.530 [2024-04-16 23:04:13.464988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.530 [2024-04-16 23:04:13.465012] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.530 qpair failed and we were unable to recover it. 00:26:22.530 [2024-04-16 23:04:13.465205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.530 [2024-04-16 23:04:13.465329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.530 [2024-04-16 23:04:13.465357] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.530 qpair failed and we were unable to recover it. 00:26:22.530 [2024-04-16 23:04:13.465540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.530 [2024-04-16 23:04:13.465682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.530 [2024-04-16 23:04:13.465706] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.530 qpair failed and we were unable to recover it. 00:26:22.530 [2024-04-16 23:04:13.465841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.530 [2024-04-16 23:04:13.465990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.531 [2024-04-16 23:04:13.466018] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.531 qpair failed and we were unable to recover it. 00:26:22.531 [2024-04-16 23:04:13.466161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.531 [2024-04-16 23:04:13.466326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.531 [2024-04-16 23:04:13.466367] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.531 qpair failed and we were unable to recover it. 00:26:22.531 [2024-04-16 23:04:13.466524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.531 [2024-04-16 23:04:13.466688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.531 [2024-04-16 23:04:13.466713] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.531 qpair failed and we were unable to recover it. 00:26:22.531 [2024-04-16 23:04:13.466851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.531 [2024-04-16 23:04:13.467015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.531 [2024-04-16 23:04:13.467043] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.531 qpair failed and we were unable to recover it. 00:26:22.531 [2024-04-16 23:04:13.467169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.531 [2024-04-16 23:04:13.467330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.531 [2024-04-16 23:04:13.467357] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.531 qpair failed and we were unable to recover it. 00:26:22.531 [2024-04-16 23:04:13.467523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.531 [2024-04-16 23:04:13.467666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.531 [2024-04-16 23:04:13.467690] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.531 qpair failed and we were unable to recover it. 00:26:22.531 [2024-04-16 23:04:13.467834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.531 [2024-04-16 23:04:13.468000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.531 [2024-04-16 23:04:13.468028] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.531 qpair failed and we were unable to recover it. 00:26:22.531 [2024-04-16 23:04:13.468256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.531 [2024-04-16 23:04:13.468394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.531 [2024-04-16 23:04:13.468420] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.531 qpair failed and we were unable to recover it. 00:26:22.531 [2024-04-16 23:04:13.468576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.531 [2024-04-16 23:04:13.468752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.531 [2024-04-16 23:04:13.468778] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.531 qpair failed and we were unable to recover it. 00:26:22.531 [2024-04-16 23:04:13.468905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.531 [2024-04-16 23:04:13.469047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.531 [2024-04-16 23:04:13.469072] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.531 qpair failed and we were unable to recover it. 00:26:22.531 [2024-04-16 23:04:13.469215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.531 [2024-04-16 23:04:13.469369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.531 [2024-04-16 23:04:13.469396] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.531 qpair failed and we were unable to recover it. 00:26:22.531 [2024-04-16 23:04:13.469603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.531 [2024-04-16 23:04:13.469759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.531 [2024-04-16 23:04:13.469792] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.531 qpair failed and we were unable to recover it. 00:26:22.531 [2024-04-16 23:04:13.469956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.531 [2024-04-16 23:04:13.470119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.531 [2024-04-16 23:04:13.470144] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.531 qpair failed and we were unable to recover it. 00:26:22.531 [2024-04-16 23:04:13.470259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.531 [2024-04-16 23:04:13.470376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.531 [2024-04-16 23:04:13.470401] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.531 qpair failed and we were unable to recover it. 00:26:22.531 [2024-04-16 23:04:13.470555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.531 [2024-04-16 23:04:13.470728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.531 [2024-04-16 23:04:13.470752] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.531 qpair failed and we were unable to recover it. 00:26:22.531 [2024-04-16 23:04:13.470893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.531 [2024-04-16 23:04:13.471027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.531 [2024-04-16 23:04:13.471054] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.531 qpair failed and we were unable to recover it. 00:26:22.531 [2024-04-16 23:04:13.471208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.531 [2024-04-16 23:04:13.471333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.531 [2024-04-16 23:04:13.471360] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.531 qpair failed and we were unable to recover it. 00:26:22.531 [2024-04-16 23:04:13.471555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.531 [2024-04-16 23:04:13.471702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.531 [2024-04-16 23:04:13.471746] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.531 qpair failed and we were unable to recover it. 00:26:22.531 [2024-04-16 23:04:13.471908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.531 [2024-04-16 23:04:13.472058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.531 [2024-04-16 23:04:13.472085] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.531 qpair failed and we were unable to recover it. 00:26:22.531 [2024-04-16 23:04:13.472238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.531 [2024-04-16 23:04:13.472383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.531 [2024-04-16 23:04:13.472410] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.531 qpair failed and we were unable to recover it. 00:26:22.531 [2024-04-16 23:04:13.472542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.531 [2024-04-16 23:04:13.472698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.531 [2024-04-16 23:04:13.472727] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.531 qpair failed and we were unable to recover it. 00:26:22.531 [2024-04-16 23:04:13.472882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.531 [2024-04-16 23:04:13.473014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.531 [2024-04-16 23:04:13.473038] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.531 qpair failed and we were unable to recover it. 00:26:22.531 [2024-04-16 23:04:13.473197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.531 [2024-04-16 23:04:13.473349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.531 [2024-04-16 23:04:13.473377] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.531 qpair failed and we were unable to recover it. 00:26:22.531 [2024-04-16 23:04:13.473513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.531 [2024-04-16 23:04:13.473639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.531 [2024-04-16 23:04:13.473665] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.531 qpair failed and we were unable to recover it. 00:26:22.531 [2024-04-16 23:04:13.473824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.531 [2024-04-16 23:04:13.473987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.531 [2024-04-16 23:04:13.474014] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.531 qpair failed and we were unable to recover it. 00:26:22.531 [2024-04-16 23:04:13.474208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.531 [2024-04-16 23:04:13.474329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.531 [2024-04-16 23:04:13.474353] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.531 qpair failed and we were unable to recover it. 00:26:22.531 [2024-04-16 23:04:13.474557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.531 [2024-04-16 23:04:13.474722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.531 [2024-04-16 23:04:13.474763] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.531 qpair failed and we were unable to recover it. 00:26:22.531 [2024-04-16 23:04:13.474929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.531 [2024-04-16 23:04:13.475072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.531 [2024-04-16 23:04:13.475096] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.531 qpair failed and we were unable to recover it. 00:26:22.531 [2024-04-16 23:04:13.475270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.531 [2024-04-16 23:04:13.475395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.531 [2024-04-16 23:04:13.475421] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.531 qpair failed and we were unable to recover it. 00:26:22.531 [2024-04-16 23:04:13.475607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.531 [2024-04-16 23:04:13.475770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.532 [2024-04-16 23:04:13.475795] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.532 qpair failed and we were unable to recover it. 00:26:22.532 [2024-04-16 23:04:13.475904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.532 [2024-04-16 23:04:13.476039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.532 [2024-04-16 23:04:13.476063] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.532 qpair failed and we were unable to recover it. 00:26:22.532 [2024-04-16 23:04:13.476210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.532 [2024-04-16 23:04:13.476391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.532 [2024-04-16 23:04:13.476415] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.532 qpair failed and we were unable to recover it. 00:26:22.532 [2024-04-16 23:04:13.476536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.532 [2024-04-16 23:04:13.476690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.532 [2024-04-16 23:04:13.476714] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.532 qpair failed and we were unable to recover it. 00:26:22.532 [2024-04-16 23:04:13.476856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.532 [2024-04-16 23:04:13.476989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.532 [2024-04-16 23:04:13.477013] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.532 qpair failed and we were unable to recover it. 00:26:22.532 [2024-04-16 23:04:13.477150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.532 [2024-04-16 23:04:13.477305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.532 [2024-04-16 23:04:13.477334] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.532 qpair failed and we were unable to recover it. 00:26:22.532 [2024-04-16 23:04:13.477489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.532 [2024-04-16 23:04:13.477670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.532 [2024-04-16 23:04:13.477697] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.532 qpair failed and we were unable to recover it. 00:26:22.532 [2024-04-16 23:04:13.477866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.532 [2024-04-16 23:04:13.477977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.532 [2024-04-16 23:04:13.478002] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.532 qpair failed and we were unable to recover it. 00:26:22.532 [2024-04-16 23:04:13.478146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.532 [2024-04-16 23:04:13.478320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.532 [2024-04-16 23:04:13.478344] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.532 qpair failed and we were unable to recover it. 00:26:22.532 [2024-04-16 23:04:13.478503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.532 [2024-04-16 23:04:13.478654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.532 [2024-04-16 23:04:13.478683] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.532 qpair failed and we were unable to recover it. 00:26:22.532 [2024-04-16 23:04:13.478851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.532 [2024-04-16 23:04:13.478989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.532 [2024-04-16 23:04:13.479014] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.532 qpair failed and we were unable to recover it. 00:26:22.532 [2024-04-16 23:04:13.479212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.532 [2024-04-16 23:04:13.479355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.532 [2024-04-16 23:04:13.479382] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.532 qpair failed and we were unable to recover it. 00:26:22.532 [2024-04-16 23:04:13.479513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.532 [2024-04-16 23:04:13.479658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.532 [2024-04-16 23:04:13.479682] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.532 qpair failed and we were unable to recover it. 00:26:22.532 [2024-04-16 23:04:13.479825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.532 [2024-04-16 23:04:13.479979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.532 [2024-04-16 23:04:13.480007] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.532 qpair failed and we were unable to recover it. 00:26:22.532 [2024-04-16 23:04:13.480155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.532 [2024-04-16 23:04:13.480322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.532 [2024-04-16 23:04:13.480347] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.532 qpair failed and we were unable to recover it. 00:26:22.532 [2024-04-16 23:04:13.480507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.532 [2024-04-16 23:04:13.480703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.532 [2024-04-16 23:04:13.480727] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.532 qpair failed and we were unable to recover it. 00:26:22.532 [2024-04-16 23:04:13.480896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.532 [2024-04-16 23:04:13.481035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.532 [2024-04-16 23:04:13.481060] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.532 qpair failed and we were unable to recover it. 00:26:22.532 [2024-04-16 23:04:13.481206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.532 [2024-04-16 23:04:13.481349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.532 [2024-04-16 23:04:13.481379] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.532 qpair failed and we were unable to recover it. 00:26:22.532 [2024-04-16 23:04:13.481553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.532 [2024-04-16 23:04:13.481700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.532 [2024-04-16 23:04:13.481726] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.532 qpair failed and we were unable to recover it. 00:26:22.532 [2024-04-16 23:04:13.481880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.532 [2024-04-16 23:04:13.482068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.532 [2024-04-16 23:04:13.482093] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.532 qpair failed and we were unable to recover it. 00:26:22.532 [2024-04-16 23:04:13.482202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.532 [2024-04-16 23:04:13.482373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.532 [2024-04-16 23:04:13.482397] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.532 qpair failed and we were unable to recover it. 00:26:22.532 [2024-04-16 23:04:13.482565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.532 [2024-04-16 23:04:13.482716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.532 [2024-04-16 23:04:13.482740] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.532 qpair failed and we were unable to recover it. 00:26:22.532 [2024-04-16 23:04:13.482859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.532 [2024-04-16 23:04:13.482994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.532 [2024-04-16 23:04:13.483021] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.532 qpair failed and we were unable to recover it. 00:26:22.532 [2024-04-16 23:04:13.483149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.532 [2024-04-16 23:04:13.483283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.532 [2024-04-16 23:04:13.483310] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.532 qpair failed and we were unable to recover it. 00:26:22.532 [2024-04-16 23:04:13.483499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.532 [2024-04-16 23:04:13.483659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.532 [2024-04-16 23:04:13.483686] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.533 qpair failed and we were unable to recover it. 00:26:22.533 [2024-04-16 23:04:13.483839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.533 [2024-04-16 23:04:13.483982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.533 [2024-04-16 23:04:13.484009] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.533 qpair failed and we were unable to recover it. 00:26:22.533 [2024-04-16 23:04:13.484159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.533 [2024-04-16 23:04:13.484312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.533 [2024-04-16 23:04:13.484338] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.533 qpair failed and we were unable to recover it. 00:26:22.533 [2024-04-16 23:04:13.484500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.533 [2024-04-16 23:04:13.484680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.533 [2024-04-16 23:04:13.484707] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.533 qpair failed and we were unable to recover it. 00:26:22.533 [2024-04-16 23:04:13.484859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.533 [2024-04-16 23:04:13.485001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.533 [2024-04-16 23:04:13.485025] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.533 qpair failed and we were unable to recover it. 00:26:22.533 [2024-04-16 23:04:13.485151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.533 [2024-04-16 23:04:13.485300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.533 [2024-04-16 23:04:13.485329] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.533 qpair failed and we were unable to recover it. 00:26:22.533 [2024-04-16 23:04:13.485456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.533 [2024-04-16 23:04:13.485578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.533 [2024-04-16 23:04:13.485605] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.533 qpair failed and we were unable to recover it. 00:26:22.533 [2024-04-16 23:04:13.485759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.533 [2024-04-16 23:04:13.485888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.533 [2024-04-16 23:04:13.485916] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.533 qpair failed and we were unable to recover it. 00:26:22.533 [2024-04-16 23:04:13.486071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.533 [2024-04-16 23:04:13.486203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.533 [2024-04-16 23:04:13.486228] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.533 qpair failed and we were unable to recover it. 00:26:22.533 [2024-04-16 23:04:13.486359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.533 [2024-04-16 23:04:13.486513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.533 [2024-04-16 23:04:13.486544] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.533 qpair failed and we were unable to recover it. 00:26:22.533 [2024-04-16 23:04:13.486669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.533 [2024-04-16 23:04:13.486790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.533 [2024-04-16 23:04:13.486817] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.533 qpair failed and we were unable to recover it. 00:26:22.533 [2024-04-16 23:04:13.486969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.533 [2024-04-16 23:04:13.487114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.533 [2024-04-16 23:04:13.487140] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.533 qpair failed and we were unable to recover it. 00:26:22.533 [2024-04-16 23:04:13.487290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.533 [2024-04-16 23:04:13.487401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.533 [2024-04-16 23:04:13.487425] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.533 qpair failed and we were unable to recover it. 00:26:22.533 [2024-04-16 23:04:13.487582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.533 [2024-04-16 23:04:13.487698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.533 [2024-04-16 23:04:13.487725] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.533 qpair failed and we were unable to recover it. 00:26:22.533 [2024-04-16 23:04:13.487919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.533 [2024-04-16 23:04:13.488049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.533 [2024-04-16 23:04:13.488076] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.533 qpair failed and we were unable to recover it. 00:26:22.533 [2024-04-16 23:04:13.488219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.533 [2024-04-16 23:04:13.488345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.533 [2024-04-16 23:04:13.488372] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.533 qpair failed and we were unable to recover it. 00:26:22.533 [2024-04-16 23:04:13.488536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.533 [2024-04-16 23:04:13.488671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.533 [2024-04-16 23:04:13.488695] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.533 qpair failed and we were unable to recover it. 00:26:22.533 [2024-04-16 23:04:13.488863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.533 [2024-04-16 23:04:13.488984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.533 [2024-04-16 23:04:13.489011] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.533 qpair failed and we were unable to recover it. 00:26:22.533 [2024-04-16 23:04:13.489158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.533 [2024-04-16 23:04:13.489319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.533 [2024-04-16 23:04:13.489347] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.533 qpair failed and we were unable to recover it. 00:26:22.533 [2024-04-16 23:04:13.489504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.533 [2024-04-16 23:04:13.489694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.533 [2024-04-16 23:04:13.489726] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.533 qpair failed and we were unable to recover it. 00:26:22.533 [2024-04-16 23:04:13.489888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.533 [2024-04-16 23:04:13.490028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.533 [2024-04-16 23:04:13.490052] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.533 qpair failed and we were unable to recover it. 00:26:22.533 [2024-04-16 23:04:13.490205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.533 [2024-04-16 23:04:13.490388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.533 [2024-04-16 23:04:13.490417] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.533 qpair failed and we were unable to recover it. 00:26:22.533 [2024-04-16 23:04:13.490579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.533 [2024-04-16 23:04:13.490827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.533 [2024-04-16 23:04:13.490853] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.533 qpair failed and we were unable to recover it. 00:26:22.533 [2024-04-16 23:04:13.491003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.533 [2024-04-16 23:04:13.491160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.533 [2024-04-16 23:04:13.491195] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.533 qpair failed and we were unable to recover it. 00:26:22.533 [2024-04-16 23:04:13.491338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.533 [2024-04-16 23:04:13.491478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.533 [2024-04-16 23:04:13.491502] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.533 qpair failed and we were unable to recover it. 00:26:22.533 [2024-04-16 23:04:13.491665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.533 [2024-04-16 23:04:13.491844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.533 [2024-04-16 23:04:13.491872] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.533 qpair failed and we were unable to recover it. 00:26:22.533 [2024-04-16 23:04:13.492003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.533 [2024-04-16 23:04:13.492143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.533 [2024-04-16 23:04:13.492168] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.533 qpair failed and we were unable to recover it. 00:26:22.533 [2024-04-16 23:04:13.492326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.533 [2024-04-16 23:04:13.492463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.533 [2024-04-16 23:04:13.492487] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.533 qpair failed and we were unable to recover it. 00:26:22.533 [2024-04-16 23:04:13.492606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.533 [2024-04-16 23:04:13.492715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.533 [2024-04-16 23:04:13.492739] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.533 qpair failed and we were unable to recover it. 00:26:22.533 [2024-04-16 23:04:13.492852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.533 [2024-04-16 23:04:13.492959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.533 [2024-04-16 23:04:13.492984] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.534 qpair failed and we were unable to recover it. 00:26:22.534 [2024-04-16 23:04:13.493097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.534 [2024-04-16 23:04:13.493209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.534 [2024-04-16 23:04:13.493235] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.534 qpair failed and we were unable to recover it. 00:26:22.534 [2024-04-16 23:04:13.493370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.534 [2024-04-16 23:04:13.493512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.534 [2024-04-16 23:04:13.493537] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.534 qpair failed and we were unable to recover it. 00:26:22.534 [2024-04-16 23:04:13.493721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.534 [2024-04-16 23:04:13.493893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.534 [2024-04-16 23:04:13.493933] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.534 qpair failed and we were unable to recover it. 00:26:22.534 [2024-04-16 23:04:13.494050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.534 [2024-04-16 23:04:13.494202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.534 [2024-04-16 23:04:13.494230] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.534 qpair failed and we were unable to recover it. 00:26:22.534 [2024-04-16 23:04:13.494377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.534 [2024-04-16 23:04:13.494551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.534 [2024-04-16 23:04:13.494576] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.534 qpair failed and we were unable to recover it. 00:26:22.534 [2024-04-16 23:04:13.494740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.534 [2024-04-16 23:04:13.494914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.534 [2024-04-16 23:04:13.494938] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.534 qpair failed and we were unable to recover it. 00:26:22.534 [2024-04-16 23:04:13.495055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.534 [2024-04-16 23:04:13.495170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.534 [2024-04-16 23:04:13.495200] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.534 qpair failed and we were unable to recover it. 00:26:22.534 [2024-04-16 23:04:13.495307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.534 [2024-04-16 23:04:13.495446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.534 [2024-04-16 23:04:13.495470] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.534 qpair failed and we were unable to recover it. 00:26:22.534 [2024-04-16 23:04:13.495634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.534 [2024-04-16 23:04:13.495743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.534 [2024-04-16 23:04:13.495768] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.534 qpair failed and we were unable to recover it. 00:26:22.534 [2024-04-16 23:04:13.495935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.534 [2024-04-16 23:04:13.496093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.534 [2024-04-16 23:04:13.496120] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.534 qpair failed and we were unable to recover it. 00:26:22.534 [2024-04-16 23:04:13.496311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.534 [2024-04-16 23:04:13.496422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.534 [2024-04-16 23:04:13.496446] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.534 qpair failed and we were unable to recover it. 00:26:22.534 [2024-04-16 23:04:13.496591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.534 [2024-04-16 23:04:13.496695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.534 [2024-04-16 23:04:13.496720] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.534 qpair failed and we were unable to recover it. 00:26:22.534 [2024-04-16 23:04:13.496859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.534 [2024-04-16 23:04:13.496996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.534 [2024-04-16 23:04:13.497022] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.534 qpair failed and we were unable to recover it. 00:26:22.534 [2024-04-16 23:04:13.497157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.534 [2024-04-16 23:04:13.497288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.534 [2024-04-16 23:04:13.497317] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.534 qpair failed and we were unable to recover it. 00:26:22.534 [2024-04-16 23:04:13.497515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.534 [2024-04-16 23:04:13.497675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.534 [2024-04-16 23:04:13.497701] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.534 qpair failed and we were unable to recover it. 00:26:22.534 [2024-04-16 23:04:13.497892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.534 [2024-04-16 23:04:13.498027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.534 [2024-04-16 23:04:13.498052] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.534 qpair failed and we were unable to recover it. 00:26:22.534 [2024-04-16 23:04:13.498249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.534 [2024-04-16 23:04:13.498394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.534 [2024-04-16 23:04:13.498419] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.534 qpair failed and we were unable to recover it. 00:26:22.534 [2024-04-16 23:04:13.498557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.534 [2024-04-16 23:04:13.498689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.534 [2024-04-16 23:04:13.498716] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.534 qpair failed and we were unable to recover it. 00:26:22.534 [2024-04-16 23:04:13.498883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.534 [2024-04-16 23:04:13.499021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.534 [2024-04-16 23:04:13.499045] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.534 qpair failed and we were unable to recover it. 00:26:22.534 [2024-04-16 23:04:13.499242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.534 [2024-04-16 23:04:13.499403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.534 [2024-04-16 23:04:13.499427] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.534 qpair failed and we were unable to recover it. 00:26:22.534 [2024-04-16 23:04:13.499570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.534 [2024-04-16 23:04:13.499766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.534 [2024-04-16 23:04:13.499790] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.534 qpair failed and we were unable to recover it. 00:26:22.534 [2024-04-16 23:04:13.499899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.534 [2024-04-16 23:04:13.500065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.534 [2024-04-16 23:04:13.500089] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.534 qpair failed and we were unable to recover it. 00:26:22.534 [2024-04-16 23:04:13.500235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.534 [2024-04-16 23:04:13.500348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.534 [2024-04-16 23:04:13.500373] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.534 qpair failed and we were unable to recover it. 00:26:22.534 [2024-04-16 23:04:13.500486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.534 [2024-04-16 23:04:13.500684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.534 [2024-04-16 23:04:13.500709] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.534 qpair failed and we were unable to recover it. 00:26:22.534 [2024-04-16 23:04:13.500843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.534 [2024-04-16 23:04:13.500993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.534 [2024-04-16 23:04:13.501021] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.534 qpair failed and we were unable to recover it. 00:26:22.534 [2024-04-16 23:04:13.501199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.534 [2024-04-16 23:04:13.501323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.534 [2024-04-16 23:04:13.501350] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.534 qpair failed and we were unable to recover it. 00:26:22.534 [2024-04-16 23:04:13.501516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.534 [2024-04-16 23:04:13.501684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.534 [2024-04-16 23:04:13.501724] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.534 qpair failed and we were unable to recover it. 00:26:22.534 [2024-04-16 23:04:13.501880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.534 [2024-04-16 23:04:13.502058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.534 [2024-04-16 23:04:13.502086] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.534 qpair failed and we were unable to recover it. 00:26:22.534 [2024-04-16 23:04:13.502295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.534 [2024-04-16 23:04:13.502475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.534 [2024-04-16 23:04:13.502502] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.534 qpair failed and we were unable to recover it. 00:26:22.535 [2024-04-16 23:04:13.502651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.535 [2024-04-16 23:04:13.502841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.535 [2024-04-16 23:04:13.502865] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.535 qpair failed and we were unable to recover it. 00:26:22.535 [2024-04-16 23:04:13.503006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.535 [2024-04-16 23:04:13.503151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.535 [2024-04-16 23:04:13.503187] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.535 qpair failed and we were unable to recover it. 00:26:22.535 [2024-04-16 23:04:13.503385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.535 [2024-04-16 23:04:13.503498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.535 [2024-04-16 23:04:13.503522] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.535 qpair failed and we were unable to recover it. 00:26:22.535 [2024-04-16 23:04:13.503654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.535 [2024-04-16 23:04:13.503834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.535 [2024-04-16 23:04:13.503862] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.535 qpair failed and we were unable to recover it. 00:26:22.535 [2024-04-16 23:04:13.504041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.535 [2024-04-16 23:04:13.504162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.535 [2024-04-16 23:04:13.504196] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.535 qpair failed and we were unable to recover it. 00:26:22.535 [2024-04-16 23:04:13.504357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.535 [2024-04-16 23:04:13.504462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.535 [2024-04-16 23:04:13.504486] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.535 qpair failed and we were unable to recover it. 00:26:22.535 [2024-04-16 23:04:13.504645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.535 [2024-04-16 23:04:13.504804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.535 [2024-04-16 23:04:13.504831] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.535 qpair failed and we were unable to recover it. 00:26:22.535 [2024-04-16 23:04:13.504954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.535 [2024-04-16 23:04:13.505105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.535 [2024-04-16 23:04:13.505132] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.535 qpair failed and we were unable to recover it. 00:26:22.535 [2024-04-16 23:04:13.505290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.535 [2024-04-16 23:04:13.505440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.535 [2024-04-16 23:04:13.505468] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.535 qpair failed and we were unable to recover it. 00:26:22.535 [2024-04-16 23:04:13.505632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.535 [2024-04-16 23:04:13.505773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.535 [2024-04-16 23:04:13.505797] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.535 qpair failed and we were unable to recover it. 00:26:22.535 [2024-04-16 23:04:13.505963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.535 [2024-04-16 23:04:13.506092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.535 [2024-04-16 23:04:13.506118] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.535 qpair failed and we were unable to recover it. 00:26:22.535 [2024-04-16 23:04:13.506296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.535 [2024-04-16 23:04:13.506421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.535 [2024-04-16 23:04:13.506453] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.535 qpair failed and we were unable to recover it. 00:26:22.535 [2024-04-16 23:04:13.506643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.535 [2024-04-16 23:04:13.506774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.535 [2024-04-16 23:04:13.506802] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.535 qpair failed and we were unable to recover it. 00:26:22.535 [2024-04-16 23:04:13.506965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.535 [2024-04-16 23:04:13.507107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.535 [2024-04-16 23:04:13.507147] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.535 qpair failed and we were unable to recover it. 00:26:22.535 [2024-04-16 23:04:13.507354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.535 [2024-04-16 23:04:13.507464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.535 [2024-04-16 23:04:13.507488] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.535 qpair failed and we were unable to recover it. 00:26:22.535 [2024-04-16 23:04:13.507654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.535 [2024-04-16 23:04:13.507779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.535 [2024-04-16 23:04:13.507805] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.535 qpair failed and we were unable to recover it. 00:26:22.535 [2024-04-16 23:04:13.507939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.535 [2024-04-16 23:04:13.508091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.535 [2024-04-16 23:04:13.508118] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.535 qpair failed and we were unable to recover it. 00:26:22.535 [2024-04-16 23:04:13.508275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.535 [2024-04-16 23:04:13.508380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.535 [2024-04-16 23:04:13.508404] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.535 qpair failed and we were unable to recover it. 00:26:22.535 [2024-04-16 23:04:13.508535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.535 [2024-04-16 23:04:13.508655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.535 [2024-04-16 23:04:13.508681] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.535 qpair failed and we were unable to recover it. 00:26:22.535 [2024-04-16 23:04:13.508828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.535 [2024-04-16 23:04:13.508978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.535 [2024-04-16 23:04:13.509005] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.535 qpair failed and we were unable to recover it. 00:26:22.535 [2024-04-16 23:04:13.509197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.535 [2024-04-16 23:04:13.509337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.535 [2024-04-16 23:04:13.509361] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.535 qpair failed and we were unable to recover it. 00:26:22.535 [2024-04-16 23:04:13.509502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.535 [2024-04-16 23:04:13.509611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.535 [2024-04-16 23:04:13.509637] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.535 qpair failed and we were unable to recover it. 00:26:22.535 [2024-04-16 23:04:13.509825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.535 [2024-04-16 23:04:13.509972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.535 [2024-04-16 23:04:13.509999] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.535 qpair failed and we were unable to recover it. 00:26:22.535 [2024-04-16 23:04:13.510206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.535 [2024-04-16 23:04:13.510351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.535 [2024-04-16 23:04:13.510377] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.535 qpair failed and we were unable to recover it. 00:26:22.535 [2024-04-16 23:04:13.510516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.535 [2024-04-16 23:04:13.510655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.535 [2024-04-16 23:04:13.510680] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.535 qpair failed and we were unable to recover it. 00:26:22.535 [2024-04-16 23:04:13.510855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.535 [2024-04-16 23:04:13.511009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.535 [2024-04-16 23:04:13.511036] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.535 qpair failed and we were unable to recover it. 00:26:22.535 [2024-04-16 23:04:13.511189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.535 [2024-04-16 23:04:13.511357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.535 [2024-04-16 23:04:13.511381] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.535 qpair failed and we were unable to recover it. 00:26:22.535 [2024-04-16 23:04:13.511548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.535 [2024-04-16 23:04:13.511690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.535 [2024-04-16 23:04:13.511714] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.535 qpair failed and we were unable to recover it. 00:26:22.535 [2024-04-16 23:04:13.511891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.535 [2024-04-16 23:04:13.512009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.535 [2024-04-16 23:04:13.512034] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.535 qpair failed and we were unable to recover it. 00:26:22.535 [2024-04-16 23:04:13.512198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.536 [2024-04-16 23:04:13.512338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.536 [2024-04-16 23:04:13.512362] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.536 qpair failed and we were unable to recover it. 00:26:22.536 [2024-04-16 23:04:13.512502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.536 [2024-04-16 23:04:13.512698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.536 [2024-04-16 23:04:13.512722] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.536 qpair failed and we were unable to recover it. 00:26:22.536 [2024-04-16 23:04:13.512857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.536 [2024-04-16 23:04:13.513035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.536 [2024-04-16 23:04:13.513060] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.536 qpair failed and we were unable to recover it. 00:26:22.536 [2024-04-16 23:04:13.513206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.536 [2024-04-16 23:04:13.513347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.536 [2024-04-16 23:04:13.513374] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.536 qpair failed and we were unable to recover it. 00:26:22.536 [2024-04-16 23:04:13.513533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.536 [2024-04-16 23:04:13.513667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.536 [2024-04-16 23:04:13.513691] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.536 qpair failed and we were unable to recover it. 00:26:22.536 [2024-04-16 23:04:13.513852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.536 [2024-04-16 23:04:13.514006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.536 [2024-04-16 23:04:13.514034] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.536 qpair failed and we were unable to recover it. 00:26:22.536 [2024-04-16 23:04:13.514185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.536 [2024-04-16 23:04:13.514313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.536 [2024-04-16 23:04:13.514341] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.536 qpair failed and we were unable to recover it. 00:26:22.536 [2024-04-16 23:04:13.514509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.536 [2024-04-16 23:04:13.514618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.536 [2024-04-16 23:04:13.514643] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.536 qpair failed and we were unable to recover it. 00:26:22.536 [2024-04-16 23:04:13.514751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.536 [2024-04-16 23:04:13.514861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.536 [2024-04-16 23:04:13.514885] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.536 qpair failed and we were unable to recover it. 00:26:22.536 [2024-04-16 23:04:13.515019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.536 [2024-04-16 23:04:13.515167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.536 [2024-04-16 23:04:13.515199] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.536 qpair failed and we were unable to recover it. 00:26:22.536 [2024-04-16 23:04:13.515363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.536 [2024-04-16 23:04:13.515521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.536 [2024-04-16 23:04:13.515578] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.536 qpair failed and we were unable to recover it. 00:26:22.536 [2024-04-16 23:04:13.515782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.536 [2024-04-16 23:04:13.515920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.536 [2024-04-16 23:04:13.515944] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.536 qpair failed and we were unable to recover it. 00:26:22.536 [2024-04-16 23:04:13.516154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.536 [2024-04-16 23:04:13.516338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.536 [2024-04-16 23:04:13.516363] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.536 qpair failed and we were unable to recover it. 00:26:22.536 [2024-04-16 23:04:13.516503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.536 [2024-04-16 23:04:13.516659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.536 [2024-04-16 23:04:13.516687] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.536 qpair failed and we were unable to recover it. 00:26:22.536 [2024-04-16 23:04:13.516893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.536 [2024-04-16 23:04:13.517067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.536 [2024-04-16 23:04:13.517091] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.536 qpair failed and we were unable to recover it. 00:26:22.536 [2024-04-16 23:04:13.517263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.536 [2024-04-16 23:04:13.517443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.536 [2024-04-16 23:04:13.517471] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.536 qpair failed and we were unable to recover it. 00:26:22.536 [2024-04-16 23:04:13.517638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.536 [2024-04-16 23:04:13.517775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.536 [2024-04-16 23:04:13.517799] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.536 qpair failed and we were unable to recover it. 00:26:22.536 [2024-04-16 23:04:13.517966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.536 [2024-04-16 23:04:13.518103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.536 [2024-04-16 23:04:13.518131] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.536 qpair failed and we were unable to recover it. 00:26:22.536 [2024-04-16 23:04:13.518283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.536 [2024-04-16 23:04:13.518407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.536 [2024-04-16 23:04:13.518434] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.536 qpair failed and we were unable to recover it. 00:26:22.536 [2024-04-16 23:04:13.518629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.536 [2024-04-16 23:04:13.518745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.536 [2024-04-16 23:04:13.518769] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.536 qpair failed and we were unable to recover it. 00:26:22.536 [2024-04-16 23:04:13.518906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.536 [2024-04-16 23:04:13.519074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.536 [2024-04-16 23:04:13.519098] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.536 qpair failed and we were unable to recover it. 00:26:22.536 [2024-04-16 23:04:13.519241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.536 [2024-04-16 23:04:13.519409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.536 [2024-04-16 23:04:13.519436] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.536 qpair failed and we were unable to recover it. 00:26:22.536 [2024-04-16 23:04:13.519656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.536 [2024-04-16 23:04:13.519862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.536 [2024-04-16 23:04:13.519912] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.536 qpair failed and we were unable to recover it. 00:26:22.536 [2024-04-16 23:04:13.520089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.536 [2024-04-16 23:04:13.520226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.536 [2024-04-16 23:04:13.520254] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.536 qpair failed and we were unable to recover it. 00:26:22.536 [2024-04-16 23:04:13.520420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.536 [2024-04-16 23:04:13.520556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.536 [2024-04-16 23:04:13.520595] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.536 qpair failed and we were unable to recover it. 00:26:22.536 [2024-04-16 23:04:13.520743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.537 [2024-04-16 23:04:13.520867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.537 [2024-04-16 23:04:13.520895] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.537 qpair failed and we were unable to recover it. 00:26:22.537 [2024-04-16 23:04:13.521064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.537 [2024-04-16 23:04:13.521232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.537 [2024-04-16 23:04:13.521256] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.537 qpair failed and we were unable to recover it. 00:26:22.537 [2024-04-16 23:04:13.521419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.537 [2024-04-16 23:04:13.521575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.537 [2024-04-16 23:04:13.521603] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.537 qpair failed and we were unable to recover it. 00:26:22.537 [2024-04-16 23:04:13.521741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.537 [2024-04-16 23:04:13.521905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.537 [2024-04-16 23:04:13.521929] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.537 qpair failed and we were unable to recover it. 00:26:22.537 [2024-04-16 23:04:13.522091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.537 [2024-04-16 23:04:13.522216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.537 [2024-04-16 23:04:13.522244] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.537 qpair failed and we were unable to recover it. 00:26:22.537 [2024-04-16 23:04:13.522372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.537 [2024-04-16 23:04:13.522528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.537 [2024-04-16 23:04:13.522555] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.537 qpair failed and we were unable to recover it. 00:26:22.537 [2024-04-16 23:04:13.522704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.537 [2024-04-16 23:04:13.522857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.537 [2024-04-16 23:04:13.522883] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.537 qpair failed and we were unable to recover it. 00:26:22.537 [2024-04-16 23:04:13.523044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.537 [2024-04-16 23:04:13.523181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.537 [2024-04-16 23:04:13.523207] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.537 qpair failed and we were unable to recover it. 00:26:22.537 [2024-04-16 23:04:13.523348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.537 [2024-04-16 23:04:13.523503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.537 [2024-04-16 23:04:13.523535] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.537 qpair failed and we were unable to recover it. 00:26:22.537 [2024-04-16 23:04:13.523759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.537 [2024-04-16 23:04:13.523915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.537 [2024-04-16 23:04:13.523941] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.537 qpair failed and we were unable to recover it. 00:26:22.537 [2024-04-16 23:04:13.524094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.537 [2024-04-16 23:04:13.524282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.537 [2024-04-16 23:04:13.524308] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.537 qpair failed and we were unable to recover it. 00:26:22.537 [2024-04-16 23:04:13.524427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.537 [2024-04-16 23:04:13.524568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.537 [2024-04-16 23:04:13.524593] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.537 qpair failed and we were unable to recover it. 00:26:22.537 [2024-04-16 23:04:13.524763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.537 [2024-04-16 23:04:13.524885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.537 [2024-04-16 23:04:13.524911] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.537 qpair failed and we were unable to recover it. 00:26:22.537 [2024-04-16 23:04:13.525028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.537 [2024-04-16 23:04:13.525159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.537 [2024-04-16 23:04:13.525196] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.537 qpair failed and we were unable to recover it. 00:26:22.537 [2024-04-16 23:04:13.525318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.537 [2024-04-16 23:04:13.525442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.537 [2024-04-16 23:04:13.525470] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.537 qpair failed and we were unable to recover it. 00:26:22.537 [2024-04-16 23:04:13.525635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.537 [2024-04-16 23:04:13.525746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.537 [2024-04-16 23:04:13.525770] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.537 qpair failed and we were unable to recover it. 00:26:22.537 [2024-04-16 23:04:13.525931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.537 [2024-04-16 23:04:13.526052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.537 [2024-04-16 23:04:13.526079] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.537 qpair failed and we were unable to recover it. 00:26:22.537 [2024-04-16 23:04:13.526216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.537 [2024-04-16 23:04:13.526347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.537 [2024-04-16 23:04:13.526375] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.537 qpair failed and we were unable to recover it. 00:26:22.537 [2024-04-16 23:04:13.526533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.537 [2024-04-16 23:04:13.526663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.537 [2024-04-16 23:04:13.526690] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.537 qpair failed and we were unable to recover it. 00:26:22.537 [2024-04-16 23:04:13.526860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.537 [2024-04-16 23:04:13.526974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.537 [2024-04-16 23:04:13.526999] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.537 qpair failed and we were unable to recover it. 00:26:22.537 [2024-04-16 23:04:13.527140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.537 [2024-04-16 23:04:13.527280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.537 [2024-04-16 23:04:13.527308] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.537 qpair failed and we were unable to recover it. 00:26:22.537 [2024-04-16 23:04:13.527442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.537 [2024-04-16 23:04:13.527595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.537 [2024-04-16 23:04:13.527623] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.537 qpair failed and we were unable to recover it. 00:26:22.537 [2024-04-16 23:04:13.527777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.537 [2024-04-16 23:04:13.527936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.537 [2024-04-16 23:04:13.527963] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.537 qpair failed and we were unable to recover it. 00:26:22.537 [2024-04-16 23:04:13.528128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.537 [2024-04-16 23:04:13.528237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.537 [2024-04-16 23:04:13.528262] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.537 qpair failed and we were unable to recover it. 00:26:22.537 [2024-04-16 23:04:13.528430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.537 [2024-04-16 23:04:13.528620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.537 [2024-04-16 23:04:13.528645] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.537 qpair failed and we were unable to recover it. 00:26:22.537 [2024-04-16 23:04:13.528784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.537 [2024-04-16 23:04:13.528948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.537 [2024-04-16 23:04:13.528975] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.537 qpair failed and we were unable to recover it. 00:26:22.537 [2024-04-16 23:04:13.529142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.537 [2024-04-16 23:04:13.529285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.537 [2024-04-16 23:04:13.529309] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.537 qpair failed and we were unable to recover it. 00:26:22.537 [2024-04-16 23:04:13.529428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.537 [2024-04-16 23:04:13.529595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.537 [2024-04-16 23:04:13.529636] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.537 qpair failed and we were unable to recover it. 00:26:22.537 [2024-04-16 23:04:13.529791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.537 [2024-04-16 23:04:13.529939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.537 [2024-04-16 23:04:13.529967] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.537 qpair failed and we were unable to recover it. 00:26:22.537 [2024-04-16 23:04:13.530126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.538 [2024-04-16 23:04:13.530289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.538 [2024-04-16 23:04:13.530317] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.538 qpair failed and we were unable to recover it. 00:26:22.538 [2024-04-16 23:04:13.530445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.538 [2024-04-16 23:04:13.530629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.538 [2024-04-16 23:04:13.530657] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.538 qpair failed and we were unable to recover it. 00:26:22.538 [2024-04-16 23:04:13.530817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.538 [2024-04-16 23:04:13.530925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.538 [2024-04-16 23:04:13.530950] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.538 qpair failed and we were unable to recover it. 00:26:22.538 [2024-04-16 23:04:13.531090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.538 [2024-04-16 23:04:13.531240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.538 [2024-04-16 23:04:13.531269] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.538 qpair failed and we were unable to recover it. 00:26:22.538 [2024-04-16 23:04:13.531384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.538 [2024-04-16 23:04:13.531563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.538 [2024-04-16 23:04:13.531590] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.538 qpair failed and we were unable to recover it. 00:26:22.538 [2024-04-16 23:04:13.531773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.538 [2024-04-16 23:04:13.531893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.538 [2024-04-16 23:04:13.531921] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.538 qpair failed and we were unable to recover it. 00:26:22.538 [2024-04-16 23:04:13.532083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.538 [2024-04-16 23:04:13.532221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.538 [2024-04-16 23:04:13.532246] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.538 qpair failed and we were unable to recover it. 00:26:22.538 [2024-04-16 23:04:13.532433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.538 [2024-04-16 23:04:13.532576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.538 [2024-04-16 23:04:13.532605] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.538 qpair failed and we were unable to recover it. 00:26:22.538 [2024-04-16 23:04:13.532765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.538 [2024-04-16 23:04:13.532917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.538 [2024-04-16 23:04:13.532945] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.538 qpair failed and we were unable to recover it. 00:26:22.538 [2024-04-16 23:04:13.533101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.538 [2024-04-16 23:04:13.533283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.538 [2024-04-16 23:04:13.533312] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.538 qpair failed and we were unable to recover it. 00:26:22.538 [2024-04-16 23:04:13.533479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.538 [2024-04-16 23:04:13.533618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.538 [2024-04-16 23:04:13.533643] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.538 qpair failed and we were unable to recover it. 00:26:22.538 [2024-04-16 23:04:13.533802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.538 [2024-04-16 23:04:13.533982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.538 [2024-04-16 23:04:13.534010] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.538 qpair failed and we were unable to recover it. 00:26:22.538 [2024-04-16 23:04:13.534161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.538 [2024-04-16 23:04:13.534335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.538 [2024-04-16 23:04:13.534364] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.538 qpair failed and we were unable to recover it. 00:26:22.538 [2024-04-16 23:04:13.534516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.538 [2024-04-16 23:04:13.534677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.538 [2024-04-16 23:04:13.534702] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.538 qpair failed and we were unable to recover it. 00:26:22.538 [2024-04-16 23:04:13.534842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.538 [2024-04-16 23:04:13.534954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.538 [2024-04-16 23:04:13.534978] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.538 qpair failed and we were unable to recover it. 00:26:22.538 [2024-04-16 23:04:13.535140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.538 [2024-04-16 23:04:13.535275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.538 [2024-04-16 23:04:13.535305] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.538 qpair failed and we were unable to recover it. 00:26:22.538 [2024-04-16 23:04:13.535467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.538 [2024-04-16 23:04:13.535622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.538 [2024-04-16 23:04:13.535649] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.538 qpair failed and we were unable to recover it. 00:26:22.538 [2024-04-16 23:04:13.535776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.538 [2024-04-16 23:04:13.535931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.538 [2024-04-16 23:04:13.535958] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.538 qpair failed and we were unable to recover it. 00:26:22.538 [2024-04-16 23:04:13.536147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.538 [2024-04-16 23:04:13.536278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.538 [2024-04-16 23:04:13.536321] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.538 qpair failed and we were unable to recover it. 00:26:22.538 [2024-04-16 23:04:13.536472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.538 [2024-04-16 23:04:13.536619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.538 [2024-04-16 23:04:13.536647] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.538 qpair failed and we were unable to recover it. 00:26:22.538 [2024-04-16 23:04:13.536848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.538 [2024-04-16 23:04:13.537063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.538 [2024-04-16 23:04:13.537091] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.538 qpair failed and we were unable to recover it. 00:26:22.538 [2024-04-16 23:04:13.537220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.538 [2024-04-16 23:04:13.537374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.538 [2024-04-16 23:04:13.537401] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.538 qpair failed and we were unable to recover it. 00:26:22.538 [2024-04-16 23:04:13.537590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.538 [2024-04-16 23:04:13.537701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.538 [2024-04-16 23:04:13.537728] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.538 qpair failed and we were unable to recover it. 00:26:22.538 [2024-04-16 23:04:13.537892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.538 [2024-04-16 23:04:13.538054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.538 [2024-04-16 23:04:13.538082] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.538 qpair failed and we were unable to recover it. 00:26:22.538 [2024-04-16 23:04:13.538236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.538 [2024-04-16 23:04:13.538395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.538 [2024-04-16 23:04:13.538423] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.538 qpair failed and we were unable to recover it. 00:26:22.538 [2024-04-16 23:04:13.538548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.538 [2024-04-16 23:04:13.538699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.538 [2024-04-16 23:04:13.538727] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.538 qpair failed and we were unable to recover it. 00:26:22.538 [2024-04-16 23:04:13.538869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.538 [2024-04-16 23:04:13.539016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.538 [2024-04-16 23:04:13.539041] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.538 qpair failed and we were unable to recover it. 00:26:22.538 [2024-04-16 23:04:13.539156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.538 [2024-04-16 23:04:13.539289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.538 [2024-04-16 23:04:13.539315] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.538 qpair failed and we were unable to recover it. 00:26:22.538 [2024-04-16 23:04:13.539484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.538 [2024-04-16 23:04:13.539629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.538 [2024-04-16 23:04:13.539654] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.538 qpair failed and we were unable to recover it. 00:26:22.538 [2024-04-16 23:04:13.539782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.538 [2024-04-16 23:04:13.539926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.539 [2024-04-16 23:04:13.539954] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.539 qpair failed and we were unable to recover it. 00:26:22.539 [2024-04-16 23:04:13.540130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.539 [2024-04-16 23:04:13.540306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.539 [2024-04-16 23:04:13.540352] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.539 qpair failed and we were unable to recover it. 00:26:22.539 [2024-04-16 23:04:13.540491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.539 [2024-04-16 23:04:13.540622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.539 [2024-04-16 23:04:13.540647] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.539 qpair failed and we were unable to recover it. 00:26:22.539 [2024-04-16 23:04:13.540812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.539 [2024-04-16 23:04:13.540961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.539 [2024-04-16 23:04:13.540988] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.539 qpair failed and we were unable to recover it. 00:26:22.539 [2024-04-16 23:04:13.541172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.539 [2024-04-16 23:04:13.541340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.539 [2024-04-16 23:04:13.541364] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.539 qpair failed and we were unable to recover it. 00:26:22.539 [2024-04-16 23:04:13.541534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.539 [2024-04-16 23:04:13.541672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.539 [2024-04-16 23:04:13.541697] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.539 qpair failed and we were unable to recover it. 00:26:22.539 [2024-04-16 23:04:13.541884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.539 [2024-04-16 23:04:13.542036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.539 [2024-04-16 23:04:13.542064] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.539 qpair failed and we were unable to recover it. 00:26:22.539 [2024-04-16 23:04:13.542208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.539 [2024-04-16 23:04:13.542391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.539 [2024-04-16 23:04:13.542419] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.539 qpair failed and we were unable to recover it. 00:26:22.539 [2024-04-16 23:04:13.542542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.539 [2024-04-16 23:04:13.542733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.539 [2024-04-16 23:04:13.542757] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.539 qpair failed and we were unable to recover it. 00:26:22.539 [2024-04-16 23:04:13.542868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.539 [2024-04-16 23:04:13.543039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.539 [2024-04-16 23:04:13.543064] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.539 qpair failed and we were unable to recover it. 00:26:22.539 [2024-04-16 23:04:13.543246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.539 [2024-04-16 23:04:13.543359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.539 [2024-04-16 23:04:13.543384] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.539 qpair failed and we were unable to recover it. 00:26:22.539 [2024-04-16 23:04:13.543530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.539 [2024-04-16 23:04:13.543665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.539 [2024-04-16 23:04:13.543693] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.539 qpair failed and we were unable to recover it. 00:26:22.539 [2024-04-16 23:04:13.543857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.539 [2024-04-16 23:04:13.543974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.539 [2024-04-16 23:04:13.544000] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.539 qpair failed and we were unable to recover it. 00:26:22.539 [2024-04-16 23:04:13.544149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.539 [2024-04-16 23:04:13.544284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.539 [2024-04-16 23:04:13.544310] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.539 qpair failed and we were unable to recover it. 00:26:22.539 [2024-04-16 23:04:13.544423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.539 [2024-04-16 23:04:13.544562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.539 [2024-04-16 23:04:13.544586] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.539 qpair failed and we were unable to recover it. 00:26:22.539 [2024-04-16 23:04:13.544780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.539 [2024-04-16 23:04:13.544949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.539 [2024-04-16 23:04:13.544991] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.539 qpair failed and we were unable to recover it. 00:26:22.539 [2024-04-16 23:04:13.545174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.539 [2024-04-16 23:04:13.545343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.539 [2024-04-16 23:04:13.545368] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.539 qpair failed and we were unable to recover it. 00:26:22.539 [2024-04-16 23:04:13.545509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.539 [2024-04-16 23:04:13.545651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.539 [2024-04-16 23:04:13.545692] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.539 qpair failed and we were unable to recover it. 00:26:22.539 [2024-04-16 23:04:13.545857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.539 [2024-04-16 23:04:13.546001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.539 [2024-04-16 23:04:13.546027] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.539 qpair failed and we were unable to recover it. 00:26:22.539 [2024-04-16 23:04:13.546230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.539 [2024-04-16 23:04:13.546398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.539 [2024-04-16 23:04:13.546439] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.539 qpair failed and we were unable to recover it. 00:26:22.539 [2024-04-16 23:04:13.546560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.539 [2024-04-16 23:04:13.546722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.539 [2024-04-16 23:04:13.546746] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.539 qpair failed and we were unable to recover it. 00:26:22.539 [2024-04-16 23:04:13.546883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.539 [2024-04-16 23:04:13.547030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.539 [2024-04-16 23:04:13.547056] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.539 qpair failed and we were unable to recover it. 00:26:22.539 [2024-04-16 23:04:13.547163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.539 [2024-04-16 23:04:13.547321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.539 [2024-04-16 23:04:13.547346] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.539 qpair failed and we were unable to recover it. 00:26:22.539 [2024-04-16 23:04:13.547463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.539 [2024-04-16 23:04:13.547632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.539 [2024-04-16 23:04:13.547657] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.539 qpair failed and we were unable to recover it. 00:26:22.539 [2024-04-16 23:04:13.547835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.539 [2024-04-16 23:04:13.548382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.539 [2024-04-16 23:04:13.548414] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.539 qpair failed and we were unable to recover it. 00:26:22.539 [2024-04-16 23:04:13.548618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.539 [2024-04-16 23:04:13.548739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.539 [2024-04-16 23:04:13.548763] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.539 qpair failed and we were unable to recover it. 00:26:22.539 [2024-04-16 23:04:13.548928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.539 [2024-04-16 23:04:13.549125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.539 [2024-04-16 23:04:13.549153] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.539 qpair failed and we were unable to recover it. 00:26:22.539 [2024-04-16 23:04:13.549323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.539 [2024-04-16 23:04:13.549450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.539 [2024-04-16 23:04:13.549479] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.539 qpair failed and we were unable to recover it. 00:26:22.539 [2024-04-16 23:04:13.549633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.539 [2024-04-16 23:04:13.549789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.539 [2024-04-16 23:04:13.549818] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.539 qpair failed and we were unable to recover it. 00:26:22.539 [2024-04-16 23:04:13.549953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.539 [2024-04-16 23:04:13.550122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.540 [2024-04-16 23:04:13.550147] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.540 qpair failed and we were unable to recover it. 00:26:22.540 [2024-04-16 23:04:13.550279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.540 [2024-04-16 23:04:13.550466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.540 [2024-04-16 23:04:13.550490] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.540 qpair failed and we were unable to recover it. 00:26:22.540 [2024-04-16 23:04:13.550612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.540 [2024-04-16 23:04:13.550769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.540 [2024-04-16 23:04:13.550796] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.540 qpair failed and we were unable to recover it. 00:26:22.540 [2024-04-16 23:04:13.550968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.540 [2024-04-16 23:04:13.551125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.540 [2024-04-16 23:04:13.551154] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.540 qpair failed and we were unable to recover it. 00:26:22.540 [2024-04-16 23:04:13.551337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.540 [2024-04-16 23:04:13.551457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.540 [2024-04-16 23:04:13.551482] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.540 qpair failed and we were unable to recover it. 00:26:22.540 [2024-04-16 23:04:13.551682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.540 [2024-04-16 23:04:13.551835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.540 [2024-04-16 23:04:13.551891] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.540 qpair failed and we were unable to recover it. 00:26:22.540 [2024-04-16 23:04:13.552045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.540 [2024-04-16 23:04:13.552191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.540 [2024-04-16 23:04:13.552227] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.540 qpair failed and we were unable to recover it. 00:26:22.540 [2024-04-16 23:04:13.552370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.540 [2024-04-16 23:04:13.552535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.540 [2024-04-16 23:04:13.552562] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.540 qpair failed and we were unable to recover it. 00:26:22.540 [2024-04-16 23:04:13.552706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.540 [2024-04-16 23:04:13.552843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.540 [2024-04-16 23:04:13.552867] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.540 qpair failed and we were unable to recover it. 00:26:22.540 [2024-04-16 23:04:13.553034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.540 [2024-04-16 23:04:13.553157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.540 [2024-04-16 23:04:13.553193] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.540 qpair failed and we were unable to recover it. 00:26:22.540 [2024-04-16 23:04:13.553325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.540 [2024-04-16 23:04:13.553491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.540 [2024-04-16 23:04:13.553519] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.540 qpair failed and we were unable to recover it. 00:26:22.540 [2024-04-16 23:04:13.553674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.540 [2024-04-16 23:04:13.553795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.540 [2024-04-16 23:04:13.553821] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.540 qpair failed and we were unable to recover it. 00:26:22.540 [2024-04-16 23:04:13.553972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.540 [2024-04-16 23:04:13.554089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.540 [2024-04-16 23:04:13.554122] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.540 qpair failed and we were unable to recover it. 00:26:22.540 [2024-04-16 23:04:13.554289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.540 [2024-04-16 23:04:13.554429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.540 [2024-04-16 23:04:13.554456] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.540 qpair failed and we were unable to recover it. 00:26:22.540 [2024-04-16 23:04:13.554619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.540 [2024-04-16 23:04:13.554825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.540 [2024-04-16 23:04:13.554875] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.540 qpair failed and we were unable to recover it. 00:26:22.540 [2024-04-16 23:04:13.555029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.540 [2024-04-16 23:04:13.555187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.540 [2024-04-16 23:04:13.555216] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.540 qpair failed and we were unable to recover it. 00:26:22.540 [2024-04-16 23:04:13.555353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.540 [2024-04-16 23:04:13.555488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.540 [2024-04-16 23:04:13.555513] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.540 qpair failed and we were unable to recover it. 00:26:22.540 [2024-04-16 23:04:13.555680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.540 [2024-04-16 23:04:13.555832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.540 [2024-04-16 23:04:13.555858] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.540 qpair failed and we were unable to recover it. 00:26:22.540 [2024-04-16 23:04:13.556027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.540 [2024-04-16 23:04:13.556183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.540 [2024-04-16 23:04:13.556211] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.540 qpair failed and we were unable to recover it. 00:26:22.540 [2024-04-16 23:04:13.556358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.540 [2024-04-16 23:04:13.556542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.540 [2024-04-16 23:04:13.556599] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.540 qpair failed and we were unable to recover it. 00:26:22.540 [2024-04-16 23:04:13.556768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.540 [2024-04-16 23:04:13.556885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.540 [2024-04-16 23:04:13.556909] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.540 qpair failed and we were unable to recover it. 00:26:22.540 [2024-04-16 23:04:13.557029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.540 [2024-04-16 23:04:13.557194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.540 [2024-04-16 23:04:13.557222] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.540 qpair failed and we were unable to recover it. 00:26:22.540 [2024-04-16 23:04:13.557389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.540 [2024-04-16 23:04:13.557496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.540 [2024-04-16 23:04:13.557520] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.540 qpair failed and we were unable to recover it. 00:26:22.540 [2024-04-16 23:04:13.557711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.540 [2024-04-16 23:04:13.557891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.540 [2024-04-16 23:04:13.557923] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.540 qpair failed and we were unable to recover it. 00:26:22.540 [2024-04-16 23:04:13.558074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.540 [2024-04-16 23:04:13.558213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.540 [2024-04-16 23:04:13.558238] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.540 qpair failed and we were unable to recover it. 00:26:22.540 [2024-04-16 23:04:13.558384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.540 [2024-04-16 23:04:13.558517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.540 [2024-04-16 23:04:13.558544] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.540 qpair failed and we were unable to recover it. 00:26:22.540 [2024-04-16 23:04:13.558704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.540 [2024-04-16 23:04:13.558861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.540 [2024-04-16 23:04:13.558888] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.540 qpair failed and we were unable to recover it. 00:26:22.540 [2024-04-16 23:04:13.559040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.540 [2024-04-16 23:04:13.559193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.540 [2024-04-16 23:04:13.559220] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.540 qpair failed and we were unable to recover it. 00:26:22.540 [2024-04-16 23:04:13.559381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.540 [2024-04-16 23:04:13.559502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.540 [2024-04-16 23:04:13.559526] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.540 qpair failed and we were unable to recover it. 00:26:22.540 [2024-04-16 23:04:13.559672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.540 [2024-04-16 23:04:13.559848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.541 [2024-04-16 23:04:13.559872] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.541 qpair failed and we were unable to recover it. 00:26:22.541 [2024-04-16 23:04:13.560014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.541 [2024-04-16 23:04:13.560192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.541 [2024-04-16 23:04:13.560218] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.541 qpair failed and we were unable to recover it. 00:26:22.541 [2024-04-16 23:04:13.560396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.541 [2024-04-16 23:04:13.560577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.541 [2024-04-16 23:04:13.560601] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.541 qpair failed and we were unable to recover it. 00:26:22.541 [2024-04-16 23:04:13.560764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.541 [2024-04-16 23:04:13.560884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.541 [2024-04-16 23:04:13.560909] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.541 qpair failed and we were unable to recover it. 00:26:22.541 [2024-04-16 23:04:13.561107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.541 [2024-04-16 23:04:13.561251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.541 [2024-04-16 23:04:13.561286] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.541 qpair failed and we were unable to recover it. 00:26:22.541 [2024-04-16 23:04:13.561451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.541 [2024-04-16 23:04:13.561674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.541 [2024-04-16 23:04:13.561699] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.541 qpair failed and we were unable to recover it. 00:26:22.541 [2024-04-16 23:04:13.561841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.541 [2024-04-16 23:04:13.562047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.541 [2024-04-16 23:04:13.562071] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.541 qpair failed and we were unable to recover it. 00:26:22.541 [2024-04-16 23:04:13.562218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.541 [2024-04-16 23:04:13.562367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.541 [2024-04-16 23:04:13.562391] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.541 qpair failed and we were unable to recover it. 00:26:22.541 [2024-04-16 23:04:13.562506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.541 [2024-04-16 23:04:13.562650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.541 [2024-04-16 23:04:13.562674] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.541 qpair failed and we were unable to recover it. 00:26:22.541 [2024-04-16 23:04:13.562895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.541 [2024-04-16 23:04:13.563063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.541 [2024-04-16 23:04:13.563090] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.541 qpair failed and we were unable to recover it. 00:26:22.541 [2024-04-16 23:04:13.563246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.541 [2024-04-16 23:04:13.563416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.541 [2024-04-16 23:04:13.563441] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.541 qpair failed and we were unable to recover it. 00:26:22.541 [2024-04-16 23:04:13.563608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.541 [2024-04-16 23:04:13.563776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.541 [2024-04-16 23:04:13.563834] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.541 qpair failed and we were unable to recover it. 00:26:22.541 [2024-04-16 23:04:13.563996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.541 [2024-04-16 23:04:13.564119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.541 [2024-04-16 23:04:13.564147] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.541 qpair failed and we were unable to recover it. 00:26:22.541 [2024-04-16 23:04:13.564331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.541 [2024-04-16 23:04:13.564496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.541 [2024-04-16 23:04:13.564520] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.541 qpair failed and we were unable to recover it. 00:26:22.541 [2024-04-16 23:04:13.564700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.541 [2024-04-16 23:04:13.564839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.541 [2024-04-16 23:04:13.564864] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.541 qpair failed and we were unable to recover it. 00:26:22.541 [2024-04-16 23:04:13.565014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.541 [2024-04-16 23:04:13.565164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.541 [2024-04-16 23:04:13.565216] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.541 qpair failed and we were unable to recover it. 00:26:22.541 [2024-04-16 23:04:13.565377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.541 [2024-04-16 23:04:13.565490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.541 [2024-04-16 23:04:13.565517] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.541 qpair failed and we were unable to recover it. 00:26:22.541 [2024-04-16 23:04:13.565651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.541 [2024-04-16 23:04:13.565814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.541 [2024-04-16 23:04:13.565838] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.541 qpair failed and we were unable to recover it. 00:26:22.541 [2024-04-16 23:04:13.565948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.541 [2024-04-16 23:04:13.566070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.541 [2024-04-16 23:04:13.566096] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.541 qpair failed and we were unable to recover it. 00:26:22.541 [2024-04-16 23:04:13.566253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.541 [2024-04-16 23:04:13.566372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.541 [2024-04-16 23:04:13.566397] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.541 qpair failed and we were unable to recover it. 00:26:22.541 [2024-04-16 23:04:13.566527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.541 [2024-04-16 23:04:13.566661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.541 [2024-04-16 23:04:13.566689] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.541 qpair failed and we were unable to recover it. 00:26:22.541 [2024-04-16 23:04:13.566871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.541 [2024-04-16 23:04:13.567007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.541 [2024-04-16 23:04:13.567032] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.541 qpair failed and we were unable to recover it. 00:26:22.541 [2024-04-16 23:04:13.567143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.541 [2024-04-16 23:04:13.567262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.541 [2024-04-16 23:04:13.567287] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.541 qpair failed and we were unable to recover it. 00:26:22.541 [2024-04-16 23:04:13.567424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.541 [2024-04-16 23:04:13.567591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.541 [2024-04-16 23:04:13.567615] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.541 qpair failed and we were unable to recover it. 00:26:22.541 [2024-04-16 23:04:13.567764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.541 [2024-04-16 23:04:13.567897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.541 [2024-04-16 23:04:13.567922] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.541 qpair failed and we were unable to recover it. 00:26:22.541 [2024-04-16 23:04:13.568070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.542 [2024-04-16 23:04:13.568329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.542 [2024-04-16 23:04:13.568355] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.542 qpair failed and we were unable to recover it. 00:26:22.542 [2024-04-16 23:04:13.568471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.542 [2024-04-16 23:04:13.568607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.542 [2024-04-16 23:04:13.568632] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.542 qpair failed and we were unable to recover it. 00:26:22.542 [2024-04-16 23:04:13.568736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.542 [2024-04-16 23:04:13.568874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.542 [2024-04-16 23:04:13.568899] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.542 qpair failed and we were unable to recover it. 00:26:22.542 [2024-04-16 23:04:13.569121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.542 [2024-04-16 23:04:13.569261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.542 [2024-04-16 23:04:13.569285] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.542 qpair failed and we were unable to recover it. 00:26:22.542 [2024-04-16 23:04:13.569458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.542 [2024-04-16 23:04:13.569680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.542 [2024-04-16 23:04:13.569740] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.542 qpair failed and we were unable to recover it. 00:26:22.542 [2024-04-16 23:04:13.569886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.542 [2024-04-16 23:04:13.570013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.542 [2024-04-16 23:04:13.570040] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.542 qpair failed and we were unable to recover it. 00:26:22.542 [2024-04-16 23:04:13.570187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.542 [2024-04-16 23:04:13.570303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.542 [2024-04-16 23:04:13.570327] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.542 qpair failed and we were unable to recover it. 00:26:22.542 [2024-04-16 23:04:13.570532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.542 [2024-04-16 23:04:13.570676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.542 [2024-04-16 23:04:13.570701] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.542 qpair failed and we were unable to recover it. 00:26:22.542 [2024-04-16 23:04:13.570844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.542 [2024-04-16 23:04:13.570958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.542 [2024-04-16 23:04:13.570985] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.542 qpair failed and we were unable to recover it. 00:26:22.542 [2024-04-16 23:04:13.571151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.542 [2024-04-16 23:04:13.571298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.542 [2024-04-16 23:04:13.571323] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.542 qpair failed and we were unable to recover it. 00:26:22.542 [2024-04-16 23:04:13.571425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.542 [2024-04-16 23:04:13.571571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.542 [2024-04-16 23:04:13.571597] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.542 qpair failed and we were unable to recover it. 00:26:22.542 [2024-04-16 23:04:13.571765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.542 [2024-04-16 23:04:13.571921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.542 [2024-04-16 23:04:13.571948] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.542 qpair failed and we were unable to recover it. 00:26:22.542 [2024-04-16 23:04:13.572082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.542 [2024-04-16 23:04:13.572210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.542 [2024-04-16 23:04:13.572237] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.542 qpair failed and we were unable to recover it. 00:26:22.542 [2024-04-16 23:04:13.572425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.542 [2024-04-16 23:04:13.572548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.542 [2024-04-16 23:04:13.572574] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.542 qpair failed and we were unable to recover it. 00:26:22.542 [2024-04-16 23:04:13.572731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.542 [2024-04-16 23:04:13.572864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.542 [2024-04-16 23:04:13.572889] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.542 qpair failed and we were unable to recover it. 00:26:22.542 [2024-04-16 23:04:13.573054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.542 [2024-04-16 23:04:13.573169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.542 [2024-04-16 23:04:13.573205] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.542 qpair failed and we were unable to recover it. 00:26:22.542 [2024-04-16 23:04:13.573357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.542 [2024-04-16 23:04:13.573509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.542 [2024-04-16 23:04:13.573536] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.542 qpair failed and we were unable to recover it. 00:26:22.542 [2024-04-16 23:04:13.573694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.542 [2024-04-16 23:04:13.573848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.542 [2024-04-16 23:04:13.573874] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.542 qpair failed and we were unable to recover it. 00:26:22.542 [2024-04-16 23:04:13.574036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.542 [2024-04-16 23:04:13.574148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.542 [2024-04-16 23:04:13.574172] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.542 qpair failed and we were unable to recover it. 00:26:22.542 [2024-04-16 23:04:13.574336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.542 [2024-04-16 23:04:13.574493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.542 [2024-04-16 23:04:13.574520] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.542 qpair failed and we were unable to recover it. 00:26:22.542 [2024-04-16 23:04:13.574652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.542 [2024-04-16 23:04:13.574809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.542 [2024-04-16 23:04:13.574834] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.542 qpair failed and we were unable to recover it. 00:26:22.542 [2024-04-16 23:04:13.574992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.542 [2024-04-16 23:04:13.575172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.542 [2024-04-16 23:04:13.575208] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.542 qpair failed and we were unable to recover it. 00:26:22.542 [2024-04-16 23:04:13.575337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.542 [2024-04-16 23:04:13.575481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.542 [2024-04-16 23:04:13.575506] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.542 qpair failed and we were unable to recover it. 00:26:22.542 [2024-04-16 23:04:13.575667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.542 [2024-04-16 23:04:13.575820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.542 [2024-04-16 23:04:13.575847] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.542 qpair failed and we were unable to recover it. 00:26:22.542 [2024-04-16 23:04:13.576082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.542 [2024-04-16 23:04:13.576252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.542 [2024-04-16 23:04:13.576277] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.542 qpair failed and we were unable to recover it. 00:26:22.542 [2024-04-16 23:04:13.576419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.542 [2024-04-16 23:04:13.576660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.542 [2024-04-16 23:04:13.576687] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.542 qpair failed and we were unable to recover it. 00:26:22.542 [2024-04-16 23:04:13.576822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.542 [2024-04-16 23:04:13.576936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.542 [2024-04-16 23:04:13.576961] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.542 qpair failed and we were unable to recover it. 00:26:22.542 [2024-04-16 23:04:13.577105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.542 [2024-04-16 23:04:13.577259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.542 [2024-04-16 23:04:13.577287] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.542 qpair failed and we were unable to recover it. 00:26:22.542 [2024-04-16 23:04:13.577440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.542 [2024-04-16 23:04:13.577620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.542 [2024-04-16 23:04:13.577670] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.542 qpair failed and we were unable to recover it. 00:26:22.542 [2024-04-16 23:04:13.577788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.543 [2024-04-16 23:04:13.577937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.543 [2024-04-16 23:04:13.577965] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.543 qpair failed and we were unable to recover it. 00:26:22.543 [2024-04-16 23:04:13.578121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.543 [2024-04-16 23:04:13.578230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.543 [2024-04-16 23:04:13.578260] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.543 qpair failed and we were unable to recover it. 00:26:22.543 [2024-04-16 23:04:13.578373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.543 [2024-04-16 23:04:13.578493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.543 [2024-04-16 23:04:13.578518] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.543 qpair failed and we were unable to recover it. 00:26:22.543 [2024-04-16 23:04:13.578623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.543 [2024-04-16 23:04:13.578764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.543 [2024-04-16 23:04:13.578788] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.543 qpair failed and we were unable to recover it. 00:26:22.543 [2024-04-16 23:04:13.578974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.543 [2024-04-16 23:04:13.579124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.543 [2024-04-16 23:04:13.579151] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.543 qpair failed and we were unable to recover it. 00:26:22.543 [2024-04-16 23:04:13.579314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.543 [2024-04-16 23:04:13.579422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.543 [2024-04-16 23:04:13.579447] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.543 qpair failed and we were unable to recover it. 00:26:22.543 [2024-04-16 23:04:13.579611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.543 [2024-04-16 23:04:13.579756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.543 [2024-04-16 23:04:13.579784] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.543 qpair failed and we were unable to recover it. 00:26:22.543 [2024-04-16 23:04:13.579946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.543 [2024-04-16 23:04:13.580113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.543 [2024-04-16 23:04:13.580138] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.543 qpair failed and we were unable to recover it. 00:26:22.543 [2024-04-16 23:04:13.580327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.543 [2024-04-16 23:04:13.580467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.543 [2024-04-16 23:04:13.580494] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.543 qpair failed and we were unable to recover it. 00:26:22.543 [2024-04-16 23:04:13.580716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.543 [2024-04-16 23:04:13.580861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.543 [2024-04-16 23:04:13.580888] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.543 qpair failed and we were unable to recover it. 00:26:22.543 [2024-04-16 23:04:13.581010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.543 [2024-04-16 23:04:13.581182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.543 [2024-04-16 23:04:13.581208] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.543 qpair failed and we were unable to recover it. 00:26:22.543 [2024-04-16 23:04:13.581358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.543 [2024-04-16 23:04:13.581475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.543 [2024-04-16 23:04:13.581500] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.543 qpair failed and we were unable to recover it. 00:26:22.543 [2024-04-16 23:04:13.581631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.543 [2024-04-16 23:04:13.581795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.543 [2024-04-16 23:04:13.581820] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.543 qpair failed and we were unable to recover it. 00:26:22.543 [2024-04-16 23:04:13.581933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.543 [2024-04-16 23:04:13.582044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.543 [2024-04-16 23:04:13.582069] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.543 qpair failed and we were unable to recover it. 00:26:22.543 [2024-04-16 23:04:13.582215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.543 [2024-04-16 23:04:13.582400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.543 [2024-04-16 23:04:13.582427] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.543 qpair failed and we were unable to recover it. 00:26:22.543 [2024-04-16 23:04:13.582576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.543 [2024-04-16 23:04:13.582697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.543 [2024-04-16 23:04:13.582726] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.543 qpair failed and we were unable to recover it. 00:26:22.543 [2024-04-16 23:04:13.582855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.543 [2024-04-16 23:04:13.583019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.543 [2024-04-16 23:04:13.583045] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.543 qpair failed and we were unable to recover it. 00:26:22.543 [2024-04-16 23:04:13.583196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.543 [2024-04-16 23:04:13.583310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.543 [2024-04-16 23:04:13.583335] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.543 qpair failed and we were unable to recover it. 00:26:22.543 [2024-04-16 23:04:13.583478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.543 [2024-04-16 23:04:13.583672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.543 [2024-04-16 23:04:13.583696] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.543 qpair failed and we were unable to recover it. 00:26:22.543 [2024-04-16 23:04:13.583812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.543 [2024-04-16 23:04:13.584012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.543 [2024-04-16 23:04:13.584037] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.543 qpair failed and we were unable to recover it. 00:26:22.543 [2024-04-16 23:04:13.584186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.543 [2024-04-16 23:04:13.584362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.543 [2024-04-16 23:04:13.584391] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.543 qpair failed and we were unable to recover it. 00:26:22.543 [2024-04-16 23:04:13.584529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.543 [2024-04-16 23:04:13.584669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.543 [2024-04-16 23:04:13.584694] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.543 qpair failed and we were unable to recover it. 00:26:22.543 [2024-04-16 23:04:13.584845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.543 [2024-04-16 23:04:13.585030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.543 [2024-04-16 23:04:13.585054] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.543 qpair failed and we were unable to recover it. 00:26:22.543 [2024-04-16 23:04:13.585197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.543 [2024-04-16 23:04:13.585375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.543 [2024-04-16 23:04:13.585400] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.543 qpair failed and we were unable to recover it. 00:26:22.543 [2024-04-16 23:04:13.585542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.543 [2024-04-16 23:04:13.585711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.543 [2024-04-16 23:04:13.585738] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.543 qpair failed and we were unable to recover it. 00:26:22.543 [2024-04-16 23:04:13.585877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.543 [2024-04-16 23:04:13.586021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.543 [2024-04-16 23:04:13.586046] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.543 qpair failed and we were unable to recover it. 00:26:22.543 [2024-04-16 23:04:13.586205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.543 [2024-04-16 23:04:13.586373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.543 [2024-04-16 23:04:13.586398] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.543 qpair failed and we were unable to recover it. 00:26:22.543 [2024-04-16 23:04:13.586565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.543 [2024-04-16 23:04:13.586702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.543 [2024-04-16 23:04:13.586726] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.543 qpair failed and we were unable to recover it. 00:26:22.543 [2024-04-16 23:04:13.586834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.543 [2024-04-16 23:04:13.586976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.543 [2024-04-16 23:04:13.587000] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.543 qpair failed and we were unable to recover it. 00:26:22.543 [2024-04-16 23:04:13.587135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.543 [2024-04-16 23:04:13.587293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.544 [2024-04-16 23:04:13.587336] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.544 qpair failed and we were unable to recover it. 00:26:22.544 [2024-04-16 23:04:13.587472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.544 [2024-04-16 23:04:13.587591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.544 [2024-04-16 23:04:13.587616] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.544 qpair failed and we were unable to recover it. 00:26:22.544 [2024-04-16 23:04:13.587762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.544 [2024-04-16 23:04:13.587938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.544 [2024-04-16 23:04:13.587963] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.544 qpair failed and we were unable to recover it. 00:26:22.544 [2024-04-16 23:04:13.588102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.544 [2024-04-16 23:04:13.588223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.544 [2024-04-16 23:04:13.588248] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.544 qpair failed and we were unable to recover it. 00:26:22.544 [2024-04-16 23:04:13.588366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.544 [2024-04-16 23:04:13.588505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.544 [2024-04-16 23:04:13.588530] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.544 qpair failed and we were unable to recover it. 00:26:22.544 [2024-04-16 23:04:13.588635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.544 [2024-04-16 23:04:13.588743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.544 [2024-04-16 23:04:13.588767] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.544 qpair failed and we were unable to recover it. 00:26:22.544 [2024-04-16 23:04:13.588934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.544 [2024-04-16 23:04:13.589103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.544 [2024-04-16 23:04:13.589129] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.544 qpair failed and we were unable to recover it. 00:26:22.544 [2024-04-16 23:04:13.589284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.544 [2024-04-16 23:04:13.589407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.544 [2024-04-16 23:04:13.589432] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.544 qpair failed and we were unable to recover it. 00:26:22.544 [2024-04-16 23:04:13.589639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.544 [2024-04-16 23:04:13.589761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.544 [2024-04-16 23:04:13.589803] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.544 qpair failed and we were unable to recover it. 00:26:22.544 [2024-04-16 23:04:13.589930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.544 [2024-04-16 23:04:13.590091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.544 [2024-04-16 23:04:13.590119] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.544 qpair failed and we were unable to recover it. 00:26:22.544 [2024-04-16 23:04:13.590261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.544 [2024-04-16 23:04:13.590385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.544 [2024-04-16 23:04:13.590411] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.544 qpair failed and we were unable to recover it. 00:26:22.544 [2024-04-16 23:04:13.590536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.544 [2024-04-16 23:04:13.590746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.544 [2024-04-16 23:04:13.590801] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.544 qpair failed and we were unable to recover it. 00:26:22.544 [2024-04-16 23:04:13.590971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.544 [2024-04-16 23:04:13.591111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.544 [2024-04-16 23:04:13.591135] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.544 qpair failed and we were unable to recover it. 00:26:22.544 [2024-04-16 23:04:13.591313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.544 [2024-04-16 23:04:13.591444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.544 [2024-04-16 23:04:13.591471] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.544 qpair failed and we were unable to recover it. 00:26:22.544 [2024-04-16 23:04:13.591673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.544 [2024-04-16 23:04:13.591932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.544 [2024-04-16 23:04:13.591988] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.544 qpair failed and we were unable to recover it. 00:26:22.544 [2024-04-16 23:04:13.592122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.544 [2024-04-16 23:04:13.592243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.544 [2024-04-16 23:04:13.592270] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.544 qpair failed and we were unable to recover it. 00:26:22.544 [2024-04-16 23:04:13.592410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.544 [2024-04-16 23:04:13.592533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.544 [2024-04-16 23:04:13.592557] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.544 qpair failed and we were unable to recover it. 00:26:22.544 [2024-04-16 23:04:13.592705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.544 [2024-04-16 23:04:13.592895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.544 [2024-04-16 23:04:13.592923] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.544 qpair failed and we were unable to recover it. 00:26:22.544 [2024-04-16 23:04:13.593056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.544 [2024-04-16 23:04:13.593182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.544 [2024-04-16 23:04:13.593211] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.544 qpair failed and we were unable to recover it. 00:26:22.544 [2024-04-16 23:04:13.593364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.544 [2024-04-16 23:04:13.593518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.544 [2024-04-16 23:04:13.593545] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.544 qpair failed and we were unable to recover it. 00:26:22.544 [2024-04-16 23:04:13.593707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.544 [2024-04-16 23:04:13.593840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.544 [2024-04-16 23:04:13.593864] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.544 qpair failed and we were unable to recover it. 00:26:22.544 [2024-04-16 23:04:13.593998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.544 [2024-04-16 23:04:13.594120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.544 [2024-04-16 23:04:13.594148] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.544 qpair failed and we were unable to recover it. 00:26:22.544 [2024-04-16 23:04:13.594306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.544 [2024-04-16 23:04:13.594464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.544 [2024-04-16 23:04:13.594488] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.544 qpair failed and we were unable to recover it. 00:26:22.544 [2024-04-16 23:04:13.594621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.544 [2024-04-16 23:04:13.594752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.544 [2024-04-16 23:04:13.594783] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.544 qpair failed and we were unable to recover it. 00:26:22.544 [2024-04-16 23:04:13.594934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.544 [2024-04-16 23:04:13.595115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.544 [2024-04-16 23:04:13.595143] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.544 qpair failed and we were unable to recover it. 00:26:22.544 [2024-04-16 23:04:13.595282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.544 [2024-04-16 23:04:13.595468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.544 [2024-04-16 23:04:13.595496] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.544 qpair failed and we were unable to recover it. 00:26:22.544 [2024-04-16 23:04:13.595617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.544 [2024-04-16 23:04:13.595736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.544 [2024-04-16 23:04:13.595763] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.544 qpair failed and we were unable to recover it. 00:26:22.544 [2024-04-16 23:04:13.595881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.544 [2024-04-16 23:04:13.596007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.544 [2024-04-16 23:04:13.596035] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.544 qpair failed and we were unable to recover it. 00:26:22.544 [2024-04-16 23:04:13.596173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.544 [2024-04-16 23:04:13.596329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.544 [2024-04-16 23:04:13.596353] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.544 qpair failed and we were unable to recover it. 00:26:22.544 [2024-04-16 23:04:13.596475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.544 [2024-04-16 23:04:13.596595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.545 [2024-04-16 23:04:13.596622] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.545 qpair failed and we were unable to recover it. 00:26:22.545 [2024-04-16 23:04:13.596754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.545 [2024-04-16 23:04:13.596903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.545 [2024-04-16 23:04:13.596930] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.545 qpair failed and we were unable to recover it. 00:26:22.545 [2024-04-16 23:04:13.597074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.545 [2024-04-16 23:04:13.597235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.545 [2024-04-16 23:04:13.597263] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.545 qpair failed and we were unable to recover it. 00:26:22.545 [2024-04-16 23:04:13.597392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.545 [2024-04-16 23:04:13.597556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.545 [2024-04-16 23:04:13.597581] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.545 qpair failed and we were unable to recover it. 00:26:22.545 [2024-04-16 23:04:13.597777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.545 [2024-04-16 23:04:13.597940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.545 [2024-04-16 23:04:13.597964] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.545 qpair failed and we were unable to recover it. 00:26:22.545 [2024-04-16 23:04:13.598105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.545 [2024-04-16 23:04:13.598207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.545 [2024-04-16 23:04:13.598251] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.545 qpair failed and we were unable to recover it. 00:26:22.545 [2024-04-16 23:04:13.598370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.545 [2024-04-16 23:04:13.598522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.545 [2024-04-16 23:04:13.598549] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.545 qpair failed and we were unable to recover it. 00:26:22.545 [2024-04-16 23:04:13.598715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.545 [2024-04-16 23:04:13.598837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.545 [2024-04-16 23:04:13.598860] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.545 qpair failed and we were unable to recover it. 00:26:22.545 [2024-04-16 23:04:13.599001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.545 [2024-04-16 23:04:13.599133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.545 [2024-04-16 23:04:13.599160] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.545 qpair failed and we were unable to recover it. 00:26:22.545 [2024-04-16 23:04:13.599339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.545 [2024-04-16 23:04:13.599483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.545 [2024-04-16 23:04:13.599508] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.545 qpair failed and we were unable to recover it. 00:26:22.545 [2024-04-16 23:04:13.599646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.545 [2024-04-16 23:04:13.599798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.545 [2024-04-16 23:04:13.599826] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.545 qpair failed and we were unable to recover it. 00:26:22.545 [2024-04-16 23:04:13.599961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.545 [2024-04-16 23:04:13.600108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.545 [2024-04-16 23:04:13.600132] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.545 qpair failed and we were unable to recover it. 00:26:22.545 [2024-04-16 23:04:13.600309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.545 [2024-04-16 23:04:13.600468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.545 [2024-04-16 23:04:13.600496] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.545 qpair failed and we were unable to recover it. 00:26:22.545 [2024-04-16 23:04:13.600668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.545 [2024-04-16 23:04:13.600779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.545 [2024-04-16 23:04:13.600803] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.545 qpair failed and we were unable to recover it. 00:26:22.545 [2024-04-16 23:04:13.600945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.545 [2024-04-16 23:04:13.601075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.545 [2024-04-16 23:04:13.601102] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.545 qpair failed and we were unable to recover it. 00:26:22.545 [2024-04-16 23:04:13.601274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.545 [2024-04-16 23:04:13.601413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.545 [2024-04-16 23:04:13.601438] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.545 qpair failed and we were unable to recover it. 00:26:22.545 [2024-04-16 23:04:13.601597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.545 [2024-04-16 23:04:13.601739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.545 [2024-04-16 23:04:13.601767] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.545 qpair failed and we were unable to recover it. 00:26:22.545 [2024-04-16 23:04:13.601912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.545 [2024-04-16 23:04:13.602086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.545 [2024-04-16 23:04:13.602111] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.545 qpair failed and we were unable to recover it. 00:26:22.545 [2024-04-16 23:04:13.602242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.545 [2024-04-16 23:04:13.602403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.545 [2024-04-16 23:04:13.602430] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.545 qpair failed and we were unable to recover it. 00:26:22.545 [2024-04-16 23:04:13.602599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.545 [2024-04-16 23:04:13.602779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.545 [2024-04-16 23:04:13.602804] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.545 qpair failed and we were unable to recover it. 00:26:22.545 [2024-04-16 23:04:13.602937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.545 [2024-04-16 23:04:13.603076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.545 [2024-04-16 23:04:13.603100] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.545 qpair failed and we were unable to recover it. 00:26:22.545 [2024-04-16 23:04:13.603239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.545 [2024-04-16 23:04:13.603385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.545 [2024-04-16 23:04:13.603411] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.545 qpair failed and we were unable to recover it. 00:26:22.545 [2024-04-16 23:04:13.603610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.545 [2024-04-16 23:04:13.603751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.545 [2024-04-16 23:04:13.603776] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.545 qpair failed and we were unable to recover it. 00:26:22.545 [2024-04-16 23:04:13.603915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.545 [2024-04-16 23:04:13.604099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.545 [2024-04-16 23:04:13.604126] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.545 qpair failed and we were unable to recover it. 00:26:22.545 [2024-04-16 23:04:13.604309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.545 [2024-04-16 23:04:13.604442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.545 [2024-04-16 23:04:13.604467] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.545 qpair failed and we were unable to recover it. 00:26:22.545 [2024-04-16 23:04:13.604626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.545 [2024-04-16 23:04:13.604757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.545 [2024-04-16 23:04:13.604785] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.545 qpair failed and we were unable to recover it. 00:26:22.545 [2024-04-16 23:04:13.604933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.545 [2024-04-16 23:04:13.605046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.545 [2024-04-16 23:04:13.605073] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.545 qpair failed and we were unable to recover it. 00:26:22.545 [2024-04-16 23:04:13.605251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.545 [2024-04-16 23:04:13.605396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.545 [2024-04-16 23:04:13.605421] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.545 qpair failed and we were unable to recover it. 00:26:22.545 [2024-04-16 23:04:13.605601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.545 [2024-04-16 23:04:13.605706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.545 [2024-04-16 23:04:13.605730] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.546 qpair failed and we were unable to recover it. 00:26:22.546 [2024-04-16 23:04:13.605866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.546 [2024-04-16 23:04:13.606026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.546 [2024-04-16 23:04:13.606053] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.546 qpair failed and we were unable to recover it. 00:26:22.546 [2024-04-16 23:04:13.606247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.546 [2024-04-16 23:04:13.606386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.546 [2024-04-16 23:04:13.606410] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.546 qpair failed and we were unable to recover it. 00:26:22.546 [2024-04-16 23:04:13.606552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.546 [2024-04-16 23:04:13.606660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.546 [2024-04-16 23:04:13.606685] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.546 qpair failed and we were unable to recover it. 00:26:22.546 [2024-04-16 23:04:13.606846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.546 [2024-04-16 23:04:13.607004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.546 [2024-04-16 23:04:13.607032] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.546 qpair failed and we were unable to recover it. 00:26:22.546 [2024-04-16 23:04:13.607154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.546 [2024-04-16 23:04:13.607362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.546 [2024-04-16 23:04:13.607386] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.546 qpair failed and we were unable to recover it. 00:26:22.546 [2024-04-16 23:04:13.607521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.546 [2024-04-16 23:04:13.607636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.546 [2024-04-16 23:04:13.607660] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.546 qpair failed and we were unable to recover it. 00:26:22.546 [2024-04-16 23:04:13.607769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.546 [2024-04-16 23:04:13.607885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.546 [2024-04-16 23:04:13.607909] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.546 qpair failed and we were unable to recover it. 00:26:22.546 [2024-04-16 23:04:13.608064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.546 [2024-04-16 23:04:13.608191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.546 [2024-04-16 23:04:13.608218] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.546 qpair failed and we were unable to recover it. 00:26:22.546 [2024-04-16 23:04:13.608413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.546 [2024-04-16 23:04:13.608588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.546 [2024-04-16 23:04:13.608612] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.546 qpair failed and we were unable to recover it. 00:26:22.546 [2024-04-16 23:04:13.608766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.546 [2024-04-16 23:04:13.608961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.546 [2024-04-16 23:04:13.608986] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.546 qpair failed and we were unable to recover it. 00:26:22.546 [2024-04-16 23:04:13.609128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.546 [2024-04-16 23:04:13.609330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.546 [2024-04-16 23:04:13.609358] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.546 qpair failed and we were unable to recover it. 00:26:22.546 [2024-04-16 23:04:13.609517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.546 [2024-04-16 23:04:13.609654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.546 [2024-04-16 23:04:13.609679] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.546 qpair failed and we were unable to recover it. 00:26:22.546 [2024-04-16 23:04:13.609880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.546 [2024-04-16 23:04:13.610018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.546 [2024-04-16 23:04:13.610054] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.546 qpair failed and we were unable to recover it. 00:26:22.546 [2024-04-16 23:04:13.610239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.546 [2024-04-16 23:04:13.610399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.546 [2024-04-16 23:04:13.610426] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.546 qpair failed and we were unable to recover it. 00:26:22.546 [2024-04-16 23:04:13.610597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.546 [2024-04-16 23:04:13.610704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.546 [2024-04-16 23:04:13.610728] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.546 qpair failed and we were unable to recover it. 00:26:22.546 [2024-04-16 23:04:13.610852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.546 [2024-04-16 23:04:13.611002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.546 [2024-04-16 23:04:13.611031] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.546 qpair failed and we were unable to recover it. 00:26:22.546 [2024-04-16 23:04:13.611204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.546 [2024-04-16 23:04:13.611345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.546 [2024-04-16 23:04:13.611375] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.546 qpair failed and we were unable to recover it. 00:26:22.546 [2024-04-16 23:04:13.611536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.546 [2024-04-16 23:04:13.611712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.546 [2024-04-16 23:04:13.611738] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.546 qpair failed and we were unable to recover it. 00:26:22.546 [2024-04-16 23:04:13.611848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.546 [2024-04-16 23:04:13.612020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.546 [2024-04-16 23:04:13.612045] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.546 qpair failed and we were unable to recover it. 00:26:22.546 [2024-04-16 23:04:13.612224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.546 [2024-04-16 23:04:13.612341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.546 [2024-04-16 23:04:13.612368] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.546 qpair failed and we were unable to recover it. 00:26:22.546 [2024-04-16 23:04:13.612556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.546 [2024-04-16 23:04:13.612699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.546 [2024-04-16 23:04:13.612726] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.546 qpair failed and we were unable to recover it. 00:26:22.546 [2024-04-16 23:04:13.612898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.546 [2024-04-16 23:04:13.613037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.546 [2024-04-16 23:04:13.613062] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.546 qpair failed and we were unable to recover it. 00:26:22.546 [2024-04-16 23:04:13.613202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.546 [2024-04-16 23:04:13.613350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.546 [2024-04-16 23:04:13.613374] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.546 qpair failed and we were unable to recover it. 00:26:22.546 [2024-04-16 23:04:13.613566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.546 [2024-04-16 23:04:13.613688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.546 [2024-04-16 23:04:13.613712] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.546 qpair failed and we were unable to recover it. 00:26:22.546 [2024-04-16 23:04:13.613860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.546 [2024-04-16 23:04:13.613985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.546 [2024-04-16 23:04:13.614012] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.546 qpair failed and we were unable to recover it. 00:26:22.547 [2024-04-16 23:04:13.614195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.547 [2024-04-16 23:04:13.614315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.547 [2024-04-16 23:04:13.614341] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.547 qpair failed and we were unable to recover it. 00:26:22.547 [2024-04-16 23:04:13.614502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.547 [2024-04-16 23:04:13.614612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.547 [2024-04-16 23:04:13.614639] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.547 qpair failed and we were unable to recover it. 00:26:22.547 [2024-04-16 23:04:13.614807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.547 [2024-04-16 23:04:13.614965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.547 [2024-04-16 23:04:13.614993] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.547 qpair failed and we were unable to recover it. 00:26:22.547 [2024-04-16 23:04:13.615148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.547 [2024-04-16 23:04:13.615331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.547 [2024-04-16 23:04:13.615356] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.547 qpair failed and we were unable to recover it. 00:26:22.547 [2024-04-16 23:04:13.615498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.547 [2024-04-16 23:04:13.615635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.547 [2024-04-16 23:04:13.615661] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.547 qpair failed and we were unable to recover it. 00:26:22.547 [2024-04-16 23:04:13.615829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.547 [2024-04-16 23:04:13.615966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.547 [2024-04-16 23:04:13.616006] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.547 qpair failed and we were unable to recover it. 00:26:22.547 [2024-04-16 23:04:13.616186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.547 [2024-04-16 23:04:13.616349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.547 [2024-04-16 23:04:13.616376] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.547 qpair failed and we were unable to recover it. 00:26:22.547 [2024-04-16 23:04:13.616565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.547 [2024-04-16 23:04:13.616825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.547 [2024-04-16 23:04:13.616852] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.547 qpair failed and we were unable to recover it. 00:26:22.547 [2024-04-16 23:04:13.617058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.547 [2024-04-16 23:04:13.617167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.547 [2024-04-16 23:04:13.617200] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.547 qpair failed and we were unable to recover it. 00:26:22.547 [2024-04-16 23:04:13.617347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.547 [2024-04-16 23:04:13.617451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.547 [2024-04-16 23:04:13.617474] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.547 qpair failed and we were unable to recover it. 00:26:22.547 [2024-04-16 23:04:13.617604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.547 [2024-04-16 23:04:13.617757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.547 [2024-04-16 23:04:13.617785] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.547 qpair failed and we were unable to recover it. 00:26:22.547 [2024-04-16 23:04:13.617979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.547 [2024-04-16 23:04:13.618107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.547 [2024-04-16 23:04:13.618134] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.547 qpair failed and we were unable to recover it. 00:26:22.547 [2024-04-16 23:04:13.618359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.547 [2024-04-16 23:04:13.618562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.547 [2024-04-16 23:04:13.618593] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:22.547 qpair failed and we were unable to recover it. 00:26:22.547 [2024-04-16 23:04:13.618725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.547 [2024-04-16 23:04:13.618835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.547 [2024-04-16 23:04:13.618861] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:22.547 qpair failed and we were unable to recover it. 00:26:22.547 [2024-04-16 23:04:13.619057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.547 [2024-04-16 23:04:13.619188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.547 [2024-04-16 23:04:13.619216] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:22.547 qpair failed and we were unable to recover it. 00:26:22.547 [2024-04-16 23:04:13.619362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.547 [2024-04-16 23:04:13.619502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.547 [2024-04-16 23:04:13.619527] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:22.547 qpair failed and we were unable to recover it. 00:26:22.547 [2024-04-16 23:04:13.619694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.547 [2024-04-16 23:04:13.619816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.547 [2024-04-16 23:04:13.619844] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:22.547 qpair failed and we were unable to recover it. 00:26:22.547 [2024-04-16 23:04:13.620040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.547 [2024-04-16 23:04:13.620156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.547 [2024-04-16 23:04:13.620216] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:22.547 qpair failed and we were unable to recover it. 00:26:22.547 [2024-04-16 23:04:13.620374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.547 [2024-04-16 23:04:13.620507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.547 [2024-04-16 23:04:13.620541] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:22.547 qpair failed and we were unable to recover it. 00:26:22.547 [2024-04-16 23:04:13.620705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.547 [2024-04-16 23:04:13.620870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.547 [2024-04-16 23:04:13.620895] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:22.547 qpair failed and we were unable to recover it. 00:26:22.547 [2024-04-16 23:04:13.621048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.547 [2024-04-16 23:04:13.621188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.547 [2024-04-16 23:04:13.621216] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:22.547 qpair failed and we were unable to recover it. 00:26:22.547 [2024-04-16 23:04:13.621348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.547 [2024-04-16 23:04:13.621486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.547 [2024-04-16 23:04:13.621512] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:22.547 qpair failed and we were unable to recover it. 00:26:22.547 [2024-04-16 23:04:13.621658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.547 [2024-04-16 23:04:13.621817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.547 [2024-04-16 23:04:13.621846] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:22.547 qpair failed and we were unable to recover it. 00:26:22.547 [2024-04-16 23:04:13.621993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.547 [2024-04-16 23:04:13.622141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.547 [2024-04-16 23:04:13.622169] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:22.547 qpair failed and we were unable to recover it. 00:26:22.547 [2024-04-16 23:04:13.622339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.547 [2024-04-16 23:04:13.622529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.547 [2024-04-16 23:04:13.622556] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:22.547 qpair failed and we were unable to recover it. 00:26:22.547 [2024-04-16 23:04:13.622712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.547 [2024-04-16 23:04:13.622824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.547 [2024-04-16 23:04:13.622849] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:22.547 qpair failed and we were unable to recover it. 00:26:22.826 [2024-04-16 23:04:13.623004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.826 [2024-04-16 23:04:13.623142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.826 [2024-04-16 23:04:13.623172] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:22.826 qpair failed and we were unable to recover it. 00:26:22.826 [2024-04-16 23:04:13.623327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.826 [2024-04-16 23:04:13.623446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.826 [2024-04-16 23:04:13.623488] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:22.826 qpair failed and we were unable to recover it. 00:26:22.826 [2024-04-16 23:04:13.623651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.826 [2024-04-16 23:04:13.623829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.826 [2024-04-16 23:04:13.623857] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:22.826 qpair failed and we were unable to recover it. 00:26:22.826 [2024-04-16 23:04:13.624017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.826 [2024-04-16 23:04:13.624153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.826 [2024-04-16 23:04:13.624186] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:22.826 qpair failed and we were unable to recover it. 00:26:22.826 [2024-04-16 23:04:13.624300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.826 [2024-04-16 23:04:13.624411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.826 [2024-04-16 23:04:13.624436] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:22.826 qpair failed and we were unable to recover it. 00:26:22.826 [2024-04-16 23:04:13.624564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.826 [2024-04-16 23:04:13.624707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.826 [2024-04-16 23:04:13.624732] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:22.826 qpair failed and we were unable to recover it. 00:26:22.826 [2024-04-16 23:04:13.624879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.826 [2024-04-16 23:04:13.625039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.826 [2024-04-16 23:04:13.625067] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:22.826 qpair failed and we were unable to recover it. 00:26:22.826 [2024-04-16 23:04:13.625234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.826 [2024-04-16 23:04:13.625345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.826 [2024-04-16 23:04:13.625370] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:22.826 qpair failed and we were unable to recover it. 00:26:22.826 [2024-04-16 23:04:13.625479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.826 [2024-04-16 23:04:13.625626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.826 [2024-04-16 23:04:13.625650] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:22.826 qpair failed and we were unable to recover it. 00:26:22.826 [2024-04-16 23:04:13.625821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.826 [2024-04-16 23:04:13.625965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.826 [2024-04-16 23:04:13.625990] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:22.826 qpair failed and we were unable to recover it. 00:26:22.826 [2024-04-16 23:04:13.626110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.826 [2024-04-16 23:04:13.626225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.826 [2024-04-16 23:04:13.626250] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:22.826 qpair failed and we were unable to recover it. 00:26:22.826 [2024-04-16 23:04:13.626365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.826 [2024-04-16 23:04:13.626480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.826 [2024-04-16 23:04:13.626505] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:22.826 qpair failed and we were unable to recover it. 00:26:22.826 [2024-04-16 23:04:13.626647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.826 [2024-04-16 23:04:13.626774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.826 [2024-04-16 23:04:13.626799] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:22.826 qpair failed and we were unable to recover it. 00:26:22.826 [2024-04-16 23:04:13.626916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.827 [2024-04-16 23:04:13.627019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.827 [2024-04-16 23:04:13.627044] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:22.827 qpair failed and we were unable to recover it. 00:26:22.827 [2024-04-16 23:04:13.627151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.827 [2024-04-16 23:04:13.627271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.827 [2024-04-16 23:04:13.627297] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:22.827 qpair failed and we were unable to recover it. 00:26:22.827 [2024-04-16 23:04:13.627440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.827 [2024-04-16 23:04:13.627557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.827 [2024-04-16 23:04:13.627582] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:22.827 qpair failed and we were unable to recover it. 00:26:22.827 [2024-04-16 23:04:13.627705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.827 [2024-04-16 23:04:13.627821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.827 [2024-04-16 23:04:13.627845] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:22.827 qpair failed and we were unable to recover it. 00:26:22.827 [2024-04-16 23:04:13.627981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.827 [2024-04-16 23:04:13.628099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.827 [2024-04-16 23:04:13.628124] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:22.827 qpair failed and we were unable to recover it. 00:26:22.827 [2024-04-16 23:04:13.628308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.827 [2024-04-16 23:04:13.628452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.827 [2024-04-16 23:04:13.628487] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:22.827 qpair failed and we were unable to recover it. 00:26:22.827 [2024-04-16 23:04:13.628603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.827 [2024-04-16 23:04:13.628726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.827 [2024-04-16 23:04:13.628751] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:22.827 qpair failed and we were unable to recover it. 00:26:22.827 [2024-04-16 23:04:13.628907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.827 [2024-04-16 23:04:13.629031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.827 [2024-04-16 23:04:13.629058] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:22.827 qpair failed and we were unable to recover it. 00:26:22.827 [2024-04-16 23:04:13.629251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.827 [2024-04-16 23:04:13.629393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.827 [2024-04-16 23:04:13.629418] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:22.827 qpair failed and we were unable to recover it. 00:26:22.827 [2024-04-16 23:04:13.629565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.827 [2024-04-16 23:04:13.629748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.827 [2024-04-16 23:04:13.629775] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:22.827 qpair failed and we were unable to recover it. 00:26:22.827 [2024-04-16 23:04:13.629942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.827 [2024-04-16 23:04:13.630058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.827 [2024-04-16 23:04:13.630083] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:22.827 qpair failed and we were unable to recover it. 00:26:22.827 [2024-04-16 23:04:13.630203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.827 [2024-04-16 23:04:13.630347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.827 [2024-04-16 23:04:13.630371] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:22.827 qpair failed and we were unable to recover it. 00:26:22.827 [2024-04-16 23:04:13.630496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.827 [2024-04-16 23:04:13.630623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.827 [2024-04-16 23:04:13.630651] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:22.827 qpair failed and we were unable to recover it. 00:26:22.827 [2024-04-16 23:04:13.630789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.827 [2024-04-16 23:04:13.630916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.827 [2024-04-16 23:04:13.630945] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.827 qpair failed and we were unable to recover it. 00:26:22.827 [2024-04-16 23:04:13.631113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.827 [2024-04-16 23:04:13.631231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.827 [2024-04-16 23:04:13.631258] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.827 qpair failed and we were unable to recover it. 00:26:22.827 [2024-04-16 23:04:13.631375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.827 [2024-04-16 23:04:13.631509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.827 [2024-04-16 23:04:13.631534] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.827 qpair failed and we were unable to recover it. 00:26:22.827 [2024-04-16 23:04:13.631647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.827 [2024-04-16 23:04:13.631783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.827 [2024-04-16 23:04:13.631808] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.827 qpair failed and we were unable to recover it. 00:26:22.827 [2024-04-16 23:04:13.631927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.827 [2024-04-16 23:04:13.632126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.827 [2024-04-16 23:04:13.632152] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.827 qpair failed and we were unable to recover it. 00:26:22.827 [2024-04-16 23:04:13.632275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.827 [2024-04-16 23:04:13.632390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.827 [2024-04-16 23:04:13.632415] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.827 qpair failed and we were unable to recover it. 00:26:22.827 [2024-04-16 23:04:13.632597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.827 [2024-04-16 23:04:13.632735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.827 [2024-04-16 23:04:13.632761] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.827 qpair failed and we were unable to recover it. 00:26:22.827 [2024-04-16 23:04:13.632951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.827 [2024-04-16 23:04:13.633089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.827 [2024-04-16 23:04:13.633114] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.827 qpair failed and we were unable to recover it. 00:26:22.827 [2024-04-16 23:04:13.633331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.827 [2024-04-16 23:04:13.633451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.827 [2024-04-16 23:04:13.633476] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.827 qpair failed and we were unable to recover it. 00:26:22.827 [2024-04-16 23:04:13.633656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.827 [2024-04-16 23:04:13.633800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.827 [2024-04-16 23:04:13.633839] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.827 qpair failed and we were unable to recover it. 00:26:22.827 [2024-04-16 23:04:13.633994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.827 [2024-04-16 23:04:13.634216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.827 [2024-04-16 23:04:13.634242] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.827 qpair failed and we were unable to recover it. 00:26:22.827 [2024-04-16 23:04:13.634409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.827 [2024-04-16 23:04:13.634544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.827 [2024-04-16 23:04:13.634571] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.827 qpair failed and we were unable to recover it. 00:26:22.827 [2024-04-16 23:04:13.634725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.827 [2024-04-16 23:04:13.634897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.827 [2024-04-16 23:04:13.634949] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.827 qpair failed and we were unable to recover it. 00:26:22.827 [2024-04-16 23:04:13.635137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.827 [2024-04-16 23:04:13.635318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.827 [2024-04-16 23:04:13.635344] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.827 qpair failed and we were unable to recover it. 00:26:22.827 [2024-04-16 23:04:13.635456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.827 [2024-04-16 23:04:13.635624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.827 [2024-04-16 23:04:13.635649] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.827 qpair failed and we were unable to recover it. 00:26:22.827 [2024-04-16 23:04:13.635890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.827 [2024-04-16 23:04:13.636065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.827 [2024-04-16 23:04:13.636092] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.828 qpair failed and we were unable to recover it. 00:26:22.828 [2024-04-16 23:04:13.636237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.828 [2024-04-16 23:04:13.636373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.828 [2024-04-16 23:04:13.636398] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.828 qpair failed and we were unable to recover it. 00:26:22.828 [2024-04-16 23:04:13.636540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.828 [2024-04-16 23:04:13.636672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.828 [2024-04-16 23:04:13.636712] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.828 qpair failed and we were unable to recover it. 00:26:22.828 [2024-04-16 23:04:13.636863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.828 [2024-04-16 23:04:13.637011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.828 [2024-04-16 23:04:13.637038] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.828 qpair failed and we were unable to recover it. 00:26:22.828 [2024-04-16 23:04:13.637242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.828 [2024-04-16 23:04:13.637349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.828 [2024-04-16 23:04:13.637373] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.828 qpair failed and we were unable to recover it. 00:26:22.828 [2024-04-16 23:04:13.637481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.828 [2024-04-16 23:04:13.637650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.828 [2024-04-16 23:04:13.637683] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.828 qpair failed and we were unable to recover it. 00:26:22.828 [2024-04-16 23:04:13.637842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.828 [2024-04-16 23:04:13.637948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.828 [2024-04-16 23:04:13.637973] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.828 qpair failed and we were unable to recover it. 00:26:22.828 [2024-04-16 23:04:13.638114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.828 [2024-04-16 23:04:13.638277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.828 [2024-04-16 23:04:13.638302] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.828 qpair failed and we were unable to recover it. 00:26:22.828 [2024-04-16 23:04:13.638449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.828 [2024-04-16 23:04:13.638656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.828 [2024-04-16 23:04:13.638681] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.828 qpair failed and we were unable to recover it. 00:26:22.828 [2024-04-16 23:04:13.638823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.828 [2024-04-16 23:04:13.638957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.828 [2024-04-16 23:04:13.638982] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.828 qpair failed and we were unable to recover it. 00:26:22.828 [2024-04-16 23:04:13.639124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.828 [2024-04-16 23:04:13.639252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.828 [2024-04-16 23:04:13.639277] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.828 qpair failed and we were unable to recover it. 00:26:22.828 [2024-04-16 23:04:13.639387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.828 [2024-04-16 23:04:13.639591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.828 [2024-04-16 23:04:13.639619] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.828 qpair failed and we were unable to recover it. 00:26:22.828 [2024-04-16 23:04:13.639740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.828 [2024-04-16 23:04:13.639888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.828 [2024-04-16 23:04:13.639916] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.828 qpair failed and we were unable to recover it. 00:26:22.828 [2024-04-16 23:04:13.640040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.828 [2024-04-16 23:04:13.640161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.828 [2024-04-16 23:04:13.640201] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.828 qpair failed and we were unable to recover it. 00:26:22.828 [2024-04-16 23:04:13.640365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.828 [2024-04-16 23:04:13.640562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.828 [2024-04-16 23:04:13.640590] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.828 qpair failed and we were unable to recover it. 00:26:22.828 [2024-04-16 23:04:13.640742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.828 [2024-04-16 23:04:13.640914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.828 [2024-04-16 23:04:13.640942] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.828 qpair failed and we were unable to recover it. 00:26:22.828 [2024-04-16 23:04:13.641055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.828 [2024-04-16 23:04:13.641188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.828 [2024-04-16 23:04:13.641216] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.828 qpair failed and we were unable to recover it. 00:26:22.828 [2024-04-16 23:04:13.641384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.828 [2024-04-16 23:04:13.641510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.828 [2024-04-16 23:04:13.641538] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.828 qpair failed and we were unable to recover it. 00:26:22.828 [2024-04-16 23:04:13.641664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.828 [2024-04-16 23:04:13.641776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.828 [2024-04-16 23:04:13.641801] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.828 qpair failed and we were unable to recover it. 00:26:22.828 [2024-04-16 23:04:13.641939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.828 [2024-04-16 23:04:13.642091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.828 [2024-04-16 23:04:13.642118] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.828 qpair failed and we were unable to recover it. 00:26:22.828 [2024-04-16 23:04:13.642310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.828 [2024-04-16 23:04:13.642420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.828 [2024-04-16 23:04:13.642444] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.828 qpair failed and we were unable to recover it. 00:26:22.828 [2024-04-16 23:04:13.642627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.828 [2024-04-16 23:04:13.642892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.828 [2024-04-16 23:04:13.642942] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.828 qpair failed and we were unable to recover it. 00:26:22.828 [2024-04-16 23:04:13.643082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.828 [2024-04-16 23:04:13.643251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.828 [2024-04-16 23:04:13.643276] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.828 qpair failed and we were unable to recover it. 00:26:22.828 [2024-04-16 23:04:13.643392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.828 [2024-04-16 23:04:13.643616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.828 [2024-04-16 23:04:13.643641] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.828 qpair failed and we were unable to recover it. 00:26:22.828 [2024-04-16 23:04:13.643778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.828 [2024-04-16 23:04:13.643949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.828 [2024-04-16 23:04:13.643977] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.828 qpair failed and we were unable to recover it. 00:26:22.828 [2024-04-16 23:04:13.644141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.828 [2024-04-16 23:04:13.644278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.828 [2024-04-16 23:04:13.644303] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.828 qpair failed and we were unable to recover it. 00:26:22.828 [2024-04-16 23:04:13.644421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.828 [2024-04-16 23:04:13.644568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.828 [2024-04-16 23:04:13.644593] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.828 qpair failed and we were unable to recover it. 00:26:22.828 [2024-04-16 23:04:13.644774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.828 [2024-04-16 23:04:13.644920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.828 [2024-04-16 23:04:13.644946] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.828 qpair failed and we were unable to recover it. 00:26:22.828 [2024-04-16 23:04:13.645147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.828 [2024-04-16 23:04:13.645275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.828 [2024-04-16 23:04:13.645300] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.828 qpair failed and we were unable to recover it. 00:26:22.828 [2024-04-16 23:04:13.645469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.828 [2024-04-16 23:04:13.645621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.829 [2024-04-16 23:04:13.645646] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.829 qpair failed and we were unable to recover it. 00:26:22.829 [2024-04-16 23:04:13.645824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.829 [2024-04-16 23:04:13.645928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.829 [2024-04-16 23:04:13.645952] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.829 qpair failed and we were unable to recover it. 00:26:22.829 [2024-04-16 23:04:13.646128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.829 [2024-04-16 23:04:13.646266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.829 [2024-04-16 23:04:13.646292] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.829 qpair failed and we were unable to recover it. 00:26:22.829 [2024-04-16 23:04:13.646399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.829 [2024-04-16 23:04:13.646501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.829 [2024-04-16 23:04:13.646525] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.829 qpair failed and we were unable to recover it. 00:26:22.829 [2024-04-16 23:04:13.646706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.829 [2024-04-16 23:04:13.646831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.829 [2024-04-16 23:04:13.646871] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.829 qpair failed and we were unable to recover it. 00:26:22.829 [2024-04-16 23:04:13.646997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.829 [2024-04-16 23:04:13.647142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.829 [2024-04-16 23:04:13.647167] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.829 qpair failed and we were unable to recover it. 00:26:22.829 [2024-04-16 23:04:13.647318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.829 [2024-04-16 23:04:13.647473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.829 [2024-04-16 23:04:13.647501] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.829 qpair failed and we were unable to recover it. 00:26:22.829 [2024-04-16 23:04:13.647674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.829 [2024-04-16 23:04:13.647806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.829 [2024-04-16 23:04:13.647831] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.829 qpair failed and we were unable to recover it. 00:26:22.829 [2024-04-16 23:04:13.647997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.829 [2024-04-16 23:04:13.648163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.829 [2024-04-16 23:04:13.648196] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.829 qpair failed and we were unable to recover it. 00:26:22.829 [2024-04-16 23:04:13.648320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.829 [2024-04-16 23:04:13.648456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.829 [2024-04-16 23:04:13.648481] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.829 qpair failed and we were unable to recover it. 00:26:22.829 [2024-04-16 23:04:13.648663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.829 [2024-04-16 23:04:13.648795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.829 [2024-04-16 23:04:13.648820] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.829 qpair failed and we were unable to recover it. 00:26:22.829 [2024-04-16 23:04:13.648961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.829 [2024-04-16 23:04:13.649099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.829 [2024-04-16 23:04:13.649124] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.829 qpair failed and we were unable to recover it. 00:26:22.829 [2024-04-16 23:04:13.649281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.829 [2024-04-16 23:04:13.649450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.829 [2024-04-16 23:04:13.649477] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.829 qpair failed and we were unable to recover it. 00:26:22.829 [2024-04-16 23:04:13.649596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.829 [2024-04-16 23:04:13.649730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.829 [2024-04-16 23:04:13.649754] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.829 qpair failed and we were unable to recover it. 00:26:22.829 [2024-04-16 23:04:13.649964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.829 [2024-04-16 23:04:13.650104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.829 [2024-04-16 23:04:13.650128] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.829 qpair failed and we were unable to recover it. 00:26:22.829 [2024-04-16 23:04:13.650291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.829 [2024-04-16 23:04:13.650431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.829 [2024-04-16 23:04:13.650456] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.829 qpair failed and we were unable to recover it. 00:26:22.829 [2024-04-16 23:04:13.650638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.829 [2024-04-16 23:04:13.650776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.829 [2024-04-16 23:04:13.650802] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.829 qpair failed and we were unable to recover it. 00:26:22.829 [2024-04-16 23:04:13.650950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.829 [2024-04-16 23:04:13.651097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.829 [2024-04-16 23:04:13.651140] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.829 qpair failed and we were unable to recover it. 00:26:22.829 [2024-04-16 23:04:13.651297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.829 [2024-04-16 23:04:13.651463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.829 [2024-04-16 23:04:13.651488] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.829 qpair failed and we were unable to recover it. 00:26:22.829 [2024-04-16 23:04:13.651599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.829 [2024-04-16 23:04:13.651744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.829 [2024-04-16 23:04:13.651769] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.829 qpair failed and we were unable to recover it. 00:26:22.829 [2024-04-16 23:04:13.651913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.829 [2024-04-16 23:04:13.652051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.829 [2024-04-16 23:04:13.652076] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.829 qpair failed and we were unable to recover it. 00:26:22.829 [2024-04-16 23:04:13.652219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.829 [2024-04-16 23:04:13.652335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.829 [2024-04-16 23:04:13.652361] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.829 qpair failed and we were unable to recover it. 00:26:22.829 [2024-04-16 23:04:13.652511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.829 [2024-04-16 23:04:13.652679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.829 [2024-04-16 23:04:13.652704] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.829 qpair failed and we were unable to recover it. 00:26:22.829 [2024-04-16 23:04:13.652909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.829 [2024-04-16 23:04:13.653049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.829 [2024-04-16 23:04:13.653074] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.829 qpair failed and we were unable to recover it. 00:26:22.829 [2024-04-16 23:04:13.653282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.829 [2024-04-16 23:04:13.653391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.829 [2024-04-16 23:04:13.653418] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.829 qpair failed and we were unable to recover it. 00:26:22.829 [2024-04-16 23:04:13.653541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.829 [2024-04-16 23:04:13.653714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.829 [2024-04-16 23:04:13.653739] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.829 qpair failed and we were unable to recover it. 00:26:22.829 [2024-04-16 23:04:13.653884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.829 [2024-04-16 23:04:13.654019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.829 [2024-04-16 23:04:13.654047] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.829 qpair failed and we were unable to recover it. 00:26:22.829 [2024-04-16 23:04:13.654210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.829 [2024-04-16 23:04:13.654385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.829 [2024-04-16 23:04:13.654410] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.829 qpair failed and we were unable to recover it. 00:26:22.829 [2024-04-16 23:04:13.654555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.829 [2024-04-16 23:04:13.654701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.829 [2024-04-16 23:04:13.654729] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.829 qpair failed and we were unable to recover it. 00:26:22.829 [2024-04-16 23:04:13.654884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.830 [2024-04-16 23:04:13.655021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.830 [2024-04-16 23:04:13.655046] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.830 qpair failed and we were unable to recover it. 00:26:22.830 [2024-04-16 23:04:13.655184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.830 [2024-04-16 23:04:13.655336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.830 [2024-04-16 23:04:13.655363] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.830 qpair failed and we were unable to recover it. 00:26:22.830 [2024-04-16 23:04:13.655501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.830 [2024-04-16 23:04:13.655645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.830 [2024-04-16 23:04:13.655673] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.830 qpair failed and we were unable to recover it. 00:26:22.830 [2024-04-16 23:04:13.656427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.830 [2024-04-16 23:04:13.656652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.830 [2024-04-16 23:04:13.656702] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.830 qpair failed and we were unable to recover it. 00:26:22.830 [2024-04-16 23:04:13.656885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.830 [2024-04-16 23:04:13.657052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.830 [2024-04-16 23:04:13.657079] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.830 qpair failed and we were unable to recover it. 00:26:22.830 [2024-04-16 23:04:13.657203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.830 [2024-04-16 23:04:13.657329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.830 [2024-04-16 23:04:13.657358] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.830 qpair failed and we were unable to recover it. 00:26:22.830 [2024-04-16 23:04:13.657547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.830 [2024-04-16 23:04:13.657730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.830 [2024-04-16 23:04:13.657779] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.830 qpair failed and we were unable to recover it. 00:26:22.830 [2024-04-16 23:04:13.657910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.830 [2024-04-16 23:04:13.658027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.830 [2024-04-16 23:04:13.658054] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.830 qpair failed and we were unable to recover it. 00:26:22.830 [2024-04-16 23:04:13.658221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.830 [2024-04-16 23:04:13.658360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.830 [2024-04-16 23:04:13.658389] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.830 qpair failed and we were unable to recover it. 00:26:22.830 [2024-04-16 23:04:13.658522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.830 [2024-04-16 23:04:13.658667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.830 [2024-04-16 23:04:13.658694] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.830 qpair failed and we were unable to recover it. 00:26:22.830 [2024-04-16 23:04:13.658822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.830 [2024-04-16 23:04:13.658943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.830 [2024-04-16 23:04:13.658970] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.830 qpair failed and we were unable to recover it. 00:26:22.830 [2024-04-16 23:04:13.659100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.830 [2024-04-16 23:04:13.659269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.830 [2024-04-16 23:04:13.659295] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.830 qpair failed and we were unable to recover it. 00:26:22.830 [2024-04-16 23:04:13.659410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.830 [2024-04-16 23:04:13.659554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.830 [2024-04-16 23:04:13.659595] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.830 qpair failed and we were unable to recover it. 00:26:22.830 [2024-04-16 23:04:13.659734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.830 [2024-04-16 23:04:13.659871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.830 [2024-04-16 23:04:13.659899] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.830 qpair failed and we were unable to recover it. 00:26:22.830 [2024-04-16 23:04:13.660019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.830 [2024-04-16 23:04:13.660142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.830 [2024-04-16 23:04:13.660183] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.830 qpair failed and we were unable to recover it. 00:26:22.830 [2024-04-16 23:04:13.660310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.830 [2024-04-16 23:04:13.660452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.830 [2024-04-16 23:04:13.660478] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.830 qpair failed and we were unable to recover it. 00:26:22.830 [2024-04-16 23:04:13.660634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.830 [2024-04-16 23:04:13.660815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.830 [2024-04-16 23:04:13.660840] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.830 qpair failed and we were unable to recover it. 00:26:22.830 [2024-04-16 23:04:13.660999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.830 [2024-04-16 23:04:13.661118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.830 [2024-04-16 23:04:13.661145] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.830 qpair failed and we were unable to recover it. 00:26:22.830 [2024-04-16 23:04:13.661322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.830 [2024-04-16 23:04:13.661438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.830 [2024-04-16 23:04:13.661463] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.830 qpair failed and we were unable to recover it. 00:26:22.830 [2024-04-16 23:04:13.661643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.830 [2024-04-16 23:04:13.661787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.830 [2024-04-16 23:04:13.661811] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.830 qpair failed and we were unable to recover it. 00:26:22.830 [2024-04-16 23:04:13.661971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.830 [2024-04-16 23:04:13.662127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.830 [2024-04-16 23:04:13.662155] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.830 qpair failed and we were unable to recover it. 00:26:22.830 [2024-04-16 23:04:13.662304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.830 [2024-04-16 23:04:13.662413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.830 [2024-04-16 23:04:13.662438] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.830 qpair failed and we were unable to recover it. 00:26:22.830 [2024-04-16 23:04:13.662620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.830 [2024-04-16 23:04:13.662760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.830 [2024-04-16 23:04:13.662787] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.830 qpair failed and we were unable to recover it. 00:26:22.830 [2024-04-16 23:04:13.662950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.830 [2024-04-16 23:04:13.663084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.830 [2024-04-16 23:04:13.663109] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.830 qpair failed and we were unable to recover it. 00:26:22.830 [2024-04-16 23:04:13.663290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.830 [2024-04-16 23:04:13.663463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.830 [2024-04-16 23:04:13.663505] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.830 qpair failed and we were unable to recover it. 00:26:22.830 [2024-04-16 23:04:13.663666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.830 [2024-04-16 23:04:13.663828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.830 [2024-04-16 23:04:13.663856] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.830 qpair failed and we were unable to recover it. 00:26:22.830 [2024-04-16 23:04:13.664016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.830 [2024-04-16 23:04:13.664186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.830 [2024-04-16 23:04:13.664214] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.830 qpair failed and we were unable to recover it. 00:26:22.830 [2024-04-16 23:04:13.664372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.830 [2024-04-16 23:04:13.664475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.830 [2024-04-16 23:04:13.664500] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.830 qpair failed and we were unable to recover it. 00:26:22.830 [2024-04-16 23:04:13.664639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.830 [2024-04-16 23:04:13.664803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.830 [2024-04-16 23:04:13.664827] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.830 qpair failed and we were unable to recover it. 00:26:22.830 [2024-04-16 23:04:13.664971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.831 [2024-04-16 23:04:13.665181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.831 [2024-04-16 23:04:13.665207] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.831 qpair failed and we were unable to recover it. 00:26:22.831 [2024-04-16 23:04:13.665328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.831 [2024-04-16 23:04:13.665494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.831 [2024-04-16 23:04:13.665521] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.831 qpair failed and we were unable to recover it. 00:26:22.831 [2024-04-16 23:04:13.665654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.831 [2024-04-16 23:04:13.665769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.831 [2024-04-16 23:04:13.665794] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.831 qpair failed and we were unable to recover it. 00:26:22.831 [2024-04-16 23:04:13.666013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.831 [2024-04-16 23:04:13.666129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.831 [2024-04-16 23:04:13.666153] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.831 qpair failed and we were unable to recover it. 00:26:22.831 [2024-04-16 23:04:13.666318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.831 [2024-04-16 23:04:13.666436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.831 [2024-04-16 23:04:13.666461] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.831 qpair failed and we were unable to recover it. 00:26:22.831 [2024-04-16 23:04:13.666596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.831 [2024-04-16 23:04:13.666764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.831 [2024-04-16 23:04:13.666805] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.831 qpair failed and we were unable to recover it. 00:26:22.831 [2024-04-16 23:04:13.666942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.831 [2024-04-16 23:04:13.667064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.831 [2024-04-16 23:04:13.667088] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.831 qpair failed and we were unable to recover it. 00:26:22.831 [2024-04-16 23:04:13.667197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.831 [2024-04-16 23:04:13.667319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.831 [2024-04-16 23:04:13.667344] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.831 qpair failed and we were unable to recover it. 00:26:22.831 [2024-04-16 23:04:13.667455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.831 [2024-04-16 23:04:13.667593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.831 [2024-04-16 23:04:13.667617] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.831 qpair failed and we were unable to recover it. 00:26:22.831 [2024-04-16 23:04:13.667735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.831 [2024-04-16 23:04:13.667863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.831 [2024-04-16 23:04:13.667888] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.831 qpair failed and we were unable to recover it. 00:26:22.831 [2024-04-16 23:04:13.668059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.831 [2024-04-16 23:04:13.668167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.831 [2024-04-16 23:04:13.668216] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.831 qpair failed and we were unable to recover it. 00:26:22.831 [2024-04-16 23:04:13.668372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.831 [2024-04-16 23:04:13.668505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.831 [2024-04-16 23:04:13.668529] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.831 qpair failed and we were unable to recover it. 00:26:22.831 [2024-04-16 23:04:13.668649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.831 [2024-04-16 23:04:13.668781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.831 [2024-04-16 23:04:13.668810] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.831 qpair failed and we were unable to recover it. 00:26:22.831 [2024-04-16 23:04:13.668950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.831 [2024-04-16 23:04:13.669114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.831 [2024-04-16 23:04:13.669139] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.831 qpair failed and we were unable to recover it. 00:26:22.831 [2024-04-16 23:04:13.669328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.831 [2024-04-16 23:04:13.669440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.831 [2024-04-16 23:04:13.669465] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.831 qpair failed and we were unable to recover it. 00:26:22.831 [2024-04-16 23:04:13.669588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.831 [2024-04-16 23:04:13.669694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.831 [2024-04-16 23:04:13.669719] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.831 qpair failed and we were unable to recover it. 00:26:22.831 [2024-04-16 23:04:13.669864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.831 [2024-04-16 23:04:13.669971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.831 [2024-04-16 23:04:13.669996] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.831 qpair failed and we were unable to recover it. 00:26:22.831 [2024-04-16 23:04:13.670148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.831 [2024-04-16 23:04:13.670273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.831 [2024-04-16 23:04:13.670299] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.831 qpair failed and we were unable to recover it. 00:26:22.831 [2024-04-16 23:04:13.670467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.831 [2024-04-16 23:04:13.670575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.831 [2024-04-16 23:04:13.670602] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.831 qpair failed and we were unable to recover it. 00:26:22.831 [2024-04-16 23:04:13.670717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.831 [2024-04-16 23:04:13.670845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.831 [2024-04-16 23:04:13.670870] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.831 qpair failed and we were unable to recover it. 00:26:22.831 [2024-04-16 23:04:13.671010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.831 [2024-04-16 23:04:13.671128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.831 [2024-04-16 23:04:13.671153] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.831 qpair failed and we were unable to recover it. 00:26:22.831 [2024-04-16 23:04:13.671281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.831 [2024-04-16 23:04:13.671405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.831 [2024-04-16 23:04:13.671432] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:22.831 qpair failed and we were unable to recover it. 00:26:22.831 [2024-04-16 23:04:13.671592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.831 [2024-04-16 23:04:13.671731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.831 [2024-04-16 23:04:13.671755] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:22.831 qpair failed and we were unable to recover it. 00:26:22.831 [2024-04-16 23:04:13.671866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.831 [2024-04-16 23:04:13.671983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.832 [2024-04-16 23:04:13.672008] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:22.832 qpair failed and we were unable to recover it. 00:26:22.832 [2024-04-16 23:04:13.672131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.832 [2024-04-16 23:04:13.672259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.832 [2024-04-16 23:04:13.672284] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:22.832 qpair failed and we were unable to recover it. 00:26:22.832 [2024-04-16 23:04:13.672429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.832 [2024-04-16 23:04:13.672604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.832 [2024-04-16 23:04:13.672632] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:22.832 qpair failed and we were unable to recover it. 00:26:22.832 [2024-04-16 23:04:13.672765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.832 [2024-04-16 23:04:13.672878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.832 [2024-04-16 23:04:13.672903] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:22.832 qpair failed and we were unable to recover it. 00:26:22.832 [2024-04-16 23:04:13.673071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.832 [2024-04-16 23:04:13.673209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.832 [2024-04-16 23:04:13.673254] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:22.832 qpair failed and we were unable to recover it. 00:26:22.832 [2024-04-16 23:04:13.673379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.832 [2024-04-16 23:04:13.673540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.832 [2024-04-16 23:04:13.673565] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:22.832 qpair failed and we were unable to recover it. 00:26:22.832 [2024-04-16 23:04:13.673726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.832 [2024-04-16 23:04:13.673925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.832 [2024-04-16 23:04:13.673954] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:22.832 qpair failed and we were unable to recover it. 00:26:22.832 [2024-04-16 23:04:13.674126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.832 [2024-04-16 23:04:13.674284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.832 [2024-04-16 23:04:13.674315] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:22.832 qpair failed and we were unable to recover it. 00:26:22.832 [2024-04-16 23:04:13.674429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.832 [2024-04-16 23:04:13.674617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.832 [2024-04-16 23:04:13.674645] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:22.832 qpair failed and we were unable to recover it. 00:26:22.832 [2024-04-16 23:04:13.674776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.832 [2024-04-16 23:04:13.674913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.832 [2024-04-16 23:04:13.674940] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:22.832 qpair failed and we were unable to recover it. 00:26:22.832 [2024-04-16 23:04:13.675057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.832 [2024-04-16 23:04:13.675252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.832 [2024-04-16 23:04:13.675279] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:22.832 qpair failed and we were unable to recover it. 00:26:22.832 [2024-04-16 23:04:13.675432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.832 [2024-04-16 23:04:13.675577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.832 [2024-04-16 23:04:13.675602] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:22.832 qpair failed and we were unable to recover it. 00:26:22.832 [2024-04-16 23:04:13.675709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.832 [2024-04-16 23:04:13.677187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.832 [2024-04-16 23:04:13.677218] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:22.832 qpair failed and we were unable to recover it. 00:26:22.832 [2024-04-16 23:04:13.677387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.832 [2024-04-16 23:04:13.677546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.832 [2024-04-16 23:04:13.677574] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:22.832 qpair failed and we were unable to recover it. 00:26:22.832 [2024-04-16 23:04:13.677745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.832 [2024-04-16 23:04:13.677916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.832 [2024-04-16 23:04:13.677941] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:22.832 qpair failed and we were unable to recover it. 00:26:22.832 [2024-04-16 23:04:13.678088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.832 [2024-04-16 23:04:13.678228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.832 [2024-04-16 23:04:13.678254] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:22.832 qpair failed and we were unable to recover it. 00:26:22.832 [2024-04-16 23:04:13.678402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.832 [2024-04-16 23:04:13.678547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.832 [2024-04-16 23:04:13.678571] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:22.832 qpair failed and we were unable to recover it. 00:26:22.832 [2024-04-16 23:04:13.678728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.832 [2024-04-16 23:04:13.678914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.832 [2024-04-16 23:04:13.678946] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:22.832 qpair failed and we were unable to recover it. 00:26:22.832 [2024-04-16 23:04:13.679133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.832 [2024-04-16 23:04:13.679335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.832 [2024-04-16 23:04:13.679361] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:22.832 qpair failed and we were unable to recover it. 00:26:22.832 [2024-04-16 23:04:13.679479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.832 [2024-04-16 23:04:13.679651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.832 [2024-04-16 23:04:13.679694] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:22.832 qpair failed and we were unable to recover it. 00:26:22.832 [2024-04-16 23:04:13.679844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.832 [2024-04-16 23:04:13.680002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.832 [2024-04-16 23:04:13.680031] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:22.832 qpair failed and we were unable to recover it. 00:26:22.832 [2024-04-16 23:04:13.680193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.832 [2024-04-16 23:04:13.682187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.832 [2024-04-16 23:04:13.682218] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:22.832 qpair failed and we were unable to recover it. 00:26:22.832 [2024-04-16 23:04:13.682408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.832 [2024-04-16 23:04:13.682580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.832 [2024-04-16 23:04:13.682608] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:22.832 qpair failed and we were unable to recover it. 00:26:22.832 [2024-04-16 23:04:13.682741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.832 [2024-04-16 23:04:13.682881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.832 [2024-04-16 23:04:13.682906] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:22.832 qpair failed and we were unable to recover it. 00:26:22.832 [2024-04-16 23:04:13.683085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.832 [2024-04-16 23:04:13.683261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.832 [2024-04-16 23:04:13.683287] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:22.832 qpair failed and we were unable to recover it. 00:26:22.832 [2024-04-16 23:04:13.683417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.832 [2024-04-16 23:04:13.683561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.832 [2024-04-16 23:04:13.683589] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:22.832 qpair failed and we were unable to recover it. 00:26:22.832 [2024-04-16 23:04:13.683779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.832 [2024-04-16 23:04:13.683907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.832 [2024-04-16 23:04:13.683934] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:22.832 qpair failed and we were unable to recover it. 00:26:22.832 [2024-04-16 23:04:13.684066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.832 [2024-04-16 23:04:13.684185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.832 [2024-04-16 23:04:13.684215] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:22.832 qpair failed and we were unable to recover it. 00:26:22.832 [2024-04-16 23:04:13.684332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.832 [2024-04-16 23:04:13.684482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.832 [2024-04-16 23:04:13.684507] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:22.832 qpair failed and we were unable to recover it. 00:26:22.832 [2024-04-16 23:04:13.684710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.833 [2024-04-16 23:04:13.684873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.833 [2024-04-16 23:04:13.684900] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:22.833 qpair failed and we were unable to recover it. 00:26:22.833 [2024-04-16 23:04:13.685030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.833 [2024-04-16 23:04:13.685195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.833 [2024-04-16 23:04:13.685222] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:22.833 qpair failed and we were unable to recover it. 00:26:22.833 [2024-04-16 23:04:13.685346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.833 [2024-04-16 23:04:13.685518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.833 [2024-04-16 23:04:13.685559] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:22.833 qpair failed and we were unable to recover it. 00:26:22.833 [2024-04-16 23:04:13.685690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.833 [2024-04-16 23:04:13.685848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.833 [2024-04-16 23:04:13.685875] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:22.833 qpair failed and we were unable to recover it. 00:26:22.833 [2024-04-16 23:04:13.686039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.833 [2024-04-16 23:04:13.686216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.833 [2024-04-16 23:04:13.686241] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:22.833 qpair failed and we were unable to recover it. 00:26:22.833 [2024-04-16 23:04:13.687189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.833 [2024-04-16 23:04:13.687345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.833 [2024-04-16 23:04:13.687371] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:22.833 qpair failed and we were unable to recover it. 00:26:22.833 [2024-04-16 23:04:13.687526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.833 [2024-04-16 23:04:13.687667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.833 [2024-04-16 23:04:13.687709] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:22.833 qpair failed and we were unable to recover it. 00:26:22.833 [2024-04-16 23:04:13.687880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.833 [2024-04-16 23:04:13.688017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.833 [2024-04-16 23:04:13.688042] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:22.833 qpair failed and we were unable to recover it. 00:26:22.833 [2024-04-16 23:04:13.688187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.833 [2024-04-16 23:04:13.688324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.833 [2024-04-16 23:04:13.688355] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:22.833 qpair failed and we were unable to recover it. 00:26:22.833 [2024-04-16 23:04:13.688481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.833 [2024-04-16 23:04:13.688676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.833 [2024-04-16 23:04:13.688702] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:22.833 qpair failed and we were unable to recover it. 00:26:22.833 [2024-04-16 23:04:13.688824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.833 [2024-04-16 23:04:13.688971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.833 [2024-04-16 23:04:13.688996] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:22.833 qpair failed and we were unable to recover it. 00:26:22.833 [2024-04-16 23:04:13.691188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.833 [2024-04-16 23:04:13.691336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.833 [2024-04-16 23:04:13.691364] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:22.833 qpair failed and we were unable to recover it. 00:26:22.833 [2024-04-16 23:04:13.691550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.833 [2024-04-16 23:04:13.691696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.833 [2024-04-16 23:04:13.691721] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:22.833 qpair failed and we were unable to recover it. 00:26:22.833 [2024-04-16 23:04:13.691869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.833 [2024-04-16 23:04:13.692038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.833 [2024-04-16 23:04:13.692063] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:22.833 qpair failed and we were unable to recover it. 00:26:22.833 [2024-04-16 23:04:13.692237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.833 [2024-04-16 23:04:13.692359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.833 [2024-04-16 23:04:13.692401] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:22.833 qpair failed and we were unable to recover it. 00:26:22.833 [2024-04-16 23:04:13.692539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.833 [2024-04-16 23:04:13.692734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.833 [2024-04-16 23:04:13.692762] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:22.833 qpair failed and we were unable to recover it. 00:26:22.833 [2024-04-16 23:04:13.692931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.833 [2024-04-16 23:04:13.693091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.833 [2024-04-16 23:04:13.693116] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:22.833 qpair failed and we were unable to recover it. 00:26:22.833 [2024-04-16 23:04:13.693279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.833 [2024-04-16 23:04:13.693406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.833 [2024-04-16 23:04:13.693434] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:22.833 qpair failed and we were unable to recover it. 00:26:22.833 [2024-04-16 23:04:13.693553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.833 [2024-04-16 23:04:13.693711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.833 [2024-04-16 23:04:13.693736] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:22.833 qpair failed and we were unable to recover it. 00:26:22.833 [2024-04-16 23:04:13.693876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.833 [2024-04-16 23:04:13.694012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.833 [2024-04-16 23:04:13.694039] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:22.833 qpair failed and we were unable to recover it. 00:26:22.833 [2024-04-16 23:04:13.694205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.833 [2024-04-16 23:04:13.694329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.833 [2024-04-16 23:04:13.694354] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:22.833 qpair failed and we were unable to recover it. 00:26:22.833 [2024-04-16 23:04:13.694557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.833 [2024-04-16 23:04:13.694711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.833 [2024-04-16 23:04:13.694738] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:22.833 qpair failed and we were unable to recover it. 00:26:22.833 [2024-04-16 23:04:13.694866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.833 [2024-04-16 23:04:13.694983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.833 [2024-04-16 23:04:13.695008] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:22.833 qpair failed and we were unable to recover it. 00:26:22.833 [2024-04-16 23:04:13.695182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.833 [2024-04-16 23:04:13.695344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.833 [2024-04-16 23:04:13.695373] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:22.833 qpair failed and we were unable to recover it. 00:26:22.833 [2024-04-16 23:04:13.695523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.833 [2024-04-16 23:04:13.695654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.833 [2024-04-16 23:04:13.695683] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:22.833 qpair failed and we were unable to recover it. 00:26:22.833 [2024-04-16 23:04:13.697188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.833 [2024-04-16 23:04:13.697378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.833 [2024-04-16 23:04:13.697407] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:22.833 qpair failed and we were unable to recover it. 00:26:22.833 [2024-04-16 23:04:13.697555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.833 [2024-04-16 23:04:13.697666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.833 [2024-04-16 23:04:13.697692] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:22.833 qpair failed and we were unable to recover it. 00:26:22.833 [2024-04-16 23:04:13.697840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.833 [2024-04-16 23:04:13.697973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.833 [2024-04-16 23:04:13.698001] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:22.833 qpair failed and we were unable to recover it. 00:26:22.833 [2024-04-16 23:04:13.698191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.833 [2024-04-16 23:04:13.698339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.833 [2024-04-16 23:04:13.698369] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:22.833 qpair failed and we were unable to recover it. 00:26:22.833 [2024-04-16 23:04:13.698542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.833 [2024-04-16 23:04:13.698682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.834 [2024-04-16 23:04:13.698708] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:22.834 qpair failed and we were unable to recover it. 00:26:22.834 [2024-04-16 23:04:13.698879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.834 [2024-04-16 23:04:13.699017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.834 [2024-04-16 23:04:13.699041] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:22.834 qpair failed and we were unable to recover it. 00:26:22.834 [2024-04-16 23:04:13.699183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.834 [2024-04-16 23:04:13.699318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.834 [2024-04-16 23:04:13.699344] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:22.834 qpair failed and we were unable to recover it. 00:26:22.834 [2024-04-16 23:04:13.699558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.834 [2024-04-16 23:04:13.699746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.834 [2024-04-16 23:04:13.699776] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:22.834 qpair failed and we were unable to recover it. 00:26:22.834 [2024-04-16 23:04:13.699960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.834 [2024-04-16 23:04:13.700095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.834 [2024-04-16 23:04:13.700123] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:22.834 qpair failed and we were unable to recover it. 00:26:22.834 [2024-04-16 23:04:13.700287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.834 [2024-04-16 23:04:13.702188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.834 [2024-04-16 23:04:13.702219] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:22.834 qpair failed and we were unable to recover it. 00:26:22.834 [2024-04-16 23:04:13.702384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.834 [2024-04-16 23:04:13.702581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.834 [2024-04-16 23:04:13.702608] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:22.834 qpair failed and we were unable to recover it. 00:26:22.834 [2024-04-16 23:04:13.702736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.834 [2024-04-16 23:04:13.702897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.834 [2024-04-16 23:04:13.702924] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:22.834 qpair failed and we were unable to recover it. 00:26:22.834 [2024-04-16 23:04:13.703084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.834 [2024-04-16 23:04:13.703218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.834 [2024-04-16 23:04:13.703246] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:22.834 qpair failed and we were unable to recover it. 00:26:22.834 [2024-04-16 23:04:13.703475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.834 [2024-04-16 23:04:13.703644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.834 [2024-04-16 23:04:13.703673] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:22.834 qpair failed and we were unable to recover it. 00:26:22.834 [2024-04-16 23:04:13.703837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.834 [2024-04-16 23:04:13.704028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.834 [2024-04-16 23:04:13.704056] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:22.834 qpair failed and we were unable to recover it. 00:26:22.834 [2024-04-16 23:04:13.704191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.834 [2024-04-16 23:04:13.704352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.834 [2024-04-16 23:04:13.704380] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:22.834 qpair failed and we were unable to recover it. 00:26:22.834 [2024-04-16 23:04:13.704544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.834 [2024-04-16 23:04:13.704707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.834 [2024-04-16 23:04:13.704735] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:22.834 qpair failed and we were unable to recover it. 00:26:22.834 [2024-04-16 23:04:13.704900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.834 [2024-04-16 23:04:13.705050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.834 [2024-04-16 23:04:13.705090] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:22.834 qpair failed and we were unable to recover it. 00:26:22.834 [2024-04-16 23:04:13.705225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.834 [2024-04-16 23:04:13.705363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.834 [2024-04-16 23:04:13.705391] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:22.834 qpair failed and we were unable to recover it. 00:26:22.834 [2024-04-16 23:04:13.705536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.834 [2024-04-16 23:04:13.705702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.834 [2024-04-16 23:04:13.705730] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:22.834 qpair failed and we were unable to recover it. 00:26:22.834 [2024-04-16 23:04:13.705864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.834 [2024-04-16 23:04:13.706028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.834 [2024-04-16 23:04:13.706057] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:22.834 qpair failed and we were unable to recover it. 00:26:22.834 [2024-04-16 23:04:13.706220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.834 [2024-04-16 23:04:13.706333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.834 [2024-04-16 23:04:13.706357] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:22.834 qpair failed and we were unable to recover it. 00:26:22.834 [2024-04-16 23:04:13.708189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.834 [2024-04-16 23:04:13.708368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.834 [2024-04-16 23:04:13.708396] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:22.834 qpair failed and we were unable to recover it. 00:26:22.834 [2024-04-16 23:04:13.708565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.834 [2024-04-16 23:04:13.708722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.834 [2024-04-16 23:04:13.708750] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:22.834 qpair failed and we were unable to recover it. 00:26:22.834 [2024-04-16 23:04:13.708940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.834 [2024-04-16 23:04:13.709065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.834 [2024-04-16 23:04:13.709092] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:22.834 qpair failed and we were unable to recover it. 00:26:22.834 [2024-04-16 23:04:13.709242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.834 [2024-04-16 23:04:13.709394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.834 [2024-04-16 23:04:13.709418] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:22.834 qpair failed and we were unable to recover it. 00:26:22.834 [2024-04-16 23:04:13.709548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.834 [2024-04-16 23:04:13.709724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.834 [2024-04-16 23:04:13.709748] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:22.834 qpair failed and we were unable to recover it. 00:26:22.834 [2024-04-16 23:04:13.709870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.834 [2024-04-16 23:04:13.709986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.834 [2024-04-16 23:04:13.710010] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:22.834 qpair failed and we were unable to recover it. 00:26:22.834 [2024-04-16 23:04:13.710168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.834 [2024-04-16 23:04:13.710357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.834 [2024-04-16 23:04:13.710382] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:22.834 qpair failed and we were unable to recover it. 00:26:22.834 [2024-04-16 23:04:13.710543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.834 [2024-04-16 23:04:13.710719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.834 [2024-04-16 23:04:13.710746] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:22.834 qpair failed and we were unable to recover it. 00:26:22.834 [2024-04-16 23:04:13.710893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.834 [2024-04-16 23:04:13.711069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.834 [2024-04-16 23:04:13.711095] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:22.834 qpair failed and we were unable to recover it. 00:26:22.834 [2024-04-16 23:04:13.711241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.834 [2024-04-16 23:04:13.711384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.834 [2024-04-16 23:04:13.711413] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:22.834 qpair failed and we were unable to recover it. 00:26:22.834 [2024-04-16 23:04:13.711542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.834 [2024-04-16 23:04:13.711674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.834 [2024-04-16 23:04:13.711702] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:22.834 qpair failed and we were unable to recover it. 00:26:22.834 [2024-04-16 23:04:13.712977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.835 [2024-04-16 23:04:13.713184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.835 [2024-04-16 23:04:13.713214] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:22.835 qpair failed and we were unable to recover it. 00:26:22.835 [2024-04-16 23:04:13.713367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.835 [2024-04-16 23:04:13.713530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.835 [2024-04-16 23:04:13.713560] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:22.835 qpair failed and we were unable to recover it. 00:26:22.835 [2024-04-16 23:04:13.713720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.835 [2024-04-16 23:04:13.713892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.835 [2024-04-16 23:04:13.713919] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:22.835 qpair failed and we were unable to recover it. 00:26:22.835 [2024-04-16 23:04:13.714096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.835 [2024-04-16 23:04:13.714245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.835 [2024-04-16 23:04:13.714270] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:22.835 qpair failed and we were unable to recover it. 00:26:22.835 [2024-04-16 23:04:13.714414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.835 [2024-04-16 23:04:13.714547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.835 [2024-04-16 23:04:13.714571] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:22.835 qpair failed and we were unable to recover it. 00:26:22.835 [2024-04-16 23:04:13.714727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.835 [2024-04-16 23:04:13.714839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.835 [2024-04-16 23:04:13.714864] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:22.835 qpair failed and we were unable to recover it. 00:26:22.835 [2024-04-16 23:04:13.714972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.835 [2024-04-16 23:04:13.715114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.835 [2024-04-16 23:04:13.715139] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:22.835 qpair failed and we were unable to recover it. 00:26:22.835 [2024-04-16 23:04:13.715326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.835 [2024-04-16 23:04:13.715431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.835 [2024-04-16 23:04:13.715456] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:22.835 qpair failed and we were unable to recover it. 00:26:22.835 [2024-04-16 23:04:13.715563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.835 [2024-04-16 23:04:13.715705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.835 [2024-04-16 23:04:13.715730] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:22.835 qpair failed and we were unable to recover it. 00:26:22.835 [2024-04-16 23:04:13.715878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.835 [2024-04-16 23:04:13.716019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.835 [2024-04-16 23:04:13.716044] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:22.835 qpair failed and we were unable to recover it. 00:26:22.835 [2024-04-16 23:04:13.716180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.835 [2024-04-16 23:04:13.716368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.835 [2024-04-16 23:04:13.716396] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:22.835 qpair failed and we were unable to recover it. 00:26:22.835 [2024-04-16 23:04:13.716564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.835 [2024-04-16 23:04:13.716740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.835 [2024-04-16 23:04:13.716766] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:22.835 qpair failed and we were unable to recover it. 00:26:22.835 [2024-04-16 23:04:13.716879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.835 [2024-04-16 23:04:13.717019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.835 [2024-04-16 23:04:13.717044] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:22.835 qpair failed and we were unable to recover it. 00:26:22.835 [2024-04-16 23:04:13.717186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.835 [2024-04-16 23:04:13.717354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.835 [2024-04-16 23:04:13.717379] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:22.835 qpair failed and we were unable to recover it. 00:26:22.835 [2024-04-16 23:04:13.717523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.835 [2024-04-16 23:04:13.717642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.835 [2024-04-16 23:04:13.717666] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:22.835 qpair failed and we were unable to recover it. 00:26:22.835 [2024-04-16 23:04:13.717776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.835 [2024-04-16 23:04:13.717960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.835 [2024-04-16 23:04:13.717987] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:22.835 qpair failed and we were unable to recover it. 00:26:22.835 [2024-04-16 23:04:13.718148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.835 [2024-04-16 23:04:13.718312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.835 [2024-04-16 23:04:13.718338] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:22.835 qpair failed and we were unable to recover it. 00:26:22.835 [2024-04-16 23:04:13.718488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.835 [2024-04-16 23:04:13.718630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.835 [2024-04-16 23:04:13.718658] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:22.835 qpair failed and we were unable to recover it. 00:26:22.835 [2024-04-16 23:04:13.718819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.835 [2024-04-16 23:04:13.719002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.835 [2024-04-16 23:04:13.719029] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:22.835 qpair failed and we were unable to recover it. 00:26:22.835 [2024-04-16 23:04:13.719183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.835 [2024-04-16 23:04:13.719377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.835 [2024-04-16 23:04:13.719402] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:22.835 qpair failed and we were unable to recover it. 00:26:22.835 [2024-04-16 23:04:13.719537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.835 [2024-04-16 23:04:13.719677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.835 [2024-04-16 23:04:13.719717] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:22.835 qpair failed and we were unable to recover it. 00:26:22.835 [2024-04-16 23:04:13.719873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.835 [2024-04-16 23:04:13.720008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.835 [2024-04-16 23:04:13.720038] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:22.835 qpair failed and we were unable to recover it. 00:26:22.835 [2024-04-16 23:04:13.720165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.835 [2024-04-16 23:04:13.720355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.835 [2024-04-16 23:04:13.720383] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:22.835 qpair failed and we were unable to recover it. 00:26:22.835 [2024-04-16 23:04:13.720533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.835 [2024-04-16 23:04:13.720715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.835 [2024-04-16 23:04:13.720743] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:22.835 qpair failed and we were unable to recover it. 00:26:22.835 [2024-04-16 23:04:13.720933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.835 [2024-04-16 23:04:13.721046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.836 [2024-04-16 23:04:13.721088] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:22.836 qpair failed and we were unable to recover it. 00:26:22.836 [2024-04-16 23:04:13.721219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.836 [2024-04-16 23:04:13.721424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.836 [2024-04-16 23:04:13.721449] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:22.836 qpair failed and we were unable to recover it. 00:26:22.836 [2024-04-16 23:04:13.721587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.836 [2024-04-16 23:04:13.721756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.836 [2024-04-16 23:04:13.721784] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:22.836 qpair failed and we were unable to recover it. 00:26:22.836 [2024-04-16 23:04:13.721950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.836 [2024-04-16 23:04:13.722101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.836 [2024-04-16 23:04:13.722125] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:22.836 qpair failed and we were unable to recover it. 00:26:22.836 [2024-04-16 23:04:13.722248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.836 [2024-04-16 23:04:13.722396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.836 [2024-04-16 23:04:13.722437] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:22.836 qpair failed and we were unable to recover it. 00:26:22.836 [2024-04-16 23:04:13.722560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.836 [2024-04-16 23:04:13.722714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.836 [2024-04-16 23:04:13.722742] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:22.836 qpair failed and we were unable to recover it. 00:26:22.836 [2024-04-16 23:04:13.722866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.836 [2024-04-16 23:04:13.723016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.836 [2024-04-16 23:04:13.723044] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:22.836 qpair failed and we were unable to recover it. 00:26:22.836 [2024-04-16 23:04:13.723260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.836 [2024-04-16 23:04:13.723435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.836 [2024-04-16 23:04:13.723466] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.836 qpair failed and we were unable to recover it. 00:26:22.836 [2024-04-16 23:04:13.723641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.836 [2024-04-16 23:04:13.723785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.836 [2024-04-16 23:04:13.723826] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.836 qpair failed and we were unable to recover it. 00:26:22.836 [2024-04-16 23:04:13.723966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.836 [2024-04-16 23:04:13.724123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.836 [2024-04-16 23:04:13.724150] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.836 qpair failed and we were unable to recover it. 00:26:22.836 [2024-04-16 23:04:13.724319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.836 [2024-04-16 23:04:13.724464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.836 [2024-04-16 23:04:13.724506] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.836 qpair failed and we were unable to recover it. 00:26:22.836 [2024-04-16 23:04:13.724631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.836 [2024-04-16 23:04:13.724822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.836 [2024-04-16 23:04:13.724846] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.836 qpair failed and we were unable to recover it. 00:26:22.836 [2024-04-16 23:04:13.724958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.836 [2024-04-16 23:04:13.725122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.836 [2024-04-16 23:04:13.725147] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.836 qpair failed and we were unable to recover it. 00:26:22.836 [2024-04-16 23:04:13.725357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.836 [2024-04-16 23:04:13.725487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.836 [2024-04-16 23:04:13.725512] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.836 qpair failed and we were unable to recover it. 00:26:22.836 [2024-04-16 23:04:13.725633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.836 [2024-04-16 23:04:13.725775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.836 [2024-04-16 23:04:13.725802] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.836 qpair failed and we were unable to recover it. 00:26:22.836 [2024-04-16 23:04:13.725918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.836 [2024-04-16 23:04:13.726028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.836 [2024-04-16 23:04:13.726053] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.836 qpair failed and we were unable to recover it. 00:26:22.836 [2024-04-16 23:04:13.726185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.836 [2024-04-16 23:04:13.726336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.836 [2024-04-16 23:04:13.726361] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.836 qpair failed and we were unable to recover it. 00:26:22.836 [2024-04-16 23:04:13.726495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.836 [2024-04-16 23:04:13.726652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.836 [2024-04-16 23:04:13.726677] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.836 qpair failed and we were unable to recover it. 00:26:22.836 [2024-04-16 23:04:13.726790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.836 [2024-04-16 23:04:13.726931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.836 [2024-04-16 23:04:13.726958] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.836 qpair failed and we were unable to recover it. 00:26:22.836 [2024-04-16 23:04:13.727101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.836 [2024-04-16 23:04:13.727267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.836 [2024-04-16 23:04:13.727293] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.836 qpair failed and we were unable to recover it. 00:26:22.836 [2024-04-16 23:04:13.727438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.836 [2024-04-16 23:04:13.727590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.836 [2024-04-16 23:04:13.727615] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.836 qpair failed and we were unable to recover it. 00:26:22.836 [2024-04-16 23:04:13.727772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.836 [2024-04-16 23:04:13.727917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.836 [2024-04-16 23:04:13.727941] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.836 qpair failed and we were unable to recover it. 00:26:22.836 [2024-04-16 23:04:13.728127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.836 [2024-04-16 23:04:13.728261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.836 [2024-04-16 23:04:13.728286] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.836 qpair failed and we were unable to recover it. 00:26:22.836 [2024-04-16 23:04:13.728437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.836 [2024-04-16 23:04:13.728610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.836 [2024-04-16 23:04:13.728635] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.836 qpair failed and we were unable to recover it. 00:26:22.836 [2024-04-16 23:04:13.728777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.836 [2024-04-16 23:04:13.728885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.836 [2024-04-16 23:04:13.728910] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.836 qpair failed and we were unable to recover it. 00:26:22.836 [2024-04-16 23:04:13.729074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.836 [2024-04-16 23:04:13.729242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.836 [2024-04-16 23:04:13.729267] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.836 qpair failed and we were unable to recover it. 00:26:22.836 [2024-04-16 23:04:13.729376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.836 [2024-04-16 23:04:13.729490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.836 [2024-04-16 23:04:13.729515] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.836 qpair failed and we were unable to recover it. 00:26:22.836 [2024-04-16 23:04:13.729619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.836 [2024-04-16 23:04:13.729784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.836 [2024-04-16 23:04:13.729813] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.836 qpair failed and we were unable to recover it. 00:26:22.836 [2024-04-16 23:04:13.729969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.836 [2024-04-16 23:04:13.730124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.836 [2024-04-16 23:04:13.730149] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.836 qpair failed and we were unable to recover it. 00:26:22.836 [2024-04-16 23:04:13.730302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.836 [2024-04-16 23:04:13.730417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.836 [2024-04-16 23:04:13.730442] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.837 qpair failed and we were unable to recover it. 00:26:22.837 [2024-04-16 23:04:13.730591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.837 [2024-04-16 23:04:13.730711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.837 [2024-04-16 23:04:13.730738] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.837 qpair failed and we were unable to recover it. 00:26:22.837 [2024-04-16 23:04:13.730859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.837 [2024-04-16 23:04:13.730989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.837 [2024-04-16 23:04:13.731018] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.837 qpair failed and we were unable to recover it. 00:26:22.837 [2024-04-16 23:04:13.731204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.837 [2024-04-16 23:04:13.731362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.837 [2024-04-16 23:04:13.731387] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.837 qpair failed and we were unable to recover it. 00:26:22.837 [2024-04-16 23:04:13.731533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.837 [2024-04-16 23:04:13.731685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.837 [2024-04-16 23:04:13.731719] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.837 qpair failed and we were unable to recover it. 00:26:22.837 [2024-04-16 23:04:13.731852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.837 [2024-04-16 23:04:13.731980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.837 [2024-04-16 23:04:13.732004] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.837 qpair failed and we were unable to recover it. 00:26:22.837 [2024-04-16 23:04:13.732112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.837 [2024-04-16 23:04:13.732221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.837 [2024-04-16 23:04:13.732247] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.837 qpair failed and we were unable to recover it. 00:26:22.837 [2024-04-16 23:04:13.732390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.837 [2024-04-16 23:04:13.732518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.837 [2024-04-16 23:04:13.732546] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.837 qpair failed and we were unable to recover it. 00:26:22.837 [2024-04-16 23:04:13.732825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.837 [2024-04-16 23:04:13.733033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.837 [2024-04-16 23:04:13.733060] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.837 qpair failed and we were unable to recover it. 00:26:22.837 [2024-04-16 23:04:13.733221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.837 [2024-04-16 23:04:13.733337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.837 [2024-04-16 23:04:13.733362] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.837 qpair failed and we were unable to recover it. 00:26:22.837 [2024-04-16 23:04:13.733501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.837 [2024-04-16 23:04:13.733662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.837 [2024-04-16 23:04:13.733689] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.837 qpair failed and we were unable to recover it. 00:26:22.837 [2024-04-16 23:04:13.733807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.837 [2024-04-16 23:04:13.733988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.837 [2024-04-16 23:04:13.734015] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.837 qpair failed and we were unable to recover it. 00:26:22.837 [2024-04-16 23:04:13.734147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.837 [2024-04-16 23:04:13.734277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.837 [2024-04-16 23:04:13.734303] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.837 qpair failed and we were unable to recover it. 00:26:22.837 [2024-04-16 23:04:13.734412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.837 [2024-04-16 23:04:13.734518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.837 [2024-04-16 23:04:13.734557] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.837 qpair failed and we were unable to recover it. 00:26:22.837 [2024-04-16 23:04:13.734716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.837 [2024-04-16 23:04:13.734846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.837 [2024-04-16 23:04:13.734873] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.837 qpair failed and we were unable to recover it. 00:26:22.837 [2024-04-16 23:04:13.735005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.837 [2024-04-16 23:04:13.735143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.837 [2024-04-16 23:04:13.735170] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.837 qpair failed and we were unable to recover it. 00:26:22.837 [2024-04-16 23:04:13.735320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.837 [2024-04-16 23:04:13.735477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.837 [2024-04-16 23:04:13.735505] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.837 qpair failed and we were unable to recover it. 00:26:22.837 [2024-04-16 23:04:13.735670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.837 [2024-04-16 23:04:13.735836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.837 [2024-04-16 23:04:13.735864] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.837 qpair failed and we were unable to recover it. 00:26:22.837 [2024-04-16 23:04:13.736004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.837 [2024-04-16 23:04:13.736186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.837 [2024-04-16 23:04:13.736211] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.837 qpair failed and we were unable to recover it. 00:26:22.837 [2024-04-16 23:04:13.736344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.837 [2024-04-16 23:04:13.736465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.837 [2024-04-16 23:04:13.736493] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.837 qpair failed and we were unable to recover it. 00:26:22.837 [2024-04-16 23:04:13.736728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.837 [2024-04-16 23:04:13.736879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.837 [2024-04-16 23:04:13.736906] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.837 qpair failed and we were unable to recover it. 00:26:22.837 [2024-04-16 23:04:13.737040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.837 [2024-04-16 23:04:13.737195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.837 [2024-04-16 23:04:13.737237] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.837 qpair failed and we were unable to recover it. 00:26:22.837 [2024-04-16 23:04:13.737389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.837 [2024-04-16 23:04:13.737634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.837 [2024-04-16 23:04:13.737661] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.837 qpair failed and we were unable to recover it. 00:26:22.837 [2024-04-16 23:04:13.737806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.837 [2024-04-16 23:04:13.737925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.837 [2024-04-16 23:04:13.737953] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.837 qpair failed and we were unable to recover it. 00:26:22.837 [2024-04-16 23:04:13.738118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.837 [2024-04-16 23:04:13.738265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.837 [2024-04-16 23:04:13.738292] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.837 qpair failed and we were unable to recover it. 00:26:22.837 [2024-04-16 23:04:13.738410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.837 [2024-04-16 23:04:13.738530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.837 [2024-04-16 23:04:13.738555] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.837 qpair failed and we were unable to recover it. 00:26:22.837 [2024-04-16 23:04:13.738681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.837 [2024-04-16 23:04:13.738825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.837 [2024-04-16 23:04:13.738850] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.837 qpair failed and we were unable to recover it. 00:26:22.837 [2024-04-16 23:04:13.738982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.837 [2024-04-16 23:04:13.739124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.837 [2024-04-16 23:04:13.739149] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.837 qpair failed and we were unable to recover it. 00:26:22.837 [2024-04-16 23:04:13.739277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.837 [2024-04-16 23:04:13.739422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.837 [2024-04-16 23:04:13.739448] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.837 qpair failed and we were unable to recover it. 00:26:22.837 [2024-04-16 23:04:13.739601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.837 [2024-04-16 23:04:13.739729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.837 [2024-04-16 23:04:13.739757] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.837 qpair failed and we were unable to recover it. 00:26:22.838 [2024-04-16 23:04:13.739927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.838 [2024-04-16 23:04:13.740058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.838 [2024-04-16 23:04:13.740085] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.838 qpair failed and we were unable to recover it. 00:26:22.838 [2024-04-16 23:04:13.740250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.838 [2024-04-16 23:04:13.740396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.838 [2024-04-16 23:04:13.740421] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.838 qpair failed and we were unable to recover it. 00:26:22.838 [2024-04-16 23:04:13.740555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.838 [2024-04-16 23:04:13.740748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.838 [2024-04-16 23:04:13.740777] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.838 qpair failed and we were unable to recover it. 00:26:22.838 [2024-04-16 23:04:13.740948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.838 [2024-04-16 23:04:13.741066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.838 [2024-04-16 23:04:13.741093] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.838 qpair failed and we were unable to recover it. 00:26:22.838 [2024-04-16 23:04:13.741246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.838 [2024-04-16 23:04:13.741389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.838 [2024-04-16 23:04:13.741414] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.838 qpair failed and we were unable to recover it. 00:26:22.838 [2024-04-16 23:04:13.741543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.838 [2024-04-16 23:04:13.741681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.838 [2024-04-16 23:04:13.741709] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.838 qpair failed and we were unable to recover it. 00:26:22.838 [2024-04-16 23:04:13.741861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.838 [2024-04-16 23:04:13.742004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.838 [2024-04-16 23:04:13.742031] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.838 qpair failed and we were unable to recover it. 00:26:22.838 [2024-04-16 23:04:13.742197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.838 [2024-04-16 23:04:13.742339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.838 [2024-04-16 23:04:13.742364] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.838 qpair failed and we were unable to recover it. 00:26:22.838 [2024-04-16 23:04:13.742497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.838 [2024-04-16 23:04:13.742668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.838 [2024-04-16 23:04:13.742694] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.838 qpair failed and we were unable to recover it. 00:26:22.838 [2024-04-16 23:04:13.742838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.838 [2024-04-16 23:04:13.742977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.838 [2024-04-16 23:04:13.743011] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.838 qpair failed and we were unable to recover it. 00:26:22.838 [2024-04-16 23:04:13.743163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.838 [2024-04-16 23:04:13.743330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.838 [2024-04-16 23:04:13.743355] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.838 qpair failed and we were unable to recover it. 00:26:22.838 [2024-04-16 23:04:13.743516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.838 [2024-04-16 23:04:13.743623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.838 [2024-04-16 23:04:13.743664] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.838 qpair failed and we were unable to recover it. 00:26:22.838 [2024-04-16 23:04:13.743778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.838 [2024-04-16 23:04:13.743932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.838 [2024-04-16 23:04:13.743973] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.838 qpair failed and we were unable to recover it. 00:26:22.838 [2024-04-16 23:04:13.744143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.838 [2024-04-16 23:04:13.744302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.838 [2024-04-16 23:04:13.744327] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.838 qpair failed and we were unable to recover it. 00:26:22.838 [2024-04-16 23:04:13.744485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.838 [2024-04-16 23:04:13.744600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.838 [2024-04-16 23:04:13.744627] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.838 qpair failed and we were unable to recover it. 00:26:22.838 [2024-04-16 23:04:13.744859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.838 [2024-04-16 23:04:13.745009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.838 [2024-04-16 23:04:13.745036] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.838 qpair failed and we were unable to recover it. 00:26:22.838 [2024-04-16 23:04:13.745221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.838 [2024-04-16 23:04:13.745379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.838 [2024-04-16 23:04:13.745404] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.838 qpair failed and we were unable to recover it. 00:26:22.838 [2024-04-16 23:04:13.745567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.838 [2024-04-16 23:04:13.745693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.838 [2024-04-16 23:04:13.745720] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.838 qpair failed and we were unable to recover it. 00:26:22.838 [2024-04-16 23:04:13.745876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.838 [2024-04-16 23:04:13.746026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.838 [2024-04-16 23:04:13.746054] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.838 qpair failed and we were unable to recover it. 00:26:22.838 [2024-04-16 23:04:13.746221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.838 [2024-04-16 23:04:13.746367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.838 [2024-04-16 23:04:13.746397] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.838 qpair failed and we were unable to recover it. 00:26:22.838 [2024-04-16 23:04:13.746575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.838 [2024-04-16 23:04:13.746746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.838 [2024-04-16 23:04:13.746815] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.838 qpair failed and we were unable to recover it. 00:26:22.838 [2024-04-16 23:04:13.746960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.838 [2024-04-16 23:04:13.747116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.838 [2024-04-16 23:04:13.747143] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.838 qpair failed and we were unable to recover it. 00:26:22.838 [2024-04-16 23:04:13.747290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.838 [2024-04-16 23:04:13.747407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.838 [2024-04-16 23:04:13.747433] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.838 qpair failed and we were unable to recover it. 00:26:22.838 [2024-04-16 23:04:13.747580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.838 [2024-04-16 23:04:13.747716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.838 [2024-04-16 23:04:13.747744] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.838 qpair failed and we were unable to recover it. 00:26:22.838 [2024-04-16 23:04:13.747889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.838 [2024-04-16 23:04:13.748037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.838 [2024-04-16 23:04:13.748065] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.838 qpair failed and we were unable to recover it. 00:26:22.838 [2024-04-16 23:04:13.748267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.838 [2024-04-16 23:04:13.748390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.838 [2024-04-16 23:04:13.748415] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.838 qpair failed and we were unable to recover it. 00:26:22.838 [2024-04-16 23:04:13.748567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.838 [2024-04-16 23:04:13.748691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.838 [2024-04-16 23:04:13.748719] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.838 qpair failed and we were unable to recover it. 00:26:22.838 [2024-04-16 23:04:13.748935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.838 [2024-04-16 23:04:13.749088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.838 [2024-04-16 23:04:13.749116] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.838 qpair failed and we were unable to recover it. 00:26:22.838 [2024-04-16 23:04:13.749249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.838 [2024-04-16 23:04:13.749364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.838 [2024-04-16 23:04:13.749389] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.838 qpair failed and we were unable to recover it. 00:26:22.838 [2024-04-16 23:04:13.749497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.839 [2024-04-16 23:04:13.749604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.839 [2024-04-16 23:04:13.749649] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.839 qpair failed and we were unable to recover it. 00:26:22.839 [2024-04-16 23:04:13.749816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.839 [2024-04-16 23:04:13.749980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.839 [2024-04-16 23:04:13.750008] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.839 qpair failed and we were unable to recover it. 00:26:22.839 [2024-04-16 23:04:13.750139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.839 [2024-04-16 23:04:13.750297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.839 [2024-04-16 23:04:13.750322] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.839 qpair failed and we were unable to recover it. 00:26:22.839 [2024-04-16 23:04:13.750467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.839 [2024-04-16 23:04:13.750585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.839 [2024-04-16 23:04:13.750613] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.839 qpair failed and we were unable to recover it. 00:26:22.839 [2024-04-16 23:04:13.750794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.839 [2024-04-16 23:04:13.750972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.839 [2024-04-16 23:04:13.751000] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.839 qpair failed and we were unable to recover it. 00:26:22.839 [2024-04-16 23:04:13.751142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.839 [2024-04-16 23:04:13.751286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.839 [2024-04-16 23:04:13.751312] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.839 qpair failed and we were unable to recover it. 00:26:22.839 [2024-04-16 23:04:13.751445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.839 [2024-04-16 23:04:13.751608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.839 [2024-04-16 23:04:13.751640] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.839 qpair failed and we were unable to recover it. 00:26:22.839 [2024-04-16 23:04:13.751768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.839 [2024-04-16 23:04:13.751886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.839 [2024-04-16 23:04:13.751914] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.839 qpair failed and we were unable to recover it. 00:26:22.839 [2024-04-16 23:04:13.752074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.839 [2024-04-16 23:04:13.752194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.839 [2024-04-16 23:04:13.752238] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.839 qpair failed and we were unable to recover it. 00:26:22.839 [2024-04-16 23:04:13.752341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.839 [2024-04-16 23:04:13.752492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.839 [2024-04-16 23:04:13.752520] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.839 qpair failed and we were unable to recover it. 00:26:22.839 [2024-04-16 23:04:13.752695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.839 [2024-04-16 23:04:13.752852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.839 [2024-04-16 23:04:13.752881] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.839 qpair failed and we were unable to recover it. 00:26:22.839 [2024-04-16 23:04:13.753035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.839 [2024-04-16 23:04:13.753142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.839 [2024-04-16 23:04:13.753166] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.839 qpair failed and we were unable to recover it. 00:26:22.839 [2024-04-16 23:04:13.753316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.839 [2024-04-16 23:04:13.753465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.839 [2024-04-16 23:04:13.753492] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.839 qpair failed and we were unable to recover it. 00:26:22.839 [2024-04-16 23:04:13.753619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.839 [2024-04-16 23:04:13.753788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.839 [2024-04-16 23:04:13.753833] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.839 qpair failed and we were unable to recover it. 00:26:22.839 [2024-04-16 23:04:13.754079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.839 [2024-04-16 23:04:13.754285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.839 [2024-04-16 23:04:13.754310] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.839 qpair failed and we were unable to recover it. 00:26:22.839 [2024-04-16 23:04:13.754420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.839 [2024-04-16 23:04:13.754564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.839 [2024-04-16 23:04:13.754590] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.839 qpair failed and we were unable to recover it. 00:26:22.839 [2024-04-16 23:04:13.754747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.839 [2024-04-16 23:04:13.754957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.839 [2024-04-16 23:04:13.754984] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.839 qpair failed and we were unable to recover it. 00:26:22.839 [2024-04-16 23:04:13.755191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.839 [2024-04-16 23:04:13.755334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.839 [2024-04-16 23:04:13.755359] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.839 qpair failed and we were unable to recover it. 00:26:22.839 [2024-04-16 23:04:13.755499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.839 [2024-04-16 23:04:13.755639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.839 [2024-04-16 23:04:13.755664] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.839 qpair failed and we were unable to recover it. 00:26:22.839 [2024-04-16 23:04:13.755895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.839 [2024-04-16 23:04:13.756041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.839 [2024-04-16 23:04:13.756070] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.839 qpair failed and we were unable to recover it. 00:26:22.839 [2024-04-16 23:04:13.756221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.839 [2024-04-16 23:04:13.756348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.839 [2024-04-16 23:04:13.756373] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.839 qpair failed and we were unable to recover it. 00:26:22.839 [2024-04-16 23:04:13.756545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.839 [2024-04-16 23:04:13.756667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.839 [2024-04-16 23:04:13.756695] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.839 qpair failed and we were unable to recover it. 00:26:22.839 [2024-04-16 23:04:13.756826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.839 [2024-04-16 23:04:13.757009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.839 [2024-04-16 23:04:13.757037] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.839 qpair failed and we were unable to recover it. 00:26:22.839 [2024-04-16 23:04:13.757172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.839 [2024-04-16 23:04:13.757287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.839 [2024-04-16 23:04:13.757311] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.839 qpair failed and we were unable to recover it. 00:26:22.839 [2024-04-16 23:04:13.757477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.839 [2024-04-16 23:04:13.757603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.839 [2024-04-16 23:04:13.757630] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.839 qpair failed and we were unable to recover it. 00:26:22.839 [2024-04-16 23:04:13.757754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.839 [2024-04-16 23:04:13.757878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.839 [2024-04-16 23:04:13.757907] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.839 qpair failed and we were unable to recover it. 00:26:22.839 [2024-04-16 23:04:13.758034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.839 [2024-04-16 23:04:13.758195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.839 [2024-04-16 23:04:13.758237] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.839 qpair failed and we were unable to recover it. 00:26:22.839 [2024-04-16 23:04:13.758348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.839 [2024-04-16 23:04:13.758472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.839 [2024-04-16 23:04:13.758499] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.839 qpair failed and we were unable to recover it. 00:26:22.839 [2024-04-16 23:04:13.758646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.839 [2024-04-16 23:04:13.758805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.839 [2024-04-16 23:04:13.758832] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.839 qpair failed and we were unable to recover it. 00:26:22.839 [2024-04-16 23:04:13.758956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.839 [2024-04-16 23:04:13.759104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.840 [2024-04-16 23:04:13.759131] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.840 qpair failed and we were unable to recover it. 00:26:22.840 [2024-04-16 23:04:13.759279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.840 [2024-04-16 23:04:13.759421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.840 [2024-04-16 23:04:13.759446] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.840 qpair failed and we were unable to recover it. 00:26:22.840 [2024-04-16 23:04:13.759604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.840 [2024-04-16 23:04:13.759731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.840 [2024-04-16 23:04:13.759760] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.840 qpair failed and we were unable to recover it. 00:26:22.840 [2024-04-16 23:04:13.759923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.840 [2024-04-16 23:04:13.760048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.840 [2024-04-16 23:04:13.760075] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.840 qpair failed and we were unable to recover it. 00:26:22.840 [2024-04-16 23:04:13.760239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.840 [2024-04-16 23:04:13.760380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.840 [2024-04-16 23:04:13.760405] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.840 qpair failed and we were unable to recover it. 00:26:22.840 [2024-04-16 23:04:13.760551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.840 [2024-04-16 23:04:13.760688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.840 [2024-04-16 23:04:13.760715] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.840 qpair failed and we were unable to recover it. 00:26:22.840 [2024-04-16 23:04:13.760847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.840 [2024-04-16 23:04:13.760997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.840 [2024-04-16 23:04:13.761024] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.840 qpair failed and we were unable to recover it. 00:26:22.840 [2024-04-16 23:04:13.761183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.840 [2024-04-16 23:04:13.761310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.840 [2024-04-16 23:04:13.761335] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.840 qpair failed and we were unable to recover it. 00:26:22.840 [2024-04-16 23:04:13.761445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.840 [2024-04-16 23:04:13.761585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.840 [2024-04-16 23:04:13.761621] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.840 qpair failed and we were unable to recover it. 00:26:22.840 [2024-04-16 23:04:13.761768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.840 [2024-04-16 23:04:13.761947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.840 [2024-04-16 23:04:13.761974] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.840 qpair failed and we were unable to recover it. 00:26:22.840 [2024-04-16 23:04:13.762122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.840 [2024-04-16 23:04:13.762268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.840 [2024-04-16 23:04:13.762294] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.840 qpair failed and we were unable to recover it. 00:26:22.840 [2024-04-16 23:04:13.762481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.840 [2024-04-16 23:04:13.762635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.840 [2024-04-16 23:04:13.762662] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.840 qpair failed and we were unable to recover it. 00:26:22.840 [2024-04-16 23:04:13.762794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.840 [2024-04-16 23:04:13.762933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.840 [2024-04-16 23:04:13.762957] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.840 qpair failed and we were unable to recover it. 00:26:22.840 [2024-04-16 23:04:13.763098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.840 [2024-04-16 23:04:13.763223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.840 [2024-04-16 23:04:13.763249] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.840 qpair failed and we were unable to recover it. 00:26:22.840 [2024-04-16 23:04:13.763409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.840 [2024-04-16 23:04:13.763532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.840 [2024-04-16 23:04:13.763559] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.840 qpair failed and we were unable to recover it. 00:26:22.840 [2024-04-16 23:04:13.763751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.840 [2024-04-16 23:04:13.763883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.840 [2024-04-16 23:04:13.763908] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.840 qpair failed and we were unable to recover it. 00:26:22.840 [2024-04-16 23:04:13.764078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.840 [2024-04-16 23:04:13.764235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.840 [2024-04-16 23:04:13.764263] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.840 qpair failed and we were unable to recover it. 00:26:22.840 [2024-04-16 23:04:13.764400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.840 [2024-04-16 23:04:13.764511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.840 [2024-04-16 23:04:13.764536] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.840 qpair failed and we were unable to recover it. 00:26:22.840 [2024-04-16 23:04:13.764700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.840 [2024-04-16 23:04:13.764852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.840 [2024-04-16 23:04:13.764880] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.840 qpair failed and we were unable to recover it. 00:26:22.840 [2024-04-16 23:04:13.765004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.840 [2024-04-16 23:04:13.765126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.840 [2024-04-16 23:04:13.765153] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.840 qpair failed and we were unable to recover it. 00:26:22.840 [2024-04-16 23:04:13.765304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.840 [2024-04-16 23:04:13.765444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.840 [2024-04-16 23:04:13.765468] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.840 qpair failed and we were unable to recover it. 00:26:22.840 [2024-04-16 23:04:13.765617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.840 [2024-04-16 23:04:13.765758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.840 [2024-04-16 23:04:13.765783] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.840 qpair failed and we were unable to recover it. 00:26:22.840 [2024-04-16 23:04:13.765954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.840 [2024-04-16 23:04:13.766077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.840 [2024-04-16 23:04:13.766108] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.840 qpair failed and we were unable to recover it. 00:26:22.840 [2024-04-16 23:04:13.766239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.840 [2024-04-16 23:04:13.766394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.840 [2024-04-16 23:04:13.766422] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.840 qpair failed and we were unable to recover it. 00:26:22.840 [2024-04-16 23:04:13.766626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.840 [2024-04-16 23:04:13.766764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.840 [2024-04-16 23:04:13.766789] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.840 qpair failed and we were unable to recover it. 00:26:22.841 [2024-04-16 23:04:13.766933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.841 [2024-04-16 23:04:13.767072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.841 [2024-04-16 23:04:13.767097] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.841 qpair failed and we were unable to recover it. 00:26:22.841 [2024-04-16 23:04:13.767263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.841 [2024-04-16 23:04:13.767453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.841 [2024-04-16 23:04:13.767488] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.841 qpair failed and we were unable to recover it. 00:26:22.841 [2024-04-16 23:04:13.767591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.841 [2024-04-16 23:04:13.767733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.841 [2024-04-16 23:04:13.767757] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.841 qpair failed and we were unable to recover it. 00:26:22.841 [2024-04-16 23:04:13.767922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.841 [2024-04-16 23:04:13.768050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.841 [2024-04-16 23:04:13.768078] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.841 qpair failed and we were unable to recover it. 00:26:22.841 [2024-04-16 23:04:13.768249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.841 [2024-04-16 23:04:13.768394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.841 [2024-04-16 23:04:13.768419] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.841 qpair failed and we were unable to recover it. 00:26:22.841 [2024-04-16 23:04:13.768565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.841 [2024-04-16 23:04:13.768725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.841 [2024-04-16 23:04:13.768750] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.841 qpair failed and we were unable to recover it. 00:26:22.841 [2024-04-16 23:04:13.768861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.841 [2024-04-16 23:04:13.768974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.841 [2024-04-16 23:04:13.768998] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.841 qpair failed and we were unable to recover it. 00:26:22.841 [2024-04-16 23:04:13.769142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.841 [2024-04-16 23:04:13.769304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.841 [2024-04-16 23:04:13.769331] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.841 qpair failed and we were unable to recover it. 00:26:22.841 [2024-04-16 23:04:13.769494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.841 [2024-04-16 23:04:13.769641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.841 [2024-04-16 23:04:13.769682] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.841 qpair failed and we were unable to recover it. 00:26:22.841 [2024-04-16 23:04:13.769876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.841 [2024-04-16 23:04:13.770001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.841 [2024-04-16 23:04:13.770025] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.841 qpair failed and we were unable to recover it. 00:26:22.841 [2024-04-16 23:04:13.770210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.841 [2024-04-16 23:04:13.770319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.841 [2024-04-16 23:04:13.770344] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.841 qpair failed and we were unable to recover it. 00:26:22.841 [2024-04-16 23:04:13.770459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.841 [2024-04-16 23:04:13.770597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.841 [2024-04-16 23:04:13.770622] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.841 qpair failed and we were unable to recover it. 00:26:22.841 [2024-04-16 23:04:13.770766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.841 [2024-04-16 23:04:13.770876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.841 [2024-04-16 23:04:13.770901] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.841 qpair failed and we were unable to recover it. 00:26:22.841 [2024-04-16 23:04:13.771034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.841 [2024-04-16 23:04:13.771165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.841 [2024-04-16 23:04:13.771198] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.841 qpair failed and we were unable to recover it. 00:26:22.841 [2024-04-16 23:04:13.771311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.841 [2024-04-16 23:04:13.771452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.841 [2024-04-16 23:04:13.771477] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.841 qpair failed and we were unable to recover it. 00:26:22.841 [2024-04-16 23:04:13.771650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.841 [2024-04-16 23:04:13.771762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.841 [2024-04-16 23:04:13.771787] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.841 qpair failed and we were unable to recover it. 00:26:22.841 [2024-04-16 23:04:13.771939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.841 [2024-04-16 23:04:13.772084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.841 [2024-04-16 23:04:13.772126] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.841 qpair failed and we were unable to recover it. 00:26:22.841 [2024-04-16 23:04:13.772254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.841 [2024-04-16 23:04:13.772415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.841 [2024-04-16 23:04:13.772444] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.841 qpair failed and we were unable to recover it. 00:26:22.841 [2024-04-16 23:04:13.772653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.841 [2024-04-16 23:04:13.772820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.841 [2024-04-16 23:04:13.772845] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.841 qpair failed and we were unable to recover it. 00:26:22.841 [2024-04-16 23:04:13.773020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.841 [2024-04-16 23:04:13.773302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.841 [2024-04-16 23:04:13.773332] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.841 qpair failed and we were unable to recover it. 00:26:22.841 [2024-04-16 23:04:13.773548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.841 [2024-04-16 23:04:13.773737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.841 [2024-04-16 23:04:13.773764] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.841 qpair failed and we were unable to recover it. 00:26:22.841 [2024-04-16 23:04:13.773921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.841 [2024-04-16 23:04:13.774086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.841 [2024-04-16 23:04:13.774113] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.841 qpair failed and we were unable to recover it. 00:26:22.841 [2024-04-16 23:04:13.774246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.841 [2024-04-16 23:04:13.774376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.841 [2024-04-16 23:04:13.774403] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.841 qpair failed and we were unable to recover it. 00:26:22.841 [2024-04-16 23:04:13.774568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.841 [2024-04-16 23:04:13.774692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.841 [2024-04-16 23:04:13.774720] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.841 qpair failed and we were unable to recover it. 00:26:22.841 [2024-04-16 23:04:13.774893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.841 [2024-04-16 23:04:13.775044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.841 [2024-04-16 23:04:13.775069] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.841 qpair failed and we were unable to recover it. 00:26:22.841 [2024-04-16 23:04:13.775272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.841 [2024-04-16 23:04:13.775382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.841 [2024-04-16 23:04:13.775407] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.841 qpair failed and we were unable to recover it. 00:26:22.841 [2024-04-16 23:04:13.775601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.841 [2024-04-16 23:04:13.775721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.841 [2024-04-16 23:04:13.775748] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.841 qpair failed and we were unable to recover it. 00:26:22.841 [2024-04-16 23:04:13.775910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.841 [2024-04-16 23:04:13.776059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.841 [2024-04-16 23:04:13.776086] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.841 qpair failed and we were unable to recover it. 00:26:22.841 [2024-04-16 23:04:13.776250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.841 [2024-04-16 23:04:13.776393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.841 [2024-04-16 23:04:13.776436] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.841 qpair failed and we were unable to recover it. 00:26:22.841 [2024-04-16 23:04:13.776556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.842 [2024-04-16 23:04:13.776713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.842 [2024-04-16 23:04:13.776741] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.842 qpair failed and we were unable to recover it. 00:26:22.842 [2024-04-16 23:04:13.776861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.842 [2024-04-16 23:04:13.777000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.842 [2024-04-16 23:04:13.777028] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.842 qpair failed and we were unable to recover it. 00:26:22.842 [2024-04-16 23:04:13.777190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.842 [2024-04-16 23:04:13.777347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.842 [2024-04-16 23:04:13.777375] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.842 qpair failed and we were unable to recover it. 00:26:22.842 [2024-04-16 23:04:13.777549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.842 [2024-04-16 23:04:13.777660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.842 [2024-04-16 23:04:13.777684] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.842 qpair failed and we were unable to recover it. 00:26:22.842 [2024-04-16 23:04:13.777824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.842 [2024-04-16 23:04:13.777989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.842 [2024-04-16 23:04:13.778016] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.842 qpair failed and we were unable to recover it. 00:26:22.842 [2024-04-16 23:04:13.778168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.842 [2024-04-16 23:04:13.778329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.842 [2024-04-16 23:04:13.778357] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.842 qpair failed and we were unable to recover it. 00:26:22.842 [2024-04-16 23:04:13.778509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.842 [2024-04-16 23:04:13.778669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.842 [2024-04-16 23:04:13.778697] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.842 qpair failed and we were unable to recover it. 00:26:22.842 [2024-04-16 23:04:13.778860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.842 [2024-04-16 23:04:13.779055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.842 [2024-04-16 23:04:13.779083] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.842 qpair failed and we were unable to recover it. 00:26:22.842 [2024-04-16 23:04:13.779265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.842 [2024-04-16 23:04:13.779389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.842 [2024-04-16 23:04:13.779417] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.842 qpair failed and we were unable to recover it. 00:26:22.842 [2024-04-16 23:04:13.779578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.842 [2024-04-16 23:04:13.779741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.842 [2024-04-16 23:04:13.779770] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.842 qpair failed and we were unable to recover it. 00:26:22.842 [2024-04-16 23:04:13.779929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.842 [2024-04-16 23:04:13.780064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.842 [2024-04-16 23:04:13.780091] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.842 qpair failed and we were unable to recover it. 00:26:22.842 [2024-04-16 23:04:13.780259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.842 [2024-04-16 23:04:13.780405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.842 [2024-04-16 23:04:13.780446] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.842 qpair failed and we were unable to recover it. 00:26:22.842 [2024-04-16 23:04:13.780610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.842 [2024-04-16 23:04:13.780727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.842 [2024-04-16 23:04:13.780756] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.842 qpair failed and we were unable to recover it. 00:26:22.842 [2024-04-16 23:04:13.780883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.842 [2024-04-16 23:04:13.781040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.842 [2024-04-16 23:04:13.781064] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.842 qpair failed and we were unable to recover it. 00:26:22.842 [2024-04-16 23:04:13.781213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.842 [2024-04-16 23:04:13.781372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.842 [2024-04-16 23:04:13.781399] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.842 qpair failed and we were unable to recover it. 00:26:22.842 [2024-04-16 23:04:13.781572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.842 [2024-04-16 23:04:13.781761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.842 [2024-04-16 23:04:13.781788] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.842 qpair failed and we were unable to recover it. 00:26:22.842 [2024-04-16 23:04:13.781970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.842 [2024-04-16 23:04:13.782118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.842 [2024-04-16 23:04:13.782145] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.842 qpair failed and we were unable to recover it. 00:26:22.842 [2024-04-16 23:04:13.782285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.842 [2024-04-16 23:04:13.782421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.842 [2024-04-16 23:04:13.782450] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.842 qpair failed and we were unable to recover it. 00:26:22.842 [2024-04-16 23:04:13.782602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.842 [2024-04-16 23:04:13.782754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.842 [2024-04-16 23:04:13.782781] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.842 qpair failed and we were unable to recover it. 00:26:22.842 [2024-04-16 23:04:13.782946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.842 [2024-04-16 23:04:13.783057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.842 [2024-04-16 23:04:13.783086] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.842 qpair failed and we were unable to recover it. 00:26:22.842 [2024-04-16 23:04:13.783270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.842 [2024-04-16 23:04:13.783411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.842 [2024-04-16 23:04:13.783437] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.842 qpair failed and we were unable to recover it. 00:26:22.842 [2024-04-16 23:04:13.783624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.842 [2024-04-16 23:04:13.783788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.842 [2024-04-16 23:04:13.783819] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.842 qpair failed and we were unable to recover it. 00:26:22.842 [2024-04-16 23:04:13.783996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.842 [2024-04-16 23:04:13.784108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.842 [2024-04-16 23:04:13.784133] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.842 qpair failed and we were unable to recover it. 00:26:22.842 [2024-04-16 23:04:13.784278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.842 [2024-04-16 23:04:13.784420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.842 [2024-04-16 23:04:13.784445] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.842 qpair failed and we were unable to recover it. 00:26:22.842 [2024-04-16 23:04:13.784560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.842 [2024-04-16 23:04:13.784668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.842 [2024-04-16 23:04:13.784693] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.842 qpair failed and we were unable to recover it. 00:26:22.842 [2024-04-16 23:04:13.784828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.842 [2024-04-16 23:04:13.785009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.842 [2024-04-16 23:04:13.785036] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.842 qpair failed and we were unable to recover it. 00:26:22.842 [2024-04-16 23:04:13.785189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.842 [2024-04-16 23:04:13.785343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.842 [2024-04-16 23:04:13.785370] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.842 qpair failed and we were unable to recover it. 00:26:22.842 [2024-04-16 23:04:13.785541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.842 [2024-04-16 23:04:13.785684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.842 [2024-04-16 23:04:13.785709] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.842 qpair failed and we were unable to recover it. 00:26:22.842 [2024-04-16 23:04:13.785914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.842 [2024-04-16 23:04:13.786056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.842 [2024-04-16 23:04:13.786085] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.842 qpair failed and we were unable to recover it. 00:26:22.842 [2024-04-16 23:04:13.786277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.842 [2024-04-16 23:04:13.786418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.843 [2024-04-16 23:04:13.786443] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.843 qpair failed and we were unable to recover it. 00:26:22.843 [2024-04-16 23:04:13.786596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.843 [2024-04-16 23:04:13.786753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.843 [2024-04-16 23:04:13.786781] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.843 qpair failed and we were unable to recover it. 00:26:22.843 [2024-04-16 23:04:13.786931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.843 [2024-04-16 23:04:13.787046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.843 [2024-04-16 23:04:13.787070] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.843 qpair failed and we were unable to recover it. 00:26:22.843 [2024-04-16 23:04:13.787276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.843 [2024-04-16 23:04:13.787446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.843 [2024-04-16 23:04:13.787471] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.843 qpair failed and we were unable to recover it. 00:26:22.843 [2024-04-16 23:04:13.787606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.843 [2024-04-16 23:04:13.787747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.843 [2024-04-16 23:04:13.787771] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.843 qpair failed and we were unable to recover it. 00:26:22.843 [2024-04-16 23:04:13.787936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.843 [2024-04-16 23:04:13.788053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.843 [2024-04-16 23:04:13.788078] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.843 qpair failed and we were unable to recover it. 00:26:22.843 [2024-04-16 23:04:13.788220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.843 [2024-04-16 23:04:13.788373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.843 [2024-04-16 23:04:13.788415] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.843 qpair failed and we were unable to recover it. 00:26:22.843 [2024-04-16 23:04:13.788568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.843 [2024-04-16 23:04:13.788761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.843 [2024-04-16 23:04:13.788786] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.843 qpair failed and we were unable to recover it. 00:26:22.843 [2024-04-16 23:04:13.788896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.843 [2024-04-16 23:04:13.788998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.843 [2024-04-16 23:04:13.789023] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.843 qpair failed and we were unable to recover it. 00:26:22.843 [2024-04-16 23:04:13.789164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.843 [2024-04-16 23:04:13.789297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.843 [2024-04-16 23:04:13.789325] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.843 qpair failed and we were unable to recover it. 00:26:22.843 [2024-04-16 23:04:13.789494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.843 [2024-04-16 23:04:13.789625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.843 [2024-04-16 23:04:13.789650] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.843 qpair failed and we were unable to recover it. 00:26:22.843 [2024-04-16 23:04:13.789814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.843 [2024-04-16 23:04:13.789967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.843 [2024-04-16 23:04:13.789994] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.843 qpair failed and we were unable to recover it. 00:26:22.843 [2024-04-16 23:04:13.790145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.843 [2024-04-16 23:04:13.790334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.843 [2024-04-16 23:04:13.790359] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.843 qpair failed and we were unable to recover it. 00:26:22.843 [2024-04-16 23:04:13.790517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.843 [2024-04-16 23:04:13.790623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.843 [2024-04-16 23:04:13.790648] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.843 qpair failed and we were unable to recover it. 00:26:22.843 [2024-04-16 23:04:13.790825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.843 [2024-04-16 23:04:13.790927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.843 [2024-04-16 23:04:13.790951] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.843 qpair failed and we were unable to recover it. 00:26:22.843 [2024-04-16 23:04:13.791093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.843 [2024-04-16 23:04:13.791208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.843 [2024-04-16 23:04:13.791234] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.843 qpair failed and we were unable to recover it. 00:26:22.843 [2024-04-16 23:04:13.791364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.843 [2024-04-16 23:04:13.791478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.843 [2024-04-16 23:04:13.791505] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.843 qpair failed and we were unable to recover it. 00:26:22.843 [2024-04-16 23:04:13.791652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.843 [2024-04-16 23:04:13.791823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.843 [2024-04-16 23:04:13.791848] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.843 qpair failed and we were unable to recover it. 00:26:22.843 [2024-04-16 23:04:13.791985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.843 [2024-04-16 23:04:13.792126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.843 [2024-04-16 23:04:13.792152] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.843 qpair failed and we were unable to recover it. 00:26:22.843 [2024-04-16 23:04:13.792343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.843 [2024-04-16 23:04:13.792522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.843 [2024-04-16 23:04:13.792550] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.843 qpair failed and we were unable to recover it. 00:26:22.843 [2024-04-16 23:04:13.792705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.843 [2024-04-16 23:04:13.792856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.843 [2024-04-16 23:04:13.792884] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.843 qpair failed and we were unable to recover it. 00:26:22.843 [2024-04-16 23:04:13.793016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.843 [2024-04-16 23:04:13.793169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.843 [2024-04-16 23:04:13.793205] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.843 qpair failed and we were unable to recover it. 00:26:22.843 [2024-04-16 23:04:13.793369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.843 [2024-04-16 23:04:13.793522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.843 [2024-04-16 23:04:13.793552] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.843 qpair failed and we were unable to recover it. 00:26:22.843 [2024-04-16 23:04:13.793702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.843 [2024-04-16 23:04:13.793883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.843 [2024-04-16 23:04:13.793908] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.843 qpair failed and we were unable to recover it. 00:26:22.843 [2024-04-16 23:04:13.794053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.843 [2024-04-16 23:04:13.794205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.843 [2024-04-16 23:04:13.794233] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.843 qpair failed and we were unable to recover it. 00:26:22.843 [2024-04-16 23:04:13.794380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.843 [2024-04-16 23:04:13.794597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.843 [2024-04-16 23:04:13.794653] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.843 qpair failed and we were unable to recover it. 00:26:22.843 [2024-04-16 23:04:13.794819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.843 [2024-04-16 23:04:13.794964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.843 [2024-04-16 23:04:13.794989] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.843 qpair failed and we were unable to recover it. 00:26:22.843 [2024-04-16 23:04:13.795157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.843 [2024-04-16 23:04:13.795303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.843 [2024-04-16 23:04:13.795331] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.843 qpair failed and we were unable to recover it. 00:26:22.843 [2024-04-16 23:04:13.795450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.843 [2024-04-16 23:04:13.795593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.843 [2024-04-16 23:04:13.795620] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.843 qpair failed and we were unable to recover it. 00:26:22.843 [2024-04-16 23:04:13.795754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.843 [2024-04-16 23:04:13.795867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.844 [2024-04-16 23:04:13.795894] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.844 qpair failed and we were unable to recover it. 00:26:22.844 [2024-04-16 23:04:13.796046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.844 [2024-04-16 23:04:13.796156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.844 [2024-04-16 23:04:13.796187] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.844 qpair failed and we were unable to recover it. 00:26:22.844 [2024-04-16 23:04:13.796377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.844 [2024-04-16 23:04:13.796553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.844 [2024-04-16 23:04:13.796578] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.844 qpair failed and we were unable to recover it. 00:26:22.844 [2024-04-16 23:04:13.796729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.844 [2024-04-16 23:04:13.796857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.844 [2024-04-16 23:04:13.796886] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.844 qpair failed and we were unable to recover it. 00:26:22.844 [2024-04-16 23:04:13.797037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.844 [2024-04-16 23:04:13.797192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.844 [2024-04-16 23:04:13.797245] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.844 qpair failed and we were unable to recover it. 00:26:22.844 [2024-04-16 23:04:13.797401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.844 [2024-04-16 23:04:13.797528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.844 [2024-04-16 23:04:13.797578] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.844 qpair failed and we were unable to recover it. 00:26:22.844 [2024-04-16 23:04:13.797734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.844 [2024-04-16 23:04:13.797875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.844 [2024-04-16 23:04:13.797903] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.844 qpair failed and we were unable to recover it. 00:26:22.844 [2024-04-16 23:04:13.798060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.844 [2024-04-16 23:04:13.798188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.844 [2024-04-16 23:04:13.798217] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.844 qpair failed and we were unable to recover it. 00:26:22.844 [2024-04-16 23:04:13.798362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.844 [2024-04-16 23:04:13.798522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.844 [2024-04-16 23:04:13.798549] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.844 qpair failed and we were unable to recover it. 00:26:22.844 [2024-04-16 23:04:13.798708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.844 [2024-04-16 23:04:13.798811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.844 [2024-04-16 23:04:13.798835] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.844 qpair failed and we were unable to recover it. 00:26:22.844 [2024-04-16 23:04:13.799003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.844 [2024-04-16 23:04:13.799148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.844 [2024-04-16 23:04:13.799180] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.844 qpair failed and we were unable to recover it. 00:26:22.844 [2024-04-16 23:04:13.799345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.844 [2024-04-16 23:04:13.799528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.844 [2024-04-16 23:04:13.799556] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.844 qpair failed and we were unable to recover it. 00:26:22.844 [2024-04-16 23:04:13.799737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.844 [2024-04-16 23:04:13.799917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.844 [2024-04-16 23:04:13.799950] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.844 qpair failed and we were unable to recover it. 00:26:22.844 [2024-04-16 23:04:13.800111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.844 [2024-04-16 23:04:13.800256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.844 [2024-04-16 23:04:13.800281] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.844 qpair failed and we were unable to recover it. 00:26:22.844 [2024-04-16 23:04:13.800495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.844 [2024-04-16 23:04:13.800603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.844 [2024-04-16 23:04:13.800628] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.844 qpair failed and we were unable to recover it. 00:26:22.844 [2024-04-16 23:04:13.800794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.844 [2024-04-16 23:04:13.800925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.844 [2024-04-16 23:04:13.800953] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.844 qpair failed and we were unable to recover it. 00:26:22.844 [2024-04-16 23:04:13.801114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.844 [2024-04-16 23:04:13.801298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.844 [2024-04-16 23:04:13.801326] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.844 qpair failed and we were unable to recover it. 00:26:22.844 [2024-04-16 23:04:13.801462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.844 [2024-04-16 23:04:13.801636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.844 [2024-04-16 23:04:13.801660] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.844 qpair failed and we were unable to recover it. 00:26:22.844 [2024-04-16 23:04:13.801807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.844 [2024-04-16 23:04:13.801959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.844 [2024-04-16 23:04:13.801986] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.844 qpair failed and we were unable to recover it. 00:26:22.844 [2024-04-16 23:04:13.802120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.844 [2024-04-16 23:04:13.802260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.844 [2024-04-16 23:04:13.802289] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.844 qpair failed and we were unable to recover it. 00:26:22.844 [2024-04-16 23:04:13.802423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.844 [2024-04-16 23:04:13.802615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.844 [2024-04-16 23:04:13.802642] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.844 qpair failed and we were unable to recover it. 00:26:22.844 [2024-04-16 23:04:13.802796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.844 [2024-04-16 23:04:13.802941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.844 [2024-04-16 23:04:13.802967] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.844 qpair failed and we were unable to recover it. 00:26:22.844 [2024-04-16 23:04:13.803166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.844 [2024-04-16 23:04:13.803322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.844 [2024-04-16 23:04:13.803350] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.844 qpair failed and we were unable to recover it. 00:26:22.844 [2024-04-16 23:04:13.803513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.844 [2024-04-16 23:04:13.803659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.844 [2024-04-16 23:04:13.803687] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.844 qpair failed and we were unable to recover it. 00:26:22.844 [2024-04-16 23:04:13.803839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.844 [2024-04-16 23:04:13.803995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.844 [2024-04-16 23:04:13.804022] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.844 qpair failed and we were unable to recover it. 00:26:22.844 [2024-04-16 23:04:13.804154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.845 [2024-04-16 23:04:13.804331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.845 [2024-04-16 23:04:13.804356] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.845 qpair failed and we were unable to recover it. 00:26:22.845 [2024-04-16 23:04:13.804507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.845 [2024-04-16 23:04:13.804649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.845 [2024-04-16 23:04:13.804674] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.845 qpair failed and we were unable to recover it. 00:26:22.845 [2024-04-16 23:04:13.804838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.845 [2024-04-16 23:04:13.804986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.845 [2024-04-16 23:04:13.805013] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.845 qpair failed and we were unable to recover it. 00:26:22.845 [2024-04-16 23:04:13.805194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.845 [2024-04-16 23:04:13.805356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.845 [2024-04-16 23:04:13.805383] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.845 qpair failed and we were unable to recover it. 00:26:22.845 [2024-04-16 23:04:13.805587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.845 [2024-04-16 23:04:13.805701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.845 [2024-04-16 23:04:13.805725] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.845 qpair failed and we were unable to recover it. 00:26:22.845 [2024-04-16 23:04:13.805867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.845 [2024-04-16 23:04:13.806011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.845 [2024-04-16 23:04:13.806037] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.845 qpair failed and we were unable to recover it. 00:26:22.845 [2024-04-16 23:04:13.806164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.845 [2024-04-16 23:04:13.806330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.845 [2024-04-16 23:04:13.806357] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.845 qpair failed and we were unable to recover it. 00:26:22.845 [2024-04-16 23:04:13.806475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.845 [2024-04-16 23:04:13.806623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.845 [2024-04-16 23:04:13.806650] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.845 qpair failed and we were unable to recover it. 00:26:22.845 [2024-04-16 23:04:13.806842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.845 [2024-04-16 23:04:13.807020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.845 [2024-04-16 23:04:13.807047] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.845 qpair failed and we were unable to recover it. 00:26:22.845 [2024-04-16 23:04:13.807238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.845 [2024-04-16 23:04:13.807390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.845 [2024-04-16 23:04:13.807417] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.845 qpair failed and we were unable to recover it. 00:26:22.845 [2024-04-16 23:04:13.807584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.845 [2024-04-16 23:04:13.807728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.845 [2024-04-16 23:04:13.807753] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.845 qpair failed and we were unable to recover it. 00:26:22.845 [2024-04-16 23:04:13.807915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.845 [2024-04-16 23:04:13.808072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.845 [2024-04-16 23:04:13.808099] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.845 qpair failed and we were unable to recover it. 00:26:22.845 [2024-04-16 23:04:13.808260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.845 [2024-04-16 23:04:13.808380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.845 [2024-04-16 23:04:13.808406] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.845 qpair failed and we were unable to recover it. 00:26:22.845 [2024-04-16 23:04:13.808565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.845 [2024-04-16 23:04:13.808685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.845 [2024-04-16 23:04:13.808712] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.845 qpair failed and we were unable to recover it. 00:26:22.845 [2024-04-16 23:04:13.808871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.845 [2024-04-16 23:04:13.809024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.845 [2024-04-16 23:04:13.809051] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.845 qpair failed and we were unable to recover it. 00:26:22.845 [2024-04-16 23:04:13.809221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.845 [2024-04-16 23:04:13.809378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.845 [2024-04-16 23:04:13.809405] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.845 qpair failed and we were unable to recover it. 00:26:22.845 [2024-04-16 23:04:13.809592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.845 [2024-04-16 23:04:13.809749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.845 [2024-04-16 23:04:13.809778] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.845 qpair failed and we were unable to recover it. 00:26:22.845 [2024-04-16 23:04:13.809933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.845 [2024-04-16 23:04:13.810068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.845 [2024-04-16 23:04:13.810092] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.845 qpair failed and we were unable to recover it. 00:26:22.845 [2024-04-16 23:04:13.810261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.845 [2024-04-16 23:04:13.810411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.845 [2024-04-16 23:04:13.810439] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.845 qpair failed and we were unable to recover it. 00:26:22.845 [2024-04-16 23:04:13.810626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.845 [2024-04-16 23:04:13.810772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.845 [2024-04-16 23:04:13.810799] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.845 qpair failed and we were unable to recover it. 00:26:22.845 [2024-04-16 23:04:13.810928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.845 [2024-04-16 23:04:13.811073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.845 [2024-04-16 23:04:13.811098] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.845 qpair failed and we were unable to recover it. 00:26:22.845 [2024-04-16 23:04:13.811257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.845 [2024-04-16 23:04:13.811384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.845 [2024-04-16 23:04:13.811412] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.845 qpair failed and we were unable to recover it. 00:26:22.845 [2024-04-16 23:04:13.811606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.845 [2024-04-16 23:04:13.811762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.845 [2024-04-16 23:04:13.811790] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.845 qpair failed and we were unable to recover it. 00:26:22.845 [2024-04-16 23:04:13.811986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.845 [2024-04-16 23:04:13.812127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.845 [2024-04-16 23:04:13.812152] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.845 qpair failed and we were unable to recover it. 00:26:22.845 [2024-04-16 23:04:13.812310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.845 [2024-04-16 23:04:13.812423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.845 [2024-04-16 23:04:13.812448] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.845 qpair failed and we were unable to recover it. 00:26:22.845 [2024-04-16 23:04:13.812592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.845 [2024-04-16 23:04:13.812733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.845 [2024-04-16 23:04:13.812759] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.845 qpair failed and we were unable to recover it. 00:26:22.845 [2024-04-16 23:04:13.812901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.845 [2024-04-16 23:04:13.813098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.845 [2024-04-16 23:04:13.813125] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.845 qpair failed and we were unable to recover it. 00:26:22.845 [2024-04-16 23:04:13.813294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.845 [2024-04-16 23:04:13.813441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.845 [2024-04-16 23:04:13.813465] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.845 qpair failed and we were unable to recover it. 00:26:22.845 [2024-04-16 23:04:13.813621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.845 [2024-04-16 23:04:13.813761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.846 [2024-04-16 23:04:13.813804] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.846 qpair failed and we were unable to recover it. 00:26:22.846 [2024-04-16 23:04:13.813969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.846 [2024-04-16 23:04:13.814122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.846 [2024-04-16 23:04:13.814151] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.846 qpair failed and we were unable to recover it. 00:26:22.846 [2024-04-16 23:04:13.814304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.846 [2024-04-16 23:04:13.814448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.846 [2024-04-16 23:04:13.814473] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.846 qpair failed and we were unable to recover it. 00:26:22.846 [2024-04-16 23:04:13.814622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.846 [2024-04-16 23:04:13.814826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.846 [2024-04-16 23:04:13.814851] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.846 qpair failed and we were unable to recover it. 00:26:22.846 [2024-04-16 23:04:13.814962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.846 [2024-04-16 23:04:13.815082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.846 [2024-04-16 23:04:13.815107] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.846 qpair failed and we were unable to recover it. 00:26:22.846 [2024-04-16 23:04:13.815281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.846 [2024-04-16 23:04:13.815435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.846 [2024-04-16 23:04:13.815462] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.846 qpair failed and we were unable to recover it. 00:26:22.846 [2024-04-16 23:04:13.815622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.846 [2024-04-16 23:04:13.815788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.846 [2024-04-16 23:04:13.815813] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.846 qpair failed and we were unable to recover it. 00:26:22.846 [2024-04-16 23:04:13.815978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.846 [2024-04-16 23:04:13.816110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.846 [2024-04-16 23:04:13.816138] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.846 qpair failed and we were unable to recover it. 00:26:22.846 [2024-04-16 23:04:13.816303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.846 [2024-04-16 23:04:13.816419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.846 [2024-04-16 23:04:13.816444] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.846 qpair failed and we were unable to recover it. 00:26:22.846 [2024-04-16 23:04:13.816553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.846 [2024-04-16 23:04:13.816681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.846 [2024-04-16 23:04:13.816708] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.846 qpair failed and we were unable to recover it. 00:26:22.846 [2024-04-16 23:04:13.816897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.846 [2024-04-16 23:04:13.817065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.846 [2024-04-16 23:04:13.817110] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.846 qpair failed and we were unable to recover it. 00:26:22.846 [2024-04-16 23:04:13.817246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.846 [2024-04-16 23:04:13.817427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.846 [2024-04-16 23:04:13.817455] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.846 qpair failed and we were unable to recover it. 00:26:22.846 [2024-04-16 23:04:13.817607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.846 [2024-04-16 23:04:13.817728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.846 [2024-04-16 23:04:13.817752] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.846 qpair failed and we were unable to recover it. 00:26:22.846 [2024-04-16 23:04:13.817868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.846 [2024-04-16 23:04:13.818027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.846 [2024-04-16 23:04:13.818055] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.846 qpair failed and we were unable to recover it. 00:26:22.846 [2024-04-16 23:04:13.818169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.846 [2024-04-16 23:04:13.818360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.846 [2024-04-16 23:04:13.818388] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.846 qpair failed and we were unable to recover it. 00:26:22.846 [2024-04-16 23:04:13.818517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.846 [2024-04-16 23:04:13.818673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.846 [2024-04-16 23:04:13.818701] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.846 qpair failed and we were unable to recover it. 00:26:22.846 [2024-04-16 23:04:13.818835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.846 [2024-04-16 23:04:13.818976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.846 [2024-04-16 23:04:13.819000] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.846 qpair failed and we were unable to recover it. 00:26:22.846 [2024-04-16 23:04:13.819152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.846 [2024-04-16 23:04:13.819305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.846 [2024-04-16 23:04:13.819331] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.846 qpair failed and we were unable to recover it. 00:26:22.846 [2024-04-16 23:04:13.819512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.846 [2024-04-16 23:04:13.819706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.846 [2024-04-16 23:04:13.819731] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.846 qpair failed and we were unable to recover it. 00:26:22.846 [2024-04-16 23:04:13.819847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.846 [2024-04-16 23:04:13.819981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.846 [2024-04-16 23:04:13.820006] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.846 qpair failed and we were unable to recover it. 00:26:22.846 [2024-04-16 23:04:13.820113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.846 [2024-04-16 23:04:13.820222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.846 [2024-04-16 23:04:13.820252] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.846 qpair failed and we were unable to recover it. 00:26:22.846 [2024-04-16 23:04:13.820399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.846 [2024-04-16 23:04:13.820524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.846 [2024-04-16 23:04:13.820551] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.846 qpair failed and we were unable to recover it. 00:26:22.846 [2024-04-16 23:04:13.820723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.846 [2024-04-16 23:04:13.820858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.846 [2024-04-16 23:04:13.820882] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.846 qpair failed and we were unable to recover it. 00:26:22.846 [2024-04-16 23:04:13.821021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.846 [2024-04-16 23:04:13.821234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.846 [2024-04-16 23:04:13.821260] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.846 qpair failed and we were unable to recover it. 00:26:22.846 [2024-04-16 23:04:13.821406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.846 [2024-04-16 23:04:13.821546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.846 [2024-04-16 23:04:13.821571] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.846 qpair failed and we were unable to recover it. 00:26:22.846 [2024-04-16 23:04:13.821685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.846 [2024-04-16 23:04:13.821831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.846 [2024-04-16 23:04:13.821856] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.846 qpair failed and we were unable to recover it. 00:26:22.846 [2024-04-16 23:04:13.822052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.846 [2024-04-16 23:04:13.822223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.846 [2024-04-16 23:04:13.822249] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.846 qpair failed and we were unable to recover it. 00:26:22.846 [2024-04-16 23:04:13.822414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.846 [2024-04-16 23:04:13.822605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.846 [2024-04-16 23:04:13.822633] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.846 qpair failed and we were unable to recover it. 00:26:22.846 [2024-04-16 23:04:13.822765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.846 [2024-04-16 23:04:13.822881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.846 [2024-04-16 23:04:13.822907] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.846 qpair failed and we were unable to recover it. 00:26:22.846 [2024-04-16 23:04:13.823018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.846 [2024-04-16 23:04:13.823184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.847 [2024-04-16 23:04:13.823212] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.847 qpair failed and we were unable to recover it. 00:26:22.847 [2024-04-16 23:04:13.823368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.847 [2024-04-16 23:04:13.823518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.847 [2024-04-16 23:04:13.823546] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.847 qpair failed and we were unable to recover it. 00:26:22.847 [2024-04-16 23:04:13.823733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.847 [2024-04-16 23:04:13.823855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.847 [2024-04-16 23:04:13.823884] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.847 qpair failed and we were unable to recover it. 00:26:22.847 [2024-04-16 23:04:13.824060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.847 [2024-04-16 23:04:13.824239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.847 [2024-04-16 23:04:13.824265] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.847 qpair failed and we were unable to recover it. 00:26:22.847 [2024-04-16 23:04:13.824375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.847 [2024-04-16 23:04:13.824535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.847 [2024-04-16 23:04:13.824562] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.847 qpair failed and we were unable to recover it. 00:26:22.847 [2024-04-16 23:04:13.824711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.847 [2024-04-16 23:04:13.824857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.847 [2024-04-16 23:04:13.824884] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.847 qpair failed and we were unable to recover it. 00:26:22.847 [2024-04-16 23:04:13.825008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.847 [2024-04-16 23:04:13.825156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.847 [2024-04-16 23:04:13.825198] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.847 qpair failed and we were unable to recover it. 00:26:22.847 [2024-04-16 23:04:13.825347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.847 [2024-04-16 23:04:13.825514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.847 [2024-04-16 23:04:13.825555] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.847 qpair failed and we were unable to recover it. 00:26:22.847 [2024-04-16 23:04:13.825708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.847 [2024-04-16 23:04:13.825855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.847 [2024-04-16 23:04:13.825883] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.847 qpair failed and we were unable to recover it. 00:26:22.847 [2024-04-16 23:04:13.826007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.847 [2024-04-16 23:04:13.826154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.847 [2024-04-16 23:04:13.826214] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.847 qpair failed and we were unable to recover it. 00:26:22.847 [2024-04-16 23:04:13.826372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.847 [2024-04-16 23:04:13.826505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.847 [2024-04-16 23:04:13.826530] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.847 qpair failed and we were unable to recover it. 00:26:22.847 [2024-04-16 23:04:13.826669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.847 [2024-04-16 23:04:13.826840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.847 [2024-04-16 23:04:13.826865] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.847 qpair failed and we were unable to recover it. 00:26:22.847 [2024-04-16 23:04:13.827040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.847 [2024-04-16 23:04:13.827205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.847 [2024-04-16 23:04:13.827234] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.847 qpair failed and we were unable to recover it. 00:26:22.847 [2024-04-16 23:04:13.827385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.847 [2024-04-16 23:04:13.827594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.847 [2024-04-16 23:04:13.827622] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.847 qpair failed and we were unable to recover it. 00:26:22.847 [2024-04-16 23:04:13.827753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.847 [2024-04-16 23:04:13.827923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.847 [2024-04-16 23:04:13.827947] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.847 qpair failed and we were unable to recover it. 00:26:22.847 [2024-04-16 23:04:13.828117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.847 [2024-04-16 23:04:13.828229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.847 [2024-04-16 23:04:13.828271] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.847 qpair failed and we were unable to recover it. 00:26:22.847 [2024-04-16 23:04:13.828405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.847 [2024-04-16 23:04:13.828534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.847 [2024-04-16 23:04:13.828561] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.847 qpair failed and we were unable to recover it. 00:26:22.847 [2024-04-16 23:04:13.828696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.847 [2024-04-16 23:04:13.828841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.847 [2024-04-16 23:04:13.828869] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.847 qpair failed and we were unable to recover it. 00:26:22.847 [2024-04-16 23:04:13.829021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.847 [2024-04-16 23:04:13.829185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.847 [2024-04-16 23:04:13.829213] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.847 qpair failed and we were unable to recover it. 00:26:22.847 [2024-04-16 23:04:13.829401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.847 [2024-04-16 23:04:13.829538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.847 [2024-04-16 23:04:13.829584] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.847 qpair failed and we were unable to recover it. 00:26:22.847 [2024-04-16 23:04:13.829739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.847 [2024-04-16 23:04:13.829863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.847 [2024-04-16 23:04:13.829890] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.847 qpair failed and we were unable to recover it. 00:26:22.847 [2024-04-16 23:04:13.830045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.847 [2024-04-16 23:04:13.830201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.847 [2024-04-16 23:04:13.830229] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.847 qpair failed and we were unable to recover it. 00:26:22.847 [2024-04-16 23:04:13.830384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.847 [2024-04-16 23:04:13.830565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.847 [2024-04-16 23:04:13.830621] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.847 qpair failed and we were unable to recover it. 00:26:22.847 [2024-04-16 23:04:13.830779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.847 [2024-04-16 23:04:13.830977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.847 [2024-04-16 23:04:13.831007] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.847 qpair failed and we were unable to recover it. 00:26:22.847 [2024-04-16 23:04:13.831138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.847 [2024-04-16 23:04:13.831313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.847 [2024-04-16 23:04:13.831338] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.847 qpair failed and we were unable to recover it. 00:26:22.847 [2024-04-16 23:04:13.831473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.847 [2024-04-16 23:04:13.831596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.847 [2024-04-16 23:04:13.831620] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.847 qpair failed and we were unable to recover it. 00:26:22.847 [2024-04-16 23:04:13.831747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.847 [2024-04-16 23:04:13.831915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.847 [2024-04-16 23:04:13.831940] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.847 qpair failed and we were unable to recover it. 00:26:22.847 [2024-04-16 23:04:13.832081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.847 [2024-04-16 23:04:13.832189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.847 [2024-04-16 23:04:13.832215] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.847 qpair failed and we were unable to recover it. 00:26:22.847 [2024-04-16 23:04:13.832409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.847 [2024-04-16 23:04:13.832594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.847 [2024-04-16 23:04:13.832645] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.847 qpair failed and we were unable to recover it. 00:26:22.847 [2024-04-16 23:04:13.832803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.847 [2024-04-16 23:04:13.833003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.847 [2024-04-16 23:04:13.833031] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.848 qpair failed and we were unable to recover it. 00:26:22.848 [2024-04-16 23:04:13.833152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.848 [2024-04-16 23:04:13.833325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.848 [2024-04-16 23:04:13.833350] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.848 qpair failed and we were unable to recover it. 00:26:22.848 [2024-04-16 23:04:13.833526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.848 [2024-04-16 23:04:13.833761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.848 [2024-04-16 23:04:13.833811] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.848 qpair failed and we were unable to recover it. 00:26:22.848 [2024-04-16 23:04:13.833962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.848 [2024-04-16 23:04:13.834119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.848 [2024-04-16 23:04:13.834159] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.848 qpair failed and we were unable to recover it. 00:26:22.848 [2024-04-16 23:04:13.834309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.848 [2024-04-16 23:04:13.834422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.848 [2024-04-16 23:04:13.834447] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.848 qpair failed and we were unable to recover it. 00:26:22.848 [2024-04-16 23:04:13.834559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.848 [2024-04-16 23:04:13.834691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.848 [2024-04-16 23:04:13.834716] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.848 qpair failed and we were unable to recover it. 00:26:22.848 [2024-04-16 23:04:13.834861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.848 [2024-04-16 23:04:13.834985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.848 [2024-04-16 23:04:13.835010] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.848 qpair failed and we were unable to recover it. 00:26:22.848 [2024-04-16 23:04:13.835146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.848 [2024-04-16 23:04:13.835317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.848 [2024-04-16 23:04:13.835342] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.848 qpair failed and we were unable to recover it. 00:26:22.848 [2024-04-16 23:04:13.835456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.848 [2024-04-16 23:04:13.835623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.848 [2024-04-16 23:04:13.835647] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.848 qpair failed and we were unable to recover it. 00:26:22.848 [2024-04-16 23:04:13.835828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.848 [2024-04-16 23:04:13.835974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.848 [2024-04-16 23:04:13.836001] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.848 qpair failed and we were unable to recover it. 00:26:22.848 [2024-04-16 23:04:13.836167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.848 [2024-04-16 23:04:13.836285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.848 [2024-04-16 23:04:13.836325] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.848 qpair failed and we were unable to recover it. 00:26:22.848 [2024-04-16 23:04:13.836479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.848 [2024-04-16 23:04:13.836601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.848 [2024-04-16 23:04:13.836630] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.848 qpair failed and we were unable to recover it. 00:26:22.848 [2024-04-16 23:04:13.836787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.848 [2024-04-16 23:04:13.836978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.848 [2024-04-16 23:04:13.837002] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.848 qpair failed and we were unable to recover it. 00:26:22.848 [2024-04-16 23:04:13.837141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.848 [2024-04-16 23:04:13.837312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.848 [2024-04-16 23:04:13.837341] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.848 qpair failed and we were unable to recover it. 00:26:22.848 [2024-04-16 23:04:13.837482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.848 [2024-04-16 23:04:13.837617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.848 [2024-04-16 23:04:13.837646] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.848 qpair failed and we were unable to recover it. 00:26:22.848 [2024-04-16 23:04:13.837777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.848 [2024-04-16 23:04:13.837925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.848 [2024-04-16 23:04:13.837953] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.848 qpair failed and we were unable to recover it. 00:26:22.848 [2024-04-16 23:04:13.838151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.848 [2024-04-16 23:04:13.838271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.848 [2024-04-16 23:04:13.838296] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.848 qpair failed and we were unable to recover it. 00:26:22.848 [2024-04-16 23:04:13.838474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.848 [2024-04-16 23:04:13.838577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.848 [2024-04-16 23:04:13.838602] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.848 qpair failed and we were unable to recover it. 00:26:22.848 [2024-04-16 23:04:13.838740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.848 [2024-04-16 23:04:13.838884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.848 [2024-04-16 23:04:13.838925] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.848 qpair failed and we were unable to recover it. 00:26:22.848 [2024-04-16 23:04:13.839075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.848 [2024-04-16 23:04:13.839223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.848 [2024-04-16 23:04:13.839248] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.848 qpair failed and we were unable to recover it. 00:26:22.848 [2024-04-16 23:04:13.839417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.848 [2024-04-16 23:04:13.839655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.848 [2024-04-16 23:04:13.839704] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.848 qpair failed and we were unable to recover it. 00:26:22.848 [2024-04-16 23:04:13.839858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.848 [2024-04-16 23:04:13.840001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.848 [2024-04-16 23:04:13.840028] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.848 qpair failed and we were unable to recover it. 00:26:22.848 [2024-04-16 23:04:13.840166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.848 [2024-04-16 23:04:13.840306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.848 [2024-04-16 23:04:13.840331] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.848 qpair failed and we were unable to recover it. 00:26:22.848 [2024-04-16 23:04:13.840470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.848 [2024-04-16 23:04:13.840662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.848 [2024-04-16 23:04:13.840690] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.848 qpair failed and we were unable to recover it. 00:26:22.848 [2024-04-16 23:04:13.840913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.848 [2024-04-16 23:04:13.841094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.848 [2024-04-16 23:04:13.841122] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.848 qpair failed and we were unable to recover it. 00:26:22.848 [2024-04-16 23:04:13.841281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.848 [2024-04-16 23:04:13.841436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.848 [2024-04-16 23:04:13.841463] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.848 qpair failed and we were unable to recover it. 00:26:22.848 [2024-04-16 23:04:13.841622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.848 [2024-04-16 23:04:13.841764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.848 [2024-04-16 23:04:13.841805] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.848 qpair failed and we were unable to recover it. 00:26:22.848 [2024-04-16 23:04:13.841965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.848 [2024-04-16 23:04:13.842126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.848 [2024-04-16 23:04:13.842154] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.848 qpair failed and we were unable to recover it. 00:26:22.849 [2024-04-16 23:04:13.842307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.849 [2024-04-16 23:04:13.842460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.849 [2024-04-16 23:04:13.842487] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.849 qpair failed and we were unable to recover it. 00:26:22.849 [2024-04-16 23:04:13.842614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.849 [2024-04-16 23:04:13.842771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.849 [2024-04-16 23:04:13.842799] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.849 qpair failed and we were unable to recover it. 00:26:22.849 [2024-04-16 23:04:13.842969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.849 [2024-04-16 23:04:13.843085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.849 [2024-04-16 23:04:13.843109] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.849 qpair failed and we were unable to recover it. 00:26:22.849 [2024-04-16 23:04:13.843284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.849 [2024-04-16 23:04:13.843441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.849 [2024-04-16 23:04:13.843468] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.849 qpair failed and we were unable to recover it. 00:26:22.849 [2024-04-16 23:04:13.843620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.849 [2024-04-16 23:04:13.843819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.849 [2024-04-16 23:04:13.843869] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.849 qpair failed and we were unable to recover it. 00:26:22.849 [2024-04-16 23:04:13.843990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.849 [2024-04-16 23:04:13.844140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.849 [2024-04-16 23:04:13.844168] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.849 qpair failed and we were unable to recover it. 00:26:22.849 [2024-04-16 23:04:13.844343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.849 [2024-04-16 23:04:13.844486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.849 [2024-04-16 23:04:13.844511] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.849 qpair failed and we were unable to recover it. 00:26:22.849 [2024-04-16 23:04:13.844654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.849 [2024-04-16 23:04:13.844801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.849 [2024-04-16 23:04:13.844828] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.849 qpair failed and we were unable to recover it. 00:26:22.849 [2024-04-16 23:04:13.845016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.849 [2024-04-16 23:04:13.845127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.849 [2024-04-16 23:04:13.845152] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.849 qpair failed and we were unable to recover it. 00:26:22.849 [2024-04-16 23:04:13.845304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.849 [2024-04-16 23:04:13.845413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.849 [2024-04-16 23:04:13.845439] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.849 qpair failed and we were unable to recover it. 00:26:22.849 [2024-04-16 23:04:13.845632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.849 [2024-04-16 23:04:13.845765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.849 [2024-04-16 23:04:13.845807] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.849 qpair failed and we were unable to recover it. 00:26:22.849 [2024-04-16 23:04:13.845969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.849 [2024-04-16 23:04:13.846119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.849 [2024-04-16 23:04:13.846146] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.849 qpair failed and we were unable to recover it. 00:26:22.849 [2024-04-16 23:04:13.846286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.849 [2024-04-16 23:04:13.846466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.849 [2024-04-16 23:04:13.846494] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.849 qpair failed and we were unable to recover it. 00:26:22.849 [2024-04-16 23:04:13.846662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.849 [2024-04-16 23:04:13.846796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.849 [2024-04-16 23:04:13.846821] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.849 qpair failed and we were unable to recover it. 00:26:22.849 [2024-04-16 23:04:13.846925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.849 [2024-04-16 23:04:13.847069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.849 [2024-04-16 23:04:13.847094] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.849 qpair failed and we were unable to recover it. 00:26:22.849 [2024-04-16 23:04:13.847238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.849 [2024-04-16 23:04:13.847373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.849 [2024-04-16 23:04:13.847400] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.849 qpair failed and we were unable to recover it. 00:26:22.849 [2024-04-16 23:04:13.847557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.849 [2024-04-16 23:04:13.847671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.849 [2024-04-16 23:04:13.847699] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.849 qpair failed and we were unable to recover it. 00:26:22.849 [2024-04-16 23:04:13.847891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.849 [2024-04-16 23:04:13.848007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.849 [2024-04-16 23:04:13.848034] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.849 qpair failed and we were unable to recover it. 00:26:22.849 [2024-04-16 23:04:13.848170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.849 [2024-04-16 23:04:13.848315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.849 [2024-04-16 23:04:13.848340] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.849 qpair failed and we were unable to recover it. 00:26:22.849 [2024-04-16 23:04:13.848508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.849 [2024-04-16 23:04:13.848657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.849 [2024-04-16 23:04:13.848685] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.849 qpair failed and we were unable to recover it. 00:26:22.849 [2024-04-16 23:04:13.848820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.849 [2024-04-16 23:04:13.848957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.849 [2024-04-16 23:04:13.848981] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.849 qpair failed and we were unable to recover it. 00:26:22.849 [2024-04-16 23:04:13.849088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.849 [2024-04-16 23:04:13.849196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.850 [2024-04-16 23:04:13.849237] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.850 qpair failed and we were unable to recover it. 00:26:22.850 [2024-04-16 23:04:13.849369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.850 [2024-04-16 23:04:13.849474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.850 [2024-04-16 23:04:13.849498] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.850 qpair failed and we were unable to recover it. 00:26:22.850 [2024-04-16 23:04:13.849634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.850 [2024-04-16 23:04:13.849795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.850 [2024-04-16 23:04:13.849820] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.850 qpair failed and we were unable to recover it. 00:26:22.850 [2024-04-16 23:04:13.849961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.850 [2024-04-16 23:04:13.850101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.850 [2024-04-16 23:04:13.850125] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.850 qpair failed and we were unable to recover it. 00:26:22.850 [2024-04-16 23:04:13.850234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.850 [2024-04-16 23:04:13.850367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.850 [2024-04-16 23:04:13.850392] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.850 qpair failed and we were unable to recover it. 00:26:22.850 [2024-04-16 23:04:13.850539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.850 [2024-04-16 23:04:13.850708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.850 [2024-04-16 23:04:13.850733] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.850 qpair failed and we were unable to recover it. 00:26:22.850 [2024-04-16 23:04:13.850866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.850 [2024-04-16 23:04:13.851065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.850 [2024-04-16 23:04:13.851090] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.850 qpair failed and we were unable to recover it. 00:26:22.850 [2024-04-16 23:04:13.851235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.850 [2024-04-16 23:04:13.851346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.850 [2024-04-16 23:04:13.851372] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.850 qpair failed and we were unable to recover it. 00:26:22.850 [2024-04-16 23:04:13.851493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.850 [2024-04-16 23:04:13.851654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.850 [2024-04-16 23:04:13.851682] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.850 qpair failed and we were unable to recover it. 00:26:22.850 [2024-04-16 23:04:13.851860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.850 [2024-04-16 23:04:13.851973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.850 [2024-04-16 23:04:13.851999] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.850 qpair failed and we were unable to recover it. 00:26:22.850 [2024-04-16 23:04:13.852131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.850 [2024-04-16 23:04:13.852243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.850 [2024-04-16 23:04:13.852268] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.850 qpair failed and we were unable to recover it. 00:26:22.850 [2024-04-16 23:04:13.852460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.850 [2024-04-16 23:04:13.852622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.850 [2024-04-16 23:04:13.852648] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.850 qpair failed and we were unable to recover it. 00:26:22.850 [2024-04-16 23:04:13.852796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.850 [2024-04-16 23:04:13.852986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.850 [2024-04-16 23:04:13.853011] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.850 qpair failed and we were unable to recover it. 00:26:22.850 [2024-04-16 23:04:13.853154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.850 [2024-04-16 23:04:13.853289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.850 [2024-04-16 23:04:13.853314] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.850 qpair failed and we were unable to recover it. 00:26:22.850 [2024-04-16 23:04:13.853431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.850 [2024-04-16 23:04:13.853579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.850 [2024-04-16 23:04:13.853604] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.850 qpair failed and we were unable to recover it. 00:26:22.850 [2024-04-16 23:04:13.853741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.850 [2024-04-16 23:04:13.853881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.850 [2024-04-16 23:04:13.853909] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.850 qpair failed and we were unable to recover it. 00:26:22.850 [2024-04-16 23:04:13.854014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.850 [2024-04-16 23:04:13.854185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.850 [2024-04-16 23:04:13.854210] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.850 qpair failed and we were unable to recover it. 00:26:22.850 [2024-04-16 23:04:13.854322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.850 [2024-04-16 23:04:13.854457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.850 [2024-04-16 23:04:13.854481] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.850 qpair failed and we were unable to recover it. 00:26:22.850 [2024-04-16 23:04:13.854623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.850 [2024-04-16 23:04:13.854816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.850 [2024-04-16 23:04:13.854840] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.850 qpair failed and we were unable to recover it. 00:26:22.850 [2024-04-16 23:04:13.854983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.850 [2024-04-16 23:04:13.855128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.850 [2024-04-16 23:04:13.855155] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.850 qpair failed and we were unable to recover it. 00:26:22.850 [2024-04-16 23:04:13.855328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.850 [2024-04-16 23:04:13.855527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.850 [2024-04-16 23:04:13.855554] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.850 qpair failed and we were unable to recover it. 00:26:22.850 [2024-04-16 23:04:13.855693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.850 [2024-04-16 23:04:13.855845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.850 [2024-04-16 23:04:13.855870] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.850 qpair failed and we were unable to recover it. 00:26:22.850 [2024-04-16 23:04:13.856089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.850 [2024-04-16 23:04:13.856232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.850 [2024-04-16 23:04:13.856274] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.850 qpair failed and we were unable to recover it. 00:26:22.850 [2024-04-16 23:04:13.856444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.850 [2024-04-16 23:04:13.856565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.850 [2024-04-16 23:04:13.856590] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.850 qpair failed and we were unable to recover it. 00:26:22.850 [2024-04-16 23:04:13.856730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.850 [2024-04-16 23:04:13.856889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.850 [2024-04-16 23:04:13.856914] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.850 qpair failed and we were unable to recover it. 00:26:22.850 [2024-04-16 23:04:13.857026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.850 [2024-04-16 23:04:13.857163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.850 [2024-04-16 23:04:13.857193] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.850 qpair failed and we were unable to recover it. 00:26:22.850 [2024-04-16 23:04:13.857341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.850 [2024-04-16 23:04:13.857447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.850 [2024-04-16 23:04:13.857472] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.850 qpair failed and we were unable to recover it. 00:26:22.851 [2024-04-16 23:04:13.857614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.851 [2024-04-16 23:04:13.857780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.851 [2024-04-16 23:04:13.857805] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.851 qpair failed and we were unable to recover it. 00:26:22.851 [2024-04-16 23:04:13.857927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.851 [2024-04-16 23:04:13.858062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.851 [2024-04-16 23:04:13.858089] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.851 qpair failed and we were unable to recover it. 00:26:22.851 [2024-04-16 23:04:13.858276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.851 [2024-04-16 23:04:13.858424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.851 [2024-04-16 23:04:13.858450] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.851 qpair failed and we were unable to recover it. 00:26:22.851 [2024-04-16 23:04:13.858573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.851 [2024-04-16 23:04:13.858715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.851 [2024-04-16 23:04:13.858744] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.851 qpair failed and we were unable to recover it. 00:26:22.851 [2024-04-16 23:04:13.858868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.851 [2024-04-16 23:04:13.859025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.851 [2024-04-16 23:04:13.859049] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.851 qpair failed and we were unable to recover it. 00:26:22.851 [2024-04-16 23:04:13.859167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.851 [2024-04-16 23:04:13.859316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.851 [2024-04-16 23:04:13.859340] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.851 qpair failed and we were unable to recover it. 00:26:22.851 [2024-04-16 23:04:13.859459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.851 [2024-04-16 23:04:13.859574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.851 [2024-04-16 23:04:13.859599] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.851 qpair failed and we were unable to recover it. 00:26:22.851 [2024-04-16 23:04:13.859767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.851 [2024-04-16 23:04:13.859928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.851 [2024-04-16 23:04:13.859964] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.851 qpair failed and we were unable to recover it. 00:26:22.851 [2024-04-16 23:04:13.860123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.851 [2024-04-16 23:04:13.860249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.851 [2024-04-16 23:04:13.860277] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.851 qpair failed and we were unable to recover it. 00:26:22.851 [2024-04-16 23:04:13.860429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.851 [2024-04-16 23:04:13.860588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.851 [2024-04-16 23:04:13.860615] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.851 qpair failed and we were unable to recover it. 00:26:22.851 [2024-04-16 23:04:13.860771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.851 [2024-04-16 23:04:13.860903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.851 [2024-04-16 23:04:13.860927] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.851 qpair failed and we were unable to recover it. 00:26:22.851 [2024-04-16 23:04:13.861066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.851 [2024-04-16 23:04:13.861221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.851 [2024-04-16 23:04:13.861249] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.851 qpair failed and we were unable to recover it. 00:26:22.851 [2024-04-16 23:04:13.861400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.851 [2024-04-16 23:04:13.861517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.851 [2024-04-16 23:04:13.861545] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.851 qpair failed and we were unable to recover it. 00:26:22.851 [2024-04-16 23:04:13.861678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.851 [2024-04-16 23:04:13.861846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.851 [2024-04-16 23:04:13.861874] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.851 qpair failed and we were unable to recover it. 00:26:22.851 [2024-04-16 23:04:13.862008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.851 [2024-04-16 23:04:13.862124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.851 [2024-04-16 23:04:13.862149] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.851 qpair failed and we were unable to recover it. 00:26:22.851 [2024-04-16 23:04:13.862261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.851 [2024-04-16 23:04:13.862422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.851 [2024-04-16 23:04:13.862450] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.851 qpair failed and we were unable to recover it. 00:26:22.851 [2024-04-16 23:04:13.862666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.851 [2024-04-16 23:04:13.862788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.851 [2024-04-16 23:04:13.862816] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.851 qpair failed and we were unable to recover it. 00:26:22.851 [2024-04-16 23:04:13.862966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.851 [2024-04-16 23:04:13.863089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.851 [2024-04-16 23:04:13.863117] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.851 qpair failed and we were unable to recover it. 00:26:22.851 [2024-04-16 23:04:13.863283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.851 [2024-04-16 23:04:13.863418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.851 [2024-04-16 23:04:13.863443] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.851 qpair failed and we were unable to recover it. 00:26:22.851 [2024-04-16 23:04:13.863582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.851 [2024-04-16 23:04:13.863778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.851 [2024-04-16 23:04:13.863803] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.851 qpair failed and we were unable to recover it. 00:26:22.851 [2024-04-16 23:04:13.863921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.851 [2024-04-16 23:04:13.864061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.851 [2024-04-16 23:04:13.864086] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.851 qpair failed and we were unable to recover it. 00:26:22.851 [2024-04-16 23:04:13.864231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.851 [2024-04-16 23:04:13.864391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.851 [2024-04-16 23:04:13.864418] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.851 qpair failed and we were unable to recover it. 00:26:22.851 [2024-04-16 23:04:13.864580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.851 [2024-04-16 23:04:13.864698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.851 [2024-04-16 23:04:13.864723] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.851 qpair failed and we were unable to recover it. 00:26:22.851 [2024-04-16 23:04:13.864928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.851 [2024-04-16 23:04:13.865072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.851 [2024-04-16 23:04:13.865100] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.851 qpair failed and we were unable to recover it. 00:26:22.851 [2024-04-16 23:04:13.865220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.851 [2024-04-16 23:04:13.865376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.851 [2024-04-16 23:04:13.865404] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.851 qpair failed and we were unable to recover it. 00:26:22.851 [2024-04-16 23:04:13.865558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.851 [2024-04-16 23:04:13.865675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.851 [2024-04-16 23:04:13.865699] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.851 qpair failed and we were unable to recover it. 00:26:22.851 [2024-04-16 23:04:13.865839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.852 [2024-04-16 23:04:13.865946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.852 [2024-04-16 23:04:13.865971] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.852 qpair failed and we were unable to recover it. 00:26:22.852 [2024-04-16 23:04:13.866111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.852 [2024-04-16 23:04:13.866280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.852 [2024-04-16 23:04:13.866309] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.852 qpair failed and we were unable to recover it. 00:26:22.852 [2024-04-16 23:04:13.866471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.852 [2024-04-16 23:04:13.866592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.852 [2024-04-16 23:04:13.866620] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.852 qpair failed and we were unable to recover it. 00:26:22.852 [2024-04-16 23:04:13.866772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.852 [2024-04-16 23:04:13.866897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.852 [2024-04-16 23:04:13.866924] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.852 qpair failed and we were unable to recover it. 00:26:22.852 [2024-04-16 23:04:13.867107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.852 [2024-04-16 23:04:13.867244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.852 [2024-04-16 23:04:13.867270] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.852 qpair failed and we were unable to recover it. 00:26:22.852 [2024-04-16 23:04:13.867420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.852 [2024-04-16 23:04:13.867538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.852 [2024-04-16 23:04:13.867562] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.852 qpair failed and we were unable to recover it. 00:26:22.852 [2024-04-16 23:04:13.867685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.852 [2024-04-16 23:04:13.867807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.852 [2024-04-16 23:04:13.867834] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.852 qpair failed and we were unable to recover it. 00:26:22.852 [2024-04-16 23:04:13.868015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.852 [2024-04-16 23:04:13.868168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.852 [2024-04-16 23:04:13.868202] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.852 qpair failed and we were unable to recover it. 00:26:22.852 [2024-04-16 23:04:13.868369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.852 [2024-04-16 23:04:13.868475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.852 [2024-04-16 23:04:13.868500] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.852 qpair failed and we were unable to recover it. 00:26:22.852 [2024-04-16 23:04:13.868692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.852 [2024-04-16 23:04:13.868816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.852 [2024-04-16 23:04:13.868843] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.852 qpair failed and we were unable to recover it. 00:26:22.852 [2024-04-16 23:04:13.868963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.852 [2024-04-16 23:04:13.869112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.852 [2024-04-16 23:04:13.869139] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.852 qpair failed and we were unable to recover it. 00:26:22.852 [2024-04-16 23:04:13.869296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.852 [2024-04-16 23:04:13.869451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.852 [2024-04-16 23:04:13.869478] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.852 qpair failed and we were unable to recover it. 00:26:22.852 [2024-04-16 23:04:13.869639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.852 [2024-04-16 23:04:13.869773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.852 [2024-04-16 23:04:13.869798] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.852 qpair failed and we were unable to recover it. 00:26:22.852 [2024-04-16 23:04:13.869950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.852 [2024-04-16 23:04:13.870076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.852 [2024-04-16 23:04:13.870108] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.852 qpair failed and we were unable to recover it. 00:26:22.852 [2024-04-16 23:04:13.870279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.852 [2024-04-16 23:04:13.870392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.852 [2024-04-16 23:04:13.870417] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.852 qpair failed and we were unable to recover it. 00:26:22.852 [2024-04-16 23:04:13.870565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.852 [2024-04-16 23:04:13.870706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.852 [2024-04-16 23:04:13.870731] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.852 qpair failed and we were unable to recover it. 00:26:22.852 [2024-04-16 23:04:13.870901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.852 [2024-04-16 23:04:13.871067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.852 [2024-04-16 23:04:13.871107] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.852 qpair failed and we were unable to recover it. 00:26:22.852 [2024-04-16 23:04:13.871233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.852 [2024-04-16 23:04:13.871382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.852 [2024-04-16 23:04:13.871410] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.852 qpair failed and we were unable to recover it. 00:26:22.852 [2024-04-16 23:04:13.871640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.852 [2024-04-16 23:04:13.871898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.852 [2024-04-16 23:04:13.871923] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.852 qpair failed and we were unable to recover it. 00:26:22.852 [2024-04-16 23:04:13.872042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.852 [2024-04-16 23:04:13.872252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.852 [2024-04-16 23:04:13.872278] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.852 qpair failed and we were unable to recover it. 00:26:22.852 [2024-04-16 23:04:13.872391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.852 [2024-04-16 23:04:13.872535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.852 [2024-04-16 23:04:13.872561] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.852 qpair failed and we were unable to recover it. 00:26:22.852 [2024-04-16 23:04:13.872696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.852 [2024-04-16 23:04:13.872891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.852 [2024-04-16 23:04:13.872915] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.852 qpair failed and we were unable to recover it. 00:26:22.852 [2024-04-16 23:04:13.873083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.852 [2024-04-16 23:04:13.873236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.852 [2024-04-16 23:04:13.873264] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.852 qpair failed and we were unable to recover it. 00:26:22.852 [2024-04-16 23:04:13.873446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.852 [2024-04-16 23:04:13.873646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.852 [2024-04-16 23:04:13.873675] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.852 qpair failed and we were unable to recover it. 00:26:22.852 [2024-04-16 23:04:13.873842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.852 [2024-04-16 23:04:13.874027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.852 [2024-04-16 23:04:13.874054] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.852 qpair failed and we were unable to recover it. 00:26:22.852 [2024-04-16 23:04:13.874232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.852 [2024-04-16 23:04:13.874367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.852 [2024-04-16 23:04:13.874392] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.852 qpair failed and we were unable to recover it. 00:26:22.852 [2024-04-16 23:04:13.874498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.852 [2024-04-16 23:04:13.874689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.852 [2024-04-16 23:04:13.874716] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.852 qpair failed and we were unable to recover it. 00:26:22.852 [2024-04-16 23:04:13.874852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.853 [2024-04-16 23:04:13.874978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.853 [2024-04-16 23:04:13.875020] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.853 qpair failed and we were unable to recover it. 00:26:22.853 [2024-04-16 23:04:13.875154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.853 [2024-04-16 23:04:13.875302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.853 [2024-04-16 23:04:13.875327] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.853 qpair failed and we were unable to recover it. 00:26:22.853 [2024-04-16 23:04:13.875514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.853 [2024-04-16 23:04:13.875648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.853 [2024-04-16 23:04:13.875673] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.853 qpair failed and we were unable to recover it. 00:26:22.853 [2024-04-16 23:04:13.875800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.853 [2024-04-16 23:04:13.875962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.853 [2024-04-16 23:04:13.875989] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.853 qpair failed and we were unable to recover it. 00:26:22.853 [2024-04-16 23:04:13.876125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.853 [2024-04-16 23:04:13.876293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.853 [2024-04-16 23:04:13.876318] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.853 qpair failed and we were unable to recover it. 00:26:22.853 [2024-04-16 23:04:13.876451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.853 [2024-04-16 23:04:13.876591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.853 [2024-04-16 23:04:13.876616] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.853 qpair failed and we were unable to recover it. 00:26:22.853 [2024-04-16 23:04:13.876795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.853 [2024-04-16 23:04:13.876938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.853 [2024-04-16 23:04:13.876963] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.853 qpair failed and we were unable to recover it. 00:26:22.853 [2024-04-16 23:04:13.877129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.853 [2024-04-16 23:04:13.877327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.853 [2024-04-16 23:04:13.877353] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.853 qpair failed and we were unable to recover it. 00:26:22.853 [2024-04-16 23:04:13.877487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.853 [2024-04-16 23:04:13.877665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.853 [2024-04-16 23:04:13.877707] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.853 qpair failed and we were unable to recover it. 00:26:22.853 [2024-04-16 23:04:13.877868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.853 [2024-04-16 23:04:13.878036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.853 [2024-04-16 23:04:13.878061] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.853 qpair failed and we were unable to recover it. 00:26:22.853 [2024-04-16 23:04:13.878206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.853 [2024-04-16 23:04:13.878320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.853 [2024-04-16 23:04:13.878345] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.853 qpair failed and we were unable to recover it. 00:26:22.853 [2024-04-16 23:04:13.878457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.853 [2024-04-16 23:04:13.878588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.853 [2024-04-16 23:04:13.878615] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.853 qpair failed and we were unable to recover it. 00:26:22.853 [2024-04-16 23:04:13.878732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.853 [2024-04-16 23:04:13.878865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.853 [2024-04-16 23:04:13.878894] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.853 qpair failed and we were unable to recover it. 00:26:22.853 [2024-04-16 23:04:13.879067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.853 [2024-04-16 23:04:13.879201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.853 [2024-04-16 23:04:13.879226] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.853 qpair failed and we were unable to recover it. 00:26:22.853 [2024-04-16 23:04:13.879338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.853 [2024-04-16 23:04:13.879515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.853 [2024-04-16 23:04:13.879542] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.853 qpair failed and we were unable to recover it. 00:26:22.853 [2024-04-16 23:04:13.879657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.853 [2024-04-16 23:04:13.879776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.853 [2024-04-16 23:04:13.879803] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.853 qpair failed and we were unable to recover it. 00:26:22.853 [2024-04-16 23:04:13.879919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.853 [2024-04-16 23:04:13.880070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.853 [2024-04-16 23:04:13.880097] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.853 qpair failed and we were unable to recover it. 00:26:22.853 [2024-04-16 23:04:13.880243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.853 [2024-04-16 23:04:13.880411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.853 [2024-04-16 23:04:13.880436] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.853 qpair failed and we were unable to recover it. 00:26:22.853 [2024-04-16 23:04:13.880566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.853 [2024-04-16 23:04:13.880721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.853 [2024-04-16 23:04:13.880745] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.853 qpair failed and we were unable to recover it. 00:26:22.853 [2024-04-16 23:04:13.880915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.853 [2024-04-16 23:04:13.881064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.853 [2024-04-16 23:04:13.881104] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.853 qpair failed and we were unable to recover it. 00:26:22.853 [2024-04-16 23:04:13.881228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.853 [2024-04-16 23:04:13.881432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.853 [2024-04-16 23:04:13.881457] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.853 qpair failed and we were unable to recover it. 00:26:22.853 [2024-04-16 23:04:13.881631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.853 [2024-04-16 23:04:13.881772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.853 [2024-04-16 23:04:13.881798] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.853 qpair failed and we were unable to recover it. 00:26:22.853 [2024-04-16 23:04:13.881943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.853 [2024-04-16 23:04:13.882083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.853 [2024-04-16 23:04:13.882107] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.853 qpair failed and we were unable to recover it. 00:26:22.853 [2024-04-16 23:04:13.882248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.853 [2024-04-16 23:04:13.882385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.853 [2024-04-16 23:04:13.882413] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.853 qpair failed and we were unable to recover it. 00:26:22.853 [2024-04-16 23:04:13.882537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.853 [2024-04-16 23:04:13.882705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.853 [2024-04-16 23:04:13.882730] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.853 qpair failed and we were unable to recover it. 00:26:22.853 [2024-04-16 23:04:13.882896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.853 [2024-04-16 23:04:13.883007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.853 [2024-04-16 23:04:13.883047] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.853 qpair failed and we were unable to recover it. 00:26:22.853 [2024-04-16 23:04:13.883206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.853 [2024-04-16 23:04:13.883363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.853 [2024-04-16 23:04:13.883388] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.853 qpair failed and we were unable to recover it. 00:26:22.853 [2024-04-16 23:04:13.883500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.853 [2024-04-16 23:04:13.883611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.853 [2024-04-16 23:04:13.883636] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.853 qpair failed and we were unable to recover it. 00:26:22.853 [2024-04-16 23:04:13.883740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.853 [2024-04-16 23:04:13.883885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.853 [2024-04-16 23:04:13.883910] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.854 qpair failed and we were unable to recover it. 00:26:22.854 [2024-04-16 23:04:13.884044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.854 [2024-04-16 23:04:13.884162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.854 [2024-04-16 23:04:13.884195] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.854 qpair failed and we were unable to recover it. 00:26:22.854 [2024-04-16 23:04:13.884334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.854 [2024-04-16 23:04:13.884500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.854 [2024-04-16 23:04:13.884525] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.854 qpair failed and we were unable to recover it. 00:26:22.854 [2024-04-16 23:04:13.884664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.854 [2024-04-16 23:04:13.884790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.854 [2024-04-16 23:04:13.884817] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.854 qpair failed and we were unable to recover it. 00:26:22.854 [2024-04-16 23:04:13.884975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.854 [2024-04-16 23:04:13.885098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.854 [2024-04-16 23:04:13.885124] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.854 qpair failed and we were unable to recover it. 00:26:22.854 [2024-04-16 23:04:13.885276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.854 [2024-04-16 23:04:13.885418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.854 [2024-04-16 23:04:13.885443] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.854 qpair failed and we were unable to recover it. 00:26:22.854 [2024-04-16 23:04:13.885583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.854 [2024-04-16 23:04:13.885747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.854 [2024-04-16 23:04:13.885772] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.854 qpair failed and we were unable to recover it. 00:26:22.854 [2024-04-16 23:04:13.885919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.854 [2024-04-16 23:04:13.886092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.854 [2024-04-16 23:04:13.886117] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.854 qpair failed and we were unable to recover it. 00:26:22.854 [2024-04-16 23:04:13.886270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.854 [2024-04-16 23:04:13.886406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.854 [2024-04-16 23:04:13.886434] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.854 qpair failed and we were unable to recover it. 00:26:22.854 [2024-04-16 23:04:13.886629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.854 [2024-04-16 23:04:13.886743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.854 [2024-04-16 23:04:13.886767] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.854 qpair failed and we were unable to recover it. 00:26:22.854 [2024-04-16 23:04:13.886910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.854 [2024-04-16 23:04:13.887054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.854 [2024-04-16 23:04:13.887078] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.854 qpair failed and we were unable to recover it. 00:26:22.854 [2024-04-16 23:04:13.887263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.854 [2024-04-16 23:04:13.887517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.854 [2024-04-16 23:04:13.887541] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.854 qpair failed and we were unable to recover it. 00:26:22.854 [2024-04-16 23:04:13.887709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.854 [2024-04-16 23:04:13.887852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.854 [2024-04-16 23:04:13.887877] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.854 qpair failed and we were unable to recover it. 00:26:22.854 [2024-04-16 23:04:13.888014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.854 [2024-04-16 23:04:13.888169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.854 [2024-04-16 23:04:13.888219] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.854 qpair failed and we were unable to recover it. 00:26:22.854 [2024-04-16 23:04:13.888361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.854 [2024-04-16 23:04:13.888511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.854 [2024-04-16 23:04:13.888538] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.854 qpair failed and we were unable to recover it. 00:26:22.854 [2024-04-16 23:04:13.888751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.854 [2024-04-16 23:04:13.889007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.854 [2024-04-16 23:04:13.889034] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.854 qpair failed and we were unable to recover it. 00:26:22.854 [2024-04-16 23:04:13.889183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.854 [2024-04-16 23:04:13.889337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.854 [2024-04-16 23:04:13.889366] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.854 qpair failed and we were unable to recover it. 00:26:22.854 [2024-04-16 23:04:13.889579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.854 [2024-04-16 23:04:13.889738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.854 [2024-04-16 23:04:13.889765] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.854 qpair failed and we were unable to recover it. 00:26:22.854 [2024-04-16 23:04:13.889947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.854 [2024-04-16 23:04:13.890068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.854 [2024-04-16 23:04:13.890110] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.854 qpair failed and we were unable to recover it. 00:26:22.854 [2024-04-16 23:04:13.890290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.854 [2024-04-16 23:04:13.890429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.854 [2024-04-16 23:04:13.890461] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.854 qpair failed and we were unable to recover it. 00:26:22.854 [2024-04-16 23:04:13.890618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.854 [2024-04-16 23:04:13.890773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.854 [2024-04-16 23:04:13.890800] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.854 qpair failed and we were unable to recover it. 00:26:22.854 [2024-04-16 23:04:13.890930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.854 [2024-04-16 23:04:13.891033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.854 [2024-04-16 23:04:13.891057] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.854 qpair failed and we were unable to recover it. 00:26:22.854 [2024-04-16 23:04:13.891190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.854 [2024-04-16 23:04:13.891323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.854 [2024-04-16 23:04:13.891350] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.854 qpair failed and we were unable to recover it. 00:26:22.854 [2024-04-16 23:04:13.891502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.854 [2024-04-16 23:04:13.891662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.854 [2024-04-16 23:04:13.891689] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.854 qpair failed and we were unable to recover it. 00:26:22.854 [2024-04-16 23:04:13.891812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.854 [2024-04-16 23:04:13.891929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.854 [2024-04-16 23:04:13.891956] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.854 qpair failed and we were unable to recover it. 00:26:22.855 [2024-04-16 23:04:13.892127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.855 [2024-04-16 23:04:13.892267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.855 [2024-04-16 23:04:13.892308] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.855 qpair failed and we were unable to recover it. 00:26:22.855 [2024-04-16 23:04:13.892453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.855 [2024-04-16 23:04:13.892575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.855 [2024-04-16 23:04:13.892602] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.855 qpair failed and we were unable to recover it. 00:26:22.855 [2024-04-16 23:04:13.892798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.855 [2024-04-16 23:04:13.892979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.855 [2024-04-16 23:04:13.893007] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.855 qpair failed and we were unable to recover it. 00:26:22.855 [2024-04-16 23:04:13.893126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.855 [2024-04-16 23:04:13.893306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.855 [2024-04-16 23:04:13.893334] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.855 qpair failed and we were unable to recover it. 00:26:22.855 [2024-04-16 23:04:13.893521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.855 [2024-04-16 23:04:13.893715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.855 [2024-04-16 23:04:13.893743] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.855 qpair failed and we were unable to recover it. 00:26:22.855 [2024-04-16 23:04:13.893907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.855 [2024-04-16 23:04:13.894058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.855 [2024-04-16 23:04:13.894085] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.855 qpair failed and we were unable to recover it. 00:26:22.855 [2024-04-16 23:04:13.894205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.855 [2024-04-16 23:04:13.894332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.855 [2024-04-16 23:04:13.894360] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.855 qpair failed and we were unable to recover it. 00:26:22.855 [2024-04-16 23:04:13.894542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.855 [2024-04-16 23:04:13.894700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.855 [2024-04-16 23:04:13.894728] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.855 qpair failed and we were unable to recover it. 00:26:22.855 [2024-04-16 23:04:13.894863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.855 [2024-04-16 23:04:13.895031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.855 [2024-04-16 23:04:13.895056] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.855 qpair failed and we were unable to recover it. 00:26:22.855 [2024-04-16 23:04:13.895170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.855 [2024-04-16 23:04:13.895333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.855 [2024-04-16 23:04:13.895361] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.855 qpair failed and we were unable to recover it. 00:26:22.855 [2024-04-16 23:04:13.895520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.855 [2024-04-16 23:04:13.895653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.855 [2024-04-16 23:04:13.895680] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.855 qpair failed and we were unable to recover it. 00:26:22.855 [2024-04-16 23:04:13.895859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.855 [2024-04-16 23:04:13.896039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.855 [2024-04-16 23:04:13.896066] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.855 qpair failed and we were unable to recover it. 00:26:22.855 [2024-04-16 23:04:13.896255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.855 [2024-04-16 23:04:13.896411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.855 [2024-04-16 23:04:13.896438] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.855 qpair failed and we were unable to recover it. 00:26:22.855 [2024-04-16 23:04:13.896558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.855 [2024-04-16 23:04:13.896671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.855 [2024-04-16 23:04:13.896699] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.855 qpair failed and we were unable to recover it. 00:26:22.855 [2024-04-16 23:04:13.896873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.855 [2024-04-16 23:04:13.897017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.855 [2024-04-16 23:04:13.897042] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.855 qpair failed and we were unable to recover it. 00:26:22.855 [2024-04-16 23:04:13.897185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.855 [2024-04-16 23:04:13.897298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.855 [2024-04-16 23:04:13.897322] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.855 qpair failed and we were unable to recover it. 00:26:22.855 [2024-04-16 23:04:13.897427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.855 [2024-04-16 23:04:13.897585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.855 [2024-04-16 23:04:13.897609] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.855 qpair failed and we were unable to recover it. 00:26:22.855 [2024-04-16 23:04:13.897784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.855 [2024-04-16 23:04:13.897942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.855 [2024-04-16 23:04:13.897967] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.855 qpair failed and we were unable to recover it. 00:26:22.855 [2024-04-16 23:04:13.898121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.855 [2024-04-16 23:04:13.898258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.855 [2024-04-16 23:04:13.898286] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.855 qpair failed and we were unable to recover it. 00:26:22.855 [2024-04-16 23:04:13.898451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.855 [2024-04-16 23:04:13.898566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.855 [2024-04-16 23:04:13.898590] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.855 qpair failed and we were unable to recover it. 00:26:22.855 [2024-04-16 23:04:13.898732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.855 [2024-04-16 23:04:13.898838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.855 [2024-04-16 23:04:13.898863] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.855 qpair failed and we were unable to recover it. 00:26:22.855 [2024-04-16 23:04:13.899004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.855 [2024-04-16 23:04:13.899143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.855 [2024-04-16 23:04:13.899167] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.855 qpair failed and we were unable to recover it. 00:26:22.855 [2024-04-16 23:04:13.899294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.855 [2024-04-16 23:04:13.899470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.855 [2024-04-16 23:04:13.899494] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.855 qpair failed and we were unable to recover it. 00:26:22.855 [2024-04-16 23:04:13.899635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.855 [2024-04-16 23:04:13.899809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.855 [2024-04-16 23:04:13.899835] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.855 qpair failed and we were unable to recover it. 00:26:22.855 [2024-04-16 23:04:13.899982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.855 [2024-04-16 23:04:13.900087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.855 [2024-04-16 23:04:13.900112] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.855 qpair failed and we were unable to recover it. 00:26:22.855 [2024-04-16 23:04:13.900256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.855 [2024-04-16 23:04:13.900404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.855 [2024-04-16 23:04:13.900429] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.855 qpair failed and we were unable to recover it. 00:26:22.855 [2024-04-16 23:04:13.900625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.855 [2024-04-16 23:04:13.900734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.855 [2024-04-16 23:04:13.900759] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.855 qpair failed and we were unable to recover it. 00:26:22.855 [2024-04-16 23:04:13.900893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.855 [2024-04-16 23:04:13.901032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.855 [2024-04-16 23:04:13.901060] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.855 qpair failed and we were unable to recover it. 00:26:22.855 [2024-04-16 23:04:13.901225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.855 [2024-04-16 23:04:13.901369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.855 [2024-04-16 23:04:13.901394] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.856 qpair failed and we were unable to recover it. 00:26:22.856 [2024-04-16 23:04:13.901563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.856 [2024-04-16 23:04:13.901731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.856 [2024-04-16 23:04:13.901759] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.856 qpair failed and we were unable to recover it. 00:26:22.856 [2024-04-16 23:04:13.901929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.856 [2024-04-16 23:04:13.902072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.856 [2024-04-16 23:04:13.902097] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.856 qpair failed and we were unable to recover it. 00:26:22.856 [2024-04-16 23:04:13.902275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.856 [2024-04-16 23:04:13.902385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.856 [2024-04-16 23:04:13.902410] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.856 qpair failed and we were unable to recover it. 00:26:22.856 [2024-04-16 23:04:13.902556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.856 [2024-04-16 23:04:13.902674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.856 [2024-04-16 23:04:13.902699] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.856 qpair failed and we were unable to recover it. 00:26:22.856 [2024-04-16 23:04:13.902837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.856 [2024-04-16 23:04:13.902979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.856 [2024-04-16 23:04:13.903008] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.856 qpair failed and we were unable to recover it. 00:26:22.856 [2024-04-16 23:04:13.903169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.856 [2024-04-16 23:04:13.903292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.856 [2024-04-16 23:04:13.903317] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.856 qpair failed and we were unable to recover it. 00:26:22.856 [2024-04-16 23:04:13.903432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.856 [2024-04-16 23:04:13.903575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.856 [2024-04-16 23:04:13.903600] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.856 qpair failed and we were unable to recover it. 00:26:22.856 [2024-04-16 23:04:13.903742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.856 [2024-04-16 23:04:13.903884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.856 [2024-04-16 23:04:13.903924] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.856 qpair failed and we were unable to recover it. 00:26:22.856 [2024-04-16 23:04:13.904079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.856 [2024-04-16 23:04:13.904263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.856 [2024-04-16 23:04:13.904289] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.856 qpair failed and we were unable to recover it. 00:26:22.856 [2024-04-16 23:04:13.904409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.856 [2024-04-16 23:04:13.904568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.856 [2024-04-16 23:04:13.904596] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.856 qpair failed and we were unable to recover it. 00:26:22.856 [2024-04-16 23:04:13.904714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.856 [2024-04-16 23:04:13.904904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.856 [2024-04-16 23:04:13.904929] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.856 qpair failed and we were unable to recover it. 00:26:22.856 [2024-04-16 23:04:13.905070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.856 [2024-04-16 23:04:13.905186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.856 [2024-04-16 23:04:13.905211] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.856 qpair failed and we were unable to recover it. 00:26:22.856 [2024-04-16 23:04:13.905325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.856 [2024-04-16 23:04:13.905456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.856 [2024-04-16 23:04:13.905484] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.856 qpair failed and we were unable to recover it. 00:26:22.856 [2024-04-16 23:04:13.905679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.856 [2024-04-16 23:04:13.905811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.856 [2024-04-16 23:04:13.905836] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.856 qpair failed and we were unable to recover it. 00:26:22.856 [2024-04-16 23:04:13.905982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.856 [2024-04-16 23:04:13.906118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.856 [2024-04-16 23:04:13.906145] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.856 qpair failed and we were unable to recover it. 00:26:22.856 [2024-04-16 23:04:13.906317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.856 [2024-04-16 23:04:13.906453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.856 [2024-04-16 23:04:13.906493] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.856 qpair failed and we were unable to recover it. 00:26:22.856 [2024-04-16 23:04:13.906647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.856 [2024-04-16 23:04:13.906844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.856 [2024-04-16 23:04:13.906900] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.856 qpair failed and we were unable to recover it. 00:26:22.856 [2024-04-16 23:04:13.907019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.856 [2024-04-16 23:04:13.907198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.856 [2024-04-16 23:04:13.907226] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.856 qpair failed and we were unable to recover it. 00:26:22.856 [2024-04-16 23:04:13.907386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.856 [2024-04-16 23:04:13.907521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.856 [2024-04-16 23:04:13.907548] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.856 qpair failed and we were unable to recover it. 00:26:22.856 [2024-04-16 23:04:13.907734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.856 [2024-04-16 23:04:13.907870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.856 [2024-04-16 23:04:13.907909] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.856 qpair failed and we were unable to recover it. 00:26:22.856 [2024-04-16 23:04:13.908069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.856 [2024-04-16 23:04:13.908225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.856 [2024-04-16 23:04:13.908253] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.856 qpair failed and we were unable to recover it. 00:26:22.856 [2024-04-16 23:04:13.908411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.856 [2024-04-16 23:04:13.908655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.856 [2024-04-16 23:04:13.908682] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.856 qpair failed and we were unable to recover it. 00:26:22.856 [2024-04-16 23:04:13.908813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.856 [2024-04-16 23:04:13.908962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.856 [2024-04-16 23:04:13.908989] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.856 qpair failed and we were unable to recover it. 00:26:22.856 [2024-04-16 23:04:13.909153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.856 [2024-04-16 23:04:13.909269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.856 [2024-04-16 23:04:13.909295] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.856 qpair failed and we were unable to recover it. 00:26:22.856 [2024-04-16 23:04:13.909435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.856 [2024-04-16 23:04:13.909580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.856 [2024-04-16 23:04:13.909608] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.856 qpair failed and we were unable to recover it. 00:26:22.856 [2024-04-16 23:04:13.909743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.856 [2024-04-16 23:04:13.909881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.856 [2024-04-16 23:04:13.909906] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.856 qpair failed and we were unable to recover it. 00:26:22.856 [2024-04-16 23:04:13.910063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.856 [2024-04-16 23:04:13.910198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.856 [2024-04-16 23:04:13.910227] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.856 qpair failed and we were unable to recover it. 00:26:22.856 [2024-04-16 23:04:13.910387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.856 [2024-04-16 23:04:13.910531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.856 [2024-04-16 23:04:13.910555] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.856 qpair failed and we were unable to recover it. 00:26:22.856 [2024-04-16 23:04:13.910691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.856 [2024-04-16 23:04:13.910875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.856 [2024-04-16 23:04:13.910902] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.856 qpair failed and we were unable to recover it. 00:26:22.857 [2024-04-16 23:04:13.911019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.857 [2024-04-16 23:04:13.911149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.857 [2024-04-16 23:04:13.911182] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.857 qpair failed and we were unable to recover it. 00:26:22.857 [2024-04-16 23:04:13.911334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.857 [2024-04-16 23:04:13.911486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.857 [2024-04-16 23:04:13.911514] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.857 qpair failed and we were unable to recover it. 00:26:22.857 [2024-04-16 23:04:13.911653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.857 [2024-04-16 23:04:13.911795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.857 [2024-04-16 23:04:13.911820] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.857 qpair failed and we were unable to recover it. 00:26:22.857 [2024-04-16 23:04:13.911976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.857 [2024-04-16 23:04:13.912125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.857 [2024-04-16 23:04:13.912152] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.857 qpair failed and we were unable to recover it. 00:26:22.857 [2024-04-16 23:04:13.912315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.857 [2024-04-16 23:04:13.912445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.857 [2024-04-16 23:04:13.912474] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.857 qpair failed and we were unable to recover it. 00:26:22.857 [2024-04-16 23:04:13.912594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.857 [2024-04-16 23:04:13.912753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.857 [2024-04-16 23:04:13.912781] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.857 qpair failed and we were unable to recover it. 00:26:22.857 [2024-04-16 23:04:13.912946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.857 [2024-04-16 23:04:13.913090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.857 [2024-04-16 23:04:13.913130] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.857 qpair failed and we were unable to recover it. 00:26:22.857 [2024-04-16 23:04:13.913279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.857 [2024-04-16 23:04:13.913429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.857 [2024-04-16 23:04:13.913457] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.857 qpair failed and we were unable to recover it. 00:26:22.857 [2024-04-16 23:04:13.913628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.857 [2024-04-16 23:04:13.913778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.857 [2024-04-16 23:04:13.913805] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.857 qpair failed and we were unable to recover it. 00:26:22.857 [2024-04-16 23:04:13.913932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.857 [2024-04-16 23:04:13.914088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.857 [2024-04-16 23:04:13.914115] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.857 qpair failed and we were unable to recover it. 00:26:22.857 [2024-04-16 23:04:13.914314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.857 [2024-04-16 23:04:13.914450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.857 [2024-04-16 23:04:13.914492] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.857 qpair failed and we were unable to recover it. 00:26:22.857 [2024-04-16 23:04:13.914605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.857 [2024-04-16 23:04:13.914735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.857 [2024-04-16 23:04:13.914762] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.857 qpair failed and we were unable to recover it. 00:26:22.857 [2024-04-16 23:04:13.914888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.857 [2024-04-16 23:04:13.915046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.857 [2024-04-16 23:04:13.915073] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.857 qpair failed and we were unable to recover it. 00:26:22.857 [2024-04-16 23:04:13.915280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.857 [2024-04-16 23:04:13.915414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.857 [2024-04-16 23:04:13.915439] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.857 qpair failed and we were unable to recover it. 00:26:22.857 [2024-04-16 23:04:13.915582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.857 [2024-04-16 23:04:13.915717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.857 [2024-04-16 23:04:13.915757] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.857 qpair failed and we were unable to recover it. 00:26:22.857 [2024-04-16 23:04:13.915923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.857 [2024-04-16 23:04:13.916035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.857 [2024-04-16 23:04:13.916060] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.857 qpair failed and we were unable to recover it. 00:26:22.857 [2024-04-16 23:04:13.916257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.857 [2024-04-16 23:04:13.916426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.857 [2024-04-16 23:04:13.916450] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.857 qpair failed and we were unable to recover it. 00:26:22.857 [2024-04-16 23:04:13.916561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.857 [2024-04-16 23:04:13.916704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.857 [2024-04-16 23:04:13.916729] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.857 qpair failed and we were unable to recover it. 00:26:22.857 [2024-04-16 23:04:13.916841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.857 [2024-04-16 23:04:13.916948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.857 [2024-04-16 23:04:13.916972] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.857 qpair failed and we were unable to recover it. 00:26:22.857 [2024-04-16 23:04:13.917106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.857 [2024-04-16 23:04:13.917258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.857 [2024-04-16 23:04:13.917283] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.857 qpair failed and we were unable to recover it. 00:26:22.857 [2024-04-16 23:04:13.917452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.857 [2024-04-16 23:04:13.917600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.857 [2024-04-16 23:04:13.917628] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.857 qpair failed and we were unable to recover it. 00:26:22.857 [2024-04-16 23:04:13.917754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.857 [2024-04-16 23:04:13.917890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.857 [2024-04-16 23:04:13.917918] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.857 qpair failed and we were unable to recover it. 00:26:22.857 [2024-04-16 23:04:13.918103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.857 [2024-04-16 23:04:13.918266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.857 [2024-04-16 23:04:13.918294] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.857 qpair failed and we were unable to recover it. 00:26:22.857 [2024-04-16 23:04:13.918446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.857 [2024-04-16 23:04:13.918606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.857 [2024-04-16 23:04:13.918630] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.857 qpair failed and we were unable to recover it. 00:26:22.857 [2024-04-16 23:04:13.918766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.857 [2024-04-16 23:04:13.918952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.857 [2024-04-16 23:04:13.918979] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.857 qpair failed and we were unable to recover it. 00:26:22.857 [2024-04-16 23:04:13.919131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.857 [2024-04-16 23:04:13.919333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.857 [2024-04-16 23:04:13.919359] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.857 qpair failed and we were unable to recover it. 00:26:22.857 [2024-04-16 23:04:13.919469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.857 [2024-04-16 23:04:13.919636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.857 [2024-04-16 23:04:13.919661] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.857 qpair failed and we were unable to recover it. 00:26:22.857 [2024-04-16 23:04:13.919834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.857 [2024-04-16 23:04:13.919967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.857 [2024-04-16 23:04:13.919992] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.857 qpair failed and we were unable to recover it. 00:26:22.857 [2024-04-16 23:04:13.920132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.857 [2024-04-16 23:04:13.920360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.857 [2024-04-16 23:04:13.920385] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.858 qpair failed and we were unable to recover it. 00:26:22.858 [2024-04-16 23:04:13.920506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.858 [2024-04-16 23:04:13.920650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.858 [2024-04-16 23:04:13.920674] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.858 qpair failed and we were unable to recover it. 00:26:22.858 [2024-04-16 23:04:13.920812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.858 [2024-04-16 23:04:13.920980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.858 [2024-04-16 23:04:13.921004] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.858 qpair failed and we were unable to recover it. 00:26:22.858 [2024-04-16 23:04:13.921144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.858 [2024-04-16 23:04:13.921312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.858 [2024-04-16 23:04:13.921337] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.858 qpair failed and we were unable to recover it. 00:26:22.858 [2024-04-16 23:04:13.921446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.858 [2024-04-16 23:04:13.921592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.858 [2024-04-16 23:04:13.921616] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.858 qpair failed and we were unable to recover it. 00:26:22.858 [2024-04-16 23:04:13.921787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.858 [2024-04-16 23:04:13.921954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.858 [2024-04-16 23:04:13.921979] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.858 qpair failed and we were unable to recover it. 00:26:22.858 [2024-04-16 23:04:13.922149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.858 [2024-04-16 23:04:13.922282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.858 [2024-04-16 23:04:13.922307] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.858 qpair failed and we were unable to recover it. 00:26:22.858 [2024-04-16 23:04:13.922470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.858 [2024-04-16 23:04:13.922615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.858 [2024-04-16 23:04:13.922640] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.858 qpair failed and we were unable to recover it. 00:26:22.858 [2024-04-16 23:04:13.922842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.858 [2024-04-16 23:04:13.923005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.858 [2024-04-16 23:04:13.923029] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.858 qpair failed and we were unable to recover it. 00:26:22.858 [2024-04-16 23:04:13.923146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.858 [2024-04-16 23:04:13.923328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.858 [2024-04-16 23:04:13.923356] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.858 qpair failed and we were unable to recover it. 00:26:22.858 [2024-04-16 23:04:13.923521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.858 [2024-04-16 23:04:13.923658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.858 [2024-04-16 23:04:13.923686] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.858 qpair failed and we were unable to recover it. 00:26:22.858 [2024-04-16 23:04:13.923814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.858 [2024-04-16 23:04:13.923961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.858 [2024-04-16 23:04:13.923988] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.858 qpair failed and we were unable to recover it. 00:26:22.858 [2024-04-16 23:04:13.924187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.858 [2024-04-16 23:04:13.924361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.858 [2024-04-16 23:04:13.924401] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.858 qpair failed and we were unable to recover it. 00:26:22.858 [2024-04-16 23:04:13.924599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.858 [2024-04-16 23:04:13.924740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.858 [2024-04-16 23:04:13.924765] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.858 qpair failed and we were unable to recover it. 00:26:22.858 [2024-04-16 23:04:13.924940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.858 [2024-04-16 23:04:13.925083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.858 [2024-04-16 23:04:13.925108] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.858 qpair failed and we were unable to recover it. 00:26:22.858 [2024-04-16 23:04:13.925254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.858 [2024-04-16 23:04:13.925381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.858 [2024-04-16 23:04:13.925408] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.858 qpair failed and we were unable to recover it. 00:26:22.858 [2024-04-16 23:04:13.925548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.858 [2024-04-16 23:04:13.925687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.858 [2024-04-16 23:04:13.925713] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.858 qpair failed and we were unable to recover it. 00:26:22.858 [2024-04-16 23:04:13.925851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.858 [2024-04-16 23:04:13.926008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.858 [2024-04-16 23:04:13.926035] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.858 qpair failed and we were unable to recover it. 00:26:22.858 [2024-04-16 23:04:13.926199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.858 [2024-04-16 23:04:13.926312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.858 [2024-04-16 23:04:13.926337] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.858 qpair failed and we were unable to recover it. 00:26:22.858 [2024-04-16 23:04:13.926469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.858 [2024-04-16 23:04:13.926628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.858 [2024-04-16 23:04:13.926653] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.858 qpair failed and we were unable to recover it. 00:26:22.858 [2024-04-16 23:04:13.926813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.858 [2024-04-16 23:04:13.926953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.858 [2024-04-16 23:04:13.926984] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.858 qpair failed and we were unable to recover it. 00:26:22.858 [2024-04-16 23:04:13.927129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.858 [2024-04-16 23:04:13.927260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.858 [2024-04-16 23:04:13.927288] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.858 qpair failed and we were unable to recover it. 00:26:22.858 [2024-04-16 23:04:13.927439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.858 [2024-04-16 23:04:13.927579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.858 [2024-04-16 23:04:13.927603] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.858 qpair failed and we were unable to recover it. 00:26:22.858 [2024-04-16 23:04:13.927765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.858 [2024-04-16 23:04:13.927912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.858 [2024-04-16 23:04:13.927939] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.858 qpair failed and we were unable to recover it. 00:26:22.858 [2024-04-16 23:04:13.928088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.858 [2024-04-16 23:04:13.928202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.858 [2024-04-16 23:04:13.928230] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.858 qpair failed and we were unable to recover it. 00:26:22.858 [2024-04-16 23:04:13.928380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.858 [2024-04-16 23:04:13.928499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.858 [2024-04-16 23:04:13.928526] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.858 qpair failed and we were unable to recover it. 00:26:22.858 [2024-04-16 23:04:13.928668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.858 [2024-04-16 23:04:13.928775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.858 [2024-04-16 23:04:13.928800] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.858 qpair failed and we were unable to recover it. 00:26:22.858 [2024-04-16 23:04:13.928928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.858 [2024-04-16 23:04:13.929038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.858 [2024-04-16 23:04:13.929066] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.859 qpair failed and we were unable to recover it. 00:26:22.859 [2024-04-16 23:04:13.929195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.859 [2024-04-16 23:04:13.929380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.859 [2024-04-16 23:04:13.929408] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.859 qpair failed and we were unable to recover it. 00:26:22.859 [2024-04-16 23:04:13.929565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.859 [2024-04-16 23:04:13.929756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.859 [2024-04-16 23:04:13.929815] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.859 qpair failed and we were unable to recover it. 00:26:22.859 [2024-04-16 23:04:13.929982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.859 [2024-04-16 23:04:13.930128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.859 [2024-04-16 23:04:13.930152] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.859 qpair failed and we were unable to recover it. 00:26:22.859 [2024-04-16 23:04:13.930305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.859 [2024-04-16 23:04:13.930442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.859 [2024-04-16 23:04:13.930470] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.859 qpair failed and we were unable to recover it. 00:26:22.859 [2024-04-16 23:04:13.930648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.859 [2024-04-16 23:04:13.930806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.859 [2024-04-16 23:04:13.930833] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.859 qpair failed and we were unable to recover it. 00:26:22.859 [2024-04-16 23:04:13.930946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.859 [2024-04-16 23:04:13.931110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.859 [2024-04-16 23:04:13.931139] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.859 qpair failed and we were unable to recover it. 00:26:22.859 [2024-04-16 23:04:13.931283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.859 [2024-04-16 23:04:13.931424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.859 [2024-04-16 23:04:13.931448] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.859 qpair failed and we were unable to recover it. 00:26:22.859 [2024-04-16 23:04:13.931609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.859 [2024-04-16 23:04:13.931765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.859 [2024-04-16 23:04:13.931792] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.859 qpair failed and we were unable to recover it. 00:26:22.859 [2024-04-16 23:04:13.931957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.859 [2024-04-16 23:04:13.932079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.859 [2024-04-16 23:04:13.932106] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.859 qpair failed and we were unable to recover it. 00:26:22.859 [2024-04-16 23:04:13.932270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.859 [2024-04-16 23:04:13.932427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.859 [2024-04-16 23:04:13.932456] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.859 qpair failed and we were unable to recover it. 00:26:22.859 [2024-04-16 23:04:13.932619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.859 [2024-04-16 23:04:13.932727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.859 [2024-04-16 23:04:13.932752] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.859 qpair failed and we were unable to recover it. 00:26:22.859 [2024-04-16 23:04:13.932923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.859 [2024-04-16 23:04:13.933050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.859 [2024-04-16 23:04:13.933088] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.859 qpair failed and we were unable to recover it. 00:26:22.859 [2024-04-16 23:04:13.933230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.859 [2024-04-16 23:04:13.933396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.859 [2024-04-16 23:04:13.933420] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.859 qpair failed and we were unable to recover it. 00:26:22.859 [2024-04-16 23:04:13.933570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.859 [2024-04-16 23:04:13.933765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.859 [2024-04-16 23:04:13.933790] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.859 qpair failed and we were unable to recover it. 00:26:22.859 [2024-04-16 23:04:13.933933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.859 [2024-04-16 23:04:13.934081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.859 [2024-04-16 23:04:13.934111] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.859 qpair failed and we were unable to recover it. 00:26:22.859 [2024-04-16 23:04:13.934274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.859 [2024-04-16 23:04:13.934412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:22.859 [2024-04-16 23:04:13.934440] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:22.859 qpair failed and we were unable to recover it. 00:26:23.139 [2024-04-16 23:04:13.934683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.139 [2024-04-16 23:04:13.934945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.139 [2024-04-16 23:04:13.934996] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.139 qpair failed and we were unable to recover it. 00:26:23.139 [2024-04-16 23:04:13.935148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.139 [2024-04-16 23:04:13.935347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.139 [2024-04-16 23:04:13.935372] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.139 qpair failed and we were unable to recover it. 00:26:23.139 [2024-04-16 23:04:13.935525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.139 [2024-04-16 23:04:13.935670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.139 [2024-04-16 23:04:13.935695] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.139 qpair failed and we were unable to recover it. 00:26:23.139 [2024-04-16 23:04:13.935839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.139 [2024-04-16 23:04:13.936013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.139 [2024-04-16 23:04:13.936039] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.139 qpair failed and we were unable to recover it. 00:26:23.139 [2024-04-16 23:04:13.936181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.139 [2024-04-16 23:04:13.936324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.139 [2024-04-16 23:04:13.936349] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.139 qpair failed and we were unable to recover it. 00:26:23.139 [2024-04-16 23:04:13.936489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.139 [2024-04-16 23:04:13.936639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.139 [2024-04-16 23:04:13.936663] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.139 qpair failed and we were unable to recover it. 00:26:23.139 [2024-04-16 23:04:13.936808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.139 [2024-04-16 23:04:13.936915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.139 [2024-04-16 23:04:13.936940] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.139 qpair failed and we were unable to recover it. 00:26:23.139 [2024-04-16 23:04:13.937072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.139 [2024-04-16 23:04:13.937222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.139 [2024-04-16 23:04:13.937248] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.139 qpair failed and we were unable to recover it. 00:26:23.139 [2024-04-16 23:04:13.937411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.139 [2024-04-16 23:04:13.937552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.139 [2024-04-16 23:04:13.937580] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.139 qpair failed and we were unable to recover it. 00:26:23.139 [2024-04-16 23:04:13.937753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.139 [2024-04-16 23:04:13.937874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.139 [2024-04-16 23:04:13.937899] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.139 qpair failed and we were unable to recover it. 00:26:23.139 [2024-04-16 23:04:13.938015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.139 [2024-04-16 23:04:13.938148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.139 [2024-04-16 23:04:13.938173] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.139 qpair failed and we were unable to recover it. 00:26:23.139 [2024-04-16 23:04:13.938340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.139 [2024-04-16 23:04:13.938446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.139 [2024-04-16 23:04:13.938471] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.139 qpair failed and we were unable to recover it. 00:26:23.139 [2024-04-16 23:04:13.938640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.139 [2024-04-16 23:04:13.938754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.139 [2024-04-16 23:04:13.938778] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.139 qpair failed and we were unable to recover it. 00:26:23.139 [2024-04-16 23:04:13.938935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.139 [2024-04-16 23:04:13.939104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.139 [2024-04-16 23:04:13.939128] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.139 qpair failed and we were unable to recover it. 00:26:23.139 [2024-04-16 23:04:13.939269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.139 [2024-04-16 23:04:13.939386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.139 [2024-04-16 23:04:13.939413] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.139 qpair failed and we were unable to recover it. 00:26:23.139 [2024-04-16 23:04:13.939558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.139 [2024-04-16 23:04:13.939718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.139 [2024-04-16 23:04:13.939745] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.139 qpair failed and we were unable to recover it. 00:26:23.139 [2024-04-16 23:04:13.939885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.139 [2024-04-16 23:04:13.940000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.139 [2024-04-16 23:04:13.940024] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.139 qpair failed and we were unable to recover it. 00:26:23.139 [2024-04-16 23:04:13.940162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.139 [2024-04-16 23:04:13.940313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.139 [2024-04-16 23:04:13.940341] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.139 qpair failed and we were unable to recover it. 00:26:23.139 [2024-04-16 23:04:13.940495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.139 [2024-04-16 23:04:13.940638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.139 [2024-04-16 23:04:13.940662] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.139 qpair failed and we were unable to recover it. 00:26:23.139 [2024-04-16 23:04:13.940809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.139 [2024-04-16 23:04:13.940964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.139 [2024-04-16 23:04:13.940991] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.139 qpair failed and we were unable to recover it. 00:26:23.139 [2024-04-16 23:04:13.941182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.139 [2024-04-16 23:04:13.941325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.139 [2024-04-16 23:04:13.941350] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.139 qpair failed and we were unable to recover it. 00:26:23.139 [2024-04-16 23:04:13.941548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.139 [2024-04-16 23:04:13.941672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.139 [2024-04-16 23:04:13.941700] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.139 qpair failed and we were unable to recover it. 00:26:23.139 [2024-04-16 23:04:13.941828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.139 [2024-04-16 23:04:13.941942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.139 [2024-04-16 23:04:13.941967] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.139 qpair failed and we were unable to recover it. 00:26:23.139 [2024-04-16 23:04:13.942085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.139 [2024-04-16 23:04:13.942206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.139 [2024-04-16 23:04:13.942232] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.139 qpair failed and we were unable to recover it. 00:26:23.139 [2024-04-16 23:04:13.942369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.139 [2024-04-16 23:04:13.942522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.139 [2024-04-16 23:04:13.942549] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.139 qpair failed and we were unable to recover it. 00:26:23.139 [2024-04-16 23:04:13.942705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.139 [2024-04-16 23:04:13.942906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.139 [2024-04-16 23:04:13.942951] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.139 qpair failed and we were unable to recover it. 00:26:23.139 [2024-04-16 23:04:13.943141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.139 [2024-04-16 23:04:13.943285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.140 [2024-04-16 23:04:13.943310] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.140 qpair failed and we were unable to recover it. 00:26:23.140 [2024-04-16 23:04:13.943424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.140 [2024-04-16 23:04:13.943567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.140 [2024-04-16 23:04:13.943596] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.140 qpair failed and we were unable to recover it. 00:26:23.140 [2024-04-16 23:04:13.943723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.140 [2024-04-16 23:04:13.943848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.140 [2024-04-16 23:04:13.943875] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.140 qpair failed and we were unable to recover it. 00:26:23.140 [2024-04-16 23:04:13.944001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.140 [2024-04-16 23:04:13.944155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.140 [2024-04-16 23:04:13.944189] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.140 qpair failed and we were unable to recover it. 00:26:23.140 [2024-04-16 23:04:13.944354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.140 [2024-04-16 23:04:13.944523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.140 [2024-04-16 23:04:13.944548] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.140 qpair failed and we were unable to recover it. 00:26:23.140 [2024-04-16 23:04:13.944706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.140 [2024-04-16 23:04:13.944864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.140 [2024-04-16 23:04:13.944889] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.140 qpair failed and we were unable to recover it. 00:26:23.140 [2024-04-16 23:04:13.945015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.140 [2024-04-16 23:04:13.945182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.140 [2024-04-16 23:04:13.945211] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.140 qpair failed and we were unable to recover it. 00:26:23.140 [2024-04-16 23:04:13.945329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.140 [2024-04-16 23:04:13.945445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.140 [2024-04-16 23:04:13.945473] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.140 qpair failed and we were unable to recover it. 00:26:23.140 [2024-04-16 23:04:13.945636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.140 [2024-04-16 23:04:13.945831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.140 [2024-04-16 23:04:13.945859] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.140 qpair failed and we were unable to recover it. 00:26:23.140 [2024-04-16 23:04:13.946020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.140 [2024-04-16 23:04:13.946201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.140 [2024-04-16 23:04:13.946230] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.140 qpair failed and we were unable to recover it. 00:26:23.140 [2024-04-16 23:04:13.946370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.140 [2024-04-16 23:04:13.946551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.140 [2024-04-16 23:04:13.946579] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.140 qpair failed and we were unable to recover it. 00:26:23.140 [2024-04-16 23:04:13.946762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.140 [2024-04-16 23:04:13.946877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.140 [2024-04-16 23:04:13.946905] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.140 qpair failed and we were unable to recover it. 00:26:23.140 [2024-04-16 23:04:13.947041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.140 [2024-04-16 23:04:13.947202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.140 [2024-04-16 23:04:13.947228] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.140 qpair failed and we were unable to recover it. 00:26:23.140 [2024-04-16 23:04:13.947392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.140 [2024-04-16 23:04:13.947557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.140 [2024-04-16 23:04:13.947584] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.140 qpair failed and we were unable to recover it. 00:26:23.140 [2024-04-16 23:04:13.947718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.140 [2024-04-16 23:04:13.947865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.140 [2024-04-16 23:04:13.947892] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.140 qpair failed and we were unable to recover it. 00:26:23.140 [2024-04-16 23:04:13.948040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.140 [2024-04-16 23:04:13.948197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.140 [2024-04-16 23:04:13.948225] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.140 qpair failed and we were unable to recover it. 00:26:23.140 [2024-04-16 23:04:13.948397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.140 [2024-04-16 23:04:13.948563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.140 [2024-04-16 23:04:13.948587] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.140 qpair failed and we were unable to recover it. 00:26:23.140 [2024-04-16 23:04:13.948753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.140 [2024-04-16 23:04:13.948908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.140 [2024-04-16 23:04:13.948936] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.140 qpair failed and we were unable to recover it. 00:26:23.140 [2024-04-16 23:04:13.949118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.140 [2024-04-16 23:04:13.949293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.140 [2024-04-16 23:04:13.949321] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.140 qpair failed and we were unable to recover it. 00:26:23.140 [2024-04-16 23:04:13.949444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.140 [2024-04-16 23:04:13.949594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.140 [2024-04-16 23:04:13.949621] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.140 qpair failed and we were unable to recover it. 00:26:23.140 [2024-04-16 23:04:13.949750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.140 [2024-04-16 23:04:13.949885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.140 [2024-04-16 23:04:13.949910] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.140 qpair failed and we were unable to recover it. 00:26:23.140 [2024-04-16 23:04:13.950064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.140 [2024-04-16 23:04:13.950189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.140 [2024-04-16 23:04:13.950218] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.140 qpair failed and we were unable to recover it. 00:26:23.140 [2024-04-16 23:04:13.950350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.140 [2024-04-16 23:04:13.950508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.140 [2024-04-16 23:04:13.950532] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.140 qpair failed and we were unable to recover it. 00:26:23.140 [2024-04-16 23:04:13.950671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.140 [2024-04-16 23:04:13.950830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.140 [2024-04-16 23:04:13.950859] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.140 qpair failed and we were unable to recover it. 00:26:23.140 [2024-04-16 23:04:13.951025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.140 [2024-04-16 23:04:13.951171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.140 [2024-04-16 23:04:13.951220] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.140 qpair failed and we were unable to recover it. 00:26:23.140 [2024-04-16 23:04:13.951347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.140 [2024-04-16 23:04:13.951502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.140 [2024-04-16 23:04:13.951529] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.140 qpair failed and we were unable to recover it. 00:26:23.140 [2024-04-16 23:04:13.951688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.140 [2024-04-16 23:04:13.951853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.140 [2024-04-16 23:04:13.951877] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.140 qpair failed and we were unable to recover it. 00:26:23.140 [2024-04-16 23:04:13.952049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.140 [2024-04-16 23:04:13.952222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.140 [2024-04-16 23:04:13.952251] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.140 qpair failed and we were unable to recover it. 00:26:23.140 [2024-04-16 23:04:13.952418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.140 [2024-04-16 23:04:13.952567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.140 [2024-04-16 23:04:13.952608] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.140 qpair failed and we were unable to recover it. 00:26:23.140 [2024-04-16 23:04:13.952791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.140 [2024-04-16 23:04:13.952972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.140 [2024-04-16 23:04:13.953009] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.140 qpair failed and we were unable to recover it. 00:26:23.140 [2024-04-16 23:04:13.953167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.140 [2024-04-16 23:04:13.953365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.140 [2024-04-16 23:04:13.953392] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.140 qpair failed and we were unable to recover it. 00:26:23.140 [2024-04-16 23:04:13.953539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.140 [2024-04-16 23:04:13.953693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.140 [2024-04-16 23:04:13.953721] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.140 qpair failed and we were unable to recover it. 00:26:23.140 [2024-04-16 23:04:13.953883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.140 [2024-04-16 23:04:13.954025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.140 [2024-04-16 23:04:13.954066] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.140 qpair failed and we were unable to recover it. 00:26:23.140 [2024-04-16 23:04:13.954202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.140 [2024-04-16 23:04:13.954394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.140 [2024-04-16 23:04:13.954419] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.140 qpair failed and we were unable to recover it. 00:26:23.140 [2024-04-16 23:04:13.954553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.140 [2024-04-16 23:04:13.954661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.140 [2024-04-16 23:04:13.954686] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.140 qpair failed and we were unable to recover it. 00:26:23.140 [2024-04-16 23:04:13.954800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.140 [2024-04-16 23:04:13.954910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.140 [2024-04-16 23:04:13.954935] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.140 qpair failed and we were unable to recover it. 00:26:23.140 [2024-04-16 23:04:13.955109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.140 [2024-04-16 23:04:13.955228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.140 [2024-04-16 23:04:13.955271] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.140 qpair failed and we were unable to recover it. 00:26:23.140 [2024-04-16 23:04:13.955416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.140 [2024-04-16 23:04:13.955581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.140 [2024-04-16 23:04:13.955606] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.140 qpair failed and we were unable to recover it. 00:26:23.140 [2024-04-16 23:04:13.955740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.140 [2024-04-16 23:04:13.955849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.140 [2024-04-16 23:04:13.955873] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.140 qpair failed and we were unable to recover it. 00:26:23.140 [2024-04-16 23:04:13.956013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.140 [2024-04-16 23:04:13.956148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.140 [2024-04-16 23:04:13.956173] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.140 qpair failed and we were unable to recover it. 00:26:23.140 [2024-04-16 23:04:13.956292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.140 [2024-04-16 23:04:13.956405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.140 [2024-04-16 23:04:13.956429] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.140 qpair failed and we were unable to recover it. 00:26:23.140 [2024-04-16 23:04:13.956560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.140 [2024-04-16 23:04:13.956698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.140 [2024-04-16 23:04:13.956722] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.140 qpair failed and we were unable to recover it. 00:26:23.140 [2024-04-16 23:04:13.956832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.140 [2024-04-16 23:04:13.956984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.140 [2024-04-16 23:04:13.957008] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.140 qpair failed and we were unable to recover it. 00:26:23.140 [2024-04-16 23:04:13.957184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.140 [2024-04-16 23:04:13.957308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.140 [2024-04-16 23:04:13.957335] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.140 qpair failed and we were unable to recover it. 00:26:23.140 [2024-04-16 23:04:13.957497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.140 [2024-04-16 23:04:13.957631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.140 [2024-04-16 23:04:13.957656] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.140 qpair failed and we were unable to recover it. 00:26:23.140 [2024-04-16 23:04:13.957791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.140 [2024-04-16 23:04:13.957970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.140 [2024-04-16 23:04:13.957998] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.140 qpair failed and we were unable to recover it. 00:26:23.140 [2024-04-16 23:04:13.958141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.140 [2024-04-16 23:04:13.958313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.140 [2024-04-16 23:04:13.958339] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.140 qpair failed and we were unable to recover it. 00:26:23.140 [2024-04-16 23:04:13.958512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.140 [2024-04-16 23:04:13.958679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.140 [2024-04-16 23:04:13.958706] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.140 qpair failed and we were unable to recover it. 00:26:23.140 [2024-04-16 23:04:13.958891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.140 [2024-04-16 23:04:13.959011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.141 [2024-04-16 23:04:13.959035] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.141 qpair failed and we were unable to recover it. 00:26:23.141 [2024-04-16 23:04:13.959241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.141 [2024-04-16 23:04:13.959360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.141 [2024-04-16 23:04:13.959385] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.141 qpair failed and we were unable to recover it. 00:26:23.141 [2024-04-16 23:04:13.959500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.141 [2024-04-16 23:04:13.959618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.141 [2024-04-16 23:04:13.959642] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.141 qpair failed and we were unable to recover it. 00:26:23.141 [2024-04-16 23:04:13.959807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.141 [2024-04-16 23:04:13.959966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.141 [2024-04-16 23:04:13.959990] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.141 qpair failed and we were unable to recover it. 00:26:23.141 [2024-04-16 23:04:13.960129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.141 [2024-04-16 23:04:13.960249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.141 [2024-04-16 23:04:13.960278] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.141 qpair failed and we were unable to recover it. 00:26:23.141 [2024-04-16 23:04:13.960478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.141 [2024-04-16 23:04:13.960618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.141 [2024-04-16 23:04:13.960643] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.141 qpair failed and we were unable to recover it. 00:26:23.141 [2024-04-16 23:04:13.960785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.141 [2024-04-16 23:04:13.960979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.141 [2024-04-16 23:04:13.961006] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.141 qpair failed and we were unable to recover it. 00:26:23.141 [2024-04-16 23:04:13.961131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.141 [2024-04-16 23:04:13.961260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.141 [2024-04-16 23:04:13.961289] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.141 qpair failed and we were unable to recover it. 00:26:23.141 [2024-04-16 23:04:13.961450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.141 [2024-04-16 23:04:13.961584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.141 [2024-04-16 23:04:13.961608] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.141 qpair failed and we were unable to recover it. 00:26:23.141 [2024-04-16 23:04:13.961776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.141 [2024-04-16 23:04:13.961953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.141 [2024-04-16 23:04:13.961980] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.141 qpair failed and we were unable to recover it. 00:26:23.141 [2024-04-16 23:04:13.962164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.141 [2024-04-16 23:04:13.962299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.141 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/target_disconnect.sh: line 44: 391847 Killed "${NVMF_APP[@]}" "$@" 00:26:23.141 [2024-04-16 23:04:13.962327] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.141 qpair failed and we were unable to recover it. 00:26:23.141 [2024-04-16 23:04:13.962450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.141 [2024-04-16 23:04:13.962572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.141 [2024-04-16 23:04:13.962600] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.141 qpair failed and we were unable to recover it. 00:26:23.141 23:04:13 -- host/target_disconnect.sh@56 -- # disconnect_init 10.0.0.2 00:26:23.141 [2024-04-16 23:04:13.962765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.141 23:04:13 -- host/target_disconnect.sh@17 -- # nvmfappstart -m 0xF0 00:26:23.141 [2024-04-16 23:04:13.962903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.141 23:04:13 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:26:23.141 [2024-04-16 23:04:13.962927] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.141 qpair failed and we were unable to recover it. 00:26:23.141 23:04:13 -- common/autotest_common.sh@712 -- # xtrace_disable 00:26:23.141 [2024-04-16 23:04:13.963100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.141 23:04:13 -- common/autotest_common.sh@10 -- # set +x 00:26:23.141 [2024-04-16 23:04:13.963212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.141 [2024-04-16 23:04:13.963241] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.141 qpair failed and we were unable to recover it. 00:26:23.141 [2024-04-16 23:04:13.963385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.141 [2024-04-16 23:04:13.963630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.141 [2024-04-16 23:04:13.963678] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.141 qpair failed and we were unable to recover it. 00:26:23.141 [2024-04-16 23:04:13.963814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.141 [2024-04-16 23:04:13.963954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.141 [2024-04-16 23:04:13.963978] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.141 qpair failed and we were unable to recover it. 00:26:23.141 [2024-04-16 23:04:13.964111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.141 [2024-04-16 23:04:13.964264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.141 [2024-04-16 23:04:13.964310] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.141 qpair failed and we were unable to recover it. 00:26:23.141 [2024-04-16 23:04:13.964438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.141 [2024-04-16 23:04:13.964592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.141 [2024-04-16 23:04:13.964619] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.141 qpair failed and we were unable to recover it. 00:26:23.141 [2024-04-16 23:04:13.964829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.141 [2024-04-16 23:04:13.964980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.141 [2024-04-16 23:04:13.965007] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.141 qpair failed and we were unable to recover it. 00:26:23.141 [2024-04-16 23:04:13.965214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.141 [2024-04-16 23:04:13.965337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.141 [2024-04-16 23:04:13.965367] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.141 qpair failed and we were unable to recover it. 00:26:23.141 [2024-04-16 23:04:13.965566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.141 [2024-04-16 23:04:13.965685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.141 [2024-04-16 23:04:13.965726] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.141 qpair failed and we were unable to recover it. 00:26:23.141 [2024-04-16 23:04:13.965855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.141 [2024-04-16 23:04:13.966006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.141 [2024-04-16 23:04:13.966033] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.141 qpair failed and we were unable to recover it. 00:26:23.141 [2024-04-16 23:04:13.966201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.141 [2024-04-16 23:04:13.966323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.141 [2024-04-16 23:04:13.966351] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.141 qpair failed and we were unable to recover it. 00:26:23.141 [2024-04-16 23:04:13.966511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.141 23:04:13 -- nvmf/common.sh@469 -- # nvmfpid=392433 00:26:23.141 [2024-04-16 23:04:13.966680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.141 23:04:13 -- nvmf/common.sh@470 -- # waitforlisten 392433 00:26:23.141 23:04:13 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF0 00:26:23.141 [2024-04-16 23:04:13.966708] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.141 qpair failed and we were unable to recover it. 00:26:23.141 [2024-04-16 23:04:13.966853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.141 23:04:13 -- common/autotest_common.sh@819 -- # '[' -z 392433 ']' 00:26:23.141 23:04:13 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk.sock 00:26:23.141 [2024-04-16 23:04:13.967039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.141 [2024-04-16 23:04:13.967066] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.141 qpair failed and we were unable to recover it. 00:26:23.141 23:04:13 -- common/autotest_common.sh@824 -- # local max_retries=100 00:26:23.141 [2024-04-16 23:04:13.967239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.141 23:04:13 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:26:23.141 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:26:23.141 [2024-04-16 23:04:13.967381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.141 23:04:13 -- common/autotest_common.sh@828 -- # xtrace_disable 00:26:23.141 [2024-04-16 23:04:13.967409] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.141 qpair failed and we were unable to recover it. 00:26:23.141 23:04:13 -- common/autotest_common.sh@10 -- # set +x 00:26:23.141 [2024-04-16 23:04:13.967569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.141 [2024-04-16 23:04:13.967724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.141 [2024-04-16 23:04:13.967751] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.141 qpair failed and we were unable to recover it. 00:26:23.141 [2024-04-16 23:04:13.967878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.141 [2024-04-16 23:04:13.968008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.141 [2024-04-16 23:04:13.968035] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.141 qpair failed and we were unable to recover it. 00:26:23.141 [2024-04-16 23:04:13.968180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.141 [2024-04-16 23:04:13.968351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.141 [2024-04-16 23:04:13.968378] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.141 qpair failed and we were unable to recover it. 00:26:23.141 [2024-04-16 23:04:13.968546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.141 [2024-04-16 23:04:13.968732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.141 [2024-04-16 23:04:13.968757] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.141 qpair failed and we were unable to recover it. 00:26:23.141 [2024-04-16 23:04:13.968914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.141 [2024-04-16 23:04:13.969047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.141 [2024-04-16 23:04:13.969073] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.141 qpair failed and we were unable to recover it. 00:26:23.141 [2024-04-16 23:04:13.969232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.141 [2024-04-16 23:04:13.969422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.141 [2024-04-16 23:04:13.969450] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.141 qpair failed and we were unable to recover it. 00:26:23.141 [2024-04-16 23:04:13.969640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.141 [2024-04-16 23:04:13.969793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.141 [2024-04-16 23:04:13.969821] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.141 qpair failed and we were unable to recover it. 00:26:23.141 [2024-04-16 23:04:13.969980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.141 [2024-04-16 23:04:13.973193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.141 [2024-04-16 23:04:13.973232] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.141 qpair failed and we were unable to recover it. 00:26:23.141 [2024-04-16 23:04:13.973413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.141 [2024-04-16 23:04:13.973616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.141 [2024-04-16 23:04:13.973647] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.141 qpair failed and we were unable to recover it. 00:26:23.141 [2024-04-16 23:04:13.973811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.141 [2024-04-16 23:04:13.973978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.141 [2024-04-16 23:04:13.974010] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.141 qpair failed and we were unable to recover it. 00:26:23.141 [2024-04-16 23:04:13.974189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.141 [2024-04-16 23:04:13.974338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.141 [2024-04-16 23:04:13.974365] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.141 qpair failed and we were unable to recover it. 00:26:23.141 [2024-04-16 23:04:13.974537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.141 [2024-04-16 23:04:13.974697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.141 [2024-04-16 23:04:13.974727] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.141 qpair failed and we were unable to recover it. 00:26:23.141 [2024-04-16 23:04:13.974889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.141 [2024-04-16 23:04:13.975026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.141 [2024-04-16 23:04:13.975055] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.141 qpair failed and we were unable to recover it. 00:26:23.141 [2024-04-16 23:04:13.975210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.141 [2024-04-16 23:04:13.975399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.141 [2024-04-16 23:04:13.975426] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.141 qpair failed and we were unable to recover it. 00:26:23.141 [2024-04-16 23:04:13.975570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.141 [2024-04-16 23:04:13.975722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.141 [2024-04-16 23:04:13.975750] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.141 qpair failed and we were unable to recover it. 00:26:23.141 [2024-04-16 23:04:13.975898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.141 [2024-04-16 23:04:13.976087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.141 [2024-04-16 23:04:13.976119] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.141 qpair failed and we were unable to recover it. 00:26:23.141 [2024-04-16 23:04:13.976302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.141 [2024-04-16 23:04:13.976433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.141 [2024-04-16 23:04:13.976465] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.141 qpair failed and we were unable to recover it. 00:26:23.141 [2024-04-16 23:04:13.976625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.141 [2024-04-16 23:04:13.976809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.141 [2024-04-16 23:04:13.976838] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.141 qpair failed and we were unable to recover it. 00:26:23.141 [2024-04-16 23:04:13.976996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.141 [2024-04-16 23:04:13.977149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.141 [2024-04-16 23:04:13.977184] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.141 qpair failed and we were unable to recover it. 00:26:23.141 [2024-04-16 23:04:13.977325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.141 [2024-04-16 23:04:13.977496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.141 [2024-04-16 23:04:13.977533] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.141 qpair failed and we were unable to recover it. 00:26:23.141 [2024-04-16 23:04:13.977698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.141 [2024-04-16 23:04:13.977822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.141 [2024-04-16 23:04:13.977850] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.141 qpair failed and we were unable to recover it. 00:26:23.141 [2024-04-16 23:04:13.977986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.141 [2024-04-16 23:04:13.978146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.142 [2024-04-16 23:04:13.978184] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.142 qpair failed and we were unable to recover it. 00:26:23.142 [2024-04-16 23:04:13.978350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.142 [2024-04-16 23:04:13.978483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.142 [2024-04-16 23:04:13.978511] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.142 qpair failed and we were unable to recover it. 00:26:23.142 [2024-04-16 23:04:13.978674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.142 [2024-04-16 23:04:13.978834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.142 [2024-04-16 23:04:13.978863] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.142 qpair failed and we were unable to recover it. 00:26:23.142 [2024-04-16 23:04:13.978990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.142 [2024-04-16 23:04:13.979156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.142 [2024-04-16 23:04:13.979199] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.142 qpair failed and we were unable to recover it. 00:26:23.142 [2024-04-16 23:04:13.979357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.142 [2024-04-16 23:04:13.979492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.142 [2024-04-16 23:04:13.979521] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.142 qpair failed and we were unable to recover it. 00:26:23.142 [2024-04-16 23:04:13.979698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.142 [2024-04-16 23:04:13.979822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.142 [2024-04-16 23:04:13.979866] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.142 qpair failed and we were unable to recover it. 00:26:23.142 [2024-04-16 23:04:13.981622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.142 [2024-04-16 23:04:13.981812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.142 [2024-04-16 23:04:13.981861] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.142 qpair failed and we were unable to recover it. 00:26:23.142 [2024-04-16 23:04:13.982064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.142 [2024-04-16 23:04:13.982186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.142 [2024-04-16 23:04:13.982213] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.142 qpair failed and we were unable to recover it. 00:26:23.142 [2024-04-16 23:04:13.982323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.142 [2024-04-16 23:04:13.982460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.142 [2024-04-16 23:04:13.982485] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.142 qpair failed and we were unable to recover it. 00:26:23.142 [2024-04-16 23:04:13.982631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.142 [2024-04-16 23:04:13.982775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.142 [2024-04-16 23:04:13.982799] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.142 qpair failed and we were unable to recover it. 00:26:23.142 [2024-04-16 23:04:13.982942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.142 [2024-04-16 23:04:13.983116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.142 [2024-04-16 23:04:13.983141] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.142 qpair failed and we were unable to recover it. 00:26:23.142 [2024-04-16 23:04:13.983289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.142 [2024-04-16 23:04:13.983434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.142 [2024-04-16 23:04:13.983459] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.142 qpair failed and we were unable to recover it. 00:26:23.142 [2024-04-16 23:04:13.983577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.142 [2024-04-16 23:04:13.983744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.142 [2024-04-16 23:04:13.983768] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.142 qpair failed and we were unable to recover it. 00:26:23.142 [2024-04-16 23:04:13.983937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.142 [2024-04-16 23:04:13.984069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.142 [2024-04-16 23:04:13.984096] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.142 qpair failed and we were unable to recover it. 00:26:23.142 [2024-04-16 23:04:13.984261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.142 [2024-04-16 23:04:13.984384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.142 [2024-04-16 23:04:13.984409] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.142 qpair failed and we were unable to recover it. 00:26:23.142 [2024-04-16 23:04:13.984558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.142 [2024-04-16 23:04:13.984698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.142 [2024-04-16 23:04:13.984727] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.142 qpair failed and we were unable to recover it. 00:26:23.142 [2024-04-16 23:04:13.984867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.142 [2024-04-16 23:04:13.984985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.142 [2024-04-16 23:04:13.985009] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.142 qpair failed and we were unable to recover it. 00:26:23.142 [2024-04-16 23:04:13.985125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.142 [2024-04-16 23:04:13.985253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.142 [2024-04-16 23:04:13.985278] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.142 qpair failed and we were unable to recover it. 00:26:23.142 [2024-04-16 23:04:13.985432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.142 [2024-04-16 23:04:13.985552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.142 [2024-04-16 23:04:13.985578] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.142 qpair failed and we were unable to recover it. 00:26:23.142 [2024-04-16 23:04:13.985717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.142 [2024-04-16 23:04:13.985869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.142 [2024-04-16 23:04:13.985894] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.142 qpair failed and we were unable to recover it. 00:26:23.142 [2024-04-16 23:04:13.986035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.142 [2024-04-16 23:04:13.986153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.142 [2024-04-16 23:04:13.986185] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.142 qpair failed and we were unable to recover it. 00:26:23.142 [2024-04-16 23:04:13.986332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.142 [2024-04-16 23:04:13.986475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.142 [2024-04-16 23:04:13.986499] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.142 qpair failed and we were unable to recover it. 00:26:23.142 [2024-04-16 23:04:13.986622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.142 [2024-04-16 23:04:13.986768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.142 [2024-04-16 23:04:13.986792] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.142 qpair failed and we were unable to recover it. 00:26:23.142 [2024-04-16 23:04:13.986910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.142 [2024-04-16 23:04:13.987051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.142 [2024-04-16 23:04:13.987077] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.142 qpair failed and we were unable to recover it. 00:26:23.142 [2024-04-16 23:04:13.987217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.142 [2024-04-16 23:04:13.987367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.142 [2024-04-16 23:04:13.987392] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.142 qpair failed and we were unable to recover it. 00:26:23.142 [2024-04-16 23:04:13.987525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.142 [2024-04-16 23:04:13.987701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.142 [2024-04-16 23:04:13.987729] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.142 qpair failed and we were unable to recover it. 00:26:23.142 [2024-04-16 23:04:13.987898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.142 [2024-04-16 23:04:13.988035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.142 [2024-04-16 23:04:13.988060] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.142 qpair failed and we were unable to recover it. 00:26:23.142 [2024-04-16 23:04:13.988173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.142 [2024-04-16 23:04:13.988324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.142 [2024-04-16 23:04:13.988348] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.142 qpair failed and we were unable to recover it. 00:26:23.142 [2024-04-16 23:04:13.988492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.142 [2024-04-16 23:04:13.988672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.142 [2024-04-16 23:04:13.988699] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.142 qpair failed and we were unable to recover it. 00:26:23.142 [2024-04-16 23:04:13.988845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.142 [2024-04-16 23:04:13.988977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.142 [2024-04-16 23:04:13.989001] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.142 qpair failed and we were unable to recover it. 00:26:23.142 [2024-04-16 23:04:13.989117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.142 [2024-04-16 23:04:13.989241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.142 [2024-04-16 23:04:13.989270] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.142 qpair failed and we were unable to recover it. 00:26:23.142 [2024-04-16 23:04:13.989393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.142 [2024-04-16 23:04:13.989557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.142 [2024-04-16 23:04:13.989583] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.142 qpair failed and we were unable to recover it. 00:26:23.142 [2024-04-16 23:04:13.989722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.142 [2024-04-16 23:04:13.989850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.142 [2024-04-16 23:04:13.989875] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.142 qpair failed and we were unable to recover it. 00:26:23.142 [2024-04-16 23:04:13.990049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.142 [2024-04-16 23:04:13.990159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.142 [2024-04-16 23:04:13.990191] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.142 qpair failed and we were unable to recover it. 00:26:23.142 [2024-04-16 23:04:13.990311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.142 [2024-04-16 23:04:13.990480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.142 [2024-04-16 23:04:13.990505] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.142 qpair failed and we were unable to recover it. 00:26:23.142 [2024-04-16 23:04:13.990636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.142 [2024-04-16 23:04:13.990748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.142 [2024-04-16 23:04:13.990772] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.142 qpair failed and we were unable to recover it. 00:26:23.142 [2024-04-16 23:04:13.990921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.142 [2024-04-16 23:04:13.991087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.142 [2024-04-16 23:04:13.991112] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.142 qpair failed and we were unable to recover it. 00:26:23.142 [2024-04-16 23:04:13.991239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.142 [2024-04-16 23:04:13.991384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.142 [2024-04-16 23:04:13.991408] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.142 qpair failed and we were unable to recover it. 00:26:23.142 [2024-04-16 23:04:13.991540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.142 [2024-04-16 23:04:13.991707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.142 [2024-04-16 23:04:13.991732] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.142 qpair failed and we were unable to recover it. 00:26:23.142 [2024-04-16 23:04:13.991873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.142 [2024-04-16 23:04:13.992014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.142 [2024-04-16 23:04:13.992038] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.142 qpair failed and we were unable to recover it. 00:26:23.142 [2024-04-16 23:04:13.992208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.142 [2024-04-16 23:04:13.992329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.142 [2024-04-16 23:04:13.992353] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.142 qpair failed and we were unable to recover it. 00:26:23.142 [2024-04-16 23:04:13.992529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.142 [2024-04-16 23:04:13.992666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.142 [2024-04-16 23:04:13.992691] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.142 qpair failed and we were unable to recover it. 00:26:23.142 [2024-04-16 23:04:13.992801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.143 [2024-04-16 23:04:13.992947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.143 [2024-04-16 23:04:13.992972] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.143 qpair failed and we were unable to recover it. 00:26:23.143 [2024-04-16 23:04:13.993117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.143 [2024-04-16 23:04:13.993236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.143 [2024-04-16 23:04:13.993261] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.143 qpair failed and we were unable to recover it. 00:26:23.143 [2024-04-16 23:04:13.993404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.143 [2024-04-16 23:04:13.993514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.143 [2024-04-16 23:04:13.993539] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.143 qpair failed and we were unable to recover it. 00:26:23.143 [2024-04-16 23:04:13.993656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.143 [2024-04-16 23:04:13.993795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.143 [2024-04-16 23:04:13.993820] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.143 qpair failed and we were unable to recover it. 00:26:23.143 [2024-04-16 23:04:13.993934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.143 [2024-04-16 23:04:13.994049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.143 [2024-04-16 23:04:13.994073] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.143 qpair failed and we were unable to recover it. 00:26:23.143 [2024-04-16 23:04:13.994221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.143 [2024-04-16 23:04:13.994363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.143 [2024-04-16 23:04:13.994387] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.143 qpair failed and we were unable to recover it. 00:26:23.143 [2024-04-16 23:04:13.994538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.143 [2024-04-16 23:04:13.994680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.143 [2024-04-16 23:04:13.994704] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.143 qpair failed and we were unable to recover it. 00:26:23.143 [2024-04-16 23:04:13.994863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.143 [2024-04-16 23:04:13.994971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.143 [2024-04-16 23:04:13.994996] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.143 qpair failed and we were unable to recover it. 00:26:23.143 [2024-04-16 23:04:13.995111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.143 [2024-04-16 23:04:13.995241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.143 [2024-04-16 23:04:13.995267] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.143 qpair failed and we were unable to recover it. 00:26:23.143 [2024-04-16 23:04:13.995450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.143 [2024-04-16 23:04:13.995560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.143 [2024-04-16 23:04:13.995585] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.143 qpair failed and we were unable to recover it. 00:26:23.143 [2024-04-16 23:04:13.995727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.143 [2024-04-16 23:04:13.995868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.143 [2024-04-16 23:04:13.995893] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.143 qpair failed and we were unable to recover it. 00:26:23.143 [2024-04-16 23:04:13.996064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.143 [2024-04-16 23:04:13.996205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.143 [2024-04-16 23:04:13.996230] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.143 qpair failed and we were unable to recover it. 00:26:23.143 [2024-04-16 23:04:13.996347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.143 [2024-04-16 23:04:13.996486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.143 [2024-04-16 23:04:13.996510] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.143 qpair failed and we were unable to recover it. 00:26:23.143 [2024-04-16 23:04:13.996645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.143 [2024-04-16 23:04:13.996778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.143 [2024-04-16 23:04:13.996803] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.143 qpair failed and we were unable to recover it. 00:26:23.143 [2024-04-16 23:04:13.996911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.143 [2024-04-16 23:04:13.997028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.143 [2024-04-16 23:04:13.997053] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.143 qpair failed and we were unable to recover it. 00:26:23.143 [2024-04-16 23:04:13.997165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.143 [2024-04-16 23:04:13.997307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.143 [2024-04-16 23:04:13.997332] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.143 qpair failed and we were unable to recover it. 00:26:23.143 [2024-04-16 23:04:13.997447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.143 [2024-04-16 23:04:13.997583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.143 [2024-04-16 23:04:13.997608] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.143 qpair failed and we were unable to recover it. 00:26:23.143 [2024-04-16 23:04:13.997754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.143 [2024-04-16 23:04:13.997871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.143 [2024-04-16 23:04:13.997898] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.143 qpair failed and we were unable to recover it. 00:26:23.143 [2024-04-16 23:04:13.998045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.143 [2024-04-16 23:04:13.998155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.143 [2024-04-16 23:04:13.998187] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.143 qpair failed and we were unable to recover it. 00:26:23.143 [2024-04-16 23:04:13.998337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.143 [2024-04-16 23:04:13.998481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.143 [2024-04-16 23:04:13.998506] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.143 qpair failed and we were unable to recover it. 00:26:23.143 [2024-04-16 23:04:13.998648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.143 [2024-04-16 23:04:13.998765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.143 [2024-04-16 23:04:13.998789] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.143 qpair failed and we were unable to recover it. 00:26:23.143 [2024-04-16 23:04:13.998905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.143 [2024-04-16 23:04:13.999043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.143 [2024-04-16 23:04:13.999067] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.143 qpair failed and we were unable to recover it. 00:26:23.143 [2024-04-16 23:04:13.999215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.143 [2024-04-16 23:04:13.999361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.143 [2024-04-16 23:04:13.999386] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.143 qpair failed and we were unable to recover it. 00:26:23.143 [2024-04-16 23:04:13.999502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.143 [2024-04-16 23:04:13.999628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.143 [2024-04-16 23:04:13.999653] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.143 qpair failed and we were unable to recover it. 00:26:23.143 [2024-04-16 23:04:13.999792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.143 [2024-04-16 23:04:13.999937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.143 [2024-04-16 23:04:13.999962] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.143 qpair failed and we were unable to recover it. 00:26:23.143 [2024-04-16 23:04:14.000097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.143 [2024-04-16 23:04:14.000269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.143 [2024-04-16 23:04:14.000295] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.143 qpair failed and we were unable to recover it. 00:26:23.143 [2024-04-16 23:04:14.000415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.143 [2024-04-16 23:04:14.000567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.143 [2024-04-16 23:04:14.000592] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.143 qpair failed and we were unable to recover it. 00:26:23.143 [2024-04-16 23:04:14.000707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.143 [2024-04-16 23:04:14.000825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.143 [2024-04-16 23:04:14.000849] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.143 qpair failed and we were unable to recover it. 00:26:23.143 [2024-04-16 23:04:14.000990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.143 [2024-04-16 23:04:14.001128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.143 [2024-04-16 23:04:14.001153] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.143 qpair failed and we were unable to recover it. 00:26:23.143 [2024-04-16 23:04:14.001329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.143 [2024-04-16 23:04:14.001468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.143 [2024-04-16 23:04:14.001492] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.143 qpair failed and we were unable to recover it. 00:26:23.143 [2024-04-16 23:04:14.001608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.143 [2024-04-16 23:04:14.001756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.143 [2024-04-16 23:04:14.001782] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.143 qpair failed and we were unable to recover it. 00:26:23.143 [2024-04-16 23:04:14.001926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.143 [2024-04-16 23:04:14.002041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.143 [2024-04-16 23:04:14.002066] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.143 qpair failed and we were unable to recover it. 00:26:23.143 [2024-04-16 23:04:14.002214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.143 [2024-04-16 23:04:14.002363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.143 [2024-04-16 23:04:14.002388] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.143 qpair failed and we were unable to recover it. 00:26:23.143 [2024-04-16 23:04:14.002544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.143 [2024-04-16 23:04:14.002689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.143 [2024-04-16 23:04:14.002714] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.143 qpair failed and we were unable to recover it. 00:26:23.143 [2024-04-16 23:04:14.002834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.143 [2024-04-16 23:04:14.002973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.143 [2024-04-16 23:04:14.003002] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.143 qpair failed and we were unable to recover it. 00:26:23.143 [2024-04-16 23:04:14.003130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.143 [2024-04-16 23:04:14.003300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.143 [2024-04-16 23:04:14.003326] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.143 qpair failed and we were unable to recover it. 00:26:23.143 [2024-04-16 23:04:14.003439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.143 [2024-04-16 23:04:14.003586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.143 [2024-04-16 23:04:14.003611] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.143 qpair failed and we were unable to recover it. 00:26:23.143 [2024-04-16 23:04:14.003736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.143 [2024-04-16 23:04:14.003856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.143 [2024-04-16 23:04:14.003881] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.143 qpair failed and we were unable to recover it. 00:26:23.143 [2024-04-16 23:04:14.003998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.143 [2024-04-16 23:04:14.004135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.143 [2024-04-16 23:04:14.004160] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.143 qpair failed and we were unable to recover it. 00:26:23.143 [2024-04-16 23:04:14.004299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.143 [2024-04-16 23:04:14.004467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.143 [2024-04-16 23:04:14.004492] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.143 qpair failed and we were unable to recover it. 00:26:23.143 [2024-04-16 23:04:14.004608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.143 [2024-04-16 23:04:14.004766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.143 [2024-04-16 23:04:14.004790] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.143 qpair failed and we were unable to recover it. 00:26:23.143 [2024-04-16 23:04:14.004961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.143 [2024-04-16 23:04:14.005074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.143 [2024-04-16 23:04:14.005099] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.143 qpair failed and we were unable to recover it. 00:26:23.143 [2024-04-16 23:04:14.005279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.143 [2024-04-16 23:04:14.005419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.143 [2024-04-16 23:04:14.005444] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.143 qpair failed and we were unable to recover it. 00:26:23.143 [2024-04-16 23:04:14.005587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.143 [2024-04-16 23:04:14.005756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.143 [2024-04-16 23:04:14.005780] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.143 qpair failed and we were unable to recover it. 00:26:23.143 [2024-04-16 23:04:14.005904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.143 [2024-04-16 23:04:14.006026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.143 [2024-04-16 23:04:14.006051] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.143 qpair failed and we were unable to recover it. 00:26:23.143 [2024-04-16 23:04:14.006183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.143 [2024-04-16 23:04:14.006318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.143 [2024-04-16 23:04:14.006343] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.143 qpair failed and we were unable to recover it. 00:26:23.143 [2024-04-16 23:04:14.006464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.143 [2024-04-16 23:04:14.006579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.143 [2024-04-16 23:04:14.006604] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.143 qpair failed and we were unable to recover it. 00:26:23.143 [2024-04-16 23:04:14.006757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.143 [2024-04-16 23:04:14.006873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.143 [2024-04-16 23:04:14.006898] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.143 qpair failed and we were unable to recover it. 00:26:23.143 [2024-04-16 23:04:14.007029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.143 [2024-04-16 23:04:14.007142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.143 [2024-04-16 23:04:14.007168] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.143 qpair failed and we were unable to recover it. 00:26:23.143 [2024-04-16 23:04:14.007291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.143 [2024-04-16 23:04:14.007438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.143 [2024-04-16 23:04:14.007463] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.143 qpair failed and we were unable to recover it. 00:26:23.144 [2024-04-16 23:04:14.007574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.144 [2024-04-16 23:04:14.007739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.144 [2024-04-16 23:04:14.007764] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.144 qpair failed and we were unable to recover it. 00:26:23.144 [2024-04-16 23:04:14.007907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.144 [2024-04-16 23:04:14.008045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.144 [2024-04-16 23:04:14.008070] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.144 qpair failed and we were unable to recover it. 00:26:23.144 [2024-04-16 23:04:14.008215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.144 [2024-04-16 23:04:14.008350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.144 [2024-04-16 23:04:14.008375] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.144 qpair failed and we were unable to recover it. 00:26:23.144 [2024-04-16 23:04:14.008446] Starting SPDK v24.01.1-pre git sha1 4b134b4ab / DPDK 23.11.0 initialization... 00:26:23.144 [2024-04-16 23:04:14.008483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.144 [2024-04-16 23:04:14.008520] [ DPDK EAL parameters: nvmf -c 0xF0 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:26:23.144 [2024-04-16 23:04:14.008585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.144 [2024-04-16 23:04:14.008609] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.144 qpair failed and we were unable to recover it. 00:26:23.144 [2024-04-16 23:04:14.008755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.144 [2024-04-16 23:04:14.008888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.144 [2024-04-16 23:04:14.008912] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.144 qpair failed and we were unable to recover it. 00:26:23.144 [2024-04-16 23:04:14.009073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.144 [2024-04-16 23:04:14.009220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.144 [2024-04-16 23:04:14.009246] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.144 qpair failed and we were unable to recover it. 00:26:23.144 [2024-04-16 23:04:14.009369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.144 [2024-04-16 23:04:14.009480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.144 [2024-04-16 23:04:14.009505] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.144 qpair failed and we were unable to recover it. 00:26:23.144 [2024-04-16 23:04:14.009623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.144 [2024-04-16 23:04:14.009781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.144 [2024-04-16 23:04:14.009806] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.144 qpair failed and we were unable to recover it. 00:26:23.144 [2024-04-16 23:04:14.009940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.144 [2024-04-16 23:04:14.010047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.144 [2024-04-16 23:04:14.010072] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.144 qpair failed and we were unable to recover it. 00:26:23.144 [2024-04-16 23:04:14.010197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.144 [2024-04-16 23:04:14.010315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.144 [2024-04-16 23:04:14.010340] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.144 qpair failed and we were unable to recover it. 00:26:23.144 [2024-04-16 23:04:14.010486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.144 [2024-04-16 23:04:14.010605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.144 [2024-04-16 23:04:14.010632] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.144 qpair failed and we were unable to recover it. 00:26:23.144 [2024-04-16 23:04:14.010771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.144 [2024-04-16 23:04:14.010944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.144 [2024-04-16 23:04:14.010969] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.144 qpair failed and we were unable to recover it. 00:26:23.144 [2024-04-16 23:04:14.011106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.144 [2024-04-16 23:04:14.011233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.144 [2024-04-16 23:04:14.011259] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.144 qpair failed and we were unable to recover it. 00:26:23.144 [2024-04-16 23:04:14.011369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.144 [2024-04-16 23:04:14.011483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.144 [2024-04-16 23:04:14.011508] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.144 qpair failed and we were unable to recover it. 00:26:23.144 [2024-04-16 23:04:14.011682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.144 [2024-04-16 23:04:14.011820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.144 [2024-04-16 23:04:14.011845] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.144 qpair failed and we were unable to recover it. 00:26:23.144 [2024-04-16 23:04:14.011982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.144 [2024-04-16 23:04:14.012092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.144 [2024-04-16 23:04:14.012123] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.144 qpair failed and we were unable to recover it. 00:26:23.144 [2024-04-16 23:04:14.012236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.144 [2024-04-16 23:04:14.012387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.144 [2024-04-16 23:04:14.012413] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.144 qpair failed and we were unable to recover it. 00:26:23.144 [2024-04-16 23:04:14.012552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.144 [2024-04-16 23:04:14.012660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.144 [2024-04-16 23:04:14.012685] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.144 qpair failed and we were unable to recover it. 00:26:23.144 [2024-04-16 23:04:14.012817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.144 [2024-04-16 23:04:14.012952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.144 [2024-04-16 23:04:14.012977] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.144 qpair failed and we were unable to recover it. 00:26:23.144 [2024-04-16 23:04:14.013090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.144 [2024-04-16 23:04:14.013229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.144 [2024-04-16 23:04:14.013255] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.144 qpair failed and we were unable to recover it. 00:26:23.144 [2024-04-16 23:04:14.013390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.144 [2024-04-16 23:04:14.013513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.144 [2024-04-16 23:04:14.013538] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.144 qpair failed and we were unable to recover it. 00:26:23.144 [2024-04-16 23:04:14.013702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.144 [2024-04-16 23:04:14.013869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.144 [2024-04-16 23:04:14.013893] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.144 qpair failed and we were unable to recover it. 00:26:23.144 [2024-04-16 23:04:14.014028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.144 [2024-04-16 23:04:14.014183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.144 [2024-04-16 23:04:14.014208] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.144 qpair failed and we were unable to recover it. 00:26:23.144 [2024-04-16 23:04:14.014348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.144 [2024-04-16 23:04:14.014465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.144 [2024-04-16 23:04:14.014491] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.144 qpair failed and we were unable to recover it. 00:26:23.144 [2024-04-16 23:04:14.014630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.144 [2024-04-16 23:04:14.014741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.144 [2024-04-16 23:04:14.014770] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.144 qpair failed and we were unable to recover it. 00:26:23.144 [2024-04-16 23:04:14.014935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.144 [2024-04-16 23:04:14.015078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.144 [2024-04-16 23:04:14.015104] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.144 qpair failed and we were unable to recover it. 00:26:23.144 [2024-04-16 23:04:14.015267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.144 [2024-04-16 23:04:14.015437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.144 [2024-04-16 23:04:14.015462] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.144 qpair failed and we were unable to recover it. 00:26:23.144 [2024-04-16 23:04:14.015610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.144 [2024-04-16 23:04:14.015752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.144 [2024-04-16 23:04:14.015779] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.144 qpair failed and we were unable to recover it. 00:26:23.144 [2024-04-16 23:04:14.015950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.144 [2024-04-16 23:04:14.016085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.144 [2024-04-16 23:04:14.016110] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.144 qpair failed and we were unable to recover it. 00:26:23.144 [2024-04-16 23:04:14.016274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.144 [2024-04-16 23:04:14.016405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.144 [2024-04-16 23:04:14.016430] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.144 qpair failed and we were unable to recover it. 00:26:23.144 [2024-04-16 23:04:14.016587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.144 [2024-04-16 23:04:14.016750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.144 [2024-04-16 23:04:14.016775] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.144 qpair failed and we were unable to recover it. 00:26:23.144 [2024-04-16 23:04:14.016911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.144 [2024-04-16 23:04:14.017019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.144 [2024-04-16 23:04:14.017045] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.144 qpair failed and we were unable to recover it. 00:26:23.144 [2024-04-16 23:04:14.017155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.144 [2024-04-16 23:04:14.017276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.144 [2024-04-16 23:04:14.017301] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.144 qpair failed and we were unable to recover it. 00:26:23.144 [2024-04-16 23:04:14.017473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.144 [2024-04-16 23:04:14.017581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.144 [2024-04-16 23:04:14.017606] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.144 qpair failed and we were unable to recover it. 00:26:23.144 [2024-04-16 23:04:14.017744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.144 [2024-04-16 23:04:14.017890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.144 [2024-04-16 23:04:14.017919] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.144 qpair failed and we were unable to recover it. 00:26:23.144 [2024-04-16 23:04:14.018033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.144 [2024-04-16 23:04:14.018201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.144 [2024-04-16 23:04:14.018226] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.144 qpair failed and we were unable to recover it. 00:26:23.144 [2024-04-16 23:04:14.018371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.144 [2024-04-16 23:04:14.018537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.144 [2024-04-16 23:04:14.018563] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.144 qpair failed and we were unable to recover it. 00:26:23.144 [2024-04-16 23:04:14.018723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.144 [2024-04-16 23:04:14.018867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.144 [2024-04-16 23:04:14.018892] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.144 qpair failed and we were unable to recover it. 00:26:23.144 [2024-04-16 23:04:14.019004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.144 [2024-04-16 23:04:14.019113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.144 [2024-04-16 23:04:14.019137] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.144 qpair failed and we were unable to recover it. 00:26:23.144 [2024-04-16 23:04:14.019261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.144 [2024-04-16 23:04:14.019369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.144 [2024-04-16 23:04:14.019393] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.145 qpair failed and we were unable to recover it. 00:26:23.145 [2024-04-16 23:04:14.019542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.145 [2024-04-16 23:04:14.019674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.145 [2024-04-16 23:04:14.019699] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.145 qpair failed and we were unable to recover it. 00:26:23.145 [2024-04-16 23:04:14.019841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.145 [2024-04-16 23:04:14.019982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.145 [2024-04-16 23:04:14.020006] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.145 qpair failed and we were unable to recover it. 00:26:23.145 [2024-04-16 23:04:14.020146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.145 [2024-04-16 23:04:14.020333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.145 [2024-04-16 23:04:14.020359] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.145 qpair failed and we were unable to recover it. 00:26:23.145 [2024-04-16 23:04:14.020498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.145 [2024-04-16 23:04:14.020605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.145 [2024-04-16 23:04:14.020632] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.145 qpair failed and we were unable to recover it. 00:26:23.145 [2024-04-16 23:04:14.020750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.145 [2024-04-16 23:04:14.020889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.145 [2024-04-16 23:04:14.020913] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.145 qpair failed and we were unable to recover it. 00:26:23.145 [2024-04-16 23:04:14.021059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.145 [2024-04-16 23:04:14.021227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.145 [2024-04-16 23:04:14.021254] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.145 qpair failed and we were unable to recover it. 00:26:23.145 [2024-04-16 23:04:14.021399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.145 [2024-04-16 23:04:14.021515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.145 [2024-04-16 23:04:14.021539] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.145 qpair failed and we were unable to recover it. 00:26:23.145 [2024-04-16 23:04:14.021652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.145 [2024-04-16 23:04:14.021759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.145 [2024-04-16 23:04:14.021784] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.145 qpair failed and we were unable to recover it. 00:26:23.145 [2024-04-16 23:04:14.021887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.145 [2024-04-16 23:04:14.022004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.145 [2024-04-16 23:04:14.022030] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.145 qpair failed and we were unable to recover it. 00:26:23.145 [2024-04-16 23:04:14.022185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.145 [2024-04-16 23:04:14.022296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.145 [2024-04-16 23:04:14.022321] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.145 qpair failed and we were unable to recover it. 00:26:23.145 [2024-04-16 23:04:14.022425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.145 [2024-04-16 23:04:14.022559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.145 [2024-04-16 23:04:14.022583] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.145 qpair failed and we were unable to recover it. 00:26:23.145 [2024-04-16 23:04:14.022734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.145 [2024-04-16 23:04:14.022867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.146 [2024-04-16 23:04:14.022892] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.146 qpair failed and we were unable to recover it. 00:26:23.146 [2024-04-16 23:04:14.023061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.146 [2024-04-16 23:04:14.023181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.146 [2024-04-16 23:04:14.023207] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.146 qpair failed and we were unable to recover it. 00:26:23.146 [2024-04-16 23:04:14.023313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.146 [2024-04-16 23:04:14.023447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.146 [2024-04-16 23:04:14.023480] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.146 qpair failed and we were unable to recover it. 00:26:23.146 [2024-04-16 23:04:14.023594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.146 [2024-04-16 23:04:14.023707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.146 [2024-04-16 23:04:14.023732] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.146 qpair failed and we were unable to recover it. 00:26:23.146 [2024-04-16 23:04:14.023879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.146 [2024-04-16 23:04:14.024009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.146 [2024-04-16 23:04:14.024034] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.146 qpair failed and we were unable to recover it. 00:26:23.146 [2024-04-16 23:04:14.024182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.146 [2024-04-16 23:04:14.024295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.146 [2024-04-16 23:04:14.024320] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.146 qpair failed and we were unable to recover it. 00:26:23.146 [2024-04-16 23:04:14.024425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.146 [2024-04-16 23:04:14.024543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.146 [2024-04-16 23:04:14.024569] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.146 qpair failed and we were unable to recover it. 00:26:23.146 [2024-04-16 23:04:14.024680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.146 [2024-04-16 23:04:14.024848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.146 [2024-04-16 23:04:14.024873] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.146 qpair failed and we were unable to recover it. 00:26:23.146 [2024-04-16 23:04:14.024982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.146 [2024-04-16 23:04:14.025088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.146 [2024-04-16 23:04:14.025114] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.146 qpair failed and we were unable to recover it. 00:26:23.146 [2024-04-16 23:04:14.025254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.146 [2024-04-16 23:04:14.025361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.146 [2024-04-16 23:04:14.025386] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.146 qpair failed and we were unable to recover it. 00:26:23.146 [2024-04-16 23:04:14.025491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.146 [2024-04-16 23:04:14.025602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.146 [2024-04-16 23:04:14.025627] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.146 qpair failed and we were unable to recover it. 00:26:23.146 [2024-04-16 23:04:14.025793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.146 [2024-04-16 23:04:14.025926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.146 [2024-04-16 23:04:14.025950] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.146 qpair failed and we were unable to recover it. 00:26:23.146 [2024-04-16 23:04:14.026092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.146 [2024-04-16 23:04:14.026227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.146 [2024-04-16 23:04:14.026256] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.146 qpair failed and we were unable to recover it. 00:26:23.146 [2024-04-16 23:04:14.026368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.146 [2024-04-16 23:04:14.026502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.146 [2024-04-16 23:04:14.026527] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.146 qpair failed and we were unable to recover it. 00:26:23.146 [2024-04-16 23:04:14.026655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.146 [2024-04-16 23:04:14.026799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.146 [2024-04-16 23:04:14.026823] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.146 qpair failed and we were unable to recover it. 00:26:23.146 [2024-04-16 23:04:14.026965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.146 [2024-04-16 23:04:14.027103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.146 [2024-04-16 23:04:14.027128] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.146 qpair failed and we were unable to recover it. 00:26:23.146 [2024-04-16 23:04:14.027256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.146 [2024-04-16 23:04:14.027364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.146 [2024-04-16 23:04:14.027389] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.146 qpair failed and we were unable to recover it. 00:26:23.146 [2024-04-16 23:04:14.027537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.146 [2024-04-16 23:04:14.027637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.146 [2024-04-16 23:04:14.027665] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.146 qpair failed and we were unable to recover it. 00:26:23.146 [2024-04-16 23:04:14.027774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.146 [2024-04-16 23:04:14.027876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.146 [2024-04-16 23:04:14.027900] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.146 qpair failed and we were unable to recover it. 00:26:23.146 [2024-04-16 23:04:14.028051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.146 [2024-04-16 23:04:14.028164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.146 [2024-04-16 23:04:14.028200] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.146 qpair failed and we were unable to recover it. 00:26:23.146 [2024-04-16 23:04:14.028354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.146 [2024-04-16 23:04:14.028489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.146 [2024-04-16 23:04:14.028514] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.146 qpair failed and we were unable to recover it. 00:26:23.146 [2024-04-16 23:04:14.028631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.146 [2024-04-16 23:04:14.028763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.146 [2024-04-16 23:04:14.028787] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.146 qpair failed and we were unable to recover it. 00:26:23.146 [2024-04-16 23:04:14.028898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.146 [2024-04-16 23:04:14.029017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.146 [2024-04-16 23:04:14.029041] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.146 qpair failed and we were unable to recover it. 00:26:23.146 [2024-04-16 23:04:14.029158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.146 [2024-04-16 23:04:14.029287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.146 [2024-04-16 23:04:14.029313] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.146 qpair failed and we were unable to recover it. 00:26:23.146 [2024-04-16 23:04:14.029437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.146 [2024-04-16 23:04:14.029588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.146 [2024-04-16 23:04:14.029613] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.146 qpair failed and we were unable to recover it. 00:26:23.146 [2024-04-16 23:04:14.029756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.146 [2024-04-16 23:04:14.029906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.146 [2024-04-16 23:04:14.029930] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.146 qpair failed and we were unable to recover it. 00:26:23.146 [2024-04-16 23:04:14.030044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.146 [2024-04-16 23:04:14.030156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.146 [2024-04-16 23:04:14.030194] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.146 qpair failed and we were unable to recover it. 00:26:23.146 [2024-04-16 23:04:14.030318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.146 [2024-04-16 23:04:14.030434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.146 [2024-04-16 23:04:14.030459] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.146 qpair failed and we were unable to recover it. 00:26:23.146 [2024-04-16 23:04:14.030576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.146 [2024-04-16 23:04:14.030715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.146 [2024-04-16 23:04:14.030740] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.146 qpair failed and we were unable to recover it. 00:26:23.146 [2024-04-16 23:04:14.030859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.146 [2024-04-16 23:04:14.030992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.146 [2024-04-16 23:04:14.031017] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.146 qpair failed and we were unable to recover it. 00:26:23.146 [2024-04-16 23:04:14.031154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.146 [2024-04-16 23:04:14.031305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.146 [2024-04-16 23:04:14.031330] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.146 qpair failed and we were unable to recover it. 00:26:23.146 [2024-04-16 23:04:14.031449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.146 [2024-04-16 23:04:14.031605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.146 [2024-04-16 23:04:14.031630] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.146 qpair failed and we were unable to recover it. 00:26:23.146 [2024-04-16 23:04:14.031739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.146 [2024-04-16 23:04:14.031852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.146 [2024-04-16 23:04:14.031877] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.146 qpair failed and we were unable to recover it. 00:26:23.146 [2024-04-16 23:04:14.032005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.146 [2024-04-16 23:04:14.032167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.146 [2024-04-16 23:04:14.032200] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.146 qpair failed and we were unable to recover it. 00:26:23.146 [2024-04-16 23:04:14.032312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.146 [2024-04-16 23:04:14.032420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.146 [2024-04-16 23:04:14.032448] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.146 qpair failed and we were unable to recover it. 00:26:23.146 [2024-04-16 23:04:14.032570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.146 [2024-04-16 23:04:14.032688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.146 [2024-04-16 23:04:14.032715] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.146 qpair failed and we were unable to recover it. 00:26:23.146 [2024-04-16 23:04:14.032864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.146 [2024-04-16 23:04:14.032985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.146 [2024-04-16 23:04:14.033010] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.146 qpair failed and we were unable to recover it. 00:26:23.146 [2024-04-16 23:04:14.033155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.146 [2024-04-16 23:04:14.033316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.146 [2024-04-16 23:04:14.033341] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.146 qpair failed and we were unable to recover it. 00:26:23.146 [2024-04-16 23:04:14.033505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.146 [2024-04-16 23:04:14.033621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.146 [2024-04-16 23:04:14.033646] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.146 qpair failed and we were unable to recover it. 00:26:23.146 [2024-04-16 23:04:14.033766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.146 [2024-04-16 23:04:14.033894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.146 [2024-04-16 23:04:14.033919] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.146 qpair failed and we were unable to recover it. 00:26:23.146 [2024-04-16 23:04:14.034061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.146 [2024-04-16 23:04:14.034182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.146 [2024-04-16 23:04:14.034209] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.146 qpair failed and we were unable to recover it. 00:26:23.146 [2024-04-16 23:04:14.034354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.146 [2024-04-16 23:04:14.034491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.146 [2024-04-16 23:04:14.034516] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.146 qpair failed and we were unable to recover it. 00:26:23.146 [2024-04-16 23:04:14.034641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.146 [2024-04-16 23:04:14.034785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.146 [2024-04-16 23:04:14.034809] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.146 qpair failed and we were unable to recover it. 00:26:23.146 [2024-04-16 23:04:14.034923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.146 [2024-04-16 23:04:14.035067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.146 [2024-04-16 23:04:14.035092] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.146 qpair failed and we were unable to recover it. 00:26:23.146 [2024-04-16 23:04:14.035238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.146 [2024-04-16 23:04:14.035351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.146 [2024-04-16 23:04:14.035375] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.146 qpair failed and we were unable to recover it. 00:26:23.146 [2024-04-16 23:04:14.035499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.146 [2024-04-16 23:04:14.035667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.146 [2024-04-16 23:04:14.035692] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.146 qpair failed and we were unable to recover it. 00:26:23.146 [2024-04-16 23:04:14.035801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.146 [2024-04-16 23:04:14.035945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.146 [2024-04-16 23:04:14.035970] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.146 qpair failed and we were unable to recover it. 00:26:23.146 [2024-04-16 23:04:14.036120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.146 [2024-04-16 23:04:14.036236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.146 [2024-04-16 23:04:14.036262] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.146 qpair failed and we were unable to recover it. 00:26:23.146 [2024-04-16 23:04:14.036374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.146 [2024-04-16 23:04:14.036489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.146 [2024-04-16 23:04:14.036514] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.146 qpair failed and we were unable to recover it. 00:26:23.146 [2024-04-16 23:04:14.036634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.146 [2024-04-16 23:04:14.036750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.146 [2024-04-16 23:04:14.036774] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.146 qpair failed and we were unable to recover it. 00:26:23.146 [2024-04-16 23:04:14.036910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.146 [2024-04-16 23:04:14.037060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.146 [2024-04-16 23:04:14.037085] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.146 qpair failed and we were unable to recover it. 00:26:23.146 [2024-04-16 23:04:14.037202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.146 [2024-04-16 23:04:14.037374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.146 [2024-04-16 23:04:14.037399] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.146 qpair failed and we were unable to recover it. 00:26:23.146 [2024-04-16 23:04:14.037518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.147 [2024-04-16 23:04:14.037639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.147 [2024-04-16 23:04:14.037664] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.147 qpair failed and we were unable to recover it. 00:26:23.147 [2024-04-16 23:04:14.037802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.147 [2024-04-16 23:04:14.037914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.147 [2024-04-16 23:04:14.037938] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.147 qpair failed and we were unable to recover it. 00:26:23.147 [2024-04-16 23:04:14.038052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.147 [2024-04-16 23:04:14.038159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.147 [2024-04-16 23:04:14.038198] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.147 qpair failed and we were unable to recover it. 00:26:23.147 [2024-04-16 23:04:14.038339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.147 [2024-04-16 23:04:14.038485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.147 [2024-04-16 23:04:14.038511] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.147 qpair failed and we were unable to recover it. 00:26:23.147 [2024-04-16 23:04:14.038663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.147 [2024-04-16 23:04:14.038824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.147 [2024-04-16 23:04:14.038849] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.147 qpair failed and we were unable to recover it. 00:26:23.147 [2024-04-16 23:04:14.039025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.147 [2024-04-16 23:04:14.039132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.147 [2024-04-16 23:04:14.039156] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.147 qpair failed and we were unable to recover it. 00:26:23.147 [2024-04-16 23:04:14.039290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.147 [2024-04-16 23:04:14.039414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.147 [2024-04-16 23:04:14.039440] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.147 qpair failed and we were unable to recover it. 00:26:23.147 [2024-04-16 23:04:14.039544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.147 [2024-04-16 23:04:14.039646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.147 [2024-04-16 23:04:14.039671] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.147 qpair failed and we were unable to recover it. 00:26:23.147 [2024-04-16 23:04:14.039824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.147 [2024-04-16 23:04:14.039961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.147 [2024-04-16 23:04:14.039986] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.147 qpair failed and we were unable to recover it. 00:26:23.147 [2024-04-16 23:04:14.040154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.147 [2024-04-16 23:04:14.040280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.147 [2024-04-16 23:04:14.040305] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.147 qpair failed and we were unable to recover it. 00:26:23.147 [2024-04-16 23:04:14.040449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.147 [2024-04-16 23:04:14.040562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.147 [2024-04-16 23:04:14.040587] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.147 qpair failed and we were unable to recover it. 00:26:23.147 [2024-04-16 23:04:14.040728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.147 [2024-04-16 23:04:14.040873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.147 [2024-04-16 23:04:14.040898] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.147 qpair failed and we were unable to recover it. 00:26:23.147 [2024-04-16 23:04:14.041014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.147 [2024-04-16 23:04:14.041151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.147 [2024-04-16 23:04:14.041183] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.147 qpair failed and we were unable to recover it. 00:26:23.147 [2024-04-16 23:04:14.041342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.147 [2024-04-16 23:04:14.041491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.147 [2024-04-16 23:04:14.041517] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.147 qpair failed and we were unable to recover it. 00:26:23.147 [2024-04-16 23:04:14.041658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.147 [2024-04-16 23:04:14.041801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.147 [2024-04-16 23:04:14.041825] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.147 qpair failed and we were unable to recover it. 00:26:23.147 [2024-04-16 23:04:14.041972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.147 [2024-04-16 23:04:14.042116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.147 [2024-04-16 23:04:14.042141] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.147 qpair failed and we were unable to recover it. 00:26:23.147 [2024-04-16 23:04:14.042260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.147 [2024-04-16 23:04:14.042400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.147 [2024-04-16 23:04:14.042425] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.147 qpair failed and we were unable to recover it. 00:26:23.147 [2024-04-16 23:04:14.042583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.147 [2024-04-16 23:04:14.042694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.147 [2024-04-16 23:04:14.042721] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.147 qpair failed and we were unable to recover it. 00:26:23.147 [2024-04-16 23:04:14.042890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.147 [2024-04-16 23:04:14.042999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.147 [2024-04-16 23:04:14.043024] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.147 qpair failed and we were unable to recover it. 00:26:23.147 [2024-04-16 23:04:14.043201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.147 [2024-04-16 23:04:14.043371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.147 [2024-04-16 23:04:14.043396] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.147 qpair failed and we were unable to recover it. 00:26:23.147 [2024-04-16 23:04:14.043533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.147 [2024-04-16 23:04:14.043643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.147 [2024-04-16 23:04:14.043668] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.147 qpair failed and we were unable to recover it. 00:26:23.147 [2024-04-16 23:04:14.043776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.147 [2024-04-16 23:04:14.043916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.147 [2024-04-16 23:04:14.043942] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.147 qpair failed and we were unable to recover it. 00:26:23.147 [2024-04-16 23:04:14.044055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.147 [2024-04-16 23:04:14.044196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.147 [2024-04-16 23:04:14.044221] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.147 qpair failed and we were unable to recover it. 00:26:23.147 [2024-04-16 23:04:14.044369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.147 [2024-04-16 23:04:14.044512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.147 [2024-04-16 23:04:14.044537] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.147 qpair failed and we were unable to recover it. 00:26:23.147 [2024-04-16 23:04:14.044684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.147 [2024-04-16 23:04:14.044796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.147 [2024-04-16 23:04:14.044821] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.147 qpair failed and we were unable to recover it. 00:26:23.147 [2024-04-16 23:04:14.044932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.147 [2024-04-16 23:04:14.045097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.147 [2024-04-16 23:04:14.045122] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.147 qpair failed and we were unable to recover it. 00:26:23.147 [2024-04-16 23:04:14.045275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.147 [2024-04-16 23:04:14.045395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.147 [2024-04-16 23:04:14.045419] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.147 qpair failed and we were unable to recover it. 00:26:23.147 [2024-04-16 23:04:14.045525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.147 [2024-04-16 23:04:14.045684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.147 [2024-04-16 23:04:14.045709] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.147 qpair failed and we were unable to recover it. 00:26:23.147 [2024-04-16 23:04:14.045834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.147 [2024-04-16 23:04:14.046003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.147 [2024-04-16 23:04:14.046028] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.147 qpair failed and we were unable to recover it. 00:26:23.147 [2024-04-16 23:04:14.046170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.147 [2024-04-16 23:04:14.046320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.147 [2024-04-16 23:04:14.046345] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.147 qpair failed and we were unable to recover it. 00:26:23.147 [2024-04-16 23:04:14.046487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.147 [2024-04-16 23:04:14.046600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.147 [2024-04-16 23:04:14.046624] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.147 qpair failed and we were unable to recover it. 00:26:23.147 [2024-04-16 23:04:14.046771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.147 [2024-04-16 23:04:14.046878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.147 [2024-04-16 23:04:14.046904] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.147 qpair failed and we were unable to recover it. 00:26:23.147 [2024-04-16 23:04:14.047070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.147 [2024-04-16 23:04:14.047187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.147 [2024-04-16 23:04:14.047212] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.147 qpair failed and we were unable to recover it. 00:26:23.147 [2024-04-16 23:04:14.047357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.147 [2024-04-16 23:04:14.047475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.147 [2024-04-16 23:04:14.047504] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.147 qpair failed and we were unable to recover it. 00:26:23.147 [2024-04-16 23:04:14.047643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.147 [2024-04-16 23:04:14.047777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.147 [2024-04-16 23:04:14.047802] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.147 qpair failed and we were unable to recover it. 00:26:23.147 [2024-04-16 23:04:14.047946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.147 [2024-04-16 23:04:14.048064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.147 [2024-04-16 23:04:14.048089] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.147 qpair failed and we were unable to recover it. 00:26:23.147 [2024-04-16 23:04:14.048203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.147 [2024-04-16 23:04:14.048351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.147 [2024-04-16 23:04:14.048376] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.147 qpair failed and we were unable to recover it. 00:26:23.147 [2024-04-16 23:04:14.048489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.147 EAL: No free 2048 kB hugepages reported on node 1 00:26:23.147 [2024-04-16 23:04:14.048633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.147 [2024-04-16 23:04:14.048659] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.147 qpair failed and we were unable to recover it. 00:26:23.147 [2024-04-16 23:04:14.048779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.147 [2024-04-16 23:04:14.048932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.147 [2024-04-16 23:04:14.048957] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.147 qpair failed and we were unable to recover it. 00:26:23.147 [2024-04-16 23:04:14.049073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.147 [2024-04-16 23:04:14.049195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.147 [2024-04-16 23:04:14.049221] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.147 qpair failed and we were unable to recover it. 00:26:23.147 [2024-04-16 23:04:14.049386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.147 [2024-04-16 23:04:14.049494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.147 [2024-04-16 23:04:14.049519] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.147 qpair failed and we were unable to recover it. 00:26:23.147 [2024-04-16 23:04:14.049638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.147 [2024-04-16 23:04:14.049805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.147 [2024-04-16 23:04:14.049829] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.147 qpair failed and we were unable to recover it. 00:26:23.147 [2024-04-16 23:04:14.049979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.147 [2024-04-16 23:04:14.050126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.147 [2024-04-16 23:04:14.050150] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.147 qpair failed and we were unable to recover it. 00:26:23.147 [2024-04-16 23:04:14.050277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.147 [2024-04-16 23:04:14.050421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.147 [2024-04-16 23:04:14.050452] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.147 qpair failed and we were unable to recover it. 00:26:23.147 [2024-04-16 23:04:14.050576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.147 [2024-04-16 23:04:14.050717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.147 [2024-04-16 23:04:14.050743] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.147 qpair failed and we were unable to recover it. 00:26:23.147 [2024-04-16 23:04:14.050855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.147 [2024-04-16 23:04:14.050964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.147 [2024-04-16 23:04:14.050988] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.147 qpair failed and we were unable to recover it. 00:26:23.147 [2024-04-16 23:04:14.051100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.147 [2024-04-16 23:04:14.051223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.147 [2024-04-16 23:04:14.051248] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.147 qpair failed and we were unable to recover it. 00:26:23.147 [2024-04-16 23:04:14.051398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.147 [2024-04-16 23:04:14.051531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.147 [2024-04-16 23:04:14.051556] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.147 qpair failed and we were unable to recover it. 00:26:23.147 [2024-04-16 23:04:14.051700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.147 [2024-04-16 23:04:14.051831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.147 [2024-04-16 23:04:14.051856] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.147 qpair failed and we were unable to recover it. 00:26:23.147 [2024-04-16 23:04:14.051976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.147 [2024-04-16 23:04:14.052098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.147 [2024-04-16 23:04:14.052124] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.147 qpair failed and we were unable to recover it. 00:26:23.147 [2024-04-16 23:04:14.052249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.147 [2024-04-16 23:04:14.052364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.147 [2024-04-16 23:04:14.052389] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.147 qpair failed and we were unable to recover it. 00:26:23.147 [2024-04-16 23:04:14.052513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.147 [2024-04-16 23:04:14.052646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.147 [2024-04-16 23:04:14.052671] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.147 qpair failed and we were unable to recover it. 00:26:23.148 [2024-04-16 23:04:14.052818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.148 [2024-04-16 23:04:14.052926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.148 [2024-04-16 23:04:14.052951] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.148 qpair failed and we were unable to recover it. 00:26:23.148 [2024-04-16 23:04:14.053059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.148 [2024-04-16 23:04:14.053173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.148 [2024-04-16 23:04:14.053206] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.148 qpair failed and we were unable to recover it. 00:26:23.148 [2024-04-16 23:04:14.053334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.148 [2024-04-16 23:04:14.053450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.148 [2024-04-16 23:04:14.053474] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.148 qpair failed and we were unable to recover it. 00:26:23.148 [2024-04-16 23:04:14.053617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.148 [2024-04-16 23:04:14.053772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.148 [2024-04-16 23:04:14.053797] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.148 qpair failed and we were unable to recover it. 00:26:23.148 [2024-04-16 23:04:14.053938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.148 [2024-04-16 23:04:14.054080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.148 [2024-04-16 23:04:14.054104] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.148 qpair failed and we were unable to recover it. 00:26:23.148 [2024-04-16 23:04:14.054237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.148 [2024-04-16 23:04:14.054347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.148 [2024-04-16 23:04:14.054373] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.148 qpair failed and we were unable to recover it. 00:26:23.148 [2024-04-16 23:04:14.054549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.148 [2024-04-16 23:04:14.054663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.148 [2024-04-16 23:04:14.054687] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.148 qpair failed and we were unable to recover it. 00:26:23.148 [2024-04-16 23:04:14.054791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.148 [2024-04-16 23:04:14.054897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.148 [2024-04-16 23:04:14.054922] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.148 qpair failed and we were unable to recover it. 00:26:23.148 [2024-04-16 23:04:14.055032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.148 [2024-04-16 23:04:14.055196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.148 [2024-04-16 23:04:14.055222] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.148 qpair failed and we were unable to recover it. 00:26:23.148 [2024-04-16 23:04:14.055332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.148 [2024-04-16 23:04:14.055440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.148 [2024-04-16 23:04:14.055465] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.148 qpair failed and we were unable to recover it. 00:26:23.148 [2024-04-16 23:04:14.055607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.148 [2024-04-16 23:04:14.055715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.148 [2024-04-16 23:04:14.055740] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.148 qpair failed and we were unable to recover it. 00:26:23.148 [2024-04-16 23:04:14.055857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.148 [2024-04-16 23:04:14.055998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.148 [2024-04-16 23:04:14.056023] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.148 qpair failed and we were unable to recover it. 00:26:23.148 [2024-04-16 23:04:14.056194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.148 [2024-04-16 23:04:14.056340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.148 [2024-04-16 23:04:14.056364] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.148 qpair failed and we were unable to recover it. 00:26:23.148 [2024-04-16 23:04:14.056495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.148 [2024-04-16 23:04:14.056666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.148 [2024-04-16 23:04:14.056690] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.148 qpair failed and we were unable to recover it. 00:26:23.148 [2024-04-16 23:04:14.056825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.148 [2024-04-16 23:04:14.056941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.148 [2024-04-16 23:04:14.056965] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.148 qpair failed and we were unable to recover it. 00:26:23.148 [2024-04-16 23:04:14.057074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.148 [2024-04-16 23:04:14.057216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.148 [2024-04-16 23:04:14.057243] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.148 qpair failed and we were unable to recover it. 00:26:23.148 [2024-04-16 23:04:14.057356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.148 [2024-04-16 23:04:14.057463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.148 [2024-04-16 23:04:14.057488] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.148 qpair failed and we were unable to recover it. 00:26:23.148 [2024-04-16 23:04:14.057632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.148 [2024-04-16 23:04:14.057795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.148 [2024-04-16 23:04:14.057820] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.148 qpair failed and we were unable to recover it. 00:26:23.148 [2024-04-16 23:04:14.057936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.148 [2024-04-16 23:04:14.058078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.148 [2024-04-16 23:04:14.058103] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.148 qpair failed and we were unable to recover it. 00:26:23.148 [2024-04-16 23:04:14.058232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.148 [2024-04-16 23:04:14.058336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.148 [2024-04-16 23:04:14.058360] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.148 qpair failed and we were unable to recover it. 00:26:23.148 [2024-04-16 23:04:14.058520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.148 [2024-04-16 23:04:14.058667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.148 [2024-04-16 23:04:14.058691] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.148 qpair failed and we were unable to recover it. 00:26:23.148 [2024-04-16 23:04:14.058802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.148 [2024-04-16 23:04:14.058970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.148 [2024-04-16 23:04:14.058994] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.148 qpair failed and we were unable to recover it. 00:26:23.148 [2024-04-16 23:04:14.059103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.148 [2024-04-16 23:04:14.059233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.148 [2024-04-16 23:04:14.059259] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.148 qpair failed and we were unable to recover it. 00:26:23.148 [2024-04-16 23:04:14.059434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.148 [2024-04-16 23:04:14.059573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.148 [2024-04-16 23:04:14.059598] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.148 qpair failed and we were unable to recover it. 00:26:23.148 [2024-04-16 23:04:14.059712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.148 [2024-04-16 23:04:14.059877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.148 [2024-04-16 23:04:14.059900] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.148 qpair failed and we were unable to recover it. 00:26:23.148 [2024-04-16 23:04:14.060020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.148 [2024-04-16 23:04:14.060170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.148 [2024-04-16 23:04:14.060202] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.148 qpair failed and we were unable to recover it. 00:26:23.148 [2024-04-16 23:04:14.060339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.148 [2024-04-16 23:04:14.060456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.148 [2024-04-16 23:04:14.060479] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.148 qpair failed and we were unable to recover it. 00:26:23.148 [2024-04-16 23:04:14.060633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.148 [2024-04-16 23:04:14.060743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.148 [2024-04-16 23:04:14.060767] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.148 qpair failed and we were unable to recover it. 00:26:23.148 [2024-04-16 23:04:14.060911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.148 [2024-04-16 23:04:14.061054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.148 [2024-04-16 23:04:14.061077] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.148 qpair failed and we were unable to recover it. 00:26:23.148 [2024-04-16 23:04:14.061205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.148 [2024-04-16 23:04:14.061313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.148 [2024-04-16 23:04:14.061337] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.148 qpair failed and we were unable to recover it. 00:26:23.148 [2024-04-16 23:04:14.061492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.148 [2024-04-16 23:04:14.061639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.148 [2024-04-16 23:04:14.061667] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.148 qpair failed and we were unable to recover it. 00:26:23.148 [2024-04-16 23:04:14.061808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.148 [2024-04-16 23:04:14.061931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.148 [2024-04-16 23:04:14.061955] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.148 qpair failed and we were unable to recover it. 00:26:23.148 [2024-04-16 23:04:14.062079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.148 [2024-04-16 23:04:14.062233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.148 [2024-04-16 23:04:14.062260] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.148 qpair failed and we were unable to recover it. 00:26:23.148 [2024-04-16 23:04:14.062387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.148 [2024-04-16 23:04:14.062499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.148 [2024-04-16 23:04:14.062524] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.148 qpair failed and we were unable to recover it. 00:26:23.148 [2024-04-16 23:04:14.062627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.148 [2024-04-16 23:04:14.062733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.148 [2024-04-16 23:04:14.062757] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.148 qpair failed and we were unable to recover it. 00:26:23.148 [2024-04-16 23:04:14.062863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.148 [2024-04-16 23:04:14.062998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.148 [2024-04-16 23:04:14.063022] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.148 qpair failed and we were unable to recover it. 00:26:23.148 [2024-04-16 23:04:14.063131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.148 [2024-04-16 23:04:14.063246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.148 [2024-04-16 23:04:14.063272] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.148 qpair failed and we were unable to recover it. 00:26:23.148 [2024-04-16 23:04:14.063418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.148 [2024-04-16 23:04:14.063567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.148 [2024-04-16 23:04:14.063602] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.148 qpair failed and we were unable to recover it. 00:26:23.148 [2024-04-16 23:04:14.063708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.148 [2024-04-16 23:04:14.063850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.148 [2024-04-16 23:04:14.063875] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.148 qpair failed and we were unable to recover it. 00:26:23.148 [2024-04-16 23:04:14.064019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.148 [2024-04-16 23:04:14.064130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.148 [2024-04-16 23:04:14.064157] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.148 qpair failed and we were unable to recover it. 00:26:23.148 [2024-04-16 23:04:14.064275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.148 [2024-04-16 23:04:14.064386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.148 [2024-04-16 23:04:14.064411] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.148 qpair failed and we were unable to recover it. 00:26:23.148 [2024-04-16 23:04:14.064528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.148 [2024-04-16 23:04:14.064631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.148 [2024-04-16 23:04:14.064655] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.148 qpair failed and we were unable to recover it. 00:26:23.148 [2024-04-16 23:04:14.064770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.148 [2024-04-16 23:04:14.064880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.148 [2024-04-16 23:04:14.064908] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.148 qpair failed and we were unable to recover it. 00:26:23.148 [2024-04-16 23:04:14.065059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.148 [2024-04-16 23:04:14.065167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.148 [2024-04-16 23:04:14.065199] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.148 qpair failed and we were unable to recover it. 00:26:23.148 [2024-04-16 23:04:14.065335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.148 [2024-04-16 23:04:14.065438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.148 [2024-04-16 23:04:14.065463] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.148 qpair failed and we were unable to recover it. 00:26:23.148 [2024-04-16 23:04:14.065572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.148 [2024-04-16 23:04:14.065716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.148 [2024-04-16 23:04:14.065740] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.148 qpair failed and we were unable to recover it. 00:26:23.148 [2024-04-16 23:04:14.065847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.148 [2024-04-16 23:04:14.065980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.148 [2024-04-16 23:04:14.066004] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.148 qpair failed and we were unable to recover it. 00:26:23.148 [2024-04-16 23:04:14.066141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.148 [2024-04-16 23:04:14.066291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.148 [2024-04-16 23:04:14.066317] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.148 qpair failed and we were unable to recover it. 00:26:23.148 [2024-04-16 23:04:14.066425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.148 [2024-04-16 23:04:14.066605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.148 [2024-04-16 23:04:14.066630] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.148 qpair failed and we were unable to recover it. 00:26:23.149 [2024-04-16 23:04:14.066783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.149 [2024-04-16 23:04:14.066926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.149 [2024-04-16 23:04:14.066951] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.149 qpair failed and we were unable to recover it. 00:26:23.149 [2024-04-16 23:04:14.067080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.149 [2024-04-16 23:04:14.067195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.149 [2024-04-16 23:04:14.067221] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.149 qpair failed and we were unable to recover it. 00:26:23.149 [2024-04-16 23:04:14.067364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.149 [2024-04-16 23:04:14.067498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.149 [2024-04-16 23:04:14.067523] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.149 qpair failed and we were unable to recover it. 00:26:23.149 [2024-04-16 23:04:14.067659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.149 [2024-04-16 23:04:14.067794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.149 [2024-04-16 23:04:14.067818] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.149 qpair failed and we were unable to recover it. 00:26:23.149 [2024-04-16 23:04:14.067957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.149 [2024-04-16 23:04:14.068099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.149 [2024-04-16 23:04:14.068125] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.149 qpair failed and we were unable to recover it. 00:26:23.149 [2024-04-16 23:04:14.068236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.149 [2024-04-16 23:04:14.068347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.149 [2024-04-16 23:04:14.068373] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.149 qpair failed and we were unable to recover it. 00:26:23.149 [2024-04-16 23:04:14.068527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.149 [2024-04-16 23:04:14.068638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.149 [2024-04-16 23:04:14.068663] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.149 qpair failed and we were unable to recover it. 00:26:23.149 [2024-04-16 23:04:14.068782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.149 [2024-04-16 23:04:14.068923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.149 [2024-04-16 23:04:14.068947] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.149 qpair failed and we were unable to recover it. 00:26:23.149 [2024-04-16 23:04:14.069063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.149 [2024-04-16 23:04:14.069219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.149 [2024-04-16 23:04:14.069245] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.149 qpair failed and we were unable to recover it. 00:26:23.149 [2024-04-16 23:04:14.069364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.149 [2024-04-16 23:04:14.069533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.149 [2024-04-16 23:04:14.069558] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.149 qpair failed and we were unable to recover it. 00:26:23.149 [2024-04-16 23:04:14.069671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.149 [2024-04-16 23:04:14.069801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.149 [2024-04-16 23:04:14.069827] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.149 qpair failed and we were unable to recover it. 00:26:23.149 [2024-04-16 23:04:14.069938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.149 [2024-04-16 23:04:14.070083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.149 [2024-04-16 23:04:14.070108] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.149 qpair failed and we were unable to recover it. 00:26:23.149 [2024-04-16 23:04:14.070239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.149 [2024-04-16 23:04:14.070377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.149 [2024-04-16 23:04:14.070402] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.149 qpair failed and we were unable to recover it. 00:26:23.149 [2024-04-16 23:04:14.070543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.149 [2024-04-16 23:04:14.070666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.149 [2024-04-16 23:04:14.070691] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.149 qpair failed and we were unable to recover it. 00:26:23.149 [2024-04-16 23:04:14.070843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.149 [2024-04-16 23:04:14.070956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.149 [2024-04-16 23:04:14.070982] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.149 qpair failed and we were unable to recover it. 00:26:23.149 [2024-04-16 23:04:14.071121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.149 [2024-04-16 23:04:14.071254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.149 [2024-04-16 23:04:14.071279] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.149 qpair failed and we were unable to recover it. 00:26:23.149 [2024-04-16 23:04:14.071435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.149 [2024-04-16 23:04:14.071548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.149 [2024-04-16 23:04:14.071572] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.149 qpair failed and we were unable to recover it. 00:26:23.149 [2024-04-16 23:04:14.071687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.149 [2024-04-16 23:04:14.071820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.149 [2024-04-16 23:04:14.071854] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.149 qpair failed and we were unable to recover it. 00:26:23.149 [2024-04-16 23:04:14.071989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.149 [2024-04-16 23:04:14.072100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.149 [2024-04-16 23:04:14.072124] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.149 qpair failed and we were unable to recover it. 00:26:23.149 [2024-04-16 23:04:14.072296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.149 [2024-04-16 23:04:14.072410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.149 [2024-04-16 23:04:14.072436] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.149 qpair failed and we were unable to recover it. 00:26:23.149 [2024-04-16 23:04:14.072586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.149 [2024-04-16 23:04:14.072694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.149 [2024-04-16 23:04:14.072719] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.149 qpair failed and we were unable to recover it. 00:26:23.149 [2024-04-16 23:04:14.072890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.149 [2024-04-16 23:04:14.073014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.149 [2024-04-16 23:04:14.073039] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.149 qpair failed and we were unable to recover it. 00:26:23.149 [2024-04-16 23:04:14.073185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.149 [2024-04-16 23:04:14.073292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.149 [2024-04-16 23:04:14.073317] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.149 qpair failed and we were unable to recover it. 00:26:23.149 [2024-04-16 23:04:14.073429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.149 [2024-04-16 23:04:14.073560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.149 [2024-04-16 23:04:14.073584] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.149 qpair failed and we were unable to recover it. 00:26:23.149 [2024-04-16 23:04:14.073735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.149 [2024-04-16 23:04:14.073875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.149 [2024-04-16 23:04:14.073899] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.149 qpair failed and we were unable to recover it. 00:26:23.149 [2024-04-16 23:04:14.074015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.149 [2024-04-16 23:04:14.074136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.149 [2024-04-16 23:04:14.074161] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.149 qpair failed and we were unable to recover it. 00:26:23.149 [2024-04-16 23:04:14.074294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.149 [2024-04-16 23:04:14.074404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.149 [2024-04-16 23:04:14.074429] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.149 qpair failed and we were unable to recover it. 00:26:23.149 [2024-04-16 23:04:14.074544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.149 [2024-04-16 23:04:14.074673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.149 [2024-04-16 23:04:14.074698] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.149 qpair failed and we were unable to recover it. 00:26:23.149 [2024-04-16 23:04:14.074803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.149 [2024-04-16 23:04:14.074914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.149 [2024-04-16 23:04:14.074940] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.149 qpair failed and we were unable to recover it. 00:26:23.149 [2024-04-16 23:04:14.075083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.149 [2024-04-16 23:04:14.075239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.149 [2024-04-16 23:04:14.075264] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.149 qpair failed and we were unable to recover it. 00:26:23.149 [2024-04-16 23:04:14.075401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.149 [2024-04-16 23:04:14.075519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.149 [2024-04-16 23:04:14.075543] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.149 qpair failed and we were unable to recover it. 00:26:23.149 [2024-04-16 23:04:14.075650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.149 [2024-04-16 23:04:14.075756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.149 [2024-04-16 23:04:14.075780] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.149 qpair failed and we were unable to recover it. 00:26:23.149 [2024-04-16 23:04:14.075907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.149 [2024-04-16 23:04:14.076045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.149 [2024-04-16 23:04:14.076078] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.149 qpair failed and we were unable to recover it. 00:26:23.149 [2024-04-16 23:04:14.076219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.149 [2024-04-16 23:04:14.076330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.149 [2024-04-16 23:04:14.076355] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.149 qpair failed and we were unable to recover it. 00:26:23.149 [2024-04-16 23:04:14.076474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.149 [2024-04-16 23:04:14.076619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.149 [2024-04-16 23:04:14.076644] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.149 qpair failed and we were unable to recover it. 00:26:23.149 [2024-04-16 23:04:14.076747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.149 [2024-04-16 23:04:14.076857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.149 [2024-04-16 23:04:14.076883] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.149 qpair failed and we were unable to recover it. 00:26:23.149 [2024-04-16 23:04:14.076993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.149 [2024-04-16 23:04:14.077110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.149 [2024-04-16 23:04:14.077135] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.149 qpair failed and we were unable to recover it. 00:26:23.149 [2024-04-16 23:04:14.077263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.149 [2024-04-16 23:04:14.077402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.149 [2024-04-16 23:04:14.077427] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.149 qpair failed and we were unable to recover it. 00:26:23.149 [2024-04-16 23:04:14.077565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.149 [2024-04-16 23:04:14.077703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.149 [2024-04-16 23:04:14.077728] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.149 qpair failed and we were unable to recover it. 00:26:23.149 [2024-04-16 23:04:14.077878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.149 [2024-04-16 23:04:14.077986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.149 [2024-04-16 23:04:14.078011] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.149 qpair failed and we were unable to recover it. 00:26:23.149 [2024-04-16 23:04:14.078132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.149 [2024-04-16 23:04:14.078269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.149 [2024-04-16 23:04:14.078296] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.149 qpair failed and we were unable to recover it. 00:26:23.149 [2024-04-16 23:04:14.078416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.149 [2024-04-16 23:04:14.078562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.149 [2024-04-16 23:04:14.078587] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.149 qpair failed and we were unable to recover it. 00:26:23.149 [2024-04-16 23:04:14.078696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.149 [2024-04-16 23:04:14.078832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.149 [2024-04-16 23:04:14.078857] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.149 qpair failed and we were unable to recover it. 00:26:23.149 [2024-04-16 23:04:14.078978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.149 [2024-04-16 23:04:14.079117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.149 [2024-04-16 23:04:14.079142] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.149 qpair failed and we were unable to recover it. 00:26:23.149 [2024-04-16 23:04:14.079294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.149 [2024-04-16 23:04:14.079407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.149 [2024-04-16 23:04:14.079436] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.149 qpair failed and we were unable to recover it. 00:26:23.149 [2024-04-16 23:04:14.079547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.149 [2024-04-16 23:04:14.079666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.149 [2024-04-16 23:04:14.079691] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.149 qpair failed and we were unable to recover it. 00:26:23.149 [2024-04-16 23:04:14.079848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.149 [2024-04-16 23:04:14.079987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.149 [2024-04-16 23:04:14.080011] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.149 qpair failed and we were unable to recover it. 00:26:23.149 [2024-04-16 23:04:14.080151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.149 [2024-04-16 23:04:14.080296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.149 [2024-04-16 23:04:14.080321] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.149 qpair failed and we were unable to recover it. 00:26:23.149 [2024-04-16 23:04:14.080444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.149 [2024-04-16 23:04:14.080561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.149 [2024-04-16 23:04:14.080585] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.149 qpair failed and we were unable to recover it. 00:26:23.149 [2024-04-16 23:04:14.080724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.149 [2024-04-16 23:04:14.080846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.149 [2024-04-16 23:04:14.080872] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.149 qpair failed and we were unable to recover it. 00:26:23.149 [2024-04-16 23:04:14.080989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.149 [2024-04-16 23:04:14.081125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.149 [2024-04-16 23:04:14.081149] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.149 qpair failed and we were unable to recover it. 00:26:23.149 [2024-04-16 23:04:14.081301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.149 [2024-04-16 23:04:14.081438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.149 [2024-04-16 23:04:14.081463] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.149 qpair failed and we were unable to recover it. 00:26:23.149 [2024-04-16 23:04:14.081572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.149 [2024-04-16 23:04:14.081700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.149 [2024-04-16 23:04:14.081726] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.149 qpair failed and we were unable to recover it. 00:26:23.149 [2024-04-16 23:04:14.081845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.149 [2024-04-16 23:04:14.081965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.150 [2024-04-16 23:04:14.081991] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.150 qpair failed and we were unable to recover it. 00:26:23.150 [2024-04-16 23:04:14.082112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.150 [2024-04-16 23:04:14.082269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.150 [2024-04-16 23:04:14.082295] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.150 qpair failed and we were unable to recover it. 00:26:23.150 [2024-04-16 23:04:14.082431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.150 [2024-04-16 23:04:14.082549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.150 [2024-04-16 23:04:14.082573] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.150 qpair failed and we were unable to recover it. 00:26:23.150 [2024-04-16 23:04:14.082692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.150 [2024-04-16 23:04:14.082860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.150 [2024-04-16 23:04:14.082884] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.150 qpair failed and we were unable to recover it. 00:26:23.150 [2024-04-16 23:04:14.083030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.150 [2024-04-16 23:04:14.083163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.150 [2024-04-16 23:04:14.083194] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.150 qpair failed and we were unable to recover it. 00:26:23.150 [2024-04-16 23:04:14.083304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.150 [2024-04-16 23:04:14.083419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.150 [2024-04-16 23:04:14.083426] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:26:23.150 [2024-04-16 23:04:14.083443] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.150 qpair failed and we were unable to recover it. 00:26:23.150 [2024-04-16 23:04:14.083563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.150 [2024-04-16 23:04:14.083708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.150 [2024-04-16 23:04:14.083732] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.150 qpair failed and we were unable to recover it. 00:26:23.150 [2024-04-16 23:04:14.083841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.150 [2024-04-16 23:04:14.083959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.150 [2024-04-16 23:04:14.083984] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.150 qpair failed and we were unable to recover it. 00:26:23.150 [2024-04-16 23:04:14.084098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.150 [2024-04-16 23:04:14.084208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.150 [2024-04-16 23:04:14.084233] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.150 qpair failed and we were unable to recover it. 00:26:23.150 [2024-04-16 23:04:14.084342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.150 [2024-04-16 23:04:14.084497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.150 [2024-04-16 23:04:14.084522] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.150 qpair failed and we were unable to recover it. 00:26:23.150 [2024-04-16 23:04:14.084634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.150 [2024-04-16 23:04:14.084779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.150 [2024-04-16 23:04:14.084804] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.150 qpair failed and we were unable to recover it. 00:26:23.150 [2024-04-16 23:04:14.084971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.150 [2024-04-16 23:04:14.085102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.150 [2024-04-16 23:04:14.085131] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.150 qpair failed and we were unable to recover it. 00:26:23.150 [2024-04-16 23:04:14.085262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.150 [2024-04-16 23:04:14.085408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.150 [2024-04-16 23:04:14.085433] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.150 qpair failed and we were unable to recover it. 00:26:23.150 [2024-04-16 23:04:14.085591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.150 [2024-04-16 23:04:14.085705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.150 [2024-04-16 23:04:14.085729] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.150 qpair failed and we were unable to recover it. 00:26:23.150 [2024-04-16 23:04:14.085841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.150 [2024-04-16 23:04:14.085957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.150 [2024-04-16 23:04:14.085981] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.150 qpair failed and we were unable to recover it. 00:26:23.150 [2024-04-16 23:04:14.086151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.150 [2024-04-16 23:04:14.086266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.150 [2024-04-16 23:04:14.086292] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.150 qpair failed and we were unable to recover it. 00:26:23.150 [2024-04-16 23:04:14.086404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.150 [2024-04-16 23:04:14.086547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.150 [2024-04-16 23:04:14.086571] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.150 qpair failed and we were unable to recover it. 00:26:23.150 [2024-04-16 23:04:14.086757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.150 [2024-04-16 23:04:14.086892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.150 [2024-04-16 23:04:14.086916] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.150 qpair failed and we were unable to recover it. 00:26:23.150 [2024-04-16 23:04:14.087112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.150 [2024-04-16 23:04:14.087264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.150 [2024-04-16 23:04:14.087289] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.150 qpair failed and we were unable to recover it. 00:26:23.150 [2024-04-16 23:04:14.087393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.150 [2024-04-16 23:04:14.087523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.150 [2024-04-16 23:04:14.087556] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.150 qpair failed and we were unable to recover it. 00:26:23.150 [2024-04-16 23:04:14.087675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.150 [2024-04-16 23:04:14.087784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.150 [2024-04-16 23:04:14.087809] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.150 qpair failed and we were unable to recover it. 00:26:23.150 [2024-04-16 23:04:14.087954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.150 [2024-04-16 23:04:14.088099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.150 [2024-04-16 23:04:14.088125] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.150 qpair failed and we were unable to recover it. 00:26:23.150 [2024-04-16 23:04:14.088288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.150 [2024-04-16 23:04:14.088404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.150 [2024-04-16 23:04:14.088429] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.150 qpair failed and we were unable to recover it. 00:26:23.150 [2024-04-16 23:04:14.088539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.150 [2024-04-16 23:04:14.088680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.150 [2024-04-16 23:04:14.088705] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.150 qpair failed and we were unable to recover it. 00:26:23.150 [2024-04-16 23:04:14.088814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.150 [2024-04-16 23:04:14.088986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.150 [2024-04-16 23:04:14.089011] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.150 qpair failed and we were unable to recover it. 00:26:23.150 [2024-04-16 23:04:14.089115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.150 [2024-04-16 23:04:14.089296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.150 [2024-04-16 23:04:14.089321] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.150 qpair failed and we were unable to recover it. 00:26:23.150 [2024-04-16 23:04:14.089435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.150 [2024-04-16 23:04:14.089582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.150 [2024-04-16 23:04:14.089607] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.150 qpair failed and we were unable to recover it. 00:26:23.150 [2024-04-16 23:04:14.089723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.150 [2024-04-16 23:04:14.089854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.150 [2024-04-16 23:04:14.089879] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.150 qpair failed and we were unable to recover it. 00:26:23.150 [2024-04-16 23:04:14.090031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.150 [2024-04-16 23:04:14.090149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.150 [2024-04-16 23:04:14.090174] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.150 qpair failed and we were unable to recover it. 00:26:23.150 [2024-04-16 23:04:14.090330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.150 [2024-04-16 23:04:14.090440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.150 [2024-04-16 23:04:14.090464] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.150 qpair failed and we were unable to recover it. 00:26:23.150 [2024-04-16 23:04:14.090605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.150 [2024-04-16 23:04:14.090719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.150 [2024-04-16 23:04:14.090743] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.150 qpair failed and we were unable to recover it. 00:26:23.150 [2024-04-16 23:04:14.090891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.150 [2024-04-16 23:04:14.091005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.150 [2024-04-16 23:04:14.091029] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.150 qpair failed and we were unable to recover it. 00:26:23.150 [2024-04-16 23:04:14.091184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.150 [2024-04-16 23:04:14.091328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.150 [2024-04-16 23:04:14.091353] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.150 qpair failed and we were unable to recover it. 00:26:23.150 [2024-04-16 23:04:14.091492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.150 [2024-04-16 23:04:14.091638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.150 [2024-04-16 23:04:14.091663] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.150 qpair failed and we were unable to recover it. 00:26:23.150 [2024-04-16 23:04:14.091835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.150 [2024-04-16 23:04:14.091973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.150 [2024-04-16 23:04:14.091998] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.150 qpair failed and we were unable to recover it. 00:26:23.150 [2024-04-16 23:04:14.092120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.150 [2024-04-16 23:04:14.092240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.150 [2024-04-16 23:04:14.092267] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.150 qpair failed and we were unable to recover it. 00:26:23.150 [2024-04-16 23:04:14.092408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.150 [2024-04-16 23:04:14.092531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.150 [2024-04-16 23:04:14.092558] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.150 qpair failed and we were unable to recover it. 00:26:23.150 [2024-04-16 23:04:14.092666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.150 [2024-04-16 23:04:14.092793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.150 [2024-04-16 23:04:14.092817] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.150 qpair failed and we were unable to recover it. 00:26:23.150 [2024-04-16 23:04:14.092987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.150 [2024-04-16 23:04:14.093097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.150 [2024-04-16 23:04:14.093122] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.150 qpair failed and we were unable to recover it. 00:26:23.150 [2024-04-16 23:04:14.093270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.150 [2024-04-16 23:04:14.093378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.150 [2024-04-16 23:04:14.093402] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.150 qpair failed and we were unable to recover it. 00:26:23.150 [2024-04-16 23:04:14.093610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.150 [2024-04-16 23:04:14.093745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.150 [2024-04-16 23:04:14.093770] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.150 qpair failed and we were unable to recover it. 00:26:23.150 [2024-04-16 23:04:14.093911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.150 [2024-04-16 23:04:14.094027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.150 [2024-04-16 23:04:14.094052] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.150 qpair failed and we were unable to recover it. 00:26:23.150 [2024-04-16 23:04:14.094158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.150 [2024-04-16 23:04:14.094293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.150 [2024-04-16 23:04:14.094318] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.150 qpair failed and we were unable to recover it. 00:26:23.150 [2024-04-16 23:04:14.094431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.150 [2024-04-16 23:04:14.094548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.150 [2024-04-16 23:04:14.094575] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.150 qpair failed and we were unable to recover it. 00:26:23.150 [2024-04-16 23:04:14.094718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.150 [2024-04-16 23:04:14.094880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.150 [2024-04-16 23:04:14.094905] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.150 qpair failed and we were unable to recover it. 00:26:23.150 [2024-04-16 23:04:14.095049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.150 [2024-04-16 23:04:14.095224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.150 [2024-04-16 23:04:14.095249] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.150 qpair failed and we were unable to recover it. 00:26:23.150 [2024-04-16 23:04:14.095393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.150 [2024-04-16 23:04:14.095523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.150 [2024-04-16 23:04:14.095548] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.150 qpair failed and we were unable to recover it. 00:26:23.150 [2024-04-16 23:04:14.095655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.150 [2024-04-16 23:04:14.095798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.150 [2024-04-16 23:04:14.095823] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.150 qpair failed and we were unable to recover it. 00:26:23.150 [2024-04-16 23:04:14.095967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.150 [2024-04-16 23:04:14.096106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.150 [2024-04-16 23:04:14.096130] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.150 qpair failed and we were unable to recover it. 00:26:23.150 [2024-04-16 23:04:14.096359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.150 [2024-04-16 23:04:14.096467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.150 [2024-04-16 23:04:14.096492] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.151 qpair failed and we were unable to recover it. 00:26:23.151 [2024-04-16 23:04:14.096600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.151 [2024-04-16 23:04:14.096712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.151 [2024-04-16 23:04:14.096738] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.151 qpair failed and we were unable to recover it. 00:26:23.151 [2024-04-16 23:04:14.096877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.151 [2024-04-16 23:04:14.096986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.151 [2024-04-16 23:04:14.097011] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.151 qpair failed and we were unable to recover it. 00:26:23.151 [2024-04-16 23:04:14.097116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.151 [2024-04-16 23:04:14.097246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.151 [2024-04-16 23:04:14.097272] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.151 qpair failed and we were unable to recover it. 00:26:23.151 [2024-04-16 23:04:14.097488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.151 [2024-04-16 23:04:14.097610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.151 [2024-04-16 23:04:14.097635] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.151 qpair failed and we were unable to recover it. 00:26:23.151 [2024-04-16 23:04:14.097751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.151 [2024-04-16 23:04:14.097896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.151 [2024-04-16 23:04:14.097920] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.151 qpair failed and we were unable to recover it. 00:26:23.151 [2024-04-16 23:04:14.098090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.151 [2024-04-16 23:04:14.098225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.151 [2024-04-16 23:04:14.098251] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.151 qpair failed and we were unable to recover it. 00:26:23.151 [2024-04-16 23:04:14.098368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.151 [2024-04-16 23:04:14.098486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.151 [2024-04-16 23:04:14.098510] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.151 qpair failed and we were unable to recover it. 00:26:23.151 [2024-04-16 23:04:14.098679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.151 [2024-04-16 23:04:14.098791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.151 [2024-04-16 23:04:14.098815] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.151 qpair failed and we were unable to recover it. 00:26:23.151 [2024-04-16 23:04:14.098931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.151 [2024-04-16 23:04:14.099044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.151 [2024-04-16 23:04:14.099068] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.151 qpair failed and we were unable to recover it. 00:26:23.151 [2024-04-16 23:04:14.099184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.151 [2024-04-16 23:04:14.099324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.151 [2024-04-16 23:04:14.099348] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.151 qpair failed and we were unable to recover it. 00:26:23.151 [2024-04-16 23:04:14.099460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.151 [2024-04-16 23:04:14.099598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.151 [2024-04-16 23:04:14.099622] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.151 qpair failed and we were unable to recover it. 00:26:23.151 [2024-04-16 23:04:14.099730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.151 [2024-04-16 23:04:14.099870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.151 [2024-04-16 23:04:14.099894] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.151 qpair failed and we were unable to recover it. 00:26:23.151 [2024-04-16 23:04:14.100034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.151 [2024-04-16 23:04:14.100145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.151 [2024-04-16 23:04:14.100189] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.151 qpair failed and we were unable to recover it. 00:26:23.151 [2024-04-16 23:04:14.100334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.151 [2024-04-16 23:04:14.100442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.151 [2024-04-16 23:04:14.100467] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.151 qpair failed and we were unable to recover it. 00:26:23.151 [2024-04-16 23:04:14.100624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.151 [2024-04-16 23:04:14.100736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.151 [2024-04-16 23:04:14.100760] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.151 qpair failed and we were unable to recover it. 00:26:23.151 [2024-04-16 23:04:14.100894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.151 [2024-04-16 23:04:14.101030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.151 [2024-04-16 23:04:14.101054] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.151 qpair failed and we were unable to recover it. 00:26:23.151 [2024-04-16 23:04:14.101216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.151 [2024-04-16 23:04:14.101332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.151 [2024-04-16 23:04:14.101357] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.151 qpair failed and we were unable to recover it. 00:26:23.151 [2024-04-16 23:04:14.101469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.151 [2024-04-16 23:04:14.101608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.151 [2024-04-16 23:04:14.101632] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.151 qpair failed and we were unable to recover it. 00:26:23.151 [2024-04-16 23:04:14.101740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.151 [2024-04-16 23:04:14.101894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.151 [2024-04-16 23:04:14.101918] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.151 qpair failed and we were unable to recover it. 00:26:23.151 [2024-04-16 23:04:14.102025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.151 [2024-04-16 23:04:14.102186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.151 [2024-04-16 23:04:14.102212] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.151 qpair failed and we were unable to recover it. 00:26:23.151 [2024-04-16 23:04:14.102358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.151 [2024-04-16 23:04:14.102470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.151 [2024-04-16 23:04:14.102499] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.151 qpair failed and we were unable to recover it. 00:26:23.151 [2024-04-16 23:04:14.102605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.151 [2024-04-16 23:04:14.102737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.151 [2024-04-16 23:04:14.102761] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.151 qpair failed and we were unable to recover it. 00:26:23.151 [2024-04-16 23:04:14.102900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.151 [2024-04-16 23:04:14.103045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.151 [2024-04-16 23:04:14.103070] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.151 qpair failed and we were unable to recover it. 00:26:23.151 [2024-04-16 23:04:14.103207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.151 [2024-04-16 23:04:14.103325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.151 [2024-04-16 23:04:14.103349] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.151 qpair failed and we were unable to recover it. 00:26:23.151 [2024-04-16 23:04:14.103497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.151 [2024-04-16 23:04:14.103606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.151 [2024-04-16 23:04:14.103632] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.151 qpair failed and we were unable to recover it. 00:26:23.151 [2024-04-16 23:04:14.103772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.151 [2024-04-16 23:04:14.103888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.151 [2024-04-16 23:04:14.103912] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.151 qpair failed and we were unable to recover it. 00:26:23.151 [2024-04-16 23:04:14.104050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.151 [2024-04-16 23:04:14.104173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.151 [2024-04-16 23:04:14.104204] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.151 qpair failed and we were unable to recover it. 00:26:23.151 [2024-04-16 23:04:14.104323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.151 [2024-04-16 23:04:14.104468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.151 [2024-04-16 23:04:14.104493] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.151 qpair failed and we were unable to recover it. 00:26:23.151 [2024-04-16 23:04:14.104639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.151 [2024-04-16 23:04:14.104747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.151 [2024-04-16 23:04:14.104772] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.151 qpair failed and we were unable to recover it. 00:26:23.151 [2024-04-16 23:04:14.104878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.151 [2024-04-16 23:04:14.104996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.151 [2024-04-16 23:04:14.105021] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.151 qpair failed and we were unable to recover it. 00:26:23.151 [2024-04-16 23:04:14.105185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.151 [2024-04-16 23:04:14.105298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.151 [2024-04-16 23:04:14.105322] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.151 qpair failed and we were unable to recover it. 00:26:23.151 [2024-04-16 23:04:14.105469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.151 [2024-04-16 23:04:14.105589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.151 [2024-04-16 23:04:14.105613] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.151 qpair failed and we were unable to recover it. 00:26:23.151 [2024-04-16 23:04:14.105782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.151 [2024-04-16 23:04:14.105890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.151 [2024-04-16 23:04:14.105915] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.151 qpair failed and we were unable to recover it. 00:26:23.151 [2024-04-16 23:04:14.106055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.151 [2024-04-16 23:04:14.106166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.151 [2024-04-16 23:04:14.106198] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.151 qpair failed and we were unable to recover it. 00:26:23.151 [2024-04-16 23:04:14.106343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.151 [2024-04-16 23:04:14.106474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.151 [2024-04-16 23:04:14.106499] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.151 qpair failed and we were unable to recover it. 00:26:23.151 [2024-04-16 23:04:14.106662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.151 [2024-04-16 23:04:14.106801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.151 [2024-04-16 23:04:14.106825] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.151 qpair failed and we were unable to recover it. 00:26:23.151 [2024-04-16 23:04:14.106968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.151 [2024-04-16 23:04:14.107106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.151 [2024-04-16 23:04:14.107130] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.151 qpair failed and we were unable to recover it. 00:26:23.151 [2024-04-16 23:04:14.107269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.151 [2024-04-16 23:04:14.107391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.151 [2024-04-16 23:04:14.107416] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.151 qpair failed and we were unable to recover it. 00:26:23.151 [2024-04-16 23:04:14.107568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.151 [2024-04-16 23:04:14.107709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.151 [2024-04-16 23:04:14.107734] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.151 qpair failed and we were unable to recover it. 00:26:23.151 [2024-04-16 23:04:14.107879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.151 [2024-04-16 23:04:14.108021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.151 [2024-04-16 23:04:14.108046] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.151 qpair failed and we were unable to recover it. 00:26:23.151 [2024-04-16 23:04:14.108198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.151 [2024-04-16 23:04:14.108340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.151 [2024-04-16 23:04:14.108365] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.151 qpair failed and we were unable to recover it. 00:26:23.151 [2024-04-16 23:04:14.108474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.151 [2024-04-16 23:04:14.108608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.151 [2024-04-16 23:04:14.108633] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.151 qpair failed and we were unable to recover it. 00:26:23.151 [2024-04-16 23:04:14.108766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.151 [2024-04-16 23:04:14.108899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.151 [2024-04-16 23:04:14.108924] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.151 qpair failed and we were unable to recover it. 00:26:23.151 [2024-04-16 23:04:14.109035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.151 [2024-04-16 23:04:14.109181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.151 [2024-04-16 23:04:14.109206] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.151 qpair failed and we were unable to recover it. 00:26:23.151 [2024-04-16 23:04:14.109341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.151 [2024-04-16 23:04:14.109474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.151 [2024-04-16 23:04:14.109499] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.151 qpair failed and we were unable to recover it. 00:26:23.151 [2024-04-16 23:04:14.109660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.151 [2024-04-16 23:04:14.109802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.151 [2024-04-16 23:04:14.109826] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.151 qpair failed and we were unable to recover it. 00:26:23.151 [2024-04-16 23:04:14.109935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.151 [2024-04-16 23:04:14.110044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.151 [2024-04-16 23:04:14.110068] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.151 qpair failed and we were unable to recover it. 00:26:23.151 [2024-04-16 23:04:14.110204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.151 [2024-04-16 23:04:14.110356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.151 [2024-04-16 23:04:14.110380] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.151 qpair failed and we were unable to recover it. 00:26:23.151 [2024-04-16 23:04:14.110507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.151 [2024-04-16 23:04:14.110676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.151 [2024-04-16 23:04:14.110700] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.151 qpair failed and we were unable to recover it. 00:26:23.151 [2024-04-16 23:04:14.110841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.151 [2024-04-16 23:04:14.110975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.151 [2024-04-16 23:04:14.111000] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.151 qpair failed and we were unable to recover it. 00:26:23.151 [2024-04-16 23:04:14.111112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.151 [2024-04-16 23:04:14.111233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.151 [2024-04-16 23:04:14.111258] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.151 qpair failed and we were unable to recover it. 00:26:23.151 [2024-04-16 23:04:14.111390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.151 [2024-04-16 23:04:14.111553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.151 [2024-04-16 23:04:14.111578] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.151 qpair failed and we were unable to recover it. 00:26:23.151 [2024-04-16 23:04:14.111704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.151 [2024-04-16 23:04:14.111839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.152 [2024-04-16 23:04:14.111864] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.152 qpair failed and we were unable to recover it. 00:26:23.152 [2024-04-16 23:04:14.111987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.152 [2024-04-16 23:04:14.112147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.152 [2024-04-16 23:04:14.112172] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.152 qpair failed and we were unable to recover it. 00:26:23.152 [2024-04-16 23:04:14.112296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.152 [2024-04-16 23:04:14.112403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.152 [2024-04-16 23:04:14.112427] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.152 qpair failed and we were unable to recover it. 00:26:23.152 [2024-04-16 23:04:14.112543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.152 [2024-04-16 23:04:14.112650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.152 [2024-04-16 23:04:14.112674] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.152 qpair failed and we were unable to recover it. 00:26:23.152 [2024-04-16 23:04:14.112817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.152 [2024-04-16 23:04:14.112959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.152 [2024-04-16 23:04:14.112983] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.152 qpair failed and we were unable to recover it. 00:26:23.152 [2024-04-16 23:04:14.113129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.152 [2024-04-16 23:04:14.113285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.152 [2024-04-16 23:04:14.113311] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.152 qpair failed and we were unable to recover it. 00:26:23.152 [2024-04-16 23:04:14.113447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.152 [2024-04-16 23:04:14.113550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.152 [2024-04-16 23:04:14.113574] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.152 qpair failed and we were unable to recover it. 00:26:23.152 [2024-04-16 23:04:14.113691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.152 [2024-04-16 23:04:14.113815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.152 [2024-04-16 23:04:14.113840] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.152 qpair failed and we were unable to recover it. 00:26:23.152 [2024-04-16 23:04:14.113972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.152 [2024-04-16 23:04:14.114111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.152 [2024-04-16 23:04:14.114135] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.152 qpair failed and we were unable to recover it. 00:26:23.152 [2024-04-16 23:04:14.114286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.152 [2024-04-16 23:04:14.114394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.152 [2024-04-16 23:04:14.114419] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.152 qpair failed and we were unable to recover it. 00:26:23.152 [2024-04-16 23:04:14.114538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.152 [2024-04-16 23:04:14.114650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.152 [2024-04-16 23:04:14.114676] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.152 qpair failed and we were unable to recover it. 00:26:23.152 [2024-04-16 23:04:14.114810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.152 [2024-04-16 23:04:14.114942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.152 [2024-04-16 23:04:14.114970] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.152 qpair failed and we were unable to recover it. 00:26:23.152 [2024-04-16 23:04:14.115081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.152 [2024-04-16 23:04:14.115197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.152 [2024-04-16 23:04:14.115223] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.152 qpair failed and we were unable to recover it. 00:26:23.152 [2024-04-16 23:04:14.115386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.152 [2024-04-16 23:04:14.115492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.152 [2024-04-16 23:04:14.115516] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.152 qpair failed and we were unable to recover it. 00:26:23.152 [2024-04-16 23:04:14.115625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.152 [2024-04-16 23:04:14.115764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.152 [2024-04-16 23:04:14.115789] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.152 qpair failed and we were unable to recover it. 00:26:23.152 [2024-04-16 23:04:14.115927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.152 [2024-04-16 23:04:14.116051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.152 [2024-04-16 23:04:14.116076] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.152 qpair failed and we were unable to recover it. 00:26:23.152 [2024-04-16 23:04:14.116190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.152 [2024-04-16 23:04:14.116338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.152 [2024-04-16 23:04:14.116363] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.152 qpair failed and we were unable to recover it. 00:26:23.152 [2024-04-16 23:04:14.116528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.152 [2024-04-16 23:04:14.116641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.152 [2024-04-16 23:04:14.116665] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.152 qpair failed and we were unable to recover it. 00:26:23.152 [2024-04-16 23:04:14.116831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.152 [2024-04-16 23:04:14.116938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.152 [2024-04-16 23:04:14.116962] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.152 qpair failed and we were unable to recover it. 00:26:23.152 [2024-04-16 23:04:14.117084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.152 [2024-04-16 23:04:14.117189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.152 [2024-04-16 23:04:14.117215] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.152 qpair failed and we were unable to recover it. 00:26:23.152 [2024-04-16 23:04:14.117330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.152 [2024-04-16 23:04:14.117478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.152 [2024-04-16 23:04:14.117502] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.152 qpair failed and we were unable to recover it. 00:26:23.152 [2024-04-16 23:04:14.117640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.152 [2024-04-16 23:04:14.117774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.152 [2024-04-16 23:04:14.117799] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.152 qpair failed and we were unable to recover it. 00:26:23.152 [2024-04-16 23:04:14.117916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.152 [2024-04-16 23:04:14.118055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.152 [2024-04-16 23:04:14.118080] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.152 qpair failed and we were unable to recover it. 00:26:23.152 [2024-04-16 23:04:14.118244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.152 [2024-04-16 23:04:14.118380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.152 [2024-04-16 23:04:14.118404] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.152 qpair failed and we were unable to recover it. 00:26:23.152 [2024-04-16 23:04:14.118546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.152 [2024-04-16 23:04:14.118681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.152 [2024-04-16 23:04:14.118705] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.152 qpair failed and we were unable to recover it. 00:26:23.152 [2024-04-16 23:04:14.118848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.152 [2024-04-16 23:04:14.118989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.152 [2024-04-16 23:04:14.119014] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.152 qpair failed and we were unable to recover it. 00:26:23.152 [2024-04-16 23:04:14.119153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.152 [2024-04-16 23:04:14.119266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.152 [2024-04-16 23:04:14.119291] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.152 qpair failed and we were unable to recover it. 00:26:23.152 [2024-04-16 23:04:14.119437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.152 [2024-04-16 23:04:14.119550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.152 [2024-04-16 23:04:14.119575] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.152 qpair failed and we were unable to recover it. 00:26:23.152 [2024-04-16 23:04:14.119718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.152 [2024-04-16 23:04:14.119877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.152 [2024-04-16 23:04:14.119902] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.152 qpair failed and we were unable to recover it. 00:26:23.152 [2024-04-16 23:04:14.120044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.152 [2024-04-16 23:04:14.120149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.152 [2024-04-16 23:04:14.120173] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.152 qpair failed and we were unable to recover it. 00:26:23.152 [2024-04-16 23:04:14.120353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.152 [2024-04-16 23:04:14.120477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.152 [2024-04-16 23:04:14.120501] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.152 qpair failed and we were unable to recover it. 00:26:23.152 [2024-04-16 23:04:14.120608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.152 [2024-04-16 23:04:14.120774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.152 [2024-04-16 23:04:14.120799] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.152 qpair failed and we were unable to recover it. 00:26:23.152 [2024-04-16 23:04:14.120913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.152 [2024-04-16 23:04:14.121019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.152 [2024-04-16 23:04:14.121044] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.152 qpair failed and we were unable to recover it. 00:26:23.152 [2024-04-16 23:04:14.121212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.152 [2024-04-16 23:04:14.121356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.152 [2024-04-16 23:04:14.121381] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.152 qpair failed and we were unable to recover it. 00:26:23.152 [2024-04-16 23:04:14.121523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.152 [2024-04-16 23:04:14.121663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.152 [2024-04-16 23:04:14.121687] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.152 qpair failed and we were unable to recover it. 00:26:23.152 [2024-04-16 23:04:14.121832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.152 [2024-04-16 23:04:14.121939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.152 [2024-04-16 23:04:14.121963] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.152 qpair failed and we were unable to recover it. 00:26:23.152 [2024-04-16 23:04:14.122092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.152 [2024-04-16 23:04:14.122240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.152 [2024-04-16 23:04:14.122265] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.152 qpair failed and we were unable to recover it. 00:26:23.152 [2024-04-16 23:04:14.122383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.152 [2024-04-16 23:04:14.122503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.152 [2024-04-16 23:04:14.122527] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.152 qpair failed and we were unable to recover it. 00:26:23.152 [2024-04-16 23:04:14.122665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.152 [2024-04-16 23:04:14.122805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.152 [2024-04-16 23:04:14.122829] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.152 qpair failed and we were unable to recover it. 00:26:23.152 [2024-04-16 23:04:14.122943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.152 [2024-04-16 23:04:14.123090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.152 [2024-04-16 23:04:14.123115] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.152 qpair failed and we were unable to recover it. 00:26:23.152 [2024-04-16 23:04:14.123270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.152 [2024-04-16 23:04:14.123429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.152 [2024-04-16 23:04:14.123454] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.152 qpair failed and we were unable to recover it. 00:26:23.152 [2024-04-16 23:04:14.123592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.152 [2024-04-16 23:04:14.123729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.152 [2024-04-16 23:04:14.123753] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.152 qpair failed and we were unable to recover it. 00:26:23.152 [2024-04-16 23:04:14.123923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.152 [2024-04-16 23:04:14.124031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.152 [2024-04-16 23:04:14.124055] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.152 qpair failed and we were unable to recover it. 00:26:23.152 [2024-04-16 23:04:14.124181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.152 [2024-04-16 23:04:14.124322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.152 [2024-04-16 23:04:14.124347] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.152 qpair failed and we were unable to recover it. 00:26:23.152 [2024-04-16 23:04:14.124472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.152 [2024-04-16 23:04:14.124589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.152 [2024-04-16 23:04:14.124613] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.152 qpair failed and we were unable to recover it. 00:26:23.152 [2024-04-16 23:04:14.124759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.152 [2024-04-16 23:04:14.124906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.152 [2024-04-16 23:04:14.124931] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.152 qpair failed and we were unable to recover it. 00:26:23.152 [2024-04-16 23:04:14.125041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.152 [2024-04-16 23:04:14.125183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.152 [2024-04-16 23:04:14.125209] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.152 qpair failed and we were unable to recover it. 00:26:23.152 [2024-04-16 23:04:14.125352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.152 [2024-04-16 23:04:14.125464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.152 [2024-04-16 23:04:14.125490] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.152 qpair failed and we were unable to recover it. 00:26:23.152 [2024-04-16 23:04:14.125666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.152 [2024-04-16 23:04:14.125787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.152 [2024-04-16 23:04:14.125813] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.152 qpair failed and we were unable to recover it. 00:26:23.152 [2024-04-16 23:04:14.125955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.152 [2024-04-16 23:04:14.126071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.152 [2024-04-16 23:04:14.126096] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.152 qpair failed and we were unable to recover it. 00:26:23.152 [2024-04-16 23:04:14.126213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.152 [2024-04-16 23:04:14.126321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.152 [2024-04-16 23:04:14.126345] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.153 qpair failed and we were unable to recover it. 00:26:23.153 [2024-04-16 23:04:14.126477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.153 [2024-04-16 23:04:14.126631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.153 [2024-04-16 23:04:14.126656] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.153 qpair failed and we were unable to recover it. 00:26:23.153 [2024-04-16 23:04:14.126778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.153 [2024-04-16 23:04:14.126926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.153 [2024-04-16 23:04:14.126951] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.153 qpair failed and we were unable to recover it. 00:26:23.153 [2024-04-16 23:04:14.127067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.153 [2024-04-16 23:04:14.127233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.153 [2024-04-16 23:04:14.127258] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.153 qpair failed and we were unable to recover it. 00:26:23.153 [2024-04-16 23:04:14.127378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.153 [2024-04-16 23:04:14.127487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.153 [2024-04-16 23:04:14.127511] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.153 qpair failed and we were unable to recover it. 00:26:23.153 [2024-04-16 23:04:14.127631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.153 [2024-04-16 23:04:14.127747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.153 [2024-04-16 23:04:14.127772] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.153 qpair failed and we were unable to recover it. 00:26:23.153 [2024-04-16 23:04:14.127882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.153 [2024-04-16 23:04:14.128001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.153 [2024-04-16 23:04:14.128026] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.153 qpair failed and we were unable to recover it. 00:26:23.153 [2024-04-16 23:04:14.128165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.153 [2024-04-16 23:04:14.128291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.153 [2024-04-16 23:04:14.128317] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.153 qpair failed and we were unable to recover it. 00:26:23.153 [2024-04-16 23:04:14.128434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.153 [2024-04-16 23:04:14.128569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.153 [2024-04-16 23:04:14.128593] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.153 qpair failed and we were unable to recover it. 00:26:23.153 [2024-04-16 23:04:14.128712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.153 [2024-04-16 23:04:14.128849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.153 [2024-04-16 23:04:14.128874] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.153 qpair failed and we were unable to recover it. 00:26:23.153 [2024-04-16 23:04:14.129013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.153 [2024-04-16 23:04:14.129150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.153 [2024-04-16 23:04:14.129180] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.153 qpair failed and we were unable to recover it. 00:26:23.153 [2024-04-16 23:04:14.129349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.153 [2024-04-16 23:04:14.129487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.153 [2024-04-16 23:04:14.129512] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.153 qpair failed and we were unable to recover it. 00:26:23.153 [2024-04-16 23:04:14.129676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.153 [2024-04-16 23:04:14.129811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.153 [2024-04-16 23:04:14.129840] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.153 qpair failed and we were unable to recover it. 00:26:23.153 [2024-04-16 23:04:14.129948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.153 [2024-04-16 23:04:14.130074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.153 [2024-04-16 23:04:14.130099] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.153 qpair failed and we were unable to recover it. 00:26:23.153 [2024-04-16 23:04:14.130210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.153 [2024-04-16 23:04:14.130335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.153 [2024-04-16 23:04:14.130360] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.153 qpair failed and we were unable to recover it. 00:26:23.153 [2024-04-16 23:04:14.130495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.153 [2024-04-16 23:04:14.130610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.153 [2024-04-16 23:04:14.130636] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.153 qpair failed and we were unable to recover it. 00:26:23.153 [2024-04-16 23:04:14.130754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.153 [2024-04-16 23:04:14.130892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.153 [2024-04-16 23:04:14.130917] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.153 qpair failed and we were unable to recover it. 00:26:23.153 [2024-04-16 23:04:14.131060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.153 [2024-04-16 23:04:14.131173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.153 [2024-04-16 23:04:14.131218] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.153 qpair failed and we were unable to recover it. 00:26:23.153 [2024-04-16 23:04:14.131344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.153 [2024-04-16 23:04:14.131461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.153 [2024-04-16 23:04:14.131486] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.153 qpair failed and we were unable to recover it. 00:26:23.153 [2024-04-16 23:04:14.131652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.153 [2024-04-16 23:04:14.131764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.153 [2024-04-16 23:04:14.131788] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.153 qpair failed and we were unable to recover it. 00:26:23.153 [2024-04-16 23:04:14.131934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.153 [2024-04-16 23:04:14.132038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.153 [2024-04-16 23:04:14.132062] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.153 qpair failed and we were unable to recover it. 00:26:23.153 [2024-04-16 23:04:14.132183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.153 [2024-04-16 23:04:14.132295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.153 [2024-04-16 23:04:14.132320] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.153 qpair failed and we were unable to recover it. 00:26:23.153 [2024-04-16 23:04:14.132460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.153 [2024-04-16 23:04:14.132569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.153 [2024-04-16 23:04:14.132593] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.153 qpair failed and we were unable to recover it. 00:26:23.153 [2024-04-16 23:04:14.132708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.153 [2024-04-16 23:04:14.132816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.153 [2024-04-16 23:04:14.132841] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.153 qpair failed and we were unable to recover it. 00:26:23.153 [2024-04-16 23:04:14.132976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.153 [2024-04-16 23:04:14.133089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.153 [2024-04-16 23:04:14.133115] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.153 qpair failed and we were unable to recover it. 00:26:23.153 [2024-04-16 23:04:14.133238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.153 [2024-04-16 23:04:14.133382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.153 [2024-04-16 23:04:14.133406] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.153 qpair failed and we were unable to recover it. 00:26:23.153 [2024-04-16 23:04:14.133521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.153 [2024-04-16 23:04:14.133690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.153 [2024-04-16 23:04:14.133715] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.153 qpair failed and we were unable to recover it. 00:26:23.153 [2024-04-16 23:04:14.133852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.153 [2024-04-16 23:04:14.133965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.153 [2024-04-16 23:04:14.133991] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.153 qpair failed and we were unable to recover it. 00:26:23.153 [2024-04-16 23:04:14.134131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.153 [2024-04-16 23:04:14.134280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.153 [2024-04-16 23:04:14.134306] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.153 qpair failed and we were unable to recover it. 00:26:23.153 [2024-04-16 23:04:14.134423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.153 [2024-04-16 23:04:14.134557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.153 [2024-04-16 23:04:14.134581] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.153 qpair failed and we were unable to recover it. 00:26:23.153 [2024-04-16 23:04:14.134689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.153 [2024-04-16 23:04:14.134809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.153 [2024-04-16 23:04:14.134833] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.153 qpair failed and we were unable to recover it. 00:26:23.153 [2024-04-16 23:04:14.134979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.153 [2024-04-16 23:04:14.135091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.153 [2024-04-16 23:04:14.135117] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.153 qpair failed and we were unable to recover it. 00:26:23.153 [2024-04-16 23:04:14.135256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.153 [2024-04-16 23:04:14.135367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.153 [2024-04-16 23:04:14.135391] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.153 qpair failed and we were unable to recover it. 00:26:23.153 [2024-04-16 23:04:14.135538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.153 [2024-04-16 23:04:14.135661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.153 [2024-04-16 23:04:14.135686] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.153 qpair failed and we were unable to recover it. 00:26:23.153 [2024-04-16 23:04:14.135827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.153 [2024-04-16 23:04:14.135937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.153 [2024-04-16 23:04:14.135962] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.153 qpair failed and we were unable to recover it. 00:26:23.153 [2024-04-16 23:04:14.136072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.153 [2024-04-16 23:04:14.136240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.153 [2024-04-16 23:04:14.136266] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.153 qpair failed and we were unable to recover it. 00:26:23.153 [2024-04-16 23:04:14.136433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.153 [2024-04-16 23:04:14.136536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.153 [2024-04-16 23:04:14.136560] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.153 qpair failed and we were unable to recover it. 00:26:23.153 [2024-04-16 23:04:14.136694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.153 [2024-04-16 23:04:14.136804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.153 [2024-04-16 23:04:14.136829] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.153 qpair failed and we were unable to recover it. 00:26:23.153 [2024-04-16 23:04:14.136935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.153 [2024-04-16 23:04:14.137049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.153 [2024-04-16 23:04:14.137073] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.153 qpair failed and we were unable to recover it. 00:26:23.153 [2024-04-16 23:04:14.137227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.153 [2024-04-16 23:04:14.137363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.153 [2024-04-16 23:04:14.137388] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.153 qpair failed and we were unable to recover it. 00:26:23.153 [2024-04-16 23:04:14.137497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.153 [2024-04-16 23:04:14.137649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.153 [2024-04-16 23:04:14.137674] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.153 qpair failed and we were unable to recover it. 00:26:23.153 [2024-04-16 23:04:14.137787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.153 [2024-04-16 23:04:14.137916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.153 [2024-04-16 23:04:14.137941] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.153 qpair failed and we were unable to recover it. 00:26:23.153 [2024-04-16 23:04:14.138054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.153 [2024-04-16 23:04:14.138201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.153 [2024-04-16 23:04:14.138227] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.153 qpair failed and we were unable to recover it. 00:26:23.153 [2024-04-16 23:04:14.138351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.153 [2024-04-16 23:04:14.138471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.153 [2024-04-16 23:04:14.138495] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.153 qpair failed and we were unable to recover it. 00:26:23.153 [2024-04-16 23:04:14.138614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.153 [2024-04-16 23:04:14.138728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.153 [2024-04-16 23:04:14.138754] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.153 qpair failed and we were unable to recover it. 00:26:23.153 [2024-04-16 23:04:14.138898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.153 [2024-04-16 23:04:14.139017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.153 [2024-04-16 23:04:14.139041] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.153 qpair failed and we were unable to recover it. 00:26:23.153 [2024-04-16 23:04:14.139166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.153 [2024-04-16 23:04:14.139286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.153 [2024-04-16 23:04:14.139311] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.153 qpair failed and we were unable to recover it. 00:26:23.153 [2024-04-16 23:04:14.139425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.153 [2024-04-16 23:04:14.139565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.153 [2024-04-16 23:04:14.139590] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.153 qpair failed and we were unable to recover it. 00:26:23.153 [2024-04-16 23:04:14.139732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.153 [2024-04-16 23:04:14.139876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.153 [2024-04-16 23:04:14.139902] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.153 qpair failed and we were unable to recover it. 00:26:23.153 [2024-04-16 23:04:14.140024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.153 [2024-04-16 23:04:14.140162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.153 [2024-04-16 23:04:14.140194] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.153 qpair failed and we were unable to recover it. 00:26:23.153 [2024-04-16 23:04:14.140311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.153 [2024-04-16 23:04:14.140433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.153 [2024-04-16 23:04:14.140457] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.153 qpair failed and we were unable to recover it. 00:26:23.153 [2024-04-16 23:04:14.140601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.153 [2024-04-16 23:04:14.140720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.154 [2024-04-16 23:04:14.140744] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.154 qpair failed and we were unable to recover it. 00:26:23.154 [2024-04-16 23:04:14.140880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.154 [2024-04-16 23:04:14.140988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.154 [2024-04-16 23:04:14.141012] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.154 qpair failed and we were unable to recover it. 00:26:23.154 [2024-04-16 23:04:14.141128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.154 [2024-04-16 23:04:14.141260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.154 [2024-04-16 23:04:14.141286] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.154 qpair failed and we were unable to recover it. 00:26:23.154 [2024-04-16 23:04:14.141464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.154 [2024-04-16 23:04:14.141574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.154 [2024-04-16 23:04:14.141599] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.154 qpair failed and we were unable to recover it. 00:26:23.154 [2024-04-16 23:04:14.141741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.154 [2024-04-16 23:04:14.141882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.154 [2024-04-16 23:04:14.141906] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.154 qpair failed and we were unable to recover it. 00:26:23.154 [2024-04-16 23:04:14.142038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.154 [2024-04-16 23:04:14.142191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.154 [2024-04-16 23:04:14.142216] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.154 qpair failed and we were unable to recover it. 00:26:23.154 [2024-04-16 23:04:14.142328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.154 [2024-04-16 23:04:14.142461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.154 [2024-04-16 23:04:14.142486] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.154 qpair failed and we were unable to recover it. 00:26:23.154 [2024-04-16 23:04:14.142629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.154 [2024-04-16 23:04:14.142747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.154 [2024-04-16 23:04:14.142772] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.154 qpair failed and we were unable to recover it. 00:26:23.154 [2024-04-16 23:04:14.142889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.154 [2024-04-16 23:04:14.143036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.154 [2024-04-16 23:04:14.143062] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.154 qpair failed and we were unable to recover it. 00:26:23.154 [2024-04-16 23:04:14.143199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.154 [2024-04-16 23:04:14.143315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.154 [2024-04-16 23:04:14.143340] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.154 qpair failed and we were unable to recover it. 00:26:23.154 [2024-04-16 23:04:14.143488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.154 [2024-04-16 23:04:14.143609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.154 [2024-04-16 23:04:14.143634] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.154 qpair failed and we were unable to recover it. 00:26:23.154 [2024-04-16 23:04:14.143780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.154 [2024-04-16 23:04:14.143899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.154 [2024-04-16 23:04:14.143924] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.154 qpair failed and we were unable to recover it. 00:26:23.154 [2024-04-16 23:04:14.144040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.154 [2024-04-16 23:04:14.144157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.154 [2024-04-16 23:04:14.144194] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.154 qpair failed and we were unable to recover it. 00:26:23.154 [2024-04-16 23:04:14.144339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.154 [2024-04-16 23:04:14.144453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.154 [2024-04-16 23:04:14.144478] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.154 qpair failed and we were unable to recover it. 00:26:23.154 [2024-04-16 23:04:14.144593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.154 [2024-04-16 23:04:14.144743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.154 [2024-04-16 23:04:14.144768] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.154 qpair failed and we were unable to recover it. 00:26:23.154 [2024-04-16 23:04:14.144937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.154 [2024-04-16 23:04:14.145070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.154 [2024-04-16 23:04:14.145095] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.154 qpair failed and we were unable to recover it. 00:26:23.154 [2024-04-16 23:04:14.145266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.154 [2024-04-16 23:04:14.145414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.154 [2024-04-16 23:04:14.145439] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.154 qpair failed and we were unable to recover it. 00:26:23.154 [2024-04-16 23:04:14.145585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.154 [2024-04-16 23:04:14.145695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.154 [2024-04-16 23:04:14.145719] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.154 qpair failed and we were unable to recover it. 00:26:23.154 [2024-04-16 23:04:14.145828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.154 [2024-04-16 23:04:14.145970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.154 [2024-04-16 23:04:14.145995] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.154 qpair failed and we were unable to recover it. 00:26:23.154 [2024-04-16 23:04:14.146136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.154 [2024-04-16 23:04:14.146304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.154 [2024-04-16 23:04:14.146330] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.154 qpair failed and we were unable to recover it. 00:26:23.154 [2024-04-16 23:04:14.146439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.154 [2024-04-16 23:04:14.146557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.154 [2024-04-16 23:04:14.146582] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.154 qpair failed and we were unable to recover it. 00:26:23.154 [2024-04-16 23:04:14.146688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.154 [2024-04-16 23:04:14.146827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.154 [2024-04-16 23:04:14.146853] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.154 qpair failed and we were unable to recover it. 00:26:23.154 [2024-04-16 23:04:14.146968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.154 [2024-04-16 23:04:14.147112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.154 [2024-04-16 23:04:14.147140] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.154 qpair failed and we were unable to recover it. 00:26:23.154 [2024-04-16 23:04:14.147266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.154 [2024-04-16 23:04:14.147409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.154 [2024-04-16 23:04:14.147435] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.154 qpair failed and we were unable to recover it. 00:26:23.154 [2024-04-16 23:04:14.147584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.154 [2024-04-16 23:04:14.147692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.154 [2024-04-16 23:04:14.147717] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.154 qpair failed and we were unable to recover it. 00:26:23.154 [2024-04-16 23:04:14.147887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.154 [2024-04-16 23:04:14.148060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.154 [2024-04-16 23:04:14.148085] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.154 qpair failed and we were unable to recover it. 00:26:23.154 [2024-04-16 23:04:14.148241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.154 [2024-04-16 23:04:14.148408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.154 [2024-04-16 23:04:14.148433] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.154 qpair failed and we were unable to recover it. 00:26:23.154 [2024-04-16 23:04:14.148612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.154 [2024-04-16 23:04:14.148792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.154 [2024-04-16 23:04:14.148816] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.154 qpair failed and we were unable to recover it. 00:26:23.154 [2024-04-16 23:04:14.148958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.154 [2024-04-16 23:04:14.149073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.154 [2024-04-16 23:04:14.149098] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.154 qpair failed and we were unable to recover it. 00:26:23.154 [2024-04-16 23:04:14.149240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.154 [2024-04-16 23:04:14.149388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.154 [2024-04-16 23:04:14.149412] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.154 qpair failed and we were unable to recover it. 00:26:23.154 [2024-04-16 23:04:14.149544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.154 [2024-04-16 23:04:14.149650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.154 [2024-04-16 23:04:14.149674] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.154 qpair failed and we were unable to recover it. 00:26:23.154 [2024-04-16 23:04:14.149812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.154 [2024-04-16 23:04:14.149952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.154 [2024-04-16 23:04:14.149976] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.154 qpair failed and we were unable to recover it. 00:26:23.154 [2024-04-16 23:04:14.150116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.154 [2024-04-16 23:04:14.150229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.154 [2024-04-16 23:04:14.150255] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.154 qpair failed and we were unable to recover it. 00:26:23.154 [2024-04-16 23:04:14.150375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.154 [2024-04-16 23:04:14.150513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.154 [2024-04-16 23:04:14.150538] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.154 qpair failed and we were unable to recover it. 00:26:23.154 [2024-04-16 23:04:14.150650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.154 [2024-04-16 23:04:14.150794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.154 [2024-04-16 23:04:14.150819] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.154 qpair failed and we were unable to recover it. 00:26:23.154 [2024-04-16 23:04:14.150973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.154 [2024-04-16 23:04:14.151116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.154 [2024-04-16 23:04:14.151142] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.154 qpair failed and we were unable to recover it. 00:26:23.154 [2024-04-16 23:04:14.151341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.154 [2024-04-16 23:04:14.151452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.154 [2024-04-16 23:04:14.151477] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.154 qpair failed and we were unable to recover it. 00:26:23.154 [2024-04-16 23:04:14.151633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.154 [2024-04-16 23:04:14.151747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.154 [2024-04-16 23:04:14.151772] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.154 qpair failed and we were unable to recover it. 00:26:23.154 [2024-04-16 23:04:14.151923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.154 [2024-04-16 23:04:14.152091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.154 [2024-04-16 23:04:14.152115] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.154 qpair failed and we were unable to recover it. 00:26:23.154 [2024-04-16 23:04:14.152255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.154 [2024-04-16 23:04:14.152369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.154 [2024-04-16 23:04:14.152393] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.154 qpair failed and we were unable to recover it. 00:26:23.154 [2024-04-16 23:04:14.152532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.154 [2024-04-16 23:04:14.152698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.154 [2024-04-16 23:04:14.152722] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.154 qpair failed and we were unable to recover it. 00:26:23.154 [2024-04-16 23:04:14.152892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.154 [2024-04-16 23:04:14.152998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.154 [2024-04-16 23:04:14.153022] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.154 qpair failed and we were unable to recover it. 00:26:23.154 [2024-04-16 23:04:14.153180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.154 [2024-04-16 23:04:14.153305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.154 [2024-04-16 23:04:14.153330] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.154 qpair failed and we were unable to recover it. 00:26:23.154 [2024-04-16 23:04:14.153443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.154 [2024-04-16 23:04:14.153583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.154 [2024-04-16 23:04:14.153607] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.154 qpair failed and we were unable to recover it. 00:26:23.154 [2024-04-16 23:04:14.153722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.154 [2024-04-16 23:04:14.153855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.154 [2024-04-16 23:04:14.153879] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.154 qpair failed and we were unable to recover it. 00:26:23.154 [2024-04-16 23:04:14.153991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.154 [2024-04-16 23:04:14.154129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.154 [2024-04-16 23:04:14.154154] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.154 qpair failed and we were unable to recover it. 00:26:23.154 [2024-04-16 23:04:14.154301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.154 [2024-04-16 23:04:14.154456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.154 [2024-04-16 23:04:14.154481] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.154 qpair failed and we were unable to recover it. 00:26:23.154 [2024-04-16 23:04:14.154639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.154 [2024-04-16 23:04:14.154795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.154 [2024-04-16 23:04:14.154820] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.154 qpair failed and we were unable to recover it. 00:26:23.154 [2024-04-16 23:04:14.154969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.154 [2024-04-16 23:04:14.155092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.154 [2024-04-16 23:04:14.155116] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.154 qpair failed and we were unable to recover it. 00:26:23.154 [2024-04-16 23:04:14.155260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.154 [2024-04-16 23:04:14.155372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.154 [2024-04-16 23:04:14.155397] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.154 qpair failed and we were unable to recover it. 00:26:23.154 [2024-04-16 23:04:14.155538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.154 [2024-04-16 23:04:14.155653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.154 [2024-04-16 23:04:14.155678] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.154 qpair failed and we were unable to recover it. 00:26:23.154 [2024-04-16 23:04:14.155790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.154 [2024-04-16 23:04:14.155915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.154 [2024-04-16 23:04:14.155940] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.154 qpair failed and we were unable to recover it. 00:26:23.154 [2024-04-16 23:04:14.156098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.154 [2024-04-16 23:04:14.156217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.154 [2024-04-16 23:04:14.156243] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.154 qpair failed and we were unable to recover it. 00:26:23.154 [2024-04-16 23:04:14.156387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.154 [2024-04-16 23:04:14.156540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.154 [2024-04-16 23:04:14.156564] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.154 qpair failed and we were unable to recover it. 00:26:23.154 [2024-04-16 23:04:14.156700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.154 [2024-04-16 23:04:14.156837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.154 [2024-04-16 23:04:14.156861] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.154 qpair failed and we were unable to recover it. 00:26:23.154 [2024-04-16 23:04:14.157031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.155 [2024-04-16 23:04:14.157138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.155 [2024-04-16 23:04:14.157162] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.155 qpair failed and we were unable to recover it. 00:26:23.155 [2024-04-16 23:04:14.157314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.155 [2024-04-16 23:04:14.157449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.155 [2024-04-16 23:04:14.157474] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.155 qpair failed and we were unable to recover it. 00:26:23.155 [2024-04-16 23:04:14.157584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.155 [2024-04-16 23:04:14.157701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.155 [2024-04-16 23:04:14.157725] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.155 qpair failed and we were unable to recover it. 00:26:23.155 [2024-04-16 23:04:14.157835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.155 [2024-04-16 23:04:14.157941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.155 [2024-04-16 23:04:14.157966] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.155 qpair failed and we were unable to recover it. 00:26:23.155 [2024-04-16 23:04:14.158078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.155 [2024-04-16 23:04:14.158186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.155 [2024-04-16 23:04:14.158212] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.155 qpair failed and we were unable to recover it. 00:26:23.155 [2024-04-16 23:04:14.158338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.155 [2024-04-16 23:04:14.158502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.155 [2024-04-16 23:04:14.158527] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.155 qpair failed and we were unable to recover it. 00:26:23.155 [2024-04-16 23:04:14.158684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.155 [2024-04-16 23:04:14.158820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.155 [2024-04-16 23:04:14.158845] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.155 qpair failed and we were unable to recover it. 00:26:23.155 [2024-04-16 23:04:14.158959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.155 [2024-04-16 23:04:14.159065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.155 [2024-04-16 23:04:14.159089] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.155 qpair failed and we were unable to recover it. 00:26:23.155 [2024-04-16 23:04:14.159234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.155 [2024-04-16 23:04:14.159408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.155 [2024-04-16 23:04:14.159434] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.155 qpair failed and we were unable to recover it. 00:26:23.155 [2024-04-16 23:04:14.159574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.155 [2024-04-16 23:04:14.159682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.155 [2024-04-16 23:04:14.159707] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.155 qpair failed and we were unable to recover it. 00:26:23.155 [2024-04-16 23:04:14.159842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.155 [2024-04-16 23:04:14.159983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.155 [2024-04-16 23:04:14.160007] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.155 qpair failed and we were unable to recover it. 00:26:23.155 [2024-04-16 23:04:14.160114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.155 [2024-04-16 23:04:14.160289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.155 [2024-04-16 23:04:14.160315] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.155 qpair failed and we were unable to recover it. 00:26:23.155 [2024-04-16 23:04:14.160458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.155 [2024-04-16 23:04:14.160594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.155 [2024-04-16 23:04:14.160619] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.155 qpair failed and we were unable to recover it. 00:26:23.155 [2024-04-16 23:04:14.160759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.155 [2024-04-16 23:04:14.160898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.155 [2024-04-16 23:04:14.160923] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.155 qpair failed and we were unable to recover it. 00:26:23.155 [2024-04-16 23:04:14.161056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.155 [2024-04-16 23:04:14.161162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.155 [2024-04-16 23:04:14.161194] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.155 qpair failed and we were unable to recover it. 00:26:23.155 [2024-04-16 23:04:14.161316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.155 [2024-04-16 23:04:14.161460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.155 [2024-04-16 23:04:14.161487] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.155 qpair failed and we were unable to recover it. 00:26:23.155 [2024-04-16 23:04:14.161623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.155 [2024-04-16 23:04:14.161789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.155 [2024-04-16 23:04:14.161813] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.155 qpair failed and we were unable to recover it. 00:26:23.155 [2024-04-16 23:04:14.161919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.155 [2024-04-16 23:04:14.162092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.155 [2024-04-16 23:04:14.162117] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.155 qpair failed and we were unable to recover it. 00:26:23.155 [2024-04-16 23:04:14.162232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.155 [2024-04-16 23:04:14.162347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.155 [2024-04-16 23:04:14.162377] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.155 qpair failed and we were unable to recover it. 00:26:23.155 [2024-04-16 23:04:14.162537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.155 [2024-04-16 23:04:14.162671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.155 [2024-04-16 23:04:14.162696] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.155 qpair failed and we were unable to recover it. 00:26:23.155 [2024-04-16 23:04:14.162872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.155 [2024-04-16 23:04:14.162983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.155 [2024-04-16 23:04:14.163010] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.155 qpair failed and we were unable to recover it. 00:26:23.155 [2024-04-16 23:04:14.163149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.155 [2024-04-16 23:04:14.163296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.155 [2024-04-16 23:04:14.163322] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.155 qpair failed and we were unable to recover it. 00:26:23.155 [2024-04-16 23:04:14.163463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.155 [2024-04-16 23:04:14.163595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.155 [2024-04-16 23:04:14.163620] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.155 qpair failed and we were unable to recover it. 00:26:23.155 [2024-04-16 23:04:14.163755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.155 [2024-04-16 23:04:14.163863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.155 [2024-04-16 23:04:14.163888] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.155 qpair failed and we were unable to recover it. 00:26:23.155 [2024-04-16 23:04:14.163999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.155 [2024-04-16 23:04:14.164143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.155 [2024-04-16 23:04:14.164168] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.155 qpair failed and we were unable to recover it. 00:26:23.155 [2024-04-16 23:04:14.164315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.155 [2024-04-16 23:04:14.164484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.155 [2024-04-16 23:04:14.164509] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.155 qpair failed and we were unable to recover it. 00:26:23.155 [2024-04-16 23:04:14.164654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.155 [2024-04-16 23:04:14.164791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.155 [2024-04-16 23:04:14.164816] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.155 qpair failed and we were unable to recover it. 00:26:23.155 [2024-04-16 23:04:14.164964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.155 [2024-04-16 23:04:14.165105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.155 [2024-04-16 23:04:14.165129] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.155 qpair failed and we were unable to recover it. 00:26:23.155 [2024-04-16 23:04:14.165242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.155 [2024-04-16 23:04:14.165355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.155 [2024-04-16 23:04:14.165379] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.155 qpair failed and we were unable to recover it. 00:26:23.155 [2024-04-16 23:04:14.165488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.155 [2024-04-16 23:04:14.165658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.155 [2024-04-16 23:04:14.165683] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.155 qpair failed and we were unable to recover it. 00:26:23.155 [2024-04-16 23:04:14.165824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.155 [2024-04-16 23:04:14.165939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.155 [2024-04-16 23:04:14.165964] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.155 qpair failed and we were unable to recover it. 00:26:23.155 [2024-04-16 23:04:14.166070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.155 [2024-04-16 23:04:14.166235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.155 [2024-04-16 23:04:14.166261] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.155 qpair failed and we were unable to recover it. 00:26:23.155 [2024-04-16 23:04:14.166372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.155 [2024-04-16 23:04:14.166498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.155 [2024-04-16 23:04:14.166523] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.155 qpair failed and we were unable to recover it. 00:26:23.155 [2024-04-16 23:04:14.166637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.155 [2024-04-16 23:04:14.166777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.155 [2024-04-16 23:04:14.166802] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.155 qpair failed and we were unable to recover it. 00:26:23.155 [2024-04-16 23:04:14.166911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.155 [2024-04-16 23:04:14.167016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.155 [2024-04-16 23:04:14.167041] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.155 qpair failed and we were unable to recover it. 00:26:23.155 [2024-04-16 23:04:14.167206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.155 [2024-04-16 23:04:14.167362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.155 [2024-04-16 23:04:14.167387] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.155 qpair failed and we were unable to recover it. 00:26:23.155 [2024-04-16 23:04:14.167499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.155 [2024-04-16 23:04:14.167642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.155 [2024-04-16 23:04:14.167667] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.155 qpair failed and we were unable to recover it. 00:26:23.155 [2024-04-16 23:04:14.167810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.155 [2024-04-16 23:04:14.167947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.155 [2024-04-16 23:04:14.167972] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.155 qpair failed and we were unable to recover it. 00:26:23.155 [2024-04-16 23:04:14.168086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.155 [2024-04-16 23:04:14.168197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.155 [2024-04-16 23:04:14.168222] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.155 qpair failed and we were unable to recover it. 00:26:23.155 [2024-04-16 23:04:14.168370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.155 [2024-04-16 23:04:14.168487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.155 [2024-04-16 23:04:14.168512] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.155 qpair failed and we were unable to recover it. 00:26:23.155 [2024-04-16 23:04:14.168658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.155 [2024-04-16 23:04:14.168815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.155 [2024-04-16 23:04:14.168839] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.155 qpair failed and we were unable to recover it. 00:26:23.155 [2024-04-16 23:04:14.168976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.155 [2024-04-16 23:04:14.169087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.155 [2024-04-16 23:04:14.169111] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.155 qpair failed and we were unable to recover it. 00:26:23.155 [2024-04-16 23:04:14.169251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.155 [2024-04-16 23:04:14.169362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.155 [2024-04-16 23:04:14.169386] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.155 qpair failed and we were unable to recover it. 00:26:23.155 [2024-04-16 23:04:14.169555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.155 [2024-04-16 23:04:14.169668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.155 [2024-04-16 23:04:14.169693] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.155 qpair failed and we were unable to recover it. 00:26:23.155 [2024-04-16 23:04:14.169805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.155 [2024-04-16 23:04:14.169923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.155 [2024-04-16 23:04:14.169948] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.155 qpair failed and we were unable to recover it. 00:26:23.155 [2024-04-16 23:04:14.170092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.155 [2024-04-16 23:04:14.170213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.155 [2024-04-16 23:04:14.170239] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.155 qpair failed and we were unable to recover it. 00:26:23.155 [2024-04-16 23:04:14.170360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.155 [2024-04-16 23:04:14.170473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.155 [2024-04-16 23:04:14.170498] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.155 qpair failed and we were unable to recover it. 00:26:23.155 [2024-04-16 23:04:14.170613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.155 [2024-04-16 23:04:14.170719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.155 [2024-04-16 23:04:14.170743] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.155 qpair failed and we were unable to recover it. 00:26:23.155 [2024-04-16 23:04:14.170848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.155 [2024-04-16 23:04:14.170975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.155 [2024-04-16 23:04:14.171000] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.155 qpair failed and we were unable to recover it. 00:26:23.155 [2024-04-16 23:04:14.171159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.155 [2024-04-16 23:04:14.171302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.155 [2024-04-16 23:04:14.171327] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.155 qpair failed and we were unable to recover it. 00:26:23.155 [2024-04-16 23:04:14.171435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.156 [2024-04-16 23:04:14.171582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.156 [2024-04-16 23:04:14.171606] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.156 qpair failed and we were unable to recover it. 00:26:23.156 [2024-04-16 23:04:14.171724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.156 [2024-04-16 23:04:14.171834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.156 [2024-04-16 23:04:14.171859] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.156 qpair failed and we were unable to recover it. 00:26:23.156 [2024-04-16 23:04:14.171970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.156 [2024-04-16 23:04:14.172110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.156 [2024-04-16 23:04:14.172135] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.156 qpair failed and we were unable to recover it. 00:26:23.156 [2024-04-16 23:04:14.172282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.156 [2024-04-16 23:04:14.172420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.156 [2024-04-16 23:04:14.172445] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.156 qpair failed and we were unable to recover it. 00:26:23.156 [2024-04-16 23:04:14.172589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.156 [2024-04-16 23:04:14.172727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.156 [2024-04-16 23:04:14.172752] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.156 qpair failed and we were unable to recover it. 00:26:23.156 [2024-04-16 23:04:14.172871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.156 [2024-04-16 23:04:14.172978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.156 [2024-04-16 23:04:14.173003] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.156 qpair failed and we were unable to recover it. 00:26:23.156 [2024-04-16 23:04:14.173114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.156 [2024-04-16 23:04:14.173232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.156 [2024-04-16 23:04:14.173258] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.156 qpair failed and we were unable to recover it. 00:26:23.156 [2024-04-16 23:04:14.173381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.156 [2024-04-16 23:04:14.173539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.156 [2024-04-16 23:04:14.173564] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.156 qpair failed and we were unable to recover it. 00:26:23.156 [2024-04-16 23:04:14.173681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.156 [2024-04-16 23:04:14.173824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.156 [2024-04-16 23:04:14.173849] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.156 qpair failed and we were unable to recover it. 00:26:23.156 [2024-04-16 23:04:14.173972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.156 [2024-04-16 23:04:14.174117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.156 [2024-04-16 23:04:14.174142] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.156 qpair failed and we were unable to recover it. 00:26:23.156 [2024-04-16 23:04:14.174271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.156 [2024-04-16 23:04:14.174382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.156 [2024-04-16 23:04:14.174407] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.156 qpair failed and we were unable to recover it. 00:26:23.156 [2024-04-16 23:04:14.174525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.156 [2024-04-16 23:04:14.174667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.156 [2024-04-16 23:04:14.174691] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.156 qpair failed and we were unable to recover it. 00:26:23.156 [2024-04-16 23:04:14.174831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.156 [2024-04-16 23:04:14.174943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.156 [2024-04-16 23:04:14.174968] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.156 qpair failed and we were unable to recover it. 00:26:23.156 [2024-04-16 23:04:14.175108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.156 [2024-04-16 23:04:14.175220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.156 [2024-04-16 23:04:14.175246] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.156 qpair failed and we were unable to recover it. 00:26:23.156 [2024-04-16 23:04:14.175363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.156 [2024-04-16 23:04:14.175482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.156 [2024-04-16 23:04:14.175508] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.156 qpair failed and we were unable to recover it. 00:26:23.156 [2024-04-16 23:04:14.175636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.156 [2024-04-16 23:04:14.175780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.156 [2024-04-16 23:04:14.175804] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.156 qpair failed and we were unable to recover it. 00:26:23.156 [2024-04-16 23:04:14.175944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.156 [2024-04-16 23:04:14.176088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.156 [2024-04-16 23:04:14.176113] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.156 qpair failed and we were unable to recover it. 00:26:23.156 [2024-04-16 23:04:14.176247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.156 [2024-04-16 23:04:14.176365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.156 [2024-04-16 23:04:14.176390] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.156 qpair failed and we were unable to recover it. 00:26:23.156 [2024-04-16 23:04:14.176537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.156 [2024-04-16 23:04:14.176657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.156 [2024-04-16 23:04:14.176683] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.156 qpair failed and we were unable to recover it. 00:26:23.156 [2024-04-16 23:04:14.176804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.156 [2024-04-16 23:04:14.176921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.156 [2024-04-16 23:04:14.176952] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.156 qpair failed and we were unable to recover it. 00:26:23.156 [2024-04-16 23:04:14.177067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.156 [2024-04-16 23:04:14.177195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.156 [2024-04-16 23:04:14.177220] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.156 qpair failed and we were unable to recover it. 00:26:23.156 [2024-04-16 23:04:14.177342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.156 [2024-04-16 23:04:14.177460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.156 [2024-04-16 23:04:14.177485] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.156 qpair failed and we were unable to recover it. 00:26:23.156 [2024-04-16 23:04:14.177624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.156 [2024-04-16 23:04:14.177762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.156 [2024-04-16 23:04:14.177787] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.156 qpair failed and we were unable to recover it. 00:26:23.156 [2024-04-16 23:04:14.177929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.156 [2024-04-16 23:04:14.178046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.156 [2024-04-16 23:04:14.178072] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.156 qpair failed and we were unable to recover it. 00:26:23.156 [2024-04-16 23:04:14.178189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.156 [2024-04-16 23:04:14.178329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.156 [2024-04-16 23:04:14.178354] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.156 qpair failed and we were unable to recover it. 00:26:23.156 [2024-04-16 23:04:14.178503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.156 [2024-04-16 23:04:14.178639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.156 [2024-04-16 23:04:14.178663] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.156 qpair failed and we were unable to recover it. 00:26:23.156 [2024-04-16 23:04:14.178808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.156 [2024-04-16 23:04:14.178946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.156 [2024-04-16 23:04:14.178970] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.156 qpair failed and we were unable to recover it. 00:26:23.156 [2024-04-16 23:04:14.179081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.156 [2024-04-16 23:04:14.179200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.156 [2024-04-16 23:04:14.179225] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.156 qpair failed and we were unable to recover it. 00:26:23.156 [2024-04-16 23:04:14.179350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.156 [2024-04-16 23:04:14.179488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.156 [2024-04-16 23:04:14.179513] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.156 qpair failed and we were unable to recover it. 00:26:23.156 [2024-04-16 23:04:14.179629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.156 [2024-04-16 23:04:14.179749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.156 [2024-04-16 23:04:14.179774] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.156 qpair failed and we were unable to recover it. 00:26:23.156 [2024-04-16 23:04:14.179897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.156 [2024-04-16 23:04:14.180041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.156 [2024-04-16 23:04:14.180067] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.156 qpair failed and we were unable to recover it. 00:26:23.156 [2024-04-16 23:04:14.180182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.156 [2024-04-16 23:04:14.180326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.156 [2024-04-16 23:04:14.180351] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.156 qpair failed and we were unable to recover it. 00:26:23.156 [2024-04-16 23:04:14.180463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.156 [2024-04-16 23:04:14.180581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.156 [2024-04-16 23:04:14.180606] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.156 qpair failed and we were unable to recover it. 00:26:23.156 [2024-04-16 23:04:14.180718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.156 [2024-04-16 23:04:14.180838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.156 [2024-04-16 23:04:14.180863] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.156 qpair failed and we were unable to recover it. 00:26:23.156 [2024-04-16 23:04:14.181000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.156 [2024-04-16 23:04:14.181142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.156 [2024-04-16 23:04:14.181167] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.156 qpair failed and we were unable to recover it. 00:26:23.156 [2024-04-16 23:04:14.181285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.156 [2024-04-16 23:04:14.181419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.156 [2024-04-16 23:04:14.181443] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.156 qpair failed and we were unable to recover it. 00:26:23.156 [2024-04-16 23:04:14.181586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.156 [2024-04-16 23:04:14.181702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.156 [2024-04-16 23:04:14.181727] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.156 qpair failed and we were unable to recover it. 00:26:23.156 [2024-04-16 23:04:14.181865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.156 [2024-04-16 23:04:14.182001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.156 [2024-04-16 23:04:14.182025] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.156 qpair failed and we were unable to recover it. 00:26:23.156 [2024-04-16 23:04:14.182169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.156 [2024-04-16 23:04:14.182316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.156 [2024-04-16 23:04:14.182340] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.156 qpair failed and we were unable to recover it. 00:26:23.156 [2024-04-16 23:04:14.182450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.156 [2024-04-16 23:04:14.182560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.156 [2024-04-16 23:04:14.182585] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.156 qpair failed and we were unable to recover it. 00:26:23.156 [2024-04-16 23:04:14.182729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.156 [2024-04-16 23:04:14.182866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.156 [2024-04-16 23:04:14.182891] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.156 qpair failed and we were unable to recover it. 00:26:23.156 [2024-04-16 23:04:14.183035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.156 [2024-04-16 23:04:14.183181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.156 [2024-04-16 23:04:14.183206] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.156 qpair failed and we were unable to recover it. 00:26:23.156 [2024-04-16 23:04:14.183325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.156 [2024-04-16 23:04:14.183491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.156 [2024-04-16 23:04:14.183515] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.156 qpair failed and we were unable to recover it. 00:26:23.156 [2024-04-16 23:04:14.183626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.156 [2024-04-16 23:04:14.183771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.156 [2024-04-16 23:04:14.183796] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.156 qpair failed and we were unable to recover it. 00:26:23.156 [2024-04-16 23:04:14.183939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.156 [2024-04-16 23:04:14.184052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.156 [2024-04-16 23:04:14.184077] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.156 qpair failed and we were unable to recover it. 00:26:23.156 [2024-04-16 23:04:14.184222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.156 [2024-04-16 23:04:14.184333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.156 [2024-04-16 23:04:14.184357] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.156 qpair failed and we were unable to recover it. 00:26:23.156 [2024-04-16 23:04:14.184480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.156 [2024-04-16 23:04:14.184611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.156 [2024-04-16 23:04:14.184636] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.156 qpair failed and we were unable to recover it. 00:26:23.156 [2024-04-16 23:04:14.184781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.156 [2024-04-16 23:04:14.184924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.156 [2024-04-16 23:04:14.184949] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.156 qpair failed and we were unable to recover it. 00:26:23.156 [2024-04-16 23:04:14.185087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.156 [2024-04-16 23:04:14.185244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.156 [2024-04-16 23:04:14.185270] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.156 qpair failed and we were unable to recover it. 00:26:23.156 [2024-04-16 23:04:14.185383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.156 [2024-04-16 23:04:14.185495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.156 [2024-04-16 23:04:14.185520] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.156 qpair failed and we were unable to recover it. 00:26:23.156 [2024-04-16 23:04:14.185643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.156 [2024-04-16 23:04:14.185787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.156 [2024-04-16 23:04:14.185812] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.156 qpair failed and we were unable to recover it. 00:26:23.156 [2024-04-16 23:04:14.185921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.156 [2024-04-16 23:04:14.186047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.157 [2024-04-16 23:04:14.186071] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.157 qpair failed and we were unable to recover it. 00:26:23.157 [2024-04-16 23:04:14.186189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.157 [2024-04-16 23:04:14.186332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.157 [2024-04-16 23:04:14.186356] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.157 qpair failed and we were unable to recover it. 00:26:23.157 [2024-04-16 23:04:14.186473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.157 [2024-04-16 23:04:14.186620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.157 [2024-04-16 23:04:14.186644] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.157 qpair failed and we were unable to recover it. 00:26:23.157 [2024-04-16 23:04:14.186765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.157 [2024-04-16 23:04:14.186867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.157 [2024-04-16 23:04:14.186891] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.157 qpair failed and we were unable to recover it. 00:26:23.157 [2024-04-16 23:04:14.187004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.157 [2024-04-16 23:04:14.187172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.157 [2024-04-16 23:04:14.187217] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.157 qpair failed and we were unable to recover it. 00:26:23.157 [2024-04-16 23:04:14.187329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.157 [2024-04-16 23:04:14.187442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.157 [2024-04-16 23:04:14.187466] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.157 qpair failed and we were unable to recover it. 00:26:23.157 [2024-04-16 23:04:14.187599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.157 [2024-04-16 23:04:14.187731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.157 [2024-04-16 23:04:14.187756] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.157 qpair failed and we were unable to recover it. 00:26:23.157 [2024-04-16 23:04:14.187895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.157 [2024-04-16 23:04:14.188034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.157 [2024-04-16 23:04:14.188058] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.157 qpair failed and we were unable to recover it. 00:26:23.157 [2024-04-16 23:04:14.188206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.157 [2024-04-16 23:04:14.188353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.157 [2024-04-16 23:04:14.188380] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.157 qpair failed and we were unable to recover it. 00:26:23.157 [2024-04-16 23:04:14.188502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.157 [2024-04-16 23:04:14.188685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.157 [2024-04-16 23:04:14.188710] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.157 qpair failed and we were unable to recover it. 00:26:23.157 [2024-04-16 23:04:14.188854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.157 [2024-04-16 23:04:14.188971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.157 [2024-04-16 23:04:14.188995] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.157 qpair failed and we were unable to recover it. 00:26:23.157 [2024-04-16 23:04:14.189144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.157 [2024-04-16 23:04:14.189287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.157 [2024-04-16 23:04:14.189313] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.157 qpair failed and we were unable to recover it. 00:26:23.157 [2024-04-16 23:04:14.189426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.157 [2024-04-16 23:04:14.189584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.157 [2024-04-16 23:04:14.189609] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.157 qpair failed and we were unable to recover it. 00:26:23.157 [2024-04-16 23:04:14.189752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.157 [2024-04-16 23:04:14.189887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.157 [2024-04-16 23:04:14.189912] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.157 qpair failed and we were unable to recover it. 00:26:23.157 [2024-04-16 23:04:14.190023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.157 [2024-04-16 23:04:14.190133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.157 [2024-04-16 23:04:14.190157] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.157 qpair failed and we were unable to recover it. 00:26:23.157 [2024-04-16 23:04:14.190307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.157 [2024-04-16 23:04:14.190424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.157 [2024-04-16 23:04:14.190449] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.157 qpair failed and we were unable to recover it. 00:26:23.157 [2024-04-16 23:04:14.190620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.157 [2024-04-16 23:04:14.190725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.157 [2024-04-16 23:04:14.190749] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.157 qpair failed and we were unable to recover it. 00:26:23.157 [2024-04-16 23:04:14.190885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.157 [2024-04-16 23:04:14.191019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.157 [2024-04-16 23:04:14.191043] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.157 qpair failed and we were unable to recover it. 00:26:23.157 [2024-04-16 23:04:14.191162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.157 [2024-04-16 23:04:14.191328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.157 [2024-04-16 23:04:14.191354] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.157 qpair failed and we were unable to recover it. 00:26:23.157 [2024-04-16 23:04:14.191466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.157 [2024-04-16 23:04:14.191598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.157 [2024-04-16 23:04:14.191627] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.157 qpair failed and we were unable to recover it. 00:26:23.157 [2024-04-16 23:04:14.191764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.157 [2024-04-16 23:04:14.191873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.157 [2024-04-16 23:04:14.191898] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.157 qpair failed and we were unable to recover it. 00:26:23.157 [2024-04-16 23:04:14.192018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.157 [2024-04-16 23:04:14.192150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.157 [2024-04-16 23:04:14.192182] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.157 qpair failed and we were unable to recover it. 00:26:23.157 [2024-04-16 23:04:14.192310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.157 [2024-04-16 23:04:14.192434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.157 [2024-04-16 23:04:14.192458] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.157 qpair failed and we were unable to recover it. 00:26:23.157 [2024-04-16 23:04:14.192605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.157 [2024-04-16 23:04:14.192719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.157 [2024-04-16 23:04:14.192744] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.157 qpair failed and we were unable to recover it. 00:26:23.157 [2024-04-16 23:04:14.192887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.157 [2024-04-16 23:04:14.193006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.157 [2024-04-16 23:04:14.193031] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.157 qpair failed and we were unable to recover it. 00:26:23.157 [2024-04-16 23:04:14.193188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.157 [2024-04-16 23:04:14.193335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.157 [2024-04-16 23:04:14.193360] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.157 qpair failed and we were unable to recover it. 00:26:23.157 [2024-04-16 23:04:14.193484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.157 [2024-04-16 23:04:14.193613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.157 [2024-04-16 23:04:14.193638] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.157 qpair failed and we were unable to recover it. 00:26:23.157 [2024-04-16 23:04:14.193813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.157 [2024-04-16 23:04:14.193933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.157 [2024-04-16 23:04:14.193959] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.157 qpair failed and we were unable to recover it. 00:26:23.157 [2024-04-16 23:04:14.194101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.157 [2024-04-16 23:04:14.194227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.157 [2024-04-16 23:04:14.194253] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.157 qpair failed and we were unable to recover it. 00:26:23.157 [2024-04-16 23:04:14.194398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.157 [2024-04-16 23:04:14.194504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.157 [2024-04-16 23:04:14.194532] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.157 qpair failed and we were unable to recover it. 00:26:23.157 [2024-04-16 23:04:14.194680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.157 [2024-04-16 23:04:14.194819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.157 [2024-04-16 23:04:14.194844] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.157 qpair failed and we were unable to recover it. 00:26:23.157 [2024-04-16 23:04:14.194964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.157 [2024-04-16 23:04:14.195082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.157 [2024-04-16 23:04:14.195106] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.157 qpair failed and we were unable to recover it. 00:26:23.157 [2024-04-16 23:04:14.195228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.157 [2024-04-16 23:04:14.195341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.157 [2024-04-16 23:04:14.195365] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.157 qpair failed and we were unable to recover it. 00:26:23.157 [2024-04-16 23:04:14.195482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.157 [2024-04-16 23:04:14.195595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.157 [2024-04-16 23:04:14.195619] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.157 qpair failed and we were unable to recover it. 00:26:23.157 [2024-04-16 23:04:14.195738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.157 [2024-04-16 23:04:14.195881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.157 [2024-04-16 23:04:14.195906] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.157 qpair failed and we were unable to recover it. 00:26:23.157 [2024-04-16 23:04:14.196050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.157 [2024-04-16 23:04:14.196161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.157 [2024-04-16 23:04:14.196192] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.157 qpair failed and we were unable to recover it. 00:26:23.157 [2024-04-16 23:04:14.196331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.157 [2024-04-16 23:04:14.196478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.157 [2024-04-16 23:04:14.196502] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.157 qpair failed and we were unable to recover it. 00:26:23.157 [2024-04-16 23:04:14.196649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.157 [2024-04-16 23:04:14.196766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.157 [2024-04-16 23:04:14.196791] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.157 qpair failed and we were unable to recover it. 00:26:23.157 [2024-04-16 23:04:14.196906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.157 [2024-04-16 23:04:14.197013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.157 [2024-04-16 23:04:14.197038] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.157 qpair failed and we were unable to recover it. 00:26:23.157 [2024-04-16 23:04:14.197187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.157 [2024-04-16 23:04:14.197310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.157 [2024-04-16 23:04:14.197335] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.157 qpair failed and we were unable to recover it. 00:26:23.157 [2024-04-16 23:04:14.197485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.157 [2024-04-16 23:04:14.197600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.157 [2024-04-16 23:04:14.197626] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.157 qpair failed and we were unable to recover it. 00:26:23.157 [2024-04-16 23:04:14.197744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.157 [2024-04-16 23:04:14.197867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.157 [2024-04-16 23:04:14.197892] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.157 qpair failed and we were unable to recover it. 00:26:23.157 [2024-04-16 23:04:14.198000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.157 [2024-04-16 23:04:14.198109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.157 [2024-04-16 23:04:14.198134] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.157 qpair failed and we were unable to recover it. 00:26:23.157 [2024-04-16 23:04:14.198253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.157 [2024-04-16 23:04:14.198267] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:26:23.157 [2024-04-16 23:04:14.198376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.157 [2024-04-16 23:04:14.198388] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:26:23.157 [2024-04-16 23:04:14.198401] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.157 [2024-04-16 23:04:14.198406] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:26:23.157 qpair failed and we were unable to recover it. 00:26:23.157 [2024-04-16 23:04:14.198419] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:26:23.157 [2024-04-16 23:04:14.198524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.157 [2024-04-16 23:04:14.198505] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 5 00:26:23.157 [2024-04-16 23:04:14.198641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.157 [2024-04-16 23:04:14.198668] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.157 qpair failed and we were unable to recover it. 00:26:23.157 [2024-04-16 23:04:14.198641] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 6 00:26:23.157 [2024-04-16 23:04:14.198671] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 7 00:26:23.157 [2024-04-16 23:04:14.198675] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 4 00:26:23.157 [2024-04-16 23:04:14.198777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.157 [2024-04-16 23:04:14.198894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.157 [2024-04-16 23:04:14.198918] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.157 qpair failed and we were unable to recover it. 00:26:23.157 [2024-04-16 23:04:14.199028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.157 [2024-04-16 23:04:14.199143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.157 [2024-04-16 23:04:14.199167] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.157 qpair failed and we were unable to recover it. 00:26:23.157 [2024-04-16 23:04:14.199311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.157 [2024-04-16 23:04:14.199421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.157 [2024-04-16 23:04:14.199446] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.157 qpair failed and we were unable to recover it. 00:26:23.157 [2024-04-16 23:04:14.199591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.157 [2024-04-16 23:04:14.199693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.157 [2024-04-16 23:04:14.199718] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.157 qpair failed and we were unable to recover it. 00:26:23.157 [2024-04-16 23:04:14.199830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.157 [2024-04-16 23:04:14.199967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.157 [2024-04-16 23:04:14.199992] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.157 qpair failed and we were unable to recover it. 00:26:23.157 [2024-04-16 23:04:14.200106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.157 [2024-04-16 23:04:14.200220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.158 [2024-04-16 23:04:14.200245] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.158 qpair failed and we were unable to recover it. 00:26:23.158 [2024-04-16 23:04:14.200355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.158 [2024-04-16 23:04:14.200471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.158 [2024-04-16 23:04:14.200497] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.158 qpair failed and we were unable to recover it. 00:26:23.158 [2024-04-16 23:04:14.200608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.158 [2024-04-16 23:04:14.200719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.158 [2024-04-16 23:04:14.200744] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.158 qpair failed and we were unable to recover it. 00:26:23.158 [2024-04-16 23:04:14.200853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.158 [2024-04-16 23:04:14.200962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.158 [2024-04-16 23:04:14.200986] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.158 qpair failed and we were unable to recover it. 00:26:23.158 [2024-04-16 23:04:14.201092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.158 [2024-04-16 23:04:14.201208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.158 [2024-04-16 23:04:14.201234] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.158 qpair failed and we were unable to recover it. 00:26:23.158 [2024-04-16 23:04:14.201339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.158 [2024-04-16 23:04:14.201446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.158 [2024-04-16 23:04:14.201471] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.158 qpair failed and we were unable to recover it. 00:26:23.158 [2024-04-16 23:04:14.201617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.158 [2024-04-16 23:04:14.201743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.158 [2024-04-16 23:04:14.201768] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.158 qpair failed and we were unable to recover it. 00:26:23.158 [2024-04-16 23:04:14.201885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.158 [2024-04-16 23:04:14.201994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.158 [2024-04-16 23:04:14.202021] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.158 qpair failed and we were unable to recover it. 00:26:23.158 [2024-04-16 23:04:14.202136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.158 [2024-04-16 23:04:14.202269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.158 [2024-04-16 23:04:14.202295] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.158 qpair failed and we were unable to recover it. 00:26:23.158 [2024-04-16 23:04:14.202410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.158 [2024-04-16 23:04:14.202528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.158 [2024-04-16 23:04:14.202552] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.158 qpair failed and we were unable to recover it. 00:26:23.158 [2024-04-16 23:04:14.202657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.158 [2024-04-16 23:04:14.202778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.158 [2024-04-16 23:04:14.202802] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.158 qpair failed and we were unable to recover it. 00:26:23.158 [2024-04-16 23:04:14.202906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.158 [2024-04-16 23:04:14.203044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.158 [2024-04-16 23:04:14.203068] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.158 qpair failed and we were unable to recover it. 00:26:23.158 [2024-04-16 23:04:14.203183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.158 [2024-04-16 23:04:14.203301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.158 [2024-04-16 23:04:14.203326] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.158 qpair failed and we were unable to recover it. 00:26:23.158 [2024-04-16 23:04:14.203441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.158 [2024-04-16 23:04:14.203575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.158 [2024-04-16 23:04:14.203600] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.158 qpair failed and we were unable to recover it. 00:26:23.158 [2024-04-16 23:04:14.203709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.158 [2024-04-16 23:04:14.203811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.158 [2024-04-16 23:04:14.203836] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.158 qpair failed and we were unable to recover it. 00:26:23.158 [2024-04-16 23:04:14.203943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.158 [2024-04-16 23:04:14.204084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.158 [2024-04-16 23:04:14.204110] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.158 qpair failed and we were unable to recover it. 00:26:23.158 [2024-04-16 23:04:14.204219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.158 [2024-04-16 23:04:14.204335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.158 [2024-04-16 23:04:14.204359] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.158 qpair failed and we were unable to recover it. 00:26:23.158 [2024-04-16 23:04:14.204478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.158 [2024-04-16 23:04:14.204603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.158 [2024-04-16 23:04:14.204627] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.158 qpair failed and we were unable to recover it. 00:26:23.158 [2024-04-16 23:04:14.204739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.158 [2024-04-16 23:04:14.204854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.158 [2024-04-16 23:04:14.204878] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.158 qpair failed and we were unable to recover it. 00:26:23.158 [2024-04-16 23:04:14.204980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.158 [2024-04-16 23:04:14.205091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.158 [2024-04-16 23:04:14.205117] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.158 qpair failed and we were unable to recover it. 00:26:23.158 [2024-04-16 23:04:14.205299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.158 [2024-04-16 23:04:14.205431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.158 [2024-04-16 23:04:14.205456] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.158 qpair failed and we were unable to recover it. 00:26:23.158 [2024-04-16 23:04:14.205568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.158 [2024-04-16 23:04:14.205692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.158 [2024-04-16 23:04:14.205716] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.158 qpair failed and we were unable to recover it. 00:26:23.158 [2024-04-16 23:04:14.205828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.158 [2024-04-16 23:04:14.205938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.158 [2024-04-16 23:04:14.205962] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.158 qpair failed and we were unable to recover it. 00:26:23.158 [2024-04-16 23:04:14.206067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.158 [2024-04-16 23:04:14.206215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.158 [2024-04-16 23:04:14.206240] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.158 qpair failed and we were unable to recover it. 00:26:23.158 [2024-04-16 23:04:14.206355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.158 [2024-04-16 23:04:14.206470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.158 [2024-04-16 23:04:14.206494] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.158 qpair failed and we were unable to recover it. 00:26:23.158 [2024-04-16 23:04:14.206612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.158 [2024-04-16 23:04:14.206727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.158 [2024-04-16 23:04:14.206752] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.158 qpair failed and we were unable to recover it. 00:26:23.158 [2024-04-16 23:04:14.206892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.158 [2024-04-16 23:04:14.207009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.158 [2024-04-16 23:04:14.207036] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.158 qpair failed and we were unable to recover it. 00:26:23.158 [2024-04-16 23:04:14.207153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.158 [2024-04-16 23:04:14.207319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.158 [2024-04-16 23:04:14.207344] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.158 qpair failed and we were unable to recover it. 00:26:23.158 [2024-04-16 23:04:14.207459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.158 [2024-04-16 23:04:14.207577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.158 [2024-04-16 23:04:14.207605] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.158 qpair failed and we were unable to recover it. 00:26:23.158 [2024-04-16 23:04:14.207750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.158 [2024-04-16 23:04:14.207868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.158 [2024-04-16 23:04:14.207893] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.158 qpair failed and we were unable to recover it. 00:26:23.158 [2024-04-16 23:04:14.208001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.158 [2024-04-16 23:04:14.208111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.158 [2024-04-16 23:04:14.208135] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.158 qpair failed and we were unable to recover it. 00:26:23.158 [2024-04-16 23:04:14.208258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.158 [2024-04-16 23:04:14.208395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.158 [2024-04-16 23:04:14.208420] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.158 qpair failed and we were unable to recover it. 00:26:23.158 [2024-04-16 23:04:14.208600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.158 [2024-04-16 23:04:14.208721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.158 [2024-04-16 23:04:14.208746] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.158 qpair failed and we were unable to recover it. 00:26:23.158 [2024-04-16 23:04:14.208887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.158 [2024-04-16 23:04:14.209005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.158 [2024-04-16 23:04:14.209029] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.158 qpair failed and we were unable to recover it. 00:26:23.158 [2024-04-16 23:04:14.209189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.158 [2024-04-16 23:04:14.209312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.158 [2024-04-16 23:04:14.209336] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.158 qpair failed and we were unable to recover it. 00:26:23.158 [2024-04-16 23:04:14.209446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.158 [2024-04-16 23:04:14.209554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.158 [2024-04-16 23:04:14.209578] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.158 qpair failed and we were unable to recover it. 00:26:23.158 [2024-04-16 23:04:14.209722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.158 [2024-04-16 23:04:14.209833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.158 [2024-04-16 23:04:14.209858] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.158 qpair failed and we were unable to recover it. 00:26:23.158 [2024-04-16 23:04:14.209972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.158 [2024-04-16 23:04:14.210115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.158 [2024-04-16 23:04:14.210139] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.158 qpair failed and we were unable to recover it. 00:26:23.158 [2024-04-16 23:04:14.210257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.158 [2024-04-16 23:04:14.210388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.158 [2024-04-16 23:04:14.210417] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.158 qpair failed and we were unable to recover it. 00:26:23.158 [2024-04-16 23:04:14.210548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.158 [2024-04-16 23:04:14.210696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.158 [2024-04-16 23:04:14.210720] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.158 qpair failed and we were unable to recover it. 00:26:23.158 [2024-04-16 23:04:14.210829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.158 [2024-04-16 23:04:14.210932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.158 [2024-04-16 23:04:14.210957] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.158 qpair failed and we were unable to recover it. 00:26:23.158 [2024-04-16 23:04:14.211072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.158 [2024-04-16 23:04:14.211187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.158 [2024-04-16 23:04:14.211214] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.158 qpair failed and we were unable to recover it. 00:26:23.158 [2024-04-16 23:04:14.211342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.158 [2024-04-16 23:04:14.211453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.158 [2024-04-16 23:04:14.211478] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.158 qpair failed and we were unable to recover it. 00:26:23.158 [2024-04-16 23:04:14.211585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.158 [2024-04-16 23:04:14.211723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.158 [2024-04-16 23:04:14.211747] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.158 qpair failed and we were unable to recover it. 00:26:23.158 [2024-04-16 23:04:14.211882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.158 [2024-04-16 23:04:14.212018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.158 [2024-04-16 23:04:14.212043] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.158 qpair failed and we were unable to recover it. 00:26:23.158 [2024-04-16 23:04:14.212153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.158 [2024-04-16 23:04:14.212277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.158 [2024-04-16 23:04:14.212302] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.158 qpair failed and we were unable to recover it. 00:26:23.158 [2024-04-16 23:04:14.212458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.158 [2024-04-16 23:04:14.212594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.158 [2024-04-16 23:04:14.212619] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.158 qpair failed and we were unable to recover it. 00:26:23.158 [2024-04-16 23:04:14.212787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.158 [2024-04-16 23:04:14.212892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.158 [2024-04-16 23:04:14.212917] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.158 qpair failed and we were unable to recover it. 00:26:23.158 [2024-04-16 23:04:14.213046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.158 [2024-04-16 23:04:14.213197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.158 [2024-04-16 23:04:14.213242] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.159 qpair failed and we were unable to recover it. 00:26:23.159 [2024-04-16 23:04:14.213397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.159 [2024-04-16 23:04:14.213532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.159 [2024-04-16 23:04:14.213556] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.159 qpair failed and we were unable to recover it. 00:26:23.159 [2024-04-16 23:04:14.213670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.159 [2024-04-16 23:04:14.213831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.159 [2024-04-16 23:04:14.213855] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.159 qpair failed and we were unable to recover it. 00:26:23.159 [2024-04-16 23:04:14.214006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.159 [2024-04-16 23:04:14.214110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.159 [2024-04-16 23:04:14.214134] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.159 qpair failed and we were unable to recover it. 00:26:23.159 [2024-04-16 23:04:14.214302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.159 [2024-04-16 23:04:14.214422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.159 [2024-04-16 23:04:14.214447] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.159 qpair failed and we were unable to recover it. 00:26:23.159 [2024-04-16 23:04:14.214560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.159 [2024-04-16 23:04:14.214681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.159 [2024-04-16 23:04:14.214706] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.159 qpair failed and we were unable to recover it. 00:26:23.159 [2024-04-16 23:04:14.214851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.159 [2024-04-16 23:04:14.214987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.159 [2024-04-16 23:04:14.215011] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.159 qpair failed and we were unable to recover it. 00:26:23.159 [2024-04-16 23:04:14.215117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.159 [2024-04-16 23:04:14.215225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.159 [2024-04-16 23:04:14.215251] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.159 qpair failed and we were unable to recover it. 00:26:23.159 [2024-04-16 23:04:14.215365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.159 [2024-04-16 23:04:14.215483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.159 [2024-04-16 23:04:14.215510] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.159 qpair failed and we were unable to recover it. 00:26:23.159 [2024-04-16 23:04:14.215627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.159 [2024-04-16 23:04:14.215736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.159 [2024-04-16 23:04:14.215761] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.159 qpair failed and we were unable to recover it. 00:26:23.159 [2024-04-16 23:04:14.215884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.159 [2024-04-16 23:04:14.216056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.159 [2024-04-16 23:04:14.216081] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.159 qpair failed and we were unable to recover it. 00:26:23.159 [2024-04-16 23:04:14.216199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.159 [2024-04-16 23:04:14.216323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.159 [2024-04-16 23:04:14.216347] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.159 qpair failed and we were unable to recover it. 00:26:23.159 [2024-04-16 23:04:14.216483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.159 [2024-04-16 23:04:14.216619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.159 [2024-04-16 23:04:14.216644] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.159 qpair failed and we were unable to recover it. 00:26:23.159 [2024-04-16 23:04:14.216778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.159 [2024-04-16 23:04:14.216895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.159 [2024-04-16 23:04:14.216920] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.159 qpair failed and we were unable to recover it. 00:26:23.159 [2024-04-16 23:04:14.217034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.159 [2024-04-16 23:04:14.217173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.159 [2024-04-16 23:04:14.217207] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.159 qpair failed and we were unable to recover it. 00:26:23.159 [2024-04-16 23:04:14.217350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.159 [2024-04-16 23:04:14.217458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.159 [2024-04-16 23:04:14.217483] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.159 qpair failed and we were unable to recover it. 00:26:23.159 [2024-04-16 23:04:14.217606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.159 [2024-04-16 23:04:14.217729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.159 [2024-04-16 23:04:14.217754] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.159 qpair failed and we were unable to recover it. 00:26:23.159 [2024-04-16 23:04:14.217876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.159 [2024-04-16 23:04:14.217999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.159 [2024-04-16 23:04:14.218023] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.159 qpair failed and we were unable to recover it. 00:26:23.159 [2024-04-16 23:04:14.218141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.159 [2024-04-16 23:04:14.218286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.159 [2024-04-16 23:04:14.218311] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.159 qpair failed and we were unable to recover it. 00:26:23.159 [2024-04-16 23:04:14.218421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.159 [2024-04-16 23:04:14.218542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.159 [2024-04-16 23:04:14.218566] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.159 qpair failed and we were unable to recover it. 00:26:23.159 [2024-04-16 23:04:14.218682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.159 [2024-04-16 23:04:14.218794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.159 [2024-04-16 23:04:14.218821] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.159 qpair failed and we were unable to recover it. 00:26:23.159 [2024-04-16 23:04:14.218939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.159 [2024-04-16 23:04:14.219068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.159 [2024-04-16 23:04:14.219094] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.159 qpair failed and we were unable to recover it. 00:26:23.159 [2024-04-16 23:04:14.219245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.159 [2024-04-16 23:04:14.219362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.159 [2024-04-16 23:04:14.219386] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.159 qpair failed and we were unable to recover it. 00:26:23.159 [2024-04-16 23:04:14.219529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.159 [2024-04-16 23:04:14.219658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.159 [2024-04-16 23:04:14.219696] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.159 qpair failed and we were unable to recover it. 00:26:23.159 [2024-04-16 23:04:14.219833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.159 [2024-04-16 23:04:14.219950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.159 [2024-04-16 23:04:14.219976] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.159 qpair failed and we were unable to recover it. 00:26:23.159 [2024-04-16 23:04:14.220083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.159 [2024-04-16 23:04:14.220194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.159 [2024-04-16 23:04:14.220220] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.159 qpair failed and we were unable to recover it. 00:26:23.159 [2024-04-16 23:04:14.220337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.159 [2024-04-16 23:04:14.220455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.159 [2024-04-16 23:04:14.220480] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.159 qpair failed and we were unable to recover it. 00:26:23.159 [2024-04-16 23:04:14.220615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.159 [2024-04-16 23:04:14.220749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.159 [2024-04-16 23:04:14.220774] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.159 qpair failed and we were unable to recover it. 00:26:23.159 [2024-04-16 23:04:14.220890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.159 [2024-04-16 23:04:14.221029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.159 [2024-04-16 23:04:14.221054] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.159 qpair failed and we were unable to recover it. 00:26:23.159 [2024-04-16 23:04:14.221183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.159 [2024-04-16 23:04:14.221300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.159 [2024-04-16 23:04:14.221326] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.159 qpair failed and we were unable to recover it. 00:26:23.159 [2024-04-16 23:04:14.221496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.159 [2024-04-16 23:04:14.221610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.159 [2024-04-16 23:04:14.221634] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.159 qpair failed and we were unable to recover it. 00:26:23.159 [2024-04-16 23:04:14.221750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.159 [2024-04-16 23:04:14.221879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.159 [2024-04-16 23:04:14.221904] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.159 qpair failed and we were unable to recover it. 00:26:23.159 [2024-04-16 23:04:14.222019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.159 [2024-04-16 23:04:14.222173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.159 [2024-04-16 23:04:14.222205] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.159 qpair failed and we were unable to recover it. 00:26:23.159 [2024-04-16 23:04:14.222313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.159 [2024-04-16 23:04:14.222457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.159 [2024-04-16 23:04:14.222481] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.159 qpair failed and we were unable to recover it. 00:26:23.159 [2024-04-16 23:04:14.222637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.159 [2024-04-16 23:04:14.222748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.159 [2024-04-16 23:04:14.222773] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.159 qpair failed and we were unable to recover it. 00:26:23.159 [2024-04-16 23:04:14.222884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.159 [2024-04-16 23:04:14.222994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.159 [2024-04-16 23:04:14.223018] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.159 qpair failed and we were unable to recover it. 00:26:23.159 [2024-04-16 23:04:14.223156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.159 [2024-04-16 23:04:14.223285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.159 [2024-04-16 23:04:14.223310] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.159 qpair failed and we were unable to recover it. 00:26:23.159 [2024-04-16 23:04:14.223436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.159 [2024-04-16 23:04:14.223552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.159 [2024-04-16 23:04:14.223577] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.159 qpair failed and we were unable to recover it. 00:26:23.159 [2024-04-16 23:04:14.223689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.159 [2024-04-16 23:04:14.223829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.159 [2024-04-16 23:04:14.223854] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.159 qpair failed and we were unable to recover it. 00:26:23.159 [2024-04-16 23:04:14.223969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.159 [2024-04-16 23:04:14.224088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.159 [2024-04-16 23:04:14.224113] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.159 qpair failed and we were unable to recover it. 00:26:23.159 [2024-04-16 23:04:14.224236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.159 [2024-04-16 23:04:14.224349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.159 [2024-04-16 23:04:14.224374] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.159 qpair failed and we were unable to recover it. 00:26:23.159 [2024-04-16 23:04:14.224490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.159 [2024-04-16 23:04:14.224603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.159 [2024-04-16 23:04:14.224635] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.159 qpair failed and we were unable to recover it. 00:26:23.159 [2024-04-16 23:04:14.224751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.159 [2024-04-16 23:04:14.224891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.159 [2024-04-16 23:04:14.224915] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.159 qpair failed and we were unable to recover it. 00:26:23.159 [2024-04-16 23:04:14.225034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.159 [2024-04-16 23:04:14.225149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.159 [2024-04-16 23:04:14.225174] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.159 qpair failed and we were unable to recover it. 00:26:23.159 [2024-04-16 23:04:14.225293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.159 [2024-04-16 23:04:14.225409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.159 [2024-04-16 23:04:14.225434] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.159 qpair failed and we were unable to recover it. 00:26:23.159 [2024-04-16 23:04:14.225565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.159 [2024-04-16 23:04:14.225723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.159 [2024-04-16 23:04:14.225748] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.159 qpair failed and we were unable to recover it. 00:26:23.159 [2024-04-16 23:04:14.225862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.159 [2024-04-16 23:04:14.225975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.159 [2024-04-16 23:04:14.226001] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.159 qpair failed and we were unable to recover it. 00:26:23.159 [2024-04-16 23:04:14.226111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.159 [2024-04-16 23:04:14.226230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.159 [2024-04-16 23:04:14.226256] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.159 qpair failed and we were unable to recover it. 00:26:23.159 [2024-04-16 23:04:14.226380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.159 [2024-04-16 23:04:14.226494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.159 [2024-04-16 23:04:14.226519] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.159 qpair failed and we were unable to recover it. 00:26:23.159 [2024-04-16 23:04:14.226667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.159 [2024-04-16 23:04:14.226780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.159 [2024-04-16 23:04:14.226804] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.159 qpair failed and we were unable to recover it. 00:26:23.159 [2024-04-16 23:04:14.226916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.159 [2024-04-16 23:04:14.227079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.159 [2024-04-16 23:04:14.227103] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.159 qpair failed and we were unable to recover it. 00:26:23.159 [2024-04-16 23:04:14.227232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.159 [2024-04-16 23:04:14.227346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.159 [2024-04-16 23:04:14.227371] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.159 qpair failed and we were unable to recover it. 00:26:23.159 [2024-04-16 23:04:14.227485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.159 [2024-04-16 23:04:14.227619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.159 [2024-04-16 23:04:14.227643] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.159 qpair failed and we were unable to recover it. 00:26:23.159 [2024-04-16 23:04:14.227763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.159 [2024-04-16 23:04:14.227908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.159 [2024-04-16 23:04:14.227932] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.159 qpair failed and we were unable to recover it. 00:26:23.159 [2024-04-16 23:04:14.228044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.159 [2024-04-16 23:04:14.228187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.159 [2024-04-16 23:04:14.228213] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.159 qpair failed and we were unable to recover it. 00:26:23.159 [2024-04-16 23:04:14.228328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.160 [2024-04-16 23:04:14.228442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.160 [2024-04-16 23:04:14.228466] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.160 qpair failed and we were unable to recover it. 00:26:23.160 [2024-04-16 23:04:14.228574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.160 [2024-04-16 23:04:14.228692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.160 [2024-04-16 23:04:14.228717] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.160 qpair failed and we were unable to recover it. 00:26:23.160 [2024-04-16 23:04:14.228862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.160 [2024-04-16 23:04:14.228963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.160 [2024-04-16 23:04:14.228988] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.160 qpair failed and we were unable to recover it. 00:26:23.160 [2024-04-16 23:04:14.229134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.160 [2024-04-16 23:04:14.229359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.160 [2024-04-16 23:04:14.229386] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.160 qpair failed and we were unable to recover it. 00:26:23.160 [2024-04-16 23:04:14.229492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.160 [2024-04-16 23:04:14.229606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.160 [2024-04-16 23:04:14.229631] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.160 qpair failed and we were unable to recover it. 00:26:23.160 [2024-04-16 23:04:14.229751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.160 [2024-04-16 23:04:14.229860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.160 [2024-04-16 23:04:14.229884] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.160 qpair failed and we were unable to recover it. 00:26:23.160 [2024-04-16 23:04:14.230012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.160 [2024-04-16 23:04:14.230135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.160 [2024-04-16 23:04:14.230165] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.160 qpair failed and we were unable to recover it. 00:26:23.160 [2024-04-16 23:04:14.230319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.160 [2024-04-16 23:04:14.230420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.160 [2024-04-16 23:04:14.230445] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.160 qpair failed and we were unable to recover it. 00:26:23.160 [2024-04-16 23:04:14.230553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.160 [2024-04-16 23:04:14.230671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.160 [2024-04-16 23:04:14.230698] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.160 qpair failed and we were unable to recover it. 00:26:23.160 [2024-04-16 23:04:14.230807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.160 [2024-04-16 23:04:14.230918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.160 [2024-04-16 23:04:14.230944] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.160 qpair failed and we were unable to recover it. 00:26:23.160 [2024-04-16 23:04:14.231065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.160 [2024-04-16 23:04:14.231205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.160 [2024-04-16 23:04:14.231231] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.160 qpair failed and we were unable to recover it. 00:26:23.160 [2024-04-16 23:04:14.231347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.160 [2024-04-16 23:04:14.231459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.160 [2024-04-16 23:04:14.231483] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.160 qpair failed and we were unable to recover it. 00:26:23.160 [2024-04-16 23:04:14.231624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.160 [2024-04-16 23:04:14.231751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.160 [2024-04-16 23:04:14.231776] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.160 qpair failed and we were unable to recover it. 00:26:23.160 [2024-04-16 23:04:14.231889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.160 [2024-04-16 23:04:14.232008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.160 [2024-04-16 23:04:14.232033] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.160 qpair failed and we were unable to recover it. 00:26:23.160 [2024-04-16 23:04:14.232146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.160 [2024-04-16 23:04:14.232262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.160 [2024-04-16 23:04:14.232289] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.160 qpair failed and we were unable to recover it. 00:26:23.160 [2024-04-16 23:04:14.232459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.160 [2024-04-16 23:04:14.232573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.160 [2024-04-16 23:04:14.232598] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.160 qpair failed and we were unable to recover it. 00:26:23.160 [2024-04-16 23:04:14.232711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.160 [2024-04-16 23:04:14.232856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.160 [2024-04-16 23:04:14.232881] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.160 qpair failed and we were unable to recover it. 00:26:23.160 [2024-04-16 23:04:14.233020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.160 [2024-04-16 23:04:14.233157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.160 [2024-04-16 23:04:14.233190] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.160 qpair failed and we were unable to recover it. 00:26:23.160 [2024-04-16 23:04:14.233316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.160 [2024-04-16 23:04:14.233430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.160 [2024-04-16 23:04:14.233459] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.160 qpair failed and we were unable to recover it. 00:26:23.160 [2024-04-16 23:04:14.233603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.160 [2024-04-16 23:04:14.233723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.160 [2024-04-16 23:04:14.233748] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.160 qpair failed and we were unable to recover it. 00:26:23.160 [2024-04-16 23:04:14.233857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.160 [2024-04-16 23:04:14.233977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.160 [2024-04-16 23:04:14.234002] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.160 qpair failed and we were unable to recover it. 00:26:23.160 [2024-04-16 23:04:14.234120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.160 [2024-04-16 23:04:14.234247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.160 [2024-04-16 23:04:14.234273] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.160 qpair failed and we were unable to recover it. 00:26:23.160 [2024-04-16 23:04:14.234395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.160 [2024-04-16 23:04:14.234525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.160 [2024-04-16 23:04:14.234556] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.160 qpair failed and we were unable to recover it. 00:26:23.160 [2024-04-16 23:04:14.234678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.160 [2024-04-16 23:04:14.234814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.160 [2024-04-16 23:04:14.234839] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.160 qpair failed and we were unable to recover it. 00:26:23.160 [2024-04-16 23:04:14.235010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.160 [2024-04-16 23:04:14.235117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.160 [2024-04-16 23:04:14.235142] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.160 qpair failed and we were unable to recover it. 00:26:23.160 [2024-04-16 23:04:14.235269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.160 [2024-04-16 23:04:14.235376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.160 [2024-04-16 23:04:14.235400] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.160 qpair failed and we were unable to recover it. 00:26:23.160 [2024-04-16 23:04:14.235581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.160 [2024-04-16 23:04:14.235685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.160 [2024-04-16 23:04:14.235710] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.160 qpair failed and we were unable to recover it. 00:26:23.160 [2024-04-16 23:04:14.235844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.160 [2024-04-16 23:04:14.235955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.160 [2024-04-16 23:04:14.235980] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.160 qpair failed and we were unable to recover it. 00:26:23.160 [2024-04-16 23:04:14.236108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.160 [2024-04-16 23:04:14.236235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.160 [2024-04-16 23:04:14.236262] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.160 qpair failed and we were unable to recover it. 00:26:23.160 [2024-04-16 23:04:14.236385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.160 [2024-04-16 23:04:14.236561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.160 [2024-04-16 23:04:14.236586] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.160 qpair failed and we were unable to recover it. 00:26:23.160 [2024-04-16 23:04:14.236766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.160 [2024-04-16 23:04:14.236889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.160 [2024-04-16 23:04:14.236914] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.160 qpair failed and we were unable to recover it. 00:26:23.160 [2024-04-16 23:04:14.237037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.160 [2024-04-16 23:04:14.237153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.160 [2024-04-16 23:04:14.237185] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.160 qpair failed and we were unable to recover it. 00:26:23.160 [2024-04-16 23:04:14.237329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.160 [2024-04-16 23:04:14.237433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.160 [2024-04-16 23:04:14.237467] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.160 qpair failed and we were unable to recover it. 00:26:23.160 [2024-04-16 23:04:14.237606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.160 [2024-04-16 23:04:14.237729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.160 [2024-04-16 23:04:14.237754] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.160 qpair failed and we were unable to recover it. 00:26:23.160 [2024-04-16 23:04:14.237898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.160 [2024-04-16 23:04:14.238037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.160 [2024-04-16 23:04:14.238062] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.160 qpair failed and we were unable to recover it. 00:26:23.160 [2024-04-16 23:04:14.238197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.160 [2024-04-16 23:04:14.238311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.160 [2024-04-16 23:04:14.238336] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.160 qpair failed and we were unable to recover it. 00:26:23.160 [2024-04-16 23:04:14.238514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.160 [2024-04-16 23:04:14.238619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.160 [2024-04-16 23:04:14.238644] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.160 qpair failed and we were unable to recover it. 00:26:23.160 [2024-04-16 23:04:14.238753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.160 [2024-04-16 23:04:14.238873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.160 [2024-04-16 23:04:14.238902] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.160 qpair failed and we were unable to recover it. 00:26:23.160 [2024-04-16 23:04:14.239022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.160 [2024-04-16 23:04:14.239157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.160 [2024-04-16 23:04:14.239226] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.160 qpair failed and we were unable to recover it. 00:26:23.160 [2024-04-16 23:04:14.239347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.160 [2024-04-16 23:04:14.239460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.160 [2024-04-16 23:04:14.239490] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.160 qpair failed and we were unable to recover it. 00:26:23.160 [2024-04-16 23:04:14.239610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.160 [2024-04-16 23:04:14.239725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.160 [2024-04-16 23:04:14.239750] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.160 qpair failed and we were unable to recover it. 00:26:23.160 [2024-04-16 23:04:14.239862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.160 [2024-04-16 23:04:14.239990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.160 [2024-04-16 23:04:14.240015] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.160 qpair failed and we were unable to recover it. 00:26:23.160 [2024-04-16 23:04:14.240129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.160 [2024-04-16 23:04:14.240278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.160 [2024-04-16 23:04:14.240305] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.160 qpair failed and we were unable to recover it. 00:26:23.160 [2024-04-16 23:04:14.240412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.160 [2024-04-16 23:04:14.240530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.160 [2024-04-16 23:04:14.240554] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.160 qpair failed and we were unable to recover it. 00:26:23.160 [2024-04-16 23:04:14.240669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.160 [2024-04-16 23:04:14.240809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.160 [2024-04-16 23:04:14.240834] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.160 qpair failed and we were unable to recover it. 00:26:23.160 [2024-04-16 23:04:14.240943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.160 [2024-04-16 23:04:14.241056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.160 [2024-04-16 23:04:14.241083] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.160 qpair failed and we were unable to recover it. 00:26:23.160 [2024-04-16 23:04:14.241213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.160 [2024-04-16 23:04:14.241341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.161 [2024-04-16 23:04:14.241375] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.161 qpair failed and we were unable to recover it. 00:26:23.161 [2024-04-16 23:04:14.241492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.161 [2024-04-16 23:04:14.241611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.161 [2024-04-16 23:04:14.241636] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.161 qpair failed and we were unable to recover it. 00:26:23.161 [2024-04-16 23:04:14.241751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.161 [2024-04-16 23:04:14.241898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.161 [2024-04-16 23:04:14.241923] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.161 qpair failed and we were unable to recover it. 00:26:23.161 [2024-04-16 23:04:14.242063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.161 [2024-04-16 23:04:14.242188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.161 [2024-04-16 23:04:14.242213] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.161 qpair failed and we were unable to recover it. 00:26:23.161 [2024-04-16 23:04:14.242330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.161 [2024-04-16 23:04:14.242452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.161 [2024-04-16 23:04:14.242488] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.161 qpair failed and we were unable to recover it. 00:26:23.161 [2024-04-16 23:04:14.242611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.161 [2024-04-16 23:04:14.242776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.161 [2024-04-16 23:04:14.242801] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.161 qpair failed and we were unable to recover it. 00:26:23.161 [2024-04-16 23:04:14.242910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.161 [2024-04-16 23:04:14.243047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.161 [2024-04-16 23:04:14.243072] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.161 qpair failed and we were unable to recover it. 00:26:23.161 [2024-04-16 23:04:14.243192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.161 [2024-04-16 23:04:14.243344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.161 [2024-04-16 23:04:14.243375] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.161 qpair failed and we were unable to recover it. 00:26:23.161 [2024-04-16 23:04:14.243523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.161 [2024-04-16 23:04:14.243667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.161 [2024-04-16 23:04:14.243692] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.161 qpair failed and we were unable to recover it. 00:26:23.161 [2024-04-16 23:04:14.243801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.161 [2024-04-16 23:04:14.243944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.161 [2024-04-16 23:04:14.243969] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.161 qpair failed and we were unable to recover it. 00:26:23.161 [2024-04-16 23:04:14.244073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.161 [2024-04-16 23:04:14.244188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.161 [2024-04-16 23:04:14.244214] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.161 qpair failed and we were unable to recover it. 00:26:23.161 [2024-04-16 23:04:14.244334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.161 [2024-04-16 23:04:14.244451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.161 [2024-04-16 23:04:14.244478] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.161 qpair failed and we were unable to recover it. 00:26:23.161 [2024-04-16 23:04:14.244591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.161 [2024-04-16 23:04:14.244714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.161 [2024-04-16 23:04:14.244741] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.161 qpair failed and we were unable to recover it. 00:26:23.161 [2024-04-16 23:04:14.244889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.161 [2024-04-16 23:04:14.245013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.161 [2024-04-16 23:04:14.245039] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.161 qpair failed and we were unable to recover it. 00:26:23.161 [2024-04-16 23:04:14.245150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.443 [2024-04-16 23:04:14.245303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.443 [2024-04-16 23:04:14.245331] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.443 qpair failed and we were unable to recover it. 00:26:23.443 [2024-04-16 23:04:14.245452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.443 [2024-04-16 23:04:14.245562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.443 [2024-04-16 23:04:14.245587] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.443 qpair failed and we were unable to recover it. 00:26:23.443 [2024-04-16 23:04:14.245762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.443 [2024-04-16 23:04:14.245872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.443 [2024-04-16 23:04:14.245907] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.443 qpair failed and we were unable to recover it. 00:26:23.443 [2024-04-16 23:04:14.246014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.443 [2024-04-16 23:04:14.246137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.443 [2024-04-16 23:04:14.246161] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.443 qpair failed and we were unable to recover it. 00:26:23.443 [2024-04-16 23:04:14.246307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.443 [2024-04-16 23:04:14.246416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.443 [2024-04-16 23:04:14.246442] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.443 qpair failed and we were unable to recover it. 00:26:23.443 [2024-04-16 23:04:14.246585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.443 [2024-04-16 23:04:14.246696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.443 [2024-04-16 23:04:14.246722] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.443 qpair failed and we were unable to recover it. 00:26:23.443 [2024-04-16 23:04:14.246846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.443 [2024-04-16 23:04:14.246987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.443 [2024-04-16 23:04:14.247013] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.443 qpair failed and we were unable to recover it. 00:26:23.443 [2024-04-16 23:04:14.247156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.443 [2024-04-16 23:04:14.247272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.443 [2024-04-16 23:04:14.247298] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:23.443 qpair failed and we were unable to recover it. 00:26:23.443 [2024-04-16 23:04:14.247443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.443 [2024-04-16 23:04:14.247571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.443 [2024-04-16 23:04:14.247601] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.443 qpair failed and we were unable to recover it. 00:26:23.443 [2024-04-16 23:04:14.247713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.443 [2024-04-16 23:04:14.247836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.443 [2024-04-16 23:04:14.247862] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.443 qpair failed and we were unable to recover it. 00:26:23.443 [2024-04-16 23:04:14.247975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.444 [2024-04-16 23:04:14.248093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.444 [2024-04-16 23:04:14.248119] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.444 qpair failed and we were unable to recover it. 00:26:23.444 [2024-04-16 23:04:14.248240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.444 [2024-04-16 23:04:14.248384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.444 [2024-04-16 23:04:14.248410] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.444 qpair failed and we were unable to recover it. 00:26:23.444 [2024-04-16 23:04:14.248558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.444 [2024-04-16 23:04:14.248712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.444 [2024-04-16 23:04:14.248739] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.444 qpair failed and we were unable to recover it. 00:26:23.444 [2024-04-16 23:04:14.248847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.444 [2024-04-16 23:04:14.248995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.444 [2024-04-16 23:04:14.249021] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.444 qpair failed and we were unable to recover it. 00:26:23.444 [2024-04-16 23:04:14.249129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.444 [2024-04-16 23:04:14.249258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.444 [2024-04-16 23:04:14.249284] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.444 qpair failed and we were unable to recover it. 00:26:23.444 [2024-04-16 23:04:14.249398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.444 [2024-04-16 23:04:14.249530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.444 [2024-04-16 23:04:14.249556] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.444 qpair failed and we were unable to recover it. 00:26:23.444 [2024-04-16 23:04:14.249671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.444 [2024-04-16 23:04:14.249815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.444 [2024-04-16 23:04:14.249841] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.444 qpair failed and we were unable to recover it. 00:26:23.444 [2024-04-16 23:04:14.249984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.444 [2024-04-16 23:04:14.250129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.444 [2024-04-16 23:04:14.250154] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.444 qpair failed and we were unable to recover it. 00:26:23.444 [2024-04-16 23:04:14.250276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.444 [2024-04-16 23:04:14.250389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.444 [2024-04-16 23:04:14.250415] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.444 qpair failed and we were unable to recover it. 00:26:23.444 [2024-04-16 23:04:14.250533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.444 [2024-04-16 23:04:14.250692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.444 [2024-04-16 23:04:14.250717] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.444 qpair failed and we were unable to recover it. 00:26:23.444 [2024-04-16 23:04:14.250840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.444 [2024-04-16 23:04:14.250948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.444 [2024-04-16 23:04:14.250984] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.444 qpair failed and we were unable to recover it. 00:26:23.444 [2024-04-16 23:04:14.251088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.444 [2024-04-16 23:04:14.251202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.444 [2024-04-16 23:04:14.251229] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.444 qpair failed and we were unable to recover it. 00:26:23.444 [2024-04-16 23:04:14.251401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.444 [2024-04-16 23:04:14.251549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.444 [2024-04-16 23:04:14.251575] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.444 qpair failed and we were unable to recover it. 00:26:23.444 [2024-04-16 23:04:14.251679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.444 [2024-04-16 23:04:14.251822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.444 [2024-04-16 23:04:14.251847] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.444 qpair failed and we were unable to recover it. 00:26:23.444 [2024-04-16 23:04:14.252002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.444 [2024-04-16 23:04:14.252115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.444 [2024-04-16 23:04:14.252140] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.444 qpair failed and we were unable to recover it. 00:26:23.444 [2024-04-16 23:04:14.252286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.444 [2024-04-16 23:04:14.252404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.444 [2024-04-16 23:04:14.252430] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.444 qpair failed and we were unable to recover it. 00:26:23.444 [2024-04-16 23:04:14.252546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.444 [2024-04-16 23:04:14.252713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.444 [2024-04-16 23:04:14.252738] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.444 qpair failed and we were unable to recover it. 00:26:23.444 [2024-04-16 23:04:14.252856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.444 [2024-04-16 23:04:14.252972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.444 [2024-04-16 23:04:14.252998] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.444 qpair failed and we were unable to recover it. 00:26:23.444 [2024-04-16 23:04:14.253140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.444 [2024-04-16 23:04:14.253300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.444 [2024-04-16 23:04:14.253326] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.444 qpair failed and we were unable to recover it. 00:26:23.444 [2024-04-16 23:04:14.253437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.444 [2024-04-16 23:04:14.253559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.444 [2024-04-16 23:04:14.253584] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.444 qpair failed and we were unable to recover it. 00:26:23.444 [2024-04-16 23:04:14.253739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.444 [2024-04-16 23:04:14.253855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.444 [2024-04-16 23:04:14.253880] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.444 qpair failed and we were unable to recover it. 00:26:23.444 [2024-04-16 23:04:14.253998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.444 [2024-04-16 23:04:14.254123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.444 [2024-04-16 23:04:14.254149] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.444 qpair failed and we were unable to recover it. 00:26:23.444 [2024-04-16 23:04:14.254273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.444 [2024-04-16 23:04:14.254389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.444 [2024-04-16 23:04:14.254414] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.444 qpair failed and we were unable to recover it. 00:26:23.444 [2024-04-16 23:04:14.254570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.444 [2024-04-16 23:04:14.254681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.444 [2024-04-16 23:04:14.254706] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.444 qpair failed and we were unable to recover it. 00:26:23.444 [2024-04-16 23:04:14.254814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.444 [2024-04-16 23:04:14.254957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.444 [2024-04-16 23:04:14.254984] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.444 qpair failed and we were unable to recover it. 00:26:23.444 [2024-04-16 23:04:14.255089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.444 [2024-04-16 23:04:14.255218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.444 [2024-04-16 23:04:14.255245] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.444 qpair failed and we were unable to recover it. 00:26:23.444 [2024-04-16 23:04:14.255357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.444 [2024-04-16 23:04:14.255470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.444 [2024-04-16 23:04:14.255495] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.444 qpair failed and we were unable to recover it. 00:26:23.444 [2024-04-16 23:04:14.255604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.444 [2024-04-16 23:04:14.255744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.444 [2024-04-16 23:04:14.255770] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.444 qpair failed and we were unable to recover it. 00:26:23.444 [2024-04-16 23:04:14.255893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.444 [2024-04-16 23:04:14.256016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.444 [2024-04-16 23:04:14.256042] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.444 qpair failed and we were unable to recover it. 00:26:23.444 [2024-04-16 23:04:14.256150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.444 [2024-04-16 23:04:14.256274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.444 [2024-04-16 23:04:14.256300] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.444 qpair failed and we were unable to recover it. 00:26:23.444 [2024-04-16 23:04:14.256413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.444 [2024-04-16 23:04:14.256543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.444 [2024-04-16 23:04:14.256569] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.444 qpair failed and we were unable to recover it. 00:26:23.444 [2024-04-16 23:04:14.256693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.444 [2024-04-16 23:04:14.256838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.444 [2024-04-16 23:04:14.256863] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.444 qpair failed and we were unable to recover it. 00:26:23.444 [2024-04-16 23:04:14.256981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.444 [2024-04-16 23:04:14.257118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.444 [2024-04-16 23:04:14.257143] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.444 qpair failed and we were unable to recover it. 00:26:23.444 [2024-04-16 23:04:14.257262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.444 [2024-04-16 23:04:14.257376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.444 [2024-04-16 23:04:14.257402] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.444 qpair failed and we were unable to recover it. 00:26:23.444 [2024-04-16 23:04:14.257523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.444 [2024-04-16 23:04:14.257675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.444 [2024-04-16 23:04:14.257701] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.444 qpair failed and we were unable to recover it. 00:26:23.444 [2024-04-16 23:04:14.257840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.444 [2024-04-16 23:04:14.257958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.444 [2024-04-16 23:04:14.257984] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.444 qpair failed and we were unable to recover it. 00:26:23.444 [2024-04-16 23:04:14.258092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.444 [2024-04-16 23:04:14.258235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.444 [2024-04-16 23:04:14.258261] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.444 qpair failed and we were unable to recover it. 00:26:23.444 [2024-04-16 23:04:14.258367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.444 [2024-04-16 23:04:14.258482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.444 [2024-04-16 23:04:14.258507] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.444 qpair failed and we were unable to recover it. 00:26:23.444 [2024-04-16 23:04:14.258620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.444 [2024-04-16 23:04:14.258760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.444 [2024-04-16 23:04:14.258786] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.444 qpair failed and we were unable to recover it. 00:26:23.444 [2024-04-16 23:04:14.258902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.444 [2024-04-16 23:04:14.259008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.444 [2024-04-16 23:04:14.259034] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.444 qpair failed and we were unable to recover it. 00:26:23.444 [2024-04-16 23:04:14.259140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.444 [2024-04-16 23:04:14.259258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.444 [2024-04-16 23:04:14.259285] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.444 qpair failed and we were unable to recover it. 00:26:23.444 [2024-04-16 23:04:14.259389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.444 [2024-04-16 23:04:14.259510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.444 [2024-04-16 23:04:14.259537] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.444 qpair failed and we were unable to recover it. 00:26:23.444 [2024-04-16 23:04:14.259664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.444 [2024-04-16 23:04:14.259805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.444 [2024-04-16 23:04:14.259831] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.444 qpair failed and we were unable to recover it. 00:26:23.444 [2024-04-16 23:04:14.259943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.444 [2024-04-16 23:04:14.260079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.444 [2024-04-16 23:04:14.260104] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.444 qpair failed and we were unable to recover it. 00:26:23.444 [2024-04-16 23:04:14.260257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.444 [2024-04-16 23:04:14.260380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.444 [2024-04-16 23:04:14.260407] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.444 qpair failed and we were unable to recover it. 00:26:23.444 [2024-04-16 23:04:14.260559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.444 [2024-04-16 23:04:14.260675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.444 [2024-04-16 23:04:14.260700] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.444 qpair failed and we were unable to recover it. 00:26:23.444 [2024-04-16 23:04:14.260842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.444 [2024-04-16 23:04:14.260970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.444 [2024-04-16 23:04:14.260997] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.444 qpair failed and we were unable to recover it. 00:26:23.444 [2024-04-16 23:04:14.261111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.444 [2024-04-16 23:04:14.261249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.444 [2024-04-16 23:04:14.261275] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.444 qpair failed and we were unable to recover it. 00:26:23.444 [2024-04-16 23:04:14.261397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.444 [2024-04-16 23:04:14.261538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.444 [2024-04-16 23:04:14.261564] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.444 qpair failed and we were unable to recover it. 00:26:23.444 [2024-04-16 23:04:14.261732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.444 [2024-04-16 23:04:14.261841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.444 [2024-04-16 23:04:14.261866] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.444 qpair failed and we were unable to recover it. 00:26:23.444 [2024-04-16 23:04:14.261982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.444 [2024-04-16 23:04:14.262106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.445 [2024-04-16 23:04:14.262132] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.445 qpair failed and we were unable to recover it. 00:26:23.445 [2024-04-16 23:04:14.262284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.445 [2024-04-16 23:04:14.262394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.445 [2024-04-16 23:04:14.262419] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.445 qpair failed and we were unable to recover it. 00:26:23.445 [2024-04-16 23:04:14.262545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.445 [2024-04-16 23:04:14.262653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.445 [2024-04-16 23:04:14.262677] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.445 qpair failed and we were unable to recover it. 00:26:23.445 [2024-04-16 23:04:14.262821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.445 [2024-04-16 23:04:14.262972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.445 [2024-04-16 23:04:14.262997] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.445 qpair failed and we were unable to recover it. 00:26:23.445 [2024-04-16 23:04:14.263110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.445 [2024-04-16 23:04:14.263228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.445 [2024-04-16 23:04:14.263254] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.445 qpair failed and we were unable to recover it. 00:26:23.445 [2024-04-16 23:04:14.263371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.445 [2024-04-16 23:04:14.263489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.445 [2024-04-16 23:04:14.263514] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.445 qpair failed and we were unable to recover it. 00:26:23.445 [2024-04-16 23:04:14.263622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.445 [2024-04-16 23:04:14.263740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.445 [2024-04-16 23:04:14.263765] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.445 qpair failed and we were unable to recover it. 00:26:23.445 [2024-04-16 23:04:14.263883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.445 [2024-04-16 23:04:14.264003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.445 [2024-04-16 23:04:14.264029] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.445 qpair failed and we were unable to recover it. 00:26:23.445 [2024-04-16 23:04:14.264182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.445 [2024-04-16 23:04:14.264296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.445 [2024-04-16 23:04:14.264325] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.445 qpair failed and we were unable to recover it. 00:26:23.445 [2024-04-16 23:04:14.264438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.445 [2024-04-16 23:04:14.264584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.445 [2024-04-16 23:04:14.264609] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.445 qpair failed and we were unable to recover it. 00:26:23.445 [2024-04-16 23:04:14.264753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.445 [2024-04-16 23:04:14.264859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.445 [2024-04-16 23:04:14.264885] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.445 qpair failed and we were unable to recover it. 00:26:23.445 [2024-04-16 23:04:14.265002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.445 [2024-04-16 23:04:14.265142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.445 [2024-04-16 23:04:14.265170] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.445 qpair failed and we were unable to recover it. 00:26:23.445 [2024-04-16 23:04:14.265290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.445 [2024-04-16 23:04:14.265431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.445 [2024-04-16 23:04:14.265455] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.445 qpair failed and we were unable to recover it. 00:26:23.445 [2024-04-16 23:04:14.265562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.445 [2024-04-16 23:04:14.265680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.445 [2024-04-16 23:04:14.265705] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.445 qpair failed and we were unable to recover it. 00:26:23.445 [2024-04-16 23:04:14.265849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.445 [2024-04-16 23:04:14.265968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.445 [2024-04-16 23:04:14.265993] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.445 qpair failed and we were unable to recover it. 00:26:23.445 [2024-04-16 23:04:14.266141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.445 [2024-04-16 23:04:14.266264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.445 [2024-04-16 23:04:14.266289] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.445 qpair failed and we were unable to recover it. 00:26:23.445 [2024-04-16 23:04:14.266400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.445 [2024-04-16 23:04:14.266514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.445 [2024-04-16 23:04:14.266539] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.445 qpair failed and we were unable to recover it. 00:26:23.445 [2024-04-16 23:04:14.266646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.445 [2024-04-16 23:04:14.266761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.445 [2024-04-16 23:04:14.266785] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.445 qpair failed and we were unable to recover it. 00:26:23.445 [2024-04-16 23:04:14.266900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.445 [2024-04-16 23:04:14.267017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.445 [2024-04-16 23:04:14.267046] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.445 qpair failed and we were unable to recover it. 00:26:23.445 [2024-04-16 23:04:14.267162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.445 [2024-04-16 23:04:14.267289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.445 [2024-04-16 23:04:14.267315] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.445 qpair failed and we were unable to recover it. 00:26:23.445 [2024-04-16 23:04:14.267424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.445 [2024-04-16 23:04:14.267567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.445 [2024-04-16 23:04:14.267593] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.445 qpair failed and we were unable to recover it. 00:26:23.445 [2024-04-16 23:04:14.267752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.445 [2024-04-16 23:04:14.267871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.445 [2024-04-16 23:04:14.267896] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.445 qpair failed and we were unable to recover it. 00:26:23.445 [2024-04-16 23:04:14.268009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.445 [2024-04-16 23:04:14.268125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.445 [2024-04-16 23:04:14.268151] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.445 qpair failed and we were unable to recover it. 00:26:23.445 [2024-04-16 23:04:14.268283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.445 [2024-04-16 23:04:14.268402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.445 [2024-04-16 23:04:14.268427] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.445 qpair failed and we were unable to recover it. 00:26:23.445 [2024-04-16 23:04:14.268539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.445 [2024-04-16 23:04:14.268664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.445 [2024-04-16 23:04:14.268688] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.445 qpair failed and we were unable to recover it. 00:26:23.445 [2024-04-16 23:04:14.268804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.445 [2024-04-16 23:04:14.268945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.445 [2024-04-16 23:04:14.268969] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.445 qpair failed and we were unable to recover it. 00:26:23.445 [2024-04-16 23:04:14.269098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.445 [2024-04-16 23:04:14.269216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.445 [2024-04-16 23:04:14.269243] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.445 qpair failed and we were unable to recover it. 00:26:23.445 [2024-04-16 23:04:14.269413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.445 [2024-04-16 23:04:14.269528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.445 [2024-04-16 23:04:14.269552] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.445 qpair failed and we were unable to recover it. 00:26:23.445 [2024-04-16 23:04:14.269670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.445 [2024-04-16 23:04:14.269791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.445 [2024-04-16 23:04:14.269821] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.445 qpair failed and we were unable to recover it. 00:26:23.445 [2024-04-16 23:04:14.269933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.445 [2024-04-16 23:04:14.270041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.445 [2024-04-16 23:04:14.270065] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.445 qpair failed and we were unable to recover it. 00:26:23.445 [2024-04-16 23:04:14.270217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.445 [2024-04-16 23:04:14.270340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.445 [2024-04-16 23:04:14.270365] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.445 qpair failed and we were unable to recover it. 00:26:23.445 [2024-04-16 23:04:14.270478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.445 [2024-04-16 23:04:14.270585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.445 [2024-04-16 23:04:14.270610] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.445 qpair failed and we were unable to recover it. 00:26:23.445 [2024-04-16 23:04:14.270716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.445 [2024-04-16 23:04:14.270824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.445 [2024-04-16 23:04:14.270850] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.445 qpair failed and we were unable to recover it. 00:26:23.445 [2024-04-16 23:04:14.270985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.445 [2024-04-16 23:04:14.271103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.445 [2024-04-16 23:04:14.271128] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.445 qpair failed and we were unable to recover it. 00:26:23.445 [2024-04-16 23:04:14.271238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.445 [2024-04-16 23:04:14.271369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.445 [2024-04-16 23:04:14.271393] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.445 qpair failed and we were unable to recover it. 00:26:23.445 [2024-04-16 23:04:14.271544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.445 [2024-04-16 23:04:14.271659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.445 [2024-04-16 23:04:14.271687] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.445 qpair failed and we were unable to recover it. 00:26:23.445 [2024-04-16 23:04:14.271798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.445 [2024-04-16 23:04:14.271910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.445 [2024-04-16 23:04:14.271934] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.445 qpair failed and we were unable to recover it. 00:26:23.445 [2024-04-16 23:04:14.272073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.445 [2024-04-16 23:04:14.272252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.445 [2024-04-16 23:04:14.272277] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.445 qpair failed and we were unable to recover it. 00:26:23.445 [2024-04-16 23:04:14.272386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.445 [2024-04-16 23:04:14.272492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.445 [2024-04-16 23:04:14.272520] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.445 qpair failed and we were unable to recover it. 00:26:23.445 [2024-04-16 23:04:14.272633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.445 [2024-04-16 23:04:14.272750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.445 [2024-04-16 23:04:14.272774] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.445 qpair failed and we were unable to recover it. 00:26:23.445 [2024-04-16 23:04:14.272886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.445 [2024-04-16 23:04:14.273005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.445 [2024-04-16 23:04:14.273030] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.445 qpair failed and we were unable to recover it. 00:26:23.445 [2024-04-16 23:04:14.273136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.445 [2024-04-16 23:04:14.273292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.445 [2024-04-16 23:04:14.273319] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.445 qpair failed and we were unable to recover it. 00:26:23.445 [2024-04-16 23:04:14.273430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.445 [2024-04-16 23:04:14.273610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.445 [2024-04-16 23:04:14.273635] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.445 qpair failed and we were unable to recover it. 00:26:23.445 [2024-04-16 23:04:14.273772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.445 [2024-04-16 23:04:14.273877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.445 [2024-04-16 23:04:14.273901] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.445 qpair failed and we were unable to recover it. 00:26:23.445 [2024-04-16 23:04:14.274051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.445 [2024-04-16 23:04:14.274212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.445 [2024-04-16 23:04:14.274239] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.445 qpair failed and we were unable to recover it. 00:26:23.445 [2024-04-16 23:04:14.274407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.445 [2024-04-16 23:04:14.274560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.445 [2024-04-16 23:04:14.274584] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.445 qpair failed and we were unable to recover it. 00:26:23.445 [2024-04-16 23:04:14.274697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.445 [2024-04-16 23:04:14.274801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.445 [2024-04-16 23:04:14.274826] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.445 qpair failed and we were unable to recover it. 00:26:23.445 [2024-04-16 23:04:14.274979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.445 [2024-04-16 23:04:14.275099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.445 [2024-04-16 23:04:14.275124] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.445 qpair failed and we were unable to recover it. 00:26:23.445 [2024-04-16 23:04:14.275252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.445 [2024-04-16 23:04:14.275360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.445 [2024-04-16 23:04:14.275386] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.445 qpair failed and we were unable to recover it. 00:26:23.445 [2024-04-16 23:04:14.275538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.445 [2024-04-16 23:04:14.275645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.445 [2024-04-16 23:04:14.275669] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.445 qpair failed and we were unable to recover it. 00:26:23.445 [2024-04-16 23:04:14.275812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.445 [2024-04-16 23:04:14.275946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.445 [2024-04-16 23:04:14.275971] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.445 qpair failed and we were unable to recover it. 00:26:23.445 [2024-04-16 23:04:14.276083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.445 [2024-04-16 23:04:14.276232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.445 [2024-04-16 23:04:14.276259] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.445 qpair failed and we were unable to recover it. 00:26:23.445 [2024-04-16 23:04:14.276372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.445 [2024-04-16 23:04:14.276507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.446 [2024-04-16 23:04:14.276532] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.446 qpair failed and we were unable to recover it. 00:26:23.446 [2024-04-16 23:04:14.276654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.446 [2024-04-16 23:04:14.276771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.446 [2024-04-16 23:04:14.276797] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.446 qpair failed and we were unable to recover it. 00:26:23.446 [2024-04-16 23:04:14.276946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.446 [2024-04-16 23:04:14.277065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.446 [2024-04-16 23:04:14.277090] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.446 qpair failed and we were unable to recover it. 00:26:23.446 [2024-04-16 23:04:14.277234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.446 [2024-04-16 23:04:14.277356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.446 [2024-04-16 23:04:14.277380] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.446 qpair failed and we were unable to recover it. 00:26:23.446 [2024-04-16 23:04:14.277521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.446 [2024-04-16 23:04:14.277636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.446 [2024-04-16 23:04:14.277660] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.446 qpair failed and we were unable to recover it. 00:26:23.446 [2024-04-16 23:04:14.277786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.446 [2024-04-16 23:04:14.277899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.446 [2024-04-16 23:04:14.277924] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.446 qpair failed and we were unable to recover it. 00:26:23.446 [2024-04-16 23:04:14.278039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.446 [2024-04-16 23:04:14.278149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.446 [2024-04-16 23:04:14.278173] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.446 qpair failed and we were unable to recover it. 00:26:23.446 [2024-04-16 23:04:14.278297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.446 [2024-04-16 23:04:14.278422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.446 [2024-04-16 23:04:14.278455] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.446 qpair failed and we were unable to recover it. 00:26:23.446 [2024-04-16 23:04:14.278573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.446 [2024-04-16 23:04:14.278688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.446 [2024-04-16 23:04:14.278715] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.446 qpair failed and we were unable to recover it. 00:26:23.446 [2024-04-16 23:04:14.278852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.446 [2024-04-16 23:04:14.278975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.446 [2024-04-16 23:04:14.279000] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.446 qpair failed and we were unable to recover it. 00:26:23.446 [2024-04-16 23:04:14.279115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.446 [2024-04-16 23:04:14.279228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.446 [2024-04-16 23:04:14.279253] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.446 qpair failed and we were unable to recover it. 00:26:23.446 [2024-04-16 23:04:14.279397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.446 [2024-04-16 23:04:14.279549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.446 [2024-04-16 23:04:14.279594] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.446 qpair failed and we were unable to recover it. 00:26:23.446 [2024-04-16 23:04:14.279727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.446 [2024-04-16 23:04:14.279863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.446 [2024-04-16 23:04:14.279889] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.446 qpair failed and we were unable to recover it. 00:26:23.446 [2024-04-16 23:04:14.280004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.446 [2024-04-16 23:04:14.280145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.446 [2024-04-16 23:04:14.280170] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.446 qpair failed and we were unable to recover it. 00:26:23.446 [2024-04-16 23:04:14.280294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.446 [2024-04-16 23:04:14.280443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.446 [2024-04-16 23:04:14.280467] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.446 qpair failed and we were unable to recover it. 00:26:23.446 [2024-04-16 23:04:14.280591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.446 [2024-04-16 23:04:14.280713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.446 [2024-04-16 23:04:14.280738] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.446 qpair failed and we were unable to recover it. 00:26:23.446 [2024-04-16 23:04:14.280861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.446 [2024-04-16 23:04:14.280983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.446 [2024-04-16 23:04:14.281007] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.446 qpair failed and we were unable to recover it. 00:26:23.446 [2024-04-16 23:04:14.281125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.446 [2024-04-16 23:04:14.281284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.446 [2024-04-16 23:04:14.281310] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.446 qpair failed and we were unable to recover it. 00:26:23.446 [2024-04-16 23:04:14.281457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.446 [2024-04-16 23:04:14.281595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.446 [2024-04-16 23:04:14.281619] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.446 qpair failed and we were unable to recover it. 00:26:23.446 [2024-04-16 23:04:14.281771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.446 [2024-04-16 23:04:14.281883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.446 [2024-04-16 23:04:14.281908] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.446 qpair failed and we were unable to recover it. 00:26:23.446 [2024-04-16 23:04:14.282058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.446 [2024-04-16 23:04:14.282169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.446 [2024-04-16 23:04:14.282201] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.446 qpair failed and we were unable to recover it. 00:26:23.446 [2024-04-16 23:04:14.282315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.446 [2024-04-16 23:04:14.282430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.446 [2024-04-16 23:04:14.282464] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.446 qpair failed and we were unable to recover it. 00:26:23.446 [2024-04-16 23:04:14.282578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.446 [2024-04-16 23:04:14.282691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.446 [2024-04-16 23:04:14.282716] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.446 qpair failed and we were unable to recover it. 00:26:23.446 [2024-04-16 23:04:14.282824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.446 [2024-04-16 23:04:14.282936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.446 [2024-04-16 23:04:14.282966] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.446 qpair failed and we were unable to recover it. 00:26:23.446 [2024-04-16 23:04:14.283087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.446 [2024-04-16 23:04:14.283200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.446 [2024-04-16 23:04:14.283226] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.446 qpair failed and we were unable to recover it. 00:26:23.446 [2024-04-16 23:04:14.283333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.446 [2024-04-16 23:04:14.283453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.446 [2024-04-16 23:04:14.283479] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.446 qpair failed and we were unable to recover it. 00:26:23.446 [2024-04-16 23:04:14.283597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.446 [2024-04-16 23:04:14.283746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.446 [2024-04-16 23:04:14.283770] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.446 qpair failed and we were unable to recover it. 00:26:23.446 [2024-04-16 23:04:14.283910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.446 [2024-04-16 23:04:14.284031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.446 [2024-04-16 23:04:14.284056] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.446 qpair failed and we were unable to recover it. 00:26:23.446 [2024-04-16 23:04:14.284173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.446 [2024-04-16 23:04:14.284303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.446 [2024-04-16 23:04:14.284328] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.446 qpair failed and we were unable to recover it. 00:26:23.446 [2024-04-16 23:04:14.284441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.446 [2024-04-16 23:04:14.284565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.446 [2024-04-16 23:04:14.284589] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.446 qpair failed and we were unable to recover it. 00:26:23.446 [2024-04-16 23:04:14.284718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.446 [2024-04-16 23:04:14.284835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.446 [2024-04-16 23:04:14.284860] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.446 qpair failed and we were unable to recover it. 00:26:23.446 [2024-04-16 23:04:14.284967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.446 [2024-04-16 23:04:14.285105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.446 [2024-04-16 23:04:14.285130] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.446 qpair failed and we were unable to recover it. 00:26:23.446 [2024-04-16 23:04:14.285265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.446 [2024-04-16 23:04:14.285405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.446 [2024-04-16 23:04:14.285431] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.446 qpair failed and we were unable to recover it. 00:26:23.446 [2024-04-16 23:04:14.285577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.446 [2024-04-16 23:04:14.285694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.446 [2024-04-16 23:04:14.285720] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.446 qpair failed and we were unable to recover it. 00:26:23.446 [2024-04-16 23:04:14.285838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.446 [2024-04-16 23:04:14.285948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.446 [2024-04-16 23:04:14.285973] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.446 qpair failed and we were unable to recover it. 00:26:23.446 [2024-04-16 23:04:14.286109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.446 [2024-04-16 23:04:14.286265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.446 [2024-04-16 23:04:14.286291] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.446 qpair failed and we were unable to recover it. 00:26:23.446 [2024-04-16 23:04:14.286400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.446 [2024-04-16 23:04:14.286537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.446 [2024-04-16 23:04:14.286561] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.446 qpair failed and we were unable to recover it. 00:26:23.446 [2024-04-16 23:04:14.286676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.446 [2024-04-16 23:04:14.286782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.446 [2024-04-16 23:04:14.286807] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.446 qpair failed and we were unable to recover it. 00:26:23.446 [2024-04-16 23:04:14.286913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.446 [2024-04-16 23:04:14.287046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.446 [2024-04-16 23:04:14.287071] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.446 qpair failed and we were unable to recover it. 00:26:23.446 [2024-04-16 23:04:14.287188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.446 [2024-04-16 23:04:14.287306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.446 [2024-04-16 23:04:14.287330] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.446 qpair failed and we were unable to recover it. 00:26:23.446 [2024-04-16 23:04:14.287464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.446 [2024-04-16 23:04:14.287579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.446 [2024-04-16 23:04:14.287605] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.446 qpair failed and we were unable to recover it. 00:26:23.446 [2024-04-16 23:04:14.287713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.446 [2024-04-16 23:04:14.287825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.446 [2024-04-16 23:04:14.287851] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.446 qpair failed and we were unable to recover it. 00:26:23.446 [2024-04-16 23:04:14.287969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.446 [2024-04-16 23:04:14.288078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.446 [2024-04-16 23:04:14.288102] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.446 qpair failed and we were unable to recover it. 00:26:23.446 [2024-04-16 23:04:14.288234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.446 [2024-04-16 23:04:14.288365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.446 [2024-04-16 23:04:14.288390] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.446 qpair failed and we were unable to recover it. 00:26:23.446 [2024-04-16 23:04:14.288539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.446 [2024-04-16 23:04:14.288651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.446 [2024-04-16 23:04:14.288676] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.446 qpair failed and we were unable to recover it. 00:26:23.446 [2024-04-16 23:04:14.288784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.446 [2024-04-16 23:04:14.288907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.446 [2024-04-16 23:04:14.288931] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.446 qpair failed and we were unable to recover it. 00:26:23.446 [2024-04-16 23:04:14.289046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.446 [2024-04-16 23:04:14.289179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.446 [2024-04-16 23:04:14.289204] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.446 qpair failed and we were unable to recover it. 00:26:23.446 [2024-04-16 23:04:14.289330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.446 [2024-04-16 23:04:14.289458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.446 [2024-04-16 23:04:14.289489] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.447 qpair failed and we were unable to recover it. 00:26:23.447 [2024-04-16 23:04:14.289748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.447 [2024-04-16 23:04:14.289903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.447 [2024-04-16 23:04:14.289928] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.447 qpair failed and we were unable to recover it. 00:26:23.447 [2024-04-16 23:04:14.290075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.447 [2024-04-16 23:04:14.290203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.447 [2024-04-16 23:04:14.290229] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.447 qpair failed and we were unable to recover it. 00:26:23.447 [2024-04-16 23:04:14.290342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.447 [2024-04-16 23:04:14.290455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.447 [2024-04-16 23:04:14.290480] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.447 qpair failed and we were unable to recover it. 00:26:23.447 [2024-04-16 23:04:14.290637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.447 [2024-04-16 23:04:14.290756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.447 [2024-04-16 23:04:14.290780] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.447 qpair failed and we were unable to recover it. 00:26:23.447 [2024-04-16 23:04:14.290911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.447 [2024-04-16 23:04:14.291025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.447 [2024-04-16 23:04:14.291050] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.447 qpair failed and we were unable to recover it. 00:26:23.447 [2024-04-16 23:04:14.291162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.447 [2024-04-16 23:04:14.291284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.447 [2024-04-16 23:04:14.291309] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.447 qpair failed and we were unable to recover it. 00:26:23.447 [2024-04-16 23:04:14.291438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.447 [2024-04-16 23:04:14.291578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.447 [2024-04-16 23:04:14.291604] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.447 qpair failed and we were unable to recover it. 00:26:23.447 [2024-04-16 23:04:14.291723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.447 [2024-04-16 23:04:14.291830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.447 [2024-04-16 23:04:14.291855] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.447 qpair failed and we were unable to recover it. 00:26:23.447 [2024-04-16 23:04:14.291976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.447 [2024-04-16 23:04:14.292090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.447 [2024-04-16 23:04:14.292116] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.447 qpair failed and we were unable to recover it. 00:26:23.447 [2024-04-16 23:04:14.292257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.447 [2024-04-16 23:04:14.292374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.447 [2024-04-16 23:04:14.292399] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.447 qpair failed and we were unable to recover it. 00:26:23.447 [2024-04-16 23:04:14.292528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.447 [2024-04-16 23:04:14.292674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.447 [2024-04-16 23:04:14.292699] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.447 qpair failed and we were unable to recover it. 00:26:23.447 [2024-04-16 23:04:14.292810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.447 [2024-04-16 23:04:14.292976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.447 [2024-04-16 23:04:14.293001] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.447 qpair failed and we were unable to recover it. 00:26:23.447 [2024-04-16 23:04:14.293106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.447 [2024-04-16 23:04:14.293247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.447 [2024-04-16 23:04:14.293273] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.447 qpair failed and we were unable to recover it. 00:26:23.447 [2024-04-16 23:04:14.293388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.447 [2024-04-16 23:04:14.293540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.447 [2024-04-16 23:04:14.293566] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.447 qpair failed and we were unable to recover it. 00:26:23.447 [2024-04-16 23:04:14.293694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.447 [2024-04-16 23:04:14.293830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.447 [2024-04-16 23:04:14.293856] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.447 qpair failed and we were unable to recover it. 00:26:23.447 [2024-04-16 23:04:14.293968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.447 [2024-04-16 23:04:14.294093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.447 [2024-04-16 23:04:14.294119] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.447 qpair failed and we were unable to recover it. 00:26:23.447 [2024-04-16 23:04:14.294259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.447 [2024-04-16 23:04:14.294406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.447 [2024-04-16 23:04:14.294432] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.447 qpair failed and we were unable to recover it. 00:26:23.447 [2024-04-16 23:04:14.294541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.447 [2024-04-16 23:04:14.294657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.447 [2024-04-16 23:04:14.294683] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.447 qpair failed and we were unable to recover it. 00:26:23.447 [2024-04-16 23:04:14.294804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.447 [2024-04-16 23:04:14.294949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.447 [2024-04-16 23:04:14.294976] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.447 qpair failed and we were unable to recover it. 00:26:23.447 [2024-04-16 23:04:14.295114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.447 [2024-04-16 23:04:14.295244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.447 [2024-04-16 23:04:14.295274] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:23.447 qpair failed and we were unable to recover it. 00:26:23.447 [2024-04-16 23:04:14.295390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.447 [2024-04-16 23:04:14.295522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.447 [2024-04-16 23:04:14.295547] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:23.447 qpair failed and we were unable to recover it. 00:26:23.447 [2024-04-16 23:04:14.295665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.447 [2024-04-16 23:04:14.295771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.447 [2024-04-16 23:04:14.295796] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:23.447 qpair failed and we were unable to recover it. 00:26:23.447 [2024-04-16 23:04:14.295917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.447 [2024-04-16 23:04:14.296021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.447 [2024-04-16 23:04:14.296046] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:23.447 qpair failed and we were unable to recover it. 00:26:23.447 [2024-04-16 23:04:14.296156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.447 [2024-04-16 23:04:14.296268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.447 [2024-04-16 23:04:14.296294] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:23.447 qpair failed and we were unable to recover it. 00:26:23.447 [2024-04-16 23:04:14.296476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.447 [2024-04-16 23:04:14.296596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.447 [2024-04-16 23:04:14.296621] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:23.447 qpair failed and we were unable to recover it. 00:26:23.447 [2024-04-16 23:04:14.296764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.447 [2024-04-16 23:04:14.296907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.447 [2024-04-16 23:04:14.296931] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:23.447 qpair failed and we were unable to recover it. 00:26:23.447 [2024-04-16 23:04:14.297043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.447 [2024-04-16 23:04:14.297159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.447 [2024-04-16 23:04:14.297197] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:23.447 qpair failed and we were unable to recover it. 00:26:23.447 [2024-04-16 23:04:14.297309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.447 [2024-04-16 23:04:14.297415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.447 [2024-04-16 23:04:14.297440] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:23.447 qpair failed and we were unable to recover it. 00:26:23.447 [2024-04-16 23:04:14.297552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.447 [2024-04-16 23:04:14.297687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.447 [2024-04-16 23:04:14.297711] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:23.447 qpair failed and we were unable to recover it. 00:26:23.447 [2024-04-16 23:04:14.297845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.447 [2024-04-16 23:04:14.297981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.447 [2024-04-16 23:04:14.298006] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:23.447 qpair failed and we were unable to recover it. 00:26:23.447 [2024-04-16 23:04:14.298123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.447 [2024-04-16 23:04:14.298246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.447 [2024-04-16 23:04:14.298272] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:23.447 qpair failed and we were unable to recover it. 00:26:23.447 [2024-04-16 23:04:14.298410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.447 [2024-04-16 23:04:14.298585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.447 [2024-04-16 23:04:14.298610] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:23.447 qpair failed and we were unable to recover it. 00:26:23.447 [2024-04-16 23:04:14.298719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.447 [2024-04-16 23:04:14.298861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.447 [2024-04-16 23:04:14.298886] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:23.447 qpair failed and we were unable to recover it. 00:26:23.447 [2024-04-16 23:04:14.298993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.447 [2024-04-16 23:04:14.299126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.447 [2024-04-16 23:04:14.299151] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:23.447 qpair failed and we were unable to recover it. 00:26:23.447 [2024-04-16 23:04:14.299278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.447 [2024-04-16 23:04:14.299382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.447 [2024-04-16 23:04:14.299407] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:23.447 qpair failed and we were unable to recover it. 00:26:23.447 [2024-04-16 23:04:14.299527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.447 [2024-04-16 23:04:14.299635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.447 [2024-04-16 23:04:14.299660] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:23.447 qpair failed and we were unable to recover it. 00:26:23.447 [2024-04-16 23:04:14.299769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.447 [2024-04-16 23:04:14.299877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.447 [2024-04-16 23:04:14.299902] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:23.447 qpair failed and we were unable to recover it. 00:26:23.447 [2024-04-16 23:04:14.300016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.447 [2024-04-16 23:04:14.300137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.447 [2024-04-16 23:04:14.300161] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:23.447 qpair failed and we were unable to recover it. 00:26:23.447 [2024-04-16 23:04:14.300283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.447 [2024-04-16 23:04:14.300401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.447 [2024-04-16 23:04:14.300426] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:23.447 qpair failed and we were unable to recover it. 00:26:23.447 [2024-04-16 23:04:14.300539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.447 [2024-04-16 23:04:14.300690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.447 [2024-04-16 23:04:14.300715] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:23.447 qpair failed and we were unable to recover it. 00:26:23.447 [2024-04-16 23:04:14.300822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.447 [2024-04-16 23:04:14.300927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.447 [2024-04-16 23:04:14.300952] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:23.447 qpair failed and we were unable to recover it. 00:26:23.447 [2024-04-16 23:04:14.301071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.447 [2024-04-16 23:04:14.301189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.447 [2024-04-16 23:04:14.301215] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:23.447 qpair failed and we were unable to recover it. 00:26:23.447 [2024-04-16 23:04:14.301327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.447 [2024-04-16 23:04:14.301446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.447 [2024-04-16 23:04:14.301472] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:23.447 qpair failed and we were unable to recover it. 00:26:23.447 [2024-04-16 23:04:14.301624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.447 [2024-04-16 23:04:14.301769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.447 [2024-04-16 23:04:14.301795] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:23.447 qpair failed and we were unable to recover it. 00:26:23.447 [2024-04-16 23:04:14.301929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.447 [2024-04-16 23:04:14.302098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.447 [2024-04-16 23:04:14.302123] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:23.447 qpair failed and we were unable to recover it. 00:26:23.447 [2024-04-16 23:04:14.302246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.447 [2024-04-16 23:04:14.302358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.447 [2024-04-16 23:04:14.302383] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:23.447 qpair failed and we were unable to recover it. 00:26:23.447 [2024-04-16 23:04:14.302496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.447 [2024-04-16 23:04:14.302641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.447 [2024-04-16 23:04:14.302666] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:23.447 qpair failed and we were unable to recover it. 00:26:23.447 [2024-04-16 23:04:14.302784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.447 [2024-04-16 23:04:14.302901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.447 [2024-04-16 23:04:14.302925] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:23.447 qpair failed and we were unable to recover it. 00:26:23.447 [2024-04-16 23:04:14.303077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.447 [2024-04-16 23:04:14.303188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.447 [2024-04-16 23:04:14.303214] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:23.447 qpair failed and we were unable to recover it. 00:26:23.447 [2024-04-16 23:04:14.303359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.447 [2024-04-16 23:04:14.303470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.447 [2024-04-16 23:04:14.303496] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:23.447 qpair failed and we were unable to recover it. 00:26:23.447 [2024-04-16 23:04:14.303612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.447 [2024-04-16 23:04:14.303724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.447 [2024-04-16 23:04:14.303748] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:23.447 qpair failed and we were unable to recover it. 00:26:23.447 [2024-04-16 23:04:14.303866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.448 [2024-04-16 23:04:14.303973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.448 [2024-04-16 23:04:14.303997] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:23.448 qpair failed and we were unable to recover it. 00:26:23.448 [2024-04-16 23:04:14.304121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.448 [2024-04-16 23:04:14.304298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.448 [2024-04-16 23:04:14.304323] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:23.448 qpair failed and we were unable to recover it. 00:26:23.448 [2024-04-16 23:04:14.304447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.448 [2024-04-16 23:04:14.304569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.448 [2024-04-16 23:04:14.304595] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:23.448 qpair failed and we were unable to recover it. 00:26:23.448 [2024-04-16 23:04:14.304746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.448 [2024-04-16 23:04:14.304869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.448 [2024-04-16 23:04:14.304894] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:23.448 qpair failed and we were unable to recover it. 00:26:23.448 [2024-04-16 23:04:14.305029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.448 [2024-04-16 23:04:14.305144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.448 [2024-04-16 23:04:14.305169] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:23.448 qpair failed and we were unable to recover it. 00:26:23.448 [2024-04-16 23:04:14.305323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.448 [2024-04-16 23:04:14.305435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.448 [2024-04-16 23:04:14.305459] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:23.448 qpair failed and we were unable to recover it. 00:26:23.448 [2024-04-16 23:04:14.305585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.448 [2024-04-16 23:04:14.305701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.448 [2024-04-16 23:04:14.305726] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:23.448 qpair failed and we were unable to recover it. 00:26:23.448 [2024-04-16 23:04:14.305830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.448 [2024-04-16 23:04:14.305943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.448 [2024-04-16 23:04:14.305967] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:23.448 qpair failed and we were unable to recover it. 00:26:23.448 [2024-04-16 23:04:14.306073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.448 [2024-04-16 23:04:14.306202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.448 [2024-04-16 23:04:14.306227] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:23.448 qpair failed and we were unable to recover it. 00:26:23.448 [2024-04-16 23:04:14.306379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.448 [2024-04-16 23:04:14.306491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.448 [2024-04-16 23:04:14.306516] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:23.448 qpair failed and we were unable to recover it. 00:26:23.448 [2024-04-16 23:04:14.306629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.448 [2024-04-16 23:04:14.306770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.448 [2024-04-16 23:04:14.306795] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:23.448 qpair failed and we were unable to recover it. 00:26:23.448 [2024-04-16 23:04:14.306958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.448 [2024-04-16 23:04:14.307071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.448 [2024-04-16 23:04:14.307096] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:23.448 qpair failed and we were unable to recover it. 00:26:23.448 [2024-04-16 23:04:14.307240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.448 [2024-04-16 23:04:14.307357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.448 [2024-04-16 23:04:14.307382] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:23.448 qpair failed and we were unable to recover it. 00:26:23.448 [2024-04-16 23:04:14.307488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.448 [2024-04-16 23:04:14.307609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.448 [2024-04-16 23:04:14.307634] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:23.448 qpair failed and we were unable to recover it. 00:26:23.448 [2024-04-16 23:04:14.307772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.448 [2024-04-16 23:04:14.307896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.448 [2024-04-16 23:04:14.307921] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:23.448 qpair failed and we were unable to recover it. 00:26:23.448 [2024-04-16 23:04:14.308066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.448 [2024-04-16 23:04:14.308181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.448 [2024-04-16 23:04:14.308207] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:23.448 qpair failed and we were unable to recover it. 00:26:23.448 [2024-04-16 23:04:14.308328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.448 [2024-04-16 23:04:14.308454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.448 [2024-04-16 23:04:14.308487] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:23.448 qpair failed and we were unable to recover it. 00:26:23.448 [2024-04-16 23:04:14.308598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.448 [2024-04-16 23:04:14.308709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.448 [2024-04-16 23:04:14.308734] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:23.448 qpair failed and we were unable to recover it. 00:26:23.448 [2024-04-16 23:04:14.308842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.448 [2024-04-16 23:04:14.308983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.448 [2024-04-16 23:04:14.309012] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:23.448 qpair failed and we were unable to recover it. 00:26:23.448 [2024-04-16 23:04:14.309121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.448 [2024-04-16 23:04:14.309250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.448 [2024-04-16 23:04:14.309276] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:23.448 qpair failed and we were unable to recover it. 00:26:23.448 [2024-04-16 23:04:14.309394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.448 [2024-04-16 23:04:14.309498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.448 [2024-04-16 23:04:14.309523] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:23.448 qpair failed and we were unable to recover it. 00:26:23.448 [2024-04-16 23:04:14.309655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.448 [2024-04-16 23:04:14.309769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.448 [2024-04-16 23:04:14.309794] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:23.448 qpair failed and we were unable to recover it. 00:26:23.448 [2024-04-16 23:04:14.309894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.448 [2024-04-16 23:04:14.310009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.448 [2024-04-16 23:04:14.310033] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:23.448 qpair failed and we were unable to recover it. 00:26:23.448 [2024-04-16 23:04:14.310143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.448 [2024-04-16 23:04:14.310260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.448 [2024-04-16 23:04:14.310285] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:23.448 qpair failed and we were unable to recover it. 00:26:23.448 [2024-04-16 23:04:14.310395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.448 [2024-04-16 23:04:14.310525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.448 [2024-04-16 23:04:14.310550] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:23.448 qpair failed and we were unable to recover it. 00:26:23.448 [2024-04-16 23:04:14.310722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.448 [2024-04-16 23:04:14.310855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.448 [2024-04-16 23:04:14.310880] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:23.448 qpair failed and we were unable to recover it. 00:26:23.448 [2024-04-16 23:04:14.311014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.448 [2024-04-16 23:04:14.311128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.448 [2024-04-16 23:04:14.311152] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:23.448 qpair failed and we were unable to recover it. 00:26:23.448 [2024-04-16 23:04:14.311299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.448 [2024-04-16 23:04:14.311411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.448 [2024-04-16 23:04:14.311437] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:23.448 qpair failed and we were unable to recover it. 00:26:23.448 [2024-04-16 23:04:14.311554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.448 [2024-04-16 23:04:14.311663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.448 [2024-04-16 23:04:14.311700] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:23.448 qpair failed and we were unable to recover it. 00:26:23.448 [2024-04-16 23:04:14.311833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.448 [2024-04-16 23:04:14.311966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.448 [2024-04-16 23:04:14.311991] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:23.448 qpair failed and we were unable to recover it. 00:26:23.448 [2024-04-16 23:04:14.312139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.448 [2024-04-16 23:04:14.312261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.448 [2024-04-16 23:04:14.312286] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:23.448 qpair failed and we were unable to recover it. 00:26:23.448 [2024-04-16 23:04:14.312392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.448 [2024-04-16 23:04:14.312494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.448 [2024-04-16 23:04:14.312518] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:23.448 qpair failed and we were unable to recover it. 00:26:23.448 [2024-04-16 23:04:14.312633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.448 [2024-04-16 23:04:14.312737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.448 [2024-04-16 23:04:14.312762] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:23.448 qpair failed and we were unable to recover it. 00:26:23.448 [2024-04-16 23:04:14.312883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.448 [2024-04-16 23:04:14.312987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.448 [2024-04-16 23:04:14.313012] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:23.448 qpair failed and we were unable to recover it. 00:26:23.448 [2024-04-16 23:04:14.313130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.448 [2024-04-16 23:04:14.313241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.448 [2024-04-16 23:04:14.313267] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:23.448 qpair failed and we were unable to recover it. 00:26:23.448 [2024-04-16 23:04:14.313388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.448 [2024-04-16 23:04:14.313500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.448 [2024-04-16 23:04:14.313526] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:23.448 qpair failed and we were unable to recover it. 00:26:23.448 [2024-04-16 23:04:14.313632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.448 [2024-04-16 23:04:14.313747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.448 [2024-04-16 23:04:14.313772] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:23.448 qpair failed and we were unable to recover it. 00:26:23.448 [2024-04-16 23:04:14.313914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.448 [2024-04-16 23:04:14.314083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.448 [2024-04-16 23:04:14.314108] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:23.448 qpair failed and we were unable to recover it. 00:26:23.448 [2024-04-16 23:04:14.314229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.448 [2024-04-16 23:04:14.314333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.448 [2024-04-16 23:04:14.314362] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:23.448 qpair failed and we were unable to recover it. 00:26:23.448 [2024-04-16 23:04:14.314466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.448 [2024-04-16 23:04:14.314611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.448 [2024-04-16 23:04:14.314636] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:23.448 qpair failed and we were unable to recover it. 00:26:23.448 [2024-04-16 23:04:14.314786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.448 [2024-04-16 23:04:14.314898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.448 [2024-04-16 23:04:14.314923] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:23.448 qpair failed and we were unable to recover it. 00:26:23.448 [2024-04-16 23:04:14.315026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.448 [2024-04-16 23:04:14.315135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.448 [2024-04-16 23:04:14.315160] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:23.448 qpair failed and we were unable to recover it. 00:26:23.448 [2024-04-16 23:04:14.315278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.448 [2024-04-16 23:04:14.315381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.448 [2024-04-16 23:04:14.315406] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:23.448 qpair failed and we were unable to recover it. 00:26:23.448 [2024-04-16 23:04:14.315514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.448 [2024-04-16 23:04:14.315651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.448 [2024-04-16 23:04:14.315676] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:23.448 qpair failed and we were unable to recover it. 00:26:23.448 [2024-04-16 23:04:14.315787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.448 [2024-04-16 23:04:14.315903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.448 [2024-04-16 23:04:14.315929] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:23.448 qpair failed and we were unable to recover it. 00:26:23.448 [2024-04-16 23:04:14.316047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.448 [2024-04-16 23:04:14.316159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.448 [2024-04-16 23:04:14.316196] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:23.448 qpair failed and we were unable to recover it. 00:26:23.448 [2024-04-16 23:04:14.316305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.448 [2024-04-16 23:04:14.316414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.448 [2024-04-16 23:04:14.316439] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:23.448 qpair failed and we were unable to recover it. 00:26:23.448 [2024-04-16 23:04:14.316555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.448 [2024-04-16 23:04:14.316699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.448 [2024-04-16 23:04:14.316724] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:23.448 qpair failed and we were unable to recover it. 00:26:23.448 [2024-04-16 23:04:14.316828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.448 [2024-04-16 23:04:14.316959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.448 [2024-04-16 23:04:14.316984] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:23.448 qpair failed and we were unable to recover it. 00:26:23.449 [2024-04-16 23:04:14.317106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.449 [2024-04-16 23:04:14.317243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.449 [2024-04-16 23:04:14.317268] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:23.449 qpair failed and we were unable to recover it. 00:26:23.449 [2024-04-16 23:04:14.317402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.449 [2024-04-16 23:04:14.317504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.449 [2024-04-16 23:04:14.317529] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:23.449 qpair failed and we were unable to recover it. 00:26:23.449 [2024-04-16 23:04:14.317650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.449 [2024-04-16 23:04:14.317769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.449 [2024-04-16 23:04:14.317795] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:23.449 qpair failed and we were unable to recover it. 00:26:23.449 [2024-04-16 23:04:14.317936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.449 [2024-04-16 23:04:14.318072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.449 [2024-04-16 23:04:14.318097] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:23.449 qpair failed and we were unable to recover it. 00:26:23.449 [2024-04-16 23:04:14.318241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.449 [2024-04-16 23:04:14.318365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.449 [2024-04-16 23:04:14.318391] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:23.449 qpair failed and we were unable to recover it. 00:26:23.449 [2024-04-16 23:04:14.318525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.449 [2024-04-16 23:04:14.318635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.449 [2024-04-16 23:04:14.318660] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:23.449 qpair failed and we were unable to recover it. 00:26:23.449 [2024-04-16 23:04:14.318772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.449 [2024-04-16 23:04:14.318908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.449 [2024-04-16 23:04:14.318933] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:23.449 qpair failed and we were unable to recover it. 00:26:23.449 [2024-04-16 23:04:14.319079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.449 [2024-04-16 23:04:14.319224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.449 [2024-04-16 23:04:14.319249] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:23.449 qpair failed and we were unable to recover it. 00:26:23.449 [2024-04-16 23:04:14.319357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.449 [2024-04-16 23:04:14.319476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.449 [2024-04-16 23:04:14.319501] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:23.449 qpair failed and we were unable to recover it. 00:26:23.449 [2024-04-16 23:04:14.319607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.449 [2024-04-16 23:04:14.319714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.449 [2024-04-16 23:04:14.319739] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:23.449 qpair failed and we were unable to recover it. 00:26:23.449 [2024-04-16 23:04:14.319878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.449 [2024-04-16 23:04:14.320015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.449 [2024-04-16 23:04:14.320041] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:23.449 qpair failed and we were unable to recover it. 00:26:23.449 [2024-04-16 23:04:14.320182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.449 [2024-04-16 23:04:14.320324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.449 [2024-04-16 23:04:14.320350] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:23.449 qpair failed and we were unable to recover it. 00:26:23.449 [2024-04-16 23:04:14.320454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.449 [2024-04-16 23:04:14.320585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.449 [2024-04-16 23:04:14.320610] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:23.449 qpair failed and we were unable to recover it. 00:26:23.449 [2024-04-16 23:04:14.320744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.449 [2024-04-16 23:04:14.320862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.449 [2024-04-16 23:04:14.320886] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:23.449 qpair failed and we were unable to recover it. 00:26:23.449 [2024-04-16 23:04:14.321053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.449 [2024-04-16 23:04:14.321155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.449 [2024-04-16 23:04:14.321220] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:23.449 qpair failed and we were unable to recover it. 00:26:23.449 [2024-04-16 23:04:14.321340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.449 [2024-04-16 23:04:14.321480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.449 [2024-04-16 23:04:14.321504] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:23.449 qpair failed and we were unable to recover it. 00:26:23.449 [2024-04-16 23:04:14.321647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.449 [2024-04-16 23:04:14.321763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.449 [2024-04-16 23:04:14.321788] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:23.449 qpair failed and we were unable to recover it. 00:26:23.449 [2024-04-16 23:04:14.321902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.449 [2024-04-16 23:04:14.322002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.449 [2024-04-16 23:04:14.322027] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:23.449 qpair failed and we were unable to recover it. 00:26:23.449 [2024-04-16 23:04:14.322146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.449 [2024-04-16 23:04:14.322296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.449 [2024-04-16 23:04:14.322321] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:23.449 qpair failed and we were unable to recover it. 00:26:23.449 [2024-04-16 23:04:14.322464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.449 [2024-04-16 23:04:14.322579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.449 [2024-04-16 23:04:14.322603] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:23.449 qpair failed and we were unable to recover it. 00:26:23.449 [2024-04-16 23:04:14.322743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.449 [2024-04-16 23:04:14.322849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.449 [2024-04-16 23:04:14.322874] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:23.449 qpair failed and we were unable to recover it. 00:26:23.449 [2024-04-16 23:04:14.322980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.449 [2024-04-16 23:04:14.323097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.449 [2024-04-16 23:04:14.323122] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:23.449 qpair failed and we were unable to recover it. 00:26:23.449 [2024-04-16 23:04:14.323250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.449 [2024-04-16 23:04:14.323389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.449 [2024-04-16 23:04:14.323414] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:23.449 qpair failed and we were unable to recover it. 00:26:23.449 [2024-04-16 23:04:14.323550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.449 [2024-04-16 23:04:14.323665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.449 [2024-04-16 23:04:14.323690] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:23.449 qpair failed and we were unable to recover it. 00:26:23.449 [2024-04-16 23:04:14.323833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.449 [2024-04-16 23:04:14.323940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.449 [2024-04-16 23:04:14.323965] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:23.449 qpair failed and we were unable to recover it. 00:26:23.449 [2024-04-16 23:04:14.324089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.449 [2024-04-16 23:04:14.324246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.449 [2024-04-16 23:04:14.324271] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:23.449 qpair failed and we were unable to recover it. 00:26:23.449 [2024-04-16 23:04:14.324411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.449 [2024-04-16 23:04:14.324538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.449 [2024-04-16 23:04:14.324571] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:23.449 qpair failed and we were unable to recover it. 00:26:23.449 [2024-04-16 23:04:14.324688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.449 [2024-04-16 23:04:14.324794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.449 [2024-04-16 23:04:14.324820] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:23.449 qpair failed and we were unable to recover it. 00:26:23.449 [2024-04-16 23:04:14.324929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.449 [2024-04-16 23:04:14.325031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.449 [2024-04-16 23:04:14.325056] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:23.449 qpair failed and we were unable to recover it. 00:26:23.449 [2024-04-16 23:04:14.325227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.449 [2024-04-16 23:04:14.325331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.449 [2024-04-16 23:04:14.325356] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:23.449 qpair failed and we were unable to recover it. 00:26:23.449 [2024-04-16 23:04:14.325478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.449 [2024-04-16 23:04:14.325584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.449 [2024-04-16 23:04:14.325609] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:23.449 qpair failed and we were unable to recover it. 00:26:23.449 [2024-04-16 23:04:14.325722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.449 [2024-04-16 23:04:14.325827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.449 [2024-04-16 23:04:14.325852] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:23.449 qpair failed and we were unable to recover it. 00:26:23.449 [2024-04-16 23:04:14.325957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.449 [2024-04-16 23:04:14.326072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.449 [2024-04-16 23:04:14.326097] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:23.449 qpair failed and we were unable to recover it. 00:26:23.449 [2024-04-16 23:04:14.326231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.449 [2024-04-16 23:04:14.326342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.449 [2024-04-16 23:04:14.326367] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:23.449 qpair failed and we were unable to recover it. 00:26:23.449 [2024-04-16 23:04:14.326486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.449 [2024-04-16 23:04:14.326626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.449 [2024-04-16 23:04:14.326651] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:23.449 qpair failed and we were unable to recover it. 00:26:23.449 [2024-04-16 23:04:14.326784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.449 [2024-04-16 23:04:14.326927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.449 [2024-04-16 23:04:14.326952] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:23.449 qpair failed and we were unable to recover it. 00:26:23.449 [2024-04-16 23:04:14.327064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.449 [2024-04-16 23:04:14.327219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.449 [2024-04-16 23:04:14.327244] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:23.449 qpair failed and we were unable to recover it. 00:26:23.449 [2024-04-16 23:04:14.327364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.449 [2024-04-16 23:04:14.327514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.449 [2024-04-16 23:04:14.327538] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:23.449 qpair failed and we were unable to recover it. 00:26:23.449 [2024-04-16 23:04:14.327685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.449 [2024-04-16 23:04:14.327789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.449 [2024-04-16 23:04:14.327813] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:23.449 qpair failed and we were unable to recover it. 00:26:23.449 [2024-04-16 23:04:14.327967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.449 [2024-04-16 23:04:14.328078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.449 [2024-04-16 23:04:14.328102] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:23.449 qpair failed and we were unable to recover it. 00:26:23.449 [2024-04-16 23:04:14.328280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.449 [2024-04-16 23:04:14.328393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.449 [2024-04-16 23:04:14.328417] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:23.449 qpair failed and we were unable to recover it. 00:26:23.449 [2024-04-16 23:04:14.328563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.449 [2024-04-16 23:04:14.328676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.449 [2024-04-16 23:04:14.328703] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:23.449 qpair failed and we were unable to recover it. 00:26:23.449 [2024-04-16 23:04:14.328825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.449 [2024-04-16 23:04:14.328994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.449 [2024-04-16 23:04:14.329019] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:23.449 qpair failed and we were unable to recover it. 00:26:23.449 [2024-04-16 23:04:14.329132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.449 [2024-04-16 23:04:14.329308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.449 [2024-04-16 23:04:14.329335] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:23.449 qpair failed and we were unable to recover it. 00:26:23.449 [2024-04-16 23:04:14.329449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.449 [2024-04-16 23:04:14.329590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.449 [2024-04-16 23:04:14.329615] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:23.449 qpair failed and we were unable to recover it. 00:26:23.449 [2024-04-16 23:04:14.329758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.449 [2024-04-16 23:04:14.329890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.449 [2024-04-16 23:04:14.329915] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:23.449 qpair failed and we were unable to recover it. 00:26:23.449 [2024-04-16 23:04:14.330021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.449 [2024-04-16 23:04:14.330170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.449 [2024-04-16 23:04:14.330200] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:23.449 qpair failed and we were unable to recover it. 00:26:23.449 [2024-04-16 23:04:14.330344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.449 [2024-04-16 23:04:14.330460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.449 [2024-04-16 23:04:14.330484] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:23.449 qpair failed and we were unable to recover it. 00:26:23.449 [2024-04-16 23:04:14.330625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.449 [2024-04-16 23:04:14.330762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.449 [2024-04-16 23:04:14.330786] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:23.449 qpair failed and we were unable to recover it. 00:26:23.449 [2024-04-16 23:04:14.330892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.449 [2024-04-16 23:04:14.331053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.449 [2024-04-16 23:04:14.331078] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:23.449 qpair failed and we were unable to recover it. 00:26:23.449 [2024-04-16 23:04:14.331218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.449 [2024-04-16 23:04:14.331327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.449 [2024-04-16 23:04:14.331352] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:23.449 qpair failed and we were unable to recover it. 00:26:23.449 [2024-04-16 23:04:14.331467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.450 [2024-04-16 23:04:14.331578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.450 [2024-04-16 23:04:14.331604] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:23.450 qpair failed and we were unable to recover it. 00:26:23.450 [2024-04-16 23:04:14.331716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.450 [2024-04-16 23:04:14.331828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.450 [2024-04-16 23:04:14.331855] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:23.450 qpair failed and we were unable to recover it. 00:26:23.450 [2024-04-16 23:04:14.331972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.450 [2024-04-16 23:04:14.332118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.450 [2024-04-16 23:04:14.332143] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:23.450 qpair failed and we were unable to recover it. 00:26:23.450 [2024-04-16 23:04:14.332293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.450 [2024-04-16 23:04:14.332399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.450 [2024-04-16 23:04:14.332424] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:23.450 qpair failed and we were unable to recover it. 00:26:23.450 [2024-04-16 23:04:14.332540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.450 [2024-04-16 23:04:14.332705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.450 [2024-04-16 23:04:14.332730] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:23.450 qpair failed and we were unable to recover it. 00:26:23.450 [2024-04-16 23:04:14.332837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.450 [2024-04-16 23:04:14.332946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.450 [2024-04-16 23:04:14.332971] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:23.450 qpair failed and we were unable to recover it. 00:26:23.450 [2024-04-16 23:04:14.333084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.450 [2024-04-16 23:04:14.333192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.450 [2024-04-16 23:04:14.333218] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:23.450 qpair failed and we were unable to recover it. 00:26:23.450 [2024-04-16 23:04:14.333357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.450 [2024-04-16 23:04:14.333505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.450 [2024-04-16 23:04:14.333530] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:23.450 qpair failed and we were unable to recover it. 00:26:23.450 [2024-04-16 23:04:14.333678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.450 [2024-04-16 23:04:14.333783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.450 [2024-04-16 23:04:14.333808] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:23.450 qpair failed and we were unable to recover it. 00:26:23.450 [2024-04-16 23:04:14.333962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.450 [2024-04-16 23:04:14.334126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.450 [2024-04-16 23:04:14.334151] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:23.450 qpair failed and we were unable to recover it. 00:26:23.450 [2024-04-16 23:04:14.334270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.450 [2024-04-16 23:04:14.334373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.450 [2024-04-16 23:04:14.334397] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:23.450 qpair failed and we were unable to recover it. 00:26:23.450 [2024-04-16 23:04:14.334520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.450 [2024-04-16 23:04:14.334657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.450 [2024-04-16 23:04:14.334682] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:23.450 qpair failed and we were unable to recover it. 00:26:23.450 [2024-04-16 23:04:14.334789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.450 [2024-04-16 23:04:14.334888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.450 [2024-04-16 23:04:14.334913] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:23.450 qpair failed and we were unable to recover it. 00:26:23.450 [2024-04-16 23:04:14.335019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.450 [2024-04-16 23:04:14.335188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.450 [2024-04-16 23:04:14.335214] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:23.450 qpair failed and we were unable to recover it. 00:26:23.450 [2024-04-16 23:04:14.335340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.450 [2024-04-16 23:04:14.335495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.450 [2024-04-16 23:04:14.335520] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:23.450 qpair failed and we were unable to recover it. 00:26:23.450 [2024-04-16 23:04:14.335628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.450 [2024-04-16 23:04:14.335732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.450 [2024-04-16 23:04:14.335756] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:23.450 qpair failed and we were unable to recover it. 00:26:23.450 [2024-04-16 23:04:14.335861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.450 [2024-04-16 23:04:14.336001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.450 [2024-04-16 23:04:14.336025] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:23.450 qpair failed and we were unable to recover it. 00:26:23.450 [2024-04-16 23:04:14.336142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.450 [2024-04-16 23:04:14.336281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.450 [2024-04-16 23:04:14.336306] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:23.450 qpair failed and we were unable to recover it. 00:26:23.450 [2024-04-16 23:04:14.336432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.450 [2024-04-16 23:04:14.336540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.450 [2024-04-16 23:04:14.336566] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:23.450 qpair failed and we were unable to recover it. 00:26:23.450 [2024-04-16 23:04:14.336698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.450 [2024-04-16 23:04:14.336871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.450 [2024-04-16 23:04:14.336896] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:23.450 qpair failed and we were unable to recover it. 00:26:23.450 [2024-04-16 23:04:14.337034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.450 [2024-04-16 23:04:14.337146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.450 [2024-04-16 23:04:14.337171] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:23.450 qpair failed and we were unable to recover it. 00:26:23.450 [2024-04-16 23:04:14.337325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.450 [2024-04-16 23:04:14.337432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.450 [2024-04-16 23:04:14.337458] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:23.450 qpair failed and we were unable to recover it. 00:26:23.450 [2024-04-16 23:04:14.337597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.450 [2024-04-16 23:04:14.337731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.450 [2024-04-16 23:04:14.337756] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:23.450 qpair failed and we were unable to recover it. 00:26:23.450 [2024-04-16 23:04:14.337871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.450 [2024-04-16 23:04:14.337979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.450 [2024-04-16 23:04:14.338004] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:23.450 qpair failed and we were unable to recover it. 00:26:23.450 [2024-04-16 23:04:14.338142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.450 [2024-04-16 23:04:14.338302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.450 [2024-04-16 23:04:14.338327] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:23.450 qpair failed and we were unable to recover it. 00:26:23.450 [2024-04-16 23:04:14.338443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.450 [2024-04-16 23:04:14.338577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.450 [2024-04-16 23:04:14.338602] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:23.450 qpair failed and we were unable to recover it. 00:26:23.450 [2024-04-16 23:04:14.338733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.450 [2024-04-16 23:04:14.338846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.450 [2024-04-16 23:04:14.338870] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:23.450 qpair failed and we were unable to recover it. 00:26:23.450 [2024-04-16 23:04:14.338980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.450 [2024-04-16 23:04:14.339143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.450 [2024-04-16 23:04:14.339168] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:23.450 qpair failed and we were unable to recover it. 00:26:23.450 [2024-04-16 23:04:14.339287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.450 [2024-04-16 23:04:14.339432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.450 [2024-04-16 23:04:14.339457] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:23.450 qpair failed and we were unable to recover it. 00:26:23.450 [2024-04-16 23:04:14.339561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.450 [2024-04-16 23:04:14.339681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.450 [2024-04-16 23:04:14.339705] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:23.450 qpair failed and we were unable to recover it. 00:26:23.450 [2024-04-16 23:04:14.339888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.450 [2024-04-16 23:04:14.340019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.450 [2024-04-16 23:04:14.340047] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea0000b90 with addr=10.0.0.2, port=4420 00:26:23.450 qpair failed and we were unable to recover it. 00:26:23.450 [2024-04-16 23:04:14.340197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.450 [2024-04-16 23:04:14.340318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.450 [2024-04-16 23:04:14.340345] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea0000b90 with addr=10.0.0.2, port=4420 00:26:23.450 qpair failed and we were unable to recover it. 00:26:23.450 [2024-04-16 23:04:14.340472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.450 [2024-04-16 23:04:14.340613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.450 [2024-04-16 23:04:14.340639] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea0000b90 with addr=10.0.0.2, port=4420 00:26:23.450 qpair failed and we were unable to recover it. 00:26:23.450 [2024-04-16 23:04:14.340755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.450 [2024-04-16 23:04:14.340899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.450 [2024-04-16 23:04:14.340924] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea0000b90 with addr=10.0.0.2, port=4420 00:26:23.450 qpair failed and we were unable to recover it. 00:26:23.450 [2024-04-16 23:04:14.341035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.450 [2024-04-16 23:04:14.341148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.450 [2024-04-16 23:04:14.341183] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea0000b90 with addr=10.0.0.2, port=4420 00:26:23.450 qpair failed and we were unable to recover it. 00:26:23.450 [2024-04-16 23:04:14.341300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.450 [2024-04-16 23:04:14.341422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.450 [2024-04-16 23:04:14.341447] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea0000b90 with addr=10.0.0.2, port=4420 00:26:23.450 qpair failed and we were unable to recover it. 00:26:23.450 [2024-04-16 23:04:14.341587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.450 [2024-04-16 23:04:14.341707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.450 [2024-04-16 23:04:14.341732] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea0000b90 with addr=10.0.0.2, port=4420 00:26:23.450 qpair failed and we were unable to recover it. 00:26:23.450 [2024-04-16 23:04:14.341869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.450 [2024-04-16 23:04:14.341995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.450 [2024-04-16 23:04:14.342021] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea0000b90 with addr=10.0.0.2, port=4420 00:26:23.450 qpair failed and we were unable to recover it. 00:26:23.450 [2024-04-16 23:04:14.342129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.450 [2024-04-16 23:04:14.342258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.450 [2024-04-16 23:04:14.342285] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea0000b90 with addr=10.0.0.2, port=4420 00:26:23.450 qpair failed and we were unable to recover it. 00:26:23.450 [2024-04-16 23:04:14.342401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.450 [2024-04-16 23:04:14.342528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.450 [2024-04-16 23:04:14.342554] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea0000b90 with addr=10.0.0.2, port=4420 00:26:23.450 qpair failed and we were unable to recover it. 00:26:23.450 [2024-04-16 23:04:14.342666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.450 [2024-04-16 23:04:14.342780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.450 [2024-04-16 23:04:14.342805] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea0000b90 with addr=10.0.0.2, port=4420 00:26:23.450 qpair failed and we were unable to recover it. 00:26:23.450 [2024-04-16 23:04:14.342970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.450 [2024-04-16 23:04:14.343085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.450 [2024-04-16 23:04:14.343111] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea0000b90 with addr=10.0.0.2, port=4420 00:26:23.450 qpair failed and we were unable to recover it. 00:26:23.450 [2024-04-16 23:04:14.343231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.450 [2024-04-16 23:04:14.343346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.450 [2024-04-16 23:04:14.343372] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea0000b90 with addr=10.0.0.2, port=4420 00:26:23.450 qpair failed and we were unable to recover it. 00:26:23.450 [2024-04-16 23:04:14.343494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.450 [2024-04-16 23:04:14.343611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.450 [2024-04-16 23:04:14.343636] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea0000b90 with addr=10.0.0.2, port=4420 00:26:23.450 qpair failed and we were unable to recover it. 00:26:23.450 [2024-04-16 23:04:14.343741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.450 [2024-04-16 23:04:14.343881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.450 [2024-04-16 23:04:14.343906] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea0000b90 with addr=10.0.0.2, port=4420 00:26:23.450 qpair failed and we were unable to recover it. 00:26:23.450 [2024-04-16 23:04:14.344012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.450 [2024-04-16 23:04:14.344126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.450 [2024-04-16 23:04:14.344151] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea0000b90 with addr=10.0.0.2, port=4420 00:26:23.450 qpair failed and we were unable to recover it. 00:26:23.450 [2024-04-16 23:04:14.344275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.450 [2024-04-16 23:04:14.344388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.450 [2024-04-16 23:04:14.344416] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea0000b90 with addr=10.0.0.2, port=4420 00:26:23.450 qpair failed and we were unable to recover it. 00:26:23.450 [2024-04-16 23:04:14.344564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.450 [2024-04-16 23:04:14.344689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.450 [2024-04-16 23:04:14.344715] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea0000b90 with addr=10.0.0.2, port=4420 00:26:23.450 qpair failed and we were unable to recover it. 00:26:23.450 [2024-04-16 23:04:14.344853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.450 [2024-04-16 23:04:14.344962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.450 [2024-04-16 23:04:14.344987] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea0000b90 with addr=10.0.0.2, port=4420 00:26:23.450 qpair failed and we were unable to recover it. 00:26:23.450 [2024-04-16 23:04:14.345100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.450 [2024-04-16 23:04:14.345226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.450 [2024-04-16 23:04:14.345253] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea0000b90 with addr=10.0.0.2, port=4420 00:26:23.450 qpair failed and we were unable to recover it. 00:26:23.450 [2024-04-16 23:04:14.345375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.450 [2024-04-16 23:04:14.345489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.451 [2024-04-16 23:04:14.345514] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea0000b90 with addr=10.0.0.2, port=4420 00:26:23.451 qpair failed and we were unable to recover it. 00:26:23.451 [2024-04-16 23:04:14.345636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.451 [2024-04-16 23:04:14.345755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.451 [2024-04-16 23:04:14.345783] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea0000b90 with addr=10.0.0.2, port=4420 00:26:23.451 qpair failed and we were unable to recover it. 00:26:23.451 [2024-04-16 23:04:14.345898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.451 [2024-04-16 23:04:14.346042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.451 [2024-04-16 23:04:14.346067] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea0000b90 with addr=10.0.0.2, port=4420 00:26:23.451 qpair failed and we were unable to recover it. 00:26:23.451 [2024-04-16 23:04:14.346185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.451 [2024-04-16 23:04:14.346294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.451 [2024-04-16 23:04:14.346319] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea0000b90 with addr=10.0.0.2, port=4420 00:26:23.451 qpair failed and we were unable to recover it. 00:26:23.451 [2024-04-16 23:04:14.346427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.451 [2024-04-16 23:04:14.346546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.451 [2024-04-16 23:04:14.346571] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea0000b90 with addr=10.0.0.2, port=4420 00:26:23.451 qpair failed and we were unable to recover it. 00:26:23.451 [2024-04-16 23:04:14.346678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.451 [2024-04-16 23:04:14.346789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.451 [2024-04-16 23:04:14.346814] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea0000b90 with addr=10.0.0.2, port=4420 00:26:23.451 qpair failed and we were unable to recover it. 00:26:23.451 [2024-04-16 23:04:14.346929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.451 [2024-04-16 23:04:14.347066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.451 [2024-04-16 23:04:14.347092] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea0000b90 with addr=10.0.0.2, port=4420 00:26:23.451 qpair failed and we were unable to recover it. 00:26:23.451 [2024-04-16 23:04:14.347209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.451 [2024-04-16 23:04:14.347323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.451 [2024-04-16 23:04:14.347349] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea0000b90 with addr=10.0.0.2, port=4420 00:26:23.451 qpair failed and we were unable to recover it. 00:26:23.451 [2024-04-16 23:04:14.347468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.451 [2024-04-16 23:04:14.347604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.451 [2024-04-16 23:04:14.347629] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea0000b90 with addr=10.0.0.2, port=4420 00:26:23.451 qpair failed and we were unable to recover it. 00:26:23.451 [2024-04-16 23:04:14.347764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.451 [2024-04-16 23:04:14.347905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.451 [2024-04-16 23:04:14.347931] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea0000b90 with addr=10.0.0.2, port=4420 00:26:23.451 qpair failed and we were unable to recover it. 00:26:23.451 [2024-04-16 23:04:14.348048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.451 [2024-04-16 23:04:14.348171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.451 [2024-04-16 23:04:14.348203] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea0000b90 with addr=10.0.0.2, port=4420 00:26:23.451 qpair failed and we were unable to recover it. 00:26:23.451 [2024-04-16 23:04:14.348314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.451 [2024-04-16 23:04:14.348454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.451 [2024-04-16 23:04:14.348487] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea0000b90 with addr=10.0.0.2, port=4420 00:26:23.451 qpair failed and we were unable to recover it. 00:26:23.451 [2024-04-16 23:04:14.348650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.451 [2024-04-16 23:04:14.348777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.451 [2024-04-16 23:04:14.348802] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea0000b90 with addr=10.0.0.2, port=4420 00:26:23.451 qpair failed and we were unable to recover it. 00:26:23.451 [2024-04-16 23:04:14.348936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.451 [2024-04-16 23:04:14.349050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.451 [2024-04-16 23:04:14.349078] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea0000b90 with addr=10.0.0.2, port=4420 00:26:23.451 qpair failed and we were unable to recover it. 00:26:23.451 [2024-04-16 23:04:14.349190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.451 [2024-04-16 23:04:14.349306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.451 [2024-04-16 23:04:14.349331] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea0000b90 with addr=10.0.0.2, port=4420 00:26:23.451 qpair failed and we were unable to recover it. 00:26:23.451 [2024-04-16 23:04:14.349440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.451 [2024-04-16 23:04:14.349577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.451 [2024-04-16 23:04:14.349603] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea0000b90 with addr=10.0.0.2, port=4420 00:26:23.451 qpair failed and we were unable to recover it. 00:26:23.451 [2024-04-16 23:04:14.349732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.451 [2024-04-16 23:04:14.349846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.451 [2024-04-16 23:04:14.349874] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea0000b90 with addr=10.0.0.2, port=4420 00:26:23.451 qpair failed and we were unable to recover it. 00:26:23.451 [2024-04-16 23:04:14.350014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.451 [2024-04-16 23:04:14.350130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.451 [2024-04-16 23:04:14.350155] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea0000b90 with addr=10.0.0.2, port=4420 00:26:23.451 qpair failed and we were unable to recover it. 00:26:23.451 [2024-04-16 23:04:14.350287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.451 [2024-04-16 23:04:14.350405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.451 [2024-04-16 23:04:14.350430] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea0000b90 with addr=10.0.0.2, port=4420 00:26:23.451 qpair failed and we were unable to recover it. 00:26:23.451 [2024-04-16 23:04:14.350603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.451 [2024-04-16 23:04:14.350715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.451 [2024-04-16 23:04:14.350745] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea0000b90 with addr=10.0.0.2, port=4420 00:26:23.451 qpair failed and we were unable to recover it. 00:26:23.451 [2024-04-16 23:04:14.350884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.451 [2024-04-16 23:04:14.351000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.451 [2024-04-16 23:04:14.351025] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea0000b90 with addr=10.0.0.2, port=4420 00:26:23.451 qpair failed and we were unable to recover it. 00:26:23.451 [2024-04-16 23:04:14.351134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.451 [2024-04-16 23:04:14.351253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.451 [2024-04-16 23:04:14.351279] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea0000b90 with addr=10.0.0.2, port=4420 00:26:23.451 qpair failed and we were unable to recover it. 00:26:23.451 [2024-04-16 23:04:14.351428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.451 [2024-04-16 23:04:14.351545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.451 [2024-04-16 23:04:14.351570] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea0000b90 with addr=10.0.0.2, port=4420 00:26:23.451 qpair failed and we were unable to recover it. 00:26:23.451 [2024-04-16 23:04:14.351680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.451 [2024-04-16 23:04:14.351811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.451 [2024-04-16 23:04:14.351837] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea0000b90 with addr=10.0.0.2, port=4420 00:26:23.451 qpair failed and we were unable to recover it. 00:26:23.451 [2024-04-16 23:04:14.351948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.451 [2024-04-16 23:04:14.352093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.451 [2024-04-16 23:04:14.352118] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea0000b90 with addr=10.0.0.2, port=4420 00:26:23.451 qpair failed and we were unable to recover it. 00:26:23.451 [2024-04-16 23:04:14.352235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.451 [2024-04-16 23:04:14.352339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.451 [2024-04-16 23:04:14.352365] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea0000b90 with addr=10.0.0.2, port=4420 00:26:23.451 qpair failed and we were unable to recover it. 00:26:23.451 [2024-04-16 23:04:14.352514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.451 [2024-04-16 23:04:14.352644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.451 [2024-04-16 23:04:14.352669] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea0000b90 with addr=10.0.0.2, port=4420 00:26:23.451 qpair failed and we were unable to recover it. 00:26:23.451 [2024-04-16 23:04:14.352813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.451 [2024-04-16 23:04:14.352922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.451 [2024-04-16 23:04:14.352947] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea0000b90 with addr=10.0.0.2, port=4420 00:26:23.451 qpair failed and we were unable to recover it. 00:26:23.451 [2024-04-16 23:04:14.353086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.451 [2024-04-16 23:04:14.353221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.451 [2024-04-16 23:04:14.353248] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea0000b90 with addr=10.0.0.2, port=4420 00:26:23.451 qpair failed and we were unable to recover it. 00:26:23.451 [2024-04-16 23:04:14.353355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.451 [2024-04-16 23:04:14.353470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.451 [2024-04-16 23:04:14.353510] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea0000b90 with addr=10.0.0.2, port=4420 00:26:23.451 qpair failed and we were unable to recover it. 00:26:23.451 [2024-04-16 23:04:14.353619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.451 [2024-04-16 23:04:14.353757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.451 [2024-04-16 23:04:14.353783] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea0000b90 with addr=10.0.0.2, port=4420 00:26:23.451 qpair failed and we were unable to recover it. 00:26:23.451 [2024-04-16 23:04:14.353952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.451 [2024-04-16 23:04:14.354060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.451 [2024-04-16 23:04:14.354085] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea0000b90 with addr=10.0.0.2, port=4420 00:26:23.451 qpair failed and we were unable to recover it. 00:26:23.451 [2024-04-16 23:04:14.354197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.451 [2024-04-16 23:04:14.354309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.451 [2024-04-16 23:04:14.354334] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea0000b90 with addr=10.0.0.2, port=4420 00:26:23.451 qpair failed and we were unable to recover it. 00:26:23.451 [2024-04-16 23:04:14.354450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.451 [2024-04-16 23:04:14.354571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.451 [2024-04-16 23:04:14.354597] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea0000b90 with addr=10.0.0.2, port=4420 00:26:23.451 qpair failed and we were unable to recover it. 00:26:23.451 [2024-04-16 23:04:14.354701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.451 [2024-04-16 23:04:14.354820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.451 [2024-04-16 23:04:14.354846] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea0000b90 with addr=10.0.0.2, port=4420 00:26:23.451 qpair failed and we were unable to recover it. 00:26:23.451 [2024-04-16 23:04:14.354958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.451 [2024-04-16 23:04:14.355078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.451 [2024-04-16 23:04:14.355103] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea0000b90 with addr=10.0.0.2, port=4420 00:26:23.451 qpair failed and we were unable to recover it. 00:26:23.451 [2024-04-16 23:04:14.355228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.451 [2024-04-16 23:04:14.355367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.451 [2024-04-16 23:04:14.355393] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea0000b90 with addr=10.0.0.2, port=4420 00:26:23.451 qpair failed and we were unable to recover it. 00:26:23.451 [2024-04-16 23:04:14.355507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.451 [2024-04-16 23:04:14.355618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.451 [2024-04-16 23:04:14.355644] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea0000b90 with addr=10.0.0.2, port=4420 00:26:23.451 qpair failed and we were unable to recover it. 00:26:23.451 [2024-04-16 23:04:14.355756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.451 [2024-04-16 23:04:14.355868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.451 [2024-04-16 23:04:14.355895] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea0000b90 with addr=10.0.0.2, port=4420 00:26:23.451 qpair failed and we were unable to recover it. 00:26:23.451 [2024-04-16 23:04:14.356016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.451 [2024-04-16 23:04:14.356168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.451 [2024-04-16 23:04:14.356205] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea0000b90 with addr=10.0.0.2, port=4420 00:26:23.451 qpair failed and we were unable to recover it. 00:26:23.451 [2024-04-16 23:04:14.356325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.451 [2024-04-16 23:04:14.356470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.451 [2024-04-16 23:04:14.356496] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea0000b90 with addr=10.0.0.2, port=4420 00:26:23.451 qpair failed and we were unable to recover it. 00:26:23.451 [2024-04-16 23:04:14.356608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.451 [2024-04-16 23:04:14.356740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.451 [2024-04-16 23:04:14.356766] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea0000b90 with addr=10.0.0.2, port=4420 00:26:23.451 qpair failed and we were unable to recover it. 00:26:23.451 [2024-04-16 23:04:14.356877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.451 [2024-04-16 23:04:14.356987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.451 [2024-04-16 23:04:14.357013] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea0000b90 with addr=10.0.0.2, port=4420 00:26:23.451 qpair failed and we were unable to recover it. 00:26:23.451 [2024-04-16 23:04:14.357138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.451 [2024-04-16 23:04:14.357259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.451 [2024-04-16 23:04:14.357285] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea0000b90 with addr=10.0.0.2, port=4420 00:26:23.451 qpair failed and we were unable to recover it. 00:26:23.451 [2024-04-16 23:04:14.357392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.451 [2024-04-16 23:04:14.357513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.451 [2024-04-16 23:04:14.357538] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea0000b90 with addr=10.0.0.2, port=4420 00:26:23.451 qpair failed and we were unable to recover it. 00:26:23.451 [2024-04-16 23:04:14.357684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.451 [2024-04-16 23:04:14.357797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.451 [2024-04-16 23:04:14.357823] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea0000b90 with addr=10.0.0.2, port=4420 00:26:23.451 qpair failed and we were unable to recover it. 00:26:23.451 [2024-04-16 23:04:14.357932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.451 [2024-04-16 23:04:14.358061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.451 [2024-04-16 23:04:14.358088] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea0000b90 with addr=10.0.0.2, port=4420 00:26:23.451 qpair failed and we were unable to recover it. 00:26:23.451 [2024-04-16 23:04:14.358213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.451 [2024-04-16 23:04:14.358350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.451 [2024-04-16 23:04:14.358377] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea0000b90 with addr=10.0.0.2, port=4420 00:26:23.451 qpair failed and we were unable to recover it. 00:26:23.451 [2024-04-16 23:04:14.358520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.452 [2024-04-16 23:04:14.358667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.452 [2024-04-16 23:04:14.358694] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea0000b90 with addr=10.0.0.2, port=4420 00:26:23.452 qpair failed and we were unable to recover it. 00:26:23.452 [2024-04-16 23:04:14.358803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.452 [2024-04-16 23:04:14.358922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.452 [2024-04-16 23:04:14.358956] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea0000b90 with addr=10.0.0.2, port=4420 00:26:23.452 qpair failed and we were unable to recover it. 00:26:23.452 [2024-04-16 23:04:14.359071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.452 [2024-04-16 23:04:14.359234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.452 [2024-04-16 23:04:14.359260] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea0000b90 with addr=10.0.0.2, port=4420 00:26:23.452 qpair failed and we were unable to recover it. 00:26:23.452 [2024-04-16 23:04:14.359396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.452 [2024-04-16 23:04:14.359522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.452 [2024-04-16 23:04:14.359548] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea0000b90 with addr=10.0.0.2, port=4420 00:26:23.452 qpair failed and we were unable to recover it. 00:26:23.452 [2024-04-16 23:04:14.359673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.452 [2024-04-16 23:04:14.359840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.452 [2024-04-16 23:04:14.359866] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea0000b90 with addr=10.0.0.2, port=4420 00:26:23.452 qpair failed and we were unable to recover it. 00:26:23.452 [2024-04-16 23:04:14.359989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.452 [2024-04-16 23:04:14.360127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.452 [2024-04-16 23:04:14.360154] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea0000b90 with addr=10.0.0.2, port=4420 00:26:23.452 qpair failed and we were unable to recover it. 00:26:23.452 [2024-04-16 23:04:14.360301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.452 [2024-04-16 23:04:14.360434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.452 [2024-04-16 23:04:14.360475] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.452 qpair failed and we were unable to recover it. 00:26:23.452 [2024-04-16 23:04:14.360591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.452 [2024-04-16 23:04:14.360702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.452 [2024-04-16 23:04:14.360728] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.452 qpair failed and we were unable to recover it. 00:26:23.452 [2024-04-16 23:04:14.360833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.452 [2024-04-16 23:04:14.360951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.452 [2024-04-16 23:04:14.360976] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.452 qpair failed and we were unable to recover it. 00:26:23.452 [2024-04-16 23:04:14.361085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.452 [2024-04-16 23:04:14.361203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.452 [2024-04-16 23:04:14.361234] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.452 qpair failed and we were unable to recover it. 00:26:23.452 [2024-04-16 23:04:14.361344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.452 [2024-04-16 23:04:14.361490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.452 [2024-04-16 23:04:14.361515] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.452 qpair failed and we were unable to recover it. 00:26:23.452 [2024-04-16 23:04:14.361625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.452 [2024-04-16 23:04:14.361741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.452 [2024-04-16 23:04:14.361766] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.452 qpair failed and we were unable to recover it. 00:26:23.452 [2024-04-16 23:04:14.361913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.452 [2024-04-16 23:04:14.362054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.452 [2024-04-16 23:04:14.362080] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.452 qpair failed and we were unable to recover it. 00:26:23.452 [2024-04-16 23:04:14.362199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.452 [2024-04-16 23:04:14.362322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.452 [2024-04-16 23:04:14.362348] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.452 qpair failed and we were unable to recover it. 00:26:23.452 [2024-04-16 23:04:14.362455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.452 [2024-04-16 23:04:14.362567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.452 [2024-04-16 23:04:14.362592] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.452 qpair failed and we were unable to recover it. 00:26:23.452 [2024-04-16 23:04:14.362730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.452 [2024-04-16 23:04:14.362869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.452 [2024-04-16 23:04:14.362895] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.452 qpair failed and we were unable to recover it. 00:26:23.452 [2024-04-16 23:04:14.362998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.452 [2024-04-16 23:04:14.363103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.452 [2024-04-16 23:04:14.363128] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.452 qpair failed and we were unable to recover it. 00:26:23.452 [2024-04-16 23:04:14.363252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.452 [2024-04-16 23:04:14.363364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.452 [2024-04-16 23:04:14.363390] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.452 qpair failed and we were unable to recover it. 00:26:23.452 [2024-04-16 23:04:14.363519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.452 [2024-04-16 23:04:14.363633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.452 [2024-04-16 23:04:14.363659] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.452 qpair failed and we were unable to recover it. 00:26:23.452 [2024-04-16 23:04:14.363779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.452 [2024-04-16 23:04:14.363913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.452 [2024-04-16 23:04:14.363939] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.452 qpair failed and we were unable to recover it. 00:26:23.452 [2024-04-16 23:04:14.364047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.452 [2024-04-16 23:04:14.364188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.452 [2024-04-16 23:04:14.364213] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.452 qpair failed and we were unable to recover it. 00:26:23.452 [2024-04-16 23:04:14.364355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.452 [2024-04-16 23:04:14.364467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.452 [2024-04-16 23:04:14.364500] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.452 qpair failed and we were unable to recover it. 00:26:23.452 [2024-04-16 23:04:14.364645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.452 [2024-04-16 23:04:14.364762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.452 [2024-04-16 23:04:14.364786] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.452 qpair failed and we were unable to recover it. 00:26:23.452 [2024-04-16 23:04:14.364928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.452 [2024-04-16 23:04:14.365046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.452 [2024-04-16 23:04:14.365071] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.452 qpair failed and we were unable to recover it. 00:26:23.452 [2024-04-16 23:04:14.365190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.452 [2024-04-16 23:04:14.365313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.452 [2024-04-16 23:04:14.365338] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.452 qpair failed and we were unable to recover it. 00:26:23.452 [2024-04-16 23:04:14.365452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.452 [2024-04-16 23:04:14.365567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.452 [2024-04-16 23:04:14.365591] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.452 qpair failed and we were unable to recover it. 00:26:23.452 [2024-04-16 23:04:14.365732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.452 [2024-04-16 23:04:14.365842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.452 [2024-04-16 23:04:14.365866] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.452 qpair failed and we were unable to recover it. 00:26:23.452 [2024-04-16 23:04:14.365984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.452 [2024-04-16 23:04:14.366106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.452 [2024-04-16 23:04:14.366133] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.452 qpair failed and we were unable to recover it. 00:26:23.452 [2024-04-16 23:04:14.366272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.452 [2024-04-16 23:04:14.366385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.452 [2024-04-16 23:04:14.366410] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.452 qpair failed and we were unable to recover it. 00:26:23.452 [2024-04-16 23:04:14.366541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.452 [2024-04-16 23:04:14.366663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.452 [2024-04-16 23:04:14.366688] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.452 qpair failed and we were unable to recover it. 00:26:23.452 [2024-04-16 23:04:14.366823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.452 [2024-04-16 23:04:14.366954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.452 [2024-04-16 23:04:14.366980] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.452 qpair failed and we were unable to recover it. 00:26:23.452 [2024-04-16 23:04:14.367094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.452 [2024-04-16 23:04:14.367209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.452 [2024-04-16 23:04:14.367235] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.452 qpair failed and we were unable to recover it. 00:26:23.452 [2024-04-16 23:04:14.367358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.452 [2024-04-16 23:04:14.367469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.452 [2024-04-16 23:04:14.367495] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.452 qpair failed and we were unable to recover it. 00:26:23.452 [2024-04-16 23:04:14.367600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.452 [2024-04-16 23:04:14.367716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.452 [2024-04-16 23:04:14.367743] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.452 qpair failed and we were unable to recover it. 00:26:23.452 [2024-04-16 23:04:14.367852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.452 [2024-04-16 23:04:14.367966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.452 [2024-04-16 23:04:14.367991] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.452 qpair failed and we were unable to recover it. 00:26:23.452 [2024-04-16 23:04:14.368116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.452 [2024-04-16 23:04:14.368233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.452 [2024-04-16 23:04:14.368259] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.452 qpair failed and we were unable to recover it. 00:26:23.452 [2024-04-16 23:04:14.368380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.452 [2024-04-16 23:04:14.368499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.452 [2024-04-16 23:04:14.368524] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.452 qpair failed and we were unable to recover it. 00:26:23.452 [2024-04-16 23:04:14.368628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.452 [2024-04-16 23:04:14.368760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.452 [2024-04-16 23:04:14.368784] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.452 qpair failed and we were unable to recover it. 00:26:23.452 [2024-04-16 23:04:14.368895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.452 [2024-04-16 23:04:14.369035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.452 [2024-04-16 23:04:14.369060] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.452 qpair failed and we were unable to recover it. 00:26:23.452 [2024-04-16 23:04:14.369181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.452 [2024-04-16 23:04:14.369309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.452 [2024-04-16 23:04:14.369334] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.452 qpair failed and we were unable to recover it. 00:26:23.452 [2024-04-16 23:04:14.369447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.452 [2024-04-16 23:04:14.369583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.452 [2024-04-16 23:04:14.369608] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.452 qpair failed and we were unable to recover it. 00:26:23.452 [2024-04-16 23:04:14.369749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.452 [2024-04-16 23:04:14.369871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.452 [2024-04-16 23:04:14.369898] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.452 qpair failed and we were unable to recover it. 00:26:23.452 [2024-04-16 23:04:14.370022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.452 [2024-04-16 23:04:14.370140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.452 [2024-04-16 23:04:14.370167] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.452 qpair failed and we were unable to recover it. 00:26:23.452 [2024-04-16 23:04:14.370299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.452 [2024-04-16 23:04:14.370423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.452 [2024-04-16 23:04:14.370448] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.452 qpair failed and we were unable to recover it. 00:26:23.452 [2024-04-16 23:04:14.370600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.452 [2024-04-16 23:04:14.370747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.452 [2024-04-16 23:04:14.370773] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.452 qpair failed and we were unable to recover it. 00:26:23.452 [2024-04-16 23:04:14.370920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.452 [2024-04-16 23:04:14.371024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.452 [2024-04-16 23:04:14.371049] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.452 qpair failed and we were unable to recover it. 00:26:23.452 [2024-04-16 23:04:14.371174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.452 [2024-04-16 23:04:14.371305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.452 [2024-04-16 23:04:14.371331] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.452 qpair failed and we were unable to recover it. 00:26:23.452 [2024-04-16 23:04:14.371468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.452 [2024-04-16 23:04:14.371584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.452 [2024-04-16 23:04:14.371610] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.452 qpair failed and we were unable to recover it. 00:26:23.452 [2024-04-16 23:04:14.371715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.452 [2024-04-16 23:04:14.371837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.452 [2024-04-16 23:04:14.371861] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.452 qpair failed and we were unable to recover it. 00:26:23.452 [2024-04-16 23:04:14.371974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.452 [2024-04-16 23:04:14.372098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.452 [2024-04-16 23:04:14.372123] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.452 qpair failed and we were unable to recover it. 00:26:23.452 [2024-04-16 23:04:14.372273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.452 [2024-04-16 23:04:14.372389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.452 [2024-04-16 23:04:14.372414] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.452 qpair failed and we were unable to recover it. 00:26:23.452 [2024-04-16 23:04:14.372543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.452 [2024-04-16 23:04:14.372658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.452 [2024-04-16 23:04:14.372683] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.452 qpair failed and we were unable to recover it. 00:26:23.452 [2024-04-16 23:04:14.372797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.452 [2024-04-16 23:04:14.372908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.452 [2024-04-16 23:04:14.372933] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.452 qpair failed and we were unable to recover it. 00:26:23.452 [2024-04-16 23:04:14.373071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.452 [2024-04-16 23:04:14.373187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.452 [2024-04-16 23:04:14.373212] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.452 qpair failed and we were unable to recover it. 00:26:23.453 [2024-04-16 23:04:14.373370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.453 [2024-04-16 23:04:14.373478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.453 [2024-04-16 23:04:14.373505] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.453 qpair failed and we were unable to recover it. 00:26:23.453 [2024-04-16 23:04:14.373641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.453 [2024-04-16 23:04:14.373777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.453 [2024-04-16 23:04:14.373803] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.453 qpair failed and we were unable to recover it. 00:26:23.453 [2024-04-16 23:04:14.373912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.453 [2024-04-16 23:04:14.374016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.453 [2024-04-16 23:04:14.374041] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.453 qpair failed and we were unable to recover it. 00:26:23.453 [2024-04-16 23:04:14.374162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.453 [2024-04-16 23:04:14.374318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.453 [2024-04-16 23:04:14.374344] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.453 qpair failed and we were unable to recover it. 00:26:23.453 [2024-04-16 23:04:14.374456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.453 [2024-04-16 23:04:14.374562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.453 [2024-04-16 23:04:14.374587] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.453 qpair failed and we were unable to recover it. 00:26:23.453 [2024-04-16 23:04:14.374707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.453 [2024-04-16 23:04:14.374813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.453 [2024-04-16 23:04:14.374839] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.453 qpair failed and we were unable to recover it. 00:26:23.453 [2024-04-16 23:04:14.374947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.453 [2024-04-16 23:04:14.375054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.453 [2024-04-16 23:04:14.375079] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.453 qpair failed and we were unable to recover it. 00:26:23.453 [2024-04-16 23:04:14.375202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.453 [2024-04-16 23:04:14.375322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.453 [2024-04-16 23:04:14.375346] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.453 qpair failed and we were unable to recover it. 00:26:23.453 [2024-04-16 23:04:14.375465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.453 [2024-04-16 23:04:14.375579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.453 [2024-04-16 23:04:14.375603] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.453 qpair failed and we were unable to recover it. 00:26:23.453 [2024-04-16 23:04:14.375721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.453 [2024-04-16 23:04:14.375858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.453 [2024-04-16 23:04:14.375883] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.453 qpair failed and we were unable to recover it. 00:26:23.453 [2024-04-16 23:04:14.375991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.453 [2024-04-16 23:04:14.376098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.453 [2024-04-16 23:04:14.376124] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.453 qpair failed and we were unable to recover it. 00:26:23.453 [2024-04-16 23:04:14.376277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.453 [2024-04-16 23:04:14.376393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.453 [2024-04-16 23:04:14.376419] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.453 qpair failed and we were unable to recover it. 00:26:23.453 [2024-04-16 23:04:14.376536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.453 [2024-04-16 23:04:14.376698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.453 [2024-04-16 23:04:14.376723] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.453 qpair failed and we were unable to recover it. 00:26:23.453 [2024-04-16 23:04:14.376841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.453 [2024-04-16 23:04:14.376949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.453 [2024-04-16 23:04:14.376975] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.453 qpair failed and we were unable to recover it. 00:26:23.453 [2024-04-16 23:04:14.377109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.453 [2024-04-16 23:04:14.377227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.453 [2024-04-16 23:04:14.377252] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.453 qpair failed and we were unable to recover it. 00:26:23.453 [2024-04-16 23:04:14.377366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.453 [2024-04-16 23:04:14.377472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.453 [2024-04-16 23:04:14.377496] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.453 qpair failed and we were unable to recover it. 00:26:23.453 [2024-04-16 23:04:14.377614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.453 [2024-04-16 23:04:14.377730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.453 [2024-04-16 23:04:14.377756] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.453 qpair failed and we were unable to recover it. 00:26:23.453 [2024-04-16 23:04:14.377867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.453 [2024-04-16 23:04:14.378006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.453 [2024-04-16 23:04:14.378031] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.453 qpair failed and we were unable to recover it. 00:26:23.453 [2024-04-16 23:04:14.378148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.453 [2024-04-16 23:04:14.378273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.453 [2024-04-16 23:04:14.378298] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.453 qpair failed and we were unable to recover it. 00:26:23.453 [2024-04-16 23:04:14.378404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.453 [2024-04-16 23:04:14.378550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.453 [2024-04-16 23:04:14.378575] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.453 qpair failed and we were unable to recover it. 00:26:23.453 [2024-04-16 23:04:14.378716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.453 [2024-04-16 23:04:14.378827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.453 [2024-04-16 23:04:14.378852] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.453 qpair failed and we were unable to recover it. 00:26:23.453 [2024-04-16 23:04:14.378972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.453 [2024-04-16 23:04:14.379088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.453 [2024-04-16 23:04:14.379112] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.453 qpair failed and we were unable to recover it. 00:26:23.453 [2024-04-16 23:04:14.379251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.453 [2024-04-16 23:04:14.379365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.453 [2024-04-16 23:04:14.379391] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.453 qpair failed and we were unable to recover it. 00:26:23.453 [2024-04-16 23:04:14.379527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.453 [2024-04-16 23:04:14.379663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.453 [2024-04-16 23:04:14.379688] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.453 qpair failed and we were unable to recover it. 00:26:23.453 [2024-04-16 23:04:14.379799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.453 [2024-04-16 23:04:14.379941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.453 [2024-04-16 23:04:14.379967] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.453 qpair failed and we were unable to recover it. 00:26:23.453 [2024-04-16 23:04:14.380074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.453 [2024-04-16 23:04:14.380199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.453 [2024-04-16 23:04:14.380236] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.453 qpair failed and we were unable to recover it. 00:26:23.453 [2024-04-16 23:04:14.380353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.453 [2024-04-16 23:04:14.380472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.453 [2024-04-16 23:04:14.380500] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.453 qpair failed and we were unable to recover it. 00:26:23.453 [2024-04-16 23:04:14.380605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.453 [2024-04-16 23:04:14.380715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.453 [2024-04-16 23:04:14.380739] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.453 qpair failed and we were unable to recover it. 00:26:23.453 [2024-04-16 23:04:14.380863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.453 [2024-04-16 23:04:14.380972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.453 [2024-04-16 23:04:14.380996] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.453 qpair failed and we were unable to recover it. 00:26:23.453 [2024-04-16 23:04:14.381110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.453 [2024-04-16 23:04:14.381245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.453 [2024-04-16 23:04:14.381270] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.453 qpair failed and we were unable to recover it. 00:26:23.453 [2024-04-16 23:04:14.381383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.453 [2024-04-16 23:04:14.381500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.453 [2024-04-16 23:04:14.381524] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.453 qpair failed and we were unable to recover it. 00:26:23.453 [2024-04-16 23:04:14.381670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.453 [2024-04-16 23:04:14.381785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.453 [2024-04-16 23:04:14.381810] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.453 qpair failed and we were unable to recover it. 00:26:23.453 [2024-04-16 23:04:14.381937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.453 [2024-04-16 23:04:14.382072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.453 [2024-04-16 23:04:14.382098] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.453 qpair failed and we were unable to recover it. 00:26:23.453 [2024-04-16 23:04:14.382206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.453 [2024-04-16 23:04:14.382335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.453 [2024-04-16 23:04:14.382361] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.453 qpair failed and we were unable to recover it. 00:26:23.453 [2024-04-16 23:04:14.382480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.453 [2024-04-16 23:04:14.382589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.453 [2024-04-16 23:04:14.382613] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.453 qpair failed and we were unable to recover it. 00:26:23.453 [2024-04-16 23:04:14.382751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.453 [2024-04-16 23:04:14.382886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.453 [2024-04-16 23:04:14.382911] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.453 qpair failed and we were unable to recover it. 00:26:23.453 [2024-04-16 23:04:14.383027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.453 [2024-04-16 23:04:14.383143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.453 [2024-04-16 23:04:14.383168] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.453 qpair failed and we were unable to recover it. 00:26:23.453 [2024-04-16 23:04:14.383308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.453 [2024-04-16 23:04:14.383413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.453 [2024-04-16 23:04:14.383438] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.453 qpair failed and we were unable to recover it. 00:26:23.453 [2024-04-16 23:04:14.383584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.453 [2024-04-16 23:04:14.383700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.453 [2024-04-16 23:04:14.383726] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.453 qpair failed and we were unable to recover it. 00:26:23.453 [2024-04-16 23:04:14.383834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.453 [2024-04-16 23:04:14.383945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.453 [2024-04-16 23:04:14.383971] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.453 qpair failed and we were unable to recover it. 00:26:23.453 [2024-04-16 23:04:14.384080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.453 [2024-04-16 23:04:14.384212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.453 [2024-04-16 23:04:14.384248] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.453 qpair failed and we were unable to recover it. 00:26:23.453 [2024-04-16 23:04:14.384353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.453 [2024-04-16 23:04:14.384477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.453 [2024-04-16 23:04:14.384502] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.453 qpair failed and we were unable to recover it. 00:26:23.453 [2024-04-16 23:04:14.384610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.453 [2024-04-16 23:04:14.384726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.453 [2024-04-16 23:04:14.384751] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.453 qpair failed and we were unable to recover it. 00:26:23.453 [2024-04-16 23:04:14.384886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.453 [2024-04-16 23:04:14.385032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.453 [2024-04-16 23:04:14.385056] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.453 qpair failed and we were unable to recover it. 00:26:23.453 [2024-04-16 23:04:14.385168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.453 [2024-04-16 23:04:14.385295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.453 [2024-04-16 23:04:14.385320] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.453 qpair failed and we were unable to recover it. 00:26:23.453 [2024-04-16 23:04:14.385455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.453 [2024-04-16 23:04:14.385589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.453 [2024-04-16 23:04:14.385615] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.453 qpair failed and we were unable to recover it. 00:26:23.453 [2024-04-16 23:04:14.385721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.453 [2024-04-16 23:04:14.385832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.453 [2024-04-16 23:04:14.385857] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.453 qpair failed and we were unable to recover it. 00:26:23.453 [2024-04-16 23:04:14.385973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.453 [2024-04-16 23:04:14.386091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.453 [2024-04-16 23:04:14.386117] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.453 qpair failed and we were unable to recover it. 00:26:23.454 [2024-04-16 23:04:14.386230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.454 [2024-04-16 23:04:14.386347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.454 [2024-04-16 23:04:14.386373] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.454 qpair failed and we were unable to recover it. 00:26:23.454 [2024-04-16 23:04:14.386490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.454 [2024-04-16 23:04:14.386611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.454 [2024-04-16 23:04:14.386636] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.454 qpair failed and we were unable to recover it. 00:26:23.454 [2024-04-16 23:04:14.386773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.454 [2024-04-16 23:04:14.386907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.454 [2024-04-16 23:04:14.386932] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.454 qpair failed and we were unable to recover it. 00:26:23.454 [2024-04-16 23:04:14.387042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.454 [2024-04-16 23:04:14.387155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.454 [2024-04-16 23:04:14.387186] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.454 qpair failed and we were unable to recover it. 00:26:23.454 [2024-04-16 23:04:14.387330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.454 [2024-04-16 23:04:14.387443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.454 [2024-04-16 23:04:14.387468] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.454 qpair failed and we were unable to recover it. 00:26:23.454 [2024-04-16 23:04:14.387626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.454 [2024-04-16 23:04:14.387760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.454 [2024-04-16 23:04:14.387785] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.454 qpair failed and we were unable to recover it. 00:26:23.454 [2024-04-16 23:04:14.387894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.454 [2024-04-16 23:04:14.388032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.454 [2024-04-16 23:04:14.388057] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.454 qpair failed and we were unable to recover it. 00:26:23.454 [2024-04-16 23:04:14.388165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.454 [2024-04-16 23:04:14.388318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.454 [2024-04-16 23:04:14.388343] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.454 qpair failed and we were unable to recover it. 00:26:23.454 [2024-04-16 23:04:14.388479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.454 [2024-04-16 23:04:14.388631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.454 [2024-04-16 23:04:14.388655] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.454 qpair failed and we were unable to recover it. 00:26:23.454 [2024-04-16 23:04:14.388776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.454 [2024-04-16 23:04:14.388922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.454 [2024-04-16 23:04:14.388947] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.454 qpair failed and we were unable to recover it. 00:26:23.454 [2024-04-16 23:04:14.389071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.454 [2024-04-16 23:04:14.389222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.454 [2024-04-16 23:04:14.389249] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.454 qpair failed and we were unable to recover it. 00:26:23.454 [2024-04-16 23:04:14.389355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.454 [2024-04-16 23:04:14.389475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.454 [2024-04-16 23:04:14.389500] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.454 qpair failed and we were unable to recover it. 00:26:23.454 [2024-04-16 23:04:14.389608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.454 [2024-04-16 23:04:14.389710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.454 [2024-04-16 23:04:14.389735] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.454 qpair failed and we were unable to recover it. 00:26:23.454 [2024-04-16 23:04:14.389848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.454 [2024-04-16 23:04:14.389953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.454 [2024-04-16 23:04:14.389978] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.454 qpair failed and we were unable to recover it. 00:26:23.454 [2024-04-16 23:04:14.390091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.454 [2024-04-16 23:04:14.390223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.454 [2024-04-16 23:04:14.390250] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.454 qpair failed and we were unable to recover it. 00:26:23.454 [2024-04-16 23:04:14.390387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.454 [2024-04-16 23:04:14.390499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.454 [2024-04-16 23:04:14.390525] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.454 qpair failed and we were unable to recover it. 00:26:23.454 [2024-04-16 23:04:14.390644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.454 [2024-04-16 23:04:14.390752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.454 [2024-04-16 23:04:14.390776] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.454 qpair failed and we were unable to recover it. 00:26:23.454 [2024-04-16 23:04:14.390890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.454 [2024-04-16 23:04:14.390998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.454 [2024-04-16 23:04:14.391026] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.454 qpair failed and we were unable to recover it. 00:26:23.454 [2024-04-16 23:04:14.391140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.454 [2024-04-16 23:04:14.391269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.454 [2024-04-16 23:04:14.391294] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.454 qpair failed and we were unable to recover it. 00:26:23.454 [2024-04-16 23:04:14.391431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.454 [2024-04-16 23:04:14.391542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.454 [2024-04-16 23:04:14.391566] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.454 qpair failed and we were unable to recover it. 00:26:23.454 [2024-04-16 23:04:14.391681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.454 [2024-04-16 23:04:14.391792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.454 [2024-04-16 23:04:14.391819] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.454 qpair failed and we were unable to recover it. 00:26:23.454 [2024-04-16 23:04:14.391947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.454 [2024-04-16 23:04:14.392052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.454 [2024-04-16 23:04:14.392077] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.454 qpair failed and we were unable to recover it. 00:26:23.454 [2024-04-16 23:04:14.392214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.454 [2024-04-16 23:04:14.392331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.454 [2024-04-16 23:04:14.392356] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.454 qpair failed and we were unable to recover it. 00:26:23.454 [2024-04-16 23:04:14.392472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.454 [2024-04-16 23:04:14.392608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.454 [2024-04-16 23:04:14.392633] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.454 qpair failed and we were unable to recover it. 00:26:23.454 [2024-04-16 23:04:14.392801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.454 [2024-04-16 23:04:14.392921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.454 [2024-04-16 23:04:14.392946] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.454 qpair failed and we were unable to recover it. 00:26:23.454 [2024-04-16 23:04:14.393088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.454 [2024-04-16 23:04:14.393202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.454 [2024-04-16 23:04:14.393230] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.454 qpair failed and we were unable to recover it. 00:26:23.454 [2024-04-16 23:04:14.393346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.454 [2024-04-16 23:04:14.393462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.454 [2024-04-16 23:04:14.393498] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.454 qpair failed and we were unable to recover it. 00:26:23.454 [2024-04-16 23:04:14.393624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.454 [2024-04-16 23:04:14.393741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.454 [2024-04-16 23:04:14.393766] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.454 qpair failed and we were unable to recover it. 00:26:23.454 [2024-04-16 23:04:14.393917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.454 [2024-04-16 23:04:14.394054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.454 [2024-04-16 23:04:14.394078] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.454 qpair failed and we were unable to recover it. 00:26:23.454 [2024-04-16 23:04:14.394213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.454 [2024-04-16 23:04:14.394369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.454 [2024-04-16 23:04:14.394394] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.454 qpair failed and we were unable to recover it. 00:26:23.454 [2024-04-16 23:04:14.394499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.454 [2024-04-16 23:04:14.394637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.454 [2024-04-16 23:04:14.394668] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.454 qpair failed and we were unable to recover it. 00:26:23.454 [2024-04-16 23:04:14.394815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.454 [2024-04-16 23:04:14.394928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.454 [2024-04-16 23:04:14.394954] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.454 qpair failed and we were unable to recover it. 00:26:23.454 [2024-04-16 23:04:14.395071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.454 [2024-04-16 23:04:14.395183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.454 [2024-04-16 23:04:14.395208] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.454 qpair failed and we were unable to recover it. 00:26:23.454 [2024-04-16 23:04:14.395329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.454 [2024-04-16 23:04:14.395451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.454 [2024-04-16 23:04:14.395477] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.454 qpair failed and we were unable to recover it. 00:26:23.454 [2024-04-16 23:04:14.395603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.454 [2024-04-16 23:04:14.395714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.454 [2024-04-16 23:04:14.395739] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.454 qpair failed and we were unable to recover it. 00:26:23.454 [2024-04-16 23:04:14.395844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.454 [2024-04-16 23:04:14.395953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.454 [2024-04-16 23:04:14.395979] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.454 qpair failed and we were unable to recover it. 00:26:23.454 [2024-04-16 23:04:14.396090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.454 [2024-04-16 23:04:14.396236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.454 [2024-04-16 23:04:14.396263] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.454 qpair failed and we were unable to recover it. 00:26:23.454 [2024-04-16 23:04:14.396377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.454 [2024-04-16 23:04:14.396490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.454 [2024-04-16 23:04:14.396516] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.454 qpair failed and we were unable to recover it. 00:26:23.454 [2024-04-16 23:04:14.396634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.454 [2024-04-16 23:04:14.396747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.454 [2024-04-16 23:04:14.396772] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.454 qpair failed and we were unable to recover it. 00:26:23.454 [2024-04-16 23:04:14.396920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.454 [2024-04-16 23:04:14.397039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.454 [2024-04-16 23:04:14.397065] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.454 qpair failed and we were unable to recover it. 00:26:23.454 [2024-04-16 23:04:14.397189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.454 [2024-04-16 23:04:14.397306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.454 [2024-04-16 23:04:14.397336] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.454 qpair failed and we were unable to recover it. 00:26:23.454 [2024-04-16 23:04:14.397454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.454 [2024-04-16 23:04:14.397576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.454 [2024-04-16 23:04:14.397601] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.454 qpair failed and we were unable to recover it. 00:26:23.454 [2024-04-16 23:04:14.397712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.454 [2024-04-16 23:04:14.397826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.454 [2024-04-16 23:04:14.397852] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.454 qpair failed and we were unable to recover it. 00:26:23.454 [2024-04-16 23:04:14.397987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.454 [2024-04-16 23:04:14.398110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.454 [2024-04-16 23:04:14.398135] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.454 qpair failed and we were unable to recover it. 00:26:23.454 [2024-04-16 23:04:14.398263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.454 [2024-04-16 23:04:14.398383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.454 [2024-04-16 23:04:14.398409] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.454 qpair failed and we were unable to recover it. 00:26:23.454 [2024-04-16 23:04:14.398540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.454 [2024-04-16 23:04:14.398669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.454 [2024-04-16 23:04:14.398694] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.454 qpair failed and we were unable to recover it. 00:26:23.454 [2024-04-16 23:04:14.398801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.454 [2024-04-16 23:04:14.398919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.454 [2024-04-16 23:04:14.398944] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.454 qpair failed and we were unable to recover it. 00:26:23.454 [2024-04-16 23:04:14.399056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.454 [2024-04-16 23:04:14.399185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.454 [2024-04-16 23:04:14.399210] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.454 qpair failed and we were unable to recover it. 00:26:23.454 [2024-04-16 23:04:14.399332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.454 [2024-04-16 23:04:14.399445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.454 [2024-04-16 23:04:14.399469] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.454 qpair failed and we were unable to recover it. 00:26:23.454 [2024-04-16 23:04:14.399589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.454 [2024-04-16 23:04:14.399699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.454 [2024-04-16 23:04:14.399725] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.454 qpair failed and we were unable to recover it. 00:26:23.454 [2024-04-16 23:04:14.399840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.454 [2024-04-16 23:04:14.399966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.454 [2024-04-16 23:04:14.399996] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.454 qpair failed and we were unable to recover it. 00:26:23.454 [2024-04-16 23:04:14.400118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.454 [2024-04-16 23:04:14.400241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.454 [2024-04-16 23:04:14.400269] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.454 qpair failed and we were unable to recover it. 00:26:23.454 [2024-04-16 23:04:14.400387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.455 [2024-04-16 23:04:14.400527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.455 [2024-04-16 23:04:14.400553] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.455 qpair failed and we were unable to recover it. 00:26:23.455 [2024-04-16 23:04:14.400671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.455 [2024-04-16 23:04:14.400807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.455 [2024-04-16 23:04:14.400832] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.455 qpair failed and we were unable to recover it. 00:26:23.455 [2024-04-16 23:04:14.400953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.455 [2024-04-16 23:04:14.401089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.455 [2024-04-16 23:04:14.401114] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.455 qpair failed and we were unable to recover it. 00:26:23.455 [2024-04-16 23:04:14.401230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.455 [2024-04-16 23:04:14.401347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.455 [2024-04-16 23:04:14.401371] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.455 qpair failed and we were unable to recover it. 00:26:23.455 [2024-04-16 23:04:14.401519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.455 [2024-04-16 23:04:14.401626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.455 [2024-04-16 23:04:14.401650] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.455 qpair failed and we were unable to recover it. 00:26:23.455 [2024-04-16 23:04:14.401765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.455 [2024-04-16 23:04:14.401915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.455 [2024-04-16 23:04:14.401941] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.455 qpair failed and we were unable to recover it. 00:26:23.455 [2024-04-16 23:04:14.402054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.455 [2024-04-16 23:04:14.402173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.455 [2024-04-16 23:04:14.402204] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.455 qpair failed and we were unable to recover it. 00:26:23.455 [2024-04-16 23:04:14.402318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.455 [2024-04-16 23:04:14.402431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.455 [2024-04-16 23:04:14.402456] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.455 qpair failed and we were unable to recover it. 00:26:23.455 [2024-04-16 23:04:14.402579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.455 [2024-04-16 23:04:14.402694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.455 [2024-04-16 23:04:14.402722] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.455 qpair failed and we were unable to recover it. 00:26:23.455 [2024-04-16 23:04:14.402833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.455 [2024-04-16 23:04:14.403003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.455 [2024-04-16 23:04:14.403027] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.455 qpair failed and we were unable to recover it. 00:26:23.455 [2024-04-16 23:04:14.403160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.455 [2024-04-16 23:04:14.403287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.455 [2024-04-16 23:04:14.403314] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.455 qpair failed and we were unable to recover it. 00:26:23.455 [2024-04-16 23:04:14.403420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.455 [2024-04-16 23:04:14.403549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.455 [2024-04-16 23:04:14.403574] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.455 qpair failed and we were unable to recover it. 00:26:23.455 [2024-04-16 23:04:14.403711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.455 [2024-04-16 23:04:14.403837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.455 [2024-04-16 23:04:14.403862] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.455 qpair failed and we were unable to recover it. 00:26:23.455 [2024-04-16 23:04:14.404005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.455 [2024-04-16 23:04:14.404186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.455 [2024-04-16 23:04:14.404212] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.455 qpair failed and we were unable to recover it. 00:26:23.455 [2024-04-16 23:04:14.404359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.455 [2024-04-16 23:04:14.404472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.455 [2024-04-16 23:04:14.404498] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.455 qpair failed and we were unable to recover it. 00:26:23.455 [2024-04-16 23:04:14.404630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.455 [2024-04-16 23:04:14.404736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.455 [2024-04-16 23:04:14.404761] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.455 qpair failed and we were unable to recover it. 00:26:23.455 [2024-04-16 23:04:14.404887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.455 [2024-04-16 23:04:14.405030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.455 [2024-04-16 23:04:14.405055] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.455 qpair failed and we were unable to recover it. 00:26:23.455 [2024-04-16 23:04:14.405199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.455 [2024-04-16 23:04:14.405307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.455 [2024-04-16 23:04:14.405331] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.455 qpair failed and we were unable to recover it. 00:26:23.455 [2024-04-16 23:04:14.405471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.455 [2024-04-16 23:04:14.405607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.455 [2024-04-16 23:04:14.405631] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.455 qpair failed and we were unable to recover it. 00:26:23.455 [2024-04-16 23:04:14.405786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.455 [2024-04-16 23:04:14.405901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.455 [2024-04-16 23:04:14.405925] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.455 qpair failed and we were unable to recover it. 00:26:23.455 [2024-04-16 23:04:14.406042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.455 [2024-04-16 23:04:14.406188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.455 [2024-04-16 23:04:14.406224] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.455 qpair failed and we were unable to recover it. 00:26:23.455 [2024-04-16 23:04:14.406330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.455 [2024-04-16 23:04:14.406441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.455 [2024-04-16 23:04:14.406468] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.455 qpair failed and we were unable to recover it. 00:26:23.455 [2024-04-16 23:04:14.406575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.455 [2024-04-16 23:04:14.406684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.455 [2024-04-16 23:04:14.406708] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.455 qpair failed and we were unable to recover it. 00:26:23.455 [2024-04-16 23:04:14.406840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.455 [2024-04-16 23:04:14.406953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.455 [2024-04-16 23:04:14.406977] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.455 qpair failed and we were unable to recover it. 00:26:23.455 [2024-04-16 23:04:14.407128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.455 [2024-04-16 23:04:14.407238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.455 [2024-04-16 23:04:14.407263] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.455 qpair failed and we were unable to recover it. 00:26:23.455 [2024-04-16 23:04:14.407415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.455 [2024-04-16 23:04:14.407537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.455 [2024-04-16 23:04:14.407563] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.455 qpair failed and we were unable to recover it. 00:26:23.455 [2024-04-16 23:04:14.407703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.455 [2024-04-16 23:04:14.407854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.455 [2024-04-16 23:04:14.407878] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.455 qpair failed and we were unable to recover it. 00:26:23.455 [2024-04-16 23:04:14.407991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.455 [2024-04-16 23:04:14.408106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.455 [2024-04-16 23:04:14.408131] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.455 qpair failed and we were unable to recover it. 00:26:23.455 [2024-04-16 23:04:14.408242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.455 [2024-04-16 23:04:14.408359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.455 [2024-04-16 23:04:14.408384] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.455 qpair failed and we were unable to recover it. 00:26:23.455 [2024-04-16 23:04:14.408497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.455 [2024-04-16 23:04:14.408609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.455 [2024-04-16 23:04:14.408635] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.455 qpair failed and we were unable to recover it. 00:26:23.455 [2024-04-16 23:04:14.408749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.455 [2024-04-16 23:04:14.408877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.455 [2024-04-16 23:04:14.408901] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.455 qpair failed and we were unable to recover it. 00:26:23.455 [2024-04-16 23:04:14.409014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.455 [2024-04-16 23:04:14.409127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.455 [2024-04-16 23:04:14.409152] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.455 qpair failed and we were unable to recover it. 00:26:23.455 [2024-04-16 23:04:14.409297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.455 [2024-04-16 23:04:14.409453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.455 [2024-04-16 23:04:14.409490] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.455 qpair failed and we were unable to recover it. 00:26:23.455 [2024-04-16 23:04:14.409614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.455 [2024-04-16 23:04:14.409759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.455 [2024-04-16 23:04:14.409784] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.455 qpair failed and we were unable to recover it. 00:26:23.455 [2024-04-16 23:04:14.409921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.455 [2024-04-16 23:04:14.410060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.455 [2024-04-16 23:04:14.410085] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.455 qpair failed and we were unable to recover it. 00:26:23.455 [2024-04-16 23:04:14.410235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.455 [2024-04-16 23:04:14.410380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.455 [2024-04-16 23:04:14.410406] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.455 qpair failed and we were unable to recover it. 00:26:23.455 [2024-04-16 23:04:14.410574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.455 [2024-04-16 23:04:14.410697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.455 [2024-04-16 23:04:14.410722] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.455 qpair failed and we were unable to recover it. 00:26:23.455 [2024-04-16 23:04:14.410839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.455 [2024-04-16 23:04:14.410952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.455 [2024-04-16 23:04:14.410977] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.455 qpair failed and we were unable to recover it. 00:26:23.455 [2024-04-16 23:04:14.411116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.455 [2024-04-16 23:04:14.411270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.455 [2024-04-16 23:04:14.411296] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.455 qpair failed and we were unable to recover it. 00:26:23.455 [2024-04-16 23:04:14.411414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.455 [2024-04-16 23:04:14.411537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.455 [2024-04-16 23:04:14.411566] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.455 qpair failed and we were unable to recover it. 00:26:23.455 [2024-04-16 23:04:14.411687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.455 [2024-04-16 23:04:14.411808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.455 [2024-04-16 23:04:14.411832] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.455 qpair failed and we were unable to recover it. 00:26:23.455 [2024-04-16 23:04:14.411944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.455 [2024-04-16 23:04:14.412084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.455 [2024-04-16 23:04:14.412108] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.455 qpair failed and we were unable to recover it. 00:26:23.455 [2024-04-16 23:04:14.412236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.455 [2024-04-16 23:04:14.412349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.455 [2024-04-16 23:04:14.412374] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.455 qpair failed and we were unable to recover it. 00:26:23.455 [2024-04-16 23:04:14.412520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.455 [2024-04-16 23:04:14.412661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.455 [2024-04-16 23:04:14.412685] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.455 qpair failed and we were unable to recover it. 00:26:23.455 [2024-04-16 23:04:14.412798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.455 [2024-04-16 23:04:14.412914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.455 [2024-04-16 23:04:14.412941] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.455 qpair failed and we were unable to recover it. 00:26:23.455 [2024-04-16 23:04:14.413053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.455 [2024-04-16 23:04:14.413168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.455 [2024-04-16 23:04:14.413204] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.455 qpair failed and we were unable to recover it. 00:26:23.455 [2024-04-16 23:04:14.413326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.455 [2024-04-16 23:04:14.413459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.455 [2024-04-16 23:04:14.413496] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.455 qpair failed and we were unable to recover it. 00:26:23.455 [2024-04-16 23:04:14.413612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.455 [2024-04-16 23:04:14.413732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.455 [2024-04-16 23:04:14.413757] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.455 qpair failed and we were unable to recover it. 00:26:23.455 [2024-04-16 23:04:14.413885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.455 [2024-04-16 23:04:14.413998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.455 [2024-04-16 23:04:14.414024] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.455 qpair failed and we were unable to recover it. 00:26:23.455 [2024-04-16 23:04:14.414133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.455 [2024-04-16 23:04:14.414271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.455 [2024-04-16 23:04:14.414296] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.455 qpair failed and we were unable to recover it. 00:26:23.455 [2024-04-16 23:04:14.414406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.455 [2024-04-16 23:04:14.414517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.455 [2024-04-16 23:04:14.414542] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.455 qpair failed and we were unable to recover it. 00:26:23.455 [2024-04-16 23:04:14.414657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.455 [2024-04-16 23:04:14.414760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.455 [2024-04-16 23:04:14.414784] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.455 qpair failed and we were unable to recover it. 00:26:23.455 [2024-04-16 23:04:14.414921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.455 [2024-04-16 23:04:14.415057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.455 [2024-04-16 23:04:14.415082] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.455 qpair failed and we were unable to recover it. 00:26:23.455 [2024-04-16 23:04:14.415219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.455 [2024-04-16 23:04:14.415344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.455 [2024-04-16 23:04:14.415369] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.455 qpair failed and we were unable to recover it. 00:26:23.455 [2024-04-16 23:04:14.415491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.456 [2024-04-16 23:04:14.415605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.456 [2024-04-16 23:04:14.415629] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.456 qpair failed and we were unable to recover it. 00:26:23.456 [2024-04-16 23:04:14.415777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.456 [2024-04-16 23:04:14.415889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.456 [2024-04-16 23:04:14.415915] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.456 qpair failed and we were unable to recover it. 00:26:23.456 [2024-04-16 23:04:14.416027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.456 [2024-04-16 23:04:14.416137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.456 [2024-04-16 23:04:14.416161] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.456 qpair failed and we were unable to recover it. 00:26:23.456 [2024-04-16 23:04:14.416283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.456 [2024-04-16 23:04:14.416398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.456 [2024-04-16 23:04:14.416422] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.456 qpair failed and we were unable to recover it. 00:26:23.456 [2024-04-16 23:04:14.416555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.456 [2024-04-16 23:04:14.416660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.456 [2024-04-16 23:04:14.416685] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.456 qpair failed and we were unable to recover it. 00:26:23.456 [2024-04-16 23:04:14.416859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.456 [2024-04-16 23:04:14.416966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.456 [2024-04-16 23:04:14.416991] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.456 qpair failed and we were unable to recover it. 00:26:23.456 [2024-04-16 23:04:14.417115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.456 [2024-04-16 23:04:14.417229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.456 [2024-04-16 23:04:14.417255] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.456 qpair failed and we were unable to recover it. 00:26:23.456 [2024-04-16 23:04:14.417372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.456 [2024-04-16 23:04:14.417488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.456 [2024-04-16 23:04:14.417513] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.456 qpair failed and we were unable to recover it. 00:26:23.456 [2024-04-16 23:04:14.417634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.456 [2024-04-16 23:04:14.417777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.456 [2024-04-16 23:04:14.417802] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.456 qpair failed and we were unable to recover it. 00:26:23.456 [2024-04-16 23:04:14.417945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.456 [2024-04-16 23:04:14.418062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.456 [2024-04-16 23:04:14.418088] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.456 qpair failed and we were unable to recover it. 00:26:23.456 [2024-04-16 23:04:14.418210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.456 [2024-04-16 23:04:14.418333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.456 [2024-04-16 23:04:14.418358] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.456 qpair failed and we were unable to recover it. 00:26:23.456 [2024-04-16 23:04:14.418475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.456 [2024-04-16 23:04:14.418588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.456 [2024-04-16 23:04:14.418613] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.456 qpair failed and we were unable to recover it. 00:26:23.456 [2024-04-16 23:04:14.418726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.456 [2024-04-16 23:04:14.418862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.456 [2024-04-16 23:04:14.418887] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.456 qpair failed and we were unable to recover it. 00:26:23.456 [2024-04-16 23:04:14.419025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.456 [2024-04-16 23:04:14.419137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.456 [2024-04-16 23:04:14.419162] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.456 qpair failed and we were unable to recover it. 00:26:23.456 [2024-04-16 23:04:14.419305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.456 [2024-04-16 23:04:14.419448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.456 [2024-04-16 23:04:14.419472] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.456 qpair failed and we were unable to recover it. 00:26:23.456 [2024-04-16 23:04:14.419585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.456 [2024-04-16 23:04:14.419695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.456 [2024-04-16 23:04:14.419720] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.456 qpair failed and we were unable to recover it. 00:26:23.456 [2024-04-16 23:04:14.419860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.456 [2024-04-16 23:04:14.419979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.456 [2024-04-16 23:04:14.420003] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.456 qpair failed and we were unable to recover it. 00:26:23.456 [2024-04-16 23:04:14.420118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.456 [2024-04-16 23:04:14.420232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.456 [2024-04-16 23:04:14.420257] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.456 qpair failed and we were unable to recover it. 00:26:23.456 [2024-04-16 23:04:14.420396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.456 [2024-04-16 23:04:14.420514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.456 [2024-04-16 23:04:14.420538] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.456 qpair failed and we were unable to recover it. 00:26:23.456 [2024-04-16 23:04:14.420651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.456 [2024-04-16 23:04:14.420788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.456 [2024-04-16 23:04:14.420813] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.456 qpair failed and we were unable to recover it. 00:26:23.456 [2024-04-16 23:04:14.420918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.456 [2024-04-16 23:04:14.421053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.456 [2024-04-16 23:04:14.421077] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.456 qpair failed and we were unable to recover it. 00:26:23.456 [2024-04-16 23:04:14.421217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.456 [2024-04-16 23:04:14.421332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.456 [2024-04-16 23:04:14.421357] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.456 qpair failed and we were unable to recover it. 00:26:23.456 [2024-04-16 23:04:14.421476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.456 [2024-04-16 23:04:14.421589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.456 [2024-04-16 23:04:14.421616] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.456 qpair failed and we were unable to recover it. 00:26:23.456 [2024-04-16 23:04:14.421758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.456 [2024-04-16 23:04:14.421866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.456 [2024-04-16 23:04:14.421891] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.456 qpair failed and we were unable to recover it. 00:26:23.456 [2024-04-16 23:04:14.421996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.456 [2024-04-16 23:04:14.422132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.456 [2024-04-16 23:04:14.422157] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.456 qpair failed and we were unable to recover it. 00:26:23.456 [2024-04-16 23:04:14.422281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.456 [2024-04-16 23:04:14.422428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.456 [2024-04-16 23:04:14.422464] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.456 qpair failed and we were unable to recover it. 00:26:23.456 [2024-04-16 23:04:14.422568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.456 [2024-04-16 23:04:14.422677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.456 [2024-04-16 23:04:14.422703] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.456 qpair failed and we were unable to recover it. 00:26:23.456 [2024-04-16 23:04:14.422843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.456 [2024-04-16 23:04:14.422982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.456 [2024-04-16 23:04:14.423008] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.456 qpair failed and we were unable to recover it. 00:26:23.456 [2024-04-16 23:04:14.423117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.456 [2024-04-16 23:04:14.423238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.456 [2024-04-16 23:04:14.423265] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.456 qpair failed and we were unable to recover it. 00:26:23.456 [2024-04-16 23:04:14.423386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.456 [2024-04-16 23:04:14.423504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.456 [2024-04-16 23:04:14.423528] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.456 qpair failed and we were unable to recover it. 00:26:23.456 [2024-04-16 23:04:14.423666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.456 [2024-04-16 23:04:14.423783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.456 [2024-04-16 23:04:14.423807] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.456 qpair failed and we were unable to recover it. 00:26:23.456 [2024-04-16 23:04:14.423919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.456 [2024-04-16 23:04:14.424031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.456 [2024-04-16 23:04:14.424055] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.456 qpair failed and we were unable to recover it. 00:26:23.456 [2024-04-16 23:04:14.424215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.456 [2024-04-16 23:04:14.424352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.456 [2024-04-16 23:04:14.424377] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.456 qpair failed and we were unable to recover it. 00:26:23.456 [2024-04-16 23:04:14.424529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.456 [2024-04-16 23:04:14.424646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.456 [2024-04-16 23:04:14.424671] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.456 qpair failed and we were unable to recover it. 00:26:23.456 [2024-04-16 23:04:14.424786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.456 [2024-04-16 23:04:14.424899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.456 [2024-04-16 23:04:14.424926] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.456 qpair failed and we were unable to recover it. 00:26:23.456 [2024-04-16 23:04:14.425054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.456 [2024-04-16 23:04:14.425163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.456 [2024-04-16 23:04:14.425194] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.456 qpair failed and we were unable to recover it. 00:26:23.456 [2024-04-16 23:04:14.425312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.456 [2024-04-16 23:04:14.425438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.456 [2024-04-16 23:04:14.425462] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.456 qpair failed and we were unable to recover it. 00:26:23.456 [2024-04-16 23:04:14.425571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.456 [2024-04-16 23:04:14.425690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.456 [2024-04-16 23:04:14.425714] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.456 qpair failed and we were unable to recover it. 00:26:23.456 [2024-04-16 23:04:14.425834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.456 [2024-04-16 23:04:14.425951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.456 [2024-04-16 23:04:14.425977] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.456 qpair failed and we were unable to recover it. 00:26:23.456 [2024-04-16 23:04:14.426120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.456 [2024-04-16 23:04:14.426230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.456 [2024-04-16 23:04:14.426256] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.456 qpair failed and we were unable to recover it. 00:26:23.456 [2024-04-16 23:04:14.426374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.456 [2024-04-16 23:04:14.426530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.456 [2024-04-16 23:04:14.426555] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.456 qpair failed and we were unable to recover it. 00:26:23.456 [2024-04-16 23:04:14.426693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.456 [2024-04-16 23:04:14.426808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.456 [2024-04-16 23:04:14.426833] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.456 qpair failed and we were unable to recover it. 00:26:23.456 [2024-04-16 23:04:14.426953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.456 [2024-04-16 23:04:14.427079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.456 [2024-04-16 23:04:14.427105] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.456 qpair failed and we were unable to recover it. 00:26:23.456 [2024-04-16 23:04:14.427228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.456 [2024-04-16 23:04:14.427347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.456 [2024-04-16 23:04:14.427374] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.456 qpair failed and we were unable to recover it. 00:26:23.456 [2024-04-16 23:04:14.427479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.456 [2024-04-16 23:04:14.427583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.456 [2024-04-16 23:04:14.427609] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.456 qpair failed and we were unable to recover it. 00:26:23.456 [2024-04-16 23:04:14.427748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.456 [2024-04-16 23:04:14.427861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.456 [2024-04-16 23:04:14.427888] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.456 qpair failed and we were unable to recover it. 00:26:23.456 [2024-04-16 23:04:14.428004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.456 [2024-04-16 23:04:14.428119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.456 [2024-04-16 23:04:14.428147] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.456 qpair failed and we were unable to recover it. 00:26:23.456 [2024-04-16 23:04:14.428303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.456 [2024-04-16 23:04:14.428438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.456 [2024-04-16 23:04:14.428473] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.456 qpair failed and we were unable to recover it. 00:26:23.456 [2024-04-16 23:04:14.428581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.456 [2024-04-16 23:04:14.428697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.457 [2024-04-16 23:04:14.428723] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.457 qpair failed and we were unable to recover it. 00:26:23.457 [2024-04-16 23:04:14.428827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.457 [2024-04-16 23:04:14.428959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.457 [2024-04-16 23:04:14.428984] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.457 qpair failed and we were unable to recover it. 00:26:23.457 [2024-04-16 23:04:14.429104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.457 [2024-04-16 23:04:14.429223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.457 [2024-04-16 23:04:14.429249] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.457 qpair failed and we were unable to recover it. 00:26:23.457 [2024-04-16 23:04:14.429387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.457 [2024-04-16 23:04:14.429494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.457 [2024-04-16 23:04:14.429518] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.457 qpair failed and we were unable to recover it. 00:26:23.457 [2024-04-16 23:04:14.429653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.457 [2024-04-16 23:04:14.429765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.457 [2024-04-16 23:04:14.429791] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.457 qpair failed and we were unable to recover it. 00:26:23.457 [2024-04-16 23:04:14.429899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.457 [2024-04-16 23:04:14.430016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.457 [2024-04-16 23:04:14.430041] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.457 qpair failed and we were unable to recover it. 00:26:23.457 [2024-04-16 23:04:14.430157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.457 [2024-04-16 23:04:14.430296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.457 [2024-04-16 23:04:14.430322] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.457 qpair failed and we were unable to recover it. 00:26:23.457 [2024-04-16 23:04:14.430426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.457 [2024-04-16 23:04:14.430575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.457 [2024-04-16 23:04:14.430600] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.457 qpair failed and we were unable to recover it. 00:26:23.457 [2024-04-16 23:04:14.430742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.457 [2024-04-16 23:04:14.430861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.457 [2024-04-16 23:04:14.430887] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.457 qpair failed and we were unable to recover it. 00:26:23.457 [2024-04-16 23:04:14.431030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.457 [2024-04-16 23:04:14.431139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.457 [2024-04-16 23:04:14.431163] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.457 qpair failed and we were unable to recover it. 00:26:23.457 [2024-04-16 23:04:14.431287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.457 [2024-04-16 23:04:14.431403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.457 [2024-04-16 23:04:14.431428] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.457 qpair failed and we were unable to recover it. 00:26:23.457 [2024-04-16 23:04:14.431552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.457 [2024-04-16 23:04:14.431658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.457 [2024-04-16 23:04:14.431683] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.457 qpair failed and we were unable to recover it. 00:26:23.457 [2024-04-16 23:04:14.431800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.457 [2024-04-16 23:04:14.431938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.457 [2024-04-16 23:04:14.431963] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.457 qpair failed and we were unable to recover it. 00:26:23.457 [2024-04-16 23:04:14.432083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.457 [2024-04-16 23:04:14.432202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.457 [2024-04-16 23:04:14.432232] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.457 qpair failed and we were unable to recover it. 00:26:23.457 [2024-04-16 23:04:14.432350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.457 [2024-04-16 23:04:14.432477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.457 [2024-04-16 23:04:14.432502] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.457 qpair failed and we were unable to recover it. 00:26:23.457 [2024-04-16 23:04:14.432611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.457 [2024-04-16 23:04:14.432795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.457 [2024-04-16 23:04:14.432821] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.457 qpair failed and we were unable to recover it. 00:26:23.457 [2024-04-16 23:04:14.432944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.457 [2024-04-16 23:04:14.433053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.457 [2024-04-16 23:04:14.433079] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.457 qpair failed and we were unable to recover it. 00:26:23.457 [2024-04-16 23:04:14.433225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.457 [2024-04-16 23:04:14.433339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.457 [2024-04-16 23:04:14.433364] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.457 qpair failed and we were unable to recover it. 00:26:23.457 [2024-04-16 23:04:14.433482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.457 [2024-04-16 23:04:14.433605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.457 [2024-04-16 23:04:14.433630] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.457 qpair failed and we were unable to recover it. 00:26:23.457 [2024-04-16 23:04:14.433739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.457 [2024-04-16 23:04:14.433847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.457 [2024-04-16 23:04:14.433871] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.457 qpair failed and we were unable to recover it. 00:26:23.457 [2024-04-16 23:04:14.434020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.457 [2024-04-16 23:04:14.434163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.457 [2024-04-16 23:04:14.434216] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.457 qpair failed and we were unable to recover it. 00:26:23.457 [2024-04-16 23:04:14.434340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.457 [2024-04-16 23:04:14.434458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.457 [2024-04-16 23:04:14.434489] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.457 qpair failed and we were unable to recover it. 00:26:23.457 [2024-04-16 23:04:14.434604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.457 [2024-04-16 23:04:14.434725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.457 [2024-04-16 23:04:14.434750] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.457 qpair failed and we were unable to recover it. 00:26:23.457 [2024-04-16 23:04:14.434859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.457 [2024-04-16 23:04:14.434994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.457 [2024-04-16 23:04:14.435019] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.457 qpair failed and we were unable to recover it. 00:26:23.457 [2024-04-16 23:04:14.435166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.457 [2024-04-16 23:04:14.435328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.457 [2024-04-16 23:04:14.435353] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.457 qpair failed and we were unable to recover it. 00:26:23.457 [2024-04-16 23:04:14.435472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.457 [2024-04-16 23:04:14.435590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.457 [2024-04-16 23:04:14.435621] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.457 qpair failed and we were unable to recover it. 00:26:23.457 [2024-04-16 23:04:14.435737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.457 [2024-04-16 23:04:14.435859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.457 [2024-04-16 23:04:14.435895] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.457 qpair failed and we were unable to recover it. 00:26:23.457 [2024-04-16 23:04:14.436041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.457 [2024-04-16 23:04:14.436151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.457 [2024-04-16 23:04:14.436215] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.457 qpair failed and we were unable to recover it. 00:26:23.457 [2024-04-16 23:04:14.436352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.457 [2024-04-16 23:04:14.436499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.457 [2024-04-16 23:04:14.436524] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.457 qpair failed and we were unable to recover it. 00:26:23.457 [2024-04-16 23:04:14.436673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.457 [2024-04-16 23:04:14.436809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.457 [2024-04-16 23:04:14.436834] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.457 qpair failed and we were unable to recover it. 00:26:23.457 [2024-04-16 23:04:14.436964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.457 [2024-04-16 23:04:14.437118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.457 [2024-04-16 23:04:14.437143] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.457 qpair failed and we were unable to recover it. 00:26:23.457 [2024-04-16 23:04:14.437287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.457 [2024-04-16 23:04:14.437403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.457 [2024-04-16 23:04:14.437429] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.457 qpair failed and we were unable to recover it. 00:26:23.457 [2024-04-16 23:04:14.437585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.457 [2024-04-16 23:04:14.437706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.457 [2024-04-16 23:04:14.437732] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.457 qpair failed and we were unable to recover it. 00:26:23.457 [2024-04-16 23:04:14.437842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.457 [2024-04-16 23:04:14.437958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.457 [2024-04-16 23:04:14.437982] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.457 qpair failed and we were unable to recover it. 00:26:23.457 [2024-04-16 23:04:14.438101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.457 [2024-04-16 23:04:14.438232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.457 [2024-04-16 23:04:14.438257] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.457 qpair failed and we were unable to recover it. 00:26:23.457 [2024-04-16 23:04:14.438370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.457 [2024-04-16 23:04:14.438480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.457 [2024-04-16 23:04:14.438506] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.457 qpair failed and we were unable to recover it. 00:26:23.457 [2024-04-16 23:04:14.438679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.457 [2024-04-16 23:04:14.438803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.457 [2024-04-16 23:04:14.438827] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.457 qpair failed and we were unable to recover it. 00:26:23.457 [2024-04-16 23:04:14.438954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.457 [2024-04-16 23:04:14.439097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.457 [2024-04-16 23:04:14.439126] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.457 qpair failed and we were unable to recover it. 00:26:23.457 [2024-04-16 23:04:14.439252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.457 [2024-04-16 23:04:14.439368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.457 [2024-04-16 23:04:14.439394] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.457 qpair failed and we were unable to recover it. 00:26:23.457 [2024-04-16 23:04:14.439553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.457 [2024-04-16 23:04:14.439684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.457 [2024-04-16 23:04:14.439709] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.457 qpair failed and we were unable to recover it. 00:26:23.457 [2024-04-16 23:04:14.439846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.457 [2024-04-16 23:04:14.440006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.457 [2024-04-16 23:04:14.440031] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.457 qpair failed and we were unable to recover it. 00:26:23.457 [2024-04-16 23:04:14.440142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.457 [2024-04-16 23:04:14.440268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.457 [2024-04-16 23:04:14.440295] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.457 qpair failed and we were unable to recover it. 00:26:23.457 [2024-04-16 23:04:14.440411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.457 [2024-04-16 23:04:14.440525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.457 [2024-04-16 23:04:14.440551] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.457 qpair failed and we were unable to recover it. 00:26:23.457 [2024-04-16 23:04:14.440674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.457 [2024-04-16 23:04:14.440789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.457 [2024-04-16 23:04:14.440814] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.457 qpair failed and we were unable to recover it. 00:26:23.457 [2024-04-16 23:04:14.440921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.457 [2024-04-16 23:04:14.441057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.457 [2024-04-16 23:04:14.441083] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.457 qpair failed and we were unable to recover it. 00:26:23.457 [2024-04-16 23:04:14.441228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.457 [2024-04-16 23:04:14.441351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.457 [2024-04-16 23:04:14.441375] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.457 qpair failed and we were unable to recover it. 00:26:23.457 [2024-04-16 23:04:14.441481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.457 [2024-04-16 23:04:14.441632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.457 [2024-04-16 23:04:14.441658] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.457 qpair failed and we were unable to recover it. 00:26:23.457 [2024-04-16 23:04:14.441772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.457 [2024-04-16 23:04:14.441879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.457 [2024-04-16 23:04:14.441907] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.457 qpair failed and we were unable to recover it. 00:26:23.457 [2024-04-16 23:04:14.442076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.457 [2024-04-16 23:04:14.442187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.457 [2024-04-16 23:04:14.442213] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.457 qpair failed and we were unable to recover it. 00:26:23.457 [2024-04-16 23:04:14.442322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.457 [2024-04-16 23:04:14.442433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.457 [2024-04-16 23:04:14.442458] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.457 qpair failed and we were unable to recover it. 00:26:23.457 [2024-04-16 23:04:14.442596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.457 [2024-04-16 23:04:14.442709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.457 [2024-04-16 23:04:14.442734] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.457 qpair failed and we were unable to recover it. 00:26:23.457 [2024-04-16 23:04:14.442878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.457 [2024-04-16 23:04:14.442999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.457 [2024-04-16 23:04:14.443024] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.457 qpair failed and we were unable to recover it. 00:26:23.457 [2024-04-16 23:04:14.443167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.457 [2024-04-16 23:04:14.443295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.458 [2024-04-16 23:04:14.443322] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.458 qpair failed and we were unable to recover it. 00:26:23.458 [2024-04-16 23:04:14.443435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.458 [2024-04-16 23:04:14.443542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.458 [2024-04-16 23:04:14.443567] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.458 qpair failed and we were unable to recover it. 00:26:23.458 [2024-04-16 23:04:14.443711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.458 [2024-04-16 23:04:14.443849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.458 [2024-04-16 23:04:14.443874] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.458 qpair failed and we were unable to recover it. 00:26:23.458 [2024-04-16 23:04:14.443990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.458 [2024-04-16 23:04:14.444123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.458 [2024-04-16 23:04:14.444150] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.458 qpair failed and we were unable to recover it. 00:26:23.458 [2024-04-16 23:04:14.444312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.458 [2024-04-16 23:04:14.444450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.458 [2024-04-16 23:04:14.444476] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.458 qpair failed and we were unable to recover it. 00:26:23.458 [2024-04-16 23:04:14.444636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.458 [2024-04-16 23:04:14.444791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.458 [2024-04-16 23:04:14.444821] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.458 qpair failed and we were unable to recover it. 00:26:23.458 [2024-04-16 23:04:14.444959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.458 [2024-04-16 23:04:14.445118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.458 [2024-04-16 23:04:14.445143] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.458 qpair failed and we were unable to recover it. 00:26:23.458 [2024-04-16 23:04:14.445279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.458 [2024-04-16 23:04:14.445401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.458 [2024-04-16 23:04:14.445428] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.458 qpair failed and we were unable to recover it. 00:26:23.458 [2024-04-16 23:04:14.445594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.458 [2024-04-16 23:04:14.445707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.458 [2024-04-16 23:04:14.445732] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.458 qpair failed and we were unable to recover it. 00:26:23.458 [2024-04-16 23:04:14.445847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.458 [2024-04-16 23:04:14.445969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.458 [2024-04-16 23:04:14.445995] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.458 qpair failed and we were unable to recover it. 00:26:23.458 [2024-04-16 23:04:14.446140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.458 [2024-04-16 23:04:14.446269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.458 [2024-04-16 23:04:14.446295] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.458 qpair failed and we were unable to recover it. 00:26:23.458 [2024-04-16 23:04:14.446412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.458 [2024-04-16 23:04:14.446535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.458 [2024-04-16 23:04:14.446562] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.458 qpair failed and we were unable to recover it. 00:26:23.458 [2024-04-16 23:04:14.446711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.458 [2024-04-16 23:04:14.446847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.458 [2024-04-16 23:04:14.446872] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.458 qpair failed and we were unable to recover it. 00:26:23.458 [2024-04-16 23:04:14.446986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.458 [2024-04-16 23:04:14.447118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.458 [2024-04-16 23:04:14.447143] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.458 qpair failed and we were unable to recover it. 00:26:23.458 [2024-04-16 23:04:14.447264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.458 [2024-04-16 23:04:14.447377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.458 [2024-04-16 23:04:14.447402] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.458 qpair failed and we were unable to recover it. 00:26:23.458 [2024-04-16 23:04:14.447549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.458 [2024-04-16 23:04:14.447700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.458 [2024-04-16 23:04:14.447725] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.458 qpair failed and we were unable to recover it. 00:26:23.458 [2024-04-16 23:04:14.447874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.458 [2024-04-16 23:04:14.448012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.458 [2024-04-16 23:04:14.448037] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.458 qpair failed and we were unable to recover it. 00:26:23.458 [2024-04-16 23:04:14.448146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.458 [2024-04-16 23:04:14.448261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.458 [2024-04-16 23:04:14.448287] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.458 qpair failed and we were unable to recover it. 00:26:23.458 [2024-04-16 23:04:14.448400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.458 [2024-04-16 23:04:14.448543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.458 [2024-04-16 23:04:14.448568] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.458 qpair failed and we were unable to recover it. 00:26:23.458 [2024-04-16 23:04:14.448736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.458 [2024-04-16 23:04:14.448848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.458 [2024-04-16 23:04:14.448873] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.458 qpair failed and we were unable to recover it. 00:26:23.458 [2024-04-16 23:04:14.448996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.458 [2024-04-16 23:04:14.449115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.458 [2024-04-16 23:04:14.449140] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.458 qpair failed and we were unable to recover it. 00:26:23.458 [2024-04-16 23:04:14.449275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.458 [2024-04-16 23:04:14.449418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.458 [2024-04-16 23:04:14.449445] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.458 qpair failed and we were unable to recover it. 00:26:23.458 [2024-04-16 23:04:14.449557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.458 [2024-04-16 23:04:14.449709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.458 [2024-04-16 23:04:14.449735] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.458 qpair failed and we were unable to recover it. 00:26:23.458 [2024-04-16 23:04:14.449853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.458 [2024-04-16 23:04:14.449990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.458 [2024-04-16 23:04:14.450015] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.458 qpair failed and we were unable to recover it. 00:26:23.458 [2024-04-16 23:04:14.450121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.458 [2024-04-16 23:04:14.450235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.458 [2024-04-16 23:04:14.450261] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.458 qpair failed and we were unable to recover it. 00:26:23.458 [2024-04-16 23:04:14.450374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.458 [2024-04-16 23:04:14.450498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.458 [2024-04-16 23:04:14.450523] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.458 qpair failed and we were unable to recover it. 00:26:23.458 [2024-04-16 23:04:14.450687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.458 [2024-04-16 23:04:14.450802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.458 [2024-04-16 23:04:14.450827] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.458 qpair failed and we were unable to recover it. 00:26:23.458 [2024-04-16 23:04:14.450962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.458 [2024-04-16 23:04:14.451098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.458 [2024-04-16 23:04:14.451123] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.458 qpair failed and we were unable to recover it. 00:26:23.458 [2024-04-16 23:04:14.451253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.458 [2024-04-16 23:04:14.451368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.458 [2024-04-16 23:04:14.451392] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.458 qpair failed and we were unable to recover it. 00:26:23.458 [2024-04-16 23:04:14.451507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.458 [2024-04-16 23:04:14.451611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.458 [2024-04-16 23:04:14.451636] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.458 qpair failed and we were unable to recover it. 00:26:23.458 [2024-04-16 23:04:14.451756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.458 [2024-04-16 23:04:14.451872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.458 [2024-04-16 23:04:14.451897] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.458 qpair failed and we were unable to recover it. 00:26:23.458 [2024-04-16 23:04:14.451997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.458 [2024-04-16 23:04:14.452100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.458 [2024-04-16 23:04:14.452126] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.458 qpair failed and we were unable to recover it. 00:26:23.458 [2024-04-16 23:04:14.452251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.458 [2024-04-16 23:04:14.452388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.458 [2024-04-16 23:04:14.452414] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.458 qpair failed and we were unable to recover it. 00:26:23.458 [2024-04-16 23:04:14.452540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.458 [2024-04-16 23:04:14.452666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.458 [2024-04-16 23:04:14.452691] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.458 qpair failed and we were unable to recover it. 00:26:23.458 [2024-04-16 23:04:14.452799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.458 [2024-04-16 23:04:14.452938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.458 [2024-04-16 23:04:14.452962] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.458 qpair failed and we were unable to recover it. 00:26:23.458 [2024-04-16 23:04:14.453081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.458 [2024-04-16 23:04:14.453227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.458 [2024-04-16 23:04:14.453252] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.458 qpair failed and we were unable to recover it. 00:26:23.458 [2024-04-16 23:04:14.453396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.458 [2024-04-16 23:04:14.453533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.458 [2024-04-16 23:04:14.453558] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.458 qpair failed and we were unable to recover it. 00:26:23.458 [2024-04-16 23:04:14.453701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.458 [2024-04-16 23:04:14.453820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.458 [2024-04-16 23:04:14.453845] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.458 qpair failed and we were unable to recover it. 00:26:23.458 [2024-04-16 23:04:14.453979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.458 [2024-04-16 23:04:14.454086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.458 [2024-04-16 23:04:14.454110] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.458 qpair failed and we were unable to recover it. 00:26:23.458 [2024-04-16 23:04:14.454226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.458 [2024-04-16 23:04:14.454368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.458 [2024-04-16 23:04:14.454393] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.458 qpair failed and we were unable to recover it. 00:26:23.458 [2024-04-16 23:04:14.454546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.458 [2024-04-16 23:04:14.454652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.458 [2024-04-16 23:04:14.454677] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.458 qpair failed and we were unable to recover it. 00:26:23.458 [2024-04-16 23:04:14.454795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.458 [2024-04-16 23:04:14.454920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.458 [2024-04-16 23:04:14.454948] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.458 qpair failed and we were unable to recover it. 00:26:23.458 [2024-04-16 23:04:14.455067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.458 [2024-04-16 23:04:14.455180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.458 [2024-04-16 23:04:14.455206] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.458 qpair failed and we were unable to recover it. 00:26:23.458 [2024-04-16 23:04:14.455337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.458 [2024-04-16 23:04:14.455459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.458 [2024-04-16 23:04:14.455484] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.458 qpair failed and we were unable to recover it. 00:26:23.458 [2024-04-16 23:04:14.455593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.458 [2024-04-16 23:04:14.455702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.458 [2024-04-16 23:04:14.455728] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.458 qpair failed and we were unable to recover it. 00:26:23.458 [2024-04-16 23:04:14.455883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.458 [2024-04-16 23:04:14.455991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.458 [2024-04-16 23:04:14.456015] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.458 qpair failed and we were unable to recover it. 00:26:23.458 [2024-04-16 23:04:14.456128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.458 [2024-04-16 23:04:14.456240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.458 [2024-04-16 23:04:14.456266] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.458 qpair failed and we were unable to recover it. 00:26:23.458 [2024-04-16 23:04:14.456379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.458 [2024-04-16 23:04:14.456491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.458 [2024-04-16 23:04:14.456515] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.458 qpair failed and we were unable to recover it. 00:26:23.458 [2024-04-16 23:04:14.456650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.458 [2024-04-16 23:04:14.456790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.458 [2024-04-16 23:04:14.456814] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.458 qpair failed and we were unable to recover it. 00:26:23.459 [2024-04-16 23:04:14.456959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.459 [2024-04-16 23:04:14.457060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.459 [2024-04-16 23:04:14.457085] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.459 qpair failed and we were unable to recover it. 00:26:23.459 [2024-04-16 23:04:14.457229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.459 [2024-04-16 23:04:14.457372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.459 [2024-04-16 23:04:14.457397] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.459 qpair failed and we were unable to recover it. 00:26:23.459 [2024-04-16 23:04:14.457576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.459 [2024-04-16 23:04:14.457743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.459 [2024-04-16 23:04:14.457767] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.459 qpair failed and we were unable to recover it. 00:26:23.459 [2024-04-16 23:04:14.457886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.459 [2024-04-16 23:04:14.458003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.459 [2024-04-16 23:04:14.458028] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.459 qpair failed and we were unable to recover it. 00:26:23.459 [2024-04-16 23:04:14.458149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.459 [2024-04-16 23:04:14.458298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.459 [2024-04-16 23:04:14.458323] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.459 qpair failed and we were unable to recover it. 00:26:23.459 [2024-04-16 23:04:14.458430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.459 [2024-04-16 23:04:14.458534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.459 [2024-04-16 23:04:14.458559] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.459 qpair failed and we were unable to recover it. 00:26:23.459 [2024-04-16 23:04:14.458702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.459 [2024-04-16 23:04:14.458829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.459 [2024-04-16 23:04:14.458854] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.459 qpair failed and we were unable to recover it. 00:26:23.459 [2024-04-16 23:04:14.458971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.459 [2024-04-16 23:04:14.459114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.459 [2024-04-16 23:04:14.459139] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.459 qpair failed and we were unable to recover it. 00:26:23.459 [2024-04-16 23:04:14.459263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.459 [2024-04-16 23:04:14.459377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.459 [2024-04-16 23:04:14.459403] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.459 qpair failed and we were unable to recover it. 00:26:23.459 [2024-04-16 23:04:14.459537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.459 [2024-04-16 23:04:14.459672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.459 [2024-04-16 23:04:14.459698] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.459 qpair failed and we were unable to recover it. 00:26:23.459 [2024-04-16 23:04:14.459806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.459 [2024-04-16 23:04:14.459942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.459 [2024-04-16 23:04:14.459967] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.459 qpair failed and we were unable to recover it. 00:26:23.459 [2024-04-16 23:04:14.460085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.459 [2024-04-16 23:04:14.460245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.459 [2024-04-16 23:04:14.460271] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.459 qpair failed and we were unable to recover it. 00:26:23.459 [2024-04-16 23:04:14.460385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.459 [2024-04-16 23:04:14.460495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.459 [2024-04-16 23:04:14.460524] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.459 qpair failed and we were unable to recover it. 00:26:23.459 [2024-04-16 23:04:14.460648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.459 [2024-04-16 23:04:14.460762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.459 [2024-04-16 23:04:14.460787] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.459 qpair failed and we were unable to recover it. 00:26:23.459 [2024-04-16 23:04:14.460921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.459 [2024-04-16 23:04:14.461032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.459 [2024-04-16 23:04:14.461056] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.459 qpair failed and we were unable to recover it. 00:26:23.459 [2024-04-16 23:04:14.461167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.459 [2024-04-16 23:04:14.461304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.459 [2024-04-16 23:04:14.461329] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.459 qpair failed and we were unable to recover it. 00:26:23.459 [2024-04-16 23:04:14.461444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.459 [2024-04-16 23:04:14.461555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.459 [2024-04-16 23:04:14.461580] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.459 qpair failed and we were unable to recover it. 00:26:23.459 [2024-04-16 23:04:14.461701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.459 [2024-04-16 23:04:14.461820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.459 [2024-04-16 23:04:14.461844] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.459 qpair failed and we were unable to recover it. 00:26:23.459 [2024-04-16 23:04:14.461981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.459 [2024-04-16 23:04:14.462117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.459 [2024-04-16 23:04:14.462142] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.459 qpair failed and we were unable to recover it. 00:26:23.459 [2024-04-16 23:04:14.462265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.459 [2024-04-16 23:04:14.462384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.459 [2024-04-16 23:04:14.462410] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.459 qpair failed and we were unable to recover it. 00:26:23.459 [2024-04-16 23:04:14.462515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.459 [2024-04-16 23:04:14.462665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.459 [2024-04-16 23:04:14.462690] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.459 qpair failed and we were unable to recover it. 00:26:23.459 [2024-04-16 23:04:14.462805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.459 [2024-04-16 23:04:14.462937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.459 [2024-04-16 23:04:14.462962] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.459 qpair failed and we were unable to recover it. 00:26:23.459 [2024-04-16 23:04:14.463122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.459 [2024-04-16 23:04:14.463241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.459 [2024-04-16 23:04:14.463267] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.459 qpair failed and we were unable to recover it. 00:26:23.459 [2024-04-16 23:04:14.463404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.459 [2024-04-16 23:04:14.463544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.459 [2024-04-16 23:04:14.463570] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.459 qpair failed and we were unable to recover it. 00:26:23.459 [2024-04-16 23:04:14.463679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.459 [2024-04-16 23:04:14.463787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.459 [2024-04-16 23:04:14.463811] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.459 qpair failed and we were unable to recover it. 00:26:23.459 [2024-04-16 23:04:14.463968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.459 [2024-04-16 23:04:14.464082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.459 [2024-04-16 23:04:14.464107] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.459 qpair failed and we were unable to recover it. 00:26:23.459 [2024-04-16 23:04:14.464225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.459 [2024-04-16 23:04:14.464346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.459 [2024-04-16 23:04:14.464371] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.459 qpair failed and we were unable to recover it. 00:26:23.459 [2024-04-16 23:04:14.464481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.459 [2024-04-16 23:04:14.464607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.459 [2024-04-16 23:04:14.464633] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.459 qpair failed and we were unable to recover it. 00:26:23.459 [2024-04-16 23:04:14.464772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.459 [2024-04-16 23:04:14.464883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.459 [2024-04-16 23:04:14.464908] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.459 qpair failed and we were unable to recover it. 00:26:23.459 [2024-04-16 23:04:14.465022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.459 [2024-04-16 23:04:14.465156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.459 [2024-04-16 23:04:14.465187] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.459 qpair failed and we were unable to recover it. 00:26:23.459 [2024-04-16 23:04:14.465316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.459 [2024-04-16 23:04:14.465435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.459 [2024-04-16 23:04:14.465460] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.459 qpair failed and we were unable to recover it. 00:26:23.459 [2024-04-16 23:04:14.465579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.459 [2024-04-16 23:04:14.465712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.459 [2024-04-16 23:04:14.465737] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.459 qpair failed and we were unable to recover it. 00:26:23.459 [2024-04-16 23:04:14.465863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.459 [2024-04-16 23:04:14.465984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.459 [2024-04-16 23:04:14.466010] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.459 qpair failed and we were unable to recover it. 00:26:23.459 [2024-04-16 23:04:14.466145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.459 [2024-04-16 23:04:14.466282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.459 [2024-04-16 23:04:14.466306] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.459 qpair failed and we were unable to recover it. 00:26:23.459 [2024-04-16 23:04:14.466423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.459 [2024-04-16 23:04:14.466537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.459 [2024-04-16 23:04:14.466561] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.459 qpair failed and we were unable to recover it. 00:26:23.459 [2024-04-16 23:04:14.466751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.459 [2024-04-16 23:04:14.466871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.459 [2024-04-16 23:04:14.466896] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.459 qpair failed and we were unable to recover it. 00:26:23.459 [2024-04-16 23:04:14.467004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.459 [2024-04-16 23:04:14.467109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.459 [2024-04-16 23:04:14.467133] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.459 qpair failed and we were unable to recover it. 00:26:23.459 [2024-04-16 23:04:14.467255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.459 [2024-04-16 23:04:14.467402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.459 [2024-04-16 23:04:14.467427] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.459 qpair failed and we were unable to recover it. 00:26:23.459 [2024-04-16 23:04:14.467544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.459 [2024-04-16 23:04:14.467657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.459 [2024-04-16 23:04:14.467682] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.459 qpair failed and we were unable to recover it. 00:26:23.459 [2024-04-16 23:04:14.467837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.459 [2024-04-16 23:04:14.467978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.459 [2024-04-16 23:04:14.468004] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.459 qpair failed and we were unable to recover it. 00:26:23.459 [2024-04-16 23:04:14.468109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.459 [2024-04-16 23:04:14.468250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.459 [2024-04-16 23:04:14.468278] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.459 qpair failed and we were unable to recover it. 00:26:23.459 [2024-04-16 23:04:14.468387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.459 [2024-04-16 23:04:14.468536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.459 [2024-04-16 23:04:14.468562] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.459 qpair failed and we were unable to recover it. 00:26:23.459 [2024-04-16 23:04:14.468704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.459 [2024-04-16 23:04:14.468821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.459 [2024-04-16 23:04:14.468845] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.459 qpair failed and we were unable to recover it. 00:26:23.459 [2024-04-16 23:04:14.468972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.459 [2024-04-16 23:04:14.469116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.459 [2024-04-16 23:04:14.469141] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.459 qpair failed and we were unable to recover it. 00:26:23.459 [2024-04-16 23:04:14.469265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.459 [2024-04-16 23:04:14.469372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.459 [2024-04-16 23:04:14.469397] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.459 qpair failed and we were unable to recover it. 00:26:23.459 [2024-04-16 23:04:14.469511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.459 [2024-04-16 23:04:14.469620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.459 [2024-04-16 23:04:14.469645] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.459 qpair failed and we were unable to recover it. 00:26:23.459 [2024-04-16 23:04:14.469754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.459 [2024-04-16 23:04:14.469871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.459 [2024-04-16 23:04:14.469895] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.459 qpair failed and we were unable to recover it. 00:26:23.459 [2024-04-16 23:04:14.470001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.459 [2024-04-16 23:04:14.470138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.459 [2024-04-16 23:04:14.470162] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.459 qpair failed and we were unable to recover it. 00:26:23.459 [2024-04-16 23:04:14.470288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.459 [2024-04-16 23:04:14.470405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.459 [2024-04-16 23:04:14.470429] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.459 qpair failed and we were unable to recover it. 00:26:23.459 [2024-04-16 23:04:14.470542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.459 [2024-04-16 23:04:14.470663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.459 [2024-04-16 23:04:14.470688] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.459 qpair failed and we were unable to recover it. 00:26:23.459 [2024-04-16 23:04:14.470792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.459 [2024-04-16 23:04:14.470911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.459 [2024-04-16 23:04:14.470936] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.459 qpair failed and we were unable to recover it. 00:26:23.459 [2024-04-16 23:04:14.471082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.459 [2024-04-16 23:04:14.471196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.459 [2024-04-16 23:04:14.471224] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.459 qpair failed and we were unable to recover it. 00:26:23.459 [2024-04-16 23:04:14.471361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.459 [2024-04-16 23:04:14.471487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.459 [2024-04-16 23:04:14.471511] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.459 qpair failed and we were unable to recover it. 00:26:23.459 [2024-04-16 23:04:14.471630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.459 [2024-04-16 23:04:14.471740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.460 [2024-04-16 23:04:14.471765] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.460 qpair failed and we were unable to recover it. 00:26:23.460 [2024-04-16 23:04:14.471874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.460 [2024-04-16 23:04:14.472021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.460 [2024-04-16 23:04:14.472046] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.460 qpair failed and we were unable to recover it. 00:26:23.460 [2024-04-16 23:04:14.472191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.460 [2024-04-16 23:04:14.472300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.460 [2024-04-16 23:04:14.472326] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.460 qpair failed and we were unable to recover it. 00:26:23.460 [2024-04-16 23:04:14.472446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.460 [2024-04-16 23:04:14.472587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.460 [2024-04-16 23:04:14.472615] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.460 qpair failed and we were unable to recover it. 00:26:23.460 [2024-04-16 23:04:14.472763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.460 [2024-04-16 23:04:14.472903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.460 [2024-04-16 23:04:14.472929] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.460 qpair failed and we were unable to recover it. 00:26:23.460 [2024-04-16 23:04:14.473075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.460 [2024-04-16 23:04:14.473203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.460 [2024-04-16 23:04:14.473241] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.460 qpair failed and we were unable to recover it. 00:26:23.460 [2024-04-16 23:04:14.473350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.460 [2024-04-16 23:04:14.473496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.460 [2024-04-16 23:04:14.473527] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.460 qpair failed and we were unable to recover it. 00:26:23.460 [2024-04-16 23:04:14.473634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.460 [2024-04-16 23:04:14.473754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.460 [2024-04-16 23:04:14.473779] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.460 qpair failed and we were unable to recover it. 00:26:23.460 [2024-04-16 23:04:14.473885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.460 [2024-04-16 23:04:14.473997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.460 [2024-04-16 23:04:14.474029] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.460 qpair failed and we were unable to recover it. 00:26:23.460 [2024-04-16 23:04:14.474165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.460 [2024-04-16 23:04:14.474315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.460 [2024-04-16 23:04:14.474340] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.460 qpair failed and we were unable to recover it. 00:26:23.460 [2024-04-16 23:04:14.474444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.460 [2024-04-16 23:04:14.474575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.460 [2024-04-16 23:04:14.474599] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.460 qpair failed and we were unable to recover it. 00:26:23.460 [2024-04-16 23:04:14.474708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.460 [2024-04-16 23:04:14.474820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.460 [2024-04-16 23:04:14.474845] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.460 qpair failed and we were unable to recover it. 00:26:23.460 [2024-04-16 23:04:14.474963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.460 [2024-04-16 23:04:14.475087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.460 [2024-04-16 23:04:14.475112] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.460 qpair failed and we were unable to recover it. 00:26:23.460 [2024-04-16 23:04:14.475260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.460 [2024-04-16 23:04:14.475368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.460 [2024-04-16 23:04:14.475392] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.460 qpair failed and we were unable to recover it. 00:26:23.460 [2024-04-16 23:04:14.475540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.460 [2024-04-16 23:04:14.475690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.460 [2024-04-16 23:04:14.475716] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.460 qpair failed and we were unable to recover it. 00:26:23.460 [2024-04-16 23:04:14.475847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.460 [2024-04-16 23:04:14.475970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.460 [2024-04-16 23:04:14.475995] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.460 qpair failed and we were unable to recover it. 00:26:23.460 [2024-04-16 23:04:14.476113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.460 [2024-04-16 23:04:14.476233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.460 [2024-04-16 23:04:14.476258] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.460 qpair failed and we were unable to recover it. 00:26:23.460 [2024-04-16 23:04:14.476402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.460 [2024-04-16 23:04:14.476529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.460 [2024-04-16 23:04:14.476561] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.460 qpair failed and we were unable to recover it. 00:26:23.460 [2024-04-16 23:04:14.476700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.460 [2024-04-16 23:04:14.476865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.460 [2024-04-16 23:04:14.476889] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.460 qpair failed and we were unable to recover it. 00:26:23.460 [2024-04-16 23:04:14.477015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.460 [2024-04-16 23:04:14.477165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.460 [2024-04-16 23:04:14.477198] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.460 qpair failed and we were unable to recover it. 00:26:23.460 [2024-04-16 23:04:14.477358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.460 [2024-04-16 23:04:14.477466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.460 [2024-04-16 23:04:14.477497] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.460 qpair failed and we were unable to recover it. 00:26:23.460 [2024-04-16 23:04:14.477612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.460 [2024-04-16 23:04:14.477754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.460 [2024-04-16 23:04:14.477780] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.460 qpair failed and we were unable to recover it. 00:26:23.460 [2024-04-16 23:04:14.477954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.460 [2024-04-16 23:04:14.478059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.460 [2024-04-16 23:04:14.478084] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.460 qpair failed and we were unable to recover it. 00:26:23.460 [2024-04-16 23:04:14.478231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.460 [2024-04-16 23:04:14.478343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.460 [2024-04-16 23:04:14.478368] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.460 qpair failed and we were unable to recover it. 00:26:23.460 [2024-04-16 23:04:14.478480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.460 [2024-04-16 23:04:14.478630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.460 [2024-04-16 23:04:14.478655] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.460 qpair failed and we were unable to recover it. 00:26:23.460 [2024-04-16 23:04:14.478785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.460 [2024-04-16 23:04:14.478929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.460 [2024-04-16 23:04:14.478955] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.460 qpair failed and we were unable to recover it. 00:26:23.460 [2024-04-16 23:04:14.479059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.460 [2024-04-16 23:04:14.479180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.460 [2024-04-16 23:04:14.479205] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.460 qpair failed and we were unable to recover it. 00:26:23.460 [2024-04-16 23:04:14.479349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.460 [2024-04-16 23:04:14.479463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.460 [2024-04-16 23:04:14.479499] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.460 qpair failed and we were unable to recover it. 00:26:23.460 [2024-04-16 23:04:14.479641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.460 [2024-04-16 23:04:14.479786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.460 [2024-04-16 23:04:14.479811] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.460 qpair failed and we were unable to recover it. 00:26:23.460 [2024-04-16 23:04:14.479933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.460 [2024-04-16 23:04:14.480052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.460 [2024-04-16 23:04:14.480078] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.460 qpair failed and we were unable to recover it. 00:26:23.460 [2024-04-16 23:04:14.480228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.460 [2024-04-16 23:04:14.480367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.460 [2024-04-16 23:04:14.480394] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.460 qpair failed and we were unable to recover it. 00:26:23.460 [2024-04-16 23:04:14.480540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.460 [2024-04-16 23:04:14.480682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.460 [2024-04-16 23:04:14.480706] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.460 qpair failed and we were unable to recover it. 00:26:23.460 [2024-04-16 23:04:14.480853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.460 [2024-04-16 23:04:14.480987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.460 [2024-04-16 23:04:14.481011] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.460 qpair failed and we were unable to recover it. 00:26:23.460 [2024-04-16 23:04:14.481127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.460 [2024-04-16 23:04:14.481276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.460 [2024-04-16 23:04:14.481302] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.460 qpair failed and we were unable to recover it. 00:26:23.460 [2024-04-16 23:04:14.481410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.460 [2024-04-16 23:04:14.481554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.460 [2024-04-16 23:04:14.481584] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.460 qpair failed and we were unable to recover it. 00:26:23.460 [2024-04-16 23:04:14.481704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.460 [2024-04-16 23:04:14.481825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.460 [2024-04-16 23:04:14.481851] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.460 qpair failed and we were unable to recover it. 00:26:23.460 [2024-04-16 23:04:14.481964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.460 [2024-04-16 23:04:14.482101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.460 [2024-04-16 23:04:14.482127] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.460 qpair failed and we were unable to recover it. 00:26:23.460 [2024-04-16 23:04:14.482249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.460 [2024-04-16 23:04:14.482366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.460 [2024-04-16 23:04:14.482391] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.460 qpair failed and we were unable to recover it. 00:26:23.460 [2024-04-16 23:04:14.482501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.460 [2024-04-16 23:04:14.482605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.460 [2024-04-16 23:04:14.482630] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.460 qpair failed and we were unable to recover it. 00:26:23.460 [2024-04-16 23:04:14.482754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.460 [2024-04-16 23:04:14.482863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.460 [2024-04-16 23:04:14.482889] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.460 qpair failed and we were unable to recover it. 00:26:23.460 [2024-04-16 23:04:14.483013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.460 [2024-04-16 23:04:14.483119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.460 [2024-04-16 23:04:14.483144] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.460 qpair failed and we were unable to recover it. 00:26:23.460 [2024-04-16 23:04:14.483295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.460 [2024-04-16 23:04:14.483410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.460 [2024-04-16 23:04:14.483436] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.460 qpair failed and we were unable to recover it. 00:26:23.460 [2024-04-16 23:04:14.483553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.460 [2024-04-16 23:04:14.483688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.460 [2024-04-16 23:04:14.483713] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.460 qpair failed and we were unable to recover it. 00:26:23.460 [2024-04-16 23:04:14.483864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.460 [2024-04-16 23:04:14.483997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.460 [2024-04-16 23:04:14.484022] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.460 qpair failed and we were unable to recover it. 00:26:23.460 [2024-04-16 23:04:14.484134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.460 [2024-04-16 23:04:14.484255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.460 [2024-04-16 23:04:14.484286] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.460 qpair failed and we were unable to recover it. 00:26:23.460 [2024-04-16 23:04:14.484410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.460 [2024-04-16 23:04:14.484521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.460 [2024-04-16 23:04:14.484546] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.460 qpair failed and we were unable to recover it. 00:26:23.460 [2024-04-16 23:04:14.484669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.460 [2024-04-16 23:04:14.484793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.460 [2024-04-16 23:04:14.484819] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.460 qpair failed and we were unable to recover it. 00:26:23.460 [2024-04-16 23:04:14.484923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.460 [2024-04-16 23:04:14.485066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.460 [2024-04-16 23:04:14.485092] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.460 qpair failed and we were unable to recover it. 00:26:23.460 [2024-04-16 23:04:14.485239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.460 [2024-04-16 23:04:14.485350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.460 [2024-04-16 23:04:14.485375] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.460 qpair failed and we were unable to recover it. 00:26:23.460 [2024-04-16 23:04:14.485527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.460 [2024-04-16 23:04:14.485642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.460 [2024-04-16 23:04:14.485666] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.460 qpair failed and we were unable to recover it. 00:26:23.460 [2024-04-16 23:04:14.485790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.460 [2024-04-16 23:04:14.485932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.460 [2024-04-16 23:04:14.485956] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.460 qpair failed and we were unable to recover it. 00:26:23.460 [2024-04-16 23:04:14.486079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.460 [2024-04-16 23:04:14.486192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.460 [2024-04-16 23:04:14.486218] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.460 qpair failed and we were unable to recover it. 00:26:23.461 [2024-04-16 23:04:14.486326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.461 [2024-04-16 23:04:14.486445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.461 [2024-04-16 23:04:14.486470] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.461 qpair failed and we were unable to recover it. 00:26:23.461 [2024-04-16 23:04:14.486579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.461 [2024-04-16 23:04:14.486686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.461 [2024-04-16 23:04:14.486710] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.461 qpair failed and we were unable to recover it. 00:26:23.461 [2024-04-16 23:04:14.486843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.461 [2024-04-16 23:04:14.486958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.461 [2024-04-16 23:04:14.486999] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.461 qpair failed and we were unable to recover it. 00:26:23.461 [2024-04-16 23:04:14.487115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.461 [2024-04-16 23:04:14.487232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.461 [2024-04-16 23:04:14.487257] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.461 qpair failed and we were unable to recover it. 00:26:23.461 [2024-04-16 23:04:14.487407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.461 [2024-04-16 23:04:14.487517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.461 [2024-04-16 23:04:14.487541] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.461 qpair failed and we were unable to recover it. 00:26:23.461 [2024-04-16 23:04:14.487644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.461 [2024-04-16 23:04:14.487758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.461 [2024-04-16 23:04:14.487783] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.461 qpair failed and we were unable to recover it. 00:26:23.461 [2024-04-16 23:04:14.487953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.461 [2024-04-16 23:04:14.488089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.461 [2024-04-16 23:04:14.488115] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.461 qpair failed and we were unable to recover it. 00:26:23.461 [2024-04-16 23:04:14.488244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.461 [2024-04-16 23:04:14.488355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.461 [2024-04-16 23:04:14.488381] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.461 qpair failed and we were unable to recover it. 00:26:23.461 [2024-04-16 23:04:14.488486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.461 [2024-04-16 23:04:14.488630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.461 [2024-04-16 23:04:14.488658] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.461 qpair failed and we were unable to recover it. 00:26:23.461 [2024-04-16 23:04:14.488769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.461 [2024-04-16 23:04:14.488880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.461 [2024-04-16 23:04:14.488904] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.461 qpair failed and we were unable to recover it. 00:26:23.461 [2024-04-16 23:04:14.489025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.461 [2024-04-16 23:04:14.489160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.461 [2024-04-16 23:04:14.489192] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.461 qpair failed and we were unable to recover it. 00:26:23.461 [2024-04-16 23:04:14.489315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.461 [2024-04-16 23:04:14.489427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.461 [2024-04-16 23:04:14.489452] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.461 qpair failed and we were unable to recover it. 00:26:23.461 [2024-04-16 23:04:14.489566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.461 [2024-04-16 23:04:14.489684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.461 [2024-04-16 23:04:14.489713] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.461 qpair failed and we were unable to recover it. 00:26:23.461 [2024-04-16 23:04:14.489819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.461 [2024-04-16 23:04:14.489939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.461 [2024-04-16 23:04:14.489963] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.461 qpair failed and we were unable to recover it. 00:26:23.461 [2024-04-16 23:04:14.490109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.461 [2024-04-16 23:04:14.490248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.461 [2024-04-16 23:04:14.490274] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.461 qpair failed and we were unable to recover it. 00:26:23.461 [2024-04-16 23:04:14.490387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.461 [2024-04-16 23:04:14.490502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.461 [2024-04-16 23:04:14.490526] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.461 qpair failed and we were unable to recover it. 00:26:23.461 [2024-04-16 23:04:14.490633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.461 [2024-04-16 23:04:14.490745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.461 [2024-04-16 23:04:14.490769] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.461 qpair failed and we were unable to recover it. 00:26:23.461 [2024-04-16 23:04:14.490905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.461 [2024-04-16 23:04:14.491010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.461 [2024-04-16 23:04:14.491034] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.461 qpair failed and we were unable to recover it. 00:26:23.461 [2024-04-16 23:04:14.491183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.461 [2024-04-16 23:04:14.491312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.461 [2024-04-16 23:04:14.491340] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.461 qpair failed and we were unable to recover it. 00:26:23.461 [2024-04-16 23:04:14.491456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.461 [2024-04-16 23:04:14.491566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.461 [2024-04-16 23:04:14.491591] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.461 qpair failed and we were unable to recover it. 00:26:23.461 [2024-04-16 23:04:14.491733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.461 [2024-04-16 23:04:14.491871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.461 [2024-04-16 23:04:14.491897] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.461 qpair failed and we were unable to recover it. 00:26:23.461 [2024-04-16 23:04:14.492014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.461 [2024-04-16 23:04:14.492120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.461 [2024-04-16 23:04:14.492145] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.461 qpair failed and we were unable to recover it. 00:26:23.461 [2024-04-16 23:04:14.492261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.461 [2024-04-16 23:04:14.492406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.461 [2024-04-16 23:04:14.492432] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.461 qpair failed and we were unable to recover it. 00:26:23.461 [2024-04-16 23:04:14.492553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.461 [2024-04-16 23:04:14.492662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.461 [2024-04-16 23:04:14.492686] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.461 qpair failed and we were unable to recover it. 00:26:23.461 [2024-04-16 23:04:14.492805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.461 [2024-04-16 23:04:14.492911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.461 [2024-04-16 23:04:14.492936] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.461 qpair failed and we were unable to recover it. 00:26:23.461 [2024-04-16 23:04:14.493051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.461 [2024-04-16 23:04:14.493188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.461 [2024-04-16 23:04:14.493214] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.461 qpair failed and we were unable to recover it. 00:26:23.461 [2024-04-16 23:04:14.493331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.461 [2024-04-16 23:04:14.493448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.461 [2024-04-16 23:04:14.493472] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.461 qpair failed and we were unable to recover it. 00:26:23.461 [2024-04-16 23:04:14.493586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.461 [2024-04-16 23:04:14.493697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.461 [2024-04-16 23:04:14.493722] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.461 qpair failed and we were unable to recover it. 00:26:23.461 [2024-04-16 23:04:14.493837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.461 [2024-04-16 23:04:14.493974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.461 [2024-04-16 23:04:14.493999] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.461 qpair failed and we were unable to recover it. 00:26:23.461 [2024-04-16 23:04:14.494109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.461 [2024-04-16 23:04:14.494221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.461 [2024-04-16 23:04:14.494246] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.461 qpair failed and we were unable to recover it. 00:26:23.461 [2024-04-16 23:04:14.494361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.461 [2024-04-16 23:04:14.494480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.461 [2024-04-16 23:04:14.494505] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.461 qpair failed and we were unable to recover it. 00:26:23.461 [2024-04-16 23:04:14.494619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.461 [2024-04-16 23:04:14.494736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.461 [2024-04-16 23:04:14.494760] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.461 qpair failed and we were unable to recover it. 00:26:23.461 [2024-04-16 23:04:14.494873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.461 [2024-04-16 23:04:14.495012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.461 [2024-04-16 23:04:14.495037] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.461 qpair failed and we were unable to recover it. 00:26:23.461 [2024-04-16 23:04:14.495152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.461 [2024-04-16 23:04:14.495281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.461 [2024-04-16 23:04:14.495306] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.461 qpair failed and we were unable to recover it. 00:26:23.461 [2024-04-16 23:04:14.495442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.461 [2024-04-16 23:04:14.495579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.461 [2024-04-16 23:04:14.495603] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.461 qpair failed and we were unable to recover it. 00:26:23.461 [2024-04-16 23:04:14.495715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.461 [2024-04-16 23:04:14.495820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.461 [2024-04-16 23:04:14.495845] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.461 qpair failed and we were unable to recover it. 00:26:23.461 [2024-04-16 23:04:14.495952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.461 [2024-04-16 23:04:14.496082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.461 [2024-04-16 23:04:14.496107] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.461 qpair failed and we were unable to recover it. 00:26:23.461 [2024-04-16 23:04:14.496228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.461 [2024-04-16 23:04:14.496348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.461 [2024-04-16 23:04:14.496373] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.461 qpair failed and we were unable to recover it. 00:26:23.461 [2024-04-16 23:04:14.496511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.461 [2024-04-16 23:04:14.496628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.461 [2024-04-16 23:04:14.496652] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.461 qpair failed and we were unable to recover it. 00:26:23.461 [2024-04-16 23:04:14.496790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.461 [2024-04-16 23:04:14.496909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.461 [2024-04-16 23:04:14.496933] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.461 qpair failed and we were unable to recover it. 00:26:23.461 [2024-04-16 23:04:14.497039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.461 [2024-04-16 23:04:14.497149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.461 [2024-04-16 23:04:14.497181] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.461 qpair failed and we were unable to recover it. 00:26:23.461 [2024-04-16 23:04:14.497307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.461 [2024-04-16 23:04:14.497427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.461 [2024-04-16 23:04:14.497451] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.461 qpair failed and we were unable to recover it. 00:26:23.461 [2024-04-16 23:04:14.497560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.461 [2024-04-16 23:04:14.497671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.461 [2024-04-16 23:04:14.497697] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.461 qpair failed and we were unable to recover it. 00:26:23.461 [2024-04-16 23:04:14.497813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.461 [2024-04-16 23:04:14.497946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.461 [2024-04-16 23:04:14.497972] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.461 qpair failed and we were unable to recover it. 00:26:23.461 [2024-04-16 23:04:14.498090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.461 [2024-04-16 23:04:14.498214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.461 [2024-04-16 23:04:14.498253] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.461 qpair failed and we were unable to recover it. 00:26:23.461 [2024-04-16 23:04:14.498398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.461 [2024-04-16 23:04:14.498521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.461 [2024-04-16 23:04:14.498546] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.461 qpair failed and we were unable to recover it. 00:26:23.461 [2024-04-16 23:04:14.498661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.461 [2024-04-16 23:04:14.498775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.462 [2024-04-16 23:04:14.498800] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.462 qpair failed and we were unable to recover it. 00:26:23.462 [2024-04-16 23:04:14.498913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.462 [2024-04-16 23:04:14.499032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.462 [2024-04-16 23:04:14.499057] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.462 qpair failed and we were unable to recover it. 00:26:23.462 [2024-04-16 23:04:14.499196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.462 [2024-04-16 23:04:14.499364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.462 [2024-04-16 23:04:14.499389] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.462 qpair failed and we were unable to recover it. 00:26:23.462 [2024-04-16 23:04:14.499525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.462 [2024-04-16 23:04:14.499674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.462 [2024-04-16 23:04:14.499700] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.462 qpair failed and we were unable to recover it. 00:26:23.462 [2024-04-16 23:04:14.499817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.462 [2024-04-16 23:04:14.499954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.462 [2024-04-16 23:04:14.499980] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.462 qpair failed and we were unable to recover it. 00:26:23.462 [2024-04-16 23:04:14.500089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.462 [2024-04-16 23:04:14.500240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.462 [2024-04-16 23:04:14.500266] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.462 qpair failed and we were unable to recover it. 00:26:23.462 [2024-04-16 23:04:14.500383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.462 [2024-04-16 23:04:14.500495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.462 [2024-04-16 23:04:14.500520] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.462 qpair failed and we were unable to recover it. 00:26:23.462 [2024-04-16 23:04:14.500674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.462 [2024-04-16 23:04:14.500777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.462 [2024-04-16 23:04:14.500802] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.462 qpair failed and we were unable to recover it. 00:26:23.462 [2024-04-16 23:04:14.500920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.462 [2024-04-16 23:04:14.501067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.462 [2024-04-16 23:04:14.501093] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.462 qpair failed and we were unable to recover it. 00:26:23.462 [2024-04-16 23:04:14.501206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.462 [2024-04-16 23:04:14.501330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.462 [2024-04-16 23:04:14.501355] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.462 qpair failed and we were unable to recover it. 00:26:23.462 [2024-04-16 23:04:14.501468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.462 [2024-04-16 23:04:14.501575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.462 [2024-04-16 23:04:14.501606] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.462 qpair failed and we were unable to recover it. 00:26:23.462 [2024-04-16 23:04:14.501716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.462 [2024-04-16 23:04:14.501838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.462 [2024-04-16 23:04:14.501864] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.462 qpair failed and we were unable to recover it. 00:26:23.462 [2024-04-16 23:04:14.502010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.462 [2024-04-16 23:04:14.502130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.462 [2024-04-16 23:04:14.502155] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.462 qpair failed and we were unable to recover it. 00:26:23.462 [2024-04-16 23:04:14.502283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.462 [2024-04-16 23:04:14.502397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.462 [2024-04-16 23:04:14.502422] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.462 qpair failed and we were unable to recover it. 00:26:23.462 [2024-04-16 23:04:14.502545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.462 [2024-04-16 23:04:14.502650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.462 [2024-04-16 23:04:14.502675] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.462 qpair failed and we were unable to recover it. 00:26:23.462 [2024-04-16 23:04:14.502815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.462 [2024-04-16 23:04:14.502951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.462 [2024-04-16 23:04:14.502975] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.462 qpair failed and we were unable to recover it. 00:26:23.462 [2024-04-16 23:04:14.503096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.462 [2024-04-16 23:04:14.503243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.462 [2024-04-16 23:04:14.503270] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.462 qpair failed and we were unable to recover it. 00:26:23.462 [2024-04-16 23:04:14.503394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.462 [2024-04-16 23:04:14.503541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.462 [2024-04-16 23:04:14.503568] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.462 qpair failed and we were unable to recover it. 00:26:23.462 [2024-04-16 23:04:14.503688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.462 [2024-04-16 23:04:14.503798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.462 [2024-04-16 23:04:14.503824] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.462 qpair failed and we were unable to recover it. 00:26:23.462 [2024-04-16 23:04:14.503972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.462 [2024-04-16 23:04:14.504092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.462 [2024-04-16 23:04:14.504119] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.462 qpair failed and we were unable to recover it. 00:26:23.462 [2024-04-16 23:04:14.504235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.462 [2024-04-16 23:04:14.504350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.462 [2024-04-16 23:04:14.504375] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.462 qpair failed and we were unable to recover it. 00:26:23.462 [2024-04-16 23:04:14.504491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.462 [2024-04-16 23:04:14.504636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.462 [2024-04-16 23:04:14.504661] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.462 qpair failed and we were unable to recover it. 00:26:23.462 [2024-04-16 23:04:14.504770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.462 [2024-04-16 23:04:14.504877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.462 [2024-04-16 23:04:14.504902] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.462 qpair failed and we were unable to recover it. 00:26:23.462 [2024-04-16 23:04:14.505024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.462 [2024-04-16 23:04:14.505140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.462 [2024-04-16 23:04:14.505166] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.462 qpair failed and we were unable to recover it. 00:26:23.462 [2024-04-16 23:04:14.505292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.462 [2024-04-16 23:04:14.505407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.462 [2024-04-16 23:04:14.505432] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.462 qpair failed and we were unable to recover it. 00:26:23.462 [2024-04-16 23:04:14.505555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.462 [2024-04-16 23:04:14.505692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.462 [2024-04-16 23:04:14.505716] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.462 qpair failed and we were unable to recover it. 00:26:23.462 [2024-04-16 23:04:14.505857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.462 [2024-04-16 23:04:14.506003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.462 [2024-04-16 23:04:14.506027] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.462 qpair failed and we were unable to recover it. 00:26:23.462 [2024-04-16 23:04:14.506156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.462 [2024-04-16 23:04:14.506300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.462 [2024-04-16 23:04:14.506325] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.462 qpair failed and we were unable to recover it. 00:26:23.462 [2024-04-16 23:04:14.506474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.462 [2024-04-16 23:04:14.506613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.462 [2024-04-16 23:04:14.506639] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.462 qpair failed and we were unable to recover it. 00:26:23.462 [2024-04-16 23:04:14.506751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.462 [2024-04-16 23:04:14.506862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.462 [2024-04-16 23:04:14.506889] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.462 qpair failed and we were unable to recover it. 00:26:23.462 [2024-04-16 23:04:14.506996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.462 [2024-04-16 23:04:14.507109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.462 [2024-04-16 23:04:14.507134] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.462 qpair failed and we were unable to recover it. 00:26:23.462 [2024-04-16 23:04:14.507252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.462 [2024-04-16 23:04:14.507393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.462 [2024-04-16 23:04:14.507419] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.462 qpair failed and we were unable to recover it. 00:26:23.462 [2024-04-16 23:04:14.507528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.462 [2024-04-16 23:04:14.507631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.462 [2024-04-16 23:04:14.507656] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.462 qpair failed and we were unable to recover it. 00:26:23.462 [2024-04-16 23:04:14.507793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.462 [2024-04-16 23:04:14.507903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.462 [2024-04-16 23:04:14.507930] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.462 qpair failed and we were unable to recover it. 00:26:23.462 [2024-04-16 23:04:14.508035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.462 [2024-04-16 23:04:14.508202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.462 [2024-04-16 23:04:14.508228] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.462 qpair failed and we were unable to recover it. 00:26:23.462 [2024-04-16 23:04:14.508340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.462 [2024-04-16 23:04:14.508449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.462 [2024-04-16 23:04:14.508476] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.462 qpair failed and we were unable to recover it. 00:26:23.462 [2024-04-16 23:04:14.508587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.462 [2024-04-16 23:04:14.508758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.462 [2024-04-16 23:04:14.508788] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.462 qpair failed and we were unable to recover it. 00:26:23.462 [2024-04-16 23:04:14.508896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.462 [2024-04-16 23:04:14.509059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.462 [2024-04-16 23:04:14.509084] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.462 qpair failed and we were unable to recover it. 00:26:23.462 [2024-04-16 23:04:14.509204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.462 [2024-04-16 23:04:14.509321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.462 [2024-04-16 23:04:14.509346] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.462 qpair failed and we were unable to recover it. 00:26:23.462 [2024-04-16 23:04:14.509453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.462 [2024-04-16 23:04:14.509564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.462 [2024-04-16 23:04:14.509589] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.462 qpair failed and we were unable to recover it. 00:26:23.462 [2024-04-16 23:04:14.509695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.462 [2024-04-16 23:04:14.509842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.462 [2024-04-16 23:04:14.509867] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.462 qpair failed and we were unable to recover it. 00:26:23.462 [2024-04-16 23:04:14.509983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.462 [2024-04-16 23:04:14.510092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.462 [2024-04-16 23:04:14.510118] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.462 qpair failed and we were unable to recover it. 00:26:23.462 [2024-04-16 23:04:14.510246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.462 [2024-04-16 23:04:14.510393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.462 [2024-04-16 23:04:14.510417] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.462 qpair failed and we were unable to recover it. 00:26:23.462 [2024-04-16 23:04:14.510566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.462 [2024-04-16 23:04:14.510677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.462 [2024-04-16 23:04:14.510702] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.462 qpair failed and we were unable to recover it. 00:26:23.462 [2024-04-16 23:04:14.510815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.462 [2024-04-16 23:04:14.510920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.462 [2024-04-16 23:04:14.510945] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.462 qpair failed and we were unable to recover it. 00:26:23.462 [2024-04-16 23:04:14.511068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.462 [2024-04-16 23:04:14.511183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.462 [2024-04-16 23:04:14.511208] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.462 qpair failed and we were unable to recover it. 00:26:23.462 [2024-04-16 23:04:14.511345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.462 [2024-04-16 23:04:14.511460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.462 [2024-04-16 23:04:14.511487] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.462 qpair failed and we were unable to recover it. 00:26:23.462 [2024-04-16 23:04:14.511598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.462 [2024-04-16 23:04:14.511730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.462 [2024-04-16 23:04:14.511755] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.462 qpair failed and we were unable to recover it. 00:26:23.462 [2024-04-16 23:04:14.511869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.462 [2024-04-16 23:04:14.512024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.462 [2024-04-16 23:04:14.512049] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.462 qpair failed and we were unable to recover it. 00:26:23.462 [2024-04-16 23:04:14.512188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.462 [2024-04-16 23:04:14.512339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.462 [2024-04-16 23:04:14.512363] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.462 qpair failed and we were unable to recover it. 00:26:23.462 [2024-04-16 23:04:14.512478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.462 [2024-04-16 23:04:14.512591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.462 [2024-04-16 23:04:14.512615] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.462 qpair failed and we were unable to recover it. 00:26:23.462 [2024-04-16 23:04:14.512762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.462 [2024-04-16 23:04:14.512872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.462 [2024-04-16 23:04:14.512896] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.462 qpair failed and we were unable to recover it. 00:26:23.462 [2024-04-16 23:04:14.513041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.462 [2024-04-16 23:04:14.513188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.462 [2024-04-16 23:04:14.513220] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.462 qpair failed and we were unable to recover it. 00:26:23.462 [2024-04-16 23:04:14.513335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.462 [2024-04-16 23:04:14.513473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.463 [2024-04-16 23:04:14.513500] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.463 qpair failed and we were unable to recover it. 00:26:23.463 [2024-04-16 23:04:14.513622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.463 [2024-04-16 23:04:14.513732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.463 [2024-04-16 23:04:14.513759] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.463 qpair failed and we were unable to recover it. 00:26:23.463 [2024-04-16 23:04:14.513906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.463 [2024-04-16 23:04:14.514032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.463 [2024-04-16 23:04:14.514057] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.463 qpair failed and we were unable to recover it. 00:26:23.463 [2024-04-16 23:04:14.514184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.463 [2024-04-16 23:04:14.514329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.463 [2024-04-16 23:04:14.514354] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.463 qpair failed and we were unable to recover it. 00:26:23.463 [2024-04-16 23:04:14.514471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.463 [2024-04-16 23:04:14.514590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.463 [2024-04-16 23:04:14.514615] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.463 qpair failed and we were unable to recover it. 00:26:23.463 [2024-04-16 23:04:14.514724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.463 [2024-04-16 23:04:14.514846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.463 [2024-04-16 23:04:14.514871] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.463 qpair failed and we were unable to recover it. 00:26:23.463 [2024-04-16 23:04:14.514983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.463 [2024-04-16 23:04:14.515104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.463 [2024-04-16 23:04:14.515128] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.463 qpair failed and we were unable to recover it. 00:26:23.463 [2024-04-16 23:04:14.515276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.463 [2024-04-16 23:04:14.515421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.463 [2024-04-16 23:04:14.515446] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.463 qpair failed and we were unable to recover it. 00:26:23.463 [2024-04-16 23:04:14.515582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.463 [2024-04-16 23:04:14.515698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.463 [2024-04-16 23:04:14.515722] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.463 qpair failed and we were unable to recover it. 00:26:23.463 [2024-04-16 23:04:14.515837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.463 [2024-04-16 23:04:14.515946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.463 [2024-04-16 23:04:14.515971] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.463 qpair failed and we were unable to recover it. 00:26:23.463 [2024-04-16 23:04:14.516088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.463 [2024-04-16 23:04:14.516202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.463 [2024-04-16 23:04:14.516237] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.463 qpair failed and we were unable to recover it. 00:26:23.463 [2024-04-16 23:04:14.516345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.463 [2024-04-16 23:04:14.516454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.463 [2024-04-16 23:04:14.516489] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.463 qpair failed and we were unable to recover it. 00:26:23.463 [2024-04-16 23:04:14.516591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.463 [2024-04-16 23:04:14.516708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.463 [2024-04-16 23:04:14.516733] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.463 qpair failed and we were unable to recover it. 00:26:23.463 [2024-04-16 23:04:14.516840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.463 [2024-04-16 23:04:14.516956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.463 [2024-04-16 23:04:14.516981] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.463 qpair failed and we were unable to recover it. 00:26:23.463 [2024-04-16 23:04:14.517093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.463 [2024-04-16 23:04:14.517213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.463 [2024-04-16 23:04:14.517239] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.463 qpair failed and we were unable to recover it. 00:26:23.463 [2024-04-16 23:04:14.517380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.463 [2024-04-16 23:04:14.517487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.463 [2024-04-16 23:04:14.517512] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.463 qpair failed and we were unable to recover it. 00:26:23.463 [2024-04-16 23:04:14.517626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.463 [2024-04-16 23:04:14.517738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.463 [2024-04-16 23:04:14.517763] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.463 qpair failed and we were unable to recover it. 00:26:23.463 [2024-04-16 23:04:14.517877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.463 [2024-04-16 23:04:14.517983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.463 [2024-04-16 23:04:14.518007] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.463 qpair failed and we were unable to recover it. 00:26:23.463 [2024-04-16 23:04:14.518144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.463 [2024-04-16 23:04:14.518271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.463 [2024-04-16 23:04:14.518298] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.463 qpair failed and we were unable to recover it. 00:26:23.463 [2024-04-16 23:04:14.518415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.463 [2024-04-16 23:04:14.518555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.463 [2024-04-16 23:04:14.518581] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.463 qpair failed and we were unable to recover it. 00:26:23.463 [2024-04-16 23:04:14.518685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.463 [2024-04-16 23:04:14.518802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.463 [2024-04-16 23:04:14.518827] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.463 qpair failed and we were unable to recover it. 00:26:23.463 [2024-04-16 23:04:14.518945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.463 [2024-04-16 23:04:14.519083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.463 [2024-04-16 23:04:14.519108] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.463 qpair failed and we were unable to recover it. 00:26:23.463 [2024-04-16 23:04:14.519226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.463 [2024-04-16 23:04:14.519345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.463 [2024-04-16 23:04:14.519369] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.463 qpair failed and we were unable to recover it. 00:26:23.463 [2024-04-16 23:04:14.519482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.463 [2024-04-16 23:04:14.519589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.463 [2024-04-16 23:04:14.519615] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.463 qpair failed and we were unable to recover it. 00:26:23.463 [2024-04-16 23:04:14.519754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.463 [2024-04-16 23:04:14.519882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.463 [2024-04-16 23:04:14.519906] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.463 qpair failed and we were unable to recover it. 00:26:23.463 [2024-04-16 23:04:14.520038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.463 [2024-04-16 23:04:14.520150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.463 [2024-04-16 23:04:14.520181] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.463 qpair failed and we were unable to recover it. 00:26:23.463 [2024-04-16 23:04:14.520302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.463 [2024-04-16 23:04:14.520441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.463 [2024-04-16 23:04:14.520465] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.463 qpair failed and we were unable to recover it. 00:26:23.463 [2024-04-16 23:04:14.520586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.463 [2024-04-16 23:04:14.520702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.463 [2024-04-16 23:04:14.520727] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.463 qpair failed and we were unable to recover it. 00:26:23.463 [2024-04-16 23:04:14.520838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.463 [2024-04-16 23:04:14.520952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.463 [2024-04-16 23:04:14.520978] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.463 qpair failed and we were unable to recover it. 00:26:23.463 [2024-04-16 23:04:14.521089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.463 [2024-04-16 23:04:14.521210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.463 [2024-04-16 23:04:14.521245] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.463 qpair failed and we were unable to recover it. 00:26:23.463 [2024-04-16 23:04:14.521373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.463 [2024-04-16 23:04:14.521488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.463 [2024-04-16 23:04:14.521513] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.463 qpair failed and we were unable to recover it. 00:26:23.463 [2024-04-16 23:04:14.521649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.463 [2024-04-16 23:04:14.521773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.463 [2024-04-16 23:04:14.521798] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.463 qpair failed and we were unable to recover it. 00:26:23.463 [2024-04-16 23:04:14.521942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.463 [2024-04-16 23:04:14.522054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.463 [2024-04-16 23:04:14.522081] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.463 qpair failed and we were unable to recover it. 00:26:23.463 [2024-04-16 23:04:14.522201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.463 [2024-04-16 23:04:14.522346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.463 [2024-04-16 23:04:14.522372] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.463 qpair failed and we were unable to recover it. 00:26:23.463 [2024-04-16 23:04:14.522489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.463 [2024-04-16 23:04:14.522610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.463 [2024-04-16 23:04:14.522634] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.463 qpair failed and we were unable to recover it. 00:26:23.463 [2024-04-16 23:04:14.522775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.463 [2024-04-16 23:04:14.522883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.463 [2024-04-16 23:04:14.522909] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.463 qpair failed and we were unable to recover it. 00:26:23.463 [2024-04-16 23:04:14.523015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.463 [2024-04-16 23:04:14.523157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.463 [2024-04-16 23:04:14.523186] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.463 qpair failed and we were unable to recover it. 00:26:23.463 [2024-04-16 23:04:14.523321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.463 [2024-04-16 23:04:14.523431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.463 [2024-04-16 23:04:14.523455] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.463 qpair failed and we were unable to recover it. 00:26:23.463 [2024-04-16 23:04:14.523570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.463 [2024-04-16 23:04:14.523740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.463 [2024-04-16 23:04:14.523764] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.463 qpair failed and we were unable to recover it. 00:26:23.463 [2024-04-16 23:04:14.523874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.463 [2024-04-16 23:04:14.523993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.463 [2024-04-16 23:04:14.524019] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.463 qpair failed and we were unable to recover it. 00:26:23.463 [2024-04-16 23:04:14.524135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.463 [2024-04-16 23:04:14.524263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.463 [2024-04-16 23:04:14.524288] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.463 qpair failed and we were unable to recover it. 00:26:23.463 [2024-04-16 23:04:14.524408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.463 [2024-04-16 23:04:14.524533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.463 [2024-04-16 23:04:14.524558] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.463 qpair failed and we were unable to recover it. 00:26:23.463 [2024-04-16 23:04:14.524731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.463 [2024-04-16 23:04:14.524836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.463 [2024-04-16 23:04:14.524862] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.463 qpair failed and we were unable to recover it. 00:26:23.463 [2024-04-16 23:04:14.525004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.463 [2024-04-16 23:04:14.525122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.463 [2024-04-16 23:04:14.525147] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.463 qpair failed and we were unable to recover it. 00:26:23.463 [2024-04-16 23:04:14.525308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.463 [2024-04-16 23:04:14.525461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.463 [2024-04-16 23:04:14.525495] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.463 qpair failed and we were unable to recover it. 00:26:23.463 [2024-04-16 23:04:14.525622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.463 [2024-04-16 23:04:14.525726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.463 [2024-04-16 23:04:14.525751] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.463 qpair failed and we were unable to recover it. 00:26:23.463 [2024-04-16 23:04:14.525865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.463 [2024-04-16 23:04:14.525977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.463 [2024-04-16 23:04:14.526002] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.463 qpair failed and we were unable to recover it. 00:26:23.463 [2024-04-16 23:04:14.526150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.463 [2024-04-16 23:04:14.526278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.463 [2024-04-16 23:04:14.526304] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.463 qpair failed and we were unable to recover it. 00:26:23.463 [2024-04-16 23:04:14.526439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.464 [2024-04-16 23:04:14.526572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.464 [2024-04-16 23:04:14.526596] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.464 qpair failed and we were unable to recover it. 00:26:23.464 [2024-04-16 23:04:14.526725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.464 [2024-04-16 23:04:14.526844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.464 [2024-04-16 23:04:14.526869] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.464 qpair failed and we were unable to recover it. 00:26:23.464 [2024-04-16 23:04:14.527006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.464 [2024-04-16 23:04:14.527116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.464 [2024-04-16 23:04:14.527141] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.464 qpair failed and we were unable to recover it. 00:26:23.464 [2024-04-16 23:04:14.527279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.464 [2024-04-16 23:04:14.527422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.464 [2024-04-16 23:04:14.527447] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.464 qpair failed and we were unable to recover it. 00:26:23.464 [2024-04-16 23:04:14.527588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.464 [2024-04-16 23:04:14.527733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.464 [2024-04-16 23:04:14.527757] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.464 qpair failed and we were unable to recover it. 00:26:23.464 [2024-04-16 23:04:14.527877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.464 [2024-04-16 23:04:14.527987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.464 [2024-04-16 23:04:14.528011] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.464 qpair failed and we were unable to recover it. 00:26:23.464 [2024-04-16 23:04:14.528133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.464 [2024-04-16 23:04:14.528244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.464 [2024-04-16 23:04:14.528273] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.464 qpair failed and we were unable to recover it. 00:26:23.464 [2024-04-16 23:04:14.528390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.464 [2024-04-16 23:04:14.528496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.464 [2024-04-16 23:04:14.528520] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.464 qpair failed and we were unable to recover it. 00:26:23.464 [2024-04-16 23:04:14.528657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.464 [2024-04-16 23:04:14.528800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.464 [2024-04-16 23:04:14.528824] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.464 qpair failed and we were unable to recover it. 00:26:23.464 [2024-04-16 23:04:14.528935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.464 [2024-04-16 23:04:14.529044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.464 [2024-04-16 23:04:14.529068] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.464 qpair failed and we were unable to recover it. 00:26:23.464 [2024-04-16 23:04:14.529208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.464 [2024-04-16 23:04:14.529326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.464 [2024-04-16 23:04:14.529351] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.464 qpair failed and we were unable to recover it. 00:26:23.464 [2024-04-16 23:04:14.529492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.464 [2024-04-16 23:04:14.529633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.464 [2024-04-16 23:04:14.529657] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.464 qpair failed and we were unable to recover it. 00:26:23.464 [2024-04-16 23:04:14.529779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.464 [2024-04-16 23:04:14.529897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.464 [2024-04-16 23:04:14.529924] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.464 qpair failed and we were unable to recover it. 00:26:23.464 [2024-04-16 23:04:14.530034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.464 [2024-04-16 23:04:14.530186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.464 [2024-04-16 23:04:14.530212] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.464 qpair failed and we were unable to recover it. 00:26:23.464 [2024-04-16 23:04:14.530321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.464 [2024-04-16 23:04:14.530425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.464 [2024-04-16 23:04:14.530450] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.464 qpair failed and we were unable to recover it. 00:26:23.464 [2024-04-16 23:04:14.530558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.464 [2024-04-16 23:04:14.530673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.464 [2024-04-16 23:04:14.530698] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.464 qpair failed and we were unable to recover it. 00:26:23.464 [2024-04-16 23:04:14.530813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.464 [2024-04-16 23:04:14.530923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.464 [2024-04-16 23:04:14.530952] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.464 qpair failed and we were unable to recover it. 00:26:23.464 [2024-04-16 23:04:14.531076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.464 [2024-04-16 23:04:14.531244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.464 [2024-04-16 23:04:14.531270] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.464 qpair failed and we were unable to recover it. 00:26:23.464 [2024-04-16 23:04:14.531385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.464 [2024-04-16 23:04:14.531503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.464 [2024-04-16 23:04:14.531528] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.464 qpair failed and we were unable to recover it. 00:26:23.464 [2024-04-16 23:04:14.531677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.464 [2024-04-16 23:04:14.531784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.464 [2024-04-16 23:04:14.531808] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.464 qpair failed and we were unable to recover it. 00:26:23.464 [2024-04-16 23:04:14.531918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.464 [2024-04-16 23:04:14.532040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.464 [2024-04-16 23:04:14.532067] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.464 qpair failed and we were unable to recover it. 00:26:23.464 [2024-04-16 23:04:14.532184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.464 [2024-04-16 23:04:14.532331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.464 [2024-04-16 23:04:14.532357] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.464 qpair failed and we were unable to recover it. 00:26:23.464 [2024-04-16 23:04:14.532500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.464 [2024-04-16 23:04:14.532622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.464 [2024-04-16 23:04:14.532647] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.464 qpair failed and we were unable to recover it. 00:26:23.464 [2024-04-16 23:04:14.532819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.464 [2024-04-16 23:04:14.532981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.464 [2024-04-16 23:04:14.533007] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.464 qpair failed and we were unable to recover it. 00:26:23.464 [2024-04-16 23:04:14.533144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.464 [2024-04-16 23:04:14.533295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.464 [2024-04-16 23:04:14.533321] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.464 qpair failed and we were unable to recover it. 00:26:23.464 [2024-04-16 23:04:14.533436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.464 [2024-04-16 23:04:14.533542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.464 [2024-04-16 23:04:14.533567] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.464 qpair failed and we were unable to recover it. 00:26:23.464 [2024-04-16 23:04:14.533715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.464 [2024-04-16 23:04:14.533826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.464 [2024-04-16 23:04:14.533855] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.464 qpair failed and we were unable to recover it. 00:26:23.464 [2024-04-16 23:04:14.533963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.464 [2024-04-16 23:04:14.534085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.464 [2024-04-16 23:04:14.534112] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.464 qpair failed and we were unable to recover it. 00:26:23.464 [2024-04-16 23:04:14.534234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.464 [2024-04-16 23:04:14.534381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.464 [2024-04-16 23:04:14.534407] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.464 qpair failed and we were unable to recover it. 00:26:23.464 [2024-04-16 23:04:14.534562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.464 [2024-04-16 23:04:14.534699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.464 [2024-04-16 23:04:14.534724] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.464 qpair failed and we were unable to recover it. 00:26:23.464 [2024-04-16 23:04:14.534845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.464 [2024-04-16 23:04:14.534955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.464 [2024-04-16 23:04:14.534980] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.464 qpair failed and we were unable to recover it. 00:26:23.464 [2024-04-16 23:04:14.535149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.464 [2024-04-16 23:04:14.535262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.464 [2024-04-16 23:04:14.535288] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.464 qpair failed and we were unable to recover it. 00:26:23.464 [2024-04-16 23:04:14.535454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.464 [2024-04-16 23:04:14.535576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.464 [2024-04-16 23:04:14.535602] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.464 qpair failed and we were unable to recover it. 00:26:23.464 [2024-04-16 23:04:14.535770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.464 [2024-04-16 23:04:14.535879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.464 [2024-04-16 23:04:14.535904] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.464 qpair failed and we were unable to recover it. 00:26:23.464 [2024-04-16 23:04:14.536013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.464 [2024-04-16 23:04:14.536127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.464 [2024-04-16 23:04:14.536153] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.464 qpair failed and we were unable to recover it. 00:26:23.464 [2024-04-16 23:04:14.536288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.464 [2024-04-16 23:04:14.536434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.464 [2024-04-16 23:04:14.536460] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.464 qpair failed and we were unable to recover it. 00:26:23.464 [2024-04-16 23:04:14.536618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.464 [2024-04-16 23:04:14.536735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.464 [2024-04-16 23:04:14.536761] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.464 qpair failed and we were unable to recover it. 00:26:23.464 [2024-04-16 23:04:14.536888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.464 [2024-04-16 23:04:14.537001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.464 [2024-04-16 23:04:14.537026] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.464 qpair failed and we were unable to recover it. 00:26:23.464 [2024-04-16 23:04:14.537168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.464 [2024-04-16 23:04:14.537301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.464 [2024-04-16 23:04:14.537327] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.464 qpair failed and we were unable to recover it. 00:26:23.464 [2024-04-16 23:04:14.537467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.464 [2024-04-16 23:04:14.537580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.464 [2024-04-16 23:04:14.537606] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.464 qpair failed and we were unable to recover it. 00:26:23.464 [2024-04-16 23:04:14.537710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.464 [2024-04-16 23:04:14.537817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.464 [2024-04-16 23:04:14.537843] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.464 qpair failed and we were unable to recover it. 00:26:23.464 [2024-04-16 23:04:14.537947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.464 [2024-04-16 23:04:14.538059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.464 [2024-04-16 23:04:14.538084] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.464 qpair failed and we were unable to recover it. 00:26:23.464 [2024-04-16 23:04:14.538206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.464 [2024-04-16 23:04:14.538331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.464 [2024-04-16 23:04:14.538357] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.464 qpair failed and we were unable to recover it. 00:26:23.464 [2024-04-16 23:04:14.538499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.464 [2024-04-16 23:04:14.538603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.464 [2024-04-16 23:04:14.538628] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.464 qpair failed and we were unable to recover it. 00:26:23.464 [2024-04-16 23:04:14.538786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.464 [2024-04-16 23:04:14.538924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.464 [2024-04-16 23:04:14.538949] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.464 qpair failed and we were unable to recover it. 00:26:23.464 [2024-04-16 23:04:14.539054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.464 [2024-04-16 23:04:14.539180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.464 [2024-04-16 23:04:14.539207] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.464 qpair failed and we were unable to recover it. 00:26:23.464 [2024-04-16 23:04:14.539346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.464 [2024-04-16 23:04:14.539459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.464 [2024-04-16 23:04:14.539485] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.464 qpair failed and we were unable to recover it. 00:26:23.464 [2024-04-16 23:04:14.539595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.464 [2024-04-16 23:04:14.539730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.464 [2024-04-16 23:04:14.539755] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.464 qpair failed and we were unable to recover it. 00:26:23.464 [2024-04-16 23:04:14.539870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.464 [2024-04-16 23:04:14.539983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.464 [2024-04-16 23:04:14.540009] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.464 qpair failed and we were unable to recover it. 00:26:23.464 [2024-04-16 23:04:14.540153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.464 [2024-04-16 23:04:14.540292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.464 [2024-04-16 23:04:14.540318] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.464 qpair failed and we were unable to recover it. 00:26:23.464 [2024-04-16 23:04:14.540423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.464 [2024-04-16 23:04:14.540531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.464 [2024-04-16 23:04:14.540557] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.464 qpair failed and we were unable to recover it. 00:26:23.464 [2024-04-16 23:04:14.540695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.464 [2024-04-16 23:04:14.540800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.464 [2024-04-16 23:04:14.540825] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.464 qpair failed and we were unable to recover it. 00:26:23.464 [2024-04-16 23:04:14.540935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.464 [2024-04-16 23:04:14.541040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.464 [2024-04-16 23:04:14.541066] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.465 qpair failed and we were unable to recover it. 00:26:23.465 [2024-04-16 23:04:14.541183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.465 [2024-04-16 23:04:14.541294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.465 [2024-04-16 23:04:14.541319] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.465 qpair failed and we were unable to recover it. 00:26:23.465 [2024-04-16 23:04:14.541424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.465 [2024-04-16 23:04:14.541540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.465 [2024-04-16 23:04:14.541566] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.465 qpair failed and we were unable to recover it. 00:26:23.465 [2024-04-16 23:04:14.541681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.465 [2024-04-16 23:04:14.541806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.465 [2024-04-16 23:04:14.541832] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.465 qpair failed and we were unable to recover it. 00:26:23.465 [2024-04-16 23:04:14.541937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.465 [2024-04-16 23:04:14.542040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.465 [2024-04-16 23:04:14.542066] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.465 qpair failed and we were unable to recover it. 00:26:23.465 [2024-04-16 23:04:14.542191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.465 [2024-04-16 23:04:14.542301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.465 [2024-04-16 23:04:14.542326] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.465 qpair failed and we were unable to recover it. 00:26:23.465 [2024-04-16 23:04:14.542447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.465 [2024-04-16 23:04:14.542588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.465 [2024-04-16 23:04:14.542613] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.465 qpair failed and we were unable to recover it. 00:26:23.465 [2024-04-16 23:04:14.542721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.465 [2024-04-16 23:04:14.542832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.465 [2024-04-16 23:04:14.542857] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.465 qpair failed and we were unable to recover it. 00:26:23.465 [2024-04-16 23:04:14.542975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.465 [2024-04-16 23:04:14.543082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.465 [2024-04-16 23:04:14.543107] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.465 qpair failed and we were unable to recover it. 00:26:23.465 [2024-04-16 23:04:14.543227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.465 [2024-04-16 23:04:14.543352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.465 [2024-04-16 23:04:14.543378] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.465 qpair failed and we were unable to recover it. 00:26:23.465 [2024-04-16 23:04:14.543525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.465 [2024-04-16 23:04:14.543632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.465 [2024-04-16 23:04:14.543657] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.465 qpair failed and we were unable to recover it. 00:26:23.465 [2024-04-16 23:04:14.543782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.465 [2024-04-16 23:04:14.543904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.465 [2024-04-16 23:04:14.543928] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.465 qpair failed and we were unable to recover it. 00:26:23.465 [2024-04-16 23:04:14.544033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.465 [2024-04-16 23:04:14.544181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.465 [2024-04-16 23:04:14.544207] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.465 qpair failed and we were unable to recover it. 00:26:23.465 [2024-04-16 23:04:14.544324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.465 [2024-04-16 23:04:14.544436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.465 [2024-04-16 23:04:14.544460] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.465 qpair failed and we were unable to recover it. 00:26:23.465 [2024-04-16 23:04:14.544583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.465 [2024-04-16 23:04:14.544723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.465 [2024-04-16 23:04:14.544747] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.465 qpair failed and we were unable to recover it. 00:26:23.465 [2024-04-16 23:04:14.544898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.465 [2024-04-16 23:04:14.545036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.465 [2024-04-16 23:04:14.545062] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.465 qpair failed and we were unable to recover it. 00:26:23.465 [2024-04-16 23:04:14.545171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.465 [2024-04-16 23:04:14.545321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.465 [2024-04-16 23:04:14.545347] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.465 qpair failed and we were unable to recover it. 00:26:23.465 [2024-04-16 23:04:14.545467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.465 [2024-04-16 23:04:14.545584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.465 [2024-04-16 23:04:14.545611] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.465 qpair failed and we were unable to recover it. 00:26:23.465 [2024-04-16 23:04:14.545731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.465 [2024-04-16 23:04:14.545846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.465 [2024-04-16 23:04:14.545870] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.465 qpair failed and we were unable to recover it. 00:26:23.465 [2024-04-16 23:04:14.546003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.465 [2024-04-16 23:04:14.546171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.465 [2024-04-16 23:04:14.546205] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.465 qpair failed and we were unable to recover it. 00:26:23.465 [2024-04-16 23:04:14.546315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.465 [2024-04-16 23:04:14.546449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.465 [2024-04-16 23:04:14.546474] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.465 qpair failed and we were unable to recover it. 00:26:23.465 [2024-04-16 23:04:14.546618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.465 [2024-04-16 23:04:14.546734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.465 [2024-04-16 23:04:14.546759] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.465 qpair failed and we were unable to recover it. 00:26:23.465 [2024-04-16 23:04:14.546873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.465 [2024-04-16 23:04:14.546991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.465 [2024-04-16 23:04:14.547017] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.465 qpair failed and we were unable to recover it. 00:26:23.465 [2024-04-16 23:04:14.547128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.747 [2024-04-16 23:04:14.547241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.747 [2024-04-16 23:04:14.547267] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.747 qpair failed and we were unable to recover it. 00:26:23.747 [2024-04-16 23:04:14.547400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.747 [2024-04-16 23:04:14.547543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.747 [2024-04-16 23:04:14.547567] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.747 qpair failed and we were unable to recover it. 00:26:23.747 [2024-04-16 23:04:14.547692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.747 [2024-04-16 23:04:14.547803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.747 [2024-04-16 23:04:14.547827] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.747 qpair failed and we were unable to recover it. 00:26:23.747 [2024-04-16 23:04:14.547942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.747 [2024-04-16 23:04:14.548065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.747 [2024-04-16 23:04:14.548092] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.747 qpair failed and we were unable to recover it. 00:26:23.747 [2024-04-16 23:04:14.548224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.747 [2024-04-16 23:04:14.548338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.747 [2024-04-16 23:04:14.548362] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.747 qpair failed and we were unable to recover it. 00:26:23.747 [2024-04-16 23:04:14.548480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.747 [2024-04-16 23:04:14.548599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.747 [2024-04-16 23:04:14.548624] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.747 qpair failed and we were unable to recover it. 00:26:23.747 [2024-04-16 23:04:14.548751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.747 [2024-04-16 23:04:14.548899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.747 [2024-04-16 23:04:14.548926] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.747 qpair failed and we were unable to recover it. 00:26:23.747 [2024-04-16 23:04:14.549038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.747 [2024-04-16 23:04:14.549157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.747 [2024-04-16 23:04:14.549192] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.747 qpair failed and we were unable to recover it. 00:26:23.747 [2024-04-16 23:04:14.549307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.747 [2024-04-16 23:04:14.549417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.747 [2024-04-16 23:04:14.549444] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.747 qpair failed and we were unable to recover it. 00:26:23.747 [2024-04-16 23:04:14.549556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.747 [2024-04-16 23:04:14.549702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.747 [2024-04-16 23:04:14.549729] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.747 qpair failed and we were unable to recover it. 00:26:23.747 [2024-04-16 23:04:14.549864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.747 [2024-04-16 23:04:14.549986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.747 [2024-04-16 23:04:14.550012] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.747 qpair failed and we were unable to recover it. 00:26:23.747 [2024-04-16 23:04:14.550116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.747 [2024-04-16 23:04:14.550229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.747 [2024-04-16 23:04:14.550255] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.747 qpair failed and we were unable to recover it. 00:26:23.747 [2024-04-16 23:04:14.550388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.747 [2024-04-16 23:04:14.550537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.747 [2024-04-16 23:04:14.550563] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.747 qpair failed and we were unable to recover it. 00:26:23.747 [2024-04-16 23:04:14.550679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.747 [2024-04-16 23:04:14.550789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.747 [2024-04-16 23:04:14.550814] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.747 qpair failed and we were unable to recover it. 00:26:23.747 [2024-04-16 23:04:14.550922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.747 [2024-04-16 23:04:14.551033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.747 [2024-04-16 23:04:14.551064] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.747 qpair failed and we were unable to recover it. 00:26:23.747 [2024-04-16 23:04:14.551202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.747 [2024-04-16 23:04:14.551355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.747 [2024-04-16 23:04:14.551380] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.747 qpair failed and we were unable to recover it. 00:26:23.747 [2024-04-16 23:04:14.551499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.747 [2024-04-16 23:04:14.551646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.747 [2024-04-16 23:04:14.551673] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.747 qpair failed and we were unable to recover it. 00:26:23.747 [2024-04-16 23:04:14.551845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.747 [2024-04-16 23:04:14.551963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.747 [2024-04-16 23:04:14.551989] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.747 qpair failed and we were unable to recover it. 00:26:23.747 [2024-04-16 23:04:14.552127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.747 [2024-04-16 23:04:14.552243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.747 [2024-04-16 23:04:14.552270] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.747 qpair failed and we were unable to recover it. 00:26:23.747 [2024-04-16 23:04:14.552390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.747 [2024-04-16 23:04:14.552508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.747 [2024-04-16 23:04:14.552534] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.747 qpair failed and we were unable to recover it. 00:26:23.747 [2024-04-16 23:04:14.552674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.747 [2024-04-16 23:04:14.552786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.747 [2024-04-16 23:04:14.552812] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.747 qpair failed and we were unable to recover it. 00:26:23.747 [2024-04-16 23:04:14.552949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.747 [2024-04-16 23:04:14.553088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.747 [2024-04-16 23:04:14.553115] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.747 qpair failed and we were unable to recover it. 00:26:23.747 [2024-04-16 23:04:14.553238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.747 [2024-04-16 23:04:14.553393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.747 [2024-04-16 23:04:14.553419] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.747 qpair failed and we were unable to recover it. 00:26:23.747 [2024-04-16 23:04:14.553531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.747 [2024-04-16 23:04:14.553678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.747 [2024-04-16 23:04:14.553703] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.747 qpair failed and we were unable to recover it. 00:26:23.747 [2024-04-16 23:04:14.553810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.747 [2024-04-16 23:04:14.553919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.747 [2024-04-16 23:04:14.553944] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.747 qpair failed and we were unable to recover it. 00:26:23.747 [2024-04-16 23:04:14.554054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.747 [2024-04-16 23:04:14.554197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.747 [2024-04-16 23:04:14.554223] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.747 qpair failed and we were unable to recover it. 00:26:23.747 [2024-04-16 23:04:14.554344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.747 [2024-04-16 23:04:14.554465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.747 [2024-04-16 23:04:14.554491] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.747 qpair failed and we were unable to recover it. 00:26:23.747 [2024-04-16 23:04:14.554633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.747 [2024-04-16 23:04:14.554739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.747 [2024-04-16 23:04:14.554764] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.747 qpair failed and we were unable to recover it. 00:26:23.747 [2024-04-16 23:04:14.554902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.747 [2024-04-16 23:04:14.555012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.747 [2024-04-16 23:04:14.555036] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.747 qpair failed and we were unable to recover it. 00:26:23.747 [2024-04-16 23:04:14.555152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.747 [2024-04-16 23:04:14.555280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.747 [2024-04-16 23:04:14.555305] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.747 qpair failed and we were unable to recover it. 00:26:23.747 [2024-04-16 23:04:14.555421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.747 [2024-04-16 23:04:14.555543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.747 [2024-04-16 23:04:14.555568] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.747 qpair failed and we were unable to recover it. 00:26:23.747 [2024-04-16 23:04:14.555714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.747 [2024-04-16 23:04:14.555852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.747 [2024-04-16 23:04:14.555877] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.747 qpair failed and we were unable to recover it. 00:26:23.747 [2024-04-16 23:04:14.555999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.747 [2024-04-16 23:04:14.556110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.747 [2024-04-16 23:04:14.556136] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.747 qpair failed and we were unable to recover it. 00:26:23.747 [2024-04-16 23:04:14.556265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.747 [2024-04-16 23:04:14.556384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.747 [2024-04-16 23:04:14.556410] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.747 qpair failed and we were unable to recover it. 00:26:23.747 [2024-04-16 23:04:14.556547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.747 [2024-04-16 23:04:14.556695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.747 [2024-04-16 23:04:14.556719] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.747 qpair failed and we were unable to recover it. 00:26:23.747 [2024-04-16 23:04:14.556837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.747 [2024-04-16 23:04:14.556949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.748 [2024-04-16 23:04:14.556973] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.748 qpair failed and we were unable to recover it. 00:26:23.748 [2024-04-16 23:04:14.557087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.748 [2024-04-16 23:04:14.557258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.748 [2024-04-16 23:04:14.557284] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.748 qpair failed and we were unable to recover it. 00:26:23.748 [2024-04-16 23:04:14.557401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.748 [2024-04-16 23:04:14.557545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.748 [2024-04-16 23:04:14.557569] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.748 qpair failed and we were unable to recover it. 00:26:23.748 [2024-04-16 23:04:14.557678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.748 [2024-04-16 23:04:14.557787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.748 [2024-04-16 23:04:14.557811] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.748 qpair failed and we were unable to recover it. 00:26:23.748 [2024-04-16 23:04:14.557921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.748 [2024-04-16 23:04:14.558056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.748 [2024-04-16 23:04:14.558081] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.748 qpair failed and we were unable to recover it. 00:26:23.748 [2024-04-16 23:04:14.558197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.748 [2024-04-16 23:04:14.558306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.748 [2024-04-16 23:04:14.558330] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.748 qpair failed and we were unable to recover it. 00:26:23.748 [2024-04-16 23:04:14.558436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.748 [2024-04-16 23:04:14.558580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.748 [2024-04-16 23:04:14.558605] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.748 qpair failed and we were unable to recover it. 00:26:23.748 [2024-04-16 23:04:14.558751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.748 [2024-04-16 23:04:14.558866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.748 [2024-04-16 23:04:14.558890] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.748 qpair failed and we were unable to recover it. 00:26:23.748 [2024-04-16 23:04:14.559001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.748 [2024-04-16 23:04:14.559117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.748 [2024-04-16 23:04:14.559143] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.748 qpair failed and we were unable to recover it. 00:26:23.748 [2024-04-16 23:04:14.559256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.748 [2024-04-16 23:04:14.559382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.748 [2024-04-16 23:04:14.559407] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.748 qpair failed and we were unable to recover it. 00:26:23.748 [2024-04-16 23:04:14.559520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.748 [2024-04-16 23:04:14.559642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.748 [2024-04-16 23:04:14.559668] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.748 qpair failed and we were unable to recover it. 00:26:23.748 [2024-04-16 23:04:14.559788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.748 [2024-04-16 23:04:14.559891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.748 [2024-04-16 23:04:14.559916] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.748 qpair failed and we were unable to recover it. 00:26:23.748 [2024-04-16 23:04:14.560027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.748 [2024-04-16 23:04:14.560141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.748 [2024-04-16 23:04:14.560166] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.748 qpair failed and we were unable to recover it. 00:26:23.748 [2024-04-16 23:04:14.560319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.748 [2024-04-16 23:04:14.560435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.748 [2024-04-16 23:04:14.560459] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.748 qpair failed and we were unable to recover it. 00:26:23.748 [2024-04-16 23:04:14.560569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.748 [2024-04-16 23:04:14.560715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.748 [2024-04-16 23:04:14.560740] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.748 qpair failed and we were unable to recover it. 00:26:23.748 [2024-04-16 23:04:14.560851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.748 [2024-04-16 23:04:14.560964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.748 [2024-04-16 23:04:14.560989] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.748 qpair failed and we were unable to recover it. 00:26:23.748 [2024-04-16 23:04:14.561098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.748 [2024-04-16 23:04:14.561207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.748 [2024-04-16 23:04:14.561232] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.748 qpair failed and we were unable to recover it. 00:26:23.748 [2024-04-16 23:04:14.561353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.748 [2024-04-16 23:04:14.561500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.748 [2024-04-16 23:04:14.561525] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.748 qpair failed and we were unable to recover it. 00:26:23.748 [2024-04-16 23:04:14.561662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.748 [2024-04-16 23:04:14.561767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.748 [2024-04-16 23:04:14.561792] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.748 qpair failed and we were unable to recover it. 00:26:23.748 [2024-04-16 23:04:14.561906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.748 [2024-04-16 23:04:14.562029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.748 [2024-04-16 23:04:14.562053] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.748 qpair failed and we were unable to recover it. 00:26:23.748 [2024-04-16 23:04:14.562212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.748 [2024-04-16 23:04:14.562317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.748 [2024-04-16 23:04:14.562341] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.748 qpair failed and we were unable to recover it. 00:26:23.748 [2024-04-16 23:04:14.562473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.748 [2024-04-16 23:04:14.562590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.748 [2024-04-16 23:04:14.562615] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.748 qpair failed and we were unable to recover it. 00:26:23.748 [2024-04-16 23:04:14.562729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.748 [2024-04-16 23:04:14.562838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.748 [2024-04-16 23:04:14.562863] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.748 qpair failed and we were unable to recover it. 00:26:23.748 [2024-04-16 23:04:14.562968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.748 [2024-04-16 23:04:14.563081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.748 [2024-04-16 23:04:14.563107] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.748 qpair failed and we were unable to recover it. 00:26:23.748 [2024-04-16 23:04:14.563228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.748 [2024-04-16 23:04:14.563364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.748 [2024-04-16 23:04:14.563388] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.748 qpair failed and we were unable to recover it. 00:26:23.748 [2024-04-16 23:04:14.563494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.748 [2024-04-16 23:04:14.563602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.748 [2024-04-16 23:04:14.563628] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.748 qpair failed and we were unable to recover it. 00:26:23.748 [2024-04-16 23:04:14.563743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.748 [2024-04-16 23:04:14.563874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.748 [2024-04-16 23:04:14.563900] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.748 qpair failed and we were unable to recover it. 00:26:23.748 [2024-04-16 23:04:14.564041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.748 [2024-04-16 23:04:14.564156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.748 [2024-04-16 23:04:14.564186] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.748 qpair failed and we were unable to recover it. 00:26:23.748 [2024-04-16 23:04:14.564302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.748 [2024-04-16 23:04:14.564421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.748 [2024-04-16 23:04:14.564447] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.748 qpair failed and we were unable to recover it. 00:26:23.748 [2024-04-16 23:04:14.564563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.748 [2024-04-16 23:04:14.564730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.748 [2024-04-16 23:04:14.564755] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.748 qpair failed and we were unable to recover it. 00:26:23.748 [2024-04-16 23:04:14.564868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.748 [2024-04-16 23:04:14.564984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.748 [2024-04-16 23:04:14.565009] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.748 qpair failed and we were unable to recover it. 00:26:23.748 [2024-04-16 23:04:14.565133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.748 [2024-04-16 23:04:14.565267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.748 [2024-04-16 23:04:14.565292] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.748 qpair failed and we were unable to recover it. 00:26:23.748 [2024-04-16 23:04:14.565445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.748 [2024-04-16 23:04:14.565549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.748 [2024-04-16 23:04:14.565574] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.748 qpair failed and we were unable to recover it. 00:26:23.748 [2024-04-16 23:04:14.565688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.748 [2024-04-16 23:04:14.565828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.748 [2024-04-16 23:04:14.565854] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.748 qpair failed and we were unable to recover it. 00:26:23.748 [2024-04-16 23:04:14.565970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.748 [2024-04-16 23:04:14.566080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.748 [2024-04-16 23:04:14.566106] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.748 qpair failed and we were unable to recover it. 00:26:23.748 [2024-04-16 23:04:14.566261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.748 [2024-04-16 23:04:14.566382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.748 [2024-04-16 23:04:14.566407] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.748 qpair failed and we were unable to recover it. 00:26:23.748 [2024-04-16 23:04:14.566520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.748 [2024-04-16 23:04:14.566634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.748 [2024-04-16 23:04:14.566658] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.748 qpair failed and we were unable to recover it. 00:26:23.748 [2024-04-16 23:04:14.566795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.748 [2024-04-16 23:04:14.566897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.748 [2024-04-16 23:04:14.566926] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.748 qpair failed and we were unable to recover it. 00:26:23.748 [2024-04-16 23:04:14.567051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.748 [2024-04-16 23:04:14.567172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.748 [2024-04-16 23:04:14.567201] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.748 qpair failed and we were unable to recover it. 00:26:23.748 [2024-04-16 23:04:14.567316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.748 [2024-04-16 23:04:14.567432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.748 [2024-04-16 23:04:14.567459] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.748 qpair failed and we were unable to recover it. 00:26:23.748 [2024-04-16 23:04:14.567577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.748 [2024-04-16 23:04:14.567722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.748 [2024-04-16 23:04:14.567747] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.748 qpair failed and we were unable to recover it. 00:26:23.748 [2024-04-16 23:04:14.567851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.748 [2024-04-16 23:04:14.567963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.748 [2024-04-16 23:04:14.567990] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.748 qpair failed and we were unable to recover it. 00:26:23.748 [2024-04-16 23:04:14.568117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.748 [2024-04-16 23:04:14.568224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.748 [2024-04-16 23:04:14.568250] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.748 qpair failed and we were unable to recover it. 00:26:23.748 [2024-04-16 23:04:14.568363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.748 [2024-04-16 23:04:14.568498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.748 [2024-04-16 23:04:14.568523] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.748 qpair failed and we were unable to recover it. 00:26:23.748 [2024-04-16 23:04:14.568643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.748 [2024-04-16 23:04:14.568749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.748 [2024-04-16 23:04:14.568774] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.748 qpair failed and we were unable to recover it. 00:26:23.748 [2024-04-16 23:04:14.568918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.748 [2024-04-16 23:04:14.569061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.748 [2024-04-16 23:04:14.569086] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.748 qpair failed and we were unable to recover it. 00:26:23.748 [2024-04-16 23:04:14.569219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.748 [2024-04-16 23:04:14.569338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.748 [2024-04-16 23:04:14.569364] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.748 qpair failed and we were unable to recover it. 00:26:23.748 [2024-04-16 23:04:14.569494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.748 [2024-04-16 23:04:14.569606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.748 [2024-04-16 23:04:14.569635] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.748 qpair failed and we were unable to recover it. 00:26:23.748 [2024-04-16 23:04:14.569755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.748 [2024-04-16 23:04:14.569872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.748 [2024-04-16 23:04:14.569897] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.748 qpair failed and we were unable to recover it. 00:26:23.748 [2024-04-16 23:04:14.570028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.748 [2024-04-16 23:04:14.570168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.748 [2024-04-16 23:04:14.570222] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.748 qpair failed and we were unable to recover it. 00:26:23.748 [2024-04-16 23:04:14.570333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.748 [2024-04-16 23:04:14.570440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.748 [2024-04-16 23:04:14.570464] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.748 qpair failed and we were unable to recover it. 00:26:23.748 [2024-04-16 23:04:14.570577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.748 [2024-04-16 23:04:14.570680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.748 [2024-04-16 23:04:14.570705] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.748 qpair failed and we were unable to recover it. 00:26:23.748 [2024-04-16 23:04:14.570840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.748 [2024-04-16 23:04:14.570954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.748 [2024-04-16 23:04:14.570979] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.748 qpair failed and we were unable to recover it. 00:26:23.748 [2024-04-16 23:04:14.571121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.748 [2024-04-16 23:04:14.571258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.748 [2024-04-16 23:04:14.571284] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.748 qpair failed and we were unable to recover it. 00:26:23.748 [2024-04-16 23:04:14.571399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.748 [2024-04-16 23:04:14.571504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.749 [2024-04-16 23:04:14.571528] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.749 qpair failed and we were unable to recover it. 00:26:23.749 [2024-04-16 23:04:14.571637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.749 [2024-04-16 23:04:14.571781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.749 [2024-04-16 23:04:14.571807] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.749 qpair failed and we were unable to recover it. 00:26:23.749 [2024-04-16 23:04:14.571916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.749 [2024-04-16 23:04:14.572030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.749 [2024-04-16 23:04:14.572055] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.749 qpair failed and we were unable to recover it. 00:26:23.749 [2024-04-16 23:04:14.572170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.749 [2024-04-16 23:04:14.572289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.749 [2024-04-16 23:04:14.572318] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.749 qpair failed and we were unable to recover it. 00:26:23.749 [2024-04-16 23:04:14.572429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.749 [2024-04-16 23:04:14.572542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.749 [2024-04-16 23:04:14.572567] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.749 qpair failed and we were unable to recover it. 00:26:23.749 [2024-04-16 23:04:14.572685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.749 [2024-04-16 23:04:14.572798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.749 [2024-04-16 23:04:14.572822] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.749 qpair failed and we were unable to recover it. 00:26:23.749 [2024-04-16 23:04:14.572955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.749 [2024-04-16 23:04:14.573062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.749 [2024-04-16 23:04:14.573088] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.749 qpair failed and we were unable to recover it. 00:26:23.749 [2024-04-16 23:04:14.573199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.749 [2024-04-16 23:04:14.573342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.749 [2024-04-16 23:04:14.573367] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.749 qpair failed and we were unable to recover it. 00:26:23.749 [2024-04-16 23:04:14.573502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.749 [2024-04-16 23:04:14.573631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.749 [2024-04-16 23:04:14.573656] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.749 qpair failed and we were unable to recover it. 00:26:23.749 [2024-04-16 23:04:14.573801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.749 [2024-04-16 23:04:14.573935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.749 [2024-04-16 23:04:14.573959] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.749 qpair failed and we were unable to recover it. 00:26:23.749 [2024-04-16 23:04:14.574063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.749 [2024-04-16 23:04:14.574205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.749 [2024-04-16 23:04:14.574230] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.749 qpair failed and we were unable to recover it. 00:26:23.749 [2024-04-16 23:04:14.574368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.749 [2024-04-16 23:04:14.574471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.749 [2024-04-16 23:04:14.574496] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.749 qpair failed and we were unable to recover it. 00:26:23.749 [2024-04-16 23:04:14.574612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.749 [2024-04-16 23:04:14.574735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.749 [2024-04-16 23:04:14.574760] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.749 qpair failed and we were unable to recover it. 00:26:23.749 [2024-04-16 23:04:14.574871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.749 [2024-04-16 23:04:14.575015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.749 [2024-04-16 23:04:14.575043] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.749 qpair failed and we were unable to recover it. 00:26:23.749 [2024-04-16 23:04:14.575160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.749 [2024-04-16 23:04:14.575308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.749 [2024-04-16 23:04:14.575333] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.749 qpair failed and we were unable to recover it. 00:26:23.749 [2024-04-16 23:04:14.575446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.749 [2024-04-16 23:04:14.575550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.749 [2024-04-16 23:04:14.575574] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.749 qpair failed and we were unable to recover it. 00:26:23.749 [2024-04-16 23:04:14.575695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.749 [2024-04-16 23:04:14.575816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.749 [2024-04-16 23:04:14.575840] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.749 qpair failed and we were unable to recover it. 00:26:23.749 [2024-04-16 23:04:14.575960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.749 [2024-04-16 23:04:14.576070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.749 [2024-04-16 23:04:14.576095] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.749 qpair failed and we were unable to recover it. 00:26:23.749 [2024-04-16 23:04:14.576215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.749 [2024-04-16 23:04:14.576357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.749 [2024-04-16 23:04:14.576381] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.749 qpair failed and we were unable to recover it. 00:26:23.749 [2024-04-16 23:04:14.576488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.749 [2024-04-16 23:04:14.576594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.749 [2024-04-16 23:04:14.576618] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.749 qpair failed and we were unable to recover it. 00:26:23.749 [2024-04-16 23:04:14.576764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.749 [2024-04-16 23:04:14.576879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.749 [2024-04-16 23:04:14.576904] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.749 qpair failed and we were unable to recover it. 00:26:23.749 [2024-04-16 23:04:14.577016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.749 [2024-04-16 23:04:14.577123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.749 [2024-04-16 23:04:14.577147] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.749 qpair failed and we were unable to recover it. 00:26:23.749 [2024-04-16 23:04:14.577295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.749 [2024-04-16 23:04:14.577411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.749 [2024-04-16 23:04:14.577437] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.749 qpair failed and we were unable to recover it. 00:26:23.749 [2024-04-16 23:04:14.577541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.749 [2024-04-16 23:04:14.577668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.749 [2024-04-16 23:04:14.577692] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.749 qpair failed and we were unable to recover it. 00:26:23.749 [2024-04-16 23:04:14.577811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.749 [2024-04-16 23:04:14.577969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.749 [2024-04-16 23:04:14.577994] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.749 qpair failed and we were unable to recover it. 00:26:23.749 [2024-04-16 23:04:14.578114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.749 [2024-04-16 23:04:14.578258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.749 [2024-04-16 23:04:14.578285] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.749 qpair failed and we were unable to recover it. 00:26:23.749 [2024-04-16 23:04:14.578407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.749 [2024-04-16 23:04:14.578531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.749 [2024-04-16 23:04:14.578556] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.749 qpair failed and we were unable to recover it. 00:26:23.749 [2024-04-16 23:04:14.578667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.749 [2024-04-16 23:04:14.578840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.749 [2024-04-16 23:04:14.578865] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.749 qpair failed and we were unable to recover it. 00:26:23.749 [2024-04-16 23:04:14.579000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.749 [2024-04-16 23:04:14.579123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.749 [2024-04-16 23:04:14.579149] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.749 qpair failed and we were unable to recover it. 00:26:23.749 [2024-04-16 23:04:14.579295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.749 [2024-04-16 23:04:14.579400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.749 [2024-04-16 23:04:14.579425] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.749 qpair failed and we were unable to recover it. 00:26:23.749 [2024-04-16 23:04:14.579534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.749 [2024-04-16 23:04:14.579649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.749 [2024-04-16 23:04:14.579674] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.749 qpair failed and we were unable to recover it. 00:26:23.749 [2024-04-16 23:04:14.579780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.749 [2024-04-16 23:04:14.579896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.749 [2024-04-16 23:04:14.579920] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.749 qpair failed and we were unable to recover it. 00:26:23.749 [2024-04-16 23:04:14.580056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.749 [2024-04-16 23:04:14.580173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.749 [2024-04-16 23:04:14.580206] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.749 qpair failed and we were unable to recover it. 00:26:23.749 [2024-04-16 23:04:14.580358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.749 [2024-04-16 23:04:14.580473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.749 [2024-04-16 23:04:14.580498] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.749 qpair failed and we were unable to recover it. 00:26:23.749 [2024-04-16 23:04:14.580646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.749 [2024-04-16 23:04:14.580765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.749 [2024-04-16 23:04:14.580789] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.749 qpair failed and we were unable to recover it. 00:26:23.749 [2024-04-16 23:04:14.580912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.749 [2024-04-16 23:04:14.581046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.749 [2024-04-16 23:04:14.581070] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.749 qpair failed and we were unable to recover it. 00:26:23.749 [2024-04-16 23:04:14.581182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.749 [2024-04-16 23:04:14.581297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.749 [2024-04-16 23:04:14.581322] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.749 qpair failed and we were unable to recover it. 00:26:23.749 [2024-04-16 23:04:14.581443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.749 [2024-04-16 23:04:14.581578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.749 [2024-04-16 23:04:14.581602] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.749 qpair failed and we were unable to recover it. 00:26:23.749 [2024-04-16 23:04:14.581726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.749 [2024-04-16 23:04:14.581842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.749 [2024-04-16 23:04:14.581867] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.749 qpair failed and we were unable to recover it. 00:26:23.749 [2024-04-16 23:04:14.582008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.749 [2024-04-16 23:04:14.582149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.749 [2024-04-16 23:04:14.582181] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.749 qpair failed and we were unable to recover it. 00:26:23.749 [2024-04-16 23:04:14.582306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.749 [2024-04-16 23:04:14.582420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.749 [2024-04-16 23:04:14.582446] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.749 qpair failed and we were unable to recover it. 00:26:23.749 [2024-04-16 23:04:14.582562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.749 [2024-04-16 23:04:14.582677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.749 [2024-04-16 23:04:14.582702] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.749 qpair failed and we were unable to recover it. 00:26:23.749 [2024-04-16 23:04:14.582837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.749 [2024-04-16 23:04:14.582948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.749 [2024-04-16 23:04:14.582973] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.749 qpair failed and we were unable to recover it. 00:26:23.750 [2024-04-16 23:04:14.583084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.750 [2024-04-16 23:04:14.583206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.750 [2024-04-16 23:04:14.583233] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.750 qpair failed and we were unable to recover it. 00:26:23.750 [2024-04-16 23:04:14.583383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.750 [2024-04-16 23:04:14.583509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.750 [2024-04-16 23:04:14.583536] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.750 qpair failed and we were unable to recover it. 00:26:23.750 [2024-04-16 23:04:14.583656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.750 [2024-04-16 23:04:14.583767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.750 [2024-04-16 23:04:14.583791] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.750 qpair failed and we were unable to recover it. 00:26:23.750 [2024-04-16 23:04:14.583906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.750 [2024-04-16 23:04:14.584047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.750 [2024-04-16 23:04:14.584072] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.750 qpair failed and we were unable to recover it. 00:26:23.750 [2024-04-16 23:04:14.584186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.750 [2024-04-16 23:04:14.584321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.750 [2024-04-16 23:04:14.584345] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.750 qpair failed and we were unable to recover it. 00:26:23.750 [2024-04-16 23:04:14.584457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.750 [2024-04-16 23:04:14.584582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.750 [2024-04-16 23:04:14.584606] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.750 qpair failed and we were unable to recover it. 00:26:23.750 [2024-04-16 23:04:14.584721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.750 [2024-04-16 23:04:14.584878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.750 [2024-04-16 23:04:14.584903] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.750 qpair failed and we were unable to recover it. 00:26:23.750 [2024-04-16 23:04:14.585012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.750 [2024-04-16 23:04:14.585117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.750 [2024-04-16 23:04:14.585142] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.750 qpair failed and we were unable to recover it. 00:26:23.750 [2024-04-16 23:04:14.585289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.750 [2024-04-16 23:04:14.585403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.750 [2024-04-16 23:04:14.585427] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.750 qpair failed and we were unable to recover it. 00:26:23.750 [2024-04-16 23:04:14.585545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.750 [2024-04-16 23:04:14.585685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.750 [2024-04-16 23:04:14.585709] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.750 qpair failed and we were unable to recover it. 00:26:23.750 [2024-04-16 23:04:14.585844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.750 [2024-04-16 23:04:14.585952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.750 [2024-04-16 23:04:14.585976] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.750 qpair failed and we were unable to recover it. 00:26:23.750 [2024-04-16 23:04:14.586094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.750 [2024-04-16 23:04:14.586210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.750 [2024-04-16 23:04:14.586235] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.750 qpair failed and we were unable to recover it. 00:26:23.750 [2024-04-16 23:04:14.586350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.750 [2024-04-16 23:04:14.586459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.750 [2024-04-16 23:04:14.586483] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.750 qpair failed and we were unable to recover it. 00:26:23.750 [2024-04-16 23:04:14.586586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.750 [2024-04-16 23:04:14.586700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.750 [2024-04-16 23:04:14.586726] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.750 qpair failed and we were unable to recover it. 00:26:23.750 [2024-04-16 23:04:14.586844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.750 [2024-04-16 23:04:14.587015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.750 [2024-04-16 23:04:14.587041] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.750 qpair failed and we were unable to recover it. 00:26:23.750 [2024-04-16 23:04:14.587149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.750 [2024-04-16 23:04:14.587300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.750 [2024-04-16 23:04:14.587327] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.750 qpair failed and we were unable to recover it. 00:26:23.750 [2024-04-16 23:04:14.587435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.750 [2024-04-16 23:04:14.587569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.750 [2024-04-16 23:04:14.587595] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.750 qpair failed and we were unable to recover it. 00:26:23.750 [2024-04-16 23:04:14.587737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.750 [2024-04-16 23:04:14.587867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.750 [2024-04-16 23:04:14.587893] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.750 qpair failed and we were unable to recover it. 00:26:23.750 [2024-04-16 23:04:14.588017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.750 [2024-04-16 23:04:14.588154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.750 [2024-04-16 23:04:14.588186] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.750 qpair failed and we were unable to recover it. 00:26:23.750 [2024-04-16 23:04:14.588305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.750 [2024-04-16 23:04:14.588431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.750 [2024-04-16 23:04:14.588457] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.750 qpair failed and we were unable to recover it. 00:26:23.750 [2024-04-16 23:04:14.588593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.750 [2024-04-16 23:04:14.588709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.750 [2024-04-16 23:04:14.588735] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.750 qpair failed and we were unable to recover it. 00:26:23.750 [2024-04-16 23:04:14.588845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.750 [2024-04-16 23:04:14.588960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.750 [2024-04-16 23:04:14.588986] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.750 qpair failed and we were unable to recover it. 00:26:23.750 [2024-04-16 23:04:14.589126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.750 [2024-04-16 23:04:14.589270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.750 [2024-04-16 23:04:14.589295] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.750 qpair failed and we were unable to recover it. 00:26:23.750 [2024-04-16 23:04:14.589417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.750 [2024-04-16 23:04:14.589536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.750 [2024-04-16 23:04:14.589562] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.750 qpair failed and we were unable to recover it. 00:26:23.750 [2024-04-16 23:04:14.589675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.750 [2024-04-16 23:04:14.589787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.750 [2024-04-16 23:04:14.589811] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.750 qpair failed and we were unable to recover it. 00:26:23.750 [2024-04-16 23:04:14.589955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.750 [2024-04-16 23:04:14.590092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.750 [2024-04-16 23:04:14.590116] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.750 qpair failed and we were unable to recover it. 00:26:23.750 [2024-04-16 23:04:14.590266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.750 [2024-04-16 23:04:14.590417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.750 [2024-04-16 23:04:14.590442] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.750 qpair failed and we were unable to recover it. 00:26:23.750 [2024-04-16 23:04:14.590548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.750 [2024-04-16 23:04:14.590655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.750 [2024-04-16 23:04:14.590680] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.750 qpair failed and we were unable to recover it. 00:26:23.750 [2024-04-16 23:04:14.590795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.750 [2024-04-16 23:04:14.590902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.750 [2024-04-16 23:04:14.590929] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.750 qpair failed and we were unable to recover it. 00:26:23.750 [2024-04-16 23:04:14.591079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.750 [2024-04-16 23:04:14.591193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.750 [2024-04-16 23:04:14.591219] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.750 qpair failed and we were unable to recover it. 00:26:23.750 [2024-04-16 23:04:14.591325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.750 [2024-04-16 23:04:14.591469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.750 [2024-04-16 23:04:14.591495] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.750 qpair failed and we were unable to recover it. 00:26:23.750 [2024-04-16 23:04:14.591634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.750 [2024-04-16 23:04:14.591770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.750 [2024-04-16 23:04:14.591796] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.750 qpair failed and we were unable to recover it. 00:26:23.750 [2024-04-16 23:04:14.591906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.750 [2024-04-16 23:04:14.592032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.750 [2024-04-16 23:04:14.592056] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.750 qpair failed and we were unable to recover it. 00:26:23.750 [2024-04-16 23:04:14.592179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.750 [2024-04-16 23:04:14.592285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.750 [2024-04-16 23:04:14.592309] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.750 qpair failed and we were unable to recover it. 00:26:23.750 [2024-04-16 23:04:14.592457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.750 [2024-04-16 23:04:14.592566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.750 [2024-04-16 23:04:14.592590] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.750 qpair failed and we were unable to recover it. 00:26:23.750 [2024-04-16 23:04:14.592728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.750 [2024-04-16 23:04:14.592876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.750 [2024-04-16 23:04:14.592901] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.750 qpair failed and we were unable to recover it. 00:26:23.750 [2024-04-16 23:04:14.593034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.750 [2024-04-16 23:04:14.593204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.750 [2024-04-16 23:04:14.593231] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.750 qpair failed and we were unable to recover it. 00:26:23.750 [2024-04-16 23:04:14.593350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.750 [2024-04-16 23:04:14.593461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.750 [2024-04-16 23:04:14.593486] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.750 qpair failed and we were unable to recover it. 00:26:23.750 [2024-04-16 23:04:14.593590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.750 [2024-04-16 23:04:14.593759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.750 [2024-04-16 23:04:14.593784] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.750 qpair failed and we were unable to recover it. 00:26:23.750 [2024-04-16 23:04:14.593890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.750 [2024-04-16 23:04:14.594019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.750 [2024-04-16 23:04:14.594050] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.750 qpair failed and we were unable to recover it. 00:26:23.750 [2024-04-16 23:04:14.594158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.750 [2024-04-16 23:04:14.594314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.750 [2024-04-16 23:04:14.594339] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.750 qpair failed and we were unable to recover it. 00:26:23.750 [2024-04-16 23:04:14.594468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.750 [2024-04-16 23:04:14.594580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.750 [2024-04-16 23:04:14.594604] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.750 qpair failed and we were unable to recover it. 00:26:23.750 [2024-04-16 23:04:14.594720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.750 [2024-04-16 23:04:14.594863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.750 [2024-04-16 23:04:14.594888] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.750 qpair failed and we were unable to recover it. 00:26:23.750 [2024-04-16 23:04:14.594999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.750 [2024-04-16 23:04:14.595138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.750 [2024-04-16 23:04:14.595163] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.750 qpair failed and we were unable to recover it. 00:26:23.750 [2024-04-16 23:04:14.595307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.750 [2024-04-16 23:04:14.595453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.750 [2024-04-16 23:04:14.595478] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.750 qpair failed and we were unable to recover it. 00:26:23.750 [2024-04-16 23:04:14.595588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.750 [2024-04-16 23:04:14.595705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.750 [2024-04-16 23:04:14.595731] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.750 qpair failed and we were unable to recover it. 00:26:23.750 [2024-04-16 23:04:14.595841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.750 [2024-04-16 23:04:14.596010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.750 [2024-04-16 23:04:14.596035] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.750 qpair failed and we were unable to recover it. 00:26:23.750 [2024-04-16 23:04:14.596139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.750 [2024-04-16 23:04:14.596253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.750 [2024-04-16 23:04:14.596280] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.750 qpair failed and we were unable to recover it. 00:26:23.750 [2024-04-16 23:04:14.596408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.750 [2024-04-16 23:04:14.596576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.750 [2024-04-16 23:04:14.596600] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.750 qpair failed and we were unable to recover it. 00:26:23.750 [2024-04-16 23:04:14.596709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.750 [2024-04-16 23:04:14.596819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.750 [2024-04-16 23:04:14.596843] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.750 qpair failed and we were unable to recover it. 00:26:23.750 [2024-04-16 23:04:14.596954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.750 [2024-04-16 23:04:14.597061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.750 [2024-04-16 23:04:14.597085] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.750 qpair failed and we were unable to recover it. 00:26:23.750 [2024-04-16 23:04:14.597242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.750 [2024-04-16 23:04:14.597376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.750 [2024-04-16 23:04:14.597401] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.750 qpair failed and we were unable to recover it. 00:26:23.750 [2024-04-16 23:04:14.597517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.750 [2024-04-16 23:04:14.597639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.750 [2024-04-16 23:04:14.597665] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.750 qpair failed and we were unable to recover it. 00:26:23.750 [2024-04-16 23:04:14.597802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.751 [2024-04-16 23:04:14.597948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.751 [2024-04-16 23:04:14.597973] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.751 qpair failed and we were unable to recover it. 00:26:23.751 [2024-04-16 23:04:14.598085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.751 [2024-04-16 23:04:14.598224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.751 [2024-04-16 23:04:14.598250] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.751 qpair failed and we were unable to recover it. 00:26:23.751 [2024-04-16 23:04:14.598389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.751 [2024-04-16 23:04:14.598503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.751 [2024-04-16 23:04:14.598527] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.751 qpair failed and we were unable to recover it. 00:26:23.751 [2024-04-16 23:04:14.598633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.751 [2024-04-16 23:04:14.598784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.751 [2024-04-16 23:04:14.598809] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.751 qpair failed and we were unable to recover it. 00:26:23.751 [2024-04-16 23:04:14.598930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.751 [2024-04-16 23:04:14.599042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.751 [2024-04-16 23:04:14.599066] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.751 qpair failed and we were unable to recover it. 00:26:23.751 [2024-04-16 23:04:14.599179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.751 [2024-04-16 23:04:14.599299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.751 [2024-04-16 23:04:14.599324] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.751 qpair failed and we were unable to recover it. 00:26:23.751 [2024-04-16 23:04:14.599437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.751 [2024-04-16 23:04:14.599567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.751 [2024-04-16 23:04:14.599592] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.751 qpair failed and we were unable to recover it. 00:26:23.751 [2024-04-16 23:04:14.599703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.751 [2024-04-16 23:04:14.599818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.751 [2024-04-16 23:04:14.599845] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.751 qpair failed and we were unable to recover it. 00:26:23.751 [2024-04-16 23:04:14.599979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.751 [2024-04-16 23:04:14.600118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.751 [2024-04-16 23:04:14.600143] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.751 qpair failed and we were unable to recover it. 00:26:23.751 [2024-04-16 23:04:14.600262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.751 [2024-04-16 23:04:14.600391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.751 [2024-04-16 23:04:14.600418] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.751 qpair failed and we were unable to recover it. 00:26:23.751 [2024-04-16 23:04:14.600531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.751 [2024-04-16 23:04:14.600656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.751 [2024-04-16 23:04:14.600681] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.751 qpair failed and we were unable to recover it. 00:26:23.751 [2024-04-16 23:04:14.600793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.751 [2024-04-16 23:04:14.600900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.751 [2024-04-16 23:04:14.600924] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.751 qpair failed and we were unable to recover it. 00:26:23.751 [2024-04-16 23:04:14.601038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.751 [2024-04-16 23:04:14.601142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.751 [2024-04-16 23:04:14.601167] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.751 qpair failed and we were unable to recover it. 00:26:23.751 [2024-04-16 23:04:14.601282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.751 [2024-04-16 23:04:14.601391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.751 [2024-04-16 23:04:14.601416] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.751 qpair failed and we were unable to recover it. 00:26:23.751 [2024-04-16 23:04:14.601529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.751 [2024-04-16 23:04:14.601643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.751 [2024-04-16 23:04:14.601667] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.751 qpair failed and we were unable to recover it. 00:26:23.751 [2024-04-16 23:04:14.601805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.751 [2024-04-16 23:04:14.601941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.751 [2024-04-16 23:04:14.601965] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.751 qpair failed and we were unable to recover it. 00:26:23.751 [2024-04-16 23:04:14.602072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.751 [2024-04-16 23:04:14.602195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.751 [2024-04-16 23:04:14.602224] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.751 qpair failed and we were unable to recover it. 00:26:23.751 [2024-04-16 23:04:14.602338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.751 [2024-04-16 23:04:14.602456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.751 [2024-04-16 23:04:14.602481] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.751 qpair failed and we were unable to recover it. 00:26:23.751 [2024-04-16 23:04:14.602592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.751 [2024-04-16 23:04:14.602738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.751 [2024-04-16 23:04:14.602763] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.751 qpair failed and we were unable to recover it. 00:26:23.751 [2024-04-16 23:04:14.602897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.751 [2024-04-16 23:04:14.603002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.751 [2024-04-16 23:04:14.603026] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.751 qpair failed and we were unable to recover it. 00:26:23.751 [2024-04-16 23:04:14.603182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.751 [2024-04-16 23:04:14.603302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.751 [2024-04-16 23:04:14.603327] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.751 qpair failed and we were unable to recover it. 00:26:23.751 [2024-04-16 23:04:14.603446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.751 [2024-04-16 23:04:14.603563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.751 [2024-04-16 23:04:14.603588] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.751 qpair failed and we were unable to recover it. 00:26:23.751 [2024-04-16 23:04:14.603707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.751 [2024-04-16 23:04:14.603813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.751 [2024-04-16 23:04:14.603837] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.751 qpair failed and we were unable to recover it. 00:26:23.751 [2024-04-16 23:04:14.603955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.751 [2024-04-16 23:04:14.604067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.751 [2024-04-16 23:04:14.604092] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.751 qpair failed and we were unable to recover it. 00:26:23.751 [2024-04-16 23:04:14.604209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.751 [2024-04-16 23:04:14.604324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.751 [2024-04-16 23:04:14.604348] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.751 qpair failed and we were unable to recover it. 00:26:23.751 [2024-04-16 23:04:14.604469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.751 [2024-04-16 23:04:14.604591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.751 [2024-04-16 23:04:14.604616] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.751 qpair failed and we were unable to recover it. 00:26:23.751 [2024-04-16 23:04:14.604720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.751 [2024-04-16 23:04:14.604862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.751 [2024-04-16 23:04:14.604887] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.751 qpair failed and we were unable to recover it. 00:26:23.751 [2024-04-16 23:04:14.605027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.751 [2024-04-16 23:04:14.605141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.751 [2024-04-16 23:04:14.605167] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.751 qpair failed and we were unable to recover it. 00:26:23.751 [2024-04-16 23:04:14.605284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.751 [2024-04-16 23:04:14.605400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.751 [2024-04-16 23:04:14.605426] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.751 qpair failed and we were unable to recover it. 00:26:23.751 [2024-04-16 23:04:14.605530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.751 [2024-04-16 23:04:14.605669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.751 [2024-04-16 23:04:14.605695] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.751 qpair failed and we were unable to recover it. 00:26:23.751 [2024-04-16 23:04:14.605828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.751 [2024-04-16 23:04:14.605940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.751 [2024-04-16 23:04:14.605966] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.751 qpair failed and we were unable to recover it. 00:26:23.751 [2024-04-16 23:04:14.606104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.751 [2024-04-16 23:04:14.606220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.751 [2024-04-16 23:04:14.606246] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.751 qpair failed and we were unable to recover it. 00:26:23.751 [2024-04-16 23:04:14.606366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.751 [2024-04-16 23:04:14.606494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.751 [2024-04-16 23:04:14.606519] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.751 qpair failed and we were unable to recover it. 00:26:23.751 [2024-04-16 23:04:14.606636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.751 [2024-04-16 23:04:14.606763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.751 [2024-04-16 23:04:14.606788] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.751 qpair failed and we were unable to recover it. 00:26:23.751 [2024-04-16 23:04:14.606914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.751 [2024-04-16 23:04:14.607059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.751 [2024-04-16 23:04:14.607084] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.751 qpair failed and we were unable to recover it. 00:26:23.751 [2024-04-16 23:04:14.607205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.751 [2024-04-16 23:04:14.607322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.751 [2024-04-16 23:04:14.607347] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.751 qpair failed and we were unable to recover it. 00:26:23.751 [2024-04-16 23:04:14.607471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.751 [2024-04-16 23:04:14.607585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.751 [2024-04-16 23:04:14.607610] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.751 qpair failed and we were unable to recover it. 00:26:23.751 [2024-04-16 23:04:14.607728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.751 [2024-04-16 23:04:14.607868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.751 [2024-04-16 23:04:14.607893] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.751 qpair failed and we were unable to recover it. 00:26:23.751 [2024-04-16 23:04:14.608009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.751 [2024-04-16 23:04:14.608135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.751 [2024-04-16 23:04:14.608160] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.751 qpair failed and we were unable to recover it. 00:26:23.751 [2024-04-16 23:04:14.608289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.751 [2024-04-16 23:04:14.608431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.751 [2024-04-16 23:04:14.608456] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.751 qpair failed and we were unable to recover it. 00:26:23.751 [2024-04-16 23:04:14.608573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.751 [2024-04-16 23:04:14.608679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.751 [2024-04-16 23:04:14.608704] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.751 qpair failed and we were unable to recover it. 00:26:23.751 [2024-04-16 23:04:14.608820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.751 [2024-04-16 23:04:14.608963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.751 [2024-04-16 23:04:14.608988] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.751 qpair failed and we were unable to recover it. 00:26:23.751 [2024-04-16 23:04:14.609120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.751 [2024-04-16 23:04:14.609225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.751 [2024-04-16 23:04:14.609251] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.751 qpair failed and we were unable to recover it. 00:26:23.751 [2024-04-16 23:04:14.609369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.751 [2024-04-16 23:04:14.609483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.751 [2024-04-16 23:04:14.609510] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.751 qpair failed and we were unable to recover it. 00:26:23.751 [2024-04-16 23:04:14.609626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.751 [2024-04-16 23:04:14.609766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.751 [2024-04-16 23:04:14.609791] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.751 qpair failed and we were unable to recover it. 00:26:23.751 [2024-04-16 23:04:14.609909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.751 [2024-04-16 23:04:14.610079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.751 [2024-04-16 23:04:14.610104] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.751 qpair failed and we were unable to recover it. 00:26:23.751 [2024-04-16 23:04:14.610253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.751 [2024-04-16 23:04:14.610372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.751 [2024-04-16 23:04:14.610397] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.751 qpair failed and we were unable to recover it. 00:26:23.751 [2024-04-16 23:04:14.610541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.751 [2024-04-16 23:04:14.610655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.751 [2024-04-16 23:04:14.610680] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.751 qpair failed and we were unable to recover it. 00:26:23.751 [2024-04-16 23:04:14.610837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.751 [2024-04-16 23:04:14.610939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.751 [2024-04-16 23:04:14.610968] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.751 qpair failed and we were unable to recover it. 00:26:23.751 [2024-04-16 23:04:14.611082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.751 [2024-04-16 23:04:14.611197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.751 [2024-04-16 23:04:14.611223] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.751 qpair failed and we were unable to recover it. 00:26:23.751 [2024-04-16 23:04:14.611369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.751 [2024-04-16 23:04:14.611484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.751 [2024-04-16 23:04:14.611509] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.751 qpair failed and we were unable to recover it. 00:26:23.751 [2024-04-16 23:04:14.611651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.751 [2024-04-16 23:04:14.611800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.751 [2024-04-16 23:04:14.611826] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.751 qpair failed and we were unable to recover it. 00:26:23.751 [2024-04-16 23:04:14.611951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.751 [2024-04-16 23:04:14.612090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.751 [2024-04-16 23:04:14.612115] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.751 qpair failed and we were unable to recover it. 00:26:23.751 [2024-04-16 23:04:14.612225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.751 [2024-04-16 23:04:14.612366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.752 [2024-04-16 23:04:14.612391] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.752 qpair failed and we were unable to recover it. 00:26:23.752 [2024-04-16 23:04:14.612503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.752 [2024-04-16 23:04:14.612642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.752 [2024-04-16 23:04:14.612667] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.752 qpair failed and we were unable to recover it. 00:26:23.752 [2024-04-16 23:04:14.612784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.752 [2024-04-16 23:04:14.612922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.752 [2024-04-16 23:04:14.612948] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.752 qpair failed and we were unable to recover it. 00:26:23.752 [2024-04-16 23:04:14.613054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.752 [2024-04-16 23:04:14.613211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.752 [2024-04-16 23:04:14.613238] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.752 qpair failed and we were unable to recover it. 00:26:23.752 [2024-04-16 23:04:14.613344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.752 [2024-04-16 23:04:14.613458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.752 [2024-04-16 23:04:14.613484] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.752 qpair failed and we were unable to recover it. 00:26:23.752 [2024-04-16 23:04:14.613595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.752 [2024-04-16 23:04:14.613707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.752 [2024-04-16 23:04:14.613737] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.752 qpair failed and we were unable to recover it. 00:26:23.752 [2024-04-16 23:04:14.613855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.752 [2024-04-16 23:04:14.614024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.752 [2024-04-16 23:04:14.614049] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.752 qpair failed and we were unable to recover it. 00:26:23.752 [2024-04-16 23:04:14.614163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.752 [2024-04-16 23:04:14.614291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.752 [2024-04-16 23:04:14.614316] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.752 qpair failed and we were unable to recover it. 00:26:23.752 [2024-04-16 23:04:14.614439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.752 [2024-04-16 23:04:14.614556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.752 [2024-04-16 23:04:14.614581] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.752 qpair failed and we were unable to recover it. 00:26:23.752 [2024-04-16 23:04:14.614728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.752 [2024-04-16 23:04:14.614877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.752 [2024-04-16 23:04:14.614903] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.752 qpair failed and we were unable to recover it. 00:26:23.752 [2024-04-16 23:04:14.615014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.752 [2024-04-16 23:04:14.615131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.752 [2024-04-16 23:04:14.615156] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.752 qpair failed and we were unable to recover it. 00:26:23.752 [2024-04-16 23:04:14.615313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.752 [2024-04-16 23:04:14.615426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.752 [2024-04-16 23:04:14.615452] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.752 qpair failed and we were unable to recover it. 00:26:23.752 [2024-04-16 23:04:14.615591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.752 [2024-04-16 23:04:14.615697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.752 [2024-04-16 23:04:14.615722] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.752 qpair failed and we were unable to recover it. 00:26:23.752 [2024-04-16 23:04:14.615832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.752 [2024-04-16 23:04:14.615946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.752 [2024-04-16 23:04:14.615973] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.752 qpair failed and we were unable to recover it. 00:26:23.752 [2024-04-16 23:04:14.616116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.752 [2024-04-16 23:04:14.616232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.752 [2024-04-16 23:04:14.616259] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.752 qpair failed and we were unable to recover it. 00:26:23.752 [2024-04-16 23:04:14.616405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.752 [2024-04-16 23:04:14.616518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.752 [2024-04-16 23:04:14.616548] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.752 qpair failed and we were unable to recover it. 00:26:23.752 [2024-04-16 23:04:14.616717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.752 [2024-04-16 23:04:14.616867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.752 [2024-04-16 23:04:14.616891] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.752 qpair failed and we were unable to recover it. 00:26:23.752 [2024-04-16 23:04:14.617002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.752 [2024-04-16 23:04:14.617123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.752 [2024-04-16 23:04:14.617148] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.752 qpair failed and we were unable to recover it. 00:26:23.752 [2024-04-16 23:04:14.617270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.752 [2024-04-16 23:04:14.617411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.752 [2024-04-16 23:04:14.617437] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.752 qpair failed and we were unable to recover it. 00:26:23.752 [2024-04-16 23:04:14.617551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.752 [2024-04-16 23:04:14.617665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.752 [2024-04-16 23:04:14.617691] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.752 qpair failed and we were unable to recover it. 00:26:23.752 [2024-04-16 23:04:14.617839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.752 [2024-04-16 23:04:14.617952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.752 [2024-04-16 23:04:14.617979] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.752 qpair failed and we were unable to recover it. 00:26:23.752 [2024-04-16 23:04:14.618117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.752 [2024-04-16 23:04:14.618271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.752 [2024-04-16 23:04:14.618298] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.752 qpair failed and we were unable to recover it. 00:26:23.752 [2024-04-16 23:04:14.618440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.752 [2024-04-16 23:04:14.618586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.752 [2024-04-16 23:04:14.618612] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.752 qpair failed and we were unable to recover it. 00:26:23.752 [2024-04-16 23:04:14.618722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.752 [2024-04-16 23:04:14.618833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.752 [2024-04-16 23:04:14.618859] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.752 qpair failed and we were unable to recover it. 00:26:23.752 [2024-04-16 23:04:14.618980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.752 [2024-04-16 23:04:14.619092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.752 [2024-04-16 23:04:14.619117] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.752 qpair failed and we were unable to recover it. 00:26:23.752 [2024-04-16 23:04:14.619256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.752 [2024-04-16 23:04:14.619376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.752 [2024-04-16 23:04:14.619406] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.752 qpair failed and we were unable to recover it. 00:26:23.752 [2024-04-16 23:04:14.619574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.752 [2024-04-16 23:04:14.619689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.752 [2024-04-16 23:04:14.619715] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.752 qpair failed and we were unable to recover it. 00:26:23.752 [2024-04-16 23:04:14.619828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.752 [2024-04-16 23:04:14.619970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.752 [2024-04-16 23:04:14.619995] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.752 qpair failed and we were unable to recover it. 00:26:23.752 [2024-04-16 23:04:14.620107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.752 [2024-04-16 23:04:14.620229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.752 [2024-04-16 23:04:14.620255] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.752 qpair failed and we were unable to recover it. 00:26:23.752 [2024-04-16 23:04:14.620373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.752 [2024-04-16 23:04:14.620493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.752 [2024-04-16 23:04:14.620518] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.752 qpair failed and we were unable to recover it. 00:26:23.752 [2024-04-16 23:04:14.620668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.752 [2024-04-16 23:04:14.620787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.752 [2024-04-16 23:04:14.620813] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.752 qpair failed and we were unable to recover it. 00:26:23.752 [2024-04-16 23:04:14.620957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.752 [2024-04-16 23:04:14.621072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.752 [2024-04-16 23:04:14.621098] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.752 qpair failed and we were unable to recover it. 00:26:23.752 [2024-04-16 23:04:14.621220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.752 [2024-04-16 23:04:14.621359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.752 [2024-04-16 23:04:14.621384] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.752 qpair failed and we were unable to recover it. 00:26:23.752 [2024-04-16 23:04:14.621496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.752 [2024-04-16 23:04:14.621614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.752 [2024-04-16 23:04:14.621641] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.752 qpair failed and we were unable to recover it. 00:26:23.752 [2024-04-16 23:04:14.621750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.752 [2024-04-16 23:04:14.621885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.752 [2024-04-16 23:04:14.621910] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.752 qpair failed and we were unable to recover it. 00:26:23.752 [2024-04-16 23:04:14.622052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.752 [2024-04-16 23:04:14.622187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.752 [2024-04-16 23:04:14.622214] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.752 qpair failed and we were unable to recover it. 00:26:23.752 [2024-04-16 23:04:14.622343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.752 [2024-04-16 23:04:14.622454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.752 [2024-04-16 23:04:14.622479] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.752 qpair failed and we were unable to recover it. 00:26:23.752 [2024-04-16 23:04:14.622599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.752 [2024-04-16 23:04:14.622714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.752 [2024-04-16 23:04:14.622739] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.752 qpair failed and we were unable to recover it. 00:26:23.752 [2024-04-16 23:04:14.622849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.752 [2024-04-16 23:04:14.622968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.752 [2024-04-16 23:04:14.622992] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.752 qpair failed and we were unable to recover it. 00:26:23.752 [2024-04-16 23:04:14.623110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.752 [2024-04-16 23:04:14.623226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.752 [2024-04-16 23:04:14.623252] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.752 qpair failed and we were unable to recover it. 00:26:23.752 [2024-04-16 23:04:14.623374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.752 [2024-04-16 23:04:14.623524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.752 [2024-04-16 23:04:14.623548] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.752 qpair failed and we were unable to recover it. 00:26:23.752 [2024-04-16 23:04:14.623669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.752 [2024-04-16 23:04:14.623808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.752 [2024-04-16 23:04:14.623832] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.752 qpair failed and we were unable to recover it. 00:26:23.752 [2024-04-16 23:04:14.624017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.752 [2024-04-16 23:04:14.624156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.752 [2024-04-16 23:04:14.624186] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.752 qpair failed and we were unable to recover it. 00:26:23.752 [2024-04-16 23:04:14.624308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.752 [2024-04-16 23:04:14.624426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.752 [2024-04-16 23:04:14.624452] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.752 qpair failed and we were unable to recover it. 00:26:23.752 [2024-04-16 23:04:14.624595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.752 [2024-04-16 23:04:14.624702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.752 [2024-04-16 23:04:14.624727] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.752 qpair failed and we were unable to recover it. 00:26:23.752 [2024-04-16 23:04:14.624835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.752 [2024-04-16 23:04:14.624979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.752 [2024-04-16 23:04:14.625003] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.752 qpair failed and we were unable to recover it. 00:26:23.752 [2024-04-16 23:04:14.625169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.752 [2024-04-16 23:04:14.625289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.752 [2024-04-16 23:04:14.625314] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.752 qpair failed and we were unable to recover it. 00:26:23.753 [2024-04-16 23:04:14.625458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.753 [2024-04-16 23:04:14.625579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.753 [2024-04-16 23:04:14.625606] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.753 qpair failed and we were unable to recover it. 00:26:23.753 [2024-04-16 23:04:14.625746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.753 [2024-04-16 23:04:14.625861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.753 [2024-04-16 23:04:14.625886] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.753 qpair failed and we were unable to recover it. 00:26:23.753 [2024-04-16 23:04:14.626000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.753 [2024-04-16 23:04:14.626108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.753 [2024-04-16 23:04:14.626132] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.753 qpair failed and we were unable to recover it. 00:26:23.753 [2024-04-16 23:04:14.626275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.753 [2024-04-16 23:04:14.626391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.753 [2024-04-16 23:04:14.626416] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.753 qpair failed and we were unable to recover it. 00:26:23.753 [2024-04-16 23:04:14.626543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.753 [2024-04-16 23:04:14.626684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.753 [2024-04-16 23:04:14.626708] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.753 qpair failed and we were unable to recover it. 00:26:23.753 [2024-04-16 23:04:14.626828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.753 [2024-04-16 23:04:14.626951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.753 [2024-04-16 23:04:14.626976] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.753 qpair failed and we were unable to recover it. 00:26:23.753 [2024-04-16 23:04:14.627088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.753 [2024-04-16 23:04:14.627262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.753 [2024-04-16 23:04:14.627288] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.753 qpair failed and we were unable to recover it. 00:26:23.753 [2024-04-16 23:04:14.627403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.753 [2024-04-16 23:04:14.627539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.753 [2024-04-16 23:04:14.627564] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.753 qpair failed and we were unable to recover it. 00:26:23.753 [2024-04-16 23:04:14.627668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.753 [2024-04-16 23:04:14.627789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.753 [2024-04-16 23:04:14.627814] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.753 qpair failed and we were unable to recover it. 00:26:23.753 [2024-04-16 23:04:14.627931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.753 [2024-04-16 23:04:14.628066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.753 [2024-04-16 23:04:14.628091] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.753 qpair failed and we were unable to recover it. 00:26:23.753 [2024-04-16 23:04:14.628202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.753 [2024-04-16 23:04:14.628324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.753 [2024-04-16 23:04:14.628349] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.753 qpair failed and we were unable to recover it. 00:26:23.753 [2024-04-16 23:04:14.628469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.753 [2024-04-16 23:04:14.628585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.753 [2024-04-16 23:04:14.628611] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.753 qpair failed and we were unable to recover it. 00:26:23.753 [2024-04-16 23:04:14.628728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.753 [2024-04-16 23:04:14.628871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.753 [2024-04-16 23:04:14.628897] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.753 qpair failed and we were unable to recover it. 00:26:23.753 [2024-04-16 23:04:14.629033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.753 [2024-04-16 23:04:14.629182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.753 [2024-04-16 23:04:14.629208] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.753 qpair failed and we were unable to recover it. 00:26:23.753 [2024-04-16 23:04:14.629338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.753 [2024-04-16 23:04:14.629452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.753 [2024-04-16 23:04:14.629476] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.753 qpair failed and we were unable to recover it. 00:26:23.753 [2024-04-16 23:04:14.629610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.753 [2024-04-16 23:04:14.629750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.753 [2024-04-16 23:04:14.629774] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.753 qpair failed and we were unable to recover it. 00:26:23.753 [2024-04-16 23:04:14.629888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.753 [2024-04-16 23:04:14.630000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.753 [2024-04-16 23:04:14.630024] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.753 qpair failed and we were unable to recover it. 00:26:23.753 [2024-04-16 23:04:14.630146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.753 [2024-04-16 23:04:14.630259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.753 [2024-04-16 23:04:14.630284] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.753 qpair failed and we were unable to recover it. 00:26:23.753 [2024-04-16 23:04:14.630393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.753 [2024-04-16 23:04:14.630535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.753 [2024-04-16 23:04:14.630560] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.753 qpair failed and we were unable to recover it. 00:26:23.753 [2024-04-16 23:04:14.630709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.753 [2024-04-16 23:04:14.630823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.753 [2024-04-16 23:04:14.630848] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.753 qpair failed and we were unable to recover it. 00:26:23.753 [2024-04-16 23:04:14.630959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.753 [2024-04-16 23:04:14.631064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.753 [2024-04-16 23:04:14.631089] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.753 qpair failed and we were unable to recover it. 00:26:23.753 [2024-04-16 23:04:14.631196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.753 [2024-04-16 23:04:14.631332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.753 [2024-04-16 23:04:14.631358] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.753 qpair failed and we were unable to recover it. 00:26:23.753 [2024-04-16 23:04:14.631472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.753 [2024-04-16 23:04:14.631605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.753 [2024-04-16 23:04:14.631629] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.753 qpair failed and we were unable to recover it. 00:26:23.753 [2024-04-16 23:04:14.631737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.753 [2024-04-16 23:04:14.631873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.753 [2024-04-16 23:04:14.631898] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.753 qpair failed and we were unable to recover it. 00:26:23.753 [2024-04-16 23:04:14.632051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.753 [2024-04-16 23:04:14.632159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.753 [2024-04-16 23:04:14.632191] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.753 qpair failed and we were unable to recover it. 00:26:23.753 [2024-04-16 23:04:14.632336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.753 [2024-04-16 23:04:14.632478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.753 [2024-04-16 23:04:14.632503] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.753 qpair failed and we were unable to recover it. 00:26:23.753 [2024-04-16 23:04:14.632633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.753 [2024-04-16 23:04:14.632739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.753 [2024-04-16 23:04:14.632765] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.753 qpair failed and we were unable to recover it. 00:26:23.753 [2024-04-16 23:04:14.632873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.753 [2024-04-16 23:04:14.632994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.753 [2024-04-16 23:04:14.633020] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.753 qpair failed and we were unable to recover it. 00:26:23.753 [2024-04-16 23:04:14.633156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.753 [2024-04-16 23:04:14.633267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.753 [2024-04-16 23:04:14.633293] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.753 qpair failed and we were unable to recover it. 00:26:23.753 [2024-04-16 23:04:14.633406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.753 [2024-04-16 23:04:14.633537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.753 [2024-04-16 23:04:14.633563] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.753 qpair failed and we were unable to recover it. 00:26:23.753 [2024-04-16 23:04:14.633676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.753 [2024-04-16 23:04:14.633809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.753 [2024-04-16 23:04:14.633835] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.753 qpair failed and we were unable to recover it. 00:26:23.753 [2024-04-16 23:04:14.633980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.753 [2024-04-16 23:04:14.634096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.753 [2024-04-16 23:04:14.634122] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.753 qpair failed and we were unable to recover it. 00:26:23.753 [2024-04-16 23:04:14.634236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.753 [2024-04-16 23:04:14.634357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.753 [2024-04-16 23:04:14.634382] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.753 qpair failed and we were unable to recover it. 00:26:23.753 [2024-04-16 23:04:14.634503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.753 [2024-04-16 23:04:14.634611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.753 [2024-04-16 23:04:14.634636] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.753 qpair failed and we were unable to recover it. 00:26:23.753 [2024-04-16 23:04:14.634752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.753 [2024-04-16 23:04:14.634870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.753 [2024-04-16 23:04:14.634894] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.753 qpair failed and we were unable to recover it. 00:26:23.753 [2024-04-16 23:04:14.635001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.753 [2024-04-16 23:04:14.635110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.753 [2024-04-16 23:04:14.635135] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.753 qpair failed and we were unable to recover it. 00:26:23.753 [2024-04-16 23:04:14.635266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.753 [2024-04-16 23:04:14.635405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.753 [2024-04-16 23:04:14.635429] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.753 qpair failed and we were unable to recover it. 00:26:23.753 [2024-04-16 23:04:14.635532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.753 [2024-04-16 23:04:14.635646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.753 [2024-04-16 23:04:14.635670] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.753 qpair failed and we were unable to recover it. 00:26:23.753 [2024-04-16 23:04:14.635783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.753 [2024-04-16 23:04:14.635899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.753 [2024-04-16 23:04:14.635924] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.753 qpair failed and we were unable to recover it. 00:26:23.753 [2024-04-16 23:04:14.636040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.753 [2024-04-16 23:04:14.636144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.753 [2024-04-16 23:04:14.636170] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.753 qpair failed and we were unable to recover it. 00:26:23.753 [2024-04-16 23:04:14.636285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.753 [2024-04-16 23:04:14.636411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.753 [2024-04-16 23:04:14.636436] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.753 qpair failed and we were unable to recover it. 00:26:23.753 [2024-04-16 23:04:14.636546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.753 [2024-04-16 23:04:14.636680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.753 [2024-04-16 23:04:14.636704] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.753 qpair failed and we were unable to recover it. 00:26:23.753 [2024-04-16 23:04:14.636816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.753 [2024-04-16 23:04:14.636924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.753 [2024-04-16 23:04:14.636950] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.753 qpair failed and we were unable to recover it. 00:26:23.753 [2024-04-16 23:04:14.637066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.753 [2024-04-16 23:04:14.637179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.753 [2024-04-16 23:04:14.637207] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.753 qpair failed and we were unable to recover it. 00:26:23.753 [2024-04-16 23:04:14.637324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.753 [2024-04-16 23:04:14.637467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.753 [2024-04-16 23:04:14.637492] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.753 qpair failed and we were unable to recover it. 00:26:23.753 [2024-04-16 23:04:14.637625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.753 [2024-04-16 23:04:14.637740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.753 [2024-04-16 23:04:14.637765] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.753 qpair failed and we were unable to recover it. 00:26:23.753 [2024-04-16 23:04:14.637890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.753 [2024-04-16 23:04:14.638002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.753 [2024-04-16 23:04:14.638028] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.753 qpair failed and we were unable to recover it. 00:26:23.753 [2024-04-16 23:04:14.638139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.753 [2024-04-16 23:04:14.638262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.753 [2024-04-16 23:04:14.638287] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.753 qpair failed and we were unable to recover it. 00:26:23.753 [2024-04-16 23:04:14.638418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.753 [2024-04-16 23:04:14.638524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.753 [2024-04-16 23:04:14.638549] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.753 qpair failed and we were unable to recover it. 00:26:23.753 [2024-04-16 23:04:14.638665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.753 [2024-04-16 23:04:14.638769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.753 [2024-04-16 23:04:14.638794] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.753 qpair failed and we were unable to recover it. 00:26:23.753 [2024-04-16 23:04:14.638906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.753 [2024-04-16 23:04:14.639016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.753 [2024-04-16 23:04:14.639041] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.753 qpair failed and we were unable to recover it. 00:26:23.753 [2024-04-16 23:04:14.639148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.753 [2024-04-16 23:04:14.639274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.753 [2024-04-16 23:04:14.639299] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.753 qpair failed and we were unable to recover it. 00:26:23.753 [2024-04-16 23:04:14.639414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.753 [2024-04-16 23:04:14.639550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.753 [2024-04-16 23:04:14.639574] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.753 qpair failed and we were unable to recover it. 00:26:23.754 [2024-04-16 23:04:14.639690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.754 [2024-04-16 23:04:14.639796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.754 [2024-04-16 23:04:14.639821] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.754 qpair failed and we were unable to recover it. 00:26:23.754 [2024-04-16 23:04:14.639973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.754 [2024-04-16 23:04:14.640088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.754 [2024-04-16 23:04:14.640112] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.754 qpair failed and we were unable to recover it. 00:26:23.754 [2024-04-16 23:04:14.640256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.754 [2024-04-16 23:04:14.640393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.754 [2024-04-16 23:04:14.640418] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.754 qpair failed and we were unable to recover it. 00:26:23.754 [2024-04-16 23:04:14.640529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.754 [2024-04-16 23:04:14.640641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.754 [2024-04-16 23:04:14.640666] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.754 qpair failed and we were unable to recover it. 00:26:23.754 [2024-04-16 23:04:14.640774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.754 [2024-04-16 23:04:14.640908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.754 [2024-04-16 23:04:14.640934] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.754 qpair failed and we were unable to recover it. 00:26:23.754 [2024-04-16 23:04:14.641048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.754 [2024-04-16 23:04:14.641158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.754 [2024-04-16 23:04:14.641189] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.754 qpair failed and we were unable to recover it. 00:26:23.754 [2024-04-16 23:04:14.641335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.754 [2024-04-16 23:04:14.641451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.754 [2024-04-16 23:04:14.641476] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.754 qpair failed and we were unable to recover it. 00:26:23.754 [2024-04-16 23:04:14.641591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.754 [2024-04-16 23:04:14.641713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.754 [2024-04-16 23:04:14.641738] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.754 qpair failed and we were unable to recover it. 00:26:23.754 [2024-04-16 23:04:14.641857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.754 [2024-04-16 23:04:14.641965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.754 [2024-04-16 23:04:14.641990] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.754 qpair failed and we were unable to recover it. 00:26:23.754 [2024-04-16 23:04:14.642106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.754 [2024-04-16 23:04:14.642221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.754 [2024-04-16 23:04:14.642247] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.754 qpair failed and we were unable to recover it. 00:26:23.754 [2024-04-16 23:04:14.642353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.754 [2024-04-16 23:04:14.642465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.754 [2024-04-16 23:04:14.642490] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.754 qpair failed and we were unable to recover it. 00:26:23.754 [2024-04-16 23:04:14.642601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.754 [2024-04-16 23:04:14.642722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.754 [2024-04-16 23:04:14.642748] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.754 qpair failed and we were unable to recover it. 00:26:23.754 [2024-04-16 23:04:14.642854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.754 [2024-04-16 23:04:14.642993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.754 [2024-04-16 23:04:14.643019] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.754 qpair failed and we were unable to recover it. 00:26:23.754 [2024-04-16 23:04:14.643123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.754 [2024-04-16 23:04:14.643240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.754 [2024-04-16 23:04:14.643265] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.754 qpair failed and we were unable to recover it. 00:26:23.754 [2024-04-16 23:04:14.643382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.754 [2024-04-16 23:04:14.643492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.754 [2024-04-16 23:04:14.643517] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.754 qpair failed and we were unable to recover it. 00:26:23.754 [2024-04-16 23:04:14.643659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.754 [2024-04-16 23:04:14.643773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.754 [2024-04-16 23:04:14.643799] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.754 qpair failed and we were unable to recover it. 00:26:23.754 [2024-04-16 23:04:14.643911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.754 [2024-04-16 23:04:14.644029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.754 [2024-04-16 23:04:14.644054] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.754 qpair failed and we were unable to recover it. 00:26:23.754 [2024-04-16 23:04:14.644171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.754 [2024-04-16 23:04:14.644298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.754 [2024-04-16 23:04:14.644323] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.754 qpair failed and we were unable to recover it. 00:26:23.754 [2024-04-16 23:04:14.644430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.754 [2024-04-16 23:04:14.644571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.754 [2024-04-16 23:04:14.644596] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.754 qpair failed and we were unable to recover it. 00:26:23.754 [2024-04-16 23:04:14.644706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.754 [2024-04-16 23:04:14.644821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.754 [2024-04-16 23:04:14.644848] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.754 qpair failed and we were unable to recover it. 00:26:23.754 [2024-04-16 23:04:14.644957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.754 [2024-04-16 23:04:14.645099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.754 [2024-04-16 23:04:14.645125] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.754 qpair failed and we were unable to recover it. 00:26:23.754 [2024-04-16 23:04:14.645263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.754 [2024-04-16 23:04:14.645392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.754 [2024-04-16 23:04:14.645419] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.754 qpair failed and we were unable to recover it. 00:26:23.754 [2024-04-16 23:04:14.645534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.754 [2024-04-16 23:04:14.645680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.754 [2024-04-16 23:04:14.645707] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.754 qpair failed and we were unable to recover it. 00:26:23.754 [2024-04-16 23:04:14.645824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.754 [2024-04-16 23:04:14.645937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.754 [2024-04-16 23:04:14.645963] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.754 qpair failed and we were unable to recover it. 00:26:23.754 [2024-04-16 23:04:14.646084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.754 [2024-04-16 23:04:14.646204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.754 [2024-04-16 23:04:14.646231] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.754 qpair failed and we were unable to recover it. 00:26:23.754 [2024-04-16 23:04:14.646336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.754 [2024-04-16 23:04:14.646447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.754 [2024-04-16 23:04:14.646473] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.754 qpair failed and we were unable to recover it. 00:26:23.754 [2024-04-16 23:04:14.646616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.754 [2024-04-16 23:04:14.646757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.754 [2024-04-16 23:04:14.646783] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.754 qpair failed and we were unable to recover it. 00:26:23.754 [2024-04-16 23:04:14.646917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.754 [2024-04-16 23:04:14.647036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.754 [2024-04-16 23:04:14.647063] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.754 qpair failed and we were unable to recover it. 00:26:23.754 [2024-04-16 23:04:14.647208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.754 [2024-04-16 23:04:14.647362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.754 [2024-04-16 23:04:14.647387] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.754 qpair failed and we were unable to recover it. 00:26:23.754 [2024-04-16 23:04:14.647500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.754 [2024-04-16 23:04:14.647617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.754 [2024-04-16 23:04:14.647643] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.754 qpair failed and we were unable to recover it. 00:26:23.754 [2024-04-16 23:04:14.647757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.754 [2024-04-16 23:04:14.647872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.754 [2024-04-16 23:04:14.647898] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.754 qpair failed and we were unable to recover it. 00:26:23.754 [2024-04-16 23:04:14.648065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.754 [2024-04-16 23:04:14.648203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.754 [2024-04-16 23:04:14.648230] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.754 qpair failed and we were unable to recover it. 00:26:23.754 [2024-04-16 23:04:14.648354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.754 [2024-04-16 23:04:14.648469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.754 [2024-04-16 23:04:14.648495] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.754 qpair failed and we were unable to recover it. 00:26:23.754 [2024-04-16 23:04:14.648601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.754 [2024-04-16 23:04:14.648711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.754 [2024-04-16 23:04:14.648737] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.754 qpair failed and we were unable to recover it. 00:26:23.754 [2024-04-16 23:04:14.648892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.754 [2024-04-16 23:04:14.649007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.754 [2024-04-16 23:04:14.649034] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.754 qpair failed and we were unable to recover it. 00:26:23.754 [2024-04-16 23:04:14.649155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.754 [2024-04-16 23:04:14.649273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.754 [2024-04-16 23:04:14.649299] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.754 qpair failed and we were unable to recover it. 00:26:23.754 [2024-04-16 23:04:14.649436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.754 [2024-04-16 23:04:14.649566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.754 [2024-04-16 23:04:14.649592] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.754 qpair failed and we were unable to recover it. 00:26:23.754 [2024-04-16 23:04:14.649704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.754 [2024-04-16 23:04:14.649821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.754 [2024-04-16 23:04:14.649847] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.754 qpair failed and we were unable to recover it. 00:26:23.754 [2024-04-16 23:04:14.649957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.754 [2024-04-16 23:04:14.650092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.754 [2024-04-16 23:04:14.650117] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.754 qpair failed and we were unable to recover it. 00:26:23.754 [2024-04-16 23:04:14.650233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.754 [2024-04-16 23:04:14.650349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.754 [2024-04-16 23:04:14.650376] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.754 qpair failed and we were unable to recover it. 00:26:23.754 [2024-04-16 23:04:14.650488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.754 [2024-04-16 23:04:14.650623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.754 [2024-04-16 23:04:14.650648] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.754 qpair failed and we were unable to recover it. 00:26:23.754 [2024-04-16 23:04:14.650793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.754 [2024-04-16 23:04:14.650905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.754 [2024-04-16 23:04:14.650931] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.754 qpair failed and we were unable to recover it. 00:26:23.754 [2024-04-16 23:04:14.651091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.754 [2024-04-16 23:04:14.651199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.754 [2024-04-16 23:04:14.651235] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.754 qpair failed and we were unable to recover it. 00:26:23.754 [2024-04-16 23:04:14.651377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.754 [2024-04-16 23:04:14.651489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.754 [2024-04-16 23:04:14.651515] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.755 qpair failed and we were unable to recover it. 00:26:23.755 [2024-04-16 23:04:14.651624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.755 [2024-04-16 23:04:14.651727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.755 [2024-04-16 23:04:14.651752] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.755 qpair failed and we were unable to recover it. 00:26:23.755 [2024-04-16 23:04:14.651894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.755 [2024-04-16 23:04:14.652008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.755 [2024-04-16 23:04:14.652034] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.755 qpair failed and we were unable to recover it. 00:26:23.755 [2024-04-16 23:04:14.652154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.755 [2024-04-16 23:04:14.652306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.755 [2024-04-16 23:04:14.652333] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.755 qpair failed and we were unable to recover it. 00:26:23.755 [2024-04-16 23:04:14.652449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.755 [2024-04-16 23:04:14.652565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.755 [2024-04-16 23:04:14.652590] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.755 qpair failed and we were unable to recover it. 00:26:23.755 [2024-04-16 23:04:14.652701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.755 [2024-04-16 23:04:14.652845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.755 [2024-04-16 23:04:14.652871] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.755 qpair failed and we were unable to recover it. 00:26:23.755 [2024-04-16 23:04:14.653011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.755 [2024-04-16 23:04:14.653120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.755 [2024-04-16 23:04:14.653146] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.755 qpair failed and we were unable to recover it. 00:26:23.755 [2024-04-16 23:04:14.653268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.755 [2024-04-16 23:04:14.653380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.755 [2024-04-16 23:04:14.653406] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.755 qpair failed and we were unable to recover it. 00:26:23.755 [2024-04-16 23:04:14.653530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.755 [2024-04-16 23:04:14.653643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.755 [2024-04-16 23:04:14.653669] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.755 qpair failed and we were unable to recover it. 00:26:23.755 [2024-04-16 23:04:14.653790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.755 [2024-04-16 23:04:14.653906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.755 [2024-04-16 23:04:14.653932] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.755 qpair failed and we were unable to recover it. 00:26:23.755 [2024-04-16 23:04:14.654075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.755 [2024-04-16 23:04:14.654191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.755 [2024-04-16 23:04:14.654218] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.755 qpair failed and we were unable to recover it. 00:26:23.755 [2024-04-16 23:04:14.654330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.755 [2024-04-16 23:04:14.654448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.755 [2024-04-16 23:04:14.654475] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.755 qpair failed and we were unable to recover it. 00:26:23.755 [2024-04-16 23:04:14.654595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.755 [2024-04-16 23:04:14.654772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.755 [2024-04-16 23:04:14.654798] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.755 qpair failed and we were unable to recover it. 00:26:23.755 [2024-04-16 23:04:14.654916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.755 [2024-04-16 23:04:14.655025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.755 [2024-04-16 23:04:14.655053] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.755 qpair failed and we were unable to recover it. 00:26:23.755 [2024-04-16 23:04:14.655179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.755 [2024-04-16 23:04:14.655296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.755 [2024-04-16 23:04:14.655322] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.755 qpair failed and we were unable to recover it. 00:26:23.755 [2024-04-16 23:04:14.655486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.755 [2024-04-16 23:04:14.655592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.755 [2024-04-16 23:04:14.655617] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.755 qpair failed and we were unable to recover it. 00:26:23.755 [2024-04-16 23:04:14.655734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.755 [2024-04-16 23:04:14.655842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.755 [2024-04-16 23:04:14.655868] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.755 qpair failed and we were unable to recover it. 00:26:23.755 [2024-04-16 23:04:14.655993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.755 [2024-04-16 23:04:14.656103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.755 [2024-04-16 23:04:14.656127] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.755 qpair failed and we were unable to recover it. 00:26:23.755 [2024-04-16 23:04:14.656261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.755 [2024-04-16 23:04:14.656405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.755 [2024-04-16 23:04:14.656430] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.755 qpair failed and we were unable to recover it. 00:26:23.755 [2024-04-16 23:04:14.656548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.755 [2024-04-16 23:04:14.656665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.755 [2024-04-16 23:04:14.656691] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.755 qpair failed and we were unable to recover it. 00:26:23.755 [2024-04-16 23:04:14.656807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.755 [2024-04-16 23:04:14.656974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.755 [2024-04-16 23:04:14.656999] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.755 qpair failed and we were unable to recover it. 00:26:23.755 [2024-04-16 23:04:14.657114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.755 [2024-04-16 23:04:14.657227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.755 [2024-04-16 23:04:14.657254] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.755 qpair failed and we were unable to recover it. 00:26:23.755 [2024-04-16 23:04:14.657371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.755 [2024-04-16 23:04:14.657482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.755 [2024-04-16 23:04:14.657508] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.755 qpair failed and we were unable to recover it. 00:26:23.755 [2024-04-16 23:04:14.657628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.755 [2024-04-16 23:04:14.657765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.755 [2024-04-16 23:04:14.657793] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.755 qpair failed and we were unable to recover it. 00:26:23.755 [2024-04-16 23:04:14.657909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.755 [2024-04-16 23:04:14.658048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.755 [2024-04-16 23:04:14.658073] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.755 qpair failed and we were unable to recover it. 00:26:23.755 [2024-04-16 23:04:14.658189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.755 [2024-04-16 23:04:14.658312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.755 [2024-04-16 23:04:14.658337] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.755 qpair failed and we were unable to recover it. 00:26:23.755 [2024-04-16 23:04:14.658475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.755 [2024-04-16 23:04:14.658613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.755 [2024-04-16 23:04:14.658638] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.755 qpair failed and we were unable to recover it. 00:26:23.755 [2024-04-16 23:04:14.658752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.755 [2024-04-16 23:04:14.658884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.755 [2024-04-16 23:04:14.658910] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.755 qpair failed and we were unable to recover it. 00:26:23.755 [2024-04-16 23:04:14.659023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.755 [2024-04-16 23:04:14.659138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.755 [2024-04-16 23:04:14.659164] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.755 qpair failed and we were unable to recover it. 00:26:23.755 [2024-04-16 23:04:14.659291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.755 [2024-04-16 23:04:14.659437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.755 [2024-04-16 23:04:14.659462] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.755 qpair failed and we were unable to recover it. 00:26:23.755 [2024-04-16 23:04:14.659575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.755 [2024-04-16 23:04:14.659743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.755 [2024-04-16 23:04:14.659769] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.755 qpair failed and we were unable to recover it. 00:26:23.755 [2024-04-16 23:04:14.659886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.755 [2024-04-16 23:04:14.660025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.755 [2024-04-16 23:04:14.660049] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.755 qpair failed and we were unable to recover it. 00:26:23.755 [2024-04-16 23:04:14.660167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.755 [2024-04-16 23:04:14.660291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.755 [2024-04-16 23:04:14.660317] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.755 qpair failed and we were unable to recover it. 00:26:23.755 [2024-04-16 23:04:14.660460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.755 [2024-04-16 23:04:14.660575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.755 [2024-04-16 23:04:14.660604] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.755 qpair failed and we were unable to recover it. 00:26:23.755 [2024-04-16 23:04:14.660746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.755 [2024-04-16 23:04:14.660855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.755 [2024-04-16 23:04:14.660879] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.755 qpair failed and we were unable to recover it. 00:26:23.755 [2024-04-16 23:04:14.660988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.755 [2024-04-16 23:04:14.661135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.755 [2024-04-16 23:04:14.661161] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.755 qpair failed and we were unable to recover it. 00:26:23.755 [2024-04-16 23:04:14.661335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.755 [2024-04-16 23:04:14.661449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.755 [2024-04-16 23:04:14.661474] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.755 qpair failed and we were unable to recover it. 00:26:23.755 [2024-04-16 23:04:14.661585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.755 [2024-04-16 23:04:14.661702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.755 [2024-04-16 23:04:14.661729] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.755 qpair failed and we were unable to recover it. 00:26:23.755 [2024-04-16 23:04:14.661845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.755 [2024-04-16 23:04:14.661983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.755 [2024-04-16 23:04:14.662008] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.755 qpair failed and we were unable to recover it. 00:26:23.755 [2024-04-16 23:04:14.662149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.755 [2024-04-16 23:04:14.662310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.755 [2024-04-16 23:04:14.662335] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.755 qpair failed and we were unable to recover it. 00:26:23.755 [2024-04-16 23:04:14.662456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.755 [2024-04-16 23:04:14.662613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.755 [2024-04-16 23:04:14.662638] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.755 qpair failed and we were unable to recover it. 00:26:23.755 [2024-04-16 23:04:14.662751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.755 [2024-04-16 23:04:14.662861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.755 [2024-04-16 23:04:14.662886] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.755 qpair failed and we were unable to recover it. 00:26:23.755 [2024-04-16 23:04:14.663020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.755 [2024-04-16 23:04:14.663137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.755 [2024-04-16 23:04:14.663163] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.755 qpair failed and we were unable to recover it. 00:26:23.755 [2024-04-16 23:04:14.663287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.755 [2024-04-16 23:04:14.663426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.755 [2024-04-16 23:04:14.663454] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.755 qpair failed and we were unable to recover it. 00:26:23.755 [2024-04-16 23:04:14.663596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.755 [2024-04-16 23:04:14.663739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.755 [2024-04-16 23:04:14.663765] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.755 qpair failed and we were unable to recover it. 00:26:23.755 [2024-04-16 23:04:14.663880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.755 [2024-04-16 23:04:14.663992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.755 [2024-04-16 23:04:14.664017] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.755 qpair failed and we were unable to recover it. 00:26:23.755 [2024-04-16 23:04:14.664140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.755 [2024-04-16 23:04:14.664250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.755 [2024-04-16 23:04:14.664276] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.755 qpair failed and we were unable to recover it. 00:26:23.755 [2024-04-16 23:04:14.664399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.755 [2024-04-16 23:04:14.664506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.756 [2024-04-16 23:04:14.664531] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.756 qpair failed and we were unable to recover it. 00:26:23.756 [2024-04-16 23:04:14.664645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.756 [2024-04-16 23:04:14.664769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.756 [2024-04-16 23:04:14.664794] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.756 qpair failed and we were unable to recover it. 00:26:23.756 [2024-04-16 23:04:14.664914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.756 [2024-04-16 23:04:14.665027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.756 [2024-04-16 23:04:14.665053] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.756 qpair failed and we were unable to recover it. 00:26:23.756 [2024-04-16 23:04:14.665158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.756 [2024-04-16 23:04:14.665291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.756 [2024-04-16 23:04:14.665317] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.756 qpair failed and we were unable to recover it. 00:26:23.756 [2024-04-16 23:04:14.665431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.756 [2024-04-16 23:04:14.665535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.756 [2024-04-16 23:04:14.665560] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.756 qpair failed and we were unable to recover it. 00:26:23.756 [2024-04-16 23:04:14.665708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.756 [2024-04-16 23:04:14.665843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.756 [2024-04-16 23:04:14.665868] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.756 qpair failed and we were unable to recover it. 00:26:23.756 [2024-04-16 23:04:14.665988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.756 [2024-04-16 23:04:14.666100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.756 [2024-04-16 23:04:14.666126] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.756 qpair failed and we were unable to recover it. 00:26:23.756 [2024-04-16 23:04:14.666255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.756 [2024-04-16 23:04:14.666364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.756 [2024-04-16 23:04:14.666389] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.756 qpair failed and we were unable to recover it. 00:26:23.756 [2024-04-16 23:04:14.666495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.756 [2024-04-16 23:04:14.666633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.756 [2024-04-16 23:04:14.666659] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.756 qpair failed and we were unable to recover it. 00:26:23.756 [2024-04-16 23:04:14.666773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.756 [2024-04-16 23:04:14.666927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.756 [2024-04-16 23:04:14.666954] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.756 qpair failed and we were unable to recover it. 00:26:23.756 [2024-04-16 23:04:14.667067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.756 [2024-04-16 23:04:14.667207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.756 [2024-04-16 23:04:14.667232] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.756 qpair failed and we were unable to recover it. 00:26:23.756 [2024-04-16 23:04:14.667350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.756 [2024-04-16 23:04:14.667472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.756 [2024-04-16 23:04:14.667497] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.756 qpair failed and we were unable to recover it. 00:26:23.756 [2024-04-16 23:04:14.667629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.756 [2024-04-16 23:04:14.667742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.756 [2024-04-16 23:04:14.667767] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.756 qpair failed and we were unable to recover it. 00:26:23.756 [2024-04-16 23:04:14.667891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.756 [2024-04-16 23:04:14.668003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.756 [2024-04-16 23:04:14.668028] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.756 qpair failed and we were unable to recover it. 00:26:23.756 [2024-04-16 23:04:14.668143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.756 [2024-04-16 23:04:14.668281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.756 [2024-04-16 23:04:14.668307] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.756 qpair failed and we were unable to recover it. 00:26:23.756 [2024-04-16 23:04:14.668418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.756 [2024-04-16 23:04:14.668537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.756 [2024-04-16 23:04:14.668561] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.756 qpair failed and we were unable to recover it. 00:26:23.756 [2024-04-16 23:04:14.668677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.756 [2024-04-16 23:04:14.668789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.756 [2024-04-16 23:04:14.668814] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.756 qpair failed and we were unable to recover it. 00:26:23.756 [2024-04-16 23:04:14.668959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.756 [2024-04-16 23:04:14.669085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.756 [2024-04-16 23:04:14.669109] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.756 qpair failed and we were unable to recover it. 00:26:23.756 [2024-04-16 23:04:14.669245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.756 [2024-04-16 23:04:14.669358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.756 [2024-04-16 23:04:14.669383] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.756 qpair failed and we were unable to recover it. 00:26:23.756 [2024-04-16 23:04:14.669498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.756 [2024-04-16 23:04:14.669615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.756 [2024-04-16 23:04:14.669640] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.756 qpair failed and we were unable to recover it. 00:26:23.756 [2024-04-16 23:04:14.669759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.756 [2024-04-16 23:04:14.669873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.756 [2024-04-16 23:04:14.669899] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.756 qpair failed and we were unable to recover it. 00:26:23.756 [2024-04-16 23:04:14.670010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.756 [2024-04-16 23:04:14.670125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.756 [2024-04-16 23:04:14.670150] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.756 qpair failed and we were unable to recover it. 00:26:23.756 [2024-04-16 23:04:14.670291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.756 [2024-04-16 23:04:14.670405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.756 [2024-04-16 23:04:14.670431] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.756 qpair failed and we were unable to recover it. 00:26:23.756 [2024-04-16 23:04:14.670565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.756 [2024-04-16 23:04:14.670702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.756 [2024-04-16 23:04:14.670729] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.756 qpair failed and we were unable to recover it. 00:26:23.756 [2024-04-16 23:04:14.670842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.756 [2024-04-16 23:04:14.670986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.756 [2024-04-16 23:04:14.671010] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.756 qpair failed and we were unable to recover it. 00:26:23.756 [2024-04-16 23:04:14.671115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.756 [2024-04-16 23:04:14.671236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.756 [2024-04-16 23:04:14.671261] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.756 qpair failed and we were unable to recover it. 00:26:23.756 [2024-04-16 23:04:14.671375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.756 [2024-04-16 23:04:14.671489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.756 [2024-04-16 23:04:14.671514] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.756 qpair failed and we were unable to recover it. 00:26:23.756 [2024-04-16 23:04:14.671624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.756 [2024-04-16 23:04:14.671755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.756 [2024-04-16 23:04:14.671779] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.756 qpair failed and we were unable to recover it. 00:26:23.756 [2024-04-16 23:04:14.671914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.756 [2024-04-16 23:04:14.672049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.756 [2024-04-16 23:04:14.672073] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.756 qpair failed and we were unable to recover it. 00:26:23.756 [2024-04-16 23:04:14.672206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.756 [2024-04-16 23:04:14.672324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.756 [2024-04-16 23:04:14.672351] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.756 qpair failed and we were unable to recover it. 00:26:23.756 [2024-04-16 23:04:14.672483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.756 [2024-04-16 23:04:14.672633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.756 [2024-04-16 23:04:14.672659] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.756 qpair failed and we were unable to recover it. 00:26:23.756 [2024-04-16 23:04:14.672768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.756 [2024-04-16 23:04:14.672879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.756 [2024-04-16 23:04:14.672903] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.756 qpair failed and we were unable to recover it. 00:26:23.756 [2024-04-16 23:04:14.673017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.756 [2024-04-16 23:04:14.673152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.756 [2024-04-16 23:04:14.673183] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.756 qpair failed and we were unable to recover it. 00:26:23.756 [2024-04-16 23:04:14.673290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.756 [2024-04-16 23:04:14.673406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.756 [2024-04-16 23:04:14.673430] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.756 qpair failed and we were unable to recover it. 00:26:23.756 [2024-04-16 23:04:14.673538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.756 [2024-04-16 23:04:14.673646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.756 [2024-04-16 23:04:14.673672] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.756 qpair failed and we were unable to recover it. 00:26:23.756 [2024-04-16 23:04:14.673789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.756 [2024-04-16 23:04:14.673909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.756 [2024-04-16 23:04:14.673934] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.756 qpair failed and we were unable to recover it. 00:26:23.756 [2024-04-16 23:04:14.674048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.756 [2024-04-16 23:04:14.674199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.756 [2024-04-16 23:04:14.674224] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.756 qpair failed and we were unable to recover it. 00:26:23.756 [2024-04-16 23:04:14.674340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.756 [2024-04-16 23:04:14.674472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.756 [2024-04-16 23:04:14.674497] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.756 qpair failed and we were unable to recover it. 00:26:23.756 [2024-04-16 23:04:14.674612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.756 [2024-04-16 23:04:14.674750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.756 [2024-04-16 23:04:14.674775] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.756 qpair failed and we were unable to recover it. 00:26:23.756 [2024-04-16 23:04:14.674882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.756 [2024-04-16 23:04:14.674996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.756 [2024-04-16 23:04:14.675021] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.756 qpair failed and we were unable to recover it. 00:26:23.756 [2024-04-16 23:04:14.675141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.756 [2024-04-16 23:04:14.675260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.756 [2024-04-16 23:04:14.675286] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.756 qpair failed and we were unable to recover it. 00:26:23.756 [2024-04-16 23:04:14.675429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.756 [2024-04-16 23:04:14.675566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.756 [2024-04-16 23:04:14.675591] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.756 qpair failed and we were unable to recover it. 00:26:23.756 [2024-04-16 23:04:14.675706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.756 [2024-04-16 23:04:14.675825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.756 [2024-04-16 23:04:14.675850] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.756 qpair failed and we were unable to recover it. 00:26:23.756 [2024-04-16 23:04:14.675955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.756 [2024-04-16 23:04:14.676064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.756 [2024-04-16 23:04:14.676091] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.756 qpair failed and we were unable to recover it. 00:26:23.756 [2024-04-16 23:04:14.676268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.756 [2024-04-16 23:04:14.676384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.756 [2024-04-16 23:04:14.676411] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.756 qpair failed and we were unable to recover it. 00:26:23.756 [2024-04-16 23:04:14.676533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.756 [2024-04-16 23:04:14.676646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.756 [2024-04-16 23:04:14.676672] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.756 qpair failed and we were unable to recover it. 00:26:23.756 [2024-04-16 23:04:14.676801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.756 [2024-04-16 23:04:14.676946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.756 [2024-04-16 23:04:14.676972] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.756 qpair failed and we were unable to recover it. 00:26:23.756 [2024-04-16 23:04:14.677090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.756 [2024-04-16 23:04:14.677200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.756 [2024-04-16 23:04:14.677225] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.756 qpair failed and we were unable to recover it. 00:26:23.756 [2024-04-16 23:04:14.677369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.756 [2024-04-16 23:04:14.677568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.756 [2024-04-16 23:04:14.677594] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.756 qpair failed and we were unable to recover it. 00:26:23.756 [2024-04-16 23:04:14.677706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.757 [2024-04-16 23:04:14.677827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.757 [2024-04-16 23:04:14.677852] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.757 qpair failed and we were unable to recover it. 00:26:23.757 [2024-04-16 23:04:14.678001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.757 [2024-04-16 23:04:14.678121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.757 [2024-04-16 23:04:14.678146] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.757 qpair failed and we were unable to recover it. 00:26:23.757 [2024-04-16 23:04:14.678260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.757 [2024-04-16 23:04:14.678401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.757 [2024-04-16 23:04:14.678425] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.757 qpair failed and we were unable to recover it. 00:26:23.757 [2024-04-16 23:04:14.678568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.757 [2024-04-16 23:04:14.678705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.757 [2024-04-16 23:04:14.678729] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.757 qpair failed and we were unable to recover it. 00:26:23.757 [2024-04-16 23:04:14.678836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.757 [2024-04-16 23:04:14.678984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.757 [2024-04-16 23:04:14.679009] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.757 qpair failed and we were unable to recover it. 00:26:23.757 [2024-04-16 23:04:14.679123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.757 [2024-04-16 23:04:14.679263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.757 [2024-04-16 23:04:14.679289] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.757 qpair failed and we were unable to recover it. 00:26:23.757 [2024-04-16 23:04:14.679398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.757 [2024-04-16 23:04:14.679504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.757 [2024-04-16 23:04:14.679530] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.757 qpair failed and we were unable to recover it. 00:26:23.757 [2024-04-16 23:04:14.679662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.757 [2024-04-16 23:04:14.679800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.757 [2024-04-16 23:04:14.679825] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.757 qpair failed and we were unable to recover it. 00:26:23.757 [2024-04-16 23:04:14.679948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.757 [2024-04-16 23:04:14.680056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.757 [2024-04-16 23:04:14.680082] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.757 qpair failed and we were unable to recover it. 00:26:23.757 [2024-04-16 23:04:14.680206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.757 [2024-04-16 23:04:14.680358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.757 [2024-04-16 23:04:14.680383] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.757 qpair failed and we were unable to recover it. 00:26:23.757 [2024-04-16 23:04:14.680489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.757 [2024-04-16 23:04:14.680627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.757 [2024-04-16 23:04:14.680652] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.757 qpair failed and we were unable to recover it. 00:26:23.757 [2024-04-16 23:04:14.680767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.757 [2024-04-16 23:04:14.680871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.757 [2024-04-16 23:04:14.680896] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.757 qpair failed and we were unable to recover it. 00:26:23.757 [2024-04-16 23:04:14.681007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.757 [2024-04-16 23:04:14.681150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.757 [2024-04-16 23:04:14.681180] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.757 qpair failed and we were unable to recover it. 00:26:23.757 [2024-04-16 23:04:14.681318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.757 [2024-04-16 23:04:14.681450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.757 [2024-04-16 23:04:14.681476] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.757 qpair failed and we were unable to recover it. 00:26:23.757 [2024-04-16 23:04:14.681611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.757 [2024-04-16 23:04:14.681718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.757 [2024-04-16 23:04:14.681743] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.757 qpair failed and we were unable to recover it. 00:26:23.757 [2024-04-16 23:04:14.681846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.757 [2024-04-16 23:04:14.681978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.757 [2024-04-16 23:04:14.682003] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.757 qpair failed and we were unable to recover it. 00:26:23.757 [2024-04-16 23:04:14.682113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.757 [2024-04-16 23:04:14.682224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.757 [2024-04-16 23:04:14.682250] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.757 qpair failed and we were unable to recover it. 00:26:23.757 [2024-04-16 23:04:14.682368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.757 [2024-04-16 23:04:14.682480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.757 [2024-04-16 23:04:14.682506] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.757 qpair failed and we were unable to recover it. 00:26:23.757 [2024-04-16 23:04:14.682657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.757 [2024-04-16 23:04:14.682763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.757 [2024-04-16 23:04:14.682788] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.757 qpair failed and we were unable to recover it. 00:26:23.757 [2024-04-16 23:04:14.682894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.757 [2024-04-16 23:04:14.683041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.757 [2024-04-16 23:04:14.683066] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.757 qpair failed and we were unable to recover it. 00:26:23.757 [2024-04-16 23:04:14.683185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.757 [2024-04-16 23:04:14.683301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.757 [2024-04-16 23:04:14.683327] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.757 qpair failed and we were unable to recover it. 00:26:23.757 [2024-04-16 23:04:14.683472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.757 [2024-04-16 23:04:14.683580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.757 [2024-04-16 23:04:14.683605] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.757 qpair failed and we were unable to recover it. 00:26:23.757 [2024-04-16 23:04:14.683713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.757 [2024-04-16 23:04:14.683823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.757 [2024-04-16 23:04:14.683849] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.757 qpair failed and we were unable to recover it. 00:26:23.757 [2024-04-16 23:04:14.684015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.757 [2024-04-16 23:04:14.684128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.757 [2024-04-16 23:04:14.684153] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.757 qpair failed and we were unable to recover it. 00:26:23.757 [2024-04-16 23:04:14.684280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.757 [2024-04-16 23:04:14.684392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.757 [2024-04-16 23:04:14.684418] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.757 qpair failed and we were unable to recover it. 00:26:23.757 [2024-04-16 23:04:14.684540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.757 [2024-04-16 23:04:14.684688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.757 [2024-04-16 23:04:14.684713] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.757 qpair failed and we were unable to recover it. 00:26:23.757 [2024-04-16 23:04:14.684832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.757 [2024-04-16 23:04:14.684952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.757 [2024-04-16 23:04:14.684977] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.757 qpair failed and we were unable to recover it. 00:26:23.757 [2024-04-16 23:04:14.685085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.757 [2024-04-16 23:04:14.685199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.757 [2024-04-16 23:04:14.685225] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.757 qpair failed and we were unable to recover it. 00:26:23.757 [2024-04-16 23:04:14.685345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.757 [2024-04-16 23:04:14.685459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.757 [2024-04-16 23:04:14.685483] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.757 qpair failed and we were unable to recover it. 00:26:23.757 [2024-04-16 23:04:14.685736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.757 [2024-04-16 23:04:14.685845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.757 [2024-04-16 23:04:14.685869] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.757 qpair failed and we were unable to recover it. 00:26:23.757 [2024-04-16 23:04:14.685978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.757 [2024-04-16 23:04:14.686094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.757 [2024-04-16 23:04:14.686119] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.757 qpair failed and we were unable to recover it. 00:26:23.757 [2024-04-16 23:04:14.686236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.757 [2024-04-16 23:04:14.686354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.757 [2024-04-16 23:04:14.686380] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.757 qpair failed and we were unable to recover it. 00:26:23.757 [2024-04-16 23:04:14.686488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.757 [2024-04-16 23:04:14.686600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.757 [2024-04-16 23:04:14.686627] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.757 qpair failed and we were unable to recover it. 00:26:23.757 [2024-04-16 23:04:14.686770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.757 [2024-04-16 23:04:14.686913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.757 [2024-04-16 23:04:14.686940] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.757 qpair failed and we were unable to recover it. 00:26:23.757 [2024-04-16 23:04:14.687087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.757 [2024-04-16 23:04:14.687197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.757 [2024-04-16 23:04:14.687224] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.757 qpair failed and we were unable to recover it. 00:26:23.757 [2024-04-16 23:04:14.687336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.757 [2024-04-16 23:04:14.687474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.757 [2024-04-16 23:04:14.687499] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.757 qpair failed and we were unable to recover it. 00:26:23.757 [2024-04-16 23:04:14.687611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.757 [2024-04-16 23:04:14.687736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.757 [2024-04-16 23:04:14.687762] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.757 qpair failed and we were unable to recover it. 00:26:23.757 [2024-04-16 23:04:14.687882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.757 [2024-04-16 23:04:14.688022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.757 [2024-04-16 23:04:14.688047] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.757 qpair failed and we were unable to recover it. 00:26:23.757 [2024-04-16 23:04:14.688158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.757 [2024-04-16 23:04:14.688285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.757 [2024-04-16 23:04:14.688312] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.757 qpair failed and we were unable to recover it. 00:26:23.757 [2024-04-16 23:04:14.688432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.757 [2024-04-16 23:04:14.688567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.757 [2024-04-16 23:04:14.688592] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.757 qpair failed and we were unable to recover it. 00:26:23.757 [2024-04-16 23:04:14.688736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.757 [2024-04-16 23:04:14.688844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.757 [2024-04-16 23:04:14.688871] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.757 qpair failed and we were unable to recover it. 00:26:23.757 [2024-04-16 23:04:14.688982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.757 [2024-04-16 23:04:14.689119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.757 [2024-04-16 23:04:14.689144] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.757 qpair failed and we were unable to recover it. 00:26:23.757 [2024-04-16 23:04:14.689271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.757 [2024-04-16 23:04:14.689383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.757 [2024-04-16 23:04:14.689409] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.757 qpair failed and we were unable to recover it. 00:26:23.757 [2024-04-16 23:04:14.689561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.757 [2024-04-16 23:04:14.689668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.757 [2024-04-16 23:04:14.689694] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.757 qpair failed and we were unable to recover it. 00:26:23.757 [2024-04-16 23:04:14.689808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.757 [2024-04-16 23:04:14.689945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.757 [2024-04-16 23:04:14.689971] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.757 qpair failed and we were unable to recover it. 00:26:23.757 [2024-04-16 23:04:14.690111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.757 [2024-04-16 23:04:14.690236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.757 [2024-04-16 23:04:14.690263] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.757 qpair failed and we were unable to recover it. 00:26:23.757 [2024-04-16 23:04:14.690367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.757 [2024-04-16 23:04:14.690477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.757 [2024-04-16 23:04:14.690503] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.757 qpair failed and we were unable to recover it. 00:26:23.757 [2024-04-16 23:04:14.690612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.758 [2024-04-16 23:04:14.690729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.758 [2024-04-16 23:04:14.690755] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.758 qpair failed and we were unable to recover it. 00:26:23.758 [2024-04-16 23:04:14.690902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.758 [2024-04-16 23:04:14.691019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.758 [2024-04-16 23:04:14.691046] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.758 qpair failed and we were unable to recover it. 00:26:23.758 [2024-04-16 23:04:14.691153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.758 [2024-04-16 23:04:14.691294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.758 [2024-04-16 23:04:14.691319] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.758 qpair failed and we were unable to recover it. 00:26:23.758 [2024-04-16 23:04:14.691457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.758 [2024-04-16 23:04:14.691575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.758 [2024-04-16 23:04:14.691600] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.758 qpair failed and we were unable to recover it. 00:26:23.758 [2024-04-16 23:04:14.691739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.758 [2024-04-16 23:04:14.691843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.758 [2024-04-16 23:04:14.691868] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.758 qpair failed and we were unable to recover it. 00:26:23.758 [2024-04-16 23:04:14.692011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.758 [2024-04-16 23:04:14.692157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.758 [2024-04-16 23:04:14.692188] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.758 qpair failed and we were unable to recover it. 00:26:23.758 [2024-04-16 23:04:14.692307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.758 [2024-04-16 23:04:14.692457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.758 [2024-04-16 23:04:14.692482] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.758 qpair failed and we were unable to recover it. 00:26:23.758 [2024-04-16 23:04:14.692607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.758 [2024-04-16 23:04:14.692719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.758 [2024-04-16 23:04:14.692744] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.758 qpair failed and we were unable to recover it. 00:26:23.758 [2024-04-16 23:04:14.692901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.758 [2024-04-16 23:04:14.693019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.758 [2024-04-16 23:04:14.693044] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.758 qpair failed and we were unable to recover it. 00:26:23.758 [2024-04-16 23:04:14.693151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.758 [2024-04-16 23:04:14.693299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.758 [2024-04-16 23:04:14.693324] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.758 qpair failed and we were unable to recover it. 00:26:23.758 [2024-04-16 23:04:14.693440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.758 [2024-04-16 23:04:14.693587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.758 [2024-04-16 23:04:14.693612] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.758 qpair failed and we were unable to recover it. 00:26:23.758 [2024-04-16 23:04:14.693749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.758 [2024-04-16 23:04:14.693870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.758 [2024-04-16 23:04:14.693895] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.758 qpair failed and we were unable to recover it. 00:26:23.758 [2024-04-16 23:04:14.694053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.758 [2024-04-16 23:04:14.694162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.758 [2024-04-16 23:04:14.694196] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.758 qpair failed and we were unable to recover it. 00:26:23.758 [2024-04-16 23:04:14.694336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.758 [2024-04-16 23:04:14.694453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.758 [2024-04-16 23:04:14.694478] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.758 qpair failed and we were unable to recover it. 00:26:23.758 [2024-04-16 23:04:14.694585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.758 [2024-04-16 23:04:14.694696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.758 [2024-04-16 23:04:14.694721] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.758 qpair failed and we were unable to recover it. 00:26:23.758 [2024-04-16 23:04:14.694859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.758 [2024-04-16 23:04:14.694972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.758 [2024-04-16 23:04:14.694997] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.758 qpair failed and we were unable to recover it. 00:26:23.758 [2024-04-16 23:04:14.695112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.758 [2024-04-16 23:04:14.695226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.758 [2024-04-16 23:04:14.695253] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.758 qpair failed and we were unable to recover it. 00:26:23.758 [2024-04-16 23:04:14.695372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.758 [2024-04-16 23:04:14.695486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.758 [2024-04-16 23:04:14.695511] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.758 qpair failed and we were unable to recover it. 00:26:23.758 [2024-04-16 23:04:14.695618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.758 [2024-04-16 23:04:14.695755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.758 [2024-04-16 23:04:14.695780] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.758 qpair failed and we were unable to recover it. 00:26:23.758 [2024-04-16 23:04:14.695917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.758 [2024-04-16 23:04:14.696027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.758 [2024-04-16 23:04:14.696051] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.758 qpair failed and we were unable to recover it. 00:26:23.758 [2024-04-16 23:04:14.696157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.758 [2024-04-16 23:04:14.696301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.758 [2024-04-16 23:04:14.696327] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.758 qpair failed and we were unable to recover it. 00:26:23.758 [2024-04-16 23:04:14.696435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.758 [2024-04-16 23:04:14.696573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.758 [2024-04-16 23:04:14.696603] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.758 qpair failed and we were unable to recover it. 00:26:23.758 [2024-04-16 23:04:14.696718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.758 [2024-04-16 23:04:14.696827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.758 [2024-04-16 23:04:14.696857] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.758 qpair failed and we were unable to recover it. 00:26:23.758 [2024-04-16 23:04:14.696971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.758 [2024-04-16 23:04:14.697085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.758 [2024-04-16 23:04:14.697115] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.758 qpair failed and we were unable to recover it. 00:26:23.758 [2024-04-16 23:04:14.697226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.758 [2024-04-16 23:04:14.697372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.758 [2024-04-16 23:04:14.697397] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.758 qpair failed and we were unable to recover it. 00:26:23.758 [2024-04-16 23:04:14.697533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.758 [2024-04-16 23:04:14.697651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.758 [2024-04-16 23:04:14.697676] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.758 qpair failed and we were unable to recover it. 00:26:23.758 [2024-04-16 23:04:14.697793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.758 [2024-04-16 23:04:14.697903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.758 [2024-04-16 23:04:14.697932] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.758 qpair failed and we were unable to recover it. 00:26:23.758 [2024-04-16 23:04:14.698040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.758 [2024-04-16 23:04:14.698158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.758 [2024-04-16 23:04:14.698189] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.758 qpair failed and we were unable to recover it. 00:26:23.758 [2024-04-16 23:04:14.698301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.758 [2024-04-16 23:04:14.698442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.758 [2024-04-16 23:04:14.698467] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.758 qpair failed and we were unable to recover it. 00:26:23.758 [2024-04-16 23:04:14.698617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.758 [2024-04-16 23:04:14.698763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.758 [2024-04-16 23:04:14.698789] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.758 qpair failed and we were unable to recover it. 00:26:23.758 [2024-04-16 23:04:14.698907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.758 [2024-04-16 23:04:14.699029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.758 [2024-04-16 23:04:14.699055] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.758 qpair failed and we were unable to recover it. 00:26:23.758 [2024-04-16 23:04:14.699194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.758 [2024-04-16 23:04:14.699304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.758 [2024-04-16 23:04:14.699334] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.758 qpair failed and we were unable to recover it. 00:26:23.758 [2024-04-16 23:04:14.699456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.758 [2024-04-16 23:04:14.699576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.758 [2024-04-16 23:04:14.699603] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.758 qpair failed and we were unable to recover it. 00:26:23.758 [2024-04-16 23:04:14.699716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.758 [2024-04-16 23:04:14.699854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.758 [2024-04-16 23:04:14.699880] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.758 qpair failed and we were unable to recover it. 00:26:23.758 [2024-04-16 23:04:14.699995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.758 [2024-04-16 23:04:14.700101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.758 [2024-04-16 23:04:14.700128] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.758 qpair failed and we were unable to recover it. 00:26:23.758 [2024-04-16 23:04:14.700237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.758 [2024-04-16 23:04:14.700376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.758 [2024-04-16 23:04:14.700404] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.758 qpair failed and we were unable to recover it. 00:26:23.758 [2024-04-16 23:04:14.700548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.758 [2024-04-16 23:04:14.700667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.758 [2024-04-16 23:04:14.700692] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.758 qpair failed and we were unable to recover it. 00:26:23.758 [2024-04-16 23:04:14.700834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.758 [2024-04-16 23:04:14.700946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.758 [2024-04-16 23:04:14.700972] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.758 qpair failed and we were unable to recover it. 00:26:23.758 [2024-04-16 23:04:14.701088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.758 [2024-04-16 23:04:14.701211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.758 [2024-04-16 23:04:14.701237] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.758 qpair failed and we were unable to recover it. 00:26:23.758 [2024-04-16 23:04:14.701349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.758 [2024-04-16 23:04:14.701461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.758 [2024-04-16 23:04:14.701486] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.758 qpair failed and we were unable to recover it. 00:26:23.758 [2024-04-16 23:04:14.701640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.758 [2024-04-16 23:04:14.701775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.758 [2024-04-16 23:04:14.701800] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.758 qpair failed and we were unable to recover it. 00:26:23.758 [2024-04-16 23:04:14.701910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.758 [2024-04-16 23:04:14.702057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.758 [2024-04-16 23:04:14.702091] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.758 qpair failed and we were unable to recover it. 00:26:23.758 [2024-04-16 23:04:14.702206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.758 [2024-04-16 23:04:14.702321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.758 [2024-04-16 23:04:14.702347] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.758 qpair failed and we were unable to recover it. 00:26:23.758 [2024-04-16 23:04:14.702462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.758 [2024-04-16 23:04:14.702577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.758 [2024-04-16 23:04:14.702602] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.758 qpair failed and we were unable to recover it. 00:26:23.758 [2024-04-16 23:04:14.702725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.758 [2024-04-16 23:04:14.702863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.758 [2024-04-16 23:04:14.702891] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.758 qpair failed and we were unable to recover it. 00:26:23.758 [2024-04-16 23:04:14.703021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.758 [2024-04-16 23:04:14.703132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.758 [2024-04-16 23:04:14.703156] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.758 qpair failed and we were unable to recover it. 00:26:23.758 [2024-04-16 23:04:14.703276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.758 [2024-04-16 23:04:14.703396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.758 [2024-04-16 23:04:14.703422] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.758 qpair failed and we were unable to recover it. 00:26:23.758 [2024-04-16 23:04:14.703557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.758 [2024-04-16 23:04:14.703661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.758 [2024-04-16 23:04:14.703686] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.758 qpair failed and we were unable to recover it. 00:26:23.758 [2024-04-16 23:04:14.703829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.758 [2024-04-16 23:04:14.703940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.758 [2024-04-16 23:04:14.703966] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.758 qpair failed and we were unable to recover it. 00:26:23.758 [2024-04-16 23:04:14.704069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.758 [2024-04-16 23:04:14.704203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.758 [2024-04-16 23:04:14.704229] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.758 qpair failed and we were unable to recover it. 00:26:23.758 [2024-04-16 23:04:14.704366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.758 [2024-04-16 23:04:14.704481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.758 [2024-04-16 23:04:14.704506] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.758 qpair failed and we were unable to recover it. 00:26:23.758 [2024-04-16 23:04:14.704637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.758 [2024-04-16 23:04:14.704755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.758 [2024-04-16 23:04:14.704785] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.758 qpair failed and we were unable to recover it. 00:26:23.758 [2024-04-16 23:04:14.704900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.758 [2024-04-16 23:04:14.705006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.758 [2024-04-16 23:04:14.705031] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.758 qpair failed and we were unable to recover it. 00:26:23.758 [2024-04-16 23:04:14.705148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.758 [2024-04-16 23:04:14.705264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.758 [2024-04-16 23:04:14.705290] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.758 qpair failed and we were unable to recover it. 00:26:23.758 [2024-04-16 23:04:14.705398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.758 [2024-04-16 23:04:14.705539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.759 [2024-04-16 23:04:14.705565] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.759 qpair failed and we were unable to recover it. 00:26:23.759 [2024-04-16 23:04:14.705674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.759 [2024-04-16 23:04:14.705775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.759 [2024-04-16 23:04:14.705800] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.759 qpair failed and we were unable to recover it. 00:26:23.759 [2024-04-16 23:04:14.705906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.759 [2024-04-16 23:04:14.706039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.759 [2024-04-16 23:04:14.706065] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.759 qpair failed and we were unable to recover it. 00:26:23.759 [2024-04-16 23:04:14.706182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.759 [2024-04-16 23:04:14.706296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.759 [2024-04-16 23:04:14.706321] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.759 qpair failed and we were unable to recover it. 00:26:23.759 [2024-04-16 23:04:14.706426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.759 [2024-04-16 23:04:14.706542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.759 [2024-04-16 23:04:14.706567] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.759 qpair failed and we were unable to recover it. 00:26:23.759 [2024-04-16 23:04:14.706684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.759 [2024-04-16 23:04:14.706801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.759 [2024-04-16 23:04:14.706825] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.759 qpair failed and we were unable to recover it. 00:26:23.759 [2024-04-16 23:04:14.706937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.759 [2024-04-16 23:04:14.707075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.759 [2024-04-16 23:04:14.707100] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.759 qpair failed and we were unable to recover it. 00:26:23.759 [2024-04-16 23:04:14.707214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.759 [2024-04-16 23:04:14.707334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.759 [2024-04-16 23:04:14.707359] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.759 qpair failed and we were unable to recover it. 00:26:23.759 [2024-04-16 23:04:14.707494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.759 [2024-04-16 23:04:14.707626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.759 [2024-04-16 23:04:14.707651] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.759 qpair failed and we were unable to recover it. 00:26:23.759 [2024-04-16 23:04:14.707785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.759 [2024-04-16 23:04:14.707905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.759 [2024-04-16 23:04:14.707930] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.759 qpair failed and we were unable to recover it. 00:26:23.759 [2024-04-16 23:04:14.708040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.759 [2024-04-16 23:04:14.708155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.759 [2024-04-16 23:04:14.708189] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.759 qpair failed and we were unable to recover it. 00:26:23.759 [2024-04-16 23:04:14.708310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.759 [2024-04-16 23:04:14.708424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.759 [2024-04-16 23:04:14.708449] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.759 qpair failed and we were unable to recover it. 00:26:23.759 [2024-04-16 23:04:14.708554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.759 [2024-04-16 23:04:14.708675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.759 [2024-04-16 23:04:14.708701] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.759 qpair failed and we were unable to recover it. 00:26:23.759 [2024-04-16 23:04:14.708831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.759 [2024-04-16 23:04:14.708948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.759 [2024-04-16 23:04:14.708974] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.759 qpair failed and we were unable to recover it. 00:26:23.759 [2024-04-16 23:04:14.709111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.759 [2024-04-16 23:04:14.709248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.759 [2024-04-16 23:04:14.709274] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.759 qpair failed and we were unable to recover it. 00:26:23.759 [2024-04-16 23:04:14.709386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.759 [2024-04-16 23:04:14.709511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.759 [2024-04-16 23:04:14.709536] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.759 qpair failed and we were unable to recover it. 00:26:23.759 [2024-04-16 23:04:14.709662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.759 [2024-04-16 23:04:14.709778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.759 [2024-04-16 23:04:14.709804] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.759 qpair failed and we were unable to recover it. 00:26:23.759 [2024-04-16 23:04:14.709929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.759 [2024-04-16 23:04:14.710071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.759 [2024-04-16 23:04:14.710096] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.759 qpair failed and we were unable to recover it. 00:26:23.759 [2024-04-16 23:04:14.710225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.759 [2024-04-16 23:04:14.710366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.759 [2024-04-16 23:04:14.710390] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.759 qpair failed and we were unable to recover it. 00:26:23.759 [2024-04-16 23:04:14.710504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.759 [2024-04-16 23:04:14.710667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.759 [2024-04-16 23:04:14.710692] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.759 qpair failed and we were unable to recover it. 00:26:23.759 [2024-04-16 23:04:14.710809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.759 [2024-04-16 23:04:14.710926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.759 [2024-04-16 23:04:14.710952] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.759 qpair failed and we were unable to recover it. 00:26:23.759 [2024-04-16 23:04:14.711067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.759 [2024-04-16 23:04:14.711212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.759 [2024-04-16 23:04:14.711238] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.759 qpair failed and we were unable to recover it. 00:26:23.759 [2024-04-16 23:04:14.711344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.759 [2024-04-16 23:04:14.711466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.759 [2024-04-16 23:04:14.711491] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.759 qpair failed and we were unable to recover it. 00:26:23.759 [2024-04-16 23:04:14.711603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.759 [2024-04-16 23:04:14.711725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.759 [2024-04-16 23:04:14.711750] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.759 qpair failed and we were unable to recover it. 00:26:23.759 [2024-04-16 23:04:14.711869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.759 [2024-04-16 23:04:14.712014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.759 [2024-04-16 23:04:14.712039] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.759 qpair failed and we were unable to recover it. 00:26:23.759 [2024-04-16 23:04:14.712155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.759 [2024-04-16 23:04:14.712276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.759 [2024-04-16 23:04:14.712304] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.759 qpair failed and we were unable to recover it. 00:26:23.759 [2024-04-16 23:04:14.712453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.759 [2024-04-16 23:04:14.712565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.759 [2024-04-16 23:04:14.712590] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.759 qpair failed and we were unable to recover it. 00:26:23.759 [2024-04-16 23:04:14.712705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.759 [2024-04-16 23:04:14.712812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.759 [2024-04-16 23:04:14.712837] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.759 qpair failed and we were unable to recover it. 00:26:23.759 [2024-04-16 23:04:14.712953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.759 [2024-04-16 23:04:14.713092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.759 [2024-04-16 23:04:14.713117] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.759 qpair failed and we were unable to recover it. 00:26:23.759 [2024-04-16 23:04:14.713235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.759 [2024-04-16 23:04:14.713344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.759 [2024-04-16 23:04:14.713369] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.759 qpair failed and we were unable to recover it. 00:26:23.759 [2024-04-16 23:04:14.713518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.759 [2024-04-16 23:04:14.713640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.759 [2024-04-16 23:04:14.713666] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.759 qpair failed and we were unable to recover it. 00:26:23.759 [2024-04-16 23:04:14.713817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.759 [2024-04-16 23:04:14.713935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.759 [2024-04-16 23:04:14.713960] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.759 qpair failed and we were unable to recover it. 00:26:23.759 [2024-04-16 23:04:14.714102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.759 [2024-04-16 23:04:14.714219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.759 [2024-04-16 23:04:14.714244] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.759 qpair failed and we were unable to recover it. 00:26:23.759 [2024-04-16 23:04:14.714361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.759 [2024-04-16 23:04:14.714483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.759 [2024-04-16 23:04:14.714507] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.759 qpair failed and we were unable to recover it. 00:26:23.759 [2024-04-16 23:04:14.714632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.759 [2024-04-16 23:04:14.714773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.759 [2024-04-16 23:04:14.714799] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.759 qpair failed and we were unable to recover it. 00:26:23.759 [2024-04-16 23:04:14.714918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.759 [2024-04-16 23:04:14.715035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.759 [2024-04-16 23:04:14.715060] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.759 qpair failed and we were unable to recover it. 00:26:23.759 [2024-04-16 23:04:14.715184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.759 [2024-04-16 23:04:14.715292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.759 [2024-04-16 23:04:14.715316] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.759 qpair failed and we were unable to recover it. 00:26:23.759 [2024-04-16 23:04:14.715437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.759 [2024-04-16 23:04:14.715575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.759 [2024-04-16 23:04:14.715600] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.759 qpair failed and we were unable to recover it. 00:26:23.759 [2024-04-16 23:04:14.715714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.759 [2024-04-16 23:04:14.715827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.759 [2024-04-16 23:04:14.715852] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.759 qpair failed and we were unable to recover it. 00:26:23.759 [2024-04-16 23:04:14.715966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.759 [2024-04-16 23:04:14.716079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.759 [2024-04-16 23:04:14.716105] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.759 qpair failed and we were unable to recover it. 00:26:23.759 [2024-04-16 23:04:14.716225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.759 [2024-04-16 23:04:14.716342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.759 [2024-04-16 23:04:14.716367] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.759 qpair failed and we were unable to recover it. 00:26:23.759 [2024-04-16 23:04:14.716479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.759 [2024-04-16 23:04:14.716594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.759 [2024-04-16 23:04:14.716619] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.759 qpair failed and we were unable to recover it. 00:26:23.759 [2024-04-16 23:04:14.716733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.759 [2024-04-16 23:04:14.716866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.759 [2024-04-16 23:04:14.716892] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.759 qpair failed and we were unable to recover it. 00:26:23.759 [2024-04-16 23:04:14.717009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.759 [2024-04-16 23:04:14.717116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.759 [2024-04-16 23:04:14.717140] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.759 qpair failed and we were unable to recover it. 00:26:23.759 [2024-04-16 23:04:14.717264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.759 [2024-04-16 23:04:14.717370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.759 [2024-04-16 23:04:14.717396] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.759 qpair failed and we were unable to recover it. 00:26:23.759 [2024-04-16 23:04:14.717504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.759 [2024-04-16 23:04:14.717626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.759 [2024-04-16 23:04:14.717652] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.759 qpair failed and we were unable to recover it. 00:26:23.759 [2024-04-16 23:04:14.717758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.759 [2024-04-16 23:04:14.717866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.759 [2024-04-16 23:04:14.717891] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.759 qpair failed and we were unable to recover it. 00:26:23.759 [2024-04-16 23:04:14.718025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.759 [2024-04-16 23:04:14.718168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.759 [2024-04-16 23:04:14.718201] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.759 qpair failed and we were unable to recover it. 00:26:23.759 [2024-04-16 23:04:14.718316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.759 [2024-04-16 23:04:14.718429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.759 [2024-04-16 23:04:14.718455] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.759 qpair failed and we were unable to recover it. 00:26:23.759 [2024-04-16 23:04:14.718569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.759 [2024-04-16 23:04:14.718685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.759 [2024-04-16 23:04:14.718710] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.759 qpair failed and we were unable to recover it. 00:26:23.759 [2024-04-16 23:04:14.718827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.759 [2024-04-16 23:04:14.718970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.759 [2024-04-16 23:04:14.718995] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.759 qpair failed and we were unable to recover it. 00:26:23.759 [2024-04-16 23:04:14.719112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.759 [2024-04-16 23:04:14.719222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.760 [2024-04-16 23:04:14.719249] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.760 qpair failed and we were unable to recover it. 00:26:23.760 [2024-04-16 23:04:14.719366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.760 [2024-04-16 23:04:14.719501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.760 [2024-04-16 23:04:14.719526] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.760 qpair failed and we were unable to recover it. 00:26:23.760 [2024-04-16 23:04:14.719665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.760 [2024-04-16 23:04:14.719774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.760 [2024-04-16 23:04:14.719799] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.760 qpair failed and we were unable to recover it. 00:26:23.760 [2024-04-16 23:04:14.719919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.760 [2024-04-16 23:04:14.720036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.760 [2024-04-16 23:04:14.720061] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.760 qpair failed and we were unable to recover it. 00:26:23.760 [2024-04-16 23:04:14.720183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.760 [2024-04-16 23:04:14.720314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.760 [2024-04-16 23:04:14.720338] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.760 qpair failed and we were unable to recover it. 00:26:23.760 [2024-04-16 23:04:14.720454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.760 [2024-04-16 23:04:14.720564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.760 [2024-04-16 23:04:14.720590] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.760 qpair failed and we were unable to recover it. 00:26:23.760 [2024-04-16 23:04:14.720703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.760 [2024-04-16 23:04:14.720853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.760 [2024-04-16 23:04:14.720878] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.760 qpair failed and we were unable to recover it. 00:26:23.760 [2024-04-16 23:04:14.720997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.760 [2024-04-16 23:04:14.721108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.760 [2024-04-16 23:04:14.721133] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.760 qpair failed and we were unable to recover it. 00:26:23.760 [2024-04-16 23:04:14.721264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.760 [2024-04-16 23:04:14.721378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.760 [2024-04-16 23:04:14.721403] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.760 qpair failed and we were unable to recover it. 00:26:23.760 [2024-04-16 23:04:14.721520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.760 [2024-04-16 23:04:14.721644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.760 [2024-04-16 23:04:14.721669] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.760 qpair failed and we were unable to recover it. 00:26:23.760 [2024-04-16 23:04:14.721784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.760 [2024-04-16 23:04:14.721905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.760 [2024-04-16 23:04:14.721930] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.760 qpair failed and we were unable to recover it. 00:26:23.760 [2024-04-16 23:04:14.722043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.760 [2024-04-16 23:04:14.722159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.760 [2024-04-16 23:04:14.722196] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.760 qpair failed and we were unable to recover it. 00:26:23.760 [2024-04-16 23:04:14.722316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.760 [2024-04-16 23:04:14.722423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.760 [2024-04-16 23:04:14.722447] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.760 qpair failed and we were unable to recover it. 00:26:23.760 [2024-04-16 23:04:14.722558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.760 [2024-04-16 23:04:14.722665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.760 [2024-04-16 23:04:14.722689] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.760 qpair failed and we were unable to recover it. 00:26:23.760 [2024-04-16 23:04:14.722809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.760 [2024-04-16 23:04:14.722927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.760 [2024-04-16 23:04:14.722951] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.760 qpair failed and we were unable to recover it. 00:26:23.760 [2024-04-16 23:04:14.723067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.760 [2024-04-16 23:04:14.723184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.760 [2024-04-16 23:04:14.723211] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.760 qpair failed and we were unable to recover it. 00:26:23.760 [2024-04-16 23:04:14.723327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.760 [2024-04-16 23:04:14.723471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.760 [2024-04-16 23:04:14.723496] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.760 qpair failed and we were unable to recover it. 00:26:23.760 [2024-04-16 23:04:14.723631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.760 [2024-04-16 23:04:14.723748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.760 [2024-04-16 23:04:14.723774] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.760 qpair failed and we were unable to recover it. 00:26:23.760 [2024-04-16 23:04:14.723879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.760 [2024-04-16 23:04:14.723983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.760 [2024-04-16 23:04:14.724007] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.760 qpair failed and we were unable to recover it. 00:26:23.760 [2024-04-16 23:04:14.724117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.760 [2024-04-16 23:04:14.724254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.760 [2024-04-16 23:04:14.724279] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.760 qpair failed and we were unable to recover it. 00:26:23.760 [2024-04-16 23:04:14.724393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.760 [2024-04-16 23:04:14.724500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.760 [2024-04-16 23:04:14.724526] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.760 qpair failed and we were unable to recover it. 00:26:23.760 [2024-04-16 23:04:14.724640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.760 [2024-04-16 23:04:14.724785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.760 [2024-04-16 23:04:14.724811] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.760 qpair failed and we were unable to recover it. 00:26:23.760 [2024-04-16 23:04:14.724916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.760 [2024-04-16 23:04:14.725034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.760 [2024-04-16 23:04:14.725059] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.760 qpair failed and we were unable to recover it. 00:26:23.760 [2024-04-16 23:04:14.725213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.760 [2024-04-16 23:04:14.725355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.760 [2024-04-16 23:04:14.725380] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.760 qpair failed and we were unable to recover it. 00:26:23.760 [2024-04-16 23:04:14.725486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.760 [2024-04-16 23:04:14.725601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.760 [2024-04-16 23:04:14.725625] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.760 qpair failed and we were unable to recover it. 00:26:23.760 [2024-04-16 23:04:14.725734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.760 [2024-04-16 23:04:14.725841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.760 [2024-04-16 23:04:14.725865] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.760 qpair failed and we were unable to recover it. 00:26:23.760 [2024-04-16 23:04:14.725983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.760 [2024-04-16 23:04:14.726097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.760 [2024-04-16 23:04:14.726123] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.760 qpair failed and we were unable to recover it. 00:26:23.760 [2024-04-16 23:04:14.726242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.760 [2024-04-16 23:04:14.726363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.760 [2024-04-16 23:04:14.726389] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.760 qpair failed and we were unable to recover it. 00:26:23.760 [2024-04-16 23:04:14.726506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.760 [2024-04-16 23:04:14.726651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.760 [2024-04-16 23:04:14.726677] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.760 qpair failed and we were unable to recover it. 00:26:23.760 [2024-04-16 23:04:14.726792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.760 [2024-04-16 23:04:14.726907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.760 [2024-04-16 23:04:14.726932] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.760 qpair failed and we were unable to recover it. 00:26:23.760 [2024-04-16 23:04:14.727071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.760 [2024-04-16 23:04:14.727183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.760 [2024-04-16 23:04:14.727209] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.760 qpair failed and we were unable to recover it. 00:26:23.760 [2024-04-16 23:04:14.727327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.760 [2024-04-16 23:04:14.727441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.760 [2024-04-16 23:04:14.727466] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.760 qpair failed and we were unable to recover it. 00:26:23.760 [2024-04-16 23:04:14.727606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.760 [2024-04-16 23:04:14.727748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.760 [2024-04-16 23:04:14.727774] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.760 qpair failed and we were unable to recover it. 00:26:23.760 [2024-04-16 23:04:14.727886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.760 [2024-04-16 23:04:14.728008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.760 [2024-04-16 23:04:14.728034] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.760 qpair failed and we were unable to recover it. 00:26:23.760 [2024-04-16 23:04:14.728188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.760 [2024-04-16 23:04:14.728299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.760 [2024-04-16 23:04:14.728325] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.760 qpair failed and we were unable to recover it. 00:26:23.760 [2024-04-16 23:04:14.728441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.760 [2024-04-16 23:04:14.728562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.760 [2024-04-16 23:04:14.728587] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.760 qpair failed and we were unable to recover it. 00:26:23.760 [2024-04-16 23:04:14.728726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.760 [2024-04-16 23:04:14.728840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.760 [2024-04-16 23:04:14.728866] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.760 qpair failed and we were unable to recover it. 00:26:23.760 [2024-04-16 23:04:14.728988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.760 [2024-04-16 23:04:14.729105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.760 [2024-04-16 23:04:14.729131] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.760 qpair failed and we were unable to recover it. 00:26:23.760 [2024-04-16 23:04:14.729252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.760 [2024-04-16 23:04:14.729394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.760 [2024-04-16 23:04:14.729419] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.760 qpair failed and we were unable to recover it. 00:26:23.760 [2024-04-16 23:04:14.729555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.760 [2024-04-16 23:04:14.729699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.760 [2024-04-16 23:04:14.729724] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.760 qpair failed and we were unable to recover it. 00:26:23.760 [2024-04-16 23:04:14.729862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.760 [2024-04-16 23:04:14.729982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.760 [2024-04-16 23:04:14.730009] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.760 qpair failed and we were unable to recover it. 00:26:23.760 [2024-04-16 23:04:14.730123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.760 [2024-04-16 23:04:14.730249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.760 [2024-04-16 23:04:14.730275] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.760 qpair failed and we were unable to recover it. 00:26:23.760 [2024-04-16 23:04:14.730395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.760 [2024-04-16 23:04:14.730502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.760 [2024-04-16 23:04:14.730527] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.760 qpair failed and we were unable to recover it. 00:26:23.760 [2024-04-16 23:04:14.730634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.760 [2024-04-16 23:04:14.730747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.760 [2024-04-16 23:04:14.730772] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.760 qpair failed and we were unable to recover it. 00:26:23.760 [2024-04-16 23:04:14.730879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.760 [2024-04-16 23:04:14.731023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.760 [2024-04-16 23:04:14.731049] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.760 qpair failed and we were unable to recover it. 00:26:23.760 [2024-04-16 23:04:14.731169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.760 [2024-04-16 23:04:14.731293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.760 [2024-04-16 23:04:14.731318] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.760 qpair failed and we were unable to recover it. 00:26:23.760 [2024-04-16 23:04:14.731437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.761 [2024-04-16 23:04:14.731551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.761 [2024-04-16 23:04:14.731576] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.761 qpair failed and we were unable to recover it. 00:26:23.761 [2024-04-16 23:04:14.731739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.761 [2024-04-16 23:04:14.731879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.761 [2024-04-16 23:04:14.731905] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.761 qpair failed and we were unable to recover it. 00:26:23.761 [2024-04-16 23:04:14.732012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.761 [2024-04-16 23:04:14.732151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.761 [2024-04-16 23:04:14.732183] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.761 qpair failed and we were unable to recover it. 00:26:23.761 [2024-04-16 23:04:14.732301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.761 [2024-04-16 23:04:14.732414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.761 [2024-04-16 23:04:14.732439] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.761 qpair failed and we were unable to recover it. 00:26:23.761 [2024-04-16 23:04:14.732545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.761 [2024-04-16 23:04:14.732654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.761 [2024-04-16 23:04:14.732679] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.761 qpair failed and we were unable to recover it. 00:26:23.761 [2024-04-16 23:04:14.732783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.761 [2024-04-16 23:04:14.732925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.761 [2024-04-16 23:04:14.732951] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.761 qpair failed and we were unable to recover it. 00:26:23.761 [2024-04-16 23:04:14.733102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.761 [2024-04-16 23:04:14.733255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.761 [2024-04-16 23:04:14.733293] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.761 qpair failed and we were unable to recover it. 00:26:23.761 [2024-04-16 23:04:14.733428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.761 [2024-04-16 23:04:14.733543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.761 [2024-04-16 23:04:14.733570] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.761 qpair failed and we were unable to recover it. 00:26:23.761 [2024-04-16 23:04:14.733712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.761 [2024-04-16 23:04:14.733822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.761 [2024-04-16 23:04:14.733849] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.761 qpair failed and we were unable to recover it. 00:26:23.761 [2024-04-16 23:04:14.733992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.761 [2024-04-16 23:04:14.734103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.761 [2024-04-16 23:04:14.734128] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.761 qpair failed and we were unable to recover it. 00:26:23.761 [2024-04-16 23:04:14.734258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.761 [2024-04-16 23:04:14.734368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.761 [2024-04-16 23:04:14.734393] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.761 qpair failed and we were unable to recover it. 00:26:23.761 [2024-04-16 23:04:14.734505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.761 [2024-04-16 23:04:14.734645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.761 [2024-04-16 23:04:14.734671] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.761 qpair failed and we were unable to recover it. 00:26:23.761 [2024-04-16 23:04:14.734789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.761 [2024-04-16 23:04:14.734891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.761 [2024-04-16 23:04:14.734917] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.761 qpair failed and we were unable to recover it. 00:26:23.761 [2024-04-16 23:04:14.735026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.761 [2024-04-16 23:04:14.735199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.761 [2024-04-16 23:04:14.735225] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.761 qpair failed and we were unable to recover it. 00:26:23.761 [2024-04-16 23:04:14.735394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.761 [2024-04-16 23:04:14.735510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.761 [2024-04-16 23:04:14.735536] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.761 qpair failed and we were unable to recover it. 00:26:23.761 [2024-04-16 23:04:14.735650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.761 [2024-04-16 23:04:14.735765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.761 [2024-04-16 23:04:14.735790] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.761 qpair failed and we were unable to recover it. 00:26:23.761 [2024-04-16 23:04:14.735933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.761 [2024-04-16 23:04:14.736053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.761 [2024-04-16 23:04:14.736081] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.761 qpair failed and we were unable to recover it. 00:26:23.761 [2024-04-16 23:04:14.736199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.761 [2024-04-16 23:04:14.736345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.761 [2024-04-16 23:04:14.736370] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.761 qpair failed and we were unable to recover it. 00:26:23.761 [2024-04-16 23:04:14.736487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.761 [2024-04-16 23:04:14.736605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.761 [2024-04-16 23:04:14.736631] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.761 qpair failed and we were unable to recover it. 00:26:23.761 [2024-04-16 23:04:14.736750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.761 [2024-04-16 23:04:14.736857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.761 [2024-04-16 23:04:14.736882] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.761 qpair failed and we were unable to recover it. 00:26:23.761 [2024-04-16 23:04:14.737027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.761 [2024-04-16 23:04:14.737166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.761 [2024-04-16 23:04:14.737199] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.761 qpair failed and we were unable to recover it. 00:26:23.761 [2024-04-16 23:04:14.737346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.761 [2024-04-16 23:04:14.737469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.761 [2024-04-16 23:04:14.737494] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.761 qpair failed and we were unable to recover it. 00:26:23.761 [2024-04-16 23:04:14.737602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.761 [2024-04-16 23:04:14.737714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.761 [2024-04-16 23:04:14.737739] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.761 qpair failed and we were unable to recover it. 00:26:23.761 [2024-04-16 23:04:14.737852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.761 [2024-04-16 23:04:14.737966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.761 [2024-04-16 23:04:14.737991] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.761 qpair failed and we were unable to recover it. 00:26:23.761 [2024-04-16 23:04:14.738101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.761 [2024-04-16 23:04:14.738228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.761 [2024-04-16 23:04:14.738253] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.761 qpair failed and we were unable to recover it. 00:26:23.761 [2024-04-16 23:04:14.738370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.761 [2024-04-16 23:04:14.738485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.761 [2024-04-16 23:04:14.738509] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.761 qpair failed and we were unable to recover it. 00:26:23.761 [2024-04-16 23:04:14.738633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.761 [2024-04-16 23:04:14.738771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.761 [2024-04-16 23:04:14.738796] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.761 qpair failed and we were unable to recover it. 00:26:23.761 [2024-04-16 23:04:14.738905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.761 [2024-04-16 23:04:14.739017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.761 [2024-04-16 23:04:14.739042] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.761 qpair failed and we were unable to recover it. 00:26:23.761 [2024-04-16 23:04:14.739184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.761 [2024-04-16 23:04:14.739293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.761 [2024-04-16 23:04:14.739319] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.761 qpair failed and we were unable to recover it. 00:26:23.761 [2024-04-16 23:04:14.739431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.761 [2024-04-16 23:04:14.739574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.761 [2024-04-16 23:04:14.739598] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.761 qpair failed and we were unable to recover it. 00:26:23.761 [2024-04-16 23:04:14.739706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.761 [2024-04-16 23:04:14.739836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.761 [2024-04-16 23:04:14.739861] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.761 qpair failed and we were unable to recover it. 00:26:23.761 [2024-04-16 23:04:14.739970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.761 [2024-04-16 23:04:14.740084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.761 [2024-04-16 23:04:14.740113] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.761 qpair failed and we were unable to recover it. 00:26:23.761 [2024-04-16 23:04:14.740233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.761 [2024-04-16 23:04:14.740344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.761 [2024-04-16 23:04:14.740370] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.761 qpair failed and we were unable to recover it. 00:26:23.761 [2024-04-16 23:04:14.740495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.761 [2024-04-16 23:04:14.740631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.761 [2024-04-16 23:04:14.740657] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.761 qpair failed and we were unable to recover it. 00:26:23.761 [2024-04-16 23:04:14.740764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.761 [2024-04-16 23:04:14.740877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.761 [2024-04-16 23:04:14.740901] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.761 qpair failed and we were unable to recover it. 00:26:23.761 [2024-04-16 23:04:14.741019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.761 [2024-04-16 23:04:14.741159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.761 [2024-04-16 23:04:14.741191] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.761 qpair failed and we were unable to recover it. 00:26:23.761 [2024-04-16 23:04:14.741328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.761 [2024-04-16 23:04:14.741436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.761 [2024-04-16 23:04:14.741463] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.761 qpair failed and we were unable to recover it. 00:26:23.761 [2024-04-16 23:04:14.741586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.761 [2024-04-16 23:04:14.741697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.761 [2024-04-16 23:04:14.741723] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.761 qpair failed and we were unable to recover it. 00:26:23.761 [2024-04-16 23:04:14.741837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.761 [2024-04-16 23:04:14.741950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.761 [2024-04-16 23:04:14.741975] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.761 qpair failed and we were unable to recover it. 00:26:23.761 [2024-04-16 23:04:14.742086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.761 [2024-04-16 23:04:14.742212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.761 [2024-04-16 23:04:14.742239] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.761 qpair failed and we were unable to recover it. 00:26:23.761 [2024-04-16 23:04:14.742343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.761 [2024-04-16 23:04:14.742481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.761 [2024-04-16 23:04:14.742507] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.761 qpair failed and we were unable to recover it. 00:26:23.761 [2024-04-16 23:04:14.742652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.761 [2024-04-16 23:04:14.742760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.761 [2024-04-16 23:04:14.742789] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.761 qpair failed and we were unable to recover it. 00:26:23.761 [2024-04-16 23:04:14.742915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.761 [2024-04-16 23:04:14.743023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.761 [2024-04-16 23:04:14.743049] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.761 qpair failed and we were unable to recover it. 00:26:23.761 [2024-04-16 23:04:14.743153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.761 [2024-04-16 23:04:14.743300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.761 [2024-04-16 23:04:14.743325] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.761 qpair failed and we were unable to recover it. 00:26:23.761 [2024-04-16 23:04:14.743441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.761 [2024-04-16 23:04:14.743544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.761 [2024-04-16 23:04:14.743569] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.761 qpair failed and we were unable to recover it. 00:26:23.761 [2024-04-16 23:04:14.743678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.761 [2024-04-16 23:04:14.743811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.761 [2024-04-16 23:04:14.743836] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.761 qpair failed and we were unable to recover it. 00:26:23.761 [2024-04-16 23:04:14.743962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.761 [2024-04-16 23:04:14.744075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.761 [2024-04-16 23:04:14.744099] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.761 qpair failed and we were unable to recover it. 00:26:23.761 [2024-04-16 23:04:14.744215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.761 [2024-04-16 23:04:14.744336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.761 [2024-04-16 23:04:14.744363] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.761 qpair failed and we were unable to recover it. 00:26:23.761 [2024-04-16 23:04:14.744532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.761 [2024-04-16 23:04:14.744668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.761 [2024-04-16 23:04:14.744694] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.761 qpair failed and we were unable to recover it. 00:26:23.761 [2024-04-16 23:04:14.744833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.761 [2024-04-16 23:04:14.744949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.761 [2024-04-16 23:04:14.744974] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.761 qpair failed and we were unable to recover it. 00:26:23.761 [2024-04-16 23:04:14.745077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.761 [2024-04-16 23:04:14.745213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.761 [2024-04-16 23:04:14.745238] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.761 qpair failed and we were unable to recover it. 00:26:23.761 [2024-04-16 23:04:14.745350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.761 [2024-04-16 23:04:14.745485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.761 [2024-04-16 23:04:14.745513] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.761 qpair failed and we were unable to recover it. 00:26:23.761 [2024-04-16 23:04:14.745628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.761 [2024-04-16 23:04:14.745743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.761 [2024-04-16 23:04:14.745767] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.761 qpair failed and we were unable to recover it. 00:26:23.762 [2024-04-16 23:04:14.745881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.762 [2024-04-16 23:04:14.745988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.762 [2024-04-16 23:04:14.746012] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.762 qpair failed and we were unable to recover it. 00:26:23.762 [2024-04-16 23:04:14.746119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.762 [2024-04-16 23:04:14.746231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.762 [2024-04-16 23:04:14.746257] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.762 qpair failed and we were unable to recover it. 00:26:23.762 [2024-04-16 23:04:14.746375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.762 [2024-04-16 23:04:14.746479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.762 [2024-04-16 23:04:14.746504] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.762 qpair failed and we were unable to recover it. 00:26:23.762 [2024-04-16 23:04:14.746650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.762 [2024-04-16 23:04:14.746799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.762 [2024-04-16 23:04:14.746824] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.762 qpair failed and we were unable to recover it. 00:26:23.762 [2024-04-16 23:04:14.746973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.762 [2024-04-16 23:04:14.747088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.762 [2024-04-16 23:04:14.747112] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.762 qpair failed and we were unable to recover it. 00:26:23.762 [2024-04-16 23:04:14.747225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.762 [2024-04-16 23:04:14.747329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.762 [2024-04-16 23:04:14.747353] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.762 qpair failed and we were unable to recover it. 00:26:23.762 [2024-04-16 23:04:14.747460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.762 [2024-04-16 23:04:14.747567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.762 [2024-04-16 23:04:14.747591] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.762 qpair failed and we were unable to recover it. 00:26:23.762 [2024-04-16 23:04:14.747724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.762 [2024-04-16 23:04:14.747837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.762 [2024-04-16 23:04:14.747861] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.762 qpair failed and we were unable to recover it. 00:26:23.762 [2024-04-16 23:04:14.747971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.762 [2024-04-16 23:04:14.748118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.762 [2024-04-16 23:04:14.748146] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.762 qpair failed and we were unable to recover it. 00:26:23.762 [2024-04-16 23:04:14.748271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.762 [2024-04-16 23:04:14.748380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.762 [2024-04-16 23:04:14.748405] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.762 qpair failed and we were unable to recover it. 00:26:23.762 [2024-04-16 23:04:14.748511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.762 [2024-04-16 23:04:14.748629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.762 [2024-04-16 23:04:14.748654] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.762 qpair failed and we were unable to recover it. 00:26:23.762 [2024-04-16 23:04:14.748792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.762 [2024-04-16 23:04:14.748896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.762 [2024-04-16 23:04:14.748920] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.762 qpair failed and we were unable to recover it. 00:26:23.762 [2024-04-16 23:04:14.749023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.762 [2024-04-16 23:04:14.749135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.762 [2024-04-16 23:04:14.749160] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.762 qpair failed and we were unable to recover it. 00:26:23.762 [2024-04-16 23:04:14.749301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.762 [2024-04-16 23:04:14.749406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.762 [2024-04-16 23:04:14.749431] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.762 qpair failed and we were unable to recover it. 00:26:23.762 [2024-04-16 23:04:14.749546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.762 [2024-04-16 23:04:14.749658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.762 [2024-04-16 23:04:14.749684] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.762 qpair failed and we were unable to recover it. 00:26:23.762 [2024-04-16 23:04:14.749798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.762 [2024-04-16 23:04:14.749964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.762 [2024-04-16 23:04:14.749988] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.762 qpair failed and we were unable to recover it. 00:26:23.762 [2024-04-16 23:04:14.750092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.762 [2024-04-16 23:04:14.750246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.762 [2024-04-16 23:04:14.750272] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.762 qpair failed and we were unable to recover it. 00:26:23.762 [2024-04-16 23:04:14.750389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.762 [2024-04-16 23:04:14.750504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.762 [2024-04-16 23:04:14.750529] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.762 qpair failed and we were unable to recover it. 00:26:23.762 [2024-04-16 23:04:14.750693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.762 [2024-04-16 23:04:14.750824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.762 [2024-04-16 23:04:14.750850] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.762 qpair failed and we were unable to recover it. 00:26:23.762 [2024-04-16 23:04:14.750960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.762 [2024-04-16 23:04:14.751105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.762 [2024-04-16 23:04:14.751130] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.762 qpair failed and we were unable to recover it. 00:26:23.762 [2024-04-16 23:04:14.751273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.762 [2024-04-16 23:04:14.751396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.762 [2024-04-16 23:04:14.751422] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.762 qpair failed and we were unable to recover it. 00:26:23.762 [2024-04-16 23:04:14.751533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.762 [2024-04-16 23:04:14.751670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.762 [2024-04-16 23:04:14.751695] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.762 qpair failed and we were unable to recover it. 00:26:23.762 [2024-04-16 23:04:14.751842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.762 [2024-04-16 23:04:14.751980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.762 [2024-04-16 23:04:14.752005] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.762 qpair failed and we were unable to recover it. 00:26:23.762 [2024-04-16 23:04:14.752108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.762 [2024-04-16 23:04:14.752221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.762 [2024-04-16 23:04:14.752246] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.762 qpair failed and we were unable to recover it. 00:26:23.762 [2024-04-16 23:04:14.752369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.762 [2024-04-16 23:04:14.752485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.762 [2024-04-16 23:04:14.752511] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.762 qpair failed and we were unable to recover it. 00:26:23.762 [2024-04-16 23:04:14.752630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.762 [2024-04-16 23:04:14.752752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.762 [2024-04-16 23:04:14.752779] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.762 qpair failed and we were unable to recover it. 00:26:23.762 [2024-04-16 23:04:14.752893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.762 [2024-04-16 23:04:14.752998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.762 [2024-04-16 23:04:14.753024] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.762 qpair failed and we were unable to recover it. 00:26:23.762 [2024-04-16 23:04:14.753143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.762 [2024-04-16 23:04:14.753290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.762 [2024-04-16 23:04:14.753315] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.762 qpair failed and we were unable to recover it. 00:26:23.762 [2024-04-16 23:04:14.753430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.762 [2024-04-16 23:04:14.753537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.762 [2024-04-16 23:04:14.753563] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.762 qpair failed and we were unable to recover it. 00:26:23.762 [2024-04-16 23:04:14.753681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.762 [2024-04-16 23:04:14.753794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.762 [2024-04-16 23:04:14.753820] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.762 qpair failed and we were unable to recover it. 00:26:23.762 [2024-04-16 23:04:14.753959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.762 [2024-04-16 23:04:14.754096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.762 [2024-04-16 23:04:14.754121] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.762 qpair failed and we were unable to recover it. 00:26:23.762 [2024-04-16 23:04:14.754253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.762 [2024-04-16 23:04:14.754360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.762 [2024-04-16 23:04:14.754386] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.762 qpair failed and we were unable to recover it. 00:26:23.762 [2024-04-16 23:04:14.754499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.762 [2024-04-16 23:04:14.754642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.762 [2024-04-16 23:04:14.754668] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.762 qpair failed and we were unable to recover it. 00:26:23.762 [2024-04-16 23:04:14.754777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.762 [2024-04-16 23:04:14.754885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.762 [2024-04-16 23:04:14.754910] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.762 qpair failed and we were unable to recover it. 00:26:23.762 [2024-04-16 23:04:14.755074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.762 [2024-04-16 23:04:14.755189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.762 [2024-04-16 23:04:14.755214] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.762 qpair failed and we were unable to recover it. 00:26:23.762 [2024-04-16 23:04:14.755335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.762 [2024-04-16 23:04:14.755452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.762 [2024-04-16 23:04:14.755477] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.762 qpair failed and we were unable to recover it. 00:26:23.762 [2024-04-16 23:04:14.755628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.762 [2024-04-16 23:04:14.755737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.762 [2024-04-16 23:04:14.755762] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.762 qpair failed and we were unable to recover it. 00:26:23.762 [2024-04-16 23:04:14.755875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.762 [2024-04-16 23:04:14.755994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.762 [2024-04-16 23:04:14.756019] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.762 qpair failed and we were unable to recover it. 00:26:23.762 [2024-04-16 23:04:14.756131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.762 [2024-04-16 23:04:14.756266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.762 [2024-04-16 23:04:14.756291] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.762 qpair failed and we were unable to recover it. 00:26:23.762 [2024-04-16 23:04:14.756414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.762 [2024-04-16 23:04:14.756562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.762 [2024-04-16 23:04:14.756588] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.762 qpair failed and we were unable to recover it. 00:26:23.762 [2024-04-16 23:04:14.756706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.762 [2024-04-16 23:04:14.756822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.762 [2024-04-16 23:04:14.756848] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.762 qpair failed and we were unable to recover it. 00:26:23.762 [2024-04-16 23:04:14.757028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.762 [2024-04-16 23:04:14.757166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.762 [2024-04-16 23:04:14.757197] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.762 qpair failed and we were unable to recover it. 00:26:23.762 [2024-04-16 23:04:14.757317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.762 [2024-04-16 23:04:14.757430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.763 [2024-04-16 23:04:14.757455] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.763 qpair failed and we were unable to recover it. 00:26:23.763 [2024-04-16 23:04:14.757598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.763 [2024-04-16 23:04:14.757721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.763 [2024-04-16 23:04:14.757747] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.763 qpair failed and we were unable to recover it. 00:26:23.763 [2024-04-16 23:04:14.757891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.763 [2024-04-16 23:04:14.758000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.763 [2024-04-16 23:04:14.758024] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.763 qpair failed and we were unable to recover it. 00:26:23.763 [2024-04-16 23:04:14.758142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.763 [2024-04-16 23:04:14.758268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.763 [2024-04-16 23:04:14.758295] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.763 qpair failed and we were unable to recover it. 00:26:23.763 [2024-04-16 23:04:14.758408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.763 [2024-04-16 23:04:14.758529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.763 [2024-04-16 23:04:14.758556] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.763 qpair failed and we were unable to recover it. 00:26:23.763 [2024-04-16 23:04:14.758728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.763 [2024-04-16 23:04:14.758838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.763 [2024-04-16 23:04:14.758862] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.763 qpair failed and we were unable to recover it. 00:26:23.763 [2024-04-16 23:04:14.758971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.763 [2024-04-16 23:04:14.759083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.763 [2024-04-16 23:04:14.759108] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.763 qpair failed and we were unable to recover it. 00:26:23.763 [2024-04-16 23:04:14.759224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.763 [2024-04-16 23:04:14.759334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.763 [2024-04-16 23:04:14.759359] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.763 qpair failed and we were unable to recover it. 00:26:23.763 [2024-04-16 23:04:14.759471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.763 [2024-04-16 23:04:14.759611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.763 [2024-04-16 23:04:14.759636] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.763 qpair failed and we were unable to recover it. 00:26:23.763 [2024-04-16 23:04:14.759749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.763 [2024-04-16 23:04:14.759870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.763 [2024-04-16 23:04:14.759895] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.763 qpair failed and we were unable to recover it. 00:26:23.763 [2024-04-16 23:04:14.760066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.763 [2024-04-16 23:04:14.760184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.763 [2024-04-16 23:04:14.760211] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.763 qpair failed and we were unable to recover it. 00:26:23.763 [2024-04-16 23:04:14.760361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.763 [2024-04-16 23:04:14.760470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.763 [2024-04-16 23:04:14.760495] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.763 qpair failed and we were unable to recover it. 00:26:23.763 [2024-04-16 23:04:14.760603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.763 [2024-04-16 23:04:14.760710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.763 [2024-04-16 23:04:14.760735] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.763 qpair failed and we were unable to recover it. 00:26:23.763 [2024-04-16 23:04:14.760851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.763 [2024-04-16 23:04:14.760966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.763 [2024-04-16 23:04:14.760991] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.763 qpair failed and we were unable to recover it. 00:26:23.763 [2024-04-16 23:04:14.761102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.763 [2024-04-16 23:04:14.761220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.763 [2024-04-16 23:04:14.761245] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.763 qpair failed and we were unable to recover it. 00:26:23.763 [2024-04-16 23:04:14.761370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.763 [2024-04-16 23:04:14.761489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.763 [2024-04-16 23:04:14.761514] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.763 qpair failed and we were unable to recover it. 00:26:23.763 [2024-04-16 23:04:14.761652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.763 [2024-04-16 23:04:14.761766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.763 [2024-04-16 23:04:14.761792] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.763 qpair failed and we were unable to recover it. 00:26:23.763 [2024-04-16 23:04:14.761912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.763 [2024-04-16 23:04:14.762043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.763 [2024-04-16 23:04:14.762068] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.763 qpair failed and we were unable to recover it. 00:26:23.763 [2024-04-16 23:04:14.762172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.763 [2024-04-16 23:04:14.762299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.763 [2024-04-16 23:04:14.762325] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.763 qpair failed and we were unable to recover it. 00:26:23.763 [2024-04-16 23:04:14.762441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.763 [2024-04-16 23:04:14.762542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.763 [2024-04-16 23:04:14.762566] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.763 qpair failed and we were unable to recover it. 00:26:23.763 [2024-04-16 23:04:14.762704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.763 [2024-04-16 23:04:14.762810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.763 [2024-04-16 23:04:14.762836] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.763 qpair failed and we were unable to recover it. 00:26:23.763 [2024-04-16 23:04:14.762947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.763 [2024-04-16 23:04:14.763067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.763 [2024-04-16 23:04:14.763093] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.763 qpair failed and we were unable to recover it. 00:26:23.763 [2024-04-16 23:04:14.763210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.763 [2024-04-16 23:04:14.763348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.763 [2024-04-16 23:04:14.763373] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.763 qpair failed and we were unable to recover it. 00:26:23.763 [2024-04-16 23:04:14.763477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.763 [2024-04-16 23:04:14.763647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.763 [2024-04-16 23:04:14.763673] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.763 qpair failed and we were unable to recover it. 00:26:23.763 [2024-04-16 23:04:14.763786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.763 [2024-04-16 23:04:14.763899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.763 [2024-04-16 23:04:14.763924] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.763 qpair failed and we were unable to recover it. 00:26:23.763 [2024-04-16 23:04:14.764072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.763 [2024-04-16 23:04:14.764178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.763 [2024-04-16 23:04:14.764204] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.763 qpair failed and we were unable to recover it. 00:26:23.763 [2024-04-16 23:04:14.764317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.763 [2024-04-16 23:04:14.764425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.763 [2024-04-16 23:04:14.764450] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.763 qpair failed and we were unable to recover it. 00:26:23.763 [2024-04-16 23:04:14.764561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.763 [2024-04-16 23:04:14.764689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.763 [2024-04-16 23:04:14.764714] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.763 qpair failed and we were unable to recover it. 00:26:23.763 [2024-04-16 23:04:14.764818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.763 [2024-04-16 23:04:14.764927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.763 [2024-04-16 23:04:14.764952] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.763 qpair failed and we were unable to recover it. 00:26:23.763 [2024-04-16 23:04:14.765070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.763 [2024-04-16 23:04:14.765196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.763 [2024-04-16 23:04:14.765222] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.763 qpair failed and we were unable to recover it. 00:26:23.763 [2024-04-16 23:04:14.765331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.763 [2024-04-16 23:04:14.765476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.763 [2024-04-16 23:04:14.765502] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.763 qpair failed and we were unable to recover it. 00:26:23.763 [2024-04-16 23:04:14.765620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.763 [2024-04-16 23:04:14.765755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.763 [2024-04-16 23:04:14.765779] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.763 qpair failed and we were unable to recover it. 00:26:23.763 [2024-04-16 23:04:14.765926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.763 [2024-04-16 23:04:14.766037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.763 [2024-04-16 23:04:14.766062] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.763 qpair failed and we were unable to recover it. 00:26:23.763 [2024-04-16 23:04:14.766171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.763 [2024-04-16 23:04:14.766288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.763 [2024-04-16 23:04:14.766314] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.763 qpair failed and we were unable to recover it. 00:26:23.763 [2024-04-16 23:04:14.766458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.763 [2024-04-16 23:04:14.766603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.763 [2024-04-16 23:04:14.766629] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.763 qpair failed and we were unable to recover it. 00:26:23.763 [2024-04-16 23:04:14.766733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.763 [2024-04-16 23:04:14.766842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.763 [2024-04-16 23:04:14.766868] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.763 qpair failed and we were unable to recover it. 00:26:23.763 [2024-04-16 23:04:14.767010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.763 [2024-04-16 23:04:14.767151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.763 [2024-04-16 23:04:14.767183] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.763 qpair failed and we were unable to recover it. 00:26:23.763 [2024-04-16 23:04:14.767331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.763 [2024-04-16 23:04:14.767433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.763 [2024-04-16 23:04:14.767458] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.763 qpair failed and we were unable to recover it. 00:26:23.763 [2024-04-16 23:04:14.767581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.763 [2024-04-16 23:04:14.767688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.763 [2024-04-16 23:04:14.767713] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.763 qpair failed and we were unable to recover it. 00:26:23.763 [2024-04-16 23:04:14.767879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.763 [2024-04-16 23:04:14.767988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.763 [2024-04-16 23:04:14.768014] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.763 qpair failed and we were unable to recover it. 00:26:23.763 [2024-04-16 23:04:14.768129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.763 [2024-04-16 23:04:14.768257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.763 [2024-04-16 23:04:14.768284] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.763 qpair failed and we were unable to recover it. 00:26:23.763 [2024-04-16 23:04:14.768393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.763 [2024-04-16 23:04:14.768510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.763 [2024-04-16 23:04:14.768535] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.763 qpair failed and we were unable to recover it. 00:26:23.763 [2024-04-16 23:04:14.768651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.763 [2024-04-16 23:04:14.768792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.763 [2024-04-16 23:04:14.768818] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.763 qpair failed and we were unable to recover it. 00:26:23.763 [2024-04-16 23:04:14.768930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.763 [2024-04-16 23:04:14.769037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.763 [2024-04-16 23:04:14.769063] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.763 qpair failed and we were unable to recover it. 00:26:23.763 [2024-04-16 23:04:14.769205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.763 [2024-04-16 23:04:14.769339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.763 [2024-04-16 23:04:14.769365] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.763 qpair failed and we were unable to recover it. 00:26:23.763 [2024-04-16 23:04:14.769499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.763 [2024-04-16 23:04:14.769606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.763 [2024-04-16 23:04:14.769632] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.763 qpair failed and we were unable to recover it. 00:26:23.763 [2024-04-16 23:04:14.769738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.763 [2024-04-16 23:04:14.769872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.763 [2024-04-16 23:04:14.769898] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.763 qpair failed and we were unable to recover it. 00:26:23.763 [2024-04-16 23:04:14.770020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.763 [2024-04-16 23:04:14.770130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.763 [2024-04-16 23:04:14.770155] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.763 qpair failed and we were unable to recover it. 00:26:23.763 [2024-04-16 23:04:14.770282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.763 [2024-04-16 23:04:14.770387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.763 [2024-04-16 23:04:14.770412] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.763 qpair failed and we were unable to recover it. 00:26:23.763 [2024-04-16 23:04:14.770542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.764 [2024-04-16 23:04:14.770653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.764 [2024-04-16 23:04:14.770680] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.764 qpair failed and we were unable to recover it. 00:26:23.764 [2024-04-16 23:04:14.770786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.764 [2024-04-16 23:04:14.770919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.764 [2024-04-16 23:04:14.770944] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.764 qpair failed and we were unable to recover it. 00:26:23.764 [2024-04-16 23:04:14.771061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.764 [2024-04-16 23:04:14.771201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.764 [2024-04-16 23:04:14.771227] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.764 qpair failed and we were unable to recover it. 00:26:23.764 [2024-04-16 23:04:14.771338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.764 [2024-04-16 23:04:14.771484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.764 [2024-04-16 23:04:14.771510] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.764 qpair failed and we were unable to recover it. 00:26:23.764 [2024-04-16 23:04:14.771628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.764 [2024-04-16 23:04:14.771738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.764 [2024-04-16 23:04:14.771764] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.764 qpair failed and we were unable to recover it. 00:26:23.764 [2024-04-16 23:04:14.771879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.764 [2024-04-16 23:04:14.772016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.764 [2024-04-16 23:04:14.772041] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.764 qpair failed and we were unable to recover it. 00:26:23.764 [2024-04-16 23:04:14.772146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.764 [2024-04-16 23:04:14.772267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.764 [2024-04-16 23:04:14.772293] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.764 qpair failed and we were unable to recover it. 00:26:23.764 [2024-04-16 23:04:14.772411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.764 [2024-04-16 23:04:14.772543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.764 [2024-04-16 23:04:14.772568] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.764 qpair failed and we were unable to recover it. 00:26:23.764 [2024-04-16 23:04:14.772671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.764 [2024-04-16 23:04:14.772789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.764 [2024-04-16 23:04:14.772814] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.764 qpair failed and we were unable to recover it. 00:26:23.764 [2024-04-16 23:04:14.772934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.764 [2024-04-16 23:04:14.773039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.764 [2024-04-16 23:04:14.773064] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.764 qpair failed and we were unable to recover it. 00:26:23.764 [2024-04-16 23:04:14.773185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.764 [2024-04-16 23:04:14.773312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.764 [2024-04-16 23:04:14.773337] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.764 qpair failed and we were unable to recover it. 00:26:23.764 [2024-04-16 23:04:14.773476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.764 [2024-04-16 23:04:14.773582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.764 [2024-04-16 23:04:14.773608] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.764 qpair failed and we were unable to recover it. 00:26:23.764 [2024-04-16 23:04:14.773740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.764 [2024-04-16 23:04:14.773853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.764 [2024-04-16 23:04:14.773879] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.764 qpair failed and we were unable to recover it. 00:26:23.764 [2024-04-16 23:04:14.774010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.764 [2024-04-16 23:04:14.774116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.764 [2024-04-16 23:04:14.774142] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.764 qpair failed and we were unable to recover it. 00:26:23.764 [2024-04-16 23:04:14.774311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.764 [2024-04-16 23:04:14.774419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.764 [2024-04-16 23:04:14.774445] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.764 qpair failed and we were unable to recover it. 00:26:23.764 [2024-04-16 23:04:14.774553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.764 [2024-04-16 23:04:14.774662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.764 [2024-04-16 23:04:14.774688] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.764 qpair failed and we were unable to recover it. 00:26:23.764 [2024-04-16 23:04:14.774804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.764 [2024-04-16 23:04:14.774908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.764 [2024-04-16 23:04:14.774933] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.764 qpair failed and we were unable to recover it. 00:26:23.764 [2024-04-16 23:04:14.775041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.764 [2024-04-16 23:04:14.775183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.764 [2024-04-16 23:04:14.775209] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.764 qpair failed and we were unable to recover it. 00:26:23.764 [2024-04-16 23:04:14.775343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.764 [2024-04-16 23:04:14.775468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.764 [2024-04-16 23:04:14.775498] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.764 qpair failed and we were unable to recover it. 00:26:23.764 [2024-04-16 23:04:14.775610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.764 [2024-04-16 23:04:14.775749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.764 [2024-04-16 23:04:14.775776] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.764 qpair failed and we were unable to recover it. 00:26:23.764 [2024-04-16 23:04:14.775892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.764 [2024-04-16 23:04:14.775996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.764 [2024-04-16 23:04:14.776021] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.764 qpair failed and we were unable to recover it. 00:26:23.764 [2024-04-16 23:04:14.776169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.764 [2024-04-16 23:04:14.776291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.764 [2024-04-16 23:04:14.776317] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.764 qpair failed and we were unable to recover it. 00:26:23.764 [2024-04-16 23:04:14.776432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.764 [2024-04-16 23:04:14.776541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.764 [2024-04-16 23:04:14.776568] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.764 qpair failed and we were unable to recover it. 00:26:23.764 [2024-04-16 23:04:14.776691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.764 [2024-04-16 23:04:14.776807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.764 [2024-04-16 23:04:14.776832] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.764 qpair failed and we were unable to recover it. 00:26:23.764 [2024-04-16 23:04:14.776970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.764 [2024-04-16 23:04:14.777087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.764 [2024-04-16 23:04:14.777111] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.764 qpair failed and we were unable to recover it. 00:26:23.764 [2024-04-16 23:04:14.777256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.764 [2024-04-16 23:04:14.777368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.764 [2024-04-16 23:04:14.777394] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.764 qpair failed and we were unable to recover it. 00:26:23.764 [2024-04-16 23:04:14.777527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.764 [2024-04-16 23:04:14.777638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.764 [2024-04-16 23:04:14.777664] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.764 qpair failed and we were unable to recover it. 00:26:23.764 [2024-04-16 23:04:14.777797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.764 [2024-04-16 23:04:14.777940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.764 [2024-04-16 23:04:14.777966] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.764 qpair failed and we were unable to recover it. 00:26:23.764 [2024-04-16 23:04:14.778077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.764 [2024-04-16 23:04:14.778194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.764 [2024-04-16 23:04:14.778221] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.764 qpair failed and we were unable to recover it. 00:26:23.764 [2024-04-16 23:04:14.778357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.764 [2024-04-16 23:04:14.778473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.764 [2024-04-16 23:04:14.778498] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.764 qpair failed and we were unable to recover it. 00:26:23.764 [2024-04-16 23:04:14.778610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.764 [2024-04-16 23:04:14.778721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.764 [2024-04-16 23:04:14.778745] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.764 qpair failed and we were unable to recover it. 00:26:23.764 [2024-04-16 23:04:14.778896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.764 [2024-04-16 23:04:14.779005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.764 [2024-04-16 23:04:14.779031] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.764 qpair failed and we were unable to recover it. 00:26:23.764 [2024-04-16 23:04:14.779144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.764 [2024-04-16 23:04:14.779290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.764 [2024-04-16 23:04:14.779315] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.764 qpair failed and we were unable to recover it. 00:26:23.764 [2024-04-16 23:04:14.779430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.764 [2024-04-16 23:04:14.779579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.764 [2024-04-16 23:04:14.779603] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.764 qpair failed and we were unable to recover it. 00:26:23.764 [2024-04-16 23:04:14.779716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.764 [2024-04-16 23:04:14.779851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.764 [2024-04-16 23:04:14.779876] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.764 qpair failed and we were unable to recover it. 00:26:23.764 [2024-04-16 23:04:14.779979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.764 [2024-04-16 23:04:14.780086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.764 [2024-04-16 23:04:14.780111] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.764 qpair failed and we were unable to recover it. 00:26:23.764 [2024-04-16 23:04:14.780239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.764 [2024-04-16 23:04:14.780371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.764 [2024-04-16 23:04:14.780396] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.764 qpair failed and we were unable to recover it. 00:26:23.764 [2024-04-16 23:04:14.780513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.764 [2024-04-16 23:04:14.780628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.764 [2024-04-16 23:04:14.780652] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.764 qpair failed and we were unable to recover it. 00:26:23.764 [2024-04-16 23:04:14.780765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.764 [2024-04-16 23:04:14.780903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.764 [2024-04-16 23:04:14.780928] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.764 qpair failed and we were unable to recover it. 00:26:23.764 [2024-04-16 23:04:14.781042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.764 [2024-04-16 23:04:14.781163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.764 [2024-04-16 23:04:14.781203] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.764 qpair failed and we were unable to recover it. 00:26:23.764 [2024-04-16 23:04:14.781313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.764 [2024-04-16 23:04:14.781458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.764 [2024-04-16 23:04:14.781490] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.764 qpair failed and we were unable to recover it. 00:26:23.764 [2024-04-16 23:04:14.781637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.764 [2024-04-16 23:04:14.781747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.764 [2024-04-16 23:04:14.781772] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.764 qpair failed and we were unable to recover it. 00:26:23.764 [2024-04-16 23:04:14.781883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.764 [2024-04-16 23:04:14.781998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.764 [2024-04-16 23:04:14.782024] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.764 qpair failed and we were unable to recover it. 00:26:23.764 [2024-04-16 23:04:14.782148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.764 [2024-04-16 23:04:14.782266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.764 [2024-04-16 23:04:14.782291] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.764 qpair failed and we were unable to recover it. 00:26:23.764 [2024-04-16 23:04:14.782401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.764 [2024-04-16 23:04:14.782519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.764 [2024-04-16 23:04:14.782544] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.764 qpair failed and we were unable to recover it. 00:26:23.764 [2024-04-16 23:04:14.782678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.764 [2024-04-16 23:04:14.782822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.764 [2024-04-16 23:04:14.782846] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.764 qpair failed and we were unable to recover it. 00:26:23.764 [2024-04-16 23:04:14.782949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.764 [2024-04-16 23:04:14.783098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.764 [2024-04-16 23:04:14.783122] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.764 qpair failed and we were unable to recover it. 00:26:23.764 [2024-04-16 23:04:14.783251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.764 [2024-04-16 23:04:14.783365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.764 [2024-04-16 23:04:14.783389] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.764 qpair failed and we were unable to recover it. 00:26:23.764 [2024-04-16 23:04:14.783511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.764 [2024-04-16 23:04:14.783619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.764 [2024-04-16 23:04:14.783648] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.764 qpair failed and we were unable to recover it. 00:26:23.764 [2024-04-16 23:04:14.783795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.764 [2024-04-16 23:04:14.783910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.764 [2024-04-16 23:04:14.783934] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.764 qpair failed and we were unable to recover it. 00:26:23.764 [2024-04-16 23:04:14.784046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.764 [2024-04-16 23:04:14.784162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.764 [2024-04-16 23:04:14.784193] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.764 qpair failed and we were unable to recover it. 00:26:23.764 [2024-04-16 23:04:14.784308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.764 [2024-04-16 23:04:14.784428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.764 [2024-04-16 23:04:14.784452] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.764 qpair failed and we were unable to recover it. 00:26:23.764 [2024-04-16 23:04:14.784599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.764 [2024-04-16 23:04:14.784709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.764 [2024-04-16 23:04:14.784735] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.764 qpair failed and we were unable to recover it. 00:26:23.764 [2024-04-16 23:04:14.784877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.764 [2024-04-16 23:04:14.784996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.764 [2024-04-16 23:04:14.785021] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.764 qpair failed and we were unable to recover it. 00:26:23.764 [2024-04-16 23:04:14.785158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.764 [2024-04-16 23:04:14.785285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.765 [2024-04-16 23:04:14.785311] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.765 qpair failed and we were unable to recover it. 00:26:23.765 [2024-04-16 23:04:14.785419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.765 [2024-04-16 23:04:14.785539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.765 [2024-04-16 23:04:14.785563] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.765 qpair failed and we were unable to recover it. 00:26:23.765 [2024-04-16 23:04:14.785680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.765 [2024-04-16 23:04:14.785820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.765 [2024-04-16 23:04:14.785845] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.765 qpair failed and we were unable to recover it. 00:26:23.765 [2024-04-16 23:04:14.785994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.765 [2024-04-16 23:04:14.786104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.765 [2024-04-16 23:04:14.786128] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.765 qpair failed and we were unable to recover it. 00:26:23.765 [2024-04-16 23:04:14.786297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.765 [2024-04-16 23:04:14.786419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.765 [2024-04-16 23:04:14.786448] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.765 qpair failed and we were unable to recover it. 00:26:23.765 [2024-04-16 23:04:14.786566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.765 [2024-04-16 23:04:14.786674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.765 [2024-04-16 23:04:14.786700] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.765 qpair failed and we were unable to recover it. 00:26:23.765 [2024-04-16 23:04:14.786832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.765 [2024-04-16 23:04:14.786969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.765 [2024-04-16 23:04:14.786995] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.765 qpair failed and we were unable to recover it. 00:26:23.765 [2024-04-16 23:04:14.787151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.765 [2024-04-16 23:04:14.787268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.765 [2024-04-16 23:04:14.787293] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.765 qpair failed and we were unable to recover it. 00:26:23.765 [2024-04-16 23:04:14.787400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.765 [2024-04-16 23:04:14.787548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.765 [2024-04-16 23:04:14.787574] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.765 qpair failed and we were unable to recover it. 00:26:23.765 [2024-04-16 23:04:14.787710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.765 [2024-04-16 23:04:14.787836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.765 [2024-04-16 23:04:14.787861] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.765 qpair failed and we were unable to recover it. 00:26:23.765 [2024-04-16 23:04:14.787998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.765 [2024-04-16 23:04:14.788145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.765 [2024-04-16 23:04:14.788170] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.765 qpair failed and we were unable to recover it. 00:26:23.765 [2024-04-16 23:04:14.788315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.765 [2024-04-16 23:04:14.788420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.765 [2024-04-16 23:04:14.788445] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.765 qpair failed and we were unable to recover it. 00:26:23.765 [2024-04-16 23:04:14.788556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.765 [2024-04-16 23:04:14.788703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.765 [2024-04-16 23:04:14.788728] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.765 qpair failed and we were unable to recover it. 00:26:23.765 [2024-04-16 23:04:14.788852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.765 [2024-04-16 23:04:14.788962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.765 [2024-04-16 23:04:14.788989] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.765 qpair failed and we were unable to recover it. 00:26:23.765 [2024-04-16 23:04:14.789101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.765 [2024-04-16 23:04:14.789208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.765 [2024-04-16 23:04:14.789238] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.765 qpair failed and we were unable to recover it. 00:26:23.765 [2024-04-16 23:04:14.789352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.765 [2024-04-16 23:04:14.789468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.765 [2024-04-16 23:04:14.789493] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.765 qpair failed and we were unable to recover it. 00:26:23.765 [2024-04-16 23:04:14.789609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.765 [2024-04-16 23:04:14.789714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.765 [2024-04-16 23:04:14.789740] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.765 qpair failed and we were unable to recover it. 00:26:23.765 [2024-04-16 23:04:14.789859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.765 [2024-04-16 23:04:14.789972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.765 [2024-04-16 23:04:14.789996] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.765 qpair failed and we were unable to recover it. 00:26:23.765 [2024-04-16 23:04:14.790132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.765 [2024-04-16 23:04:14.790292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.765 [2024-04-16 23:04:14.790317] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.765 qpair failed and we were unable to recover it. 00:26:23.765 [2024-04-16 23:04:14.790456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.765 [2024-04-16 23:04:14.790608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.765 [2024-04-16 23:04:14.790633] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.765 qpair failed and we were unable to recover it. 00:26:23.765 [2024-04-16 23:04:14.790744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.765 [2024-04-16 23:04:14.790865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.765 [2024-04-16 23:04:14.790890] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.765 qpair failed and we were unable to recover it. 00:26:23.765 [2024-04-16 23:04:14.791001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.765 [2024-04-16 23:04:14.791109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.765 [2024-04-16 23:04:14.791133] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.765 qpair failed and we were unable to recover it. 00:26:23.765 [2024-04-16 23:04:14.791262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.765 [2024-04-16 23:04:14.791377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.765 [2024-04-16 23:04:14.791403] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.765 qpair failed and we were unable to recover it. 00:26:23.765 [2024-04-16 23:04:14.791541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.765 [2024-04-16 23:04:14.791676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.765 [2024-04-16 23:04:14.791701] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.765 qpair failed and we were unable to recover it. 00:26:23.765 [2024-04-16 23:04:14.791816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.765 [2024-04-16 23:04:14.791952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.765 [2024-04-16 23:04:14.791981] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.765 qpair failed and we were unable to recover it. 00:26:23.765 [2024-04-16 23:04:14.792119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.765 [2024-04-16 23:04:14.792229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.765 [2024-04-16 23:04:14.792255] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.765 qpair failed and we were unable to recover it. 00:26:23.765 [2024-04-16 23:04:14.792371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.765 [2024-04-16 23:04:14.792517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.765 [2024-04-16 23:04:14.792541] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.765 qpair failed and we were unable to recover it. 00:26:23.765 [2024-04-16 23:04:14.792682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.765 [2024-04-16 23:04:14.792807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.765 [2024-04-16 23:04:14.792832] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.765 qpair failed and we were unable to recover it. 00:26:23.765 [2024-04-16 23:04:14.792938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.765 [2024-04-16 23:04:14.793051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.765 [2024-04-16 23:04:14.793075] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.765 qpair failed and we were unable to recover it. 00:26:23.765 [2024-04-16 23:04:14.793219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.765 [2024-04-16 23:04:14.793347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.765 [2024-04-16 23:04:14.793373] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.765 qpair failed and we were unable to recover it. 00:26:23.765 [2024-04-16 23:04:14.793516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.765 [2024-04-16 23:04:14.793665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.765 [2024-04-16 23:04:14.793691] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.765 qpair failed and we were unable to recover it. 00:26:23.765 [2024-04-16 23:04:14.793810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.765 [2024-04-16 23:04:14.793919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.765 [2024-04-16 23:04:14.793945] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.765 qpair failed and we were unable to recover it. 00:26:23.765 [2024-04-16 23:04:14.794088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.765 [2024-04-16 23:04:14.794210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.765 [2024-04-16 23:04:14.794237] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.765 qpair failed and we were unable to recover it. 00:26:23.765 [2024-04-16 23:04:14.794351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.765 [2024-04-16 23:04:14.794463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.765 [2024-04-16 23:04:14.794495] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.765 qpair failed and we were unable to recover it. 00:26:23.765 [2024-04-16 23:04:14.794607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.765 [2024-04-16 23:04:14.794718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.765 [2024-04-16 23:04:14.794744] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.765 qpair failed and we were unable to recover it. 00:26:23.765 [2024-04-16 23:04:14.794887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.765 [2024-04-16 23:04:14.794994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.765 [2024-04-16 23:04:14.795021] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.765 qpair failed and we were unable to recover it. 00:26:23.765 [2024-04-16 23:04:14.795169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.765 [2024-04-16 23:04:14.795300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.765 [2024-04-16 23:04:14.795326] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.765 qpair failed and we were unable to recover it. 00:26:23.765 [2024-04-16 23:04:14.795464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.765 [2024-04-16 23:04:14.795579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.765 [2024-04-16 23:04:14.795604] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.765 qpair failed and we were unable to recover it. 00:26:23.765 [2024-04-16 23:04:14.795745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.765 [2024-04-16 23:04:14.795892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.765 [2024-04-16 23:04:14.795917] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.765 qpair failed and we were unable to recover it. 00:26:23.765 [2024-04-16 23:04:14.796052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.765 [2024-04-16 23:04:14.796166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.765 [2024-04-16 23:04:14.796196] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.765 qpair failed and we were unable to recover it. 00:26:23.765 [2024-04-16 23:04:14.796304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.765 [2024-04-16 23:04:14.796413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.765 [2024-04-16 23:04:14.796439] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.765 qpair failed and we were unable to recover it. 00:26:23.765 [2024-04-16 23:04:14.796560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.765 [2024-04-16 23:04:14.796698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.765 [2024-04-16 23:04:14.796723] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.765 qpair failed and we were unable to recover it. 00:26:23.765 [2024-04-16 23:04:14.796827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.765 [2024-04-16 23:04:14.796941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.765 [2024-04-16 23:04:14.796965] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.765 qpair failed and we were unable to recover it. 00:26:23.765 [2024-04-16 23:04:14.797106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.765 [2024-04-16 23:04:14.797258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.765 [2024-04-16 23:04:14.797283] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.765 qpair failed and we were unable to recover it. 00:26:23.765 [2024-04-16 23:04:14.797404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.765 [2024-04-16 23:04:14.797534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.765 [2024-04-16 23:04:14.797559] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.765 qpair failed and we were unable to recover it. 00:26:23.765 [2024-04-16 23:04:14.797681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.765 [2024-04-16 23:04:14.797801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.765 [2024-04-16 23:04:14.797827] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.765 qpair failed and we were unable to recover it. 00:26:23.765 [2024-04-16 23:04:14.797941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.765 [2024-04-16 23:04:14.798095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.765 [2024-04-16 23:04:14.798124] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.765 qpair failed and we were unable to recover it. 00:26:23.765 [2024-04-16 23:04:14.798252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.765 [2024-04-16 23:04:14.798408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.766 [2024-04-16 23:04:14.798434] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.766 qpair failed and we were unable to recover it. 00:26:23.766 [2024-04-16 23:04:14.798563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.766 [2024-04-16 23:04:14.798707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.766 [2024-04-16 23:04:14.798732] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.766 qpair failed and we were unable to recover it. 00:26:23.766 [2024-04-16 23:04:14.798842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.766 [2024-04-16 23:04:14.798945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.766 [2024-04-16 23:04:14.798971] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.766 qpair failed and we were unable to recover it. 00:26:23.766 [2024-04-16 23:04:14.799088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.766 [2024-04-16 23:04:14.799214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.766 [2024-04-16 23:04:14.799241] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.766 qpair failed and we were unable to recover it. 00:26:23.766 [2024-04-16 23:04:14.799363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.766 [2024-04-16 23:04:14.799487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.766 [2024-04-16 23:04:14.799513] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.766 qpair failed and we were unable to recover it. 00:26:23.766 [2024-04-16 23:04:14.799635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.766 [2024-04-16 23:04:14.799777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.766 [2024-04-16 23:04:14.799803] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.766 qpair failed and we were unable to recover it. 00:26:23.766 [2024-04-16 23:04:14.799909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.766 [2024-04-16 23:04:14.800025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.766 [2024-04-16 23:04:14.800050] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.766 qpair failed and we were unable to recover it. 00:26:23.766 [2024-04-16 23:04:14.800185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.766 [2024-04-16 23:04:14.800334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.766 [2024-04-16 23:04:14.800359] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.766 qpair failed and we were unable to recover it. 00:26:23.766 [2024-04-16 23:04:14.800476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.766 [2024-04-16 23:04:14.800593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.766 [2024-04-16 23:04:14.800617] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.766 qpair failed and we were unable to recover it. 00:26:23.766 [2024-04-16 23:04:14.800737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.766 [2024-04-16 23:04:14.800848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.766 [2024-04-16 23:04:14.800873] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.766 qpair failed and we were unable to recover it. 00:26:23.766 [2024-04-16 23:04:14.800980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.766 [2024-04-16 23:04:14.801108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.766 [2024-04-16 23:04:14.801133] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.766 qpair failed and we were unable to recover it. 00:26:23.766 [2024-04-16 23:04:14.801283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.766 [2024-04-16 23:04:14.801390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.766 [2024-04-16 23:04:14.801414] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.766 qpair failed and we were unable to recover it. 00:26:23.766 [2024-04-16 23:04:14.801562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.766 [2024-04-16 23:04:14.801691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.766 [2024-04-16 23:04:14.801716] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.766 qpair failed and we were unable to recover it. 00:26:23.766 [2024-04-16 23:04:14.801832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.766 [2024-04-16 23:04:14.801942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.766 [2024-04-16 23:04:14.801968] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.766 qpair failed and we were unable to recover it. 00:26:23.766 [2024-04-16 23:04:14.802092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.766 [2024-04-16 23:04:14.802203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.766 [2024-04-16 23:04:14.802228] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.766 qpair failed and we were unable to recover it. 00:26:23.766 [2024-04-16 23:04:14.802335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.766 [2024-04-16 23:04:14.802473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.766 [2024-04-16 23:04:14.802498] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.766 qpair failed and we were unable to recover it. 00:26:23.766 [2024-04-16 23:04:14.802609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.766 [2024-04-16 23:04:14.802713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.766 [2024-04-16 23:04:14.802737] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.766 qpair failed and we were unable to recover it. 00:26:23.766 [2024-04-16 23:04:14.802873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.766 [2024-04-16 23:04:14.803007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.766 [2024-04-16 23:04:14.803032] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.766 qpair failed and we were unable to recover it. 00:26:23.766 [2024-04-16 23:04:14.803147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.766 [2024-04-16 23:04:14.803262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.766 [2024-04-16 23:04:14.803286] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.766 qpair failed and we were unable to recover it. 00:26:23.766 [2024-04-16 23:04:14.803400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.766 [2024-04-16 23:04:14.803523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.766 [2024-04-16 23:04:14.803547] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.766 qpair failed and we were unable to recover it. 00:26:23.766 [2024-04-16 23:04:14.803694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.766 [2024-04-16 23:04:14.803808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.766 [2024-04-16 23:04:14.803833] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.766 qpair failed and we were unable to recover it. 00:26:23.766 [2024-04-16 23:04:14.803938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.766 [2024-04-16 23:04:14.804048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.766 [2024-04-16 23:04:14.804073] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.766 qpair failed and we were unable to recover it. 00:26:23.766 [2024-04-16 23:04:14.804191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.766 [2024-04-16 23:04:14.804303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.766 [2024-04-16 23:04:14.804328] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.766 qpair failed and we were unable to recover it. 00:26:23.766 [2024-04-16 23:04:14.804446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.766 [2024-04-16 23:04:14.804564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.766 [2024-04-16 23:04:14.804589] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.766 qpair failed and we were unable to recover it. 00:26:23.766 [2024-04-16 23:04:14.804701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.766 [2024-04-16 23:04:14.804810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.766 [2024-04-16 23:04:14.804835] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.766 qpair failed and we were unable to recover it. 00:26:23.766 [2024-04-16 23:04:14.804974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.766 [2024-04-16 23:04:14.805094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.766 [2024-04-16 23:04:14.805120] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.766 qpair failed and we were unable to recover it. 00:26:23.766 [2024-04-16 23:04:14.805260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.766 [2024-04-16 23:04:14.805374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.766 [2024-04-16 23:04:14.805399] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.766 qpair failed and we were unable to recover it. 00:26:23.766 [2024-04-16 23:04:14.805503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.766 [2024-04-16 23:04:14.805609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.766 [2024-04-16 23:04:14.805634] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.766 qpair failed and we were unable to recover it. 00:26:23.766 [2024-04-16 23:04:14.805751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.766 [2024-04-16 23:04:14.805864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.766 [2024-04-16 23:04:14.805891] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.766 qpair failed and we were unable to recover it. 00:26:23.766 [2024-04-16 23:04:14.806007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.766 [2024-04-16 23:04:14.806127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.766 [2024-04-16 23:04:14.806152] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.766 qpair failed and we were unable to recover it. 00:26:23.766 [2024-04-16 23:04:14.806284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.766 [2024-04-16 23:04:14.806404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.766 [2024-04-16 23:04:14.806430] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.766 qpair failed and we were unable to recover it. 00:26:23.766 [2024-04-16 23:04:14.806553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.766 [2024-04-16 23:04:14.806660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.766 [2024-04-16 23:04:14.806685] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.766 qpair failed and we were unable to recover it. 00:26:23.766 [2024-04-16 23:04:14.806797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.766 [2024-04-16 23:04:14.806913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.766 [2024-04-16 23:04:14.806938] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.766 qpair failed and we were unable to recover it. 00:26:23.766 [2024-04-16 23:04:14.807071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.766 [2024-04-16 23:04:14.807200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.766 [2024-04-16 23:04:14.807227] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.766 qpair failed and we were unable to recover it. 00:26:23.766 [2024-04-16 23:04:14.807336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.766 [2024-04-16 23:04:14.807458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.766 [2024-04-16 23:04:14.807484] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.766 qpair failed and we were unable to recover it. 00:26:23.766 [2024-04-16 23:04:14.807605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.766 [2024-04-16 23:04:14.807778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.766 [2024-04-16 23:04:14.807804] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.766 qpair failed and we were unable to recover it. 00:26:23.766 [2024-04-16 23:04:14.807927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.766 [2024-04-16 23:04:14.808061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.766 [2024-04-16 23:04:14.808087] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.766 qpair failed and we were unable to recover it. 00:26:23.766 [2024-04-16 23:04:14.808202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.766 [2024-04-16 23:04:14.808309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.766 [2024-04-16 23:04:14.808335] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.766 qpair failed and we were unable to recover it. 00:26:23.766 [2024-04-16 23:04:14.808461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.766 [2024-04-16 23:04:14.808564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.766 [2024-04-16 23:04:14.808590] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.766 qpair failed and we were unable to recover it. 00:26:23.766 [2024-04-16 23:04:14.808706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.766 [2024-04-16 23:04:14.808833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.766 [2024-04-16 23:04:14.808858] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.766 qpair failed and we were unable to recover it. 00:26:23.766 [2024-04-16 23:04:14.808998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.766 [2024-04-16 23:04:14.809113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.766 [2024-04-16 23:04:14.809138] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.766 qpair failed and we were unable to recover it. 00:26:23.766 [2024-04-16 23:04:14.809251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.766 [2024-04-16 23:04:14.809369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.766 [2024-04-16 23:04:14.809395] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.766 qpair failed and we were unable to recover it. 00:26:23.766 [2024-04-16 23:04:14.809512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.766 [2024-04-16 23:04:14.809658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.766 [2024-04-16 23:04:14.809683] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.766 qpair failed and we were unable to recover it. 00:26:23.766 [2024-04-16 23:04:14.809789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.766 [2024-04-16 23:04:14.809896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.766 [2024-04-16 23:04:14.809921] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.766 qpair failed and we were unable to recover it. 00:26:23.766 [2024-04-16 23:04:14.810031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.766 [2024-04-16 23:04:14.810135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.766 [2024-04-16 23:04:14.810160] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.766 qpair failed and we were unable to recover it. 00:26:23.766 [2024-04-16 23:04:14.810301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.766 [2024-04-16 23:04:14.810416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.766 [2024-04-16 23:04:14.810441] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.766 qpair failed and we were unable to recover it. 00:26:23.766 [2024-04-16 23:04:14.810566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.766 [2024-04-16 23:04:14.810677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.766 [2024-04-16 23:04:14.810703] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.766 qpair failed and we were unable to recover it. 00:26:23.766 [2024-04-16 23:04:14.810821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.766 [2024-04-16 23:04:14.810960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.766 [2024-04-16 23:04:14.810985] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.766 qpair failed and we were unable to recover it. 00:26:23.766 [2024-04-16 23:04:14.811127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.766 [2024-04-16 23:04:14.811247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.766 [2024-04-16 23:04:14.811274] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.766 qpair failed and we were unable to recover it. 00:26:23.766 [2024-04-16 23:04:14.811391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.766 [2024-04-16 23:04:14.811497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.766 [2024-04-16 23:04:14.811523] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.766 qpair failed and we were unable to recover it. 00:26:23.766 [2024-04-16 23:04:14.811639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.766 [2024-04-16 23:04:14.811746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.766 [2024-04-16 23:04:14.811772] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.766 qpair failed and we were unable to recover it. 00:26:23.766 [2024-04-16 23:04:14.811877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.766 [2024-04-16 23:04:14.811981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.766 [2024-04-16 23:04:14.812006] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.766 qpair failed and we were unable to recover it. 00:26:23.766 [2024-04-16 23:04:14.812133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.766 [2024-04-16 23:04:14.812251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.766 [2024-04-16 23:04:14.812278] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.766 qpair failed and we were unable to recover it. 00:26:23.766 [2024-04-16 23:04:14.812390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.766 [2024-04-16 23:04:14.812501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.766 [2024-04-16 23:04:14.812527] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.766 qpair failed and we were unable to recover it. 00:26:23.767 [2024-04-16 23:04:14.812640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.767 [2024-04-16 23:04:14.812786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.767 [2024-04-16 23:04:14.812812] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.767 qpair failed and we were unable to recover it. 00:26:23.767 [2024-04-16 23:04:14.812922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.767 [2024-04-16 23:04:14.813028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.767 [2024-04-16 23:04:14.813053] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.767 qpair failed and we were unable to recover it. 00:26:23.767 [2024-04-16 23:04:14.813192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.767 [2024-04-16 23:04:14.813304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.767 [2024-04-16 23:04:14.813332] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.767 qpair failed and we were unable to recover it. 00:26:23.767 [2024-04-16 23:04:14.813442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.767 [2024-04-16 23:04:14.813556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.767 [2024-04-16 23:04:14.813583] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.767 qpair failed and we were unable to recover it. 00:26:23.767 [2024-04-16 23:04:14.813692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.767 [2024-04-16 23:04:14.813807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.767 [2024-04-16 23:04:14.813834] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.767 qpair failed and we were unable to recover it. 00:26:23.767 [2024-04-16 23:04:14.813946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.767 [2024-04-16 23:04:14.814059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.767 [2024-04-16 23:04:14.814086] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.767 qpair failed and we were unable to recover it. 00:26:23.767 [2024-04-16 23:04:14.814202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.767 [2024-04-16 23:04:14.814327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.767 [2024-04-16 23:04:14.814352] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.767 qpair failed and we were unable to recover it. 00:26:23.767 [2024-04-16 23:04:14.814461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.767 [2024-04-16 23:04:14.814592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.767 [2024-04-16 23:04:14.814617] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.767 qpair failed and we were unable to recover it. 00:26:23.767 [2024-04-16 23:04:14.814747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.767 [2024-04-16 23:04:14.814878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.767 [2024-04-16 23:04:14.814903] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.767 qpair failed and we were unable to recover it. 00:26:23.767 [2024-04-16 23:04:14.815018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.767 [2024-04-16 23:04:14.815133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.767 [2024-04-16 23:04:14.815158] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.767 qpair failed and we were unable to recover it. 00:26:23.767 [2024-04-16 23:04:14.815310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.767 [2024-04-16 23:04:14.815445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.767 [2024-04-16 23:04:14.815471] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.767 qpair failed and we were unable to recover it. 00:26:23.767 [2024-04-16 23:04:14.815584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.767 [2024-04-16 23:04:14.815694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.767 [2024-04-16 23:04:14.815720] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.767 qpair failed and we were unable to recover it. 00:26:23.767 [2024-04-16 23:04:14.815832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.767 [2024-04-16 23:04:14.815943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.767 [2024-04-16 23:04:14.815969] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.767 qpair failed and we were unable to recover it. 00:26:23.767 [2024-04-16 23:04:14.816085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.767 [2024-04-16 23:04:14.816196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.767 [2024-04-16 23:04:14.816222] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.767 qpair failed and we were unable to recover it. 00:26:23.767 [2024-04-16 23:04:14.816360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.767 [2024-04-16 23:04:14.816474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.767 [2024-04-16 23:04:14.816499] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.767 qpair failed and we were unable to recover it. 00:26:23.767 [2024-04-16 23:04:14.816639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.767 [2024-04-16 23:04:14.816746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.767 [2024-04-16 23:04:14.816770] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.767 qpair failed and we were unable to recover it. 00:26:23.767 [2024-04-16 23:04:14.816886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.767 [2024-04-16 23:04:14.817023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.767 [2024-04-16 23:04:14.817048] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.767 qpair failed and we were unable to recover it. 00:26:23.767 [2024-04-16 23:04:14.817161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.767 [2024-04-16 23:04:14.817301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.767 [2024-04-16 23:04:14.817325] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.767 qpair failed and we were unable to recover it. 00:26:23.767 [2024-04-16 23:04:14.817430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.767 [2024-04-16 23:04:14.817584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.767 [2024-04-16 23:04:14.817609] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.767 qpair failed and we were unable to recover it. 00:26:23.767 [2024-04-16 23:04:14.817742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.767 [2024-04-16 23:04:14.817905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.767 [2024-04-16 23:04:14.817930] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.767 qpair failed and we were unable to recover it. 00:26:23.767 [2024-04-16 23:04:14.818074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.767 [2024-04-16 23:04:14.818223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.767 [2024-04-16 23:04:14.818250] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.767 qpair failed and we were unable to recover it. 00:26:23.767 [2024-04-16 23:04:14.818390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.767 [2024-04-16 23:04:14.818500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.767 [2024-04-16 23:04:14.818526] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.767 qpair failed and we were unable to recover it. 00:26:23.767 [2024-04-16 23:04:14.818668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.767 [2024-04-16 23:04:14.818773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.767 [2024-04-16 23:04:14.818797] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.767 qpair failed and we were unable to recover it. 00:26:23.767 [2024-04-16 23:04:14.818912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.767 [2024-04-16 23:04:14.819048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.767 [2024-04-16 23:04:14.819073] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.767 qpair failed and we were unable to recover it. 00:26:23.767 [2024-04-16 23:04:14.819201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.767 [2024-04-16 23:04:14.819345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.767 [2024-04-16 23:04:14.819370] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.767 qpair failed and we were unable to recover it. 00:26:23.767 [2024-04-16 23:04:14.819510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.767 [2024-04-16 23:04:14.819661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.767 [2024-04-16 23:04:14.819685] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.767 qpair failed and we were unable to recover it. 00:26:23.767 [2024-04-16 23:04:14.819794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.767 [2024-04-16 23:04:14.819929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.767 [2024-04-16 23:04:14.819954] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.767 qpair failed and we were unable to recover it. 00:26:23.767 [2024-04-16 23:04:14.820069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.767 [2024-04-16 23:04:14.820245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.767 [2024-04-16 23:04:14.820271] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.767 qpair failed and we were unable to recover it. 00:26:23.767 [2024-04-16 23:04:14.820385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.767 [2024-04-16 23:04:14.820555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.767 [2024-04-16 23:04:14.820581] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.767 qpair failed and we were unable to recover it. 00:26:23.767 [2024-04-16 23:04:14.820690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.767 [2024-04-16 23:04:14.820801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.767 [2024-04-16 23:04:14.820826] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.767 qpair failed and we were unable to recover it. 00:26:23.767 [2024-04-16 23:04:14.820933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.767 [2024-04-16 23:04:14.821041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.767 [2024-04-16 23:04:14.821067] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.767 qpair failed and we were unable to recover it. 00:26:23.767 [2024-04-16 23:04:14.821185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.767 [2024-04-16 23:04:14.821311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.767 [2024-04-16 23:04:14.821336] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.767 qpair failed and we were unable to recover it. 00:26:23.767 [2024-04-16 23:04:14.821486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.767 [2024-04-16 23:04:14.821630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.767 [2024-04-16 23:04:14.821656] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.767 qpair failed and we were unable to recover it. 00:26:23.767 [2024-04-16 23:04:14.821766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.767 [2024-04-16 23:04:14.821873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.767 [2024-04-16 23:04:14.821897] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.767 qpair failed and we were unable to recover it. 00:26:23.767 [2024-04-16 23:04:14.822012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.767 [2024-04-16 23:04:14.822137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.767 [2024-04-16 23:04:14.822162] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.767 qpair failed and we were unable to recover it. 00:26:23.767 [2024-04-16 23:04:14.822298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.767 [2024-04-16 23:04:14.822441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.767 [2024-04-16 23:04:14.822466] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.767 qpair failed and we were unable to recover it. 00:26:23.767 [2024-04-16 23:04:14.822587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.767 [2024-04-16 23:04:14.822725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.767 [2024-04-16 23:04:14.822751] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.767 qpair failed and we were unable to recover it. 00:26:23.767 [2024-04-16 23:04:14.822861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.767 [2024-04-16 23:04:14.823000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.767 [2024-04-16 23:04:14.823025] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.767 qpair failed and we were unable to recover it. 00:26:23.767 [2024-04-16 23:04:14.823137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.767 [2024-04-16 23:04:14.823257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.767 [2024-04-16 23:04:14.823283] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.767 qpair failed and we were unable to recover it. 00:26:23.767 [2024-04-16 23:04:14.823418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.767 [2024-04-16 23:04:14.823565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.767 [2024-04-16 23:04:14.823590] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.767 qpair failed and we were unable to recover it. 00:26:23.767 [2024-04-16 23:04:14.823757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.767 [2024-04-16 23:04:14.823874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.767 [2024-04-16 23:04:14.823901] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.767 qpair failed and we were unable to recover it. 00:26:23.767 [2024-04-16 23:04:14.824045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.767 [2024-04-16 23:04:14.824155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.767 [2024-04-16 23:04:14.824190] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.767 qpair failed and we were unable to recover it. 00:26:23.767 [2024-04-16 23:04:14.824320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.767 [2024-04-16 23:04:14.824442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.767 [2024-04-16 23:04:14.824467] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.767 qpair failed and we were unable to recover it. 00:26:23.767 [2024-04-16 23:04:14.824581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.767 [2024-04-16 23:04:14.824721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.767 [2024-04-16 23:04:14.824746] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.767 qpair failed and we were unable to recover it. 00:26:23.767 [2024-04-16 23:04:14.824864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.767 [2024-04-16 23:04:14.825003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.767 [2024-04-16 23:04:14.825031] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.767 qpair failed and we were unable to recover it. 00:26:23.767 [2024-04-16 23:04:14.825143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.767 [2024-04-16 23:04:14.825296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.767 [2024-04-16 23:04:14.825322] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.767 qpair failed and we were unable to recover it. 00:26:23.767 [2024-04-16 23:04:14.825445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.767 [2024-04-16 23:04:14.825555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.767 [2024-04-16 23:04:14.825579] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.767 qpair failed and we were unable to recover it. 00:26:23.767 [2024-04-16 23:04:14.825702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.767 [2024-04-16 23:04:14.825813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.768 [2024-04-16 23:04:14.825838] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.768 qpair failed and we were unable to recover it. 00:26:23.768 [2024-04-16 23:04:14.825966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.768 [2024-04-16 23:04:14.826093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.768 [2024-04-16 23:04:14.826117] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.768 qpair failed and we were unable to recover it. 00:26:23.768 [2024-04-16 23:04:14.826233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.768 [2024-04-16 23:04:14.826346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.768 [2024-04-16 23:04:14.826372] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.768 qpair failed and we were unable to recover it. 00:26:23.768 [2024-04-16 23:04:14.826490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.768 [2024-04-16 23:04:14.826632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.768 [2024-04-16 23:04:14.826657] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.768 qpair failed and we were unable to recover it. 00:26:23.768 [2024-04-16 23:04:14.826778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.768 [2024-04-16 23:04:14.826904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.768 [2024-04-16 23:04:14.826929] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.768 qpair failed and we were unable to recover it. 00:26:23.768 [2024-04-16 23:04:14.827055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.768 [2024-04-16 23:04:14.827193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.768 [2024-04-16 23:04:14.827219] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.768 qpair failed and we were unable to recover it. 00:26:23.768 [2024-04-16 23:04:14.827362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.768 [2024-04-16 23:04:14.827501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.768 [2024-04-16 23:04:14.827528] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.768 qpair failed and we were unable to recover it. 00:26:23.768 [2024-04-16 23:04:14.827639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.768 [2024-04-16 23:04:14.827757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.768 [2024-04-16 23:04:14.827788] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.768 qpair failed and we were unable to recover it. 00:26:23.768 [2024-04-16 23:04:14.827903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.768 [2024-04-16 23:04:14.828040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.768 [2024-04-16 23:04:14.828065] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.768 qpair failed and we were unable to recover it. 00:26:23.768 [2024-04-16 23:04:14.828204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.768 [2024-04-16 23:04:14.828345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.768 [2024-04-16 23:04:14.828371] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.768 qpair failed and we were unable to recover it. 00:26:23.768 [2024-04-16 23:04:14.828517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.768 [2024-04-16 23:04:14.828625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.768 [2024-04-16 23:04:14.828649] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.768 qpair failed and we were unable to recover it. 00:26:23.768 [2024-04-16 23:04:14.828761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.768 [2024-04-16 23:04:14.828875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.768 [2024-04-16 23:04:14.828900] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.768 qpair failed and we were unable to recover it. 00:26:23.768 [2024-04-16 23:04:14.829018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.768 [2024-04-16 23:04:14.829132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.768 [2024-04-16 23:04:14.829157] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.768 qpair failed and we were unable to recover it. 00:26:23.768 [2024-04-16 23:04:14.829323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.768 [2024-04-16 23:04:14.829441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.768 [2024-04-16 23:04:14.829468] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.768 qpair failed and we were unable to recover it. 00:26:23.768 [2024-04-16 23:04:14.829618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.768 [2024-04-16 23:04:14.829731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.768 [2024-04-16 23:04:14.829756] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.768 qpair failed and we were unable to recover it. 00:26:23.768 [2024-04-16 23:04:14.829876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.768 [2024-04-16 23:04:14.829982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.768 [2024-04-16 23:04:14.830007] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.768 qpair failed and we were unable to recover it. 00:26:23.768 [2024-04-16 23:04:14.830124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.768 [2024-04-16 23:04:14.830269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.768 [2024-04-16 23:04:14.830295] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.768 qpair failed and we were unable to recover it. 00:26:23.768 [2024-04-16 23:04:14.830413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.768 [2024-04-16 23:04:14.830529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.768 [2024-04-16 23:04:14.830563] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.768 qpair failed and we were unable to recover it. 00:26:23.768 [2024-04-16 23:04:14.830700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.768 [2024-04-16 23:04:14.830812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.768 [2024-04-16 23:04:14.830837] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.768 qpair failed and we were unable to recover it. 00:26:23.768 [2024-04-16 23:04:14.830962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.768 [2024-04-16 23:04:14.831074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.768 [2024-04-16 23:04:14.831101] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.768 qpair failed and we were unable to recover it. 00:26:23.768 [2024-04-16 23:04:14.831239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.768 [2024-04-16 23:04:14.831353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.768 [2024-04-16 23:04:14.831377] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.768 qpair failed and we were unable to recover it. 00:26:23.768 [2024-04-16 23:04:14.831491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.768 [2024-04-16 23:04:14.831638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.768 [2024-04-16 23:04:14.831663] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.768 qpair failed and we were unable to recover it. 00:26:23.768 [2024-04-16 23:04:14.831765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.768 [2024-04-16 23:04:14.831880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.768 [2024-04-16 23:04:14.831904] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.768 qpair failed and we were unable to recover it. 00:26:23.768 [2024-04-16 23:04:14.832022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.768 [2024-04-16 23:04:14.832168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.768 [2024-04-16 23:04:14.832197] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.768 qpair failed and we were unable to recover it. 00:26:23.768 [2024-04-16 23:04:14.832317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.768 [2024-04-16 23:04:14.832428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.768 [2024-04-16 23:04:14.832455] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.768 qpair failed and we were unable to recover it. 00:26:23.768 [2024-04-16 23:04:14.832565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.768 [2024-04-16 23:04:14.832680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.768 [2024-04-16 23:04:14.832705] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.768 qpair failed and we were unable to recover it. 00:26:23.768 [2024-04-16 23:04:14.832841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.768 [2024-04-16 23:04:14.832987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.768 [2024-04-16 23:04:14.833013] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.768 qpair failed and we were unable to recover it. 00:26:23.768 [2024-04-16 23:04:14.833119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.768 [2024-04-16 23:04:14.833262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.768 [2024-04-16 23:04:14.833291] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.768 qpair failed and we were unable to recover it. 00:26:23.768 [2024-04-16 23:04:14.833402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.768 [2024-04-16 23:04:14.833542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.768 [2024-04-16 23:04:14.833567] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.768 qpair failed and we were unable to recover it. 00:26:23.768 [2024-04-16 23:04:14.833714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.768 [2024-04-16 23:04:14.833855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.768 [2024-04-16 23:04:14.833879] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.768 qpair failed and we were unable to recover it. 00:26:23.768 [2024-04-16 23:04:14.833987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.768 [2024-04-16 23:04:14.834090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.768 [2024-04-16 23:04:14.834115] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.768 qpair failed and we were unable to recover it. 00:26:23.768 [2024-04-16 23:04:14.834264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.768 [2024-04-16 23:04:14.834371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.768 [2024-04-16 23:04:14.834396] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.768 qpair failed and we were unable to recover it. 00:26:23.768 [2024-04-16 23:04:14.834525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.768 [2024-04-16 23:04:14.834638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.768 [2024-04-16 23:04:14.834662] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.768 qpair failed and we were unable to recover it. 00:26:23.768 [2024-04-16 23:04:14.834796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.768 [2024-04-16 23:04:14.834958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.768 [2024-04-16 23:04:14.834983] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.768 qpair failed and we were unable to recover it. 00:26:23.768 [2024-04-16 23:04:14.835131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.768 [2024-04-16 23:04:14.835333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.768 [2024-04-16 23:04:14.835359] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.768 qpair failed and we were unable to recover it. 00:26:23.768 [2024-04-16 23:04:14.835477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.768 [2024-04-16 23:04:14.835639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.768 [2024-04-16 23:04:14.835665] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.768 qpair failed and we were unable to recover it. 00:26:23.768 [2024-04-16 23:04:14.835815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.768 [2024-04-16 23:04:14.835950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.768 [2024-04-16 23:04:14.835974] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.768 qpair failed and we were unable to recover it. 00:26:23.768 [2024-04-16 23:04:14.836098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.768 [2024-04-16 23:04:14.836218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.768 [2024-04-16 23:04:14.836243] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.768 qpair failed and we were unable to recover it. 00:26:23.768 [2024-04-16 23:04:14.836364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.768 [2024-04-16 23:04:14.836475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.768 [2024-04-16 23:04:14.836501] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.768 qpair failed and we were unable to recover it. 00:26:23.768 [2024-04-16 23:04:14.836636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.768 [2024-04-16 23:04:14.836804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.768 [2024-04-16 23:04:14.836829] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.768 qpair failed and we were unable to recover it. 00:26:23.768 [2024-04-16 23:04:14.836966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.768 [2024-04-16 23:04:14.837080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.768 [2024-04-16 23:04:14.837108] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.768 qpair failed and we were unable to recover it. 00:26:23.768 [2024-04-16 23:04:14.837262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.768 [2024-04-16 23:04:14.837430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.768 [2024-04-16 23:04:14.837455] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.768 qpair failed and we were unable to recover it. 00:26:23.768 [2024-04-16 23:04:14.837604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.768 [2024-04-16 23:04:14.837713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.768 [2024-04-16 23:04:14.837738] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.768 qpair failed and we were unable to recover it. 00:26:23.768 [2024-04-16 23:04:14.837843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.768 [2024-04-16 23:04:14.837980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.768 [2024-04-16 23:04:14.838005] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.768 qpair failed and we were unable to recover it. 00:26:23.768 [2024-04-16 23:04:14.838130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.768 [2024-04-16 23:04:14.838240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.768 [2024-04-16 23:04:14.838266] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.768 qpair failed and we were unable to recover it. 00:26:23.768 [2024-04-16 23:04:14.838388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.768 [2024-04-16 23:04:14.838502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.768 [2024-04-16 23:04:14.838527] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.768 qpair failed and we were unable to recover it. 00:26:23.768 [2024-04-16 23:04:14.838644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.768 [2024-04-16 23:04:14.838754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.768 [2024-04-16 23:04:14.838779] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.768 qpair failed and we were unable to recover it. 00:26:23.768 [2024-04-16 23:04:14.838919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.768 [2024-04-16 23:04:14.839033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.768 [2024-04-16 23:04:14.839057] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.768 qpair failed and we were unable to recover it. 00:26:23.768 [2024-04-16 23:04:14.839190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.768 [2024-04-16 23:04:14.839312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.768 [2024-04-16 23:04:14.839338] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.768 qpair failed and we were unable to recover it. 00:26:23.768 [2024-04-16 23:04:14.839457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.768 [2024-04-16 23:04:14.839561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.768 [2024-04-16 23:04:14.839586] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.768 qpair failed and we were unable to recover it. 00:26:23.768 [2024-04-16 23:04:14.839703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.768 [2024-04-16 23:04:14.839814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.769 [2024-04-16 23:04:14.839838] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.769 qpair failed and we were unable to recover it. 00:26:23.769 [2024-04-16 23:04:14.839960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.769 [2024-04-16 23:04:14.840070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.769 [2024-04-16 23:04:14.840095] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.769 qpair failed and we were unable to recover it. 00:26:23.769 [2024-04-16 23:04:14.840242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.769 [2024-04-16 23:04:14.840384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.769 [2024-04-16 23:04:14.840409] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.769 qpair failed and we were unable to recover it. 00:26:23.769 [2024-04-16 23:04:14.840589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.769 [2024-04-16 23:04:14.840702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.769 [2024-04-16 23:04:14.840727] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.769 qpair failed and we were unable to recover it. 00:26:23.769 [2024-04-16 23:04:14.840865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.769 [2024-04-16 23:04:14.840985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.769 [2024-04-16 23:04:14.841012] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.769 qpair failed and we were unable to recover it. 00:26:23.769 [2024-04-16 23:04:14.841156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.769 [2024-04-16 23:04:14.841304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.769 [2024-04-16 23:04:14.841329] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.769 qpair failed and we were unable to recover it. 00:26:23.769 [2024-04-16 23:04:14.841441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.769 [2024-04-16 23:04:14.841592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.769 [2024-04-16 23:04:14.841618] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.769 qpair failed and we were unable to recover it. 00:26:23.769 [2024-04-16 23:04:14.841759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.769 [2024-04-16 23:04:14.841872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.769 [2024-04-16 23:04:14.841897] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.769 qpair failed and we were unable to recover it. 00:26:23.769 [2024-04-16 23:04:14.842014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.769 [2024-04-16 23:04:14.842128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.769 [2024-04-16 23:04:14.842153] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3ea8000b90 with addr=10.0.0.2, port=4420 00:26:23.769 qpair failed and we were unable to recover it. 00:26:23.769 [2024-04-16 23:04:14.842361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.769 [2024-04-16 23:04:14.842529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.769 [2024-04-16 23:04:14.842564] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:23.769 qpair failed and we were unable to recover it. 00:26:23.769 [2024-04-16 23:04:14.842676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.769 [2024-04-16 23:04:14.842782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.769 [2024-04-16 23:04:14.842808] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:23.769 qpair failed and we were unable to recover it. 00:26:23.769 [2024-04-16 23:04:14.842912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.769 [2024-04-16 23:04:14.843020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.769 [2024-04-16 23:04:14.843045] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:23.769 qpair failed and we were unable to recover it. 00:26:23.769 [2024-04-16 23:04:14.843156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.769 [2024-04-16 23:04:14.843285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.769 [2024-04-16 23:04:14.843310] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:23.769 qpair failed and we were unable to recover it. 00:26:23.769 [2024-04-16 23:04:14.843430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.769 [2024-04-16 23:04:14.843546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.769 [2024-04-16 23:04:14.843573] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:23.769 qpair failed and we were unable to recover it. 00:26:23.769 [2024-04-16 23:04:14.843719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.769 [2024-04-16 23:04:14.843821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.769 [2024-04-16 23:04:14.843846] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:23.769 qpair failed and we were unable to recover it. 00:26:23.769 [2024-04-16 23:04:14.843956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.769 [2024-04-16 23:04:14.844097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.769 [2024-04-16 23:04:14.844121] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:23.769 qpair failed and we were unable to recover it. 00:26:23.769 [2024-04-16 23:04:14.844242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.769 [2024-04-16 23:04:14.844353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.769 [2024-04-16 23:04:14.844378] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:23.769 qpair failed and we were unable to recover it. 00:26:23.769 [2024-04-16 23:04:14.844485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.769 [2024-04-16 23:04:14.844593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.769 [2024-04-16 23:04:14.844628] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:23.769 qpair failed and we were unable to recover it. 00:26:23.769 [2024-04-16 23:04:14.844785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.769 [2024-04-16 23:04:14.844893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.769 [2024-04-16 23:04:14.844918] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:23.769 qpair failed and we were unable to recover it. 00:26:23.769 [2024-04-16 23:04:14.845025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.769 [2024-04-16 23:04:14.845136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.769 [2024-04-16 23:04:14.845161] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:23.769 qpair failed and we were unable to recover it. 00:26:23.769 [2024-04-16 23:04:14.845336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.769 [2024-04-16 23:04:14.845471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.769 [2024-04-16 23:04:14.845496] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:23.769 qpair failed and we were unable to recover it. 00:26:23.769 [2024-04-16 23:04:14.845603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.769 [2024-04-16 23:04:14.845705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.769 [2024-04-16 23:04:14.845730] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:23.769 qpair failed and we were unable to recover it. 00:26:23.769 [2024-04-16 23:04:14.845842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.769 [2024-04-16 23:04:14.846007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.769 [2024-04-16 23:04:14.846032] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:23.769 qpair failed and we were unable to recover it. 00:26:23.769 [2024-04-16 23:04:14.846147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.769 [2024-04-16 23:04:14.846268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.769 [2024-04-16 23:04:14.846295] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:23.769 qpair failed and we were unable to recover it. 00:26:23.769 [2024-04-16 23:04:14.846409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.769 [2024-04-16 23:04:14.846528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.769 [2024-04-16 23:04:14.846553] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:23.769 qpair failed and we were unable to recover it. 00:26:23.769 [2024-04-16 23:04:14.846665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.769 [2024-04-16 23:04:14.846778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.769 [2024-04-16 23:04:14.846804] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:23.769 qpair failed and we were unable to recover it. 00:26:23.769 [2024-04-16 23:04:14.846920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.769 [2024-04-16 23:04:14.847046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.769 [2024-04-16 23:04:14.847082] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:23.769 qpair failed and we were unable to recover it. 00:26:23.769 [2024-04-16 23:04:14.847199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.769 [2024-04-16 23:04:14.847320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.769 [2024-04-16 23:04:14.847345] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:23.769 qpair failed and we were unable to recover it. 00:26:23.769 [2024-04-16 23:04:14.847457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.769 [2024-04-16 23:04:14.847602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.769 [2024-04-16 23:04:14.847628] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:23.769 qpair failed and we were unable to recover it. 00:26:23.769 [2024-04-16 23:04:14.847740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.769 [2024-04-16 23:04:14.847852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.769 [2024-04-16 23:04:14.847877] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:23.769 qpair failed and we were unable to recover it. 00:26:23.769 [2024-04-16 23:04:14.847990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.769 [2024-04-16 23:04:14.848105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.769 [2024-04-16 23:04:14.848132] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:23.769 qpair failed and we were unable to recover it. 00:26:23.769 [2024-04-16 23:04:14.848250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.769 [2024-04-16 23:04:14.848389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.769 [2024-04-16 23:04:14.848415] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:23.769 qpair failed and we were unable to recover it. 00:26:23.769 [2024-04-16 23:04:14.848536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.769 [2024-04-16 23:04:14.848648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.769 [2024-04-16 23:04:14.848675] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:23.769 qpair failed and we were unable to recover it. 00:26:23.769 [2024-04-16 23:04:14.848781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.769 [2024-04-16 23:04:14.848913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.769 [2024-04-16 23:04:14.848938] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:23.769 qpair failed and we were unable to recover it. 00:26:23.769 [2024-04-16 23:04:14.849052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.769 [2024-04-16 23:04:14.849162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.769 [2024-04-16 23:04:14.849199] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:23.769 qpair failed and we were unable to recover it. 00:26:23.769 [2024-04-16 23:04:14.849319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.769 [2024-04-16 23:04:14.849456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.769 [2024-04-16 23:04:14.849482] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:23.769 qpair failed and we were unable to recover it. 00:26:23.769 [2024-04-16 23:04:14.849589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.769 [2024-04-16 23:04:14.849711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.769 [2024-04-16 23:04:14.849737] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:23.769 qpair failed and we were unable to recover it. 00:26:23.769 [2024-04-16 23:04:14.849843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.769 [2024-04-16 23:04:14.849965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.769 [2024-04-16 23:04:14.849990] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:23.769 qpair failed and we were unable to recover it. 00:26:23.769 [2024-04-16 23:04:14.850123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.769 [2024-04-16 23:04:14.850275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.769 [2024-04-16 23:04:14.850300] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:23.769 qpair failed and we were unable to recover it. 00:26:23.769 [2024-04-16 23:04:14.850410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.769 [2024-04-16 23:04:14.850536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.769 [2024-04-16 23:04:14.850561] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:23.769 qpair failed and we were unable to recover it. 00:26:23.769 [2024-04-16 23:04:14.850697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.769 [2024-04-16 23:04:14.850804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.769 [2024-04-16 23:04:14.850828] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:23.769 qpair failed and we were unable to recover it. 00:26:23.769 [2024-04-16 23:04:14.850941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.769 [2024-04-16 23:04:14.851059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.769 [2024-04-16 23:04:14.851085] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:23.769 qpair failed and we were unable to recover it. 00:26:23.769 [2024-04-16 23:04:14.851225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.769 [2024-04-16 23:04:14.851351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.057 [2024-04-16 23:04:14.851376] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:24.058 qpair failed and we were unable to recover it. 00:26:24.058 [2024-04-16 23:04:14.851537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.058 [2024-04-16 23:04:14.851649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.058 [2024-04-16 23:04:14.851675] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:24.058 qpair failed and we were unable to recover it. 00:26:24.058 [2024-04-16 23:04:14.851783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.058 [2024-04-16 23:04:14.851891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.058 [2024-04-16 23:04:14.851917] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:24.058 qpair failed and we were unable to recover it. 00:26:24.058 [2024-04-16 23:04:14.852054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.058 [2024-04-16 23:04:14.852170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.058 [2024-04-16 23:04:14.852200] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:24.058 qpair failed and we were unable to recover it. 00:26:24.058 [2024-04-16 23:04:14.852318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.058 [2024-04-16 23:04:14.852428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.058 [2024-04-16 23:04:14.852453] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:24.058 qpair failed and we were unable to recover it. 00:26:24.058 [2024-04-16 23:04:14.852573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.058 [2024-04-16 23:04:14.852691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.058 [2024-04-16 23:04:14.852727] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:24.058 qpair failed and we were unable to recover it. 00:26:24.058 [2024-04-16 23:04:14.852882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.058 [2024-04-16 23:04:14.853036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.058 [2024-04-16 23:04:14.853065] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:24.058 qpair failed and we were unable to recover it. 00:26:24.058 [2024-04-16 23:04:14.853236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.058 [2024-04-16 23:04:14.853363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.058 [2024-04-16 23:04:14.853390] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:24.058 qpair failed and we were unable to recover it. 00:26:24.058 [2024-04-16 23:04:14.853503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.058 [2024-04-16 23:04:14.853619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.058 [2024-04-16 23:04:14.853644] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:24.058 qpair failed and we were unable to recover it. 00:26:24.058 [2024-04-16 23:04:14.853758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.058 [2024-04-16 23:04:14.853871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.058 [2024-04-16 23:04:14.853897] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:24.058 qpair failed and we were unable to recover it. 00:26:24.058 [2024-04-16 23:04:14.854006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.058 [2024-04-16 23:04:14.854123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.058 [2024-04-16 23:04:14.854148] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:24.058 qpair failed and we were unable to recover it. 00:26:24.058 [2024-04-16 23:04:14.854290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.058 [2024-04-16 23:04:14.854414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.058 [2024-04-16 23:04:14.854439] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:24.058 qpair failed and we were unable to recover it. 00:26:24.058 [2024-04-16 23:04:14.854587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.058 [2024-04-16 23:04:14.854704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.058 [2024-04-16 23:04:14.854730] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:24.058 qpair failed and we were unable to recover it. 00:26:24.058 [2024-04-16 23:04:14.854838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.058 [2024-04-16 23:04:14.854944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.058 [2024-04-16 23:04:14.854969] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:24.058 qpair failed and we were unable to recover it. 00:26:24.058 [2024-04-16 23:04:14.855107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.058 [2024-04-16 23:04:14.855227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.058 [2024-04-16 23:04:14.855252] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:24.058 qpair failed and we were unable to recover it. 00:26:24.058 [2024-04-16 23:04:14.855358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.058 [2024-04-16 23:04:14.855463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.058 [2024-04-16 23:04:14.855500] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:24.058 qpair failed and we were unable to recover it. 00:26:24.058 [2024-04-16 23:04:14.855649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.058 [2024-04-16 23:04:14.855755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.058 [2024-04-16 23:04:14.855780] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:24.058 qpair failed and we were unable to recover it. 00:26:24.058 [2024-04-16 23:04:14.855887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.058 [2024-04-16 23:04:14.855998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.058 [2024-04-16 23:04:14.856022] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:24.058 qpair failed and we were unable to recover it. 00:26:24.058 [2024-04-16 23:04:14.856161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.058 [2024-04-16 23:04:14.856300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.058 [2024-04-16 23:04:14.856327] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:24.058 qpair failed and we were unable to recover it. 00:26:24.058 [2024-04-16 23:04:14.856433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.058 [2024-04-16 23:04:14.856584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.058 [2024-04-16 23:04:14.856608] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:24.058 qpair failed and we were unable to recover it. 00:26:24.058 [2024-04-16 23:04:14.856715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.058 [2024-04-16 23:04:14.856821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.058 [2024-04-16 23:04:14.856845] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:24.058 qpair failed and we were unable to recover it. 00:26:24.058 [2024-04-16 23:04:14.856948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.058 [2024-04-16 23:04:14.857054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.058 [2024-04-16 23:04:14.857079] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:24.058 qpair failed and we were unable to recover it. 00:26:24.058 [2024-04-16 23:04:14.857195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.058 [2024-04-16 23:04:14.857320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.058 [2024-04-16 23:04:14.857345] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:24.058 qpair failed and we were unable to recover it. 00:26:24.058 [2024-04-16 23:04:14.857465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.058 [2024-04-16 23:04:14.857580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.058 [2024-04-16 23:04:14.857605] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:24.058 qpair failed and we were unable to recover it. 00:26:24.058 [2024-04-16 23:04:14.857717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.058 [2024-04-16 23:04:14.857874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.058 [2024-04-16 23:04:14.857900] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:24.058 qpair failed and we were unable to recover it. 00:26:24.058 [2024-04-16 23:04:14.858022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.058 [2024-04-16 23:04:14.858123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.058 [2024-04-16 23:04:14.858148] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:24.058 qpair failed and we were unable to recover it. 00:26:24.058 [2024-04-16 23:04:14.858280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.058 [2024-04-16 23:04:14.858390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.058 [2024-04-16 23:04:14.858420] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:24.058 qpair failed and we were unable to recover it. 00:26:24.058 [2024-04-16 23:04:14.858536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.058 [2024-04-16 23:04:14.858643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.058 [2024-04-16 23:04:14.858670] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:24.058 qpair failed and we were unable to recover it. 00:26:24.058 [2024-04-16 23:04:14.858817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.058 [2024-04-16 23:04:14.858934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.058 [2024-04-16 23:04:14.858958] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:24.058 qpair failed and we were unable to recover it. 00:26:24.058 [2024-04-16 23:04:14.859076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.058 [2024-04-16 23:04:14.859192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.058 [2024-04-16 23:04:14.859218] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:24.058 qpair failed and we were unable to recover it. 00:26:24.058 [2024-04-16 23:04:14.859335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.058 [2024-04-16 23:04:14.859438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.058 [2024-04-16 23:04:14.859463] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:24.058 qpair failed and we were unable to recover it. 00:26:24.058 [2024-04-16 23:04:14.859572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.058 [2024-04-16 23:04:14.859692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.058 [2024-04-16 23:04:14.859716] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:24.058 qpair failed and we were unable to recover it. 00:26:24.058 [2024-04-16 23:04:14.859860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.059 [2024-04-16 23:04:14.859978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.059 [2024-04-16 23:04:14.860002] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:24.059 qpair failed and we were unable to recover it. 00:26:24.059 [2024-04-16 23:04:14.860138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.059 [2024-04-16 23:04:14.860262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.059 [2024-04-16 23:04:14.860287] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:24.059 qpair failed and we were unable to recover it. 00:26:24.059 [2024-04-16 23:04:14.860442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.059 [2024-04-16 23:04:14.860547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.059 [2024-04-16 23:04:14.860573] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:24.059 qpair failed and we were unable to recover it. 00:26:24.059 [2024-04-16 23:04:14.860685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.059 [2024-04-16 23:04:14.860822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.059 [2024-04-16 23:04:14.860846] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:24.059 qpair failed and we were unable to recover it. 00:26:24.059 [2024-04-16 23:04:14.860967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.059 [2024-04-16 23:04:14.861113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.059 [2024-04-16 23:04:14.861142] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:24.059 qpair failed and we were unable to recover it. 00:26:24.059 [2024-04-16 23:04:14.861308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.059 [2024-04-16 23:04:14.861421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.059 [2024-04-16 23:04:14.861445] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:24.059 qpair failed and we were unable to recover it. 00:26:24.059 [2024-04-16 23:04:14.861572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.059 [2024-04-16 23:04:14.861681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.059 [2024-04-16 23:04:14.861708] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:24.059 qpair failed and we were unable to recover it. 00:26:24.059 [2024-04-16 23:04:14.861878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.059 [2024-04-16 23:04:14.861989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.059 [2024-04-16 23:04:14.862015] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:24.059 qpair failed and we were unable to recover it. 00:26:24.059 [2024-04-16 23:04:14.862124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.059 [2024-04-16 23:04:14.862238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.059 [2024-04-16 23:04:14.862264] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:24.059 qpair failed and we were unable to recover it. 00:26:24.059 [2024-04-16 23:04:14.862392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.059 [2024-04-16 23:04:14.862521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.059 [2024-04-16 23:04:14.862550] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:24.059 qpair failed and we were unable to recover it. 00:26:24.059 [2024-04-16 23:04:14.862661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.059 [2024-04-16 23:04:14.862829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.059 [2024-04-16 23:04:14.862853] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:24.059 qpair failed and we were unable to recover it. 00:26:24.059 [2024-04-16 23:04:14.862972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.059 [2024-04-16 23:04:14.863086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.059 [2024-04-16 23:04:14.863111] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:24.059 qpair failed and we were unable to recover it. 00:26:24.059 [2024-04-16 23:04:14.863247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.059 [2024-04-16 23:04:14.863363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.059 [2024-04-16 23:04:14.863388] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:24.059 qpair failed and we were unable to recover it. 00:26:24.059 [2024-04-16 23:04:14.863513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.059 [2024-04-16 23:04:14.863629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.059 [2024-04-16 23:04:14.863653] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:24.059 qpair failed and we were unable to recover it. 00:26:24.059 [2024-04-16 23:04:14.863767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.059 [2024-04-16 23:04:14.863915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.059 [2024-04-16 23:04:14.863939] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:24.059 qpair failed and we were unable to recover it. 00:26:24.059 [2024-04-16 23:04:14.864100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.059 [2024-04-16 23:04:14.864237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.059 [2024-04-16 23:04:14.864264] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:24.059 qpair failed and we were unable to recover it. 00:26:24.059 [2024-04-16 23:04:14.864383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.059 [2024-04-16 23:04:14.864493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.059 [2024-04-16 23:04:14.864518] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:24.059 qpair failed and we were unable to recover it. 00:26:24.059 [2024-04-16 23:04:14.864643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.059 [2024-04-16 23:04:14.864764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.059 [2024-04-16 23:04:14.864791] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:24.059 qpair failed and we were unable to recover it. 00:26:24.059 [2024-04-16 23:04:14.864936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.059 [2024-04-16 23:04:14.865073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.059 [2024-04-16 23:04:14.865098] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:24.059 qpair failed and we were unable to recover it. 00:26:24.059 [2024-04-16 23:04:14.865206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.059 [2024-04-16 23:04:14.865320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.059 [2024-04-16 23:04:14.865345] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:24.059 qpair failed and we were unable to recover it. 00:26:24.059 [2024-04-16 23:04:14.865456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.059 [2024-04-16 23:04:14.865584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.059 [2024-04-16 23:04:14.865609] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:24.059 qpair failed and we were unable to recover it. 00:26:24.059 [2024-04-16 23:04:14.865720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.059 [2024-04-16 23:04:14.865853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.059 [2024-04-16 23:04:14.865878] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:24.059 qpair failed and we were unable to recover it. 00:26:24.059 [2024-04-16 23:04:14.866028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.059 [2024-04-16 23:04:14.866171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.059 [2024-04-16 23:04:14.866202] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:24.059 qpair failed and we were unable to recover it. 00:26:24.059 [2024-04-16 23:04:14.866310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.059 [2024-04-16 23:04:14.866425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.059 [2024-04-16 23:04:14.866449] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:24.059 qpair failed and we were unable to recover it. 00:26:24.059 [2024-04-16 23:04:14.866573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.059 [2024-04-16 23:04:14.866687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.059 [2024-04-16 23:04:14.866712] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:24.059 qpair failed and we were unable to recover it. 00:26:24.059 [2024-04-16 23:04:14.866868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.059 [2024-04-16 23:04:14.866978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.059 [2024-04-16 23:04:14.867004] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:24.059 qpair failed and we were unable to recover it. 00:26:24.059 [2024-04-16 23:04:14.867136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.059 [2024-04-16 23:04:14.867292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.059 [2024-04-16 23:04:14.867318] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:24.059 qpair failed and we were unable to recover it. 00:26:24.059 [2024-04-16 23:04:14.867425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.059 [2024-04-16 23:04:14.867552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.059 [2024-04-16 23:04:14.867577] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:24.059 qpair failed and we were unable to recover it. 00:26:24.059 [2024-04-16 23:04:14.867695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.059 [2024-04-16 23:04:14.867816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.059 [2024-04-16 23:04:14.867840] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:24.059 qpair failed and we were unable to recover it. 00:26:24.059 [2024-04-16 23:04:14.867947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.059 [2024-04-16 23:04:14.868061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.059 [2024-04-16 23:04:14.868086] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:24.059 qpair failed and we were unable to recover it. 00:26:24.059 [2024-04-16 23:04:14.868255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.060 [2024-04-16 23:04:14.868391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.060 [2024-04-16 23:04:14.868416] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:24.060 qpair failed and we were unable to recover it. 00:26:24.060 [2024-04-16 23:04:14.868530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.060 [2024-04-16 23:04:14.868647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.060 [2024-04-16 23:04:14.868672] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:24.060 qpair failed and we were unable to recover it. 00:26:24.060 [2024-04-16 23:04:14.868788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.060 [2024-04-16 23:04:14.868901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.060 [2024-04-16 23:04:14.868926] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:24.060 qpair failed and we were unable to recover it. 00:26:24.060 [2024-04-16 23:04:14.869030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.060 [2024-04-16 23:04:14.869165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.060 [2024-04-16 23:04:14.869198] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:24.060 qpair failed and we were unable to recover it. 00:26:24.060 [2024-04-16 23:04:14.869369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.060 [2024-04-16 23:04:14.869472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.060 [2024-04-16 23:04:14.869497] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:24.060 qpair failed and we were unable to recover it. 00:26:24.060 [2024-04-16 23:04:14.869611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.060 [2024-04-16 23:04:14.869726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.060 [2024-04-16 23:04:14.869751] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:24.060 qpair failed and we were unable to recover it. 00:26:24.060 [2024-04-16 23:04:14.869862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.060 [2024-04-16 23:04:14.870002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.060 [2024-04-16 23:04:14.870027] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:24.060 qpair failed and we were unable to recover it. 00:26:24.060 [2024-04-16 23:04:14.870131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.060 [2024-04-16 23:04:14.870249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.060 [2024-04-16 23:04:14.870275] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:24.060 qpair failed and we were unable to recover it. 00:26:24.060 [2024-04-16 23:04:14.870388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.060 [2024-04-16 23:04:14.870497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.060 [2024-04-16 23:04:14.870523] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:24.060 qpair failed and we were unable to recover it. 00:26:24.060 [2024-04-16 23:04:14.870652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.060 [2024-04-16 23:04:14.870796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.060 [2024-04-16 23:04:14.870821] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:24.060 qpair failed and we were unable to recover it. 00:26:24.060 [2024-04-16 23:04:14.870970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.060 [2024-04-16 23:04:14.871084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.060 [2024-04-16 23:04:14.871108] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:24.060 qpair failed and we were unable to recover it. 00:26:24.060 [2024-04-16 23:04:14.871267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.060 [2024-04-16 23:04:14.871421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.060 [2024-04-16 23:04:14.871446] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:24.060 qpair failed and we were unable to recover it. 00:26:24.060 [2024-04-16 23:04:14.871550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.060 [2024-04-16 23:04:14.871654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.060 [2024-04-16 23:04:14.871678] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:24.060 qpair failed and we were unable to recover it. 00:26:24.060 [2024-04-16 23:04:14.871856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.060 [2024-04-16 23:04:14.871972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.060 [2024-04-16 23:04:14.871997] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:24.060 qpair failed and we were unable to recover it. 00:26:24.060 [2024-04-16 23:04:14.872114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.060 [2024-04-16 23:04:14.872236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.060 [2024-04-16 23:04:14.872262] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:24.060 qpair failed and we were unable to recover it. 00:26:24.060 [2024-04-16 23:04:14.872373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.060 [2024-04-16 23:04:14.872522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.060 [2024-04-16 23:04:14.872547] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:24.060 qpair failed and we were unable to recover it. 00:26:24.060 [2024-04-16 23:04:14.872688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.060 [2024-04-16 23:04:14.872825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.060 [2024-04-16 23:04:14.872850] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:24.060 qpair failed and we were unable to recover it. 00:26:24.060 [2024-04-16 23:04:14.872955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.060 [2024-04-16 23:04:14.873088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.060 [2024-04-16 23:04:14.873113] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:24.060 qpair failed and we were unable to recover it. 00:26:24.060 [2024-04-16 23:04:14.873231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.060 [2024-04-16 23:04:14.873369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.060 [2024-04-16 23:04:14.873393] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:24.060 qpair failed and we were unable to recover it. 00:26:24.060 [2024-04-16 23:04:14.873543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.060 [2024-04-16 23:04:14.873684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.060 [2024-04-16 23:04:14.873709] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:24.060 qpair failed and we were unable to recover it. 00:26:24.060 [2024-04-16 23:04:14.873853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.060 [2024-04-16 23:04:14.873961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.060 [2024-04-16 23:04:14.873985] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:24.060 qpair failed and we were unable to recover it. 00:26:24.060 [2024-04-16 23:04:14.874121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.060 [2024-04-16 23:04:14.874239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.060 [2024-04-16 23:04:14.874264] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:24.060 qpair failed and we were unable to recover it. 00:26:24.060 [2024-04-16 23:04:14.874368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.060 [2024-04-16 23:04:14.874546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.060 [2024-04-16 23:04:14.874570] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:24.060 qpair failed and we were unable to recover it. 00:26:24.060 [2024-04-16 23:04:14.874713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.060 [2024-04-16 23:04:14.874840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.060 [2024-04-16 23:04:14.874865] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:24.060 qpair failed and we were unable to recover it. 00:26:24.060 [2024-04-16 23:04:14.874998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.060 [2024-04-16 23:04:14.875132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.060 [2024-04-16 23:04:14.875156] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:24.060 qpair failed and we were unable to recover it. 00:26:24.060 [2024-04-16 23:04:14.875284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.060 [2024-04-16 23:04:14.875402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.060 [2024-04-16 23:04:14.875430] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:24.060 qpair failed and we were unable to recover it. 00:26:24.060 [2024-04-16 23:04:14.875574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.060 [2024-04-16 23:04:14.875713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.060 [2024-04-16 23:04:14.875738] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:24.060 qpair failed and we were unable to recover it. 00:26:24.060 [2024-04-16 23:04:14.875882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.060 [2024-04-16 23:04:14.875996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.060 [2024-04-16 23:04:14.876021] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:24.060 qpair failed and we were unable to recover it. 00:26:24.060 [2024-04-16 23:04:14.876128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.060 [2024-04-16 23:04:14.876277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.060 [2024-04-16 23:04:14.876303] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:24.060 qpair failed and we were unable to recover it. 00:26:24.060 [2024-04-16 23:04:14.876416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.060 [2024-04-16 23:04:14.876584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.060 [2024-04-16 23:04:14.876609] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:24.060 qpair failed and we were unable to recover it. 00:26:24.060 [2024-04-16 23:04:14.876749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.060 [2024-04-16 23:04:14.876862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.060 [2024-04-16 23:04:14.876887] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:24.060 qpair failed and we were unable to recover it. 00:26:24.060 [2024-04-16 23:04:14.876991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.060 [2024-04-16 23:04:14.877099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.060 [2024-04-16 23:04:14.877124] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:24.060 qpair failed and we were unable to recover it. 00:26:24.060 [2024-04-16 23:04:14.877235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.060 [2024-04-16 23:04:14.877373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.060 [2024-04-16 23:04:14.877398] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:24.060 qpair failed and we were unable to recover it. 00:26:24.060 [2024-04-16 23:04:14.877524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.060 [2024-04-16 23:04:14.877638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.060 [2024-04-16 23:04:14.877662] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:24.060 qpair failed and we were unable to recover it. 00:26:24.060 [2024-04-16 23:04:14.877782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.060 [2024-04-16 23:04:14.877902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.060 [2024-04-16 23:04:14.877927] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:24.060 qpair failed and we were unable to recover it. 00:26:24.060 [2024-04-16 23:04:14.878052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.060 [2024-04-16 23:04:14.878192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.060 [2024-04-16 23:04:14.878217] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:24.060 qpair failed and we were unable to recover it. 00:26:24.060 [2024-04-16 23:04:14.878366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.060 [2024-04-16 23:04:14.878514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.060 [2024-04-16 23:04:14.878539] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:24.060 qpair failed and we were unable to recover it. 00:26:24.060 [2024-04-16 23:04:14.878687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.060 [2024-04-16 23:04:14.878822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.060 [2024-04-16 23:04:14.878847] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:24.060 qpair failed and we were unable to recover it. 00:26:24.060 [2024-04-16 23:04:14.878966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.060 [2024-04-16 23:04:14.879099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.060 [2024-04-16 23:04:14.879125] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:24.060 qpair failed and we were unable to recover it. 00:26:24.060 [2024-04-16 23:04:14.879237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.060 [2024-04-16 23:04:14.879374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.060 [2024-04-16 23:04:14.879398] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:24.060 qpair failed and we were unable to recover it. 00:26:24.060 [2024-04-16 23:04:14.879510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.060 [2024-04-16 23:04:14.879631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.060 [2024-04-16 23:04:14.879656] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:24.060 qpair failed and we were unable to recover it. 00:26:24.060 [2024-04-16 23:04:14.879805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.060 [2024-04-16 23:04:14.879939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.060 [2024-04-16 23:04:14.879964] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:24.060 qpair failed and we were unable to recover it. 00:26:24.060 [2024-04-16 23:04:14.880135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.060 [2024-04-16 23:04:14.880257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.060 [2024-04-16 23:04:14.880283] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:24.060 qpair failed and we were unable to recover it. 00:26:24.060 [2024-04-16 23:04:14.880430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.060 [2024-04-16 23:04:14.880551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.060 [2024-04-16 23:04:14.880575] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:24.060 qpair failed and we were unable to recover it. 00:26:24.060 [2024-04-16 23:04:14.880731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.060 [2024-04-16 23:04:14.880879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.060 [2024-04-16 23:04:14.880904] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:24.060 qpair failed and we were unable to recover it. 00:26:24.060 [2024-04-16 23:04:14.881019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.061 [2024-04-16 23:04:14.881127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.061 [2024-04-16 23:04:14.881152] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:24.061 qpair failed and we were unable to recover it. 00:26:24.061 [2024-04-16 23:04:14.881276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.061 [2024-04-16 23:04:14.881394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.061 [2024-04-16 23:04:14.881419] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:24.061 qpair failed and we were unable to recover it. 00:26:24.061 [2024-04-16 23:04:14.881536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.061 [2024-04-16 23:04:14.881685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.061 [2024-04-16 23:04:14.881710] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:24.061 qpair failed and we were unable to recover it. 00:26:24.061 [2024-04-16 23:04:14.881825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.061 [2024-04-16 23:04:14.881969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.061 [2024-04-16 23:04:14.881993] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:24.061 qpair failed and we were unable to recover it. 00:26:24.061 [2024-04-16 23:04:14.882115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.061 [2024-04-16 23:04:14.882226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.061 [2024-04-16 23:04:14.882252] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:24.061 qpair failed and we were unable to recover it. 00:26:24.061 [2024-04-16 23:04:14.882402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.061 [2024-04-16 23:04:14.882531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.061 [2024-04-16 23:04:14.882564] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:24.061 qpair failed and we were unable to recover it. 00:26:24.061 [2024-04-16 23:04:14.882679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.061 [2024-04-16 23:04:14.882786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.061 [2024-04-16 23:04:14.882811] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:24.061 qpair failed and we were unable to recover it. 00:26:24.061 [2024-04-16 23:04:14.882945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.061 [2024-04-16 23:04:14.883046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.061 [2024-04-16 23:04:14.883071] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:24.061 qpair failed and we were unable to recover it. 00:26:24.061 [2024-04-16 23:04:14.883186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.061 [2024-04-16 23:04:14.883307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.061 [2024-04-16 23:04:14.883332] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:24.061 qpair failed and we were unable to recover it. 00:26:24.061 [2024-04-16 23:04:14.883438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.061 [2024-04-16 23:04:14.883604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.061 [2024-04-16 23:04:14.883629] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:24.061 qpair failed and we were unable to recover it. 00:26:24.061 [2024-04-16 23:04:14.883761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.061 [2024-04-16 23:04:14.883888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.061 [2024-04-16 23:04:14.883913] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:24.061 qpair failed and we were unable to recover it. 00:26:24.061 [2024-04-16 23:04:14.884049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.061 [2024-04-16 23:04:14.884189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.061 [2024-04-16 23:04:14.884214] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:24.061 qpair failed and we were unable to recover it. 00:26:24.061 [2024-04-16 23:04:14.884362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.061 [2024-04-16 23:04:14.884471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.061 [2024-04-16 23:04:14.884496] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:24.061 qpair failed and we were unable to recover it. 00:26:24.061 [2024-04-16 23:04:14.884653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.061 [2024-04-16 23:04:14.884843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.061 [2024-04-16 23:04:14.884868] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:24.061 qpair failed and we were unable to recover it. 00:26:24.061 [2024-04-16 23:04:14.884974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.061 [2024-04-16 23:04:14.885082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.061 [2024-04-16 23:04:14.885107] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:24.061 qpair failed and we were unable to recover it. 00:26:24.061 [2024-04-16 23:04:14.885222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.061 [2024-04-16 23:04:14.885349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.061 [2024-04-16 23:04:14.885374] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:24.061 qpair failed and we were unable to recover it. 00:26:24.061 [2024-04-16 23:04:14.885487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.061 [2024-04-16 23:04:14.885612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.061 [2024-04-16 23:04:14.885638] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:24.061 qpair failed and we were unable to recover it. 00:26:24.061 [2024-04-16 23:04:14.885761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.061 [2024-04-16 23:04:14.885878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.061 [2024-04-16 23:04:14.885903] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:24.061 qpair failed and we were unable to recover it. 00:26:24.061 [2024-04-16 23:04:14.886023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.061 [2024-04-16 23:04:14.886155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.061 [2024-04-16 23:04:14.886197] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:24.061 qpair failed and we were unable to recover it. 00:26:24.061 [2024-04-16 23:04:14.886306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.061 [2024-04-16 23:04:14.886430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.061 [2024-04-16 23:04:14.886455] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:24.061 qpair failed and we were unable to recover it. 00:26:24.061 [2024-04-16 23:04:14.886592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.061 [2024-04-16 23:04:14.886699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.061 [2024-04-16 23:04:14.886726] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:24.061 qpair failed and we were unable to recover it. 00:26:24.061 [2024-04-16 23:04:14.886841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.061 [2024-04-16 23:04:14.886988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.061 [2024-04-16 23:04:14.887014] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:24.061 qpair failed and we were unable to recover it. 00:26:24.061 [2024-04-16 23:04:14.887127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.061 [2024-04-16 23:04:14.887295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.061 [2024-04-16 23:04:14.887322] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:24.061 qpair failed and we were unable to recover it. 00:26:24.061 [2024-04-16 23:04:14.887436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.061 [2024-04-16 23:04:14.887582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.061 [2024-04-16 23:04:14.887607] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:24.061 qpair failed and we were unable to recover it. 00:26:24.061 [2024-04-16 23:04:14.887739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.061 [2024-04-16 23:04:14.887847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.061 [2024-04-16 23:04:14.887872] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:24.061 qpair failed and we were unable to recover it. 00:26:24.061 [2024-04-16 23:04:14.887978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.061 [2024-04-16 23:04:14.888116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.061 [2024-04-16 23:04:14.888141] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:24.061 qpair failed and we were unable to recover it. 00:26:24.061 [2024-04-16 23:04:14.888271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.061 [2024-04-16 23:04:14.888386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.061 [2024-04-16 23:04:14.888411] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:24.061 qpair failed and we were unable to recover it. 00:26:24.061 [2024-04-16 23:04:14.888541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.061 [2024-04-16 23:04:14.888654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.061 [2024-04-16 23:04:14.888679] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:24.061 qpair failed and we were unable to recover it. 00:26:24.061 [2024-04-16 23:04:14.888787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.061 [2024-04-16 23:04:14.888897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.061 [2024-04-16 23:04:14.888921] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:24.061 qpair failed and we were unable to recover it. 00:26:24.061 [2024-04-16 23:04:14.889039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.061 [2024-04-16 23:04:14.889157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.061 [2024-04-16 23:04:14.889196] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:24.061 qpair failed and we were unable to recover it. 00:26:24.061 [2024-04-16 23:04:14.889305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.061 [2024-04-16 23:04:14.889426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.061 [2024-04-16 23:04:14.889453] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:24.061 qpair failed and we were unable to recover it. 00:26:24.061 [2024-04-16 23:04:14.889569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.061 [2024-04-16 23:04:14.889680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.061 [2024-04-16 23:04:14.889709] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:24.061 qpair failed and we were unable to recover it. 00:26:24.061 [2024-04-16 23:04:14.889877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.061 [2024-04-16 23:04:14.889979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.061 [2024-04-16 23:04:14.890004] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:24.061 qpair failed and we were unable to recover it. 00:26:24.061 [2024-04-16 23:04:14.890113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.061 [2024-04-16 23:04:14.890257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.061 [2024-04-16 23:04:14.890283] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:24.061 qpair failed and we were unable to recover it. 00:26:24.061 [2024-04-16 23:04:14.890397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.061 [2024-04-16 23:04:14.890509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.061 [2024-04-16 23:04:14.890534] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:24.061 qpair failed and we were unable to recover it. 00:26:24.061 [2024-04-16 23:04:14.890648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.061 [2024-04-16 23:04:14.890752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.061 [2024-04-16 23:04:14.890777] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:24.061 qpair failed and we were unable to recover it. 00:26:24.061 [2024-04-16 23:04:14.890883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.061 [2024-04-16 23:04:14.890989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.061 [2024-04-16 23:04:14.891014] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:24.061 qpair failed and we were unable to recover it. 00:26:24.061 [2024-04-16 23:04:14.891150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.061 [2024-04-16 23:04:14.891272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.061 [2024-04-16 23:04:14.891298] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:24.061 qpair failed and we were unable to recover it. 00:26:24.061 [2024-04-16 23:04:14.891403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.061 [2024-04-16 23:04:14.891525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.061 [2024-04-16 23:04:14.891554] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:24.061 qpair failed and we were unable to recover it. 00:26:24.061 [2024-04-16 23:04:14.891681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.061 [2024-04-16 23:04:14.891816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.061 [2024-04-16 23:04:14.891840] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:24.061 qpair failed and we were unable to recover it. 00:26:24.062 [2024-04-16 23:04:14.891944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.062 [2024-04-16 23:04:14.892060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.062 [2024-04-16 23:04:14.892085] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:24.062 qpair failed and we were unable to recover it. 00:26:24.062 [2024-04-16 23:04:14.892198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.062 [2024-04-16 23:04:14.892326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.062 [2024-04-16 23:04:14.892351] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:24.062 qpair failed and we were unable to recover it. 00:26:24.062 [2024-04-16 23:04:14.892471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.062 [2024-04-16 23:04:14.892592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.062 [2024-04-16 23:04:14.892616] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:24.062 qpair failed and we were unable to recover it. 00:26:24.062 [2024-04-16 23:04:14.892724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.062 [2024-04-16 23:04:14.892837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.062 [2024-04-16 23:04:14.892862] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:24.062 qpair failed and we were unable to recover it. 00:26:24.062 [2024-04-16 23:04:14.892966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.062 [2024-04-16 23:04:14.893101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.062 [2024-04-16 23:04:14.893126] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:24.062 qpair failed and we were unable to recover it. 00:26:24.062 [2024-04-16 23:04:14.893244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.062 [2024-04-16 23:04:14.893351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.062 [2024-04-16 23:04:14.893376] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:24.062 qpair failed and we were unable to recover it. 00:26:24.062 [2024-04-16 23:04:14.893492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.062 [2024-04-16 23:04:14.893629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.062 [2024-04-16 23:04:14.893655] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:24.062 qpair failed and we were unable to recover it. 00:26:24.062 [2024-04-16 23:04:14.893762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.062 [2024-04-16 23:04:14.893879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.062 [2024-04-16 23:04:14.893904] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:24.062 qpair failed and we were unable to recover it. 00:26:24.062 [2024-04-16 23:04:14.894006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.062 [2024-04-16 23:04:14.894116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.062 [2024-04-16 23:04:14.894143] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:24.062 qpair failed and we were unable to recover it. 00:26:24.062 [2024-04-16 23:04:14.894304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.062 [2024-04-16 23:04:14.894420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.062 [2024-04-16 23:04:14.894445] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:24.062 qpair failed and we were unable to recover it. 00:26:24.062 [2024-04-16 23:04:14.894595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.062 [2024-04-16 23:04:14.894726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.062 [2024-04-16 23:04:14.894751] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:24.062 qpair failed and we were unable to recover it. 00:26:24.062 [2024-04-16 23:04:14.894885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.062 [2024-04-16 23:04:14.895020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.062 [2024-04-16 23:04:14.895045] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:24.062 qpair failed and we were unable to recover it. 00:26:24.062 [2024-04-16 23:04:14.895195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.062 [2024-04-16 23:04:14.895333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.062 [2024-04-16 23:04:14.895358] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:24.062 qpair failed and we were unable to recover it. 00:26:24.062 [2024-04-16 23:04:14.895464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.062 [2024-04-16 23:04:14.895587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.062 [2024-04-16 23:04:14.895611] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:24.062 qpair failed and we were unable to recover it. 00:26:24.062 [2024-04-16 23:04:14.895752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.062 [2024-04-16 23:04:14.895859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.062 [2024-04-16 23:04:14.895885] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:24.062 qpair failed and we were unable to recover it. 00:26:24.062 [2024-04-16 23:04:14.895990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.062 [2024-04-16 23:04:14.896126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.062 [2024-04-16 23:04:14.896151] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:24.062 qpair failed and we were unable to recover it. 00:26:24.062 [2024-04-16 23:04:14.896271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.062 [2024-04-16 23:04:14.896388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.062 [2024-04-16 23:04:14.896412] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:24.062 qpair failed and we were unable to recover it. 00:26:24.062 [2024-04-16 23:04:14.896523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.062 [2024-04-16 23:04:14.896654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.062 [2024-04-16 23:04:14.896678] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:24.062 qpair failed and we were unable to recover it. 00:26:24.062 [2024-04-16 23:04:14.896781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.062 [2024-04-16 23:04:14.896933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.062 [2024-04-16 23:04:14.896958] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:24.062 qpair failed and we were unable to recover it. 00:26:24.062 [2024-04-16 23:04:14.897060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.062 [2024-04-16 23:04:14.897169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.062 [2024-04-16 23:04:14.897198] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:24.062 qpair failed and we were unable to recover it. 00:26:24.062 [2024-04-16 23:04:14.897317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.062 [2024-04-16 23:04:14.897431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.062 [2024-04-16 23:04:14.897456] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:24.062 qpair failed and we were unable to recover it. 00:26:24.062 [2024-04-16 23:04:14.897558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.062 [2024-04-16 23:04:14.897677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.062 [2024-04-16 23:04:14.897701] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:24.062 qpair failed and we were unable to recover it. 00:26:24.062 [2024-04-16 23:04:14.897819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.062 [2024-04-16 23:04:14.897959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.062 [2024-04-16 23:04:14.897983] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:24.062 qpair failed and we were unable to recover it. 00:26:24.062 [2024-04-16 23:04:14.898095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.062 [2024-04-16 23:04:14.898234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.062 [2024-04-16 23:04:14.898259] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:24.062 qpair failed and we were unable to recover it. 00:26:24.062 [2024-04-16 23:04:14.898396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.062 [2024-04-16 23:04:14.898500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.062 [2024-04-16 23:04:14.898525] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:24.062 qpair failed and we were unable to recover it. 00:26:24.062 [2024-04-16 23:04:14.898674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.062 [2024-04-16 23:04:14.898794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.062 [2024-04-16 23:04:14.898818] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:24.062 qpair failed and we were unable to recover it. 00:26:24.062 [2024-04-16 23:04:14.898921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.062 [2024-04-16 23:04:14.899088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.062 [2024-04-16 23:04:14.899113] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:24.062 qpair failed and we were unable to recover it. 00:26:24.062 [2024-04-16 23:04:14.899240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.062 [2024-04-16 23:04:14.899378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.062 [2024-04-16 23:04:14.899406] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:24.062 qpair failed and we were unable to recover it. 00:26:24.062 [2024-04-16 23:04:14.899526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.062 [2024-04-16 23:04:14.899640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.062 [2024-04-16 23:04:14.899664] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:24.062 qpair failed and we were unable to recover it. 00:26:24.062 [2024-04-16 23:04:14.899834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.062 [2024-04-16 23:04:14.899954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.062 [2024-04-16 23:04:14.899978] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:24.062 qpair failed and we were unable to recover it. 00:26:24.062 [2024-04-16 23:04:14.900092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.062 [2024-04-16 23:04:14.900220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.062 [2024-04-16 23:04:14.900247] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:24.062 qpair failed and we were unable to recover it. 00:26:24.062 [2024-04-16 23:04:14.900379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.062 [2024-04-16 23:04:14.900523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.062 [2024-04-16 23:04:14.900548] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:24.062 qpair failed and we were unable to recover it. 00:26:24.062 [2024-04-16 23:04:14.900653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.062 [2024-04-16 23:04:14.900765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.062 [2024-04-16 23:04:14.900790] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:24.062 qpair failed and we were unable to recover it. 00:26:24.062 [2024-04-16 23:04:14.900913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.062 [2024-04-16 23:04:14.901087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.062 [2024-04-16 23:04:14.901112] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:24.062 qpair failed and we were unable to recover it. 00:26:24.062 [2024-04-16 23:04:14.901229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.062 [2024-04-16 23:04:14.901339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.062 [2024-04-16 23:04:14.901364] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:24.062 qpair failed and we were unable to recover it. 00:26:24.062 [2024-04-16 23:04:14.901474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.062 [2024-04-16 23:04:14.901602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.062 [2024-04-16 23:04:14.901627] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:24.062 qpair failed and we were unable to recover it. 00:26:24.062 [2024-04-16 23:04:14.901768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.062 [2024-04-16 23:04:14.901908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.062 [2024-04-16 23:04:14.901944] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:24.062 qpair failed and we were unable to recover it. 00:26:24.062 [2024-04-16 23:04:14.902064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.062 [2024-04-16 23:04:14.902180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.062 [2024-04-16 23:04:14.902205] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:24.062 qpair failed and we were unable to recover it. 00:26:24.062 [2024-04-16 23:04:14.902316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.062 [2024-04-16 23:04:14.902434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.062 [2024-04-16 23:04:14.902459] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:24.062 qpair failed and we were unable to recover it. 00:26:24.062 [2024-04-16 23:04:14.902573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.062 [2024-04-16 23:04:14.902689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.062 [2024-04-16 23:04:14.902713] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:24.062 qpair failed and we were unable to recover it. 00:26:24.062 [2024-04-16 23:04:14.902829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.062 [2024-04-16 23:04:14.902945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.062 [2024-04-16 23:04:14.902969] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:24.062 qpair failed and we were unable to recover it. 00:26:24.062 [2024-04-16 23:04:14.903094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.062 [2024-04-16 23:04:14.903236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.062 [2024-04-16 23:04:14.903262] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:24.062 qpair failed and we were unable to recover it. 00:26:24.062 [2024-04-16 23:04:14.903403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.062 [2024-04-16 23:04:14.903524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.062 [2024-04-16 23:04:14.903553] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:24.062 qpair failed and we were unable to recover it. 00:26:24.062 [2024-04-16 23:04:14.903672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.062 [2024-04-16 23:04:14.903777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.062 [2024-04-16 23:04:14.903801] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:24.062 qpair failed and we were unable to recover it. 00:26:24.062 [2024-04-16 23:04:14.903916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.062 [2024-04-16 23:04:14.904083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.062 [2024-04-16 23:04:14.904108] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:24.062 qpair failed and we were unable to recover it. 00:26:24.062 [2024-04-16 23:04:14.904242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.062 [2024-04-16 23:04:14.904400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.062 [2024-04-16 23:04:14.904425] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:24.062 qpair failed and we were unable to recover it. 00:26:24.062 [2024-04-16 23:04:14.904545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.063 [2024-04-16 23:04:14.904695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.063 [2024-04-16 23:04:14.904720] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:24.063 qpair failed and we were unable to recover it. 00:26:24.063 [2024-04-16 23:04:14.904872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.063 [2024-04-16 23:04:14.905018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.063 [2024-04-16 23:04:14.905043] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:24.063 qpair failed and we were unable to recover it. 00:26:24.063 [2024-04-16 23:04:14.905198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.063 [2024-04-16 23:04:14.905314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.063 [2024-04-16 23:04:14.905339] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:24.063 qpair failed and we were unable to recover it. 00:26:24.063 [2024-04-16 23:04:14.905494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.063 [2024-04-16 23:04:14.905612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.063 [2024-04-16 23:04:14.905637] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:24.063 qpair failed and we were unable to recover it. 00:26:24.063 [2024-04-16 23:04:14.905749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.063 [2024-04-16 23:04:14.905862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.063 [2024-04-16 23:04:14.905886] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:24.063 qpair failed and we were unable to recover it. 00:26:24.063 [2024-04-16 23:04:14.906025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.063 [2024-04-16 23:04:14.906134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.063 [2024-04-16 23:04:14.906159] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:24.063 qpair failed and we were unable to recover it. 00:26:24.063 [2024-04-16 23:04:14.906305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.063 [2024-04-16 23:04:14.906414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.063 [2024-04-16 23:04:14.906443] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:24.063 qpair failed and we were unable to recover it. 00:26:24.063 [2024-04-16 23:04:14.906551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.063 [2024-04-16 23:04:14.906662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.063 [2024-04-16 23:04:14.906686] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:24.063 qpair failed and we were unable to recover it. 00:26:24.063 [2024-04-16 23:04:14.906796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.063 [2024-04-16 23:04:14.906899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.063 [2024-04-16 23:04:14.906924] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:24.063 qpair failed and we were unable to recover it. 00:26:24.063 [2024-04-16 23:04:14.907044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.063 [2024-04-16 23:04:14.907146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.063 [2024-04-16 23:04:14.907171] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:24.063 qpair failed and we were unable to recover it. 00:26:24.063 [2024-04-16 23:04:14.907330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.063 [2024-04-16 23:04:14.907441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.063 [2024-04-16 23:04:14.907466] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:24.063 qpair failed and we were unable to recover it. 00:26:24.063 [2024-04-16 23:04:14.907614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.063 [2024-04-16 23:04:14.907729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.063 [2024-04-16 23:04:14.907754] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:24.063 qpair failed and we were unable to recover it. 00:26:24.063 [2024-04-16 23:04:14.907888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.063 [2024-04-16 23:04:14.907998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.063 [2024-04-16 23:04:14.908022] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:24.063 qpair failed and we were unable to recover it. 00:26:24.063 [2024-04-16 23:04:14.908155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.063 [2024-04-16 23:04:14.908278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.063 [2024-04-16 23:04:14.908303] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:24.063 qpair failed and we were unable to recover it. 00:26:24.063 [2024-04-16 23:04:14.908458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.063 [2024-04-16 23:04:14.908593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.063 [2024-04-16 23:04:14.908617] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:24.063 qpair failed and we were unable to recover it. 00:26:24.063 [2024-04-16 23:04:14.908731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.063 [2024-04-16 23:04:14.908846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.063 [2024-04-16 23:04:14.908871] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:24.063 qpair failed and we were unable to recover it. 00:26:24.063 [2024-04-16 23:04:14.909015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.063 [2024-04-16 23:04:14.909123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.063 [2024-04-16 23:04:14.909148] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:24.063 qpair failed and we were unable to recover it. 00:26:24.063 [2024-04-16 23:04:14.909284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.063 [2024-04-16 23:04:14.909393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.063 [2024-04-16 23:04:14.909417] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:24.063 qpair failed and we were unable to recover it. 00:26:24.063 [2024-04-16 23:04:14.909535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.063 [2024-04-16 23:04:14.909647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.063 [2024-04-16 23:04:14.909672] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:24.063 qpair failed and we were unable to recover it. 00:26:24.063 [2024-04-16 23:04:14.909782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.063 [2024-04-16 23:04:14.909894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.063 [2024-04-16 23:04:14.909919] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:24.063 qpair failed and we were unable to recover it. 00:26:24.063 [2024-04-16 23:04:14.910038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.063 [2024-04-16 23:04:14.910170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.063 [2024-04-16 23:04:14.910201] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:24.063 qpair failed and we were unable to recover it. 00:26:24.063 [2024-04-16 23:04:14.910323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.063 [2024-04-16 23:04:14.910475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.063 [2024-04-16 23:04:14.910500] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:24.063 qpair failed and we were unable to recover it. 00:26:24.063 [2024-04-16 23:04:14.910634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.063 [2024-04-16 23:04:14.910742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.063 [2024-04-16 23:04:14.910767] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:24.063 qpair failed and we were unable to recover it. 00:26:24.063 [2024-04-16 23:04:14.910886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.063 [2024-04-16 23:04:14.911018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.063 [2024-04-16 23:04:14.911043] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:24.063 qpair failed and we were unable to recover it. 00:26:24.063 [2024-04-16 23:04:14.911156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.063 [2024-04-16 23:04:14.911311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.063 [2024-04-16 23:04:14.911337] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:24.063 qpair failed and we were unable to recover it. 00:26:24.063 [2024-04-16 23:04:14.911441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.063 [2024-04-16 23:04:14.911552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.063 [2024-04-16 23:04:14.911577] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:24.063 qpair failed and we were unable to recover it. 00:26:24.063 [2024-04-16 23:04:14.911698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.063 [2024-04-16 23:04:14.911839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.063 [2024-04-16 23:04:14.911864] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:24.063 qpair failed and we were unable to recover it. 00:26:24.063 [2024-04-16 23:04:14.912005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.063 [2024-04-16 23:04:14.912121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.063 [2024-04-16 23:04:14.912145] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:24.063 qpair failed and we were unable to recover it. 00:26:24.063 [2024-04-16 23:04:14.912265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.063 [2024-04-16 23:04:14.912377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.063 [2024-04-16 23:04:14.912402] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:24.063 qpair failed and we were unable to recover it. 00:26:24.063 [2024-04-16 23:04:14.912554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.063 [2024-04-16 23:04:14.912681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.063 [2024-04-16 23:04:14.912709] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:24.063 qpair failed and we were unable to recover it. 00:26:24.063 [2024-04-16 23:04:14.912840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.063 [2024-04-16 23:04:14.912982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.063 [2024-04-16 23:04:14.913007] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:24.063 qpair failed and we were unable to recover it. 00:26:24.063 [2024-04-16 23:04:14.913121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.063 [2024-04-16 23:04:14.913246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.063 [2024-04-16 23:04:14.913272] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:24.063 qpair failed and we were unable to recover it. 00:26:24.063 [2024-04-16 23:04:14.913394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.063 [2024-04-16 23:04:14.913508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.063 [2024-04-16 23:04:14.913533] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:24.063 qpair failed and we were unable to recover it. 00:26:24.063 [2024-04-16 23:04:14.913652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.063 [2024-04-16 23:04:14.913793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.063 [2024-04-16 23:04:14.913818] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:24.063 qpair failed and we were unable to recover it. 00:26:24.063 [2024-04-16 23:04:14.913941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.063 [2024-04-16 23:04:14.914054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.063 [2024-04-16 23:04:14.914079] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:24.063 qpair failed and we were unable to recover it. 00:26:24.063 [2024-04-16 23:04:14.914198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.063 [2024-04-16 23:04:14.914311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.063 [2024-04-16 23:04:14.914336] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:24.063 qpair failed and we were unable to recover it. 00:26:24.063 [2024-04-16 23:04:14.914438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.063 [2024-04-16 23:04:14.914549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.063 [2024-04-16 23:04:14.914573] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:24.063 qpair failed and we were unable to recover it. 00:26:24.063 [2024-04-16 23:04:14.914676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.063 [2024-04-16 23:04:14.914790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.063 [2024-04-16 23:04:14.914815] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:24.063 qpair failed and we were unable to recover it. 00:26:24.063 [2024-04-16 23:04:14.914933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.063 [2024-04-16 23:04:14.915069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.063 [2024-04-16 23:04:14.915094] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:24.063 qpair failed and we were unable to recover it. 00:26:24.063 [2024-04-16 23:04:14.915230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.063 [2024-04-16 23:04:14.915361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.063 [2024-04-16 23:04:14.915386] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:24.063 qpair failed and we were unable to recover it. 00:26:24.063 [2024-04-16 23:04:14.915502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.063 [2024-04-16 23:04:14.915618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.063 [2024-04-16 23:04:14.915642] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:24.063 qpair failed and we were unable to recover it. 00:26:24.063 [2024-04-16 23:04:14.915778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.063 [2024-04-16 23:04:14.915885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.063 [2024-04-16 23:04:14.915910] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:24.063 qpair failed and we were unable to recover it. 00:26:24.063 [2024-04-16 23:04:14.916054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.063 [2024-04-16 23:04:14.916193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.063 [2024-04-16 23:04:14.916219] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:24.063 qpair failed and we were unable to recover it. 00:26:24.063 [2024-04-16 23:04:14.916340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.063 [2024-04-16 23:04:14.916453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.063 [2024-04-16 23:04:14.916486] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:24.063 qpair failed and we were unable to recover it. 00:26:24.063 [2024-04-16 23:04:14.916605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.063 [2024-04-16 23:04:14.916739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.063 [2024-04-16 23:04:14.916763] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:24.063 qpair failed and we were unable to recover it. 00:26:24.063 [2024-04-16 23:04:14.916899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.063 [2024-04-16 23:04:14.917020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.063 [2024-04-16 23:04:14.917045] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:24.063 qpair failed and we were unable to recover it. 00:26:24.063 [2024-04-16 23:04:14.917183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.063 [2024-04-16 23:04:14.917290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.064 [2024-04-16 23:04:14.917314] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:24.064 qpair failed and we were unable to recover it. 00:26:24.064 [2024-04-16 23:04:14.917421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.064 [2024-04-16 23:04:14.917542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.064 [2024-04-16 23:04:14.917567] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:24.064 qpair failed and we were unable to recover it. 00:26:24.064 [2024-04-16 23:04:14.917674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.064 [2024-04-16 23:04:14.917779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.064 [2024-04-16 23:04:14.917804] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:24.064 qpair failed and we were unable to recover it. 00:26:24.064 [2024-04-16 23:04:14.917914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.064 [2024-04-16 23:04:14.918029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.064 [2024-04-16 23:04:14.918053] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:24.064 qpair failed and we were unable to recover it. 00:26:24.064 [2024-04-16 23:04:14.918190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.064 [2024-04-16 23:04:14.918300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.064 [2024-04-16 23:04:14.918324] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:24.064 qpair failed and we were unable to recover it. 00:26:24.064 [2024-04-16 23:04:14.918442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.064 [2024-04-16 23:04:14.918586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.064 [2024-04-16 23:04:14.918610] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:24.064 qpair failed and we were unable to recover it. 00:26:24.064 [2024-04-16 23:04:14.918723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.064 [2024-04-16 23:04:14.918838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.064 [2024-04-16 23:04:14.918863] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:24.064 qpair failed and we were unable to recover it. 00:26:24.064 [2024-04-16 23:04:14.918979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.064 [2024-04-16 23:04:14.919084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.064 [2024-04-16 23:04:14.919109] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:24.064 qpair failed and we were unable to recover it. 00:26:24.064 [2024-04-16 23:04:14.919244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.064 [2024-04-16 23:04:14.919351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.064 [2024-04-16 23:04:14.919376] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:24.064 qpair failed and we were unable to recover it. 00:26:24.064 [2024-04-16 23:04:14.919508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.064 [2024-04-16 23:04:14.919618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.064 [2024-04-16 23:04:14.919643] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:24.064 qpair failed and we were unable to recover it. 00:26:24.064 [2024-04-16 23:04:14.919747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.064 [2024-04-16 23:04:14.919881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.064 [2024-04-16 23:04:14.919906] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:24.064 qpair failed and we were unable to recover it. 00:26:24.064 [2024-04-16 23:04:14.920015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.064 [2024-04-16 23:04:14.920131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.064 [2024-04-16 23:04:14.920160] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:24.064 qpair failed and we were unable to recover it. 00:26:24.064 [2024-04-16 23:04:14.920304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.064 [2024-04-16 23:04:14.920422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.064 [2024-04-16 23:04:14.920447] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:24.064 qpair failed and we were unable to recover it. 00:26:24.064 [2024-04-16 23:04:14.920561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.064 [2024-04-16 23:04:14.920673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.064 [2024-04-16 23:04:14.920704] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:24.064 qpair failed and we were unable to recover it. 00:26:24.064 [2024-04-16 23:04:14.920810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.064 [2024-04-16 23:04:14.920916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.064 [2024-04-16 23:04:14.920941] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:24.064 qpair failed and we were unable to recover it. 00:26:24.064 [2024-04-16 23:04:14.921059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.064 [2024-04-16 23:04:14.921168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.064 [2024-04-16 23:04:14.921199] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:24.064 qpair failed and we were unable to recover it. 00:26:24.064 [2024-04-16 23:04:14.921342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.064 [2024-04-16 23:04:14.921455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.064 [2024-04-16 23:04:14.921484] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:24.064 qpair failed and we were unable to recover it. 00:26:24.064 [2024-04-16 23:04:14.921597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.064 [2024-04-16 23:04:14.921716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.064 [2024-04-16 23:04:14.921742] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:24.064 qpair failed and we were unable to recover it. 00:26:24.064 [2024-04-16 23:04:14.921861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.064 [2024-04-16 23:04:14.921997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.064 [2024-04-16 23:04:14.922022] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:24.064 qpair failed and we were unable to recover it. 00:26:24.064 [2024-04-16 23:04:14.922134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.064 [2024-04-16 23:04:14.922298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.064 [2024-04-16 23:04:14.922324] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:24.064 qpair failed and we were unable to recover it. 00:26:24.064 [2024-04-16 23:04:14.922443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.064 [2024-04-16 23:04:14.922610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.064 [2024-04-16 23:04:14.922635] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:24.064 qpair failed and we were unable to recover it. 00:26:24.064 [2024-04-16 23:04:14.922738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.064 [2024-04-16 23:04:14.922848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.064 [2024-04-16 23:04:14.922873] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:24.064 qpair failed and we were unable to recover it. 00:26:24.064 [2024-04-16 23:04:14.922983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.064 [2024-04-16 23:04:14.923118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.064 [2024-04-16 23:04:14.923143] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:24.064 qpair failed and we were unable to recover it. 00:26:24.064 [2024-04-16 23:04:14.923272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.064 [2024-04-16 23:04:14.923411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.064 [2024-04-16 23:04:14.923436] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:24.064 qpair failed and we were unable to recover it. 00:26:24.064 [2024-04-16 23:04:14.923544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.064 [2024-04-16 23:04:14.923661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.064 [2024-04-16 23:04:14.923685] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:24.064 qpair failed and we were unable to recover it. 00:26:24.064 [2024-04-16 23:04:14.923831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.064 [2024-04-16 23:04:14.923943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.064 [2024-04-16 23:04:14.923970] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:24.064 qpair failed and we were unable to recover it. 00:26:24.064 [2024-04-16 23:04:14.924118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.064 [2024-04-16 23:04:14.924250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.064 [2024-04-16 23:04:14.924277] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:24.064 qpair failed and we were unable to recover it. 00:26:24.064 [2024-04-16 23:04:14.924391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.064 [2024-04-16 23:04:14.924538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.064 [2024-04-16 23:04:14.924563] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:24.064 qpair failed and we were unable to recover it. 00:26:24.064 [2024-04-16 23:04:14.924667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.064 [2024-04-16 23:04:14.924785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.064 [2024-04-16 23:04:14.924810] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:24.064 qpair failed and we were unable to recover it. 00:26:24.064 [2024-04-16 23:04:14.924924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.064 [2024-04-16 23:04:14.925037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.064 [2024-04-16 23:04:14.925062] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:24.064 qpair failed and we were unable to recover it. 00:26:24.064 [2024-04-16 23:04:14.925201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.064 [2024-04-16 23:04:14.925336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.064 [2024-04-16 23:04:14.925360] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:24.064 qpair failed and we were unable to recover it. 00:26:24.064 [2024-04-16 23:04:14.925475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.064 [2024-04-16 23:04:14.925621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.064 [2024-04-16 23:04:14.925646] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:24.064 qpair failed and we were unable to recover it. 00:26:24.064 [2024-04-16 23:04:14.925766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.064 [2024-04-16 23:04:14.925903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.064 [2024-04-16 23:04:14.925929] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:24.064 qpair failed and we were unable to recover it. 00:26:24.064 [2024-04-16 23:04:14.926040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.064 [2024-04-16 23:04:14.926154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.064 [2024-04-16 23:04:14.926196] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:24.064 qpair failed and we were unable to recover it. 00:26:24.064 [2024-04-16 23:04:14.926301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.064 [2024-04-16 23:04:14.926415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.064 [2024-04-16 23:04:14.926440] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:24.064 qpair failed and we were unable to recover it. 00:26:24.064 [2024-04-16 23:04:14.926616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.064 [2024-04-16 23:04:14.926728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.064 [2024-04-16 23:04:14.926753] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:24.064 qpair failed and we were unable to recover it. 00:26:24.064 [2024-04-16 23:04:14.926890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.064 [2024-04-16 23:04:14.927043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.064 [2024-04-16 23:04:14.927068] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:24.064 qpair failed and we were unable to recover it. 00:26:24.064 [2024-04-16 23:04:14.927208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.064 [2024-04-16 23:04:14.927364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.064 [2024-04-16 23:04:14.927390] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:24.064 qpair failed and we were unable to recover it. 00:26:24.064 [2024-04-16 23:04:14.927539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.064 [2024-04-16 23:04:14.927677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.064 [2024-04-16 23:04:14.927702] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:24.064 qpair failed and we were unable to recover it. 00:26:24.064 [2024-04-16 23:04:14.927817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.064 [2024-04-16 23:04:14.927922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.064 [2024-04-16 23:04:14.927947] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:24.064 qpair failed and we were unable to recover it. 00:26:24.064 [2024-04-16 23:04:14.928050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.064 [2024-04-16 23:04:14.928164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.064 [2024-04-16 23:04:14.928196] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:24.064 qpair failed and we were unable to recover it. 00:26:24.064 [2024-04-16 23:04:14.928346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.064 [2024-04-16 23:04:14.928459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.065 [2024-04-16 23:04:14.928484] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:24.065 qpair failed and we were unable to recover it. 00:26:24.065 [2024-04-16 23:04:14.928606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.065 [2024-04-16 23:04:14.928762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.065 [2024-04-16 23:04:14.928788] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:24.065 qpair failed and we were unable to recover it. 00:26:24.065 [2024-04-16 23:04:14.928892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.065 [2024-04-16 23:04:14.929037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.065 [2024-04-16 23:04:14.929062] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:24.065 qpair failed and we were unable to recover it. 00:26:24.065 [2024-04-16 23:04:14.929162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.065 [2024-04-16 23:04:14.929279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.065 [2024-04-16 23:04:14.929305] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:24.065 qpair failed and we were unable to recover it. 00:26:24.065 [2024-04-16 23:04:14.929444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.065 [2024-04-16 23:04:14.929556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.065 [2024-04-16 23:04:14.929580] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:24.065 qpair failed and we were unable to recover it. 00:26:24.065 [2024-04-16 23:04:14.929698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.065 [2024-04-16 23:04:14.929821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.065 [2024-04-16 23:04:14.929846] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:24.065 qpair failed and we were unable to recover it. 00:26:24.065 [2024-04-16 23:04:14.929966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.065 [2024-04-16 23:04:14.930077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.065 [2024-04-16 23:04:14.930101] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:24.065 qpair failed and we were unable to recover it. 00:26:24.065 [2024-04-16 23:04:14.930218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.065 [2024-04-16 23:04:14.930387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.065 [2024-04-16 23:04:14.930412] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:24.065 qpair failed and we were unable to recover it. 00:26:24.065 [2024-04-16 23:04:14.930532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.065 [2024-04-16 23:04:14.930668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.065 [2024-04-16 23:04:14.930692] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:24.065 qpair failed and we were unable to recover it. 00:26:24.065 [2024-04-16 23:04:14.930822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.065 [2024-04-16 23:04:14.930996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.065 [2024-04-16 23:04:14.931021] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:24.065 qpair failed and we were unable to recover it. 00:26:24.065 [2024-04-16 23:04:14.931155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.065 [2024-04-16 23:04:14.931308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.065 [2024-04-16 23:04:14.931333] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:24.065 qpair failed and we were unable to recover it. 00:26:24.065 [2024-04-16 23:04:14.931441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.065 [2024-04-16 23:04:14.931562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.065 [2024-04-16 23:04:14.931587] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:24.065 qpair failed and we were unable to recover it. 00:26:24.065 [2024-04-16 23:04:14.931711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.065 [2024-04-16 23:04:14.931822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.065 [2024-04-16 23:04:14.931848] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:24.065 qpair failed and we were unable to recover it. 00:26:24.065 [2024-04-16 23:04:14.931965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.065 [2024-04-16 23:04:14.932101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.065 [2024-04-16 23:04:14.932125] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:24.065 qpair failed and we were unable to recover it. 00:26:24.065 [2024-04-16 23:04:14.932243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.065 [2024-04-16 23:04:14.932409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.065 [2024-04-16 23:04:14.932433] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:24.065 qpair failed and we were unable to recover it. 00:26:24.065 [2024-04-16 23:04:14.932548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.065 [2024-04-16 23:04:14.932714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.065 [2024-04-16 23:04:14.932739] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:24.065 qpair failed and we were unable to recover it. 00:26:24.065 [2024-04-16 23:04:14.932883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.065 [2024-04-16 23:04:14.933036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.065 [2024-04-16 23:04:14.933061] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:24.065 qpair failed and we were unable to recover it. 00:26:24.065 [2024-04-16 23:04:14.933168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.065 [2024-04-16 23:04:14.933313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.065 [2024-04-16 23:04:14.933339] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:24.065 qpair failed and we were unable to recover it. 00:26:24.065 [2024-04-16 23:04:14.933493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.065 [2024-04-16 23:04:14.933606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.065 [2024-04-16 23:04:14.933631] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:24.065 qpair failed and we were unable to recover it. 00:26:24.065 [2024-04-16 23:04:14.933766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.065 [2024-04-16 23:04:14.933880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.065 [2024-04-16 23:04:14.933905] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:24.065 qpair failed and we were unable to recover it. 00:26:24.065 [2024-04-16 23:04:14.934046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.065 [2024-04-16 23:04:14.934152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.065 [2024-04-16 23:04:14.934194] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:24.065 qpair failed and we were unable to recover it. 00:26:24.065 [2024-04-16 23:04:14.934334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.065 [2024-04-16 23:04:14.934480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.065 [2024-04-16 23:04:14.934508] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:24.065 qpair failed and we were unable to recover it. 00:26:24.065 [2024-04-16 23:04:14.934614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.065 [2024-04-16 23:04:14.934761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.065 [2024-04-16 23:04:14.934785] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:24.065 qpair failed and we were unable to recover it. 00:26:24.065 [2024-04-16 23:04:14.934893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.065 [2024-04-16 23:04:14.935005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.065 [2024-04-16 23:04:14.935030] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:24.065 qpair failed and we were unable to recover it. 00:26:24.065 [2024-04-16 23:04:14.935182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.065 [2024-04-16 23:04:14.935296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.065 [2024-04-16 23:04:14.935321] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:24.065 qpair failed and we were unable to recover it. 00:26:24.065 [2024-04-16 23:04:14.935434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.065 [2024-04-16 23:04:14.935548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.065 [2024-04-16 23:04:14.935573] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:24.065 qpair failed and we were unable to recover it. 00:26:24.065 [2024-04-16 23:04:14.935712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.065 [2024-04-16 23:04:14.935816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.065 [2024-04-16 23:04:14.935840] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:24.065 qpair failed and we were unable to recover it. 00:26:24.065 [2024-04-16 23:04:14.935954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.065 [2024-04-16 23:04:14.936057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.065 [2024-04-16 23:04:14.936082] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:24.065 qpair failed and we were unable to recover it. 00:26:24.065 [2024-04-16 23:04:14.936194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.065 [2024-04-16 23:04:14.936332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.065 [2024-04-16 23:04:14.936357] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:24.065 qpair failed and we were unable to recover it. 00:26:24.065 [2024-04-16 23:04:14.936460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.065 [2024-04-16 23:04:14.936583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.065 [2024-04-16 23:04:14.936608] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:24.065 qpair failed and we were unable to recover it. 00:26:24.065 [2024-04-16 23:04:14.936711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.065 [2024-04-16 23:04:14.936850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.065 [2024-04-16 23:04:14.936875] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:24.065 qpair failed and we were unable to recover it. 00:26:24.065 [2024-04-16 23:04:14.936995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.065 [2024-04-16 23:04:14.937133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.065 [2024-04-16 23:04:14.937158] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:24.065 qpair failed and we were unable to recover it. 00:26:24.065 [2024-04-16 23:04:14.937282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.065 [2024-04-16 23:04:14.937386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.065 [2024-04-16 23:04:14.937411] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:24.065 qpair failed and we were unable to recover it. 00:26:24.065 [2024-04-16 23:04:14.937522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.065 [2024-04-16 23:04:14.937658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.065 [2024-04-16 23:04:14.937683] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:24.065 qpair failed and we were unable to recover it. 00:26:24.065 [2024-04-16 23:04:14.937789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.065 [2024-04-16 23:04:14.937891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.065 [2024-04-16 23:04:14.937916] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:24.065 qpair failed and we were unable to recover it. 00:26:24.065 [2024-04-16 23:04:14.938023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.065 [2024-04-16 23:04:14.938136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.065 [2024-04-16 23:04:14.938161] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:24.065 qpair failed and we were unable to recover it. 00:26:24.065 [2024-04-16 23:04:14.938277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.065 [2024-04-16 23:04:14.938381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.065 [2024-04-16 23:04:14.938406] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:24.065 qpair failed and we were unable to recover it. 00:26:24.065 [2024-04-16 23:04:14.938547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.065 [2024-04-16 23:04:14.938662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.065 [2024-04-16 23:04:14.938687] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:24.065 qpair failed and we were unable to recover it. 00:26:24.065 [2024-04-16 23:04:14.938842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.065 [2024-04-16 23:04:14.938990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.065 [2024-04-16 23:04:14.939015] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:24.065 qpair failed and we were unable to recover it. 00:26:24.065 [2024-04-16 23:04:14.939149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.065 [2024-04-16 23:04:14.939269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.065 [2024-04-16 23:04:14.939294] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:24.065 qpair failed and we were unable to recover it. 00:26:24.065 [2024-04-16 23:04:14.939430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.065 [2024-04-16 23:04:14.939539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.065 [2024-04-16 23:04:14.939564] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:24.065 qpair failed and we were unable to recover it. 00:26:24.065 [2024-04-16 23:04:14.939710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.065 [2024-04-16 23:04:14.939823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.065 [2024-04-16 23:04:14.939848] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:24.065 qpair failed and we were unable to recover it. 00:26:24.065 [2024-04-16 23:04:14.939962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.065 [2024-04-16 23:04:14.940081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.065 [2024-04-16 23:04:14.940106] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:24.065 qpair failed and we were unable to recover it. 00:26:24.065 [2024-04-16 23:04:14.940244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.065 [2024-04-16 23:04:14.940355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.065 [2024-04-16 23:04:14.940382] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:24.065 qpair failed and we were unable to recover it. 00:26:24.065 [2024-04-16 23:04:14.940489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.065 [2024-04-16 23:04:14.940616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.065 [2024-04-16 23:04:14.940641] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:24.065 qpair failed and we were unable to recover it. 00:26:24.065 [2024-04-16 23:04:14.940790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.065 [2024-04-16 23:04:14.940894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.065 [2024-04-16 23:04:14.940919] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:24.065 qpair failed and we were unable to recover it. 00:26:24.065 [2024-04-16 23:04:14.941033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.066 [2024-04-16 23:04:14.941139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.066 [2024-04-16 23:04:14.941164] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:24.066 qpair failed and we were unable to recover it. 00:26:24.066 [2024-04-16 23:04:14.941288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.066 [2024-04-16 23:04:14.941405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.066 [2024-04-16 23:04:14.941431] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:24.066 qpair failed and we were unable to recover it. 00:26:24.066 [2024-04-16 23:04:14.941586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.066 [2024-04-16 23:04:14.941708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.066 [2024-04-16 23:04:14.941733] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:24.066 qpair failed and we were unable to recover it. 00:26:24.066 [2024-04-16 23:04:14.941877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.066 [2024-04-16 23:04:14.942009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.066 [2024-04-16 23:04:14.942033] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:24.066 qpair failed and we were unable to recover it. 00:26:24.066 [2024-04-16 23:04:14.942137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.066 [2024-04-16 23:04:14.942275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.066 [2024-04-16 23:04:14.942300] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:24.066 qpair failed and we were unable to recover it. 00:26:24.066 [2024-04-16 23:04:14.942430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.066 [2024-04-16 23:04:14.942564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.066 [2024-04-16 23:04:14.942588] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:24.066 qpair failed and we were unable to recover it. 00:26:24.066 [2024-04-16 23:04:14.942704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.066 [2024-04-16 23:04:14.942850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.066 [2024-04-16 23:04:14.942875] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:24.066 qpair failed and we were unable to recover it. 00:26:24.066 [2024-04-16 23:04:14.942985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.066 [2024-04-16 23:04:14.943100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.066 [2024-04-16 23:04:14.943125] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:24.066 qpair failed and we were unable to recover it. 00:26:24.066 [2024-04-16 23:04:14.943276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.066 [2024-04-16 23:04:14.943390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.066 [2024-04-16 23:04:14.943414] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:24.066 qpair failed and we were unable to recover it. 00:26:24.066 [2024-04-16 23:04:14.943533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.066 [2024-04-16 23:04:14.943642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.066 [2024-04-16 23:04:14.943667] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:24.066 qpair failed and we were unable to recover it. 00:26:24.066 [2024-04-16 23:04:14.943774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.066 [2024-04-16 23:04:14.943877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.066 [2024-04-16 23:04:14.943902] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:24.066 qpair failed and we were unable to recover it. 00:26:24.066 [2024-04-16 23:04:14.944017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.066 [2024-04-16 23:04:14.944131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.066 [2024-04-16 23:04:14.944156] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:24.066 qpair failed and we were unable to recover it. 00:26:24.066 [2024-04-16 23:04:14.944290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.066 [2024-04-16 23:04:14.944449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.066 [2024-04-16 23:04:14.944482] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:24.066 qpair failed and we were unable to recover it. 00:26:24.066 [2024-04-16 23:04:14.944598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.066 [2024-04-16 23:04:14.944742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.066 [2024-04-16 23:04:14.944768] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:24.066 qpair failed and we were unable to recover it. 00:26:24.066 [2024-04-16 23:04:14.944888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.066 [2024-04-16 23:04:14.945005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.066 [2024-04-16 23:04:14.945033] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:24.066 qpair failed and we were unable to recover it. 00:26:24.066 [2024-04-16 23:04:14.945154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.066 [2024-04-16 23:04:14.945320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.066 [2024-04-16 23:04:14.945346] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:24.066 qpair failed and we were unable to recover it. 00:26:24.066 [2024-04-16 23:04:14.945456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.066 [2024-04-16 23:04:14.945574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.066 [2024-04-16 23:04:14.945600] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:24.066 qpair failed and we were unable to recover it. 00:26:24.066 [2024-04-16 23:04:14.945705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.066 [2024-04-16 23:04:14.945819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.066 [2024-04-16 23:04:14.945845] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:24.066 qpair failed and we were unable to recover it. 00:26:24.066 [2024-04-16 23:04:14.945956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.066 [2024-04-16 23:04:14.946064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.066 [2024-04-16 23:04:14.946089] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:24.066 qpair failed and we were unable to recover it. 00:26:24.066 [2024-04-16 23:04:14.946214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.066 [2024-04-16 23:04:14.946335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.066 [2024-04-16 23:04:14.946360] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:24.066 qpair failed and we were unable to recover it. 00:26:24.066 [2024-04-16 23:04:14.946482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.066 [2024-04-16 23:04:14.946613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.066 [2024-04-16 23:04:14.946638] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:24.066 qpair failed and we were unable to recover it. 00:26:24.066 [2024-04-16 23:04:14.946771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.066 [2024-04-16 23:04:14.946929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.066 [2024-04-16 23:04:14.946954] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:24.066 qpair failed and we were unable to recover it. 00:26:24.066 [2024-04-16 23:04:14.947073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.066 [2024-04-16 23:04:14.947220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.066 [2024-04-16 23:04:14.947246] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:24.066 qpair failed and we were unable to recover it. 00:26:24.066 [2024-04-16 23:04:14.947357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.066 [2024-04-16 23:04:14.947497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.066 [2024-04-16 23:04:14.947523] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:24.066 qpair failed and we were unable to recover it. 00:26:24.066 [2024-04-16 23:04:14.947637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.066 [2024-04-16 23:04:14.947754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.066 [2024-04-16 23:04:14.947779] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:24.066 qpair failed and we were unable to recover it. 00:26:24.066 [2024-04-16 23:04:14.947894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.066 [2024-04-16 23:04:14.948033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.066 [2024-04-16 23:04:14.948059] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:24.066 qpair failed and we were unable to recover it. 00:26:24.066 [2024-04-16 23:04:14.948202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.066 [2024-04-16 23:04:14.948323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.066 [2024-04-16 23:04:14.948349] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:24.066 qpair failed and we were unable to recover it. 00:26:24.066 [2024-04-16 23:04:14.948498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.066 [2024-04-16 23:04:14.948607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.066 [2024-04-16 23:04:14.948632] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:24.066 qpair failed and we were unable to recover it. 00:26:24.066 [2024-04-16 23:04:14.948777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.066 [2024-04-16 23:04:14.948893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.066 [2024-04-16 23:04:14.948920] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:24.066 qpair failed and we were unable to recover it. 00:26:24.066 [2024-04-16 23:04:14.949072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.066 [2024-04-16 23:04:14.949221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.066 [2024-04-16 23:04:14.949247] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:24.066 qpair failed and we were unable to recover it. 00:26:24.066 [2024-04-16 23:04:14.949358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.066 [2024-04-16 23:04:14.949505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.066 [2024-04-16 23:04:14.949529] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:24.066 qpair failed and we were unable to recover it. 00:26:24.066 [2024-04-16 23:04:14.949658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.066 [2024-04-16 23:04:14.949799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.066 [2024-04-16 23:04:14.949826] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:24.066 qpair failed and we were unable to recover it. 00:26:24.066 [2024-04-16 23:04:14.949938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.066 [2024-04-16 23:04:14.950054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.066 [2024-04-16 23:04:14.950079] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:24.066 qpair failed and we were unable to recover it. 00:26:24.066 [2024-04-16 23:04:14.950224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.066 [2024-04-16 23:04:14.950341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.066 [2024-04-16 23:04:14.950366] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:24.066 qpair failed and we were unable to recover it. 00:26:24.066 [2024-04-16 23:04:14.950539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.066 [2024-04-16 23:04:14.950647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.066 [2024-04-16 23:04:14.950672] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:24.066 qpair failed and we were unable to recover it. 00:26:24.066 [2024-04-16 23:04:14.950782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.066 [2024-04-16 23:04:14.950892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.066 [2024-04-16 23:04:14.950919] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:24.066 qpair failed and we were unable to recover it. 00:26:24.066 [2024-04-16 23:04:14.951032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.066 [2024-04-16 23:04:14.951169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.066 [2024-04-16 23:04:14.951200] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:24.066 qpair failed and we were unable to recover it. 00:26:24.066 [2024-04-16 23:04:14.951318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.066 [2024-04-16 23:04:14.951428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.066 [2024-04-16 23:04:14.951453] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:24.066 qpair failed and we were unable to recover it. 00:26:24.066 [2024-04-16 23:04:14.951561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.066 [2024-04-16 23:04:14.951678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.066 [2024-04-16 23:04:14.951703] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:24.066 qpair failed and we were unable to recover it. 00:26:24.066 [2024-04-16 23:04:14.951836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.066 [2024-04-16 23:04:14.951946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.066 [2024-04-16 23:04:14.951971] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:24.066 qpair failed and we were unable to recover it. 00:26:24.066 [2024-04-16 23:04:14.952087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.066 [2024-04-16 23:04:14.952214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.066 [2024-04-16 23:04:14.952239] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:24.066 qpair failed and we were unable to recover it. 00:26:24.066 [2024-04-16 23:04:14.952383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.066 [2024-04-16 23:04:14.952491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.066 [2024-04-16 23:04:14.952517] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:24.066 qpair failed and we were unable to recover it. 00:26:24.066 [2024-04-16 23:04:14.952656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.066 [2024-04-16 23:04:14.952798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.066 [2024-04-16 23:04:14.952824] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:24.066 qpair failed and we were unable to recover it. 00:26:24.066 [2024-04-16 23:04:14.952945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.066 [2024-04-16 23:04:14.953054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.066 [2024-04-16 23:04:14.953080] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:24.066 qpair failed and we were unable to recover it. 00:26:24.066 [2024-04-16 23:04:14.953188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.066 [2024-04-16 23:04:14.953361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.066 [2024-04-16 23:04:14.953386] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:24.066 qpair failed and we were unable to recover it. 00:26:24.066 [2024-04-16 23:04:14.953521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.066 [2024-04-16 23:04:14.953658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.066 [2024-04-16 23:04:14.953682] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:24.066 qpair failed and we were unable to recover it. 00:26:24.066 [2024-04-16 23:04:14.953800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.067 [2024-04-16 23:04:14.953904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.067 [2024-04-16 23:04:14.953934] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:24.067 qpair failed and we were unable to recover it. 00:26:24.067 [2024-04-16 23:04:14.954054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.067 [2024-04-16 23:04:14.954169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.067 [2024-04-16 23:04:14.954202] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:24.067 qpair failed and we were unable to recover it. 00:26:24.067 [2024-04-16 23:04:14.954308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.067 [2024-04-16 23:04:14.954455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.067 [2024-04-16 23:04:14.954480] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:24.067 qpair failed and we were unable to recover it. 00:26:24.067 [2024-04-16 23:04:14.954621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.067 [2024-04-16 23:04:14.954733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.067 [2024-04-16 23:04:14.954758] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:24.067 qpair failed and we were unable to recover it. 00:26:24.067 [2024-04-16 23:04:14.954881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.067 [2024-04-16 23:04:14.955019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.067 [2024-04-16 23:04:14.955046] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:24.067 qpair failed and we were unable to recover it. 00:26:24.067 [2024-04-16 23:04:14.955188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.067 [2024-04-16 23:04:14.955303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.067 [2024-04-16 23:04:14.955328] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:24.067 qpair failed and we were unable to recover it. 00:26:24.067 [2024-04-16 23:04:14.955447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.067 [2024-04-16 23:04:14.955552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.067 [2024-04-16 23:04:14.955577] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:24.067 qpair failed and we were unable to recover it. 00:26:24.067 [2024-04-16 23:04:14.955721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.067 [2024-04-16 23:04:14.955830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.067 [2024-04-16 23:04:14.955855] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:24.067 qpair failed and we were unable to recover it. 00:26:24.067 [2024-04-16 23:04:14.955963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.067 [2024-04-16 23:04:14.956078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.067 [2024-04-16 23:04:14.956103] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:24.067 qpair failed and we were unable to recover it. 00:26:24.067 [2024-04-16 23:04:14.956228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.067 [2024-04-16 23:04:14.956345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.067 [2024-04-16 23:04:14.956370] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:24.067 qpair failed and we were unable to recover it. 00:26:24.067 [2024-04-16 23:04:14.956483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.067 [2024-04-16 23:04:14.956649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.067 [2024-04-16 23:04:14.956678] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:24.067 qpair failed and we were unable to recover it. 00:26:24.067 [2024-04-16 23:04:14.956789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.067 [2024-04-16 23:04:14.956930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.067 [2024-04-16 23:04:14.956955] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:24.067 qpair failed and we were unable to recover it. 00:26:24.067 [2024-04-16 23:04:14.957097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.067 [2024-04-16 23:04:14.957204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.067 [2024-04-16 23:04:14.957230] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:24.067 qpair failed and we were unable to recover it. 00:26:24.067 [2024-04-16 23:04:14.957381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.067 [2024-04-16 23:04:14.957550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.067 [2024-04-16 23:04:14.957575] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:24.067 qpair failed and we were unable to recover it. 00:26:24.067 [2024-04-16 23:04:14.957681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.067 [2024-04-16 23:04:14.957829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.067 [2024-04-16 23:04:14.957854] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:24.067 qpair failed and we were unable to recover it. 00:26:24.067 [2024-04-16 23:04:14.957962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.067 [2024-04-16 23:04:14.958071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.067 [2024-04-16 23:04:14.958096] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:24.067 qpair failed and we were unable to recover it. 00:26:24.067 [2024-04-16 23:04:14.958232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.067 [2024-04-16 23:04:14.958348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.067 [2024-04-16 23:04:14.958374] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:24.067 qpair failed and we were unable to recover it. 00:26:24.067 [2024-04-16 23:04:14.958513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.067 [2024-04-16 23:04:14.958678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.067 [2024-04-16 23:04:14.958703] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:24.067 qpair failed and we were unable to recover it. 00:26:24.067 [2024-04-16 23:04:14.958820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.067 [2024-04-16 23:04:14.958968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.067 [2024-04-16 23:04:14.958993] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:24.067 qpair failed and we were unable to recover it. 00:26:24.067 [2024-04-16 23:04:14.959141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.067 [2024-04-16 23:04:14.959259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.067 [2024-04-16 23:04:14.959284] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:24.067 qpair failed and we were unable to recover it. 00:26:24.067 [2024-04-16 23:04:14.959422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.067 [2024-04-16 23:04:14.959532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.067 [2024-04-16 23:04:14.959561] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:24.067 qpair failed and we were unable to recover it. 00:26:24.067 [2024-04-16 23:04:14.959675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.067 [2024-04-16 23:04:14.959801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.067 [2024-04-16 23:04:14.959827] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:24.067 qpair failed and we were unable to recover it. 00:26:24.067 [2024-04-16 23:04:14.959963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.067 [2024-04-16 23:04:14.960076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.067 [2024-04-16 23:04:14.960102] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:24.067 qpair failed and we were unable to recover it. 00:26:24.067 [2024-04-16 23:04:14.960240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.067 [2024-04-16 23:04:14.960347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.067 [2024-04-16 23:04:14.960372] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:24.067 qpair failed and we were unable to recover it. 00:26:24.067 [2024-04-16 23:04:14.960481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.067 [2024-04-16 23:04:14.960623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.067 [2024-04-16 23:04:14.960649] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:24.067 qpair failed and we were unable to recover it. 00:26:24.067 [2024-04-16 23:04:14.960797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.067 [2024-04-16 23:04:14.960917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.067 [2024-04-16 23:04:14.960942] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:24.067 qpair failed and we were unable to recover it. 00:26:24.067 [2024-04-16 23:04:14.961078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.067 [2024-04-16 23:04:14.961248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.067 [2024-04-16 23:04:14.961274] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:24.067 qpair failed and we were unable to recover it. 00:26:24.067 [2024-04-16 23:04:14.961385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.067 [2024-04-16 23:04:14.961496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.067 [2024-04-16 23:04:14.961521] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:24.067 qpair failed and we were unable to recover it. 00:26:24.067 [2024-04-16 23:04:14.961639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.067 [2024-04-16 23:04:14.961748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.067 [2024-04-16 23:04:14.961773] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:24.067 qpair failed and we were unable to recover it. 00:26:24.067 [2024-04-16 23:04:14.961892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.067 [2024-04-16 23:04:14.962054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.067 [2024-04-16 23:04:14.962079] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:24.067 qpair failed and we were unable to recover it. 00:26:24.067 [2024-04-16 23:04:14.962186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.067 [2024-04-16 23:04:14.962300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.067 [2024-04-16 23:04:14.962331] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:24.067 qpair failed and we were unable to recover it. 00:26:24.067 [2024-04-16 23:04:14.962449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.067 [2024-04-16 23:04:14.962569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.067 [2024-04-16 23:04:14.962594] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:24.067 qpair failed and we were unable to recover it. 00:26:24.067 [2024-04-16 23:04:14.962739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.067 [2024-04-16 23:04:14.962848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.067 [2024-04-16 23:04:14.962874] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:24.067 qpair failed and we were unable to recover it. 00:26:24.067 [2024-04-16 23:04:14.962988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.067 [2024-04-16 23:04:14.963120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.067 [2024-04-16 23:04:14.963145] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:24.067 qpair failed and we were unable to recover it. 00:26:24.067 [2024-04-16 23:04:14.963266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.067 [2024-04-16 23:04:14.963371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.067 [2024-04-16 23:04:14.963396] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:24.067 qpair failed and we were unable to recover it. 00:26:24.067 [2024-04-16 23:04:14.963516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.067 [2024-04-16 23:04:14.963632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.067 [2024-04-16 23:04:14.963657] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:24.067 qpair failed and we were unable to recover it. 00:26:24.067 [2024-04-16 23:04:14.963768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.067 [2024-04-16 23:04:14.963879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.067 [2024-04-16 23:04:14.963904] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:24.067 qpair failed and we were unable to recover it. 00:26:24.067 [2024-04-16 23:04:14.964015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.067 [2024-04-16 23:04:14.964120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.067 [2024-04-16 23:04:14.964146] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:24.067 qpair failed and we were unable to recover it. 00:26:24.067 [2024-04-16 23:04:14.964318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.067 [2024-04-16 23:04:14.964444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.067 [2024-04-16 23:04:14.964469] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:24.067 qpair failed and we were unable to recover it. 00:26:24.067 [2024-04-16 23:04:14.964584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.067 [2024-04-16 23:04:14.964693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.067 [2024-04-16 23:04:14.964719] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:24.067 qpair failed and we were unable to recover it. 00:26:24.067 [2024-04-16 23:04:14.964837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.067 [2024-04-16 23:04:14.964950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.067 [2024-04-16 23:04:14.964975] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:24.067 qpair failed and we were unable to recover it. 00:26:24.067 [2024-04-16 23:04:14.965096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.068 [2024-04-16 23:04:14.965213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.068 [2024-04-16 23:04:14.965240] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:24.068 qpair failed and we were unable to recover it. 00:26:24.068 [2024-04-16 23:04:14.965351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.068 [2024-04-16 23:04:14.965504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.068 [2024-04-16 23:04:14.965530] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:24.068 qpair failed and we were unable to recover it. 00:26:24.068 [2024-04-16 23:04:14.965648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.068 [2024-04-16 23:04:14.965754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.068 [2024-04-16 23:04:14.965779] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:24.068 qpair failed and we were unable to recover it. 00:26:24.068 [2024-04-16 23:04:14.965909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.068 [2024-04-16 23:04:14.966019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.068 [2024-04-16 23:04:14.966044] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:24.068 qpair failed and we were unable to recover it. 00:26:24.068 [2024-04-16 23:04:14.966157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.068 [2024-04-16 23:04:14.966274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.068 [2024-04-16 23:04:14.966299] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:24.068 qpair failed and we were unable to recover it. 00:26:24.068 [2024-04-16 23:04:14.966415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.068 [2024-04-16 23:04:14.966549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.068 [2024-04-16 23:04:14.966574] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:24.068 qpair failed and we were unable to recover it. 00:26:24.068 [2024-04-16 23:04:14.966679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.068 [2024-04-16 23:04:14.966784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.068 [2024-04-16 23:04:14.966808] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:24.068 qpair failed and we were unable to recover it. 00:26:24.068 [2024-04-16 23:04:14.966920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.068 [2024-04-16 23:04:14.967059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.068 [2024-04-16 23:04:14.967084] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:24.068 qpair failed and we were unable to recover it. 00:26:24.068 [2024-04-16 23:04:14.967204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.068 [2024-04-16 23:04:14.967311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.068 [2024-04-16 23:04:14.967336] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:24.068 qpair failed and we were unable to recover it. 00:26:24.068 [2024-04-16 23:04:14.967448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.068 [2024-04-16 23:04:14.967576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.068 [2024-04-16 23:04:14.967601] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:24.068 qpair failed and we were unable to recover it. 00:26:24.068 [2024-04-16 23:04:14.967742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.068 [2024-04-16 23:04:14.967851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.068 [2024-04-16 23:04:14.967876] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:24.068 qpair failed and we were unable to recover it. 00:26:24.068 [2024-04-16 23:04:14.967986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.068 [2024-04-16 23:04:14.968103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.068 [2024-04-16 23:04:14.968129] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:24.068 qpair failed and we were unable to recover it. 00:26:24.068 [2024-04-16 23:04:14.968249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.068 [2024-04-16 23:04:14.968364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.068 [2024-04-16 23:04:14.968390] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:24.068 qpair failed and we were unable to recover it. 00:26:24.068 [2024-04-16 23:04:14.968528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.068 [2024-04-16 23:04:14.968647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.068 [2024-04-16 23:04:14.968672] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:24.068 qpair failed and we were unable to recover it. 00:26:24.068 [2024-04-16 23:04:14.968789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.068 [2024-04-16 23:04:14.968895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.068 [2024-04-16 23:04:14.968919] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:24.068 qpair failed and we were unable to recover it. 00:26:24.068 [2024-04-16 23:04:14.969054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.068 [2024-04-16 23:04:14.969197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.068 [2024-04-16 23:04:14.969222] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:24.068 qpair failed and we were unable to recover it. 00:26:24.068 [2024-04-16 23:04:14.969356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.068 [2024-04-16 23:04:14.969471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.068 [2024-04-16 23:04:14.969497] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:24.068 qpair failed and we were unable to recover it. 00:26:24.068 [2024-04-16 23:04:14.969607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.068 [2024-04-16 23:04:14.969746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.068 [2024-04-16 23:04:14.969771] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:24.068 qpair failed and we were unable to recover it. 00:26:24.068 [2024-04-16 23:04:14.969872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.068 [2024-04-16 23:04:14.969982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.068 [2024-04-16 23:04:14.970008] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:24.068 qpair failed and we were unable to recover it. 00:26:24.068 [2024-04-16 23:04:14.970119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.068 [2024-04-16 23:04:14.970245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.068 [2024-04-16 23:04:14.970272] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:24.068 qpair failed and we were unable to recover it. 00:26:24.068 [2024-04-16 23:04:14.970396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.068 [2024-04-16 23:04:14.970537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.068 [2024-04-16 23:04:14.970562] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:24.068 qpair failed and we were unable to recover it. 00:26:24.068 [2024-04-16 23:04:14.970690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.068 [2024-04-16 23:04:14.970790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.068 [2024-04-16 23:04:14.970815] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:24.068 qpair failed and we were unable to recover it. 00:26:24.068 [2024-04-16 23:04:14.970935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.068 [2024-04-16 23:04:14.971078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.068 [2024-04-16 23:04:14.971103] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:24.068 qpair failed and we were unable to recover it. 00:26:24.068 [2024-04-16 23:04:14.971221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.068 [2024-04-16 23:04:14.971339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.068 [2024-04-16 23:04:14.971364] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:24.068 qpair failed and we were unable to recover it. 00:26:24.068 [2024-04-16 23:04:14.971475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.068 [2024-04-16 23:04:14.971579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.068 [2024-04-16 23:04:14.971603] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:24.068 qpair failed and we were unable to recover it. 00:26:24.068 [2024-04-16 23:04:14.971710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.068 [2024-04-16 23:04:14.971868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.068 [2024-04-16 23:04:14.971892] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:24.068 qpair failed and we were unable to recover it. 00:26:24.068 [2024-04-16 23:04:14.972013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.068 [2024-04-16 23:04:14.972119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.068 [2024-04-16 23:04:14.972143] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:24.068 qpair failed and we were unable to recover it. 00:26:24.068 [2024-04-16 23:04:14.972293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.068 [2024-04-16 23:04:14.972413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.068 [2024-04-16 23:04:14.972439] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:24.068 qpair failed and we were unable to recover it. 00:26:24.068 [2024-04-16 23:04:14.972554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.068 [2024-04-16 23:04:14.972661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.068 [2024-04-16 23:04:14.972687] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:24.068 qpair failed and we were unable to recover it. 00:26:24.068 [2024-04-16 23:04:14.972796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.068 [2024-04-16 23:04:14.972916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.068 [2024-04-16 23:04:14.972940] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:24.068 qpair failed and we were unable to recover it. 00:26:24.068 [2024-04-16 23:04:14.973065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.068 [2024-04-16 23:04:14.973183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.068 [2024-04-16 23:04:14.973209] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:24.068 qpair failed and we were unable to recover it. 00:26:24.068 [2024-04-16 23:04:14.973325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.068 [2024-04-16 23:04:14.973433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.068 [2024-04-16 23:04:14.973459] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:24.068 qpair failed and we were unable to recover it. 00:26:24.068 [2024-04-16 23:04:14.973582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.068 [2024-04-16 23:04:14.973723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.068 [2024-04-16 23:04:14.973749] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:24.068 qpair failed and we were unable to recover it. 00:26:24.068 [2024-04-16 23:04:14.973863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.068 [2024-04-16 23:04:14.973970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.068 [2024-04-16 23:04:14.973995] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:24.068 qpair failed and we were unable to recover it. 00:26:24.068 [2024-04-16 23:04:14.974134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.068 [2024-04-16 23:04:14.974270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.068 [2024-04-16 23:04:14.974297] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:24.068 qpair failed and we were unable to recover it. 00:26:24.068 [2024-04-16 23:04:14.974404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.068 [2024-04-16 23:04:14.974516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.068 [2024-04-16 23:04:14.974541] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:24.068 qpair failed and we were unable to recover it. 00:26:24.068 [2024-04-16 23:04:14.974657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.068 [2024-04-16 23:04:14.974769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.068 [2024-04-16 23:04:14.974793] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:24.068 qpair failed and we were unable to recover it. 00:26:24.068 [2024-04-16 23:04:14.974921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.068 [2024-04-16 23:04:14.975032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.068 [2024-04-16 23:04:14.975057] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:24.068 qpair failed and we were unable to recover it. 00:26:24.068 [2024-04-16 23:04:14.975169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.068 [2024-04-16 23:04:14.975319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.068 [2024-04-16 23:04:14.975343] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:24.068 qpair failed and we were unable to recover it. 00:26:24.068 [2024-04-16 23:04:14.975480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.068 [2024-04-16 23:04:14.975619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.068 [2024-04-16 23:04:14.975646] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:24.068 qpair failed and we were unable to recover it. 00:26:24.068 [2024-04-16 23:04:14.975768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.068 [2024-04-16 23:04:14.975899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.068 [2024-04-16 23:04:14.975924] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:24.068 qpair failed and we were unable to recover it. 00:26:24.068 [2024-04-16 23:04:14.976029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.068 [2024-04-16 23:04:14.976151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.068 [2024-04-16 23:04:14.976184] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:24.068 qpair failed and we were unable to recover it. 00:26:24.068 [2024-04-16 23:04:14.976295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.068 [2024-04-16 23:04:14.976409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.068 [2024-04-16 23:04:14.976434] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:24.068 qpair failed and we were unable to recover it. 00:26:24.068 [2024-04-16 23:04:14.976545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.068 [2024-04-16 23:04:14.976693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.068 [2024-04-16 23:04:14.976717] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:24.068 qpair failed and we were unable to recover it. 00:26:24.068 [2024-04-16 23:04:14.976859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.068 [2024-04-16 23:04:14.976967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.068 [2024-04-16 23:04:14.976993] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:24.068 qpair failed and we were unable to recover it. 00:26:24.068 [2024-04-16 23:04:14.977128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.068 [2024-04-16 23:04:14.977236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.069 [2024-04-16 23:04:14.977267] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:24.069 qpair failed and we were unable to recover it. 00:26:24.069 [2024-04-16 23:04:14.977378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.069 [2024-04-16 23:04:14.977493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.069 [2024-04-16 23:04:14.977517] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:24.069 qpair failed and we were unable to recover it. 00:26:24.069 [2024-04-16 23:04:14.977628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.069 [2024-04-16 23:04:14.977736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.069 [2024-04-16 23:04:14.977760] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:24.069 qpair failed and we were unable to recover it. 00:26:24.069 [2024-04-16 23:04:14.977863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.069 [2024-04-16 23:04:14.978002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.069 [2024-04-16 23:04:14.978027] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:24.069 qpair failed and we were unable to recover it. 00:26:24.069 [2024-04-16 23:04:14.978137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.069 [2024-04-16 23:04:14.978267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.069 [2024-04-16 23:04:14.978295] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:24.069 qpair failed and we were unable to recover it. 00:26:24.069 [2024-04-16 23:04:14.978420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.069 [2024-04-16 23:04:14.978535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.069 [2024-04-16 23:04:14.978560] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:24.069 qpair failed and we were unable to recover it. 00:26:24.069 [2024-04-16 23:04:14.978688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.069 [2024-04-16 23:04:14.978791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.069 [2024-04-16 23:04:14.978816] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:24.069 qpair failed and we were unable to recover it. 00:26:24.069 [2024-04-16 23:04:14.978925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.069 [2024-04-16 23:04:14.979036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.069 [2024-04-16 23:04:14.979061] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:24.069 qpair failed and we were unable to recover it. 00:26:24.069 [2024-04-16 23:04:14.979180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.069 [2024-04-16 23:04:14.979298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.069 [2024-04-16 23:04:14.979323] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:24.069 qpair failed and we were unable to recover it. 00:26:24.069 [2024-04-16 23:04:14.979441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.069 [2024-04-16 23:04:14.979586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.069 [2024-04-16 23:04:14.979611] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:24.069 qpair failed and we were unable to recover it. 00:26:24.069 [2024-04-16 23:04:14.979729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.069 [2024-04-16 23:04:14.979863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.069 [2024-04-16 23:04:14.979887] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:24.069 qpair failed and we were unable to recover it. 00:26:24.069 [2024-04-16 23:04:14.980003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.069 [2024-04-16 23:04:14.980112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.069 [2024-04-16 23:04:14.980137] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:24.069 qpair failed and we were unable to recover it. 00:26:24.069 [2024-04-16 23:04:14.980266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.069 [2024-04-16 23:04:14.980373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.069 [2024-04-16 23:04:14.980398] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:24.069 qpair failed and we were unable to recover it. 00:26:24.069 [2024-04-16 23:04:14.980527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.069 [2024-04-16 23:04:14.980639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.069 [2024-04-16 23:04:14.980663] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:24.069 qpair failed and we were unable to recover it. 00:26:24.069 [2024-04-16 23:04:14.980783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.069 [2024-04-16 23:04:14.980899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.069 [2024-04-16 23:04:14.980923] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:24.069 qpair failed and we were unable to recover it. 00:26:24.069 [2024-04-16 23:04:14.981066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.069 [2024-04-16 23:04:14.981184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.069 [2024-04-16 23:04:14.981221] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:24.069 qpair failed and we were unable to recover it. 00:26:24.069 [2024-04-16 23:04:14.981371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.069 [2024-04-16 23:04:14.981481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.069 [2024-04-16 23:04:14.981506] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:24.069 qpair failed and we were unable to recover it. 00:26:24.069 [2024-04-16 23:04:14.981646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.069 [2024-04-16 23:04:14.981770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.069 [2024-04-16 23:04:14.981795] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:24.069 qpair failed and we were unable to recover it. 00:26:24.069 [2024-04-16 23:04:14.981909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.069 [2024-04-16 23:04:14.982026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.069 [2024-04-16 23:04:14.982052] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:24.069 qpair failed and we were unable to recover it. 00:26:24.069 [2024-04-16 23:04:14.982166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.069 [2024-04-16 23:04:14.982311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.069 [2024-04-16 23:04:14.982336] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:24.069 qpair failed and we were unable to recover it. 00:26:24.069 [2024-04-16 23:04:14.982453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.069 [2024-04-16 23:04:14.982576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.069 [2024-04-16 23:04:14.982601] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:24.069 qpair failed and we were unable to recover it. 00:26:24.069 [2024-04-16 23:04:14.982730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.069 [2024-04-16 23:04:14.982841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.069 [2024-04-16 23:04:14.982866] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:24.069 qpair failed and we were unable to recover it. 00:26:24.069 [2024-04-16 23:04:14.983021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.069 [2024-04-16 23:04:14.983170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.069 [2024-04-16 23:04:14.983203] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:24.069 qpair failed and we were unable to recover it. 00:26:24.069 [2024-04-16 23:04:14.983323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.069 [2024-04-16 23:04:14.983447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.069 [2024-04-16 23:04:14.983471] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:24.069 qpair failed and we were unable to recover it. 00:26:24.069 [2024-04-16 23:04:14.983589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.069 [2024-04-16 23:04:14.983730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.069 [2024-04-16 23:04:14.983755] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:24.069 qpair failed and we were unable to recover it. 00:26:24.069 [2024-04-16 23:04:14.983890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.069 [2024-04-16 23:04:14.984006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.069 [2024-04-16 23:04:14.984031] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:24.069 qpair failed and we were unable to recover it. 00:26:24.069 [2024-04-16 23:04:14.984166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.069 [2024-04-16 23:04:14.984286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.069 [2024-04-16 23:04:14.984312] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:24.069 qpair failed and we were unable to recover it. 00:26:24.069 [2024-04-16 23:04:14.984418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.069 [2024-04-16 23:04:14.984545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.069 [2024-04-16 23:04:14.984569] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:24.069 qpair failed and we were unable to recover it. 00:26:24.069 [2024-04-16 23:04:14.984692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.069 [2024-04-16 23:04:14.984804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.069 [2024-04-16 23:04:14.984829] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:24.069 qpair failed and we were unable to recover it. 00:26:24.069 [2024-04-16 23:04:14.984946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.069 [2024-04-16 23:04:14.985065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.069 [2024-04-16 23:04:14.985089] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:24.069 qpair failed and we were unable to recover it. 00:26:24.069 [2024-04-16 23:04:14.985207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.069 [2024-04-16 23:04:14.985362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.069 [2024-04-16 23:04:14.985386] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:24.069 qpair failed and we were unable to recover it. 00:26:24.069 [2024-04-16 23:04:14.985495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.069 [2024-04-16 23:04:14.985604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.069 [2024-04-16 23:04:14.985628] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:24.069 qpair failed and we were unable to recover it. 00:26:24.069 [2024-04-16 23:04:14.985741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.069 [2024-04-16 23:04:14.985855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.069 [2024-04-16 23:04:14.985880] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:24.069 qpair failed and we were unable to recover it. 00:26:24.069 [2024-04-16 23:04:14.986003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.069 [2024-04-16 23:04:14.986115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.069 [2024-04-16 23:04:14.986140] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:24.069 qpair failed and we were unable to recover it. 00:26:24.069 [2024-04-16 23:04:14.986254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.069 [2024-04-16 23:04:14.986362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.069 [2024-04-16 23:04:14.986386] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:24.069 qpair failed and we were unable to recover it. 00:26:24.069 [2024-04-16 23:04:14.986499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.069 [2024-04-16 23:04:14.986643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.069 [2024-04-16 23:04:14.986668] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:24.069 qpair failed and we were unable to recover it. 00:26:24.069 [2024-04-16 23:04:14.986802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.069 [2024-04-16 23:04:14.986940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.069 [2024-04-16 23:04:14.986965] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:24.069 qpair failed and we were unable to recover it. 00:26:24.069 [2024-04-16 23:04:14.987111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.069 [2024-04-16 23:04:14.987226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.069 [2024-04-16 23:04:14.987250] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:24.069 qpair failed and we were unable to recover it. 00:26:24.069 [2024-04-16 23:04:14.987388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.069 [2024-04-16 23:04:14.987506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.069 [2024-04-16 23:04:14.987530] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:24.069 qpair failed and we were unable to recover it. 00:26:24.069 [2024-04-16 23:04:14.987643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.069 [2024-04-16 23:04:14.987760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.069 [2024-04-16 23:04:14.987785] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:24.069 qpair failed and we were unable to recover it. 00:26:24.069 [2024-04-16 23:04:14.987889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.069 23:04:14 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:26:24.069 [2024-04-16 23:04:14.988001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.069 [2024-04-16 23:04:14.988026] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:24.069 qpair failed and we were unable to recover it. 00:26:24.069 23:04:14 -- common/autotest_common.sh@852 -- # return 0 00:26:24.069 [2024-04-16 23:04:14.988140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.069 23:04:14 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:26:24.069 [2024-04-16 23:04:14.988253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.069 [2024-04-16 23:04:14.988280] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:24.069 qpair failed and we were unable to recover it. 00:26:24.069 23:04:14 -- common/autotest_common.sh@718 -- # xtrace_disable 00:26:24.069 [2024-04-16 23:04:14.988426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.069 23:04:14 -- common/autotest_common.sh@10 -- # set +x 00:26:24.069 [2024-04-16 23:04:14.988560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.069 [2024-04-16 23:04:14.988585] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:24.069 qpair failed and we were unable to recover it. 00:26:24.069 [2024-04-16 23:04:14.988741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.069 [2024-04-16 23:04:14.988856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.069 [2024-04-16 23:04:14.988880] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:24.069 qpair failed and we were unable to recover it. 00:26:24.069 [2024-04-16 23:04:14.988997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.069 [2024-04-16 23:04:14.989104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.069 [2024-04-16 23:04:14.989135] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:24.069 qpair failed and we were unable to recover it. 00:26:24.069 [2024-04-16 23:04:14.989257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.069 [2024-04-16 23:04:14.989364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.070 [2024-04-16 23:04:14.989389] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:24.070 qpair failed and we were unable to recover it. 00:26:24.070 [2024-04-16 23:04:14.989507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.070 [2024-04-16 23:04:14.989630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.070 [2024-04-16 23:04:14.989655] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:24.070 qpair failed and we were unable to recover it. 00:26:24.070 [2024-04-16 23:04:14.989796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.070 [2024-04-16 23:04:14.989912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.070 [2024-04-16 23:04:14.989937] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:24.070 qpair failed and we were unable to recover it. 00:26:24.070 [2024-04-16 23:04:14.990046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.070 [2024-04-16 23:04:14.990155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.070 [2024-04-16 23:04:14.990186] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:24.070 qpair failed and we were unable to recover it. 00:26:24.070 [2024-04-16 23:04:14.990333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.070 [2024-04-16 23:04:14.990449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.070 [2024-04-16 23:04:14.990474] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:24.070 qpair failed and we were unable to recover it. 00:26:24.070 [2024-04-16 23:04:14.990618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.070 [2024-04-16 23:04:14.990725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.070 [2024-04-16 23:04:14.990750] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:24.070 qpair failed and we were unable to recover it. 00:26:24.070 [2024-04-16 23:04:14.990891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.070 [2024-04-16 23:04:14.990995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.070 [2024-04-16 23:04:14.991020] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:24.070 qpair failed and we were unable to recover it. 00:26:24.070 [2024-04-16 23:04:14.991127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.070 [2024-04-16 23:04:14.991257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.070 [2024-04-16 23:04:14.991283] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:24.070 qpair failed and we were unable to recover it. 00:26:24.070 [2024-04-16 23:04:14.991394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.070 [2024-04-16 23:04:14.991500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.070 [2024-04-16 23:04:14.991525] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:24.070 qpair failed and we were unable to recover it. 00:26:24.070 [2024-04-16 23:04:14.991689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.070 [2024-04-16 23:04:14.991813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.070 [2024-04-16 23:04:14.991842] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:24.070 qpair failed and we were unable to recover it. 00:26:24.070 [2024-04-16 23:04:14.991964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.070 [2024-04-16 23:04:14.992087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.070 [2024-04-16 23:04:14.992112] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:24.070 qpair failed and we were unable to recover it. 00:26:24.070 [2024-04-16 23:04:14.992229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.070 [2024-04-16 23:04:14.992341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.070 [2024-04-16 23:04:14.992366] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:24.070 qpair failed and we were unable to recover it. 00:26:24.070 [2024-04-16 23:04:14.992475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.070 [2024-04-16 23:04:14.992587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.070 [2024-04-16 23:04:14.992618] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:24.070 qpair failed and we were unable to recover it. 00:26:24.070 [2024-04-16 23:04:14.992761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.070 [2024-04-16 23:04:14.992870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.070 [2024-04-16 23:04:14.992896] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:24.070 qpair failed and we were unable to recover it. 00:26:24.070 [2024-04-16 23:04:14.993000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.070 [2024-04-16 23:04:14.993135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.070 [2024-04-16 23:04:14.993160] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:24.070 qpair failed and we were unable to recover it. 00:26:24.070 [2024-04-16 23:04:14.993279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.070 [2024-04-16 23:04:14.993397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.070 [2024-04-16 23:04:14.993427] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:24.070 qpair failed and we were unable to recover it. 00:26:24.070 [2024-04-16 23:04:14.993572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.070 [2024-04-16 23:04:14.993708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.070 [2024-04-16 23:04:14.993733] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:24.070 qpair failed and we were unable to recover it. 00:26:24.070 [2024-04-16 23:04:14.993836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.070 [2024-04-16 23:04:14.993966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.070 [2024-04-16 23:04:14.993992] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:24.070 qpair failed and we were unable to recover it. 00:26:24.070 [2024-04-16 23:04:14.994132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.070 [2024-04-16 23:04:14.994255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.070 [2024-04-16 23:04:14.994280] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:24.070 qpair failed and we were unable to recover it. 00:26:24.070 [2024-04-16 23:04:14.994409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.070 [2024-04-16 23:04:14.994526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.070 [2024-04-16 23:04:14.994552] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:24.070 qpair failed and we were unable to recover it. 00:26:24.070 [2024-04-16 23:04:14.994694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.070 [2024-04-16 23:04:14.994823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.070 [2024-04-16 23:04:14.994848] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:24.070 qpair failed and we were unable to recover it. 00:26:24.070 [2024-04-16 23:04:14.994988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.070 [2024-04-16 23:04:14.995096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.070 [2024-04-16 23:04:14.995121] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:24.070 qpair failed and we were unable to recover it. 00:26:24.070 [2024-04-16 23:04:14.995245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.070 [2024-04-16 23:04:14.995354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.070 [2024-04-16 23:04:14.995378] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:24.070 qpair failed and we were unable to recover it. 00:26:24.070 [2024-04-16 23:04:14.995486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.070 [2024-04-16 23:04:14.995596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.070 [2024-04-16 23:04:14.995621] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:24.070 qpair failed and we were unable to recover it. 00:26:24.070 [2024-04-16 23:04:14.995735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.070 [2024-04-16 23:04:14.995860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.070 [2024-04-16 23:04:14.995885] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:24.070 qpair failed and we were unable to recover it. 00:26:24.070 [2024-04-16 23:04:14.996024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.070 [2024-04-16 23:04:14.996133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.070 [2024-04-16 23:04:14.996158] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:24.070 qpair failed and we were unable to recover it. 00:26:24.070 [2024-04-16 23:04:14.996289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.070 [2024-04-16 23:04:14.996395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.070 [2024-04-16 23:04:14.996420] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:24.070 qpair failed and we were unable to recover it. 00:26:24.070 [2024-04-16 23:04:14.996557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.070 [2024-04-16 23:04:14.996682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.070 [2024-04-16 23:04:14.996708] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:24.070 qpair failed and we were unable to recover it. 00:26:24.070 [2024-04-16 23:04:14.996821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.070 [2024-04-16 23:04:14.996930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.070 [2024-04-16 23:04:14.996956] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:24.070 qpair failed and we were unable to recover it. 00:26:24.070 [2024-04-16 23:04:14.997075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.070 [2024-04-16 23:04:14.997208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.070 [2024-04-16 23:04:14.997244] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:24.070 qpair failed and we were unable to recover it. 00:26:24.070 [2024-04-16 23:04:14.997359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.070 [2024-04-16 23:04:14.997472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.070 [2024-04-16 23:04:14.997496] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:24.070 qpair failed and we were unable to recover it. 00:26:24.070 [2024-04-16 23:04:14.997629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.070 [2024-04-16 23:04:14.997744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.070 [2024-04-16 23:04:14.997769] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:24.070 qpair failed and we were unable to recover it. 00:26:24.070 [2024-04-16 23:04:14.997883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.070 [2024-04-16 23:04:14.998028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.070 [2024-04-16 23:04:14.998052] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:24.070 qpair failed and we were unable to recover it. 00:26:24.070 [2024-04-16 23:04:14.998165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.070 [2024-04-16 23:04:14.998326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.070 [2024-04-16 23:04:14.998351] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:24.070 qpair failed and we were unable to recover it. 00:26:24.070 [2024-04-16 23:04:14.998462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.070 [2024-04-16 23:04:14.998569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.070 [2024-04-16 23:04:14.998594] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:24.070 qpair failed and we were unable to recover it. 00:26:24.070 [2024-04-16 23:04:14.998696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.070 [2024-04-16 23:04:14.998805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.070 [2024-04-16 23:04:14.998831] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:24.070 qpair failed and we were unable to recover it. 00:26:24.070 [2024-04-16 23:04:14.998938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.070 [2024-04-16 23:04:14.999084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.070 [2024-04-16 23:04:14.999108] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:24.070 qpair failed and we were unable to recover it. 00:26:24.070 [2024-04-16 23:04:14.999246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.070 [2024-04-16 23:04:14.999360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.070 [2024-04-16 23:04:14.999386] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:24.070 qpair failed and we were unable to recover it. 00:26:24.070 [2024-04-16 23:04:14.999499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.070 [2024-04-16 23:04:14.999612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.070 [2024-04-16 23:04:14.999638] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:24.070 qpair failed and we were unable to recover it. 00:26:24.070 [2024-04-16 23:04:14.999763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.070 [2024-04-16 23:04:14.999903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.070 [2024-04-16 23:04:14.999927] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:24.070 qpair failed and we were unable to recover it. 00:26:24.070 [2024-04-16 23:04:15.000040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.070 [2024-04-16 23:04:15.000154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.070 [2024-04-16 23:04:15.000184] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:24.071 qpair failed and we were unable to recover it. 00:26:24.071 [2024-04-16 23:04:15.000300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.071 [2024-04-16 23:04:15.000405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.071 [2024-04-16 23:04:15.000430] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:24.071 qpair failed and we were unable to recover it. 00:26:24.071 [2024-04-16 23:04:15.000558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.071 [2024-04-16 23:04:15.000668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.071 [2024-04-16 23:04:15.000693] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:24.071 qpair failed and we were unable to recover it. 00:26:24.071 [2024-04-16 23:04:15.000798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.071 [2024-04-16 23:04:15.000902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.071 [2024-04-16 23:04:15.000927] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:24.071 qpair failed and we were unable to recover it. 00:26:24.071 [2024-04-16 23:04:15.001070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.071 [2024-04-16 23:04:15.001171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.071 [2024-04-16 23:04:15.001203] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:24.071 qpair failed and we were unable to recover it. 00:26:24.071 [2024-04-16 23:04:15.001322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.071 [2024-04-16 23:04:15.001428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.071 [2024-04-16 23:04:15.001454] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:24.071 qpair failed and we were unable to recover it. 00:26:24.071 [2024-04-16 23:04:15.001585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.071 [2024-04-16 23:04:15.001694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.071 [2024-04-16 23:04:15.001719] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:24.071 qpair failed and we were unable to recover it. 00:26:24.071 [2024-04-16 23:04:15.001842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.071 [2024-04-16 23:04:15.001953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.071 [2024-04-16 23:04:15.001978] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:24.071 qpair failed and we were unable to recover it. 00:26:24.071 [2024-04-16 23:04:15.002119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.071 [2024-04-16 23:04:15.002243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.071 [2024-04-16 23:04:15.002269] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:24.071 qpair failed and we were unable to recover it. 00:26:24.071 [2024-04-16 23:04:15.002384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.071 [2024-04-16 23:04:15.002500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.071 [2024-04-16 23:04:15.002525] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:24.071 qpair failed and we were unable to recover it. 00:26:24.071 [2024-04-16 23:04:15.002644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.071 [2024-04-16 23:04:15.002781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.071 [2024-04-16 23:04:15.002808] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:24.071 qpair failed and we were unable to recover it. 00:26:24.071 [2024-04-16 23:04:15.002950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.071 [2024-04-16 23:04:15.003066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.071 [2024-04-16 23:04:15.003091] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:24.071 qpair failed and we were unable to recover it. 00:26:24.071 [2024-04-16 23:04:15.003244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.071 [2024-04-16 23:04:15.003382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.071 [2024-04-16 23:04:15.003406] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:24.071 qpair failed and we were unable to recover it. 00:26:24.071 [2024-04-16 23:04:15.003511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.071 [2024-04-16 23:04:15.003614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.071 [2024-04-16 23:04:15.003639] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:24.071 qpair failed and we were unable to recover it. 00:26:24.071 [2024-04-16 23:04:15.003746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.071 [2024-04-16 23:04:15.003868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.071 [2024-04-16 23:04:15.003894] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:24.071 qpair failed and we were unable to recover it. 00:26:24.071 [2024-04-16 23:04:15.004033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.071 [2024-04-16 23:04:15.004150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.071 [2024-04-16 23:04:15.004181] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:24.071 qpair failed and we were unable to recover it. 00:26:24.071 [2024-04-16 23:04:15.004321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.071 [2024-04-16 23:04:15.004436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.071 [2024-04-16 23:04:15.004461] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:24.071 qpair failed and we were unable to recover it. 00:26:24.071 [2024-04-16 23:04:15.004628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.071 [2024-04-16 23:04:15.004735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.071 [2024-04-16 23:04:15.004760] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:24.071 qpair failed and we were unable to recover it. 00:26:24.071 [2024-04-16 23:04:15.004871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.071 [2024-04-16 23:04:15.005039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.071 [2024-04-16 23:04:15.005065] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:24.071 qpair failed and we were unable to recover it. 00:26:24.071 [2024-04-16 23:04:15.005171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.071 [2024-04-16 23:04:15.005286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.071 [2024-04-16 23:04:15.005311] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:24.071 qpair failed and we were unable to recover it. 00:26:24.071 [2024-04-16 23:04:15.005462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.071 [2024-04-16 23:04:15.005580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.071 [2024-04-16 23:04:15.005605] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:24.071 qpair failed and we were unable to recover it. 00:26:24.071 [2024-04-16 23:04:15.005722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.071 [2024-04-16 23:04:15.005872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.071 [2024-04-16 23:04:15.005897] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:24.071 qpair failed and we were unable to recover it. 00:26:24.071 [2024-04-16 23:04:15.006018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.071 [2024-04-16 23:04:15.006131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.071 [2024-04-16 23:04:15.006156] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:24.071 qpair failed and we were unable to recover it. 00:26:24.071 [2024-04-16 23:04:15.006295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.071 [2024-04-16 23:04:15.006464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.071 [2024-04-16 23:04:15.006490] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:24.071 qpair failed and we were unable to recover it. 00:26:24.071 [2024-04-16 23:04:15.006608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.071 [2024-04-16 23:04:15.006757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.071 [2024-04-16 23:04:15.006782] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:24.071 qpair failed and we were unable to recover it. 00:26:24.071 [2024-04-16 23:04:15.006894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.071 [2024-04-16 23:04:15.007011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.071 [2024-04-16 23:04:15.007036] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:24.071 qpair failed and we were unable to recover it. 00:26:24.071 [2024-04-16 23:04:15.007155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.071 [2024-04-16 23:04:15.007297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.071 [2024-04-16 23:04:15.007324] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:24.071 qpair failed and we were unable to recover it. 00:26:24.071 [2024-04-16 23:04:15.007460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.071 23:04:15 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:26:24.071 [2024-04-16 23:04:15.007601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.071 [2024-04-16 23:04:15.007627] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:24.071 qpair failed and we were unable to recover it. 00:26:24.071 23:04:15 -- host/target_disconnect.sh@19 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc0 00:26:24.071 [2024-04-16 23:04:15.007737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.071 23:04:15 -- common/autotest_common.sh@551 -- # xtrace_disable 00:26:24.071 [2024-04-16 23:04:15.007880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.071 [2024-04-16 23:04:15.007906] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:24.071 qpair failed and we were unable to recover it. 00:26:24.071 23:04:15 -- common/autotest_common.sh@10 -- # set +x 00:26:24.071 [2024-04-16 23:04:15.008015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.071 [2024-04-16 23:04:15.008154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.071 [2024-04-16 23:04:15.008187] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:24.071 qpair failed and we were unable to recover it. 00:26:24.071 [2024-04-16 23:04:15.008307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.071 [2024-04-16 23:04:15.008413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.071 [2024-04-16 23:04:15.008438] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:24.071 qpair failed and we were unable to recover it. 00:26:24.071 [2024-04-16 23:04:15.008579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.071 [2024-04-16 23:04:15.008715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.071 [2024-04-16 23:04:15.008740] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:24.071 qpair failed and we were unable to recover it. 00:26:24.071 [2024-04-16 23:04:15.008854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.071 [2024-04-16 23:04:15.008966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.071 [2024-04-16 23:04:15.008991] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:24.071 qpair failed and we were unable to recover it. 00:26:24.071 [2024-04-16 23:04:15.009099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.071 [2024-04-16 23:04:15.009210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.071 [2024-04-16 23:04:15.009236] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:24.071 qpair failed and we were unable to recover it. 00:26:24.071 [2024-04-16 23:04:15.009353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.071 [2024-04-16 23:04:15.009463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.071 [2024-04-16 23:04:15.009497] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:24.071 qpair failed and we were unable to recover it. 00:26:24.071 [2024-04-16 23:04:15.009605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.071 [2024-04-16 23:04:15.009721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.071 [2024-04-16 23:04:15.009745] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:24.071 qpair failed and we were unable to recover it. 00:26:24.071 [2024-04-16 23:04:15.009851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.071 [2024-04-16 23:04:15.009956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.071 [2024-04-16 23:04:15.009981] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:24.071 qpair failed and we were unable to recover it. 00:26:24.071 [2024-04-16 23:04:15.010091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.071 [2024-04-16 23:04:15.010237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.071 [2024-04-16 23:04:15.010264] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:24.071 qpair failed and we were unable to recover it. 00:26:24.071 [2024-04-16 23:04:15.010384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.071 [2024-04-16 23:04:15.010521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.071 [2024-04-16 23:04:15.010545] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:24.071 qpair failed and we were unable to recover it. 00:26:24.071 [2024-04-16 23:04:15.010675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.071 [2024-04-16 23:04:15.010843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.071 [2024-04-16 23:04:15.010868] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:24.071 qpair failed and we were unable to recover it. 00:26:24.071 [2024-04-16 23:04:15.010988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.071 [2024-04-16 23:04:15.011088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.071 [2024-04-16 23:04:15.011113] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:24.071 qpair failed and we were unable to recover it. 00:26:24.071 [2024-04-16 23:04:15.011257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.071 [2024-04-16 23:04:15.011423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.071 [2024-04-16 23:04:15.011448] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:24.071 qpair failed and we were unable to recover it. 00:26:24.071 [2024-04-16 23:04:15.011566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.071 [2024-04-16 23:04:15.011676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.071 [2024-04-16 23:04:15.011700] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:24.071 qpair failed and we were unable to recover it. 00:26:24.071 [2024-04-16 23:04:15.011848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.071 [2024-04-16 23:04:15.011957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.071 [2024-04-16 23:04:15.011982] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:24.071 qpair failed and we were unable to recover it. 00:26:24.071 [2024-04-16 23:04:15.012102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.071 [2024-04-16 23:04:15.012213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.071 [2024-04-16 23:04:15.012238] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:24.071 qpair failed and we were unable to recover it. 00:26:24.071 [2024-04-16 23:04:15.012381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.071 [2024-04-16 23:04:15.012496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.072 [2024-04-16 23:04:15.012522] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:24.072 qpair failed and we were unable to recover it. 00:26:24.072 [2024-04-16 23:04:15.012630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.072 [2024-04-16 23:04:15.012743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.072 [2024-04-16 23:04:15.012768] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:24.072 qpair failed and we were unable to recover it. 00:26:24.072 [2024-04-16 23:04:15.012883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.072 [2024-04-16 23:04:15.013022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.072 [2024-04-16 23:04:15.013047] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:24.072 qpair failed and we were unable to recover it. 00:26:24.072 [2024-04-16 23:04:15.013191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.072 [2024-04-16 23:04:15.013300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.072 [2024-04-16 23:04:15.013325] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:24.072 qpair failed and we were unable to recover it. 00:26:24.072 [2024-04-16 23:04:15.013438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.072 [2024-04-16 23:04:15.013559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.072 [2024-04-16 23:04:15.013584] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:24.072 qpair failed and we were unable to recover it. 00:26:24.072 [2024-04-16 23:04:15.013718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.072 [2024-04-16 23:04:15.013833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.072 [2024-04-16 23:04:15.013859] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:24.072 qpair failed and we were unable to recover it. 00:26:24.072 [2024-04-16 23:04:15.013972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.072 [2024-04-16 23:04:15.014082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.072 [2024-04-16 23:04:15.014107] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:24.072 qpair failed and we were unable to recover it. 00:26:24.072 [2024-04-16 23:04:15.014225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.072 [2024-04-16 23:04:15.014368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.072 [2024-04-16 23:04:15.014393] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:24.072 qpair failed and we were unable to recover it. 00:26:24.072 [2024-04-16 23:04:15.014508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.072 [2024-04-16 23:04:15.014649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.072 [2024-04-16 23:04:15.014674] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:24.072 qpair failed and we were unable to recover it. 00:26:24.072 [2024-04-16 23:04:15.014821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.072 [2024-04-16 23:04:15.014957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.072 [2024-04-16 23:04:15.014982] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:24.072 qpair failed and we were unable to recover it. 00:26:24.072 [2024-04-16 23:04:15.015089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.072 [2024-04-16 23:04:15.015200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.072 [2024-04-16 23:04:15.015228] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:24.072 qpair failed and we were unable to recover it. 00:26:24.072 [2024-04-16 23:04:15.015345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.072 [2024-04-16 23:04:15.015454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.072 [2024-04-16 23:04:15.015480] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:24.072 qpair failed and we were unable to recover it. 00:26:24.072 [2024-04-16 23:04:15.015622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.072 [2024-04-16 23:04:15.015789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.072 [2024-04-16 23:04:15.015814] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:24.072 qpair failed and we were unable to recover it. 00:26:24.072 [2024-04-16 23:04:15.015954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.072 [2024-04-16 23:04:15.016155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.072 [2024-04-16 23:04:15.016187] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:24.072 qpair failed and we were unable to recover it. 00:26:24.072 [2024-04-16 23:04:15.016302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.072 [2024-04-16 23:04:15.016446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.072 [2024-04-16 23:04:15.016471] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:24.072 qpair failed and we were unable to recover it. 00:26:24.072 [2024-04-16 23:04:15.016590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.072 [2024-04-16 23:04:15.016698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.072 [2024-04-16 23:04:15.016722] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:24.072 qpair failed and we were unable to recover it. 00:26:24.072 [2024-04-16 23:04:15.016825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.072 [2024-04-16 23:04:15.016963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.072 [2024-04-16 23:04:15.016988] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:24.072 qpair failed and we were unable to recover it. 00:26:24.072 [2024-04-16 23:04:15.017092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.072 [2024-04-16 23:04:15.017234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.072 [2024-04-16 23:04:15.017261] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:24.072 qpair failed and we were unable to recover it. 00:26:24.072 [2024-04-16 23:04:15.017375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.072 [2024-04-16 23:04:15.017516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.072 [2024-04-16 23:04:15.017540] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:24.072 qpair failed and we were unable to recover it. 00:26:24.072 [2024-04-16 23:04:15.017685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.072 [2024-04-16 23:04:15.017796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.072 [2024-04-16 23:04:15.017820] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:24.072 qpair failed and we were unable to recover it. 00:26:24.072 [2024-04-16 23:04:15.017948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.072 [2024-04-16 23:04:15.018073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.072 [2024-04-16 23:04:15.018098] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:24.072 qpair failed and we were unable to recover it. 00:26:24.072 [2024-04-16 23:04:15.018208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.072 [2024-04-16 23:04:15.018348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.072 [2024-04-16 23:04:15.018373] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:24.072 qpair failed and we were unable to recover it. 00:26:24.072 [2024-04-16 23:04:15.018581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.072 [2024-04-16 23:04:15.018688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.072 [2024-04-16 23:04:15.018713] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:24.072 qpair failed and we were unable to recover it. 00:26:24.072 [2024-04-16 23:04:15.018857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.072 [2024-04-16 23:04:15.018999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.072 [2024-04-16 23:04:15.019024] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:24.072 qpair failed and we were unable to recover it. 00:26:24.072 [2024-04-16 23:04:15.019148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.072 [2024-04-16 23:04:15.019298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.072 [2024-04-16 23:04:15.019328] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:24.072 qpair failed and we were unable to recover it. 00:26:24.072 [2024-04-16 23:04:15.019476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.072 [2024-04-16 23:04:15.019594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.072 [2024-04-16 23:04:15.019620] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:24.072 qpair failed and we were unable to recover it. 00:26:24.072 [2024-04-16 23:04:15.019731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.072 [2024-04-16 23:04:15.019868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.072 [2024-04-16 23:04:15.019893] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:24.072 qpair failed and we were unable to recover it. 00:26:24.072 [2024-04-16 23:04:15.020033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.072 [2024-04-16 23:04:15.020148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.072 [2024-04-16 23:04:15.020172] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:24.072 qpair failed and we were unable to recover it. 00:26:24.072 [2024-04-16 23:04:15.020325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.072 [2024-04-16 23:04:15.020437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.072 [2024-04-16 23:04:15.020462] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:24.072 qpair failed and we were unable to recover it. 00:26:24.072 [2024-04-16 23:04:15.020624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.072 [2024-04-16 23:04:15.020774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.072 [2024-04-16 23:04:15.020799] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:24.072 qpair failed and we were unable to recover it. 00:26:24.072 [2024-04-16 23:04:15.020916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.072 [2024-04-16 23:04:15.021037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.072 [2024-04-16 23:04:15.021064] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:24.072 qpair failed and we were unable to recover it. 00:26:24.072 [2024-04-16 23:04:15.021207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.072 [2024-04-16 23:04:15.021312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.072 [2024-04-16 23:04:15.021337] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:24.072 qpair failed and we were unable to recover it. 00:26:24.072 [2024-04-16 23:04:15.021503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.072 [2024-04-16 23:04:15.021639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.072 [2024-04-16 23:04:15.021664] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:24.072 qpair failed and we were unable to recover it. 00:26:24.072 [2024-04-16 23:04:15.021771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.072 [2024-04-16 23:04:15.021885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.072 [2024-04-16 23:04:15.021910] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:24.072 qpair failed and we were unable to recover it. 00:26:24.072 [2024-04-16 23:04:15.022023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.072 [2024-04-16 23:04:15.022187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.072 [2024-04-16 23:04:15.022225] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:24.072 qpair failed and we were unable to recover it. 00:26:24.072 [2024-04-16 23:04:15.022394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.072 [2024-04-16 23:04:15.022511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.072 [2024-04-16 23:04:15.022536] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:24.072 qpair failed and we were unable to recover it. 00:26:24.072 [2024-04-16 23:04:15.022642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.072 [2024-04-16 23:04:15.022766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.072 [2024-04-16 23:04:15.022791] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:24.072 qpair failed and we were unable to recover it. 00:26:24.072 [2024-04-16 23:04:15.022933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.072 [2024-04-16 23:04:15.023043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.072 [2024-04-16 23:04:15.023068] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:24.072 qpair failed and we were unable to recover it. 00:26:24.072 [2024-04-16 23:04:15.023224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.072 [2024-04-16 23:04:15.023374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.072 [2024-04-16 23:04:15.023399] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:24.072 qpair failed and we were unable to recover it. 00:26:24.072 [2024-04-16 23:04:15.023511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.072 [2024-04-16 23:04:15.023623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.072 [2024-04-16 23:04:15.023648] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:24.072 qpair failed and we were unable to recover it. 00:26:24.072 [2024-04-16 23:04:15.023757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.072 [2024-04-16 23:04:15.023868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.072 [2024-04-16 23:04:15.023893] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:24.072 qpair failed and we were unable to recover it. 00:26:24.072 [2024-04-16 23:04:15.024015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.072 [2024-04-16 23:04:15.024155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.072 [2024-04-16 23:04:15.024194] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:24.072 qpair failed and we were unable to recover it. 00:26:24.072 [2024-04-16 23:04:15.024309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.072 [2024-04-16 23:04:15.024415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.072 [2024-04-16 23:04:15.024439] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:24.072 qpair failed and we were unable to recover it. 00:26:24.072 [2024-04-16 23:04:15.024576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.072 [2024-04-16 23:04:15.024679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.072 [2024-04-16 23:04:15.024704] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:24.072 qpair failed and we were unable to recover it. 00:26:24.072 [2024-04-16 23:04:15.024840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.072 [2024-04-16 23:04:15.024974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.072 [2024-04-16 23:04:15.025003] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:24.072 qpair failed and we were unable to recover it. 00:26:24.072 [2024-04-16 23:04:15.025132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.073 [2024-04-16 23:04:15.025242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.073 [2024-04-16 23:04:15.025268] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:24.073 qpair failed and we were unable to recover it. 00:26:24.073 [2024-04-16 23:04:15.025387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.073 [2024-04-16 23:04:15.025563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.073 [2024-04-16 23:04:15.025588] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:24.073 qpair failed and we were unable to recover it. 00:26:24.073 [2024-04-16 23:04:15.025710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.073 [2024-04-16 23:04:15.025819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.073 [2024-04-16 23:04:15.025845] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:24.073 qpair failed and we were unable to recover it. 00:26:24.073 [2024-04-16 23:04:15.025984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.073 [2024-04-16 23:04:15.026095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.073 [2024-04-16 23:04:15.026120] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:24.073 qpair failed and we were unable to recover it. 00:26:24.073 [2024-04-16 23:04:15.026241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.073 [2024-04-16 23:04:15.026351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.073 [2024-04-16 23:04:15.026376] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:24.073 qpair failed and we were unable to recover it. 00:26:24.073 [2024-04-16 23:04:15.026513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.073 [2024-04-16 23:04:15.026618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.073 [2024-04-16 23:04:15.026642] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:24.073 qpair failed and we were unable to recover it. 00:26:24.073 [2024-04-16 23:04:15.026747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.073 [2024-04-16 23:04:15.026881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.073 [2024-04-16 23:04:15.026905] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:24.073 qpair failed and we were unable to recover it. 00:26:24.073 [2024-04-16 23:04:15.027010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.073 [2024-04-16 23:04:15.027142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.073 [2024-04-16 23:04:15.027167] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:24.073 qpair failed and we were unable to recover it. 00:26:24.073 [2024-04-16 23:04:15.027326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.073 [2024-04-16 23:04:15.027440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.073 [2024-04-16 23:04:15.027471] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:24.073 qpair failed and we were unable to recover it. 00:26:24.073 [2024-04-16 23:04:15.027592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.073 [2024-04-16 23:04:15.027706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.073 [2024-04-16 23:04:15.027740] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:24.073 qpair failed and we were unable to recover it. 00:26:24.073 [2024-04-16 23:04:15.027854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.073 [2024-04-16 23:04:15.027969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.073 [2024-04-16 23:04:15.027996] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:24.073 qpair failed and we were unable to recover it. 00:26:24.073 [2024-04-16 23:04:15.028109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.073 [2024-04-16 23:04:15.028286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.073 [2024-04-16 23:04:15.028312] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:24.073 qpair failed and we were unable to recover it. 00:26:24.073 [2024-04-16 23:04:15.028433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.073 [2024-04-16 23:04:15.028550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.073 [2024-04-16 23:04:15.028575] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:24.073 qpair failed and we were unable to recover it. 00:26:24.073 [2024-04-16 23:04:15.028687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.073 [2024-04-16 23:04:15.028833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.073 [2024-04-16 23:04:15.028859] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:24.073 qpair failed and we were unable to recover it. 00:26:24.073 [2024-04-16 23:04:15.028972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.073 [2024-04-16 23:04:15.029090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.073 [2024-04-16 23:04:15.029115] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:24.073 qpair failed and we were unable to recover it. 00:26:24.073 [2024-04-16 23:04:15.029235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.073 [2024-04-16 23:04:15.029377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.073 [2024-04-16 23:04:15.029403] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:24.073 qpair failed and we were unable to recover it. 00:26:24.073 [2024-04-16 23:04:15.029513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.073 [2024-04-16 23:04:15.029621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.073 [2024-04-16 23:04:15.029646] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:24.073 qpair failed and we were unable to recover it. 00:26:24.073 [2024-04-16 23:04:15.029785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.073 [2024-04-16 23:04:15.029897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.073 [2024-04-16 23:04:15.029922] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:24.073 qpair failed and we were unable to recover it. 00:26:24.073 [2024-04-16 23:04:15.030032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.073 [2024-04-16 23:04:15.030187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.073 [2024-04-16 23:04:15.030213] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:24.073 qpair failed and we were unable to recover it. 00:26:24.073 [2024-04-16 23:04:15.030355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.073 [2024-04-16 23:04:15.030470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.073 [2024-04-16 23:04:15.030496] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:24.073 qpair failed and we were unable to recover it. 00:26:24.073 [2024-04-16 23:04:15.030632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.073 [2024-04-16 23:04:15.030746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.073 [2024-04-16 23:04:15.030772] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:24.073 qpair failed and we were unable to recover it. 00:26:24.073 [2024-04-16 23:04:15.030903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.073 [2024-04-16 23:04:15.031014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.073 [2024-04-16 23:04:15.031041] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:24.073 qpair failed and we were unable to recover it. 00:26:24.073 [2024-04-16 23:04:15.031167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.073 [2024-04-16 23:04:15.031309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.073 [2024-04-16 23:04:15.031335] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:24.073 qpair failed and we were unable to recover it. 00:26:24.073 [2024-04-16 23:04:15.031457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.073 [2024-04-16 23:04:15.031577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.073 [2024-04-16 23:04:15.031601] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:24.073 qpair failed and we were unable to recover it. 00:26:24.073 [2024-04-16 23:04:15.031729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.073 Malloc0 00:26:24.073 [2024-04-16 23:04:15.031872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.073 [2024-04-16 23:04:15.031898] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:24.073 qpair failed and we were unable to recover it. 00:26:24.073 [2024-04-16 23:04:15.032011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.073 23:04:15 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:26:24.073 [2024-04-16 23:04:15.032127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.073 [2024-04-16 23:04:15.032152] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:24.073 qpair failed and we were unable to recover it. 00:26:24.073 [2024-04-16 23:04:15.032269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.073 23:04:15 -- host/target_disconnect.sh@21 -- # rpc_cmd nvmf_create_transport -t tcp -o 00:26:24.073 [2024-04-16 23:04:15.032404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.073 23:04:15 -- common/autotest_common.sh@551 -- # xtrace_disable 00:26:24.073 [2024-04-16 23:04:15.032430] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:24.073 qpair failed and we were unable to recover it. 00:26:24.073 23:04:15 -- common/autotest_common.sh@10 -- # set +x 00:26:24.073 [2024-04-16 23:04:15.032544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.073 [2024-04-16 23:04:15.032689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.073 [2024-04-16 23:04:15.032715] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:24.073 qpair failed and we were unable to recover it. 00:26:24.073 [2024-04-16 23:04:15.032826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.073 [2024-04-16 23:04:15.032930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.073 [2024-04-16 23:04:15.032956] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:24.073 qpair failed and we were unable to recover it. 00:26:24.073 [2024-04-16 23:04:15.033116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.073 [2024-04-16 23:04:15.033267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.073 [2024-04-16 23:04:15.033297] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:24.073 qpair failed and we were unable to recover it. 00:26:24.073 [2024-04-16 23:04:15.033449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.073 [2024-04-16 23:04:15.033557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.073 [2024-04-16 23:04:15.033583] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:24.073 qpair failed and we were unable to recover it. 00:26:24.073 [2024-04-16 23:04:15.033716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.073 [2024-04-16 23:04:15.033834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.073 [2024-04-16 23:04:15.033859] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:24.073 qpair failed and we were unable to recover it. 00:26:24.073 [2024-04-16 23:04:15.033974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.073 [2024-04-16 23:04:15.034119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.073 [2024-04-16 23:04:15.034144] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:24.073 qpair failed and we were unable to recover it. 00:26:24.073 [2024-04-16 23:04:15.034259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.073 [2024-04-16 23:04:15.034365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.073 [2024-04-16 23:04:15.034389] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:24.073 qpair failed and we were unable to recover it. 00:26:24.073 [2024-04-16 23:04:15.034506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.073 [2024-04-16 23:04:15.034655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.073 [2024-04-16 23:04:15.034680] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:24.073 qpair failed and we were unable to recover it. 00:26:24.073 [2024-04-16 23:04:15.034784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.073 [2024-04-16 23:04:15.034927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.073 [2024-04-16 23:04:15.034951] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:24.073 qpair failed and we were unable to recover it. 00:26:24.073 [2024-04-16 23:04:15.035065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.073 [2024-04-16 23:04:15.035171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.073 [2024-04-16 23:04:15.035211] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:24.073 qpair failed and we were unable to recover it. 00:26:24.073 [2024-04-16 23:04:15.035331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.073 [2024-04-16 23:04:15.035445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.073 [2024-04-16 23:04:15.035470] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:24.073 qpair failed and we were unable to recover it. 00:26:24.073 [2024-04-16 23:04:15.035549] tcp.c: 659:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:26:24.073 [2024-04-16 23:04:15.035590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.073 [2024-04-16 23:04:15.035703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.073 [2024-04-16 23:04:15.035727] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:24.073 qpair failed and we were unable to recover it. 00:26:24.073 [2024-04-16 23:04:15.035860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.073 [2024-04-16 23:04:15.035997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.073 [2024-04-16 23:04:15.036020] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:24.073 qpair failed and we were unable to recover it. 00:26:24.073 [2024-04-16 23:04:15.036127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.073 [2024-04-16 23:04:15.036264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.074 [2024-04-16 23:04:15.036290] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:24.074 qpair failed and we were unable to recover it. 00:26:24.074 [2024-04-16 23:04:15.036401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.074 [2024-04-16 23:04:15.036547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.074 [2024-04-16 23:04:15.036572] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:24.074 qpair failed and we were unable to recover it. 00:26:24.074 [2024-04-16 23:04:15.036688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.074 [2024-04-16 23:04:15.036793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.074 [2024-04-16 23:04:15.036817] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:24.074 qpair failed and we were unable to recover it. 00:26:24.074 [2024-04-16 23:04:15.036927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.074 [2024-04-16 23:04:15.037029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.074 [2024-04-16 23:04:15.037055] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:24.074 qpair failed and we were unable to recover it. 00:26:24.074 [2024-04-16 23:04:15.037166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.074 [2024-04-16 23:04:15.037297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.074 [2024-04-16 23:04:15.037322] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:24.074 qpair failed and we were unable to recover it. 00:26:24.074 [2024-04-16 23:04:15.037465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.074 [2024-04-16 23:04:15.037585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.074 [2024-04-16 23:04:15.037610] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:24.074 qpair failed and we were unable to recover it. 00:26:24.074 [2024-04-16 23:04:15.037748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.074 [2024-04-16 23:04:15.037860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.074 [2024-04-16 23:04:15.037884] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:24.074 qpair failed and we were unable to recover it. 00:26:24.074 [2024-04-16 23:04:15.038020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.074 [2024-04-16 23:04:15.038126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.074 [2024-04-16 23:04:15.038151] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:24.074 qpair failed and we were unable to recover it. 00:26:24.074 [2024-04-16 23:04:15.038298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.074 [2024-04-16 23:04:15.038436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.074 [2024-04-16 23:04:15.038461] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:24.074 qpair failed and we were unable to recover it. 00:26:24.074 [2024-04-16 23:04:15.038586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.074 [2024-04-16 23:04:15.038757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.074 [2024-04-16 23:04:15.038782] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:24.074 qpair failed and we were unable to recover it. 00:26:24.074 [2024-04-16 23:04:15.038925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.074 [2024-04-16 23:04:15.039065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.074 [2024-04-16 23:04:15.039090] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:24.074 qpair failed and we were unable to recover it. 00:26:24.074 [2024-04-16 23:04:15.039212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.074 [2024-04-16 23:04:15.039330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.074 [2024-04-16 23:04:15.039355] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:24.074 qpair failed and we were unable to recover it. 00:26:24.074 [2024-04-16 23:04:15.039496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.074 [2024-04-16 23:04:15.039660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.074 [2024-04-16 23:04:15.039684] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:24.074 qpair failed and we were unable to recover it. 00:26:24.074 [2024-04-16 23:04:15.039796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.074 [2024-04-16 23:04:15.039935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.074 [2024-04-16 23:04:15.039960] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:24.074 qpair failed and we were unable to recover it. 00:26:24.074 [2024-04-16 23:04:15.040068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.074 [2024-04-16 23:04:15.040220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.074 [2024-04-16 23:04:15.040245] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:24.074 qpair failed and we were unable to recover it. 00:26:24.074 [2024-04-16 23:04:15.040354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.074 [2024-04-16 23:04:15.040514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.074 [2024-04-16 23:04:15.040539] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:24.074 qpair failed and we were unable to recover it. 00:26:24.074 [2024-04-16 23:04:15.040643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.074 [2024-04-16 23:04:15.040765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.074 [2024-04-16 23:04:15.040790] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:24.074 qpair failed and we were unable to recover it. 00:26:24.074 [2024-04-16 23:04:15.040902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.074 [2024-04-16 23:04:15.041013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.074 [2024-04-16 23:04:15.041040] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:24.074 qpair failed and we were unable to recover it. 00:26:24.074 [2024-04-16 23:04:15.041187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.074 [2024-04-16 23:04:15.041303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.074 [2024-04-16 23:04:15.041329] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:24.074 qpair failed and we were unable to recover it. 00:26:24.074 [2024-04-16 23:04:15.041442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.074 [2024-04-16 23:04:15.041561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.074 [2024-04-16 23:04:15.041590] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:24.074 qpair failed and we were unable to recover it. 00:26:24.074 [2024-04-16 23:04:15.041722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.074 [2024-04-16 23:04:15.041889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.074 [2024-04-16 23:04:15.041914] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:24.074 qpair failed and we were unable to recover it. 00:26:24.074 [2024-04-16 23:04:15.042021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.074 [2024-04-16 23:04:15.042136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.074 [2024-04-16 23:04:15.042160] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:24.074 qpair failed and we were unable to recover it. 00:26:24.074 [2024-04-16 23:04:15.042285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.074 [2024-04-16 23:04:15.042424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.074 [2024-04-16 23:04:15.042449] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:24.074 qpair failed and we were unable to recover it. 00:26:24.074 [2024-04-16 23:04:15.042567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.074 [2024-04-16 23:04:15.042677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.074 [2024-04-16 23:04:15.042703] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:24.074 qpair failed and we were unable to recover it. 00:26:24.074 [2024-04-16 23:04:15.042808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.074 [2024-04-16 23:04:15.042947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.074 [2024-04-16 23:04:15.042971] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:24.074 qpair failed and we were unable to recover it. 00:26:24.074 [2024-04-16 23:04:15.043122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.074 [2024-04-16 23:04:15.043255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.074 [2024-04-16 23:04:15.043280] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:24.074 qpair failed and we were unable to recover it. 00:26:24.074 [2024-04-16 23:04:15.043435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.074 [2024-04-16 23:04:15.043574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.074 [2024-04-16 23:04:15.043599] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:24.074 qpair failed and we were unable to recover it. 00:26:24.074 [2024-04-16 23:04:15.043717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.074 [2024-04-16 23:04:15.043830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.074 [2024-04-16 23:04:15.043855] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:24.074 qpair failed and we were unable to recover it. 00:26:24.074 23:04:15 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:26:24.074 [2024-04-16 23:04:15.043980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.074 23:04:15 -- host/target_disconnect.sh@22 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:26:24.074 [2024-04-16 23:04:15.044097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.074 [2024-04-16 23:04:15.044122] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10f39f0 with addr=10.0.0.2, port=4420 00:26:24.074 qpair failed and we were unable to recover it. 00:26:24.074 23:04:15 -- common/autotest_common.sh@551 -- # xtrace_disable 00:26:24.074 [2024-04-16 23:04:15.044289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.074 23:04:15 -- common/autotest_common.sh@10 -- # set +x 00:26:24.074 [2024-04-16 23:04:15.044425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.074 [2024-04-16 23:04:15.044453] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:24.074 qpair failed and we were unable to recover it. 00:26:24.074 [2024-04-16 23:04:15.044571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.074 [2024-04-16 23:04:15.044690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.074 [2024-04-16 23:04:15.044716] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:24.074 qpair failed and we were unable to recover it. 00:26:24.074 [2024-04-16 23:04:15.044825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.074 [2024-04-16 23:04:15.044947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.074 [2024-04-16 23:04:15.044972] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:24.074 qpair failed and we were unable to recover it. 00:26:24.074 [2024-04-16 23:04:15.045125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.074 [2024-04-16 23:04:15.045297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.074 [2024-04-16 23:04:15.045324] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:24.074 qpair failed and we were unable to recover it. 00:26:24.074 [2024-04-16 23:04:15.045435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.074 [2024-04-16 23:04:15.045556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.074 [2024-04-16 23:04:15.045581] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:24.074 qpair failed and we were unable to recover it. 00:26:24.074 [2024-04-16 23:04:15.045686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.074 [2024-04-16 23:04:15.045847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.074 [2024-04-16 23:04:15.045871] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:24.074 qpair failed and we were unable to recover it. 00:26:24.074 [2024-04-16 23:04:15.045983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.074 [2024-04-16 23:04:15.046118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.074 [2024-04-16 23:04:15.046143] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:24.074 qpair failed and we were unable to recover it. 00:26:24.074 [2024-04-16 23:04:15.046275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.074 [2024-04-16 23:04:15.046387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.074 [2024-04-16 23:04:15.046412] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:24.074 qpair failed and we were unable to recover it. 00:26:24.074 [2024-04-16 23:04:15.046521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.074 [2024-04-16 23:04:15.046639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.074 [2024-04-16 23:04:15.046664] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:24.074 qpair failed and we were unable to recover it. 00:26:24.074 [2024-04-16 23:04:15.046773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.074 [2024-04-16 23:04:15.046923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.074 [2024-04-16 23:04:15.046947] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:24.074 qpair failed and we were unable to recover it. 00:26:24.074 [2024-04-16 23:04:15.047072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.074 [2024-04-16 23:04:15.047220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.074 [2024-04-16 23:04:15.047247] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:24.074 qpair failed and we were unable to recover it. 00:26:24.074 [2024-04-16 23:04:15.047363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.074 [2024-04-16 23:04:15.047479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.074 [2024-04-16 23:04:15.047504] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:24.074 qpair failed and we were unable to recover it. 00:26:24.074 [2024-04-16 23:04:15.047623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.074 [2024-04-16 23:04:15.047761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.074 [2024-04-16 23:04:15.047786] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:24.074 qpair failed and we were unable to recover it. 00:26:24.074 [2024-04-16 23:04:15.047899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.074 [2024-04-16 23:04:15.048016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.074 [2024-04-16 23:04:15.048041] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:24.074 qpair failed and we were unable to recover it. 00:26:24.074 [2024-04-16 23:04:15.048188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.074 [2024-04-16 23:04:15.048304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.074 [2024-04-16 23:04:15.048329] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:24.074 qpair failed and we were unable to recover it. 00:26:24.074 [2024-04-16 23:04:15.048438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.074 [2024-04-16 23:04:15.048558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.074 [2024-04-16 23:04:15.048583] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:24.074 qpair failed and we were unable to recover it. 00:26:24.074 [2024-04-16 23:04:15.048721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.074 [2024-04-16 23:04:15.048828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.075 [2024-04-16 23:04:15.048853] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:24.075 qpair failed and we were unable to recover it. 00:26:24.075 [2024-04-16 23:04:15.048963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.075 [2024-04-16 23:04:15.049109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.075 [2024-04-16 23:04:15.049136] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:24.075 qpair failed and we were unable to recover it. 00:26:24.075 [2024-04-16 23:04:15.049326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.075 [2024-04-16 23:04:15.049432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.075 [2024-04-16 23:04:15.049457] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:24.075 qpair failed and we were unable to recover it. 00:26:24.075 [2024-04-16 23:04:15.049599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.075 [2024-04-16 23:04:15.049713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.075 [2024-04-16 23:04:15.049738] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:24.075 qpair failed and we were unable to recover it. 00:26:24.075 [2024-04-16 23:04:15.049893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.075 [2024-04-16 23:04:15.050002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.075 [2024-04-16 23:04:15.050027] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:24.075 qpair failed and we were unable to recover it. 00:26:24.075 [2024-04-16 23:04:15.050134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.075 [2024-04-16 23:04:15.050269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.075 [2024-04-16 23:04:15.050294] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:24.075 qpair failed and we were unable to recover it. 00:26:24.075 [2024-04-16 23:04:15.050411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.075 [2024-04-16 23:04:15.050571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.075 [2024-04-16 23:04:15.050596] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:24.075 qpair failed and we were unable to recover it. 00:26:24.075 [2024-04-16 23:04:15.050736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.075 [2024-04-16 23:04:15.050846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.075 [2024-04-16 23:04:15.050871] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:24.075 qpair failed and we were unable to recover it. 00:26:24.075 [2024-04-16 23:04:15.050985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.075 [2024-04-16 23:04:15.051125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.075 [2024-04-16 23:04:15.051150] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:24.075 qpair failed and we were unable to recover it. 00:26:24.075 [2024-04-16 23:04:15.051284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.075 [2024-04-16 23:04:15.051391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.075 [2024-04-16 23:04:15.051416] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:24.075 qpair failed and we were unable to recover it. 00:26:24.075 [2024-04-16 23:04:15.051576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.075 [2024-04-16 23:04:15.051723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.075 [2024-04-16 23:04:15.051748] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:24.075 qpair failed and we were unable to recover it. 00:26:24.075 23:04:15 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:26:24.075 [2024-04-16 23:04:15.051858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.075 23:04:15 -- host/target_disconnect.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:26:24.075 [2024-04-16 23:04:15.051972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.075 [2024-04-16 23:04:15.051997] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:24.075 qpair failed and we were unable to recover it. 00:26:24.075 23:04:15 -- common/autotest_common.sh@551 -- # xtrace_disable 00:26:24.075 [2024-04-16 23:04:15.052143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.075 23:04:15 -- common/autotest_common.sh@10 -- # set +x 00:26:24.075 [2024-04-16 23:04:15.052300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.075 [2024-04-16 23:04:15.052325] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:24.075 qpair failed and we were unable to recover it. 00:26:24.075 [2024-04-16 23:04:15.052437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.075 [2024-04-16 23:04:15.052618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.075 [2024-04-16 23:04:15.052644] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:24.075 qpair failed and we were unable to recover it. 00:26:24.075 [2024-04-16 23:04:15.052793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.075 [2024-04-16 23:04:15.052913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.075 [2024-04-16 23:04:15.052939] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:24.075 qpair failed and we were unable to recover it. 00:26:24.075 [2024-04-16 23:04:15.053055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.075 [2024-04-16 23:04:15.053169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.075 [2024-04-16 23:04:15.053202] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:24.075 qpair failed and we were unable to recover it. 00:26:24.075 [2024-04-16 23:04:15.053344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.075 [2024-04-16 23:04:15.053457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.075 [2024-04-16 23:04:15.053482] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:24.075 qpair failed and we were unable to recover it. 00:26:24.075 [2024-04-16 23:04:15.053590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.075 [2024-04-16 23:04:15.053733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.075 [2024-04-16 23:04:15.053759] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:24.075 qpair failed and we were unable to recover it. 00:26:24.075 [2024-04-16 23:04:15.053865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.075 [2024-04-16 23:04:15.054020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.075 [2024-04-16 23:04:15.054045] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:24.075 qpair failed and we were unable to recover it. 00:26:24.075 [2024-04-16 23:04:15.054154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.075 [2024-04-16 23:04:15.054277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.075 [2024-04-16 23:04:15.054303] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:24.075 qpair failed and we were unable to recover it. 00:26:24.075 [2024-04-16 23:04:15.054416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.075 [2024-04-16 23:04:15.054526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.075 [2024-04-16 23:04:15.054550] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:24.075 qpair failed and we were unable to recover it. 00:26:24.075 [2024-04-16 23:04:15.054682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.075 [2024-04-16 23:04:15.054799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.075 [2024-04-16 23:04:15.054823] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:24.075 qpair failed and we were unable to recover it. 00:26:24.075 [2024-04-16 23:04:15.054968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.075 [2024-04-16 23:04:15.055108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.075 [2024-04-16 23:04:15.055133] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:24.075 qpair failed and we were unable to recover it. 00:26:24.075 [2024-04-16 23:04:15.055274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.075 [2024-04-16 23:04:15.055400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.075 [2024-04-16 23:04:15.055426] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:24.075 qpair failed and we were unable to recover it. 00:26:24.075 [2024-04-16 23:04:15.055584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.075 [2024-04-16 23:04:15.055736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.075 [2024-04-16 23:04:15.055761] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:24.075 qpair failed and we were unable to recover it. 00:26:24.075 [2024-04-16 23:04:15.055900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.075 [2024-04-16 23:04:15.056009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.075 [2024-04-16 23:04:15.056034] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:24.075 qpair failed and we were unable to recover it. 00:26:24.075 [2024-04-16 23:04:15.056170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.075 [2024-04-16 23:04:15.056304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.075 [2024-04-16 23:04:15.056329] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:24.075 qpair failed and we were unable to recover it. 00:26:24.075 [2024-04-16 23:04:15.056442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.075 [2024-04-16 23:04:15.056567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.075 [2024-04-16 23:04:15.056592] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:24.075 qpair failed and we were unable to recover it. 00:26:24.075 [2024-04-16 23:04:15.056709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.075 [2024-04-16 23:04:15.056860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.075 [2024-04-16 23:04:15.056885] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:24.075 qpair failed and we were unable to recover it. 00:26:24.075 [2024-04-16 23:04:15.056996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.075 [2024-04-16 23:04:15.057111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.075 [2024-04-16 23:04:15.057135] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:24.075 qpair failed and we were unable to recover it. 00:26:24.075 [2024-04-16 23:04:15.057294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.075 [2024-04-16 23:04:15.057412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.075 [2024-04-16 23:04:15.057437] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:24.075 qpair failed and we were unable to recover it. 00:26:24.075 [2024-04-16 23:04:15.057549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.075 [2024-04-16 23:04:15.057671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.075 [2024-04-16 23:04:15.057697] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:24.075 qpair failed and we were unable to recover it. 00:26:24.075 [2024-04-16 23:04:15.057820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.075 [2024-04-16 23:04:15.057925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.075 [2024-04-16 23:04:15.057949] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:24.075 qpair failed and we were unable to recover it. 00:26:24.075 [2024-04-16 23:04:15.058089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.075 [2024-04-16 23:04:15.058241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.075 [2024-04-16 23:04:15.058271] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:24.075 qpair failed and we were unable to recover it. 00:26:24.075 [2024-04-16 23:04:15.058391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.075 [2024-04-16 23:04:15.058499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.075 [2024-04-16 23:04:15.058524] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:24.075 qpair failed and we were unable to recover it. 00:26:24.075 [2024-04-16 23:04:15.058663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.075 [2024-04-16 23:04:15.058820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.075 [2024-04-16 23:04:15.058844] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:24.075 qpair failed and we were unable to recover it. 00:26:24.075 [2024-04-16 23:04:15.058964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.075 [2024-04-16 23:04:15.059075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.075 [2024-04-16 23:04:15.059102] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:24.075 qpair failed and we were unable to recover it. 00:26:24.075 [2024-04-16 23:04:15.059256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.075 [2024-04-16 23:04:15.059365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.075 [2024-04-16 23:04:15.059390] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:24.075 qpair failed and we were unable to recover it. 00:26:24.075 [2024-04-16 23:04:15.059513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.075 [2024-04-16 23:04:15.059639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.075 [2024-04-16 23:04:15.059663] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:24.075 qpair failed and we were unable to recover it. 00:26:24.075 [2024-04-16 23:04:15.059781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.075 23:04:15 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:26:24.075 [2024-04-16 23:04:15.059908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.075 [2024-04-16 23:04:15.059933] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:24.075 qpair failed and we were unable to recover it. 00:26:24.075 [2024-04-16 23:04:15.060038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.075 23:04:15 -- host/target_disconnect.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:26:24.075 [2024-04-16 23:04:15.060151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.075 23:04:15 -- common/autotest_common.sh@551 -- # xtrace_disable 00:26:24.075 [2024-04-16 23:04:15.060180] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:24.075 qpair failed and we were unable to recover it. 00:26:24.075 23:04:15 -- common/autotest_common.sh@10 -- # set +x 00:26:24.075 [2024-04-16 23:04:15.060306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.075 [2024-04-16 23:04:15.060463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.075 [2024-04-16 23:04:15.060487] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:24.075 qpair failed and we were unable to recover it. 00:26:24.075 [2024-04-16 23:04:15.060608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.075 [2024-04-16 23:04:15.060746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.075 [2024-04-16 23:04:15.060771] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:24.075 qpair failed and we were unable to recover it. 00:26:24.075 [2024-04-16 23:04:15.060885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.075 [2024-04-16 23:04:15.061036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.076 [2024-04-16 23:04:15.061062] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:24.076 qpair failed and we were unable to recover it. 00:26:24.076 [2024-04-16 23:04:15.061188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.076 [2024-04-16 23:04:15.061314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.076 [2024-04-16 23:04:15.061340] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:24.076 qpair failed and we were unable to recover it. 00:26:24.076 [2024-04-16 23:04:15.061445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.076 [2024-04-16 23:04:15.061556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.076 [2024-04-16 23:04:15.061581] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:24.076 qpair failed and we were unable to recover it. 00:26:24.076 [2024-04-16 23:04:15.061707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.076 [2024-04-16 23:04:15.061811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.076 [2024-04-16 23:04:15.061836] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:24.076 qpair failed and we were unable to recover it. 00:26:24.076 [2024-04-16 23:04:15.061960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.076 [2024-04-16 23:04:15.062080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.076 [2024-04-16 23:04:15.062105] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:24.076 qpair failed and we were unable to recover it. 00:26:24.076 [2024-04-16 23:04:15.062248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.076 [2024-04-16 23:04:15.062360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.076 [2024-04-16 23:04:15.062385] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:24.076 qpair failed and we were unable to recover it. 00:26:24.076 [2024-04-16 23:04:15.062491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.076 [2024-04-16 23:04:15.062615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.076 [2024-04-16 23:04:15.062639] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:24.076 qpair failed and we were unable to recover it. 00:26:24.076 [2024-04-16 23:04:15.062763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.076 [2024-04-16 23:04:15.062869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.076 [2024-04-16 23:04:15.062894] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:24.076 qpair failed and we were unable to recover it. 00:26:24.076 [2024-04-16 23:04:15.063029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.076 [2024-04-16 23:04:15.063136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.076 [2024-04-16 23:04:15.063161] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:24.076 qpair failed and we were unable to recover it. 00:26:24.076 [2024-04-16 23:04:15.063295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.076 [2024-04-16 23:04:15.063406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.076 [2024-04-16 23:04:15.063432] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:24.076 qpair failed and we were unable to recover it. 00:26:24.076 [2024-04-16 23:04:15.063548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.076 [2024-04-16 23:04:15.063672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.076 [2024-04-16 23:04:15.063696] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f3eb0000b90 with addr=10.0.0.2, port=4420 00:26:24.076 qpair failed and we were unable to recover it. 00:26:24.076 [2024-04-16 23:04:15.063776] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:26:24.076 [2024-04-16 23:04:15.066251] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:26:24.076 [2024-04-16 23:04:15.066390] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:26:24.076 [2024-04-16 23:04:15.066417] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:26:24.076 [2024-04-16 23:04:15.066432] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:26:24.076 [2024-04-16 23:04:15.066444] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f3eb0000b90 00:26:24.076 [2024-04-16 23:04:15.066489] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:26:24.076 qpair failed and we were unable to recover it. 00:26:24.076 23:04:15 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:26:24.076 23:04:15 -- host/target_disconnect.sh@26 -- # rpc_cmd nvmf_subsystem_add_listener discovery -t tcp -a 10.0.0.2 -s 4420 00:26:24.076 23:04:15 -- common/autotest_common.sh@551 -- # xtrace_disable 00:26:24.076 23:04:15 -- common/autotest_common.sh@10 -- # set +x 00:26:24.076 23:04:15 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:26:24.076 23:04:15 -- host/target_disconnect.sh@58 -- # wait 392009 00:26:24.076 [2024-04-16 23:04:15.076170] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:26:24.076 [2024-04-16 23:04:15.076306] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:26:24.076 [2024-04-16 23:04:15.076333] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:26:24.076 [2024-04-16 23:04:15.076347] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:26:24.076 [2024-04-16 23:04:15.076360] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f3eb0000b90 00:26:24.076 [2024-04-16 23:04:15.076389] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:26:24.076 qpair failed and we were unable to recover it. 00:26:24.076 [2024-04-16 23:04:15.086152] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:26:24.076 [2024-04-16 23:04:15.086310] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:26:24.076 [2024-04-16 23:04:15.086336] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:26:24.076 [2024-04-16 23:04:15.086350] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:26:24.076 [2024-04-16 23:04:15.086362] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f3eb0000b90 00:26:24.076 [2024-04-16 23:04:15.086391] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:26:24.076 qpair failed and we were unable to recover it. 00:26:24.076 [2024-04-16 23:04:15.096137] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:26:24.076 [2024-04-16 23:04:15.096275] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:26:24.076 [2024-04-16 23:04:15.096306] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:26:24.076 [2024-04-16 23:04:15.096321] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:26:24.076 [2024-04-16 23:04:15.096333] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f3eb0000b90 00:26:24.076 [2024-04-16 23:04:15.096361] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:26:24.076 qpair failed and we were unable to recover it. 00:26:24.076 [2024-04-16 23:04:15.106138] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:26:24.076 [2024-04-16 23:04:15.106261] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:26:24.076 [2024-04-16 23:04:15.106288] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:26:24.076 [2024-04-16 23:04:15.106302] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:26:24.076 [2024-04-16 23:04:15.106314] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f3eb0000b90 00:26:24.076 [2024-04-16 23:04:15.106342] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:26:24.076 qpair failed and we were unable to recover it. 00:26:24.076 [2024-04-16 23:04:15.116168] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:26:24.076 [2024-04-16 23:04:15.116288] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:26:24.076 [2024-04-16 23:04:15.116314] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:26:24.076 [2024-04-16 23:04:15.116329] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:26:24.076 [2024-04-16 23:04:15.116341] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f3eb0000b90 00:26:24.076 [2024-04-16 23:04:15.116369] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:26:24.076 qpair failed and we were unable to recover it. 00:26:24.076 [2024-04-16 23:04:15.126207] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:26:24.076 [2024-04-16 23:04:15.126323] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:26:24.076 [2024-04-16 23:04:15.126351] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:26:24.076 [2024-04-16 23:04:15.126365] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:26:24.076 [2024-04-16 23:04:15.126377] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f3eb0000b90 00:26:24.076 [2024-04-16 23:04:15.126404] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:26:24.076 qpair failed and we were unable to recover it. 00:26:24.076 [2024-04-16 23:04:15.136235] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:26:24.076 [2024-04-16 23:04:15.136359] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:26:24.076 [2024-04-16 23:04:15.136385] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:26:24.076 [2024-04-16 23:04:15.136399] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:26:24.076 [2024-04-16 23:04:15.136411] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f3eb0000b90 00:26:24.076 [2024-04-16 23:04:15.136451] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:26:24.076 qpair failed and we were unable to recover it. 00:26:24.076 [2024-04-16 23:04:15.146258] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:26:24.076 [2024-04-16 23:04:15.146375] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:26:24.076 [2024-04-16 23:04:15.146401] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:26:24.076 [2024-04-16 23:04:15.146415] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:26:24.076 [2024-04-16 23:04:15.146427] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f3eb0000b90 00:26:24.076 [2024-04-16 23:04:15.146455] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:26:24.076 qpair failed and we were unable to recover it. 00:26:24.076 [2024-04-16 23:04:15.156251] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:26:24.076 [2024-04-16 23:04:15.156365] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:26:24.076 [2024-04-16 23:04:15.156391] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:26:24.076 [2024-04-16 23:04:15.156405] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:26:24.076 [2024-04-16 23:04:15.156417] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f3eb0000b90 00:26:24.076 [2024-04-16 23:04:15.156445] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:26:24.076 qpair failed and we were unable to recover it. 00:26:24.336 [2024-04-16 23:04:15.166292] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:26:24.336 [2024-04-16 23:04:15.166453] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:26:24.336 [2024-04-16 23:04:15.166480] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:26:24.336 [2024-04-16 23:04:15.166494] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:26:24.336 [2024-04-16 23:04:15.166506] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f3eb0000b90 00:26:24.336 [2024-04-16 23:04:15.166534] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:26:24.336 qpair failed and we were unable to recover it. 00:26:24.336 [2024-04-16 23:04:15.176285] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:26:24.336 [2024-04-16 23:04:15.176403] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:26:24.336 [2024-04-16 23:04:15.176439] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:26:24.336 [2024-04-16 23:04:15.176453] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:26:24.336 [2024-04-16 23:04:15.176464] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f3eb0000b90 00:26:24.336 [2024-04-16 23:04:15.176493] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:26:24.336 qpair failed and we were unable to recover it. 00:26:24.336 [2024-04-16 23:04:15.186384] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:26:24.336 [2024-04-16 23:04:15.186509] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:26:24.336 [2024-04-16 23:04:15.186540] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:26:24.336 [2024-04-16 23:04:15.186555] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:26:24.336 [2024-04-16 23:04:15.186567] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f3eb0000b90 00:26:24.336 [2024-04-16 23:04:15.186595] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:26:24.336 qpair failed and we were unable to recover it. 00:26:24.336 [2024-04-16 23:04:15.196384] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:26:24.336 [2024-04-16 23:04:15.196511] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:26:24.336 [2024-04-16 23:04:15.196536] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:26:24.336 [2024-04-16 23:04:15.196550] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:26:24.336 [2024-04-16 23:04:15.196562] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f3eb0000b90 00:26:24.336 [2024-04-16 23:04:15.196590] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:26:24.336 qpair failed and we were unable to recover it. 00:26:24.336 [2024-04-16 23:04:15.206397] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:26:24.336 [2024-04-16 23:04:15.206511] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:26:24.336 [2024-04-16 23:04:15.206536] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:26:24.336 [2024-04-16 23:04:15.206550] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:26:24.336 [2024-04-16 23:04:15.206562] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f3eb0000b90 00:26:24.336 [2024-04-16 23:04:15.206590] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:26:24.336 qpair failed and we were unable to recover it. 00:26:24.336 [2024-04-16 23:04:15.216421] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:26:24.336 [2024-04-16 23:04:15.216542] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:26:24.336 [2024-04-16 23:04:15.216567] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:26:24.336 [2024-04-16 23:04:15.216582] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:26:24.336 [2024-04-16 23:04:15.216593] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f3eb0000b90 00:26:24.336 [2024-04-16 23:04:15.216622] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:26:24.336 qpair failed and we were unable to recover it. 00:26:24.336 [2024-04-16 23:04:15.226645] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:26:24.336 [2024-04-16 23:04:15.226778] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:26:24.336 [2024-04-16 23:04:15.226805] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:26:24.336 [2024-04-16 23:04:15.226819] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:26:24.336 [2024-04-16 23:04:15.226831] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f3eb0000b90 00:26:24.336 [2024-04-16 23:04:15.226864] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:26:24.336 qpair failed and we were unable to recover it. 00:26:24.336 [2024-04-16 23:04:15.236536] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:26:24.336 [2024-04-16 23:04:15.236702] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:26:24.337 [2024-04-16 23:04:15.236728] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:26:24.337 [2024-04-16 23:04:15.236742] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:26:24.337 [2024-04-16 23:04:15.236753] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f3eb0000b90 00:26:24.337 [2024-04-16 23:04:15.236781] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:26:24.337 qpair failed and we were unable to recover it. 00:26:24.337 [2024-04-16 23:04:15.246553] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:26:24.337 [2024-04-16 23:04:15.246702] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:26:24.337 [2024-04-16 23:04:15.246727] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:26:24.337 [2024-04-16 23:04:15.246742] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:26:24.337 [2024-04-16 23:04:15.246753] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f3eb0000b90 00:26:24.337 [2024-04-16 23:04:15.246781] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:26:24.337 qpair failed and we were unable to recover it. 00:26:24.337 [2024-04-16 23:04:15.256563] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:26:24.337 [2024-04-16 23:04:15.256698] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:26:24.337 [2024-04-16 23:04:15.256723] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:26:24.337 [2024-04-16 23:04:15.256737] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:26:24.337 [2024-04-16 23:04:15.256748] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f3eb0000b90 00:26:24.337 [2024-04-16 23:04:15.256776] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:26:24.337 qpair failed and we were unable to recover it. 00:26:24.337 [2024-04-16 23:04:15.266576] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:26:24.337 [2024-04-16 23:04:15.266702] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:26:24.337 [2024-04-16 23:04:15.266728] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:26:24.337 [2024-04-16 23:04:15.266742] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:26:24.337 [2024-04-16 23:04:15.266757] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f3eb0000b90 00:26:24.337 [2024-04-16 23:04:15.266786] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:26:24.337 qpair failed and we were unable to recover it. 00:26:24.337 [2024-04-16 23:04:15.276607] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:26:24.337 [2024-04-16 23:04:15.276738] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:26:24.337 [2024-04-16 23:04:15.276763] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:26:24.337 [2024-04-16 23:04:15.276778] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:26:24.337 [2024-04-16 23:04:15.276789] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f3eb0000b90 00:26:24.337 [2024-04-16 23:04:15.276817] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:26:24.337 qpair failed and we were unable to recover it. 00:26:24.337 [2024-04-16 23:04:15.286653] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:26:24.337 [2024-04-16 23:04:15.286782] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:26:24.337 [2024-04-16 23:04:15.286808] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:26:24.337 [2024-04-16 23:04:15.286822] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:26:24.337 [2024-04-16 23:04:15.286834] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f3eb0000b90 00:26:24.337 [2024-04-16 23:04:15.286862] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:26:24.337 qpair failed and we were unable to recover it. 00:26:24.337 [2024-04-16 23:04:15.296651] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:26:24.337 [2024-04-16 23:04:15.296774] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:26:24.337 [2024-04-16 23:04:15.296800] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:26:24.337 [2024-04-16 23:04:15.296814] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:26:24.337 [2024-04-16 23:04:15.296826] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f3eb0000b90 00:26:24.337 [2024-04-16 23:04:15.296854] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:26:24.337 qpair failed and we were unable to recover it. 00:26:24.337 [2024-04-16 23:04:15.306729] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:26:24.337 [2024-04-16 23:04:15.306895] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:26:24.337 [2024-04-16 23:04:15.306921] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:26:24.337 [2024-04-16 23:04:15.306935] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:26:24.337 [2024-04-16 23:04:15.306946] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f3eb0000b90 00:26:24.337 [2024-04-16 23:04:15.306974] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:26:24.337 qpair failed and we were unable to recover it. 00:26:24.337 [2024-04-16 23:04:15.316749] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:26:24.337 [2024-04-16 23:04:15.316866] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:26:24.337 [2024-04-16 23:04:15.316891] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:26:24.337 [2024-04-16 23:04:15.316905] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:26:24.337 [2024-04-16 23:04:15.316922] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f3eb0000b90 00:26:24.337 [2024-04-16 23:04:15.316951] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:26:24.337 qpair failed and we were unable to recover it. 00:26:24.337 [2024-04-16 23:04:15.326742] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:26:24.337 [2024-04-16 23:04:15.326862] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:26:24.337 [2024-04-16 23:04:15.326887] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:26:24.337 [2024-04-16 23:04:15.326901] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:26:24.337 [2024-04-16 23:04:15.326913] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f3eb0000b90 00:26:24.337 [2024-04-16 23:04:15.326940] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:26:24.337 qpair failed and we were unable to recover it. 00:26:24.337 [2024-04-16 23:04:15.336788] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:26:24.337 [2024-04-16 23:04:15.336919] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:26:24.337 [2024-04-16 23:04:15.336944] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:26:24.337 [2024-04-16 23:04:15.336958] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:26:24.337 [2024-04-16 23:04:15.336970] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f3eb0000b90 00:26:24.337 [2024-04-16 23:04:15.336998] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:26:24.337 qpair failed and we were unable to recover it. 00:26:24.337 [2024-04-16 23:04:15.346883] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:26:24.337 [2024-04-16 23:04:15.347001] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:26:24.337 [2024-04-16 23:04:15.347026] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:26:24.337 [2024-04-16 23:04:15.347039] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:26:24.337 [2024-04-16 23:04:15.347051] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f3eb0000b90 00:26:24.337 [2024-04-16 23:04:15.347080] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:26:24.337 qpair failed and we were unable to recover it. 00:26:24.337 [2024-04-16 23:04:15.356834] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:26:24.337 [2024-04-16 23:04:15.356950] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:26:24.337 [2024-04-16 23:04:15.356976] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:26:24.337 [2024-04-16 23:04:15.356989] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:26:24.337 [2024-04-16 23:04:15.357002] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f3eb0000b90 00:26:24.337 [2024-04-16 23:04:15.357029] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:26:24.337 qpair failed and we were unable to recover it. 00:26:24.337 [2024-04-16 23:04:15.366848] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:26:24.337 [2024-04-16 23:04:15.366977] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:26:24.337 [2024-04-16 23:04:15.367001] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:26:24.337 [2024-04-16 23:04:15.367015] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:26:24.337 [2024-04-16 23:04:15.367027] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f3eb0000b90 00:26:24.338 [2024-04-16 23:04:15.367055] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:26:24.338 qpair failed and we were unable to recover it. 00:26:24.338 [2024-04-16 23:04:15.376867] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:26:24.338 [2024-04-16 23:04:15.376998] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:26:24.338 [2024-04-16 23:04:15.377023] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:26:24.338 [2024-04-16 23:04:15.377037] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:26:24.338 [2024-04-16 23:04:15.377049] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f3eb0000b90 00:26:24.338 [2024-04-16 23:04:15.377078] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:26:24.338 qpair failed and we were unable to recover it. 00:26:24.338 [2024-04-16 23:04:15.386933] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:26:24.338 [2024-04-16 23:04:15.387055] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:26:24.338 [2024-04-16 23:04:15.387080] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:26:24.338 [2024-04-16 23:04:15.387095] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:26:24.338 [2024-04-16 23:04:15.387106] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f3eb0000b90 00:26:24.338 [2024-04-16 23:04:15.387135] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:26:24.338 qpair failed and we were unable to recover it. 00:26:24.338 [2024-04-16 23:04:15.396939] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:26:24.338 [2024-04-16 23:04:15.397054] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:26:24.338 [2024-04-16 23:04:15.397080] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:26:24.338 [2024-04-16 23:04:15.397094] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:26:24.338 [2024-04-16 23:04:15.397106] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f3eb0000b90 00:26:24.338 [2024-04-16 23:04:15.397134] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:26:24.338 qpair failed and we were unable to recover it. 00:26:24.338 [2024-04-16 23:04:15.406974] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:26:24.338 [2024-04-16 23:04:15.407124] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:26:24.338 [2024-04-16 23:04:15.407151] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:26:24.338 [2024-04-16 23:04:15.407174] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:26:24.338 [2024-04-16 23:04:15.407199] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f3eb0000b90 00:26:24.338 [2024-04-16 23:04:15.407228] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:26:24.338 qpair failed and we were unable to recover it. 00:26:24.338 [2024-04-16 23:04:15.417015] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:26:24.338 [2024-04-16 23:04:15.417173] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:26:24.338 [2024-04-16 23:04:15.417207] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:26:24.338 [2024-04-16 23:04:15.417222] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:26:24.338 [2024-04-16 23:04:15.417234] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f3eb0000b90 00:26:24.338 [2024-04-16 23:04:15.417263] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:26:24.338 qpair failed and we were unable to recover it. 00:26:24.338 [2024-04-16 23:04:15.427022] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:26:24.338 [2024-04-16 23:04:15.427145] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:26:24.338 [2024-04-16 23:04:15.427171] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:26:24.338 [2024-04-16 23:04:15.427193] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:26:24.338 [2024-04-16 23:04:15.427206] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f3eb0000b90 00:26:24.338 [2024-04-16 23:04:15.427247] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:26:24.338 qpair failed and we were unable to recover it. 00:26:24.338 [2024-04-16 23:04:15.437019] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:26:24.338 [2024-04-16 23:04:15.437133] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:26:24.338 [2024-04-16 23:04:15.437159] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:26:24.338 [2024-04-16 23:04:15.437174] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:26:24.338 [2024-04-16 23:04:15.437197] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f3eb0000b90 00:26:24.338 [2024-04-16 23:04:15.437228] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:26:24.338 qpair failed and we were unable to recover it. 00:26:24.338 [2024-04-16 23:04:15.447059] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:26:24.338 [2024-04-16 23:04:15.447182] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:26:24.338 [2024-04-16 23:04:15.447209] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:26:24.338 [2024-04-16 23:04:15.447223] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:26:24.338 [2024-04-16 23:04:15.447235] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f3eb0000b90 00:26:24.338 [2024-04-16 23:04:15.447276] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:26:24.338 qpair failed and we were unable to recover it. 00:26:24.338 [2024-04-16 23:04:15.457108] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:26:24.338 [2024-04-16 23:04:15.457285] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:26:24.338 [2024-04-16 23:04:15.457311] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:26:24.338 [2024-04-16 23:04:15.457325] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:26:24.338 [2024-04-16 23:04:15.457337] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f3eb0000b90 00:26:24.338 [2024-04-16 23:04:15.457365] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:26:24.338 qpair failed and we were unable to recover it. 00:26:24.598 [2024-04-16 23:04:15.467103] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:26:24.598 [2024-04-16 23:04:15.467232] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:26:24.598 [2024-04-16 23:04:15.467258] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:26:24.598 [2024-04-16 23:04:15.467273] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:26:24.598 [2024-04-16 23:04:15.467285] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f3eb0000b90 00:26:24.598 [2024-04-16 23:04:15.467313] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:26:24.598 qpair failed and we were unable to recover it. 00:26:24.598 [2024-04-16 23:04:15.477124] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:26:24.598 [2024-04-16 23:04:15.477240] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:26:24.598 [2024-04-16 23:04:15.477264] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:26:24.598 [2024-04-16 23:04:15.477278] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:26:24.598 [2024-04-16 23:04:15.477290] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f3eb0000b90 00:26:24.598 [2024-04-16 23:04:15.477318] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:26:24.598 qpair failed and we were unable to recover it. 00:26:24.598 [2024-04-16 23:04:15.487167] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:26:24.598 [2024-04-16 23:04:15.487287] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:26:24.598 [2024-04-16 23:04:15.487312] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:26:24.598 [2024-04-16 23:04:15.487326] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:26:24.598 [2024-04-16 23:04:15.487338] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f3eb0000b90 00:26:24.598 [2024-04-16 23:04:15.487378] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:26:24.598 qpair failed and we were unable to recover it. 00:26:24.598 [2024-04-16 23:04:15.497224] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:26:24.598 [2024-04-16 23:04:15.497387] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:26:24.598 [2024-04-16 23:04:15.497412] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:26:24.598 [2024-04-16 23:04:15.497431] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:26:24.598 [2024-04-16 23:04:15.497444] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f3eb0000b90 00:26:24.598 [2024-04-16 23:04:15.497473] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:26:24.598 qpair failed and we were unable to recover it. 00:26:24.598 [2024-04-16 23:04:15.507225] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:26:24.598 [2024-04-16 23:04:15.507346] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:26:24.598 [2024-04-16 23:04:15.507373] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:26:24.598 [2024-04-16 23:04:15.507387] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:26:24.598 [2024-04-16 23:04:15.507398] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f3eb0000b90 00:26:24.598 [2024-04-16 23:04:15.507428] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:26:24.598 qpair failed and we were unable to recover it. 00:26:24.598 [2024-04-16 23:04:15.517262] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:26:24.599 [2024-04-16 23:04:15.517379] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:26:24.599 [2024-04-16 23:04:15.517405] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:26:24.599 [2024-04-16 23:04:15.517420] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:26:24.599 [2024-04-16 23:04:15.517433] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f3eb0000b90 00:26:24.599 [2024-04-16 23:04:15.517476] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:26:24.599 qpair failed and we were unable to recover it. 00:26:24.599 [2024-04-16 23:04:15.527296] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:26:24.599 [2024-04-16 23:04:15.527412] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:26:24.599 [2024-04-16 23:04:15.527438] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:26:24.599 [2024-04-16 23:04:15.527452] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:26:24.599 [2024-04-16 23:04:15.527464] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f3eb0000b90 00:26:24.599 [2024-04-16 23:04:15.527492] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:26:24.599 qpair failed and we were unable to recover it. 00:26:24.599 [2024-04-16 23:04:15.537360] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:26:24.599 [2024-04-16 23:04:15.537485] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:26:24.599 [2024-04-16 23:04:15.537511] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:26:24.599 [2024-04-16 23:04:15.537525] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:26:24.599 [2024-04-16 23:04:15.537537] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f3eb0000b90 00:26:24.599 [2024-04-16 23:04:15.537577] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:26:24.599 qpair failed and we were unable to recover it. 00:26:24.599 [2024-04-16 23:04:15.547328] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:26:24.599 [2024-04-16 23:04:15.547467] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:26:24.599 [2024-04-16 23:04:15.547492] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:26:24.599 [2024-04-16 23:04:15.547507] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:26:24.599 [2024-04-16 23:04:15.547519] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f3eb0000b90 00:26:24.599 [2024-04-16 23:04:15.547547] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:26:24.599 qpair failed and we were unable to recover it. 00:26:24.599 [2024-04-16 23:04:15.557389] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:26:24.599 [2024-04-16 23:04:15.557505] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:26:24.599 [2024-04-16 23:04:15.557530] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:26:24.599 [2024-04-16 23:04:15.557544] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:26:24.599 [2024-04-16 23:04:15.557556] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f3eb0000b90 00:26:24.599 [2024-04-16 23:04:15.557584] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:26:24.599 qpair failed and we were unable to recover it. 00:26:24.599 [2024-04-16 23:04:15.567399] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:26:24.599 [2024-04-16 23:04:15.567513] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:26:24.599 [2024-04-16 23:04:15.567538] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:26:24.599 [2024-04-16 23:04:15.567552] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:26:24.599 [2024-04-16 23:04:15.567564] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f3eb0000b90 00:26:24.599 [2024-04-16 23:04:15.567604] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:26:24.599 qpair failed and we were unable to recover it. 00:26:24.599 [2024-04-16 23:04:15.577440] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:26:24.599 [2024-04-16 23:04:15.577565] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:26:24.599 [2024-04-16 23:04:15.577590] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:26:24.599 [2024-04-16 23:04:15.577604] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:26:24.599 [2024-04-16 23:04:15.577616] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f3eb0000b90 00:26:24.599 [2024-04-16 23:04:15.577645] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:26:24.599 qpair failed and we were unable to recover it. 00:26:24.599 [2024-04-16 23:04:15.587463] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:26:24.599 [2024-04-16 23:04:15.587582] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:26:24.599 [2024-04-16 23:04:15.587613] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:26:24.599 [2024-04-16 23:04:15.587628] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:26:24.599 [2024-04-16 23:04:15.587640] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f3eb0000b90 00:26:24.599 [2024-04-16 23:04:15.587668] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:26:24.599 qpair failed and we were unable to recover it. 00:26:24.599 [2024-04-16 23:04:15.597494] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:26:24.599 [2024-04-16 23:04:15.597653] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:26:24.599 [2024-04-16 23:04:15.597678] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:26:24.599 [2024-04-16 23:04:15.597693] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:26:24.599 [2024-04-16 23:04:15.597704] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f3eb0000b90 00:26:24.599 [2024-04-16 23:04:15.597732] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:26:24.599 qpair failed and we were unable to recover it. 00:26:24.599 [2024-04-16 23:04:15.607519] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:26:24.599 [2024-04-16 23:04:15.607653] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:26:24.599 [2024-04-16 23:04:15.607679] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:26:24.599 [2024-04-16 23:04:15.607693] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:26:24.599 [2024-04-16 23:04:15.607704] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f3eb0000b90 00:26:24.599 [2024-04-16 23:04:15.607733] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:26:24.599 qpair failed and we were unable to recover it. 00:26:24.599 [2024-04-16 23:04:15.617574] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:26:24.599 [2024-04-16 23:04:15.617695] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:26:24.599 [2024-04-16 23:04:15.617720] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:26:24.599 [2024-04-16 23:04:15.617734] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:26:24.599 [2024-04-16 23:04:15.617746] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f3eb0000b90 00:26:24.599 [2024-04-16 23:04:15.617787] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:26:24.599 qpair failed and we were unable to recover it. 00:26:24.599 [2024-04-16 23:04:15.627576] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:26:24.599 [2024-04-16 23:04:15.627696] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:26:24.599 [2024-04-16 23:04:15.627722] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:26:24.599 [2024-04-16 23:04:15.627737] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:26:24.599 [2024-04-16 23:04:15.627749] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f3eb0000b90 00:26:24.599 [2024-04-16 23:04:15.627783] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:26:24.599 qpair failed and we were unable to recover it. 00:26:24.599 [2024-04-16 23:04:15.637610] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:26:24.599 [2024-04-16 23:04:15.637742] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:26:24.599 [2024-04-16 23:04:15.637767] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:26:24.599 [2024-04-16 23:04:15.637781] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:26:24.599 [2024-04-16 23:04:15.637793] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f3eb0000b90 00:26:24.599 [2024-04-16 23:04:15.637822] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:26:24.599 qpair failed and we were unable to recover it. 00:26:24.599 [2024-04-16 23:04:15.647677] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:26:24.599 [2024-04-16 23:04:15.647807] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:26:24.600 [2024-04-16 23:04:15.647835] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:26:24.600 [2024-04-16 23:04:15.647850] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:26:24.600 [2024-04-16 23:04:15.647862] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f3eb0000b90 00:26:24.600 [2024-04-16 23:04:15.647891] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:26:24.600 qpair failed and we were unable to recover it. 00:26:24.600 [2024-04-16 23:04:15.657694] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:26:24.600 [2024-04-16 23:04:15.657825] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:26:24.600 [2024-04-16 23:04:15.657851] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:26:24.600 [2024-04-16 23:04:15.657866] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:26:24.600 [2024-04-16 23:04:15.657878] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f3eb0000b90 00:26:24.600 [2024-04-16 23:04:15.657906] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:26:24.600 qpair failed and we were unable to recover it. 00:26:24.600 [2024-04-16 23:04:15.667694] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:26:24.600 [2024-04-16 23:04:15.667812] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:26:24.600 [2024-04-16 23:04:15.667837] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:26:24.600 [2024-04-16 23:04:15.667851] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:26:24.600 [2024-04-16 23:04:15.667863] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f3eb0000b90 00:26:24.600 [2024-04-16 23:04:15.667891] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:26:24.600 qpair failed and we were unable to recover it. 00:26:24.600 [2024-04-16 23:04:15.677756] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:26:24.600 [2024-04-16 23:04:15.677887] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:26:24.600 [2024-04-16 23:04:15.677918] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:26:24.600 [2024-04-16 23:04:15.677933] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:26:24.600 [2024-04-16 23:04:15.677944] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f3eb0000b90 00:26:24.600 [2024-04-16 23:04:15.677973] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:26:24.600 qpair failed and we were unable to recover it. 00:26:24.600 [2024-04-16 23:04:15.687829] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:26:24.600 [2024-04-16 23:04:15.687983] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:26:24.600 [2024-04-16 23:04:15.688009] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:26:24.600 [2024-04-16 23:04:15.688023] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:26:24.600 [2024-04-16 23:04:15.688035] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f3eb0000b90 00:26:24.600 [2024-04-16 23:04:15.688075] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:26:24.600 qpair failed and we were unable to recover it. 00:26:24.600 [2024-04-16 23:04:15.697800] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:26:24.600 [2024-04-16 23:04:15.697924] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:26:24.600 [2024-04-16 23:04:15.697949] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:26:24.600 [2024-04-16 23:04:15.697963] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:26:24.600 [2024-04-16 23:04:15.697974] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f3eb0000b90 00:26:24.600 [2024-04-16 23:04:15.698003] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:26:24.600 qpair failed and we were unable to recover it. 00:26:24.600 [2024-04-16 23:04:15.707819] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:26:24.600 [2024-04-16 23:04:15.707940] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:26:24.600 [2024-04-16 23:04:15.707966] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:26:24.600 [2024-04-16 23:04:15.707980] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:26:24.600 [2024-04-16 23:04:15.707992] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f3eb0000b90 00:26:24.600 [2024-04-16 23:04:15.708020] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:26:24.600 qpair failed and we were unable to recover it. 00:26:24.600 [2024-04-16 23:04:15.717870] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:26:24.600 [2024-04-16 23:04:15.717988] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:26:24.600 [2024-04-16 23:04:15.718014] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:26:24.600 [2024-04-16 23:04:15.718028] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:26:24.600 [2024-04-16 23:04:15.718040] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f3eb0000b90 00:26:24.600 [2024-04-16 23:04:15.718084] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:26:24.600 qpair failed and we were unable to recover it. 00:26:24.860 [2024-04-16 23:04:15.727934] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:26:24.860 [2024-04-16 23:04:15.728087] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:26:24.860 [2024-04-16 23:04:15.728112] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:26:24.860 [2024-04-16 23:04:15.728127] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:26:24.860 [2024-04-16 23:04:15.728139] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f3eb0000b90 00:26:24.860 [2024-04-16 23:04:15.728174] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:26:24.860 qpair failed and we were unable to recover it. 00:26:24.860 [2024-04-16 23:04:15.737954] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:26:24.860 [2024-04-16 23:04:15.738072] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:26:24.860 [2024-04-16 23:04:15.738097] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:26:24.860 [2024-04-16 23:04:15.738110] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:26:24.860 [2024-04-16 23:04:15.738122] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f3eb0000b90 00:26:24.860 [2024-04-16 23:04:15.738151] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:26:24.860 qpair failed and we were unable to recover it. 00:26:24.860 [2024-04-16 23:04:15.747963] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:26:24.860 [2024-04-16 23:04:15.748084] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:26:24.860 [2024-04-16 23:04:15.748109] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:26:24.860 [2024-04-16 23:04:15.748123] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:26:24.860 [2024-04-16 23:04:15.748135] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f3eb0000b90 00:26:24.860 [2024-04-16 23:04:15.748162] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:26:24.860 qpair failed and we were unable to recover it. 00:26:24.860 [2024-04-16 23:04:15.757999] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:26:24.860 [2024-04-16 23:04:15.758116] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:26:24.860 [2024-04-16 23:04:15.758141] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:26:24.860 [2024-04-16 23:04:15.758155] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:26:24.860 [2024-04-16 23:04:15.758167] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f3eb0000b90 00:26:24.860 [2024-04-16 23:04:15.758228] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:26:24.860 qpair failed and we were unable to recover it. 00:26:24.860 [2024-04-16 23:04:15.768012] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:26:24.860 [2024-04-16 23:04:15.768173] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:26:24.860 [2024-04-16 23:04:15.768213] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:26:24.860 [2024-04-16 23:04:15.768228] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:26:24.860 [2024-04-16 23:04:15.768240] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f3eb0000b90 00:26:24.860 [2024-04-16 23:04:15.768268] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:26:24.860 qpair failed and we were unable to recover it. 00:26:24.860 [2024-04-16 23:04:15.778107] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:26:24.860 [2024-04-16 23:04:15.778254] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:26:24.860 [2024-04-16 23:04:15.778279] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:26:24.860 [2024-04-16 23:04:15.778293] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:26:24.860 [2024-04-16 23:04:15.778305] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f3eb0000b90 00:26:24.860 [2024-04-16 23:04:15.778334] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:26:24.860 qpair failed and we were unable to recover it. 00:26:24.860 [2024-04-16 23:04:15.788103] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:26:24.860 [2024-04-16 23:04:15.788241] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:26:24.860 [2024-04-16 23:04:15.788267] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:26:24.860 [2024-04-16 23:04:15.788281] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:26:24.860 [2024-04-16 23:04:15.788293] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f3eb0000b90 00:26:24.860 [2024-04-16 23:04:15.788321] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:26:24.860 qpair failed and we were unable to recover it. 00:26:24.860 [2024-04-16 23:04:15.798131] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:26:24.860 [2024-04-16 23:04:15.798277] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:26:24.860 [2024-04-16 23:04:15.798303] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:26:24.860 [2024-04-16 23:04:15.798316] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:26:24.860 [2024-04-16 23:04:15.798328] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f3eb0000b90 00:26:24.860 [2024-04-16 23:04:15.798369] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:26:24.860 qpair failed and we were unable to recover it. 00:26:24.860 [2024-04-16 23:04:15.808123] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:26:24.860 [2024-04-16 23:04:15.808260] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:26:24.860 [2024-04-16 23:04:15.808286] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:26:24.860 [2024-04-16 23:04:15.808300] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:26:24.860 [2024-04-16 23:04:15.808317] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f3eb0000b90 00:26:24.860 [2024-04-16 23:04:15.808346] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:26:24.860 qpair failed and we were unable to recover it. 00:26:24.860 [2024-04-16 23:04:15.818212] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:26:24.860 [2024-04-16 23:04:15.818332] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:26:24.860 [2024-04-16 23:04:15.818357] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:26:24.860 [2024-04-16 23:04:15.818371] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:26:24.860 [2024-04-16 23:04:15.818383] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f3eb0000b90 00:26:24.860 [2024-04-16 23:04:15.818411] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:26:24.860 qpair failed and we were unable to recover it. 00:26:24.860 [2024-04-16 23:04:15.828212] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:26:24.860 [2024-04-16 23:04:15.828333] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:26:24.860 [2024-04-16 23:04:15.828359] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:26:24.860 [2024-04-16 23:04:15.828373] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:26:24.860 [2024-04-16 23:04:15.828384] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f3eb0000b90 00:26:24.860 [2024-04-16 23:04:15.828413] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:26:24.860 qpair failed and we were unable to recover it. 00:26:24.860 [2024-04-16 23:04:15.838231] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:26:24.860 [2024-04-16 23:04:15.838349] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:26:24.861 [2024-04-16 23:04:15.838374] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:26:24.861 [2024-04-16 23:04:15.838389] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:26:24.861 [2024-04-16 23:04:15.838400] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f3eb0000b90 00:26:24.861 [2024-04-16 23:04:15.838429] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:26:24.861 qpair failed and we were unable to recover it. 00:26:24.861 [2024-04-16 23:04:15.848257] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:26:24.861 [2024-04-16 23:04:15.848373] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:26:24.861 [2024-04-16 23:04:15.848399] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:26:24.861 [2024-04-16 23:04:15.848413] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:26:24.861 [2024-04-16 23:04:15.848425] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f3eb0000b90 00:26:24.861 [2024-04-16 23:04:15.848465] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:26:24.861 qpair failed and we were unable to recover it. 00:26:24.861 [2024-04-16 23:04:15.858293] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:26:24.861 [2024-04-16 23:04:15.858432] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:26:24.861 [2024-04-16 23:04:15.858458] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:26:24.861 [2024-04-16 23:04:15.858472] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:26:24.861 [2024-04-16 23:04:15.858484] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f3eb0000b90 00:26:24.861 [2024-04-16 23:04:15.858512] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:26:24.861 qpair failed and we were unable to recover it. 00:26:24.861 [2024-04-16 23:04:15.868338] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:26:24.861 [2024-04-16 23:04:15.868481] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:26:24.861 [2024-04-16 23:04:15.868507] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:26:24.861 [2024-04-16 23:04:15.868521] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:26:24.861 [2024-04-16 23:04:15.868533] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f3eb0000b90 00:26:24.861 [2024-04-16 23:04:15.868560] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:26:24.861 qpair failed and we were unable to recover it. 00:26:24.861 [2024-04-16 23:04:15.878347] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:26:24.861 [2024-04-16 23:04:15.878463] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:26:24.861 [2024-04-16 23:04:15.878488] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:26:24.861 [2024-04-16 23:04:15.878502] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:26:24.861 [2024-04-16 23:04:15.878514] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f3eb0000b90 00:26:24.861 [2024-04-16 23:04:15.878554] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:26:24.861 qpair failed and we were unable to recover it. 00:26:24.861 [2024-04-16 23:04:15.888366] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:26:24.861 [2024-04-16 23:04:15.888487] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:26:24.861 [2024-04-16 23:04:15.888513] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:26:24.861 [2024-04-16 23:04:15.888527] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:26:24.861 [2024-04-16 23:04:15.888539] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f3eb0000b90 00:26:24.861 [2024-04-16 23:04:15.888567] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:26:24.861 qpair failed and we were unable to recover it. 00:26:24.861 [2024-04-16 23:04:15.898409] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:26:24.861 [2024-04-16 23:04:15.898556] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:26:24.861 [2024-04-16 23:04:15.898581] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:26:24.861 [2024-04-16 23:04:15.898595] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:26:24.861 [2024-04-16 23:04:15.898612] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f3eb0000b90 00:26:24.861 [2024-04-16 23:04:15.898642] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:26:24.861 qpair failed and we were unable to recover it. 00:26:24.861 [2024-04-16 23:04:15.908406] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:26:24.861 [2024-04-16 23:04:15.908523] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:26:24.861 [2024-04-16 23:04:15.908550] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:26:24.861 [2024-04-16 23:04:15.908563] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:26:24.861 [2024-04-16 23:04:15.908575] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f3eb0000b90 00:26:24.861 [2024-04-16 23:04:15.908604] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:26:24.861 qpair failed and we were unable to recover it. 00:26:24.861 [2024-04-16 23:04:15.918568] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:26:24.861 [2024-04-16 23:04:15.918682] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:26:24.861 [2024-04-16 23:04:15.918707] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:26:24.861 [2024-04-16 23:04:15.918721] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:26:24.861 [2024-04-16 23:04:15.918733] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f3eb0000b90 00:26:24.861 [2024-04-16 23:04:15.918761] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:26:24.861 qpair failed and we were unable to recover it. 00:26:24.861 [2024-04-16 23:04:15.928469] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:26:24.861 [2024-04-16 23:04:15.928586] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:26:24.861 [2024-04-16 23:04:15.928611] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:26:24.861 [2024-04-16 23:04:15.928626] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:26:24.861 [2024-04-16 23:04:15.928638] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f3eb0000b90 00:26:24.861 [2024-04-16 23:04:15.928679] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:26:24.861 qpair failed and we were unable to recover it. 00:26:24.861 [2024-04-16 23:04:15.938532] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:26:24.861 [2024-04-16 23:04:15.938655] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:26:24.861 [2024-04-16 23:04:15.938681] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:26:24.861 [2024-04-16 23:04:15.938694] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:26:24.861 [2024-04-16 23:04:15.938706] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f3eb0000b90 00:26:24.861 [2024-04-16 23:04:15.938734] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:26:24.861 qpair failed and we were unable to recover it. 00:26:24.861 [2024-04-16 23:04:15.948573] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:26:24.861 [2024-04-16 23:04:15.948692] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:26:24.861 [2024-04-16 23:04:15.948718] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:26:24.861 [2024-04-16 23:04:15.948732] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:26:24.861 [2024-04-16 23:04:15.948744] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f3eb0000b90 00:26:24.861 [2024-04-16 23:04:15.948786] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:26:24.861 qpair failed and we were unable to recover it. 00:26:24.861 [2024-04-16 23:04:15.958635] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:26:24.861 [2024-04-16 23:04:15.958748] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:26:24.861 [2024-04-16 23:04:15.958774] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:26:24.861 [2024-04-16 23:04:15.958788] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:26:24.861 [2024-04-16 23:04:15.958800] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f3eb0000b90 00:26:24.861 [2024-04-16 23:04:15.958828] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:26:24.861 qpair failed and we were unable to recover it. 00:26:24.861 [2024-04-16 23:04:15.968608] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:26:24.861 [2024-04-16 23:04:15.968728] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:26:24.861 [2024-04-16 23:04:15.968753] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:26:24.862 [2024-04-16 23:04:15.968767] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:26:24.862 [2024-04-16 23:04:15.968779] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f3eb0000b90 00:26:24.862 [2024-04-16 23:04:15.968808] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:26:24.862 qpair failed and we were unable to recover it. 00:26:24.862 [2024-04-16 23:04:15.978719] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:26:24.862 [2024-04-16 23:04:15.978855] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:26:24.862 [2024-04-16 23:04:15.978880] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:26:24.862 [2024-04-16 23:04:15.978894] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:26:24.862 [2024-04-16 23:04:15.978907] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f3eb0000b90 00:26:24.862 [2024-04-16 23:04:15.978935] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:26:24.862 qpair failed and we were unable to recover it. 00:26:25.122 [2024-04-16 23:04:15.988737] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:26:25.122 [2024-04-16 23:04:15.988862] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:26:25.122 [2024-04-16 23:04:15.988888] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:26:25.122 [2024-04-16 23:04:15.988907] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:26:25.122 [2024-04-16 23:04:15.988919] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f3eb0000b90 00:26:25.122 [2024-04-16 23:04:15.988947] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:26:25.122 qpair failed and we were unable to recover it. 00:26:25.122 [2024-04-16 23:04:15.998763] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:26:25.122 [2024-04-16 23:04:15.998879] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:26:25.122 [2024-04-16 23:04:15.998905] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:26:25.122 [2024-04-16 23:04:15.998918] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:26:25.122 [2024-04-16 23:04:15.998930] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f3eb0000b90 00:26:25.122 [2024-04-16 23:04:15.998957] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:26:25.122 qpair failed and we were unable to recover it. 00:26:25.122 [2024-04-16 23:04:16.008706] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:26:25.122 [2024-04-16 23:04:16.008827] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:26:25.122 [2024-04-16 23:04:16.008852] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:26:25.122 [2024-04-16 23:04:16.008865] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:26:25.122 [2024-04-16 23:04:16.008877] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f3eb0000b90 00:26:25.122 [2024-04-16 23:04:16.008905] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:26:25.122 qpair failed and we were unable to recover it. 00:26:25.122 [2024-04-16 23:04:16.018853] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:26:25.122 [2024-04-16 23:04:16.018979] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:26:25.122 [2024-04-16 23:04:16.019004] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:26:25.122 [2024-04-16 23:04:16.019018] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:26:25.122 [2024-04-16 23:04:16.019030] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f3eb0000b90 00:26:25.122 [2024-04-16 23:04:16.019058] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:26:25.122 qpair failed and we were unable to recover it. 00:26:25.122 [2024-04-16 23:04:16.028768] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:26:25.122 [2024-04-16 23:04:16.028895] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:26:25.122 [2024-04-16 23:04:16.028921] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:26:25.122 [2024-04-16 23:04:16.028935] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:26:25.122 [2024-04-16 23:04:16.028947] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f3eb0000b90 00:26:25.122 [2024-04-16 23:04:16.028975] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:26:25.122 qpair failed and we were unable to recover it. 00:26:25.122 [2024-04-16 23:04:16.038795] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:26:25.122 [2024-04-16 23:04:16.038953] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:26:25.122 [2024-04-16 23:04:16.038977] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:26:25.122 [2024-04-16 23:04:16.038990] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:26:25.123 [2024-04-16 23:04:16.039002] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f3eb0000b90 00:26:25.123 [2024-04-16 23:04:16.039030] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:26:25.123 qpair failed and we were unable to recover it. 00:26:25.123 [2024-04-16 23:04:16.048845] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:26:25.123 [2024-04-16 23:04:16.048969] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:26:25.123 [2024-04-16 23:04:16.048994] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:26:25.123 [2024-04-16 23:04:16.049009] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:26:25.123 [2024-04-16 23:04:16.049020] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f3eb0000b90 00:26:25.123 [2024-04-16 23:04:16.049048] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:26:25.123 qpair failed and we were unable to recover it. 00:26:25.123 [2024-04-16 23:04:16.058883] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:26:25.123 [2024-04-16 23:04:16.059016] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:26:25.123 [2024-04-16 23:04:16.059041] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:26:25.123 [2024-04-16 23:04:16.059055] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:26:25.123 [2024-04-16 23:04:16.059067] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f3eb0000b90 00:26:25.123 [2024-04-16 23:04:16.059095] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:26:25.123 qpair failed and we were unable to recover it. 00:26:25.123 [2024-04-16 23:04:16.068923] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:26:25.123 [2024-04-16 23:04:16.069042] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:26:25.123 [2024-04-16 23:04:16.069067] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:26:25.123 [2024-04-16 23:04:16.069081] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:26:25.123 [2024-04-16 23:04:16.069093] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f3eb0000b90 00:26:25.123 [2024-04-16 23:04:16.069121] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:26:25.123 qpair failed and we were unable to recover it. 00:26:25.123 [2024-04-16 23:04:16.078910] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:26:25.123 [2024-04-16 23:04:16.079027] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:26:25.123 [2024-04-16 23:04:16.079059] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:26:25.123 [2024-04-16 23:04:16.079074] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:26:25.123 [2024-04-16 23:04:16.079086] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f3eb0000b90 00:26:25.123 [2024-04-16 23:04:16.079114] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:26:25.123 qpair failed and we were unable to recover it. 00:26:25.123 [2024-04-16 23:04:16.088959] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:26:25.123 [2024-04-16 23:04:16.089087] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:26:25.123 [2024-04-16 23:04:16.089114] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:26:25.123 [2024-04-16 23:04:16.089128] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:26:25.123 [2024-04-16 23:04:16.089140] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f3eb0000b90 00:26:25.123 [2024-04-16 23:04:16.089168] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:26:25.123 qpair failed and we were unable to recover it. 00:26:25.123 [2024-04-16 23:04:16.099034] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:26:25.123 [2024-04-16 23:04:16.099157] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:26:25.123 [2024-04-16 23:04:16.099190] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:26:25.123 [2024-04-16 23:04:16.099206] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:26:25.123 [2024-04-16 23:04:16.099218] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f3eb0000b90 00:26:25.123 [2024-04-16 23:04:16.099247] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:26:25.123 qpair failed and we were unable to recover it. 00:26:25.123 [2024-04-16 23:04:16.109028] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:26:25.123 [2024-04-16 23:04:16.109147] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:26:25.123 [2024-04-16 23:04:16.109173] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:26:25.123 [2024-04-16 23:04:16.109197] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:26:25.123 [2024-04-16 23:04:16.109209] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f3eb0000b90 00:26:25.123 [2024-04-16 23:04:16.109237] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:26:25.123 qpair failed and we were unable to recover it. 00:26:25.123 [2024-04-16 23:04:16.119061] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:26:25.123 [2024-04-16 23:04:16.119246] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:26:25.123 [2024-04-16 23:04:16.119272] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:26:25.123 [2024-04-16 23:04:16.119286] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:26:25.123 [2024-04-16 23:04:16.119297] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f3eb0000b90 00:26:25.123 [2024-04-16 23:04:16.119330] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:26:25.123 qpair failed and we were unable to recover it. 00:26:25.123 [2024-04-16 23:04:16.129109] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:26:25.123 [2024-04-16 23:04:16.129265] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:26:25.123 [2024-04-16 23:04:16.129291] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:26:25.123 [2024-04-16 23:04:16.129305] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:26:25.123 [2024-04-16 23:04:16.129317] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f3eb0000b90 00:26:25.123 [2024-04-16 23:04:16.129346] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:26:25.123 qpair failed and we were unable to recover it. 00:26:25.123 [2024-04-16 23:04:16.139149] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:26:25.123 [2024-04-16 23:04:16.139295] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:26:25.123 [2024-04-16 23:04:16.139321] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:26:25.123 [2024-04-16 23:04:16.139335] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:26:25.123 [2024-04-16 23:04:16.139347] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f3eb0000b90 00:26:25.123 [2024-04-16 23:04:16.139376] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:26:25.123 qpair failed and we were unable to recover it. 00:26:25.123 [2024-04-16 23:04:16.149185] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:26:25.123 [2024-04-16 23:04:16.149312] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:26:25.123 [2024-04-16 23:04:16.149344] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:26:25.123 [2024-04-16 23:04:16.149359] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:26:25.123 [2024-04-16 23:04:16.149372] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x10f39f0 00:26:25.123 [2024-04-16 23:04:16.149400] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:26:25.123 qpair failed and we were unable to recover it. 00:26:25.123 [2024-04-16 23:04:16.159173] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:26:25.123 [2024-04-16 23:04:16.159294] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:26:25.123 [2024-04-16 23:04:16.159321] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:26:25.123 [2024-04-16 23:04:16.159336] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:26:25.123 [2024-04-16 23:04:16.159348] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x10f39f0 00:26:25.123 [2024-04-16 23:04:16.159375] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:26:25.123 qpair failed and we were unable to recover it. 00:26:25.123 [2024-04-16 23:04:16.169221] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:26:25.123 [2024-04-16 23:04:16.169352] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:26:25.123 [2024-04-16 23:04:16.169386] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:26:25.123 [2024-04-16 23:04:16.169401] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:26:25.123 [2024-04-16 23:04:16.169413] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x10f39f0 00:26:25.123 [2024-04-16 23:04:16.169441] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:26:25.123 qpair failed and we were unable to recover it. 00:26:25.123 [2024-04-16 23:04:16.179269] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:26:25.124 [2024-04-16 23:04:16.179395] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:26:25.124 [2024-04-16 23:04:16.179422] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:26:25.124 [2024-04-16 23:04:16.179436] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:26:25.124 [2024-04-16 23:04:16.179448] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x10f39f0 00:26:25.124 [2024-04-16 23:04:16.179475] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:26:25.124 qpair failed and we were unable to recover it. 00:26:25.124 [2024-04-16 23:04:16.189268] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:26:25.124 [2024-04-16 23:04:16.189404] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:26:25.124 [2024-04-16 23:04:16.189430] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:26:25.124 [2024-04-16 23:04:16.189444] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:26:25.124 [2024-04-16 23:04:16.189456] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x10f39f0 00:26:25.124 [2024-04-16 23:04:16.189483] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:26:25.124 qpair failed and we were unable to recover it. 00:26:25.124 [2024-04-16 23:04:16.199314] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:26:25.124 [2024-04-16 23:04:16.199431] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:26:25.124 [2024-04-16 23:04:16.199457] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:26:25.124 [2024-04-16 23:04:16.199472] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:26:25.124 [2024-04-16 23:04:16.199484] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x10f39f0 00:26:25.124 [2024-04-16 23:04:16.199511] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:26:25.124 qpair failed and we were unable to recover it. 00:26:25.124 [2024-04-16 23:04:16.209302] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:26:25.124 [2024-04-16 23:04:16.209446] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:26:25.124 [2024-04-16 23:04:16.209472] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:26:25.124 [2024-04-16 23:04:16.209486] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:26:25.124 [2024-04-16 23:04:16.209498] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x10f39f0 00:26:25.124 [2024-04-16 23:04:16.209530] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:26:25.124 qpair failed and we were unable to recover it. 00:26:25.124 [2024-04-16 23:04:16.219389] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:26:25.124 [2024-04-16 23:04:16.219503] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:26:25.124 [2024-04-16 23:04:16.219529] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:26:25.124 [2024-04-16 23:04:16.219543] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:26:25.124 [2024-04-16 23:04:16.219555] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x10f39f0 00:26:25.124 [2024-04-16 23:04:16.219581] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:26:25.124 qpair failed and we were unable to recover it. 00:26:25.124 [2024-04-16 23:04:16.229393] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:26:25.124 [2024-04-16 23:04:16.229543] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:26:25.124 [2024-04-16 23:04:16.229568] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:26:25.124 [2024-04-16 23:04:16.229582] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:26:25.124 [2024-04-16 23:04:16.229595] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x10f39f0 00:26:25.124 [2024-04-16 23:04:16.229621] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:26:25.124 qpair failed and we were unable to recover it. 00:26:25.124 [2024-04-16 23:04:16.239463] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:26:25.124 [2024-04-16 23:04:16.239600] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:26:25.124 [2024-04-16 23:04:16.239626] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:26:25.124 [2024-04-16 23:04:16.239640] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:26:25.124 [2024-04-16 23:04:16.239651] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x10f39f0 00:26:25.124 [2024-04-16 23:04:16.239678] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:26:25.124 qpair failed and we were unable to recover it. 00:26:25.124 [2024-04-16 23:04:16.249425] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:26:25.385 [2024-04-16 23:04:16.249565] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:26:25.385 [2024-04-16 23:04:16.249593] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:26:25.385 [2024-04-16 23:04:16.249608] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:26:25.385 [2024-04-16 23:04:16.249621] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x10f39f0 00:26:25.385 [2024-04-16 23:04:16.249648] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:26:25.385 qpair failed and we were unable to recover it. 00:26:25.385 [2024-04-16 23:04:16.259490] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:26:25.385 [2024-04-16 23:04:16.259612] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:26:25.385 [2024-04-16 23:04:16.259644] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:26:25.385 [2024-04-16 23:04:16.259659] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:26:25.385 [2024-04-16 23:04:16.259671] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x10f39f0 00:26:25.385 [2024-04-16 23:04:16.259698] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:26:25.385 qpair failed and we were unable to recover it. 00:26:25.385 [2024-04-16 23:04:16.269502] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:26:25.385 [2024-04-16 23:04:16.269627] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:26:25.385 [2024-04-16 23:04:16.269654] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:26:25.385 [2024-04-16 23:04:16.269669] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:26:25.385 [2024-04-16 23:04:16.269680] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x10f39f0 00:26:25.385 [2024-04-16 23:04:16.269707] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:26:25.385 qpair failed and we were unable to recover it. 00:26:25.385 [2024-04-16 23:04:16.279505] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:26:25.385 [2024-04-16 23:04:16.279633] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:26:25.385 [2024-04-16 23:04:16.279659] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:26:25.385 [2024-04-16 23:04:16.279673] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:26:25.385 [2024-04-16 23:04:16.279685] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x10f39f0 00:26:25.385 [2024-04-16 23:04:16.279712] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:26:25.385 qpair failed and we were unable to recover it. 00:26:25.385 [2024-04-16 23:04:16.289538] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:26:25.385 [2024-04-16 23:04:16.289653] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:26:25.385 [2024-04-16 23:04:16.289679] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:26:25.385 [2024-04-16 23:04:16.289693] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:26:25.385 [2024-04-16 23:04:16.289704] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x10f39f0 00:26:25.385 [2024-04-16 23:04:16.289731] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:26:25.385 qpair failed and we were unable to recover it. 00:26:25.385 [2024-04-16 23:04:16.299603] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:26:25.385 [2024-04-16 23:04:16.299763] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:26:25.386 [2024-04-16 23:04:16.299788] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:26:25.386 [2024-04-16 23:04:16.299802] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:26:25.386 [2024-04-16 23:04:16.299814] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x10f39f0 00:26:25.386 [2024-04-16 23:04:16.299845] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:26:25.386 qpair failed and we were unable to recover it. 00:26:25.386 [2024-04-16 23:04:16.309596] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:26:25.386 [2024-04-16 23:04:16.309711] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:26:25.386 [2024-04-16 23:04:16.309738] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:26:25.386 [2024-04-16 23:04:16.309752] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:26:25.386 [2024-04-16 23:04:16.309764] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x10f39f0 00:26:25.386 [2024-04-16 23:04:16.309790] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:26:25.386 qpair failed and we were unable to recover it. 00:26:25.386 [2024-04-16 23:04:16.319646] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:26:25.386 [2024-04-16 23:04:16.319812] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:26:25.386 [2024-04-16 23:04:16.319838] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:26:25.386 [2024-04-16 23:04:16.319852] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:26:25.386 [2024-04-16 23:04:16.319864] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x10f39f0 00:26:25.386 [2024-04-16 23:04:16.319891] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:26:25.386 qpair failed and we were unable to recover it. 00:26:25.386 [2024-04-16 23:04:16.329679] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:26:25.386 [2024-04-16 23:04:16.329801] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:26:25.386 [2024-04-16 23:04:16.329827] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:26:25.386 [2024-04-16 23:04:16.329841] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:26:25.386 [2024-04-16 23:04:16.329852] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x10f39f0 00:26:25.386 [2024-04-16 23:04:16.329880] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:26:25.386 qpair failed and we were unable to recover it. 00:26:25.386 [2024-04-16 23:04:16.339717] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:26:25.386 [2024-04-16 23:04:16.339838] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:26:25.386 [2024-04-16 23:04:16.339863] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:26:25.386 [2024-04-16 23:04:16.339877] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:26:25.386 [2024-04-16 23:04:16.339889] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x10f39f0 00:26:25.386 [2024-04-16 23:04:16.339916] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:26:25.386 qpair failed and we were unable to recover it. 00:26:25.386 [2024-04-16 23:04:16.349749] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:26:25.386 [2024-04-16 23:04:16.349870] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:26:25.386 [2024-04-16 23:04:16.349900] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:26:25.386 [2024-04-16 23:04:16.349916] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:26:25.386 [2024-04-16 23:04:16.349928] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x10f39f0 00:26:25.386 [2024-04-16 23:04:16.349955] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:26:25.386 qpair failed and we were unable to recover it. 00:26:25.386 [2024-04-16 23:04:16.359760] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:26:25.386 [2024-04-16 23:04:16.359875] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:26:25.386 [2024-04-16 23:04:16.359901] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:26:25.386 [2024-04-16 23:04:16.359916] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:26:25.386 [2024-04-16 23:04:16.359927] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x10f39f0 00:26:25.386 [2024-04-16 23:04:16.359954] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:26:25.386 qpair failed and we were unable to recover it. 00:26:25.386 [2024-04-16 23:04:16.369785] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:26:25.386 [2024-04-16 23:04:16.369939] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:26:25.386 [2024-04-16 23:04:16.369965] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:26:25.386 [2024-04-16 23:04:16.369979] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:26:25.386 [2024-04-16 23:04:16.369990] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x10f39f0 00:26:25.386 [2024-04-16 23:04:16.370017] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:26:25.386 qpair failed and we were unable to recover it. 00:26:25.386 [2024-04-16 23:04:16.379804] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:26:25.386 [2024-04-16 23:04:16.379919] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:26:25.386 [2024-04-16 23:04:16.379944] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:26:25.386 [2024-04-16 23:04:16.379958] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:26:25.386 [2024-04-16 23:04:16.379969] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x10f39f0 00:26:25.386 [2024-04-16 23:04:16.379997] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:26:25.386 qpair failed and we were unable to recover it. 00:26:25.386 [2024-04-16 23:04:16.389858] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:26:25.386 [2024-04-16 23:04:16.389978] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:26:25.386 [2024-04-16 23:04:16.390003] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:26:25.386 [2024-04-16 23:04:16.390017] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:26:25.386 [2024-04-16 23:04:16.390028] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x10f39f0 00:26:25.386 [2024-04-16 23:04:16.390060] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:26:25.386 qpair failed and we were unable to recover it. 00:26:25.386 [2024-04-16 23:04:16.399882] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:26:25.386 [2024-04-16 23:04:16.399998] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:26:25.386 [2024-04-16 23:04:16.400024] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:26:25.386 [2024-04-16 23:04:16.400041] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:26:25.386 [2024-04-16 23:04:16.400054] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x10f39f0 00:26:25.386 [2024-04-16 23:04:16.400082] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:26:25.386 qpair failed and we were unable to recover it. 00:26:25.386 [2024-04-16 23:04:16.409922] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:26:25.386 [2024-04-16 23:04:16.410039] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:26:25.386 [2024-04-16 23:04:16.410064] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:26:25.386 [2024-04-16 23:04:16.410078] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:26:25.386 [2024-04-16 23:04:16.410090] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x10f39f0 00:26:25.386 [2024-04-16 23:04:16.410117] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:26:25.386 qpair failed and we were unable to recover it. 00:26:25.386 [2024-04-16 23:04:16.419960] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:26:25.386 [2024-04-16 23:04:16.420122] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:26:25.386 [2024-04-16 23:04:16.420147] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:26:25.386 [2024-04-16 23:04:16.420161] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:26:25.386 [2024-04-16 23:04:16.420173] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x10f39f0 00:26:25.386 [2024-04-16 23:04:16.420208] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:26:25.386 qpair failed and we were unable to recover it. 00:26:25.386 [2024-04-16 23:04:16.429950] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:26:25.386 [2024-04-16 23:04:16.430065] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:26:25.386 [2024-04-16 23:04:16.430090] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:26:25.386 [2024-04-16 23:04:16.430103] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:26:25.387 [2024-04-16 23:04:16.430115] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x10f39f0 00:26:25.387 [2024-04-16 23:04:16.430142] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:26:25.387 qpair failed and we were unable to recover it. 00:26:25.387 [2024-04-16 23:04:16.439978] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:26:25.387 [2024-04-16 23:04:16.440136] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:26:25.387 [2024-04-16 23:04:16.440167] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:26:25.387 [2024-04-16 23:04:16.440189] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:26:25.387 [2024-04-16 23:04:16.440201] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x10f39f0 00:26:25.387 [2024-04-16 23:04:16.440229] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:26:25.387 qpair failed and we were unable to recover it. 00:26:25.387 [2024-04-16 23:04:16.450003] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:26:25.387 [2024-04-16 23:04:16.450122] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:26:25.387 [2024-04-16 23:04:16.450150] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:26:25.387 [2024-04-16 23:04:16.450165] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:26:25.387 [2024-04-16 23:04:16.450184] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x10f39f0 00:26:25.387 [2024-04-16 23:04:16.450214] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:26:25.387 qpair failed and we were unable to recover it. 00:26:25.387 [2024-04-16 23:04:16.460057] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:26:25.387 [2024-04-16 23:04:16.460186] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:26:25.387 [2024-04-16 23:04:16.460212] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:26:25.387 [2024-04-16 23:04:16.460226] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:26:25.387 [2024-04-16 23:04:16.460238] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x10f39f0 00:26:25.387 [2024-04-16 23:04:16.460265] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:26:25.387 qpair failed and we were unable to recover it. 00:26:25.387 [2024-04-16 23:04:16.470050] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:26:25.387 [2024-04-16 23:04:16.470168] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:26:25.387 [2024-04-16 23:04:16.470201] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:26:25.387 [2024-04-16 23:04:16.470216] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:26:25.387 [2024-04-16 23:04:16.470228] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x10f39f0 00:26:25.387 [2024-04-16 23:04:16.470260] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:26:25.387 qpair failed and we were unable to recover it. 00:26:25.387 [2024-04-16 23:04:16.480071] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:26:25.387 [2024-04-16 23:04:16.480186] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:26:25.387 [2024-04-16 23:04:16.480214] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:26:25.387 [2024-04-16 23:04:16.480235] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:26:25.387 [2024-04-16 23:04:16.480253] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x10f39f0 00:26:25.387 [2024-04-16 23:04:16.480281] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:26:25.387 qpair failed and we were unable to recover it. 00:26:25.387 [2024-04-16 23:04:16.490106] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:26:25.387 [2024-04-16 23:04:16.490214] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:26:25.387 [2024-04-16 23:04:16.490238] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:26:25.387 [2024-04-16 23:04:16.490252] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:26:25.387 [2024-04-16 23:04:16.490264] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x10f39f0 00:26:25.387 [2024-04-16 23:04:16.490291] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:26:25.387 qpair failed and we were unable to recover it. 00:26:25.387 [2024-04-16 23:04:16.500164] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:26:25.387 [2024-04-16 23:04:16.500298] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:26:25.387 [2024-04-16 23:04:16.500324] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:26:25.387 [2024-04-16 23:04:16.500338] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:26:25.387 [2024-04-16 23:04:16.500350] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x10f39f0 00:26:25.387 [2024-04-16 23:04:16.500377] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:26:25.387 qpair failed and we were unable to recover it. 00:26:25.387 [2024-04-16 23:04:16.510154] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:26:25.387 [2024-04-16 23:04:16.510298] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:26:25.387 [2024-04-16 23:04:16.510325] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:26:25.387 [2024-04-16 23:04:16.510340] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:26:25.387 [2024-04-16 23:04:16.510352] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x10f39f0 00:26:25.387 [2024-04-16 23:04:16.510379] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:26:25.387 qpair failed and we were unable to recover it. 00:26:25.648 [2024-04-16 23:04:16.520232] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:26:25.648 [2024-04-16 23:04:16.520351] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:26:25.648 [2024-04-16 23:04:16.520378] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:26:25.648 [2024-04-16 23:04:16.520393] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:26:25.648 [2024-04-16 23:04:16.520405] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x10f39f0 00:26:25.648 [2024-04-16 23:04:16.520433] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:26:25.648 qpair failed and we were unable to recover it. 00:26:25.648 [2024-04-16 23:04:16.530239] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:26:25.648 [2024-04-16 23:04:16.530398] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:26:25.648 [2024-04-16 23:04:16.530424] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:26:25.648 [2024-04-16 23:04:16.530438] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:26:25.648 [2024-04-16 23:04:16.530450] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x10f39f0 00:26:25.648 [2024-04-16 23:04:16.530478] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:26:25.648 qpair failed and we were unable to recover it. 00:26:25.648 [2024-04-16 23:04:16.540282] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:26:25.648 [2024-04-16 23:04:16.540403] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:26:25.648 [2024-04-16 23:04:16.540428] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:26:25.648 [2024-04-16 23:04:16.540442] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:26:25.648 [2024-04-16 23:04:16.540454] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x10f39f0 00:26:25.648 [2024-04-16 23:04:16.540481] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:26:25.648 qpair failed and we were unable to recover it. 00:26:25.648 [2024-04-16 23:04:16.550310] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:26:25.648 [2024-04-16 23:04:16.550433] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:26:25.648 [2024-04-16 23:04:16.550458] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:26:25.648 [2024-04-16 23:04:16.550472] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:26:25.648 [2024-04-16 23:04:16.550487] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x10f39f0 00:26:25.648 [2024-04-16 23:04:16.550514] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:26:25.648 qpair failed and we were unable to recover it. 00:26:25.648 [2024-04-16 23:04:16.560366] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:26:25.648 [2024-04-16 23:04:16.560485] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:26:25.648 [2024-04-16 23:04:16.560511] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:26:25.648 [2024-04-16 23:04:16.560525] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:26:25.648 [2024-04-16 23:04:16.560536] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x10f39f0 00:26:25.648 [2024-04-16 23:04:16.560563] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:26:25.648 qpair failed and we were unable to recover it. 00:26:25.648 [2024-04-16 23:04:16.570352] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:26:25.648 [2024-04-16 23:04:16.570467] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:26:25.648 [2024-04-16 23:04:16.570492] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:26:25.648 [2024-04-16 23:04:16.570506] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:26:25.648 [2024-04-16 23:04:16.570522] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x10f39f0 00:26:25.648 [2024-04-16 23:04:16.570550] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:26:25.648 qpair failed and we were unable to recover it. 00:26:25.648 [2024-04-16 23:04:16.580403] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:26:25.648 [2024-04-16 23:04:16.580521] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:26:25.648 [2024-04-16 23:04:16.580547] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:26:25.648 [2024-04-16 23:04:16.580561] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:26:25.648 [2024-04-16 23:04:16.580573] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x10f39f0 00:26:25.648 [2024-04-16 23:04:16.580600] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:26:25.648 qpair failed and we were unable to recover it. 00:26:25.648 [2024-04-16 23:04:16.590500] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:26:25.648 [2024-04-16 23:04:16.590614] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:26:25.648 [2024-04-16 23:04:16.590640] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:26:25.649 [2024-04-16 23:04:16.590654] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:26:25.649 [2024-04-16 23:04:16.590666] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x10f39f0 00:26:25.649 [2024-04-16 23:04:16.590692] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:26:25.649 qpair failed and we were unable to recover it. 00:26:25.649 [2024-04-16 23:04:16.600437] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:26:25.649 [2024-04-16 23:04:16.600556] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:26:25.649 [2024-04-16 23:04:16.600582] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:26:25.649 [2024-04-16 23:04:16.600596] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:26:25.649 [2024-04-16 23:04:16.600608] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x10f39f0 00:26:25.649 [2024-04-16 23:04:16.600634] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:26:25.649 qpair failed and we were unable to recover it. 00:26:25.649 [2024-04-16 23:04:16.610552] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:26:25.649 [2024-04-16 23:04:16.610689] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:26:25.649 [2024-04-16 23:04:16.610715] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:26:25.649 [2024-04-16 23:04:16.610729] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:26:25.649 [2024-04-16 23:04:16.610741] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x10f39f0 00:26:25.649 [2024-04-16 23:04:16.610768] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:26:25.649 qpair failed and we were unable to recover it. 00:26:25.649 [2024-04-16 23:04:16.620580] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:26:25.649 [2024-04-16 23:04:16.620704] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:26:25.649 [2024-04-16 23:04:16.620730] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:26:25.649 [2024-04-16 23:04:16.620745] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:26:25.649 [2024-04-16 23:04:16.620756] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x10f39f0 00:26:25.649 [2024-04-16 23:04:16.620783] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:26:25.649 qpair failed and we were unable to recover it. 00:26:25.649 [2024-04-16 23:04:16.630519] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:26:25.649 [2024-04-16 23:04:16.630646] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:26:25.649 [2024-04-16 23:04:16.630672] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:26:25.649 [2024-04-16 23:04:16.630687] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:26:25.649 [2024-04-16 23:04:16.630699] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x10f39f0 00:26:25.649 [2024-04-16 23:04:16.630726] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:26:25.649 qpair failed and we were unable to recover it. 00:26:25.649 [2024-04-16 23:04:16.640625] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:26:25.649 [2024-04-16 23:04:16.640745] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:26:25.649 [2024-04-16 23:04:16.640770] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:26:25.649 [2024-04-16 23:04:16.640784] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:26:25.649 [2024-04-16 23:04:16.640796] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x10f39f0 00:26:25.649 [2024-04-16 23:04:16.640823] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:26:25.649 qpair failed and we were unable to recover it. 00:26:25.649 [2024-04-16 23:04:16.650644] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:26:25.649 [2024-04-16 23:04:16.650765] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:26:25.649 [2024-04-16 23:04:16.650790] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:26:25.649 [2024-04-16 23:04:16.650805] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:26:25.649 [2024-04-16 23:04:16.650817] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x10f39f0 00:26:25.649 [2024-04-16 23:04:16.650843] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:26:25.649 qpair failed and we were unable to recover it. 00:26:25.649 [2024-04-16 23:04:16.660699] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:26:25.649 [2024-04-16 23:04:16.660820] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:26:25.649 [2024-04-16 23:04:16.660846] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:26:25.649 [2024-04-16 23:04:16.660859] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:26:25.649 [2024-04-16 23:04:16.660877] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x10f39f0 00:26:25.649 [2024-04-16 23:04:16.660905] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:26:25.649 qpair failed and we were unable to recover it. 00:26:25.649 [2024-04-16 23:04:16.670660] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:26:25.649 [2024-04-16 23:04:16.670780] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:26:25.649 [2024-04-16 23:04:16.670806] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:26:25.649 [2024-04-16 23:04:16.670820] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:26:25.649 [2024-04-16 23:04:16.670832] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x10f39f0 00:26:25.649 [2024-04-16 23:04:16.670858] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:26:25.649 qpair failed and we were unable to recover it. 00:26:25.649 [2024-04-16 23:04:16.680738] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:26:25.649 [2024-04-16 23:04:16.680885] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:26:25.649 [2024-04-16 23:04:16.680911] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:26:25.649 [2024-04-16 23:04:16.680925] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:26:25.649 [2024-04-16 23:04:16.680936] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x10f39f0 00:26:25.649 [2024-04-16 23:04:16.680963] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:26:25.649 qpair failed and we were unable to recover it. 00:26:25.649 [2024-04-16 23:04:16.690668] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:26:25.649 [2024-04-16 23:04:16.690783] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:26:25.649 [2024-04-16 23:04:16.690808] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:26:25.649 [2024-04-16 23:04:16.690823] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:26:25.649 [2024-04-16 23:04:16.690834] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x10f39f0 00:26:25.649 [2024-04-16 23:04:16.690861] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:26:25.649 qpair failed and we were unable to recover it. 00:26:25.649 [2024-04-16 23:04:16.700849] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:26:25.649 [2024-04-16 23:04:16.700987] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:26:25.649 [2024-04-16 23:04:16.701013] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:26:25.649 [2024-04-16 23:04:16.701027] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:26:25.649 [2024-04-16 23:04:16.701039] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x10f39f0 00:26:25.649 [2024-04-16 23:04:16.701067] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:26:25.649 qpair failed and we were unable to recover it. 00:26:25.649 [2024-04-16 23:04:16.710823] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:26:25.649 [2024-04-16 23:04:16.710978] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:26:25.649 [2024-04-16 23:04:16.711004] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:26:25.649 [2024-04-16 23:04:16.711018] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:26:25.649 [2024-04-16 23:04:16.711030] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x10f39f0 00:26:25.649 [2024-04-16 23:04:16.711056] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:26:25.649 qpair failed and we were unable to recover it. 00:26:25.649 [2024-04-16 23:04:16.720755] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:26:25.649 [2024-04-16 23:04:16.720872] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:26:25.649 [2024-04-16 23:04:16.720897] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:26:25.649 [2024-04-16 23:04:16.720912] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:26:25.649 [2024-04-16 23:04:16.720923] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x10f39f0 00:26:25.649 [2024-04-16 23:04:16.720949] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:26:25.649 qpair failed and we were unable to recover it. 00:26:25.650 [2024-04-16 23:04:16.730891] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:26:25.650 [2024-04-16 23:04:16.731069] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:26:25.650 [2024-04-16 23:04:16.731095] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:26:25.650 [2024-04-16 23:04:16.731110] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:26:25.650 [2024-04-16 23:04:16.731122] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x10f39f0 00:26:25.650 [2024-04-16 23:04:16.731148] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:26:25.650 qpair failed and we were unable to recover it. 00:26:25.650 [2024-04-16 23:04:16.740822] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:26:25.650 [2024-04-16 23:04:16.740939] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:26:25.650 [2024-04-16 23:04:16.740965] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:26:25.650 [2024-04-16 23:04:16.740979] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:26:25.650 [2024-04-16 23:04:16.740990] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x10f39f0 00:26:25.650 [2024-04-16 23:04:16.741017] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:26:25.650 qpair failed and we were unable to recover it. 00:26:25.650 [2024-04-16 23:04:16.750858] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:26:25.650 [2024-04-16 23:04:16.750976] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:26:25.650 [2024-04-16 23:04:16.751002] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:26:25.650 [2024-04-16 23:04:16.751016] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:26:25.650 [2024-04-16 23:04:16.751041] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x10f39f0 00:26:25.650 [2024-04-16 23:04:16.751068] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:26:25.650 qpair failed and we were unable to recover it. 00:26:25.650 [2024-04-16 23:04:16.760911] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:26:25.650 [2024-04-16 23:04:16.761028] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:26:25.650 [2024-04-16 23:04:16.761054] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:26:25.650 [2024-04-16 23:04:16.761068] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:26:25.650 [2024-04-16 23:04:16.761079] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x10f39f0 00:26:25.650 [2024-04-16 23:04:16.761106] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:26:25.650 qpair failed and we were unable to recover it. 00:26:25.650 [2024-04-16 23:04:16.770922] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:26:25.650 [2024-04-16 23:04:16.771049] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:26:25.650 [2024-04-16 23:04:16.771075] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:26:25.650 [2024-04-16 23:04:16.771094] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:26:25.650 [2024-04-16 23:04:16.771119] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x10f39f0 00:26:25.650 [2024-04-16 23:04:16.771151] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:26:25.650 qpair failed and we were unable to recover it. 00:26:25.910 [2024-04-16 23:04:16.781046] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:26:25.910 [2024-04-16 23:04:16.781166] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:26:25.910 [2024-04-16 23:04:16.781383] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:26:25.910 [2024-04-16 23:04:16.781400] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:26:25.910 [2024-04-16 23:04:16.781412] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x10f39f0 00:26:25.910 [2024-04-16 23:04:16.781441] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:26:25.910 qpair failed and we were unable to recover it. 00:26:25.910 [2024-04-16 23:04:16.791048] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:26:25.910 [2024-04-16 23:04:16.791199] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:26:25.910 [2024-04-16 23:04:16.791230] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:26:25.910 [2024-04-16 23:04:16.791245] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:26:25.910 [2024-04-16 23:04:16.791257] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x10f39f0 00:26:25.910 [2024-04-16 23:04:16.791284] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:26:25.910 qpair failed and we were unable to recover it. 00:26:25.910 [2024-04-16 23:04:16.801082] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:26:25.910 [2024-04-16 23:04:16.801208] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:26:25.910 [2024-04-16 23:04:16.801234] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:26:25.910 [2024-04-16 23:04:16.801248] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:26:25.910 [2024-04-16 23:04:16.801260] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x10f39f0 00:26:25.910 [2024-04-16 23:04:16.801288] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:26:25.910 qpair failed and we were unable to recover it. 00:26:25.910 [2024-04-16 23:04:16.811040] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:26:25.910 [2024-04-16 23:04:16.811163] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:26:25.910 [2024-04-16 23:04:16.811199] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:26:25.910 [2024-04-16 23:04:16.811216] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:26:25.910 [2024-04-16 23:04:16.811229] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x10f39f0 00:26:25.910 [2024-04-16 23:04:16.811257] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:26:25.910 qpair failed and we were unable to recover it. 00:26:25.910 [2024-04-16 23:04:16.821058] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:26:25.910 [2024-04-16 23:04:16.821181] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:26:25.910 [2024-04-16 23:04:16.821207] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:26:25.910 [2024-04-16 23:04:16.821221] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:26:25.910 [2024-04-16 23:04:16.821233] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x10f39f0 00:26:25.910 [2024-04-16 23:04:16.821260] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:26:25.910 qpair failed and we were unable to recover it. 00:26:25.910 [2024-04-16 23:04:16.831078] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:26:25.910 [2024-04-16 23:04:16.831233] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:26:25.910 [2024-04-16 23:04:16.831259] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:26:25.910 [2024-04-16 23:04:16.831273] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:26:25.910 [2024-04-16 23:04:16.831285] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x10f39f0 00:26:25.910 [2024-04-16 23:04:16.831312] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:26:25.910 qpair failed and we were unable to recover it. 00:26:25.910 [2024-04-16 23:04:16.841106] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:26:25.910 [2024-04-16 23:04:16.841222] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:26:25.910 [2024-04-16 23:04:16.841247] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:26:25.910 [2024-04-16 23:04:16.841266] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:26:25.910 [2024-04-16 23:04:16.841279] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x10f39f0 00:26:25.910 [2024-04-16 23:04:16.841306] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:26:25.910 qpair failed and we were unable to recover it. 00:26:25.910 [2024-04-16 23:04:16.851195] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:26:25.910 [2024-04-16 23:04:16.851311] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:26:25.910 [2024-04-16 23:04:16.851336] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:26:25.910 [2024-04-16 23:04:16.851351] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:26:25.910 [2024-04-16 23:04:16.851363] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x10f39f0 00:26:25.910 [2024-04-16 23:04:16.851390] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:26:25.910 qpair failed and we were unable to recover it. 00:26:25.910 [2024-04-16 23:04:16.861183] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:26:25.910 [2024-04-16 23:04:16.861301] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:26:25.910 [2024-04-16 23:04:16.861326] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:26:25.910 [2024-04-16 23:04:16.861340] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:26:25.910 [2024-04-16 23:04:16.861352] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x10f39f0 00:26:25.911 [2024-04-16 23:04:16.861379] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:26:25.911 qpair failed and we were unable to recover it. 00:26:25.911 [2024-04-16 23:04:16.871285] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:26:25.911 [2024-04-16 23:04:16.871404] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:26:25.911 [2024-04-16 23:04:16.871429] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:26:25.911 [2024-04-16 23:04:16.871443] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:26:25.911 [2024-04-16 23:04:16.871454] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x10f39f0 00:26:25.911 [2024-04-16 23:04:16.871482] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:26:25.911 qpair failed and we were unable to recover it. 00:26:25.911 [2024-04-16 23:04:16.881326] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:26:25.911 [2024-04-16 23:04:16.881458] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:26:25.911 [2024-04-16 23:04:16.881484] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:26:25.911 [2024-04-16 23:04:16.881498] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:26:25.911 [2024-04-16 23:04:16.881510] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x10f39f0 00:26:25.911 [2024-04-16 23:04:16.881536] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:26:25.911 qpair failed and we were unable to recover it. 00:26:25.911 [2024-04-16 23:04:16.891244] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:26:25.911 [2024-04-16 23:04:16.891359] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:26:25.911 [2024-04-16 23:04:16.891385] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:26:25.911 [2024-04-16 23:04:16.891399] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:26:25.911 [2024-04-16 23:04:16.891411] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x10f39f0 00:26:25.911 [2024-04-16 23:04:16.891437] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:26:25.911 qpair failed and we were unable to recover it. 00:26:25.911 [2024-04-16 23:04:16.901331] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:26:25.911 [2024-04-16 23:04:16.901456] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:26:25.911 [2024-04-16 23:04:16.901482] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:26:25.911 [2024-04-16 23:04:16.901495] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:26:25.911 [2024-04-16 23:04:16.901507] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x10f39f0 00:26:25.911 [2024-04-16 23:04:16.901534] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:26:25.911 qpair failed and we were unable to recover it. 00:26:25.911 [2024-04-16 23:04:16.911327] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:26:25.911 [2024-04-16 23:04:16.911464] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:26:25.911 [2024-04-16 23:04:16.911492] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:26:25.911 [2024-04-16 23:04:16.911506] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:26:25.911 [2024-04-16 23:04:16.911522] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x10f39f0 00:26:25.911 [2024-04-16 23:04:16.911551] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:26:25.911 qpair failed and we were unable to recover it. 00:26:25.911 [2024-04-16 23:04:16.921352] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:26:25.911 [2024-04-16 23:04:16.921465] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:26:25.911 [2024-04-16 23:04:16.921491] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:26:25.911 [2024-04-16 23:04:16.921505] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:26:25.911 [2024-04-16 23:04:16.921516] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x10f39f0 00:26:25.911 [2024-04-16 23:04:16.921544] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:26:25.911 qpair failed and we were unable to recover it. 00:26:25.911 [2024-04-16 23:04:16.931453] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:26:25.911 [2024-04-16 23:04:16.931572] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:26:25.911 [2024-04-16 23:04:16.931598] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:26:25.911 [2024-04-16 23:04:16.931618] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:26:25.911 [2024-04-16 23:04:16.931631] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x10f39f0 00:26:25.911 [2024-04-16 23:04:16.931658] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:26:25.911 qpair failed and we were unable to recover it. 00:26:25.911 [2024-04-16 23:04:16.941403] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:26:25.911 [2024-04-16 23:04:16.941566] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:26:25.911 [2024-04-16 23:04:16.941591] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:26:25.911 [2024-04-16 23:04:16.941605] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:26:25.911 [2024-04-16 23:04:16.941617] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x10f39f0 00:26:25.911 [2024-04-16 23:04:16.941644] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:26:25.911 qpair failed and we were unable to recover it. 00:26:25.911 [2024-04-16 23:04:16.951432] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:26:25.911 [2024-04-16 23:04:16.951552] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:26:25.911 [2024-04-16 23:04:16.951578] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:26:25.911 [2024-04-16 23:04:16.951592] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:26:25.911 [2024-04-16 23:04:16.951604] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x10f39f0 00:26:25.911 [2024-04-16 23:04:16.951631] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:26:25.911 qpair failed and we were unable to recover it. 00:26:25.911 [2024-04-16 23:04:16.961535] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:26:25.911 [2024-04-16 23:04:16.961646] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:26:25.911 [2024-04-16 23:04:16.961672] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:26:25.911 [2024-04-16 23:04:16.961685] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:26:25.911 [2024-04-16 23:04:16.961697] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x10f39f0 00:26:25.911 [2024-04-16 23:04:16.961724] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:26:25.911 qpair failed and we were unable to recover it. 00:26:25.911 [2024-04-16 23:04:16.971582] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:26:25.911 [2024-04-16 23:04:16.971717] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:26:25.911 [2024-04-16 23:04:16.971744] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:26:25.911 [2024-04-16 23:04:16.971757] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:26:25.911 [2024-04-16 23:04:16.971769] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x10f39f0 00:26:25.911 [2024-04-16 23:04:16.971796] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:26:25.911 qpair failed and we were unable to recover it. 00:26:25.911 [2024-04-16 23:04:16.981628] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:26:25.911 [2024-04-16 23:04:16.981754] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:26:25.911 [2024-04-16 23:04:16.981782] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:26:25.911 [2024-04-16 23:04:16.981797] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:26:25.911 [2024-04-16 23:04:16.981809] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x10f39f0 00:26:25.911 [2024-04-16 23:04:16.981837] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:26:25.911 qpair failed and we were unable to recover it. 00:26:25.911 [2024-04-16 23:04:16.991550] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:26:25.911 [2024-04-16 23:04:16.991672] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:26:25.911 [2024-04-16 23:04:16.991698] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:26:25.912 [2024-04-16 23:04:16.991713] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:26:25.912 [2024-04-16 23:04:16.991725] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x10f39f0 00:26:25.912 [2024-04-16 23:04:16.991752] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:26:25.912 qpair failed and we were unable to recover it. 00:26:25.912 [2024-04-16 23:04:17.001582] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:26:25.912 [2024-04-16 23:04:17.001695] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:26:25.912 [2024-04-16 23:04:17.001721] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:26:25.912 [2024-04-16 23:04:17.001735] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:26:25.912 [2024-04-16 23:04:17.001746] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x10f39f0 00:26:25.912 [2024-04-16 23:04:17.001773] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:26:25.912 qpair failed and we were unable to recover it. 00:26:25.912 [2024-04-16 23:04:17.011599] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:26:25.912 [2024-04-16 23:04:17.011711] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:26:25.912 [2024-04-16 23:04:17.011737] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:26:25.912 [2024-04-16 23:04:17.011751] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:26:25.912 [2024-04-16 23:04:17.011763] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x10f39f0 00:26:25.912 [2024-04-16 23:04:17.011790] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:26:25.912 qpair failed and we were unable to recover it. 00:26:25.912 [2024-04-16 23:04:17.021669] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:26:25.912 [2024-04-16 23:04:17.021808] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:26:25.912 [2024-04-16 23:04:17.021834] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:26:25.912 [2024-04-16 23:04:17.021853] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:26:25.912 [2024-04-16 23:04:17.021866] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x10f39f0 00:26:25.912 [2024-04-16 23:04:17.021893] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:26:25.912 qpair failed and we were unable to recover it. 00:26:25.912 [2024-04-16 23:04:17.031698] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:26:25.912 [2024-04-16 23:04:17.031825] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:26:25.912 [2024-04-16 23:04:17.031851] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:26:25.912 [2024-04-16 23:04:17.031865] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:26:25.912 [2024-04-16 23:04:17.031877] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x10f39f0 00:26:25.912 [2024-04-16 23:04:17.031904] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:26:25.912 qpair failed and we were unable to recover it. 00:26:26.171 [2024-04-16 23:04:17.041675] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:26:26.171 [2024-04-16 23:04:17.041793] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:26:26.171 [2024-04-16 23:04:17.041818] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:26:26.171 [2024-04-16 23:04:17.041832] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:26:26.171 [2024-04-16 23:04:17.041845] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x10f39f0 00:26:26.171 [2024-04-16 23:04:17.041872] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:26:26.171 qpair failed and we were unable to recover it. 00:26:26.171 [2024-04-16 23:04:17.051738] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:26:26.171 [2024-04-16 23:04:17.051899] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:26:26.171 [2024-04-16 23:04:17.051925] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:26:26.171 [2024-04-16 23:04:17.051939] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:26:26.171 [2024-04-16 23:04:17.051951] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x10f39f0 00:26:26.171 [2024-04-16 23:04:17.051979] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:26:26.171 qpair failed and we were unable to recover it. 00:26:26.171 [2024-04-16 23:04:17.061756] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:26:26.171 [2024-04-16 23:04:17.061883] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:26:26.171 [2024-04-16 23:04:17.061908] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:26:26.171 [2024-04-16 23:04:17.061922] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:26:26.171 [2024-04-16 23:04:17.061934] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x10f39f0 00:26:26.171 [2024-04-16 23:04:17.061961] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:26:26.171 qpair failed and we were unable to recover it. 00:26:26.171 [2024-04-16 23:04:17.071792] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:26:26.171 [2024-04-16 23:04:17.071908] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:26:26.171 [2024-04-16 23:04:17.071934] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:26:26.171 [2024-04-16 23:04:17.071948] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:26:26.171 [2024-04-16 23:04:17.071959] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x10f39f0 00:26:26.171 [2024-04-16 23:04:17.071986] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:26:26.171 qpair failed and we were unable to recover it. 00:26:26.171 [2024-04-16 23:04:17.081797] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:26:26.171 [2024-04-16 23:04:17.081923] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:26:26.171 [2024-04-16 23:04:17.081948] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:26:26.171 [2024-04-16 23:04:17.081962] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:26:26.171 [2024-04-16 23:04:17.081973] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x10f39f0 00:26:26.171 [2024-04-16 23:04:17.082000] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:26:26.171 qpair failed and we were unable to recover it. 00:26:26.171 [2024-04-16 23:04:17.091841] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:26:26.171 [2024-04-16 23:04:17.091963] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:26:26.171 [2024-04-16 23:04:17.091988] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:26:26.171 [2024-04-16 23:04:17.092002] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:26:26.171 [2024-04-16 23:04:17.092014] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x10f39f0 00:26:26.171 [2024-04-16 23:04:17.092040] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:26:26.171 qpair failed and we were unable to recover it. 00:26:26.171 [2024-04-16 23:04:17.101871] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:26:26.171 [2024-04-16 23:04:17.101992] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:26:26.171 [2024-04-16 23:04:17.102017] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:26:26.172 [2024-04-16 23:04:17.102031] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:26:26.172 [2024-04-16 23:04:17.102043] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x10f39f0 00:26:26.172 [2024-04-16 23:04:17.102069] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:26:26.172 qpair failed and we were unable to recover it. 00:26:26.172 [2024-04-16 23:04:17.111890] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:26:26.172 [2024-04-16 23:04:17.112019] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:26:26.172 [2024-04-16 23:04:17.112045] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:26:26.172 [2024-04-16 23:04:17.112064] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:26:26.172 [2024-04-16 23:04:17.112077] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x10f39f0 00:26:26.172 [2024-04-16 23:04:17.112104] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:26:26.172 qpair failed and we were unable to recover it. 00:26:26.172 [2024-04-16 23:04:17.121937] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:26:26.172 [2024-04-16 23:04:17.122094] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:26:26.172 [2024-04-16 23:04:17.122119] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:26:26.172 [2024-04-16 23:04:17.122133] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:26:26.172 [2024-04-16 23:04:17.122146] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x10f39f0 00:26:26.172 [2024-04-16 23:04:17.122173] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:26:26.172 qpair failed and we were unable to recover it. 00:26:26.172 [2024-04-16 23:04:17.131938] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:26:26.172 [2024-04-16 23:04:17.132050] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:26:26.172 [2024-04-16 23:04:17.132075] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:26:26.172 [2024-04-16 23:04:17.132089] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:26:26.172 [2024-04-16 23:04:17.132101] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x10f39f0 00:26:26.172 [2024-04-16 23:04:17.132128] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:26:26.172 qpair failed and we were unable to recover it. 00:26:26.172 [2024-04-16 23:04:17.141995] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:26:26.172 [2024-04-16 23:04:17.142132] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:26:26.172 [2024-04-16 23:04:17.142159] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:26:26.172 [2024-04-16 23:04:17.142173] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:26:26.172 [2024-04-16 23:04:17.142193] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x10f39f0 00:26:26.172 [2024-04-16 23:04:17.142221] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:26:26.172 qpair failed and we were unable to recover it. 00:26:26.172 [2024-04-16 23:04:17.152036] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:26:26.172 [2024-04-16 23:04:17.152160] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:26:26.172 [2024-04-16 23:04:17.152192] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:26:26.172 [2024-04-16 23:04:17.152208] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:26:26.172 [2024-04-16 23:04:17.152220] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x10f39f0 00:26:26.172 [2024-04-16 23:04:17.152247] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:26:26.172 qpair failed and we were unable to recover it. 00:26:26.172 [2024-04-16 23:04:17.162054] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:26:26.172 [2024-04-16 23:04:17.162180] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:26:26.172 [2024-04-16 23:04:17.162206] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:26:26.172 [2024-04-16 23:04:17.162219] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:26:26.172 [2024-04-16 23:04:17.162231] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x10f39f0 00:26:26.172 [2024-04-16 23:04:17.162259] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:26:26.172 qpair failed and we were unable to recover it. 00:26:26.172 [2024-04-16 23:04:17.172075] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:26:26.172 [2024-04-16 23:04:17.172196] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:26:26.172 [2024-04-16 23:04:17.172222] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:26:26.172 [2024-04-16 23:04:17.172236] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:26:26.172 [2024-04-16 23:04:17.172247] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x10f39f0 00:26:26.172 [2024-04-16 23:04:17.172274] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:26:26.172 qpair failed and we were unable to recover it. 00:26:26.172 [2024-04-16 23:04:17.182136] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:26:26.172 [2024-04-16 23:04:17.182274] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:26:26.172 [2024-04-16 23:04:17.182299] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:26:26.172 [2024-04-16 23:04:17.182313] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:26:26.172 [2024-04-16 23:04:17.182324] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x10f39f0 00:26:26.172 [2024-04-16 23:04:17.182351] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:26:26.172 qpair failed and we were unable to recover it. 00:26:26.172 [2024-04-16 23:04:17.192125] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:26:26.172 [2024-04-16 23:04:17.192307] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:26:26.172 [2024-04-16 23:04:17.192333] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:26:26.172 [2024-04-16 23:04:17.192347] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:26:26.172 [2024-04-16 23:04:17.192360] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x10f39f0 00:26:26.172 [2024-04-16 23:04:17.192387] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:26:26.172 qpair failed and we were unable to recover it. 00:26:26.172 [2024-04-16 23:04:17.202173] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:26:26.172 [2024-04-16 23:04:17.202301] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:26:26.172 [2024-04-16 23:04:17.202330] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:26:26.172 [2024-04-16 23:04:17.202345] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:26:26.172 [2024-04-16 23:04:17.202357] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x10f39f0 00:26:26.172 [2024-04-16 23:04:17.202384] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:26:26.172 qpair failed and we were unable to recover it. 00:26:26.172 [2024-04-16 23:04:17.212235] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:26:26.172 [2024-04-16 23:04:17.212354] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:26:26.172 [2024-04-16 23:04:17.212380] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:26:26.172 [2024-04-16 23:04:17.212394] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:26:26.172 [2024-04-16 23:04:17.212406] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x10f39f0 00:26:26.172 [2024-04-16 23:04:17.212433] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:26:26.172 qpair failed and we were unable to recover it. 00:26:26.172 [2024-04-16 23:04:17.222220] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:26:26.172 [2024-04-16 23:04:17.222339] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:26:26.172 [2024-04-16 23:04:17.222363] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:26:26.172 [2024-04-16 23:04:17.222378] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:26:26.172 [2024-04-16 23:04:17.222389] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x10f39f0 00:26:26.172 [2024-04-16 23:04:17.222417] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:26:26.172 qpair failed and we were unable to recover it. 00:26:26.172 [2024-04-16 23:04:17.232393] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:26:26.173 [2024-04-16 23:04:17.232522] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:26:26.173 [2024-04-16 23:04:17.232547] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:26:26.173 [2024-04-16 23:04:17.232562] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:26:26.173 [2024-04-16 23:04:17.232574] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x10f39f0 00:26:26.173 [2024-04-16 23:04:17.232601] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:26:26.173 qpair failed and we were unable to recover it. 00:26:26.173 [2024-04-16 23:04:17.242291] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:26:26.173 [2024-04-16 23:04:17.242418] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:26:26.173 [2024-04-16 23:04:17.242444] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:26:26.173 [2024-04-16 23:04:17.242458] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:26:26.173 [2024-04-16 23:04:17.242470] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x10f39f0 00:26:26.173 [2024-04-16 23:04:17.242497] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:26:26.173 qpair failed and we were unable to recover it. 00:26:26.173 [2024-04-16 23:04:17.252350] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:26:26.173 [2024-04-16 23:04:17.252469] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:26:26.173 [2024-04-16 23:04:17.252495] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:26:26.173 [2024-04-16 23:04:17.252510] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:26:26.173 [2024-04-16 23:04:17.252521] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x10f39f0 00:26:26.173 [2024-04-16 23:04:17.252548] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:26:26.173 qpair failed and we were unable to recover it. 00:26:26.173 [2024-04-16 23:04:17.262422] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:26:26.173 [2024-04-16 23:04:17.262543] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:26:26.173 [2024-04-16 23:04:17.262569] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:26:26.173 [2024-04-16 23:04:17.262583] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:26:26.173 [2024-04-16 23:04:17.262595] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x10f39f0 00:26:26.173 [2024-04-16 23:04:17.262622] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:26:26.173 qpair failed and we were unable to recover it. 00:26:26.173 [2024-04-16 23:04:17.272353] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:26:26.173 [2024-04-16 23:04:17.272483] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:26:26.173 [2024-04-16 23:04:17.272508] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:26:26.173 [2024-04-16 23:04:17.272521] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:26:26.173 [2024-04-16 23:04:17.272533] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x10f39f0 00:26:26.173 [2024-04-16 23:04:17.272560] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:26:26.173 qpair failed and we were unable to recover it. 00:26:26.173 [2024-04-16 23:04:17.282433] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:26:26.173 [2024-04-16 23:04:17.282581] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:26:26.173 [2024-04-16 23:04:17.282607] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:26:26.173 [2024-04-16 23:04:17.282621] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:26:26.173 [2024-04-16 23:04:17.282633] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x10f39f0 00:26:26.173 [2024-04-16 23:04:17.282660] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:26:26.173 qpair failed and we were unable to recover it. 00:26:26.173 [2024-04-16 23:04:17.292416] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:26:26.173 [2024-04-16 23:04:17.292536] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:26:26.173 [2024-04-16 23:04:17.292566] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:26:26.173 [2024-04-16 23:04:17.292581] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:26:26.173 [2024-04-16 23:04:17.292593] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x10f39f0 00:26:26.173 [2024-04-16 23:04:17.292620] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:26:26.173 qpair failed and we were unable to recover it. 00:26:26.431 [2024-04-16 23:04:17.302467] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:26:26.432 [2024-04-16 23:04:17.302587] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:26:26.432 [2024-04-16 23:04:17.302614] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:26:26.432 [2024-04-16 23:04:17.302629] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:26:26.432 [2024-04-16 23:04:17.302641] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x10f39f0 00:26:26.432 [2024-04-16 23:04:17.302668] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:26:26.432 qpair failed and we were unable to recover it. 00:26:26.432 [2024-04-16 23:04:17.312445] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:26:26.432 [2024-04-16 23:04:17.312562] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:26:26.432 [2024-04-16 23:04:17.312588] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:26:26.432 [2024-04-16 23:04:17.312601] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:26:26.432 [2024-04-16 23:04:17.312613] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x10f39f0 00:26:26.432 [2024-04-16 23:04:17.312641] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:26:26.432 qpair failed and we were unable to recover it. 00:26:26.432 [2024-04-16 23:04:17.322499] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:26:26.432 [2024-04-16 23:04:17.322617] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:26:26.432 [2024-04-16 23:04:17.322643] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:26:26.432 [2024-04-16 23:04:17.322657] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:26:26.432 [2024-04-16 23:04:17.322669] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x10f39f0 00:26:26.432 [2024-04-16 23:04:17.322695] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:26:26.432 qpair failed and we were unable to recover it. 00:26:26.432 [2024-04-16 23:04:17.332522] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:26:26.432 [2024-04-16 23:04:17.332637] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:26:26.432 [2024-04-16 23:04:17.332662] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:26:26.432 [2024-04-16 23:04:17.332676] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:26:26.432 [2024-04-16 23:04:17.332687] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x10f39f0 00:26:26.432 [2024-04-16 23:04:17.332720] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:26:26.432 qpair failed and we were unable to recover it. 00:26:26.432 [2024-04-16 23:04:17.342610] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:26:26.432 [2024-04-16 23:04:17.342755] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:26:26.432 [2024-04-16 23:04:17.342780] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:26:26.432 [2024-04-16 23:04:17.342794] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:26:26.432 [2024-04-16 23:04:17.342806] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x10f39f0 00:26:26.432 [2024-04-16 23:04:17.342833] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:26:26.432 qpair failed and we were unable to recover it. 00:26:26.432 [2024-04-16 23:04:17.352573] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:26:26.432 [2024-04-16 23:04:17.352700] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:26:26.432 [2024-04-16 23:04:17.352727] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:26:26.432 [2024-04-16 23:04:17.352741] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:26:26.432 [2024-04-16 23:04:17.352753] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x10f39f0 00:26:26.432 [2024-04-16 23:04:17.352780] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:26:26.432 qpair failed and we were unable to recover it. 00:26:26.432 [2024-04-16 23:04:17.362696] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:26:26.432 [2024-04-16 23:04:17.362833] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:26:26.432 [2024-04-16 23:04:17.362859] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:26:26.432 [2024-04-16 23:04:17.362873] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:26:26.432 [2024-04-16 23:04:17.362885] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x10f39f0 00:26:26.432 [2024-04-16 23:04:17.362912] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:26:26.432 qpair failed and we were unable to recover it. 00:26:26.432 [2024-04-16 23:04:17.372681] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:26:26.432 [2024-04-16 23:04:17.372797] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:26:26.432 [2024-04-16 23:04:17.372824] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:26:26.432 [2024-04-16 23:04:17.372839] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:26:26.432 [2024-04-16 23:04:17.372853] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x10f39f0 00:26:26.432 [2024-04-16 23:04:17.372881] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:26:26.432 qpair failed and we were unable to recover it. 00:26:26.432 [2024-04-16 23:04:17.382769] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:26:26.432 [2024-04-16 23:04:17.382912] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:26:26.432 [2024-04-16 23:04:17.382943] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:26:26.432 [2024-04-16 23:04:17.382958] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:26:26.432 [2024-04-16 23:04:17.382970] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x10f39f0 00:26:26.432 [2024-04-16 23:04:17.382997] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:26:26.432 qpair failed and we were unable to recover it. 00:26:26.432 [2024-04-16 23:04:17.392683] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:26:26.432 [2024-04-16 23:04:17.392799] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:26:26.432 [2024-04-16 23:04:17.392824] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:26:26.432 [2024-04-16 23:04:17.392838] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:26:26.432 [2024-04-16 23:04:17.392850] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x10f39f0 00:26:26.432 [2024-04-16 23:04:17.392877] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:26:26.432 qpair failed and we were unable to recover it. 00:26:26.432 [2024-04-16 23:04:17.402804] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:26:26.432 [2024-04-16 23:04:17.402918] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:26:26.432 [2024-04-16 23:04:17.402944] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:26:26.432 [2024-04-16 23:04:17.402958] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:26:26.432 [2024-04-16 23:04:17.402970] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x10f39f0 00:26:26.432 [2024-04-16 23:04:17.402997] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:26:26.432 qpair failed and we were unable to recover it. 00:26:26.432 [2024-04-16 23:04:17.412741] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:26:26.432 [2024-04-16 23:04:17.412855] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:26:26.432 [2024-04-16 23:04:17.412880] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:26:26.432 [2024-04-16 23:04:17.412893] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:26:26.432 [2024-04-16 23:04:17.412905] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x10f39f0 00:26:26.432 [2024-04-16 23:04:17.412933] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:26:26.432 qpair failed and we were unable to recover it. 00:26:26.432 [2024-04-16 23:04:17.422773] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:26:26.432 [2024-04-16 23:04:17.422912] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:26:26.432 [2024-04-16 23:04:17.422937] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:26:26.432 [2024-04-16 23:04:17.422951] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:26:26.432 [2024-04-16 23:04:17.422963] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x10f39f0 00:26:26.432 [2024-04-16 23:04:17.422995] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:26:26.432 qpair failed and we were unable to recover it. 00:26:26.432 [2024-04-16 23:04:17.432800] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:26:26.432 [2024-04-16 23:04:17.432930] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:26:26.432 [2024-04-16 23:04:17.432955] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:26:26.433 [2024-04-16 23:04:17.432969] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:26:26.433 [2024-04-16 23:04:17.432981] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x10f39f0 00:26:26.433 [2024-04-16 23:04:17.433008] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:26:26.433 qpair failed and we were unable to recover it. 00:26:26.433 [2024-04-16 23:04:17.442827] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:26:26.433 [2024-04-16 23:04:17.442954] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:26:26.433 [2024-04-16 23:04:17.442979] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:26:26.433 [2024-04-16 23:04:17.442993] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:26:26.433 [2024-04-16 23:04:17.443005] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x10f39f0 00:26:26.433 [2024-04-16 23:04:17.443032] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:26:26.433 qpair failed and we were unable to recover it. 00:26:26.433 [2024-04-16 23:04:17.452919] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:26:26.433 [2024-04-16 23:04:17.453032] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:26:26.433 [2024-04-16 23:04:17.453057] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:26:26.433 [2024-04-16 23:04:17.453070] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:26:26.433 [2024-04-16 23:04:17.453082] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x10f39f0 00:26:26.433 [2024-04-16 23:04:17.453109] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:26:26.433 qpair failed and we were unable to recover it. 00:26:26.433 [2024-04-16 23:04:17.462983] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:26:26.433 [2024-04-16 23:04:17.463104] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:26:26.433 [2024-04-16 23:04:17.463130] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:26:26.433 [2024-04-16 23:04:17.463144] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:26:26.433 [2024-04-16 23:04:17.463156] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x10f39f0 00:26:26.433 [2024-04-16 23:04:17.463190] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:26:26.433 qpair failed and we were unable to recover it. 00:26:26.433 [2024-04-16 23:04:17.472924] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:26:26.433 [2024-04-16 23:04:17.473053] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:26:26.433 [2024-04-16 23:04:17.473083] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:26:26.433 [2024-04-16 23:04:17.473098] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:26:26.433 [2024-04-16 23:04:17.473110] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x10f39f0 00:26:26.433 [2024-04-16 23:04:17.473138] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:26:26.433 qpair failed and we were unable to recover it. 00:26:26.433 [2024-04-16 23:04:17.483044] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:26:26.433 [2024-04-16 23:04:17.483189] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:26:26.433 [2024-04-16 23:04:17.483215] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:26:26.433 [2024-04-16 23:04:17.483229] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:26:26.433 [2024-04-16 23:04:17.483240] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x10f39f0 00:26:26.433 [2024-04-16 23:04:17.483268] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:26:26.433 qpair failed and we were unable to recover it. 00:26:26.433 [2024-04-16 23:04:17.493067] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:26:26.433 [2024-04-16 23:04:17.493191] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:26:26.433 [2024-04-16 23:04:17.493216] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:26:26.433 [2024-04-16 23:04:17.493230] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:26:26.433 [2024-04-16 23:04:17.493242] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x10f39f0 00:26:26.433 [2024-04-16 23:04:17.493270] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:26:26.433 qpair failed and we were unable to recover it. 00:26:26.433 [2024-04-16 23:04:17.503000] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:26:26.433 [2024-04-16 23:04:17.503130] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:26:26.433 [2024-04-16 23:04:17.503155] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:26:26.433 [2024-04-16 23:04:17.503169] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:26:26.433 [2024-04-16 23:04:17.503191] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x10f39f0 00:26:26.433 [2024-04-16 23:04:17.503220] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:26:26.433 qpair failed and we were unable to recover it. 00:26:26.433 [2024-04-16 23:04:17.513008] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:26:26.433 [2024-04-16 23:04:17.513126] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:26:26.433 [2024-04-16 23:04:17.513151] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:26:26.433 [2024-04-16 23:04:17.513165] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:26:26.433 [2024-04-16 23:04:17.513184] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x10f39f0 00:26:26.433 [2024-04-16 23:04:17.513220] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:26:26.433 qpair failed and we were unable to recover it. 00:26:26.433 [2024-04-16 23:04:17.523075] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:26:26.433 [2024-04-16 23:04:17.523246] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:26:26.433 [2024-04-16 23:04:17.523272] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:26:26.433 [2024-04-16 23:04:17.523287] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:26:26.433 [2024-04-16 23:04:17.523298] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x10f39f0 00:26:26.433 [2024-04-16 23:04:17.523325] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:26:26.433 qpair failed and we were unable to recover it. 00:26:26.433 [2024-04-16 23:04:17.533095] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:26:26.433 [2024-04-16 23:04:17.533223] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:26:26.433 [2024-04-16 23:04:17.533249] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:26:26.433 [2024-04-16 23:04:17.533263] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:26:26.433 [2024-04-16 23:04:17.533275] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x10f39f0 00:26:26.433 [2024-04-16 23:04:17.533302] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:26:26.433 qpair failed and we were unable to recover it. 00:26:26.433 [2024-04-16 23:04:17.543124] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:26:26.433 [2024-04-16 23:04:17.543268] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:26:26.433 [2024-04-16 23:04:17.543294] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:26:26.433 [2024-04-16 23:04:17.543309] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:26:26.433 [2024-04-16 23:04:17.543320] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x10f39f0 00:26:26.433 [2024-04-16 23:04:17.543348] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:26:26.433 qpair failed and we were unable to recover it. 00:26:26.433 [2024-04-16 23:04:17.553131] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:26:26.433 [2024-04-16 23:04:17.553258] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:26:26.433 [2024-04-16 23:04:17.553284] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:26:26.433 [2024-04-16 23:04:17.553298] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:26:26.433 [2024-04-16 23:04:17.553309] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x10f39f0 00:26:26.433 [2024-04-16 23:04:17.553337] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:26:26.433 qpair failed and we were unable to recover it. 00:26:26.692 [2024-04-16 23:04:17.563197] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:26:26.692 [2024-04-16 23:04:17.563354] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:26:26.692 [2024-04-16 23:04:17.563399] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:26:26.693 [2024-04-16 23:04:17.563418] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:26:26.693 [2024-04-16 23:04:17.563430] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x10f39f0 00:26:26.693 [2024-04-16 23:04:17.563458] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:26:26.693 qpair failed and we were unable to recover it. 00:26:26.693 [2024-04-16 23:04:17.573196] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:26:26.693 [2024-04-16 23:04:17.573310] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:26:26.693 [2024-04-16 23:04:17.573336] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:26:26.693 [2024-04-16 23:04:17.573350] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:26:26.693 [2024-04-16 23:04:17.573362] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x10f39f0 00:26:26.693 [2024-04-16 23:04:17.573389] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:26:26.693 qpair failed and we were unable to recover it. 00:26:26.693 [2024-04-16 23:04:17.583268] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:26:26.693 [2024-04-16 23:04:17.583434] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:26:26.693 [2024-04-16 23:04:17.583460] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:26:26.693 [2024-04-16 23:04:17.583474] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:26:26.693 [2024-04-16 23:04:17.583486] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x10f39f0 00:26:26.693 [2024-04-16 23:04:17.583513] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:26:26.693 qpair failed and we were unable to recover it. 00:26:26.693 [2024-04-16 23:04:17.593319] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:26:26.693 [2024-04-16 23:04:17.593437] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:26:26.693 [2024-04-16 23:04:17.593463] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:26:26.693 [2024-04-16 23:04:17.593477] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:26:26.693 [2024-04-16 23:04:17.593489] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x10f39f0 00:26:26.693 [2024-04-16 23:04:17.593516] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:26:26.693 qpair failed and we were unable to recover it. 00:26:26.693 [2024-04-16 23:04:17.603283] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:26:26.693 [2024-04-16 23:04:17.603402] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:26:26.693 [2024-04-16 23:04:17.603428] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:26:26.693 [2024-04-16 23:04:17.603444] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:26:26.693 [2024-04-16 23:04:17.603456] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x10f39f0 00:26:26.693 [2024-04-16 23:04:17.603488] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:26:26.693 qpair failed and we were unable to recover it. 00:26:26.693 [2024-04-16 23:04:17.613319] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:26:26.693 [2024-04-16 23:04:17.613443] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:26:26.693 [2024-04-16 23:04:17.613468] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:26:26.693 [2024-04-16 23:04:17.613483] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:26:26.693 [2024-04-16 23:04:17.613494] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x10f39f0 00:26:26.693 [2024-04-16 23:04:17.613522] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:26:26.693 qpair failed and we were unable to recover it. 00:26:26.693 [2024-04-16 23:04:17.623339] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:26:26.693 [2024-04-16 23:04:17.623465] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:26:26.693 [2024-04-16 23:04:17.623491] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:26:26.693 [2024-04-16 23:04:17.623505] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:26:26.693 [2024-04-16 23:04:17.623517] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x10f39f0 00:26:26.693 [2024-04-16 23:04:17.623544] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:26:26.693 qpair failed and we were unable to recover it. 00:26:26.693 [2024-04-16 23:04:17.633450] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:26:26.693 [2024-04-16 23:04:17.633564] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:26:26.693 [2024-04-16 23:04:17.633589] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:26:26.693 [2024-04-16 23:04:17.633603] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:26:26.693 [2024-04-16 23:04:17.633615] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x10f39f0 00:26:26.693 [2024-04-16 23:04:17.633642] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:26:26.693 qpair failed and we were unable to recover it. 00:26:26.693 [2024-04-16 23:04:17.643409] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:26:26.693 [2024-04-16 23:04:17.643527] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:26:26.693 [2024-04-16 23:04:17.643552] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:26:26.693 [2024-04-16 23:04:17.643566] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:26:26.693 [2024-04-16 23:04:17.643578] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x10f39f0 00:26:26.693 [2024-04-16 23:04:17.643604] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:26:26.693 qpair failed and we were unable to recover it. 00:26:26.693 [2024-04-16 23:04:17.653444] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:26:26.693 [2024-04-16 23:04:17.653560] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:26:26.693 [2024-04-16 23:04:17.653590] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:26:26.693 [2024-04-16 23:04:17.653605] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:26:26.693 [2024-04-16 23:04:17.653617] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x10f39f0 00:26:26.693 [2024-04-16 23:04:17.653644] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:26:26.693 qpair failed and we were unable to recover it. 00:26:26.693 [2024-04-16 23:04:17.663462] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:26:26.693 [2024-04-16 23:04:17.663598] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:26:26.693 [2024-04-16 23:04:17.663624] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:26:26.693 [2024-04-16 23:04:17.663637] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:26:26.693 [2024-04-16 23:04:17.663649] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x10f39f0 00:26:26.693 [2024-04-16 23:04:17.663676] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:26:26.693 qpair failed and we were unable to recover it. 00:26:26.693 [2024-04-16 23:04:17.673501] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:26:26.693 [2024-04-16 23:04:17.673619] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:26:26.693 [2024-04-16 23:04:17.673644] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:26:26.693 [2024-04-16 23:04:17.673658] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:26:26.693 [2024-04-16 23:04:17.673670] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x10f39f0 00:26:26.693 [2024-04-16 23:04:17.673697] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:26:26.693 qpair failed and we were unable to recover it. 00:26:26.693 [2024-04-16 23:04:17.683543] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:26:26.693 [2024-04-16 23:04:17.683701] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:26:26.693 [2024-04-16 23:04:17.683725] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:26:26.693 [2024-04-16 23:04:17.683739] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:26:26.693 [2024-04-16 23:04:17.683750] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x10f39f0 00:26:26.693 [2024-04-16 23:04:17.683777] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:26:26.693 qpair failed and we were unable to recover it. 00:26:26.693 [2024-04-16 23:04:17.693554] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:26:26.693 [2024-04-16 23:04:17.693662] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:26:26.693 [2024-04-16 23:04:17.693688] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:26:26.693 [2024-04-16 23:04:17.693701] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:26:26.693 [2024-04-16 23:04:17.693718] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x10f39f0 00:26:26.694 [2024-04-16 23:04:17.693745] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:26:26.694 qpair failed and we were unable to recover it. 00:26:26.694 [2024-04-16 23:04:17.703634] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:26:26.694 [2024-04-16 23:04:17.703755] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:26:26.694 [2024-04-16 23:04:17.703781] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:26:26.694 [2024-04-16 23:04:17.703794] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:26:26.694 [2024-04-16 23:04:17.703806] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x10f39f0 00:26:26.694 [2024-04-16 23:04:17.703833] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:26:26.694 qpair failed and we were unable to recover it. 00:26:26.694 [2024-04-16 23:04:17.713597] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:26:26.694 [2024-04-16 23:04:17.713717] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:26:26.694 [2024-04-16 23:04:17.713742] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:26:26.694 [2024-04-16 23:04:17.713756] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:26:26.694 [2024-04-16 23:04:17.713768] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x10f39f0 00:26:26.694 [2024-04-16 23:04:17.713795] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:26:26.694 qpair failed and we were unable to recover it. 00:26:26.694 [2024-04-16 23:04:17.723654] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:26:26.694 [2024-04-16 23:04:17.723779] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:26:26.694 [2024-04-16 23:04:17.723805] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:26:26.694 [2024-04-16 23:04:17.723819] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:26:26.694 [2024-04-16 23:04:17.723831] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x10f39f0 00:26:26.694 [2024-04-16 23:04:17.723857] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:26:26.694 qpair failed and we were unable to recover it. 00:26:26.694 [2024-04-16 23:04:17.733662] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:26:26.694 [2024-04-16 23:04:17.733777] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:26:26.694 [2024-04-16 23:04:17.733802] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:26:26.694 [2024-04-16 23:04:17.733817] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:26:26.694 [2024-04-16 23:04:17.733828] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x10f39f0 00:26:26.694 [2024-04-16 23:04:17.733855] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:26:26.694 qpair failed and we were unable to recover it. 00:26:26.694 [2024-04-16 23:04:17.743720] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:26:26.694 [2024-04-16 23:04:17.743862] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:26:26.694 [2024-04-16 23:04:17.743887] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:26:26.694 [2024-04-16 23:04:17.743902] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:26:26.694 [2024-04-16 23:04:17.743913] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x10f39f0 00:26:26.694 [2024-04-16 23:04:17.743940] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:26:26.694 qpair failed and we were unable to recover it. 00:26:26.694 [2024-04-16 23:04:17.753755] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:26:26.694 [2024-04-16 23:04:17.753932] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:26:26.694 [2024-04-16 23:04:17.753957] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:26:26.694 [2024-04-16 23:04:17.753971] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:26:26.694 [2024-04-16 23:04:17.753983] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x10f39f0 00:26:26.694 [2024-04-16 23:04:17.754009] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:26:26.694 qpair failed and we were unable to recover it. 00:26:26.694 [2024-04-16 23:04:17.763819] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:26:26.694 [2024-04-16 23:04:17.763950] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:26:26.694 [2024-04-16 23:04:17.763976] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:26:26.694 [2024-04-16 23:04:17.763990] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:26:26.694 [2024-04-16 23:04:17.764002] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x10f39f0 00:26:26.694 [2024-04-16 23:04:17.764029] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:26:26.694 qpair failed and we were unable to recover it. 00:26:26.694 [2024-04-16 23:04:17.773793] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:26:26.694 [2024-04-16 23:04:17.773913] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:26:26.694 [2024-04-16 23:04:17.773939] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:26:26.694 [2024-04-16 23:04:17.773953] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:26:26.694 [2024-04-16 23:04:17.773965] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x10f39f0 00:26:26.694 [2024-04-16 23:04:17.773993] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:26:26.694 qpair failed and we were unable to recover it. 00:26:26.694 [2024-04-16 23:04:17.783837] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:26:26.694 [2024-04-16 23:04:17.783957] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:26:26.694 [2024-04-16 23:04:17.783982] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:26:26.694 [2024-04-16 23:04:17.783996] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:26:26.694 [2024-04-16 23:04:17.784013] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x10f39f0 00:26:26.694 [2024-04-16 23:04:17.784041] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:26:26.694 qpair failed and we were unable to recover it. 00:26:26.694 [2024-04-16 23:04:17.793940] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:26:26.694 [2024-04-16 23:04:17.794055] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:26:26.694 [2024-04-16 23:04:17.794081] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:26:26.694 [2024-04-16 23:04:17.794095] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:26:26.694 [2024-04-16 23:04:17.794107] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x10f39f0 00:26:26.694 [2024-04-16 23:04:17.794134] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:26:26.694 qpair failed and we were unable to recover it. 00:26:26.694 [2024-04-16 23:04:17.803923] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:26:26.694 [2024-04-16 23:04:17.804078] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:26:26.694 [2024-04-16 23:04:17.804103] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:26:26.694 [2024-04-16 23:04:17.804117] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:26:26.694 [2024-04-16 23:04:17.804129] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x10f39f0 00:26:26.694 [2024-04-16 23:04:17.804156] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:26:26.694 qpair failed and we were unable to recover it. 00:26:26.694 [2024-04-16 23:04:17.813903] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:26:26.694 [2024-04-16 23:04:17.814029] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:26:26.694 [2024-04-16 23:04:17.814056] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:26:26.694 [2024-04-16 23:04:17.814072] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:26:26.694 [2024-04-16 23:04:17.814086] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x10f39f0 00:26:26.694 [2024-04-16 23:04:17.814114] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:26:26.694 qpair failed and we were unable to recover it. 00:26:26.956 [2024-04-16 23:04:17.823935] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:26:26.956 [2024-04-16 23:04:17.824055] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:26:26.956 [2024-04-16 23:04:17.824082] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:26:26.956 [2024-04-16 23:04:17.824097] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:26:26.956 [2024-04-16 23:04:17.824109] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x10f39f0 00:26:26.956 [2024-04-16 23:04:17.824136] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:26:26.956 qpair failed and we were unable to recover it. 00:26:26.956 [2024-04-16 23:04:17.833952] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:26:26.956 [2024-04-16 23:04:17.834081] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:26:26.956 [2024-04-16 23:04:17.834107] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:26:26.956 [2024-04-16 23:04:17.834122] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:26:26.956 [2024-04-16 23:04:17.834134] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x10f39f0 00:26:26.956 [2024-04-16 23:04:17.834161] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:26:26.956 qpair failed and we were unable to recover it. 00:26:26.956 [2024-04-16 23:04:17.843974] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:26:26.956 [2024-04-16 23:04:17.844092] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:26:26.956 [2024-04-16 23:04:17.844126] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:26:26.956 [2024-04-16 23:04:17.844140] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:26:26.956 [2024-04-16 23:04:17.844151] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x10f39f0 00:26:26.956 [2024-04-16 23:04:17.844186] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:26:26.956 qpair failed and we were unable to recover it. 00:26:26.956 [2024-04-16 23:04:17.854042] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:26:26.956 [2024-04-16 23:04:17.854173] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:26:26.956 [2024-04-16 23:04:17.854207] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:26:26.956 [2024-04-16 23:04:17.854221] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:26:26.956 [2024-04-16 23:04:17.854233] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x10f39f0 00:26:26.956 [2024-04-16 23:04:17.854261] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:26:26.956 qpair failed and we were unable to recover it. 00:26:26.956 [2024-04-16 23:04:17.864075] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:26:26.956 [2024-04-16 23:04:17.864242] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:26:26.956 [2024-04-16 23:04:17.864267] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:26:26.956 [2024-04-16 23:04:17.864282] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:26:26.956 [2024-04-16 23:04:17.864294] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x10f39f0 00:26:26.956 [2024-04-16 23:04:17.864321] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:26:26.956 qpair failed and we were unable to recover it. 00:26:26.956 [2024-04-16 23:04:17.874162] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:26:26.956 [2024-04-16 23:04:17.874321] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:26:26.956 [2024-04-16 23:04:17.874346] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:26:26.956 [2024-04-16 23:04:17.874360] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:26:26.956 [2024-04-16 23:04:17.874377] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x10f39f0 00:26:26.956 [2024-04-16 23:04:17.874405] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:26:26.956 qpair failed and we were unable to recover it. 00:26:26.956 [2024-04-16 23:04:17.884188] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:26:26.956 [2024-04-16 23:04:17.884349] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:26:26.956 [2024-04-16 23:04:17.884374] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:26:26.956 [2024-04-16 23:04:17.884388] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:26:26.956 [2024-04-16 23:04:17.884400] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x10f39f0 00:26:26.956 [2024-04-16 23:04:17.884427] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:26:26.956 qpair failed and we were unable to recover it. 00:26:26.956 [2024-04-16 23:04:17.894120] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:26:26.956 [2024-04-16 23:04:17.894301] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:26:26.956 [2024-04-16 23:04:17.894326] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:26:26.956 [2024-04-16 23:04:17.894340] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:26:26.956 [2024-04-16 23:04:17.894352] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x10f39f0 00:26:26.956 [2024-04-16 23:04:17.894379] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:26:26.956 qpair failed and we were unable to recover it. 00:26:26.956 [2024-04-16 23:04:17.904185] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:26:26.956 [2024-04-16 23:04:17.904319] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:26:26.956 [2024-04-16 23:04:17.904344] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:26:26.956 [2024-04-16 23:04:17.904358] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:26:26.956 [2024-04-16 23:04:17.904371] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x10f39f0 00:26:26.956 [2024-04-16 23:04:17.904397] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:26:26.956 qpair failed and we were unable to recover it. 00:26:26.956 [2024-04-16 23:04:17.914174] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:26:26.956 [2024-04-16 23:04:17.914295] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:26:26.956 [2024-04-16 23:04:17.914320] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:26:26.956 [2024-04-16 23:04:17.914334] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:26:26.956 [2024-04-16 23:04:17.914346] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x10f39f0 00:26:26.956 [2024-04-16 23:04:17.914373] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:26:26.956 qpair failed and we were unable to recover it. 00:26:26.956 [2024-04-16 23:04:17.924210] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:26:26.956 [2024-04-16 23:04:17.924333] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:26:26.956 [2024-04-16 23:04:17.924359] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:26:26.957 [2024-04-16 23:04:17.924373] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:26:26.957 [2024-04-16 23:04:17.924385] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x10f39f0 00:26:26.957 [2024-04-16 23:04:17.924412] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:26:26.957 qpair failed and we were unable to recover it. 00:26:26.957 [2024-04-16 23:04:17.934266] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:26:26.957 [2024-04-16 23:04:17.934394] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:26:26.957 [2024-04-16 23:04:17.934420] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:26:26.957 [2024-04-16 23:04:17.934434] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:26:26.957 [2024-04-16 23:04:17.934446] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x10f39f0 00:26:26.957 [2024-04-16 23:04:17.934472] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:26:26.957 qpair failed and we were unable to recover it. 00:26:26.957 [2024-04-16 23:04:17.944365] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:26:26.957 [2024-04-16 23:04:17.944484] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:26:26.957 [2024-04-16 23:04:17.944509] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:26:26.957 [2024-04-16 23:04:17.944523] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:26:26.957 [2024-04-16 23:04:17.944535] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x10f39f0 00:26:26.957 [2024-04-16 23:04:17.944562] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:26:26.957 qpair failed and we were unable to recover it. 00:26:26.957 [2024-04-16 23:04:17.954405] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:26:26.957 [2024-04-16 23:04:17.954552] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:26:26.957 [2024-04-16 23:04:17.954577] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:26:26.957 [2024-04-16 23:04:17.954591] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:26:26.957 [2024-04-16 23:04:17.954603] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x10f39f0 00:26:26.957 [2024-04-16 23:04:17.954630] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:26:26.957 qpair failed and we were unable to recover it. 00:26:26.957 [2024-04-16 23:04:17.964423] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:26:26.957 [2024-04-16 23:04:17.964539] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:26:26.957 [2024-04-16 23:04:17.964564] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:26:26.957 [2024-04-16 23:04:17.964578] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:26:26.957 [2024-04-16 23:04:17.964595] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x10f39f0 00:26:26.957 [2024-04-16 23:04:17.964623] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:26:26.957 qpair failed and we were unable to recover it. 00:26:26.957 [2024-04-16 23:04:17.974384] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:26:26.957 [2024-04-16 23:04:17.974503] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:26:26.957 [2024-04-16 23:04:17.974530] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:26:26.957 [2024-04-16 23:04:17.974544] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:26:26.957 [2024-04-16 23:04:17.974556] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x10f39f0 00:26:26.957 [2024-04-16 23:04:17.974583] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:26:26.957 qpair failed and we were unable to recover it. 00:26:26.957 [2024-04-16 23:04:17.984404] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:26:26.957 [2024-04-16 23:04:17.984546] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:26:26.957 [2024-04-16 23:04:17.984571] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:26:26.957 [2024-04-16 23:04:17.984585] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:26:26.957 [2024-04-16 23:04:17.984597] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x10f39f0 00:26:26.957 [2024-04-16 23:04:17.984624] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:26:26.957 qpair failed and we were unable to recover it. 00:26:26.957 [2024-04-16 23:04:17.994525] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:26:26.957 [2024-04-16 23:04:17.994647] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:26:26.957 [2024-04-16 23:04:17.994672] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:26:26.957 [2024-04-16 23:04:17.994686] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:26:26.957 [2024-04-16 23:04:17.994698] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x10f39f0 00:26:26.957 [2024-04-16 23:04:17.994725] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:26:26.957 qpair failed and we were unable to recover it. 00:26:26.957 [2024-04-16 23:04:18.004439] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:26:26.957 [2024-04-16 23:04:18.004564] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:26:26.957 [2024-04-16 23:04:18.004590] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:26:26.957 [2024-04-16 23:04:18.004604] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:26:26.957 [2024-04-16 23:04:18.004616] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x10f39f0 00:26:26.957 [2024-04-16 23:04:18.004642] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:26:26.957 qpair failed and we were unable to recover it. 00:26:26.957 [2024-04-16 23:04:18.014456] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:26:26.957 [2024-04-16 23:04:18.014569] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:26:26.957 [2024-04-16 23:04:18.014595] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:26:26.957 [2024-04-16 23:04:18.014609] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:26:26.957 [2024-04-16 23:04:18.014620] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x10f39f0 00:26:26.957 [2024-04-16 23:04:18.014648] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:26:26.957 qpair failed and we were unable to recover it. 00:26:26.957 [2024-04-16 23:04:18.024496] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:26:26.957 [2024-04-16 23:04:18.024617] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:26:26.957 [2024-04-16 23:04:18.024643] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:26:26.957 [2024-04-16 23:04:18.024657] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:26:26.957 [2024-04-16 23:04:18.024669] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x10f39f0 00:26:26.957 [2024-04-16 23:04:18.024695] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:26:26.957 qpair failed and we were unable to recover it. 00:26:26.957 [2024-04-16 23:04:18.034550] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:26:26.957 [2024-04-16 23:04:18.034685] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:26:26.957 [2024-04-16 23:04:18.034710] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:26:26.957 [2024-04-16 23:04:18.034724] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:26:26.957 [2024-04-16 23:04:18.034736] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x10f39f0 00:26:26.957 [2024-04-16 23:04:18.034763] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:26:26.957 qpair failed and we were unable to recover it. 00:26:26.957 [2024-04-16 23:04:18.044583] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:26:26.957 [2024-04-16 23:04:18.044706] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:26:26.957 [2024-04-16 23:04:18.044729] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:26:26.957 [2024-04-16 23:04:18.044743] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:26:26.957 [2024-04-16 23:04:18.044755] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x10f39f0 00:26:26.957 [2024-04-16 23:04:18.044781] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:26:26.957 qpair failed and we were unable to recover it. 00:26:26.957 [2024-04-16 23:04:18.054628] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:26:26.957 [2024-04-16 23:04:18.054790] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:26:26.957 [2024-04-16 23:04:18.054815] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:26:26.957 [2024-04-16 23:04:18.054835] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:26:26.957 [2024-04-16 23:04:18.054848] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x10f39f0 00:26:26.957 [2024-04-16 23:04:18.054875] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:26:26.957 qpair failed and we were unable to recover it. 00:26:26.957 [2024-04-16 23:04:18.064624] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:26:26.958 [2024-04-16 23:04:18.064757] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:26:26.958 [2024-04-16 23:04:18.064783] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:26:26.958 [2024-04-16 23:04:18.064796] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:26:26.958 [2024-04-16 23:04:18.064810] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x10f39f0 00:26:26.958 [2024-04-16 23:04:18.064837] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:26:26.958 qpair failed and we were unable to recover it. 00:26:26.958 [2024-04-16 23:04:18.074631] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:26:26.958 [2024-04-16 23:04:18.074755] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:26:26.958 [2024-04-16 23:04:18.074781] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:26:26.958 [2024-04-16 23:04:18.074795] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:26:26.958 [2024-04-16 23:04:18.074807] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x10f39f0 00:26:26.958 [2024-04-16 23:04:18.074834] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:26:26.958 qpair failed and we were unable to recover it. 00:26:27.219 [2024-04-16 23:04:18.084761] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:26:27.219 [2024-04-16 23:04:18.084878] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:26:27.219 [2024-04-16 23:04:18.084904] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:26:27.219 [2024-04-16 23:04:18.084918] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:26:27.219 [2024-04-16 23:04:18.084931] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x10f39f0 00:26:27.219 [2024-04-16 23:04:18.084958] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:26:27.219 qpair failed and we were unable to recover it. 00:26:27.219 [2024-04-16 23:04:18.094741] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:26:27.219 [2024-04-16 23:04:18.094908] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:26:27.219 [2024-04-16 23:04:18.094934] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:26:27.219 [2024-04-16 23:04:18.094949] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:26:27.219 [2024-04-16 23:04:18.094961] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x10f39f0 00:26:27.219 [2024-04-16 23:04:18.094988] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:26:27.219 qpair failed and we were unable to recover it. 00:26:27.219 [2024-04-16 23:04:18.104759] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:26:27.219 [2024-04-16 23:04:18.104881] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:26:27.219 [2024-04-16 23:04:18.104906] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:26:27.219 [2024-04-16 23:04:18.104920] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:26:27.219 [2024-04-16 23:04:18.104932] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x10f39f0 00:26:27.219 [2024-04-16 23:04:18.104959] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:26:27.219 qpair failed and we were unable to recover it. 00:26:27.219 [2024-04-16 23:04:18.114774] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:26:27.219 [2024-04-16 23:04:18.114895] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:26:27.219 [2024-04-16 23:04:18.114920] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:26:27.219 [2024-04-16 23:04:18.114934] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:26:27.219 [2024-04-16 23:04:18.114946] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x10f39f0 00:26:27.219 [2024-04-16 23:04:18.114972] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:26:27.219 qpair failed and we were unable to recover it. 00:26:27.219 [2024-04-16 23:04:18.124914] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:26:27.219 [2024-04-16 23:04:18.125029] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:26:27.219 [2024-04-16 23:04:18.125054] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:26:27.219 [2024-04-16 23:04:18.125067] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:26:27.219 [2024-04-16 23:04:18.125079] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x10f39f0 00:26:27.219 [2024-04-16 23:04:18.125106] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:26:27.219 qpair failed and we were unable to recover it. 00:26:27.219 [2024-04-16 23:04:18.134857] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:26:27.219 [2024-04-16 23:04:18.135023] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:26:27.219 [2024-04-16 23:04:18.135048] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:26:27.219 [2024-04-16 23:04:18.135062] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:26:27.219 [2024-04-16 23:04:18.135074] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x10f39f0 00:26:27.219 [2024-04-16 23:04:18.135101] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:26:27.219 qpair failed and we were unable to recover it. 00:26:27.219 [2024-04-16 23:04:18.144969] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:26:27.219 [2024-04-16 23:04:18.145086] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:26:27.219 [2024-04-16 23:04:18.145111] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:26:27.219 [2024-04-16 23:04:18.145130] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:26:27.219 [2024-04-16 23:04:18.145143] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x10f39f0 00:26:27.219 [2024-04-16 23:04:18.145169] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:26:27.219 qpair failed and we were unable to recover it. 00:26:27.219 [2024-04-16 23:04:18.154975] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:26:27.219 [2024-04-16 23:04:18.155091] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:26:27.219 [2024-04-16 23:04:18.155117] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:26:27.219 [2024-04-16 23:04:18.155131] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:26:27.219 [2024-04-16 23:04:18.155142] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x10f39f0 00:26:27.219 [2024-04-16 23:04:18.155169] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:26:27.219 qpair failed and we were unable to recover it. 00:26:27.219 [2024-04-16 23:04:18.164910] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:26:27.219 [2024-04-16 23:04:18.165027] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:26:27.220 [2024-04-16 23:04:18.165053] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:26:27.220 [2024-04-16 23:04:18.165067] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:26:27.220 [2024-04-16 23:04:18.165078] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x10f39f0 00:26:27.220 [2024-04-16 23:04:18.165105] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:26:27.220 qpair failed and we were unable to recover it. 00:26:27.220 [2024-04-16 23:04:18.174980] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:26:27.220 [2024-04-16 23:04:18.175096] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:26:27.220 [2024-04-16 23:04:18.175121] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:26:27.220 [2024-04-16 23:04:18.175136] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:26:27.220 [2024-04-16 23:04:18.175147] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x10f39f0 00:26:27.220 [2024-04-16 23:04:18.175184] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:26:27.220 qpair failed and we were unable to recover it. 00:26:27.220 [2024-04-16 23:04:18.185102] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:26:27.220 [2024-04-16 23:04:18.185239] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:26:27.220 [2024-04-16 23:04:18.185265] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:26:27.220 [2024-04-16 23:04:18.185279] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:26:27.220 [2024-04-16 23:04:18.185291] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x10f39f0 00:26:27.220 [2024-04-16 23:04:18.185318] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:26:27.220 qpair failed and we were unable to recover it. 00:26:27.220 [2024-04-16 23:04:18.195019] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:26:27.220 [2024-04-16 23:04:18.195150] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:26:27.220 [2024-04-16 23:04:18.195182] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:26:27.220 [2024-04-16 23:04:18.195199] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:26:27.220 [2024-04-16 23:04:18.195211] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x10f39f0 00:26:27.220 [2024-04-16 23:04:18.195248] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:26:27.220 qpair failed and we were unable to recover it. 00:26:27.220 [2024-04-16 23:04:18.205043] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:26:27.220 [2024-04-16 23:04:18.205161] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:26:27.220 [2024-04-16 23:04:18.205193] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:26:27.220 [2024-04-16 23:04:18.205208] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:26:27.220 [2024-04-16 23:04:18.205231] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x10f39f0 00:26:27.220 [2024-04-16 23:04:18.205258] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:26:27.220 qpair failed and we were unable to recover it. 00:26:27.220 [2024-04-16 23:04:18.215062] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:26:27.220 [2024-04-16 23:04:18.215186] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:26:27.220 [2024-04-16 23:04:18.215212] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:26:27.220 [2024-04-16 23:04:18.215226] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:26:27.220 [2024-04-16 23:04:18.215238] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x10f39f0 00:26:27.220 [2024-04-16 23:04:18.215266] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:26:27.220 qpair failed and we were unable to recover it. 00:26:27.220 [2024-04-16 23:04:18.225101] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:26:27.220 [2024-04-16 23:04:18.225240] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:26:27.220 [2024-04-16 23:04:18.225266] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:26:27.220 [2024-04-16 23:04:18.225280] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:26:27.220 [2024-04-16 23:04:18.225292] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x10f39f0 00:26:27.220 [2024-04-16 23:04:18.225320] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:26:27.220 qpair failed and we were unable to recover it. 00:26:27.220 [2024-04-16 23:04:18.235153] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:26:27.220 [2024-04-16 23:04:18.235280] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:26:27.220 [2024-04-16 23:04:18.235305] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:26:27.220 [2024-04-16 23:04:18.235325] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:26:27.220 [2024-04-16 23:04:18.235338] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x10f39f0 00:26:27.220 [2024-04-16 23:04:18.235365] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:26:27.220 qpair failed and we were unable to recover it. 00:26:27.220 [2024-04-16 23:04:18.245271] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:26:27.220 [2024-04-16 23:04:18.245391] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:26:27.220 [2024-04-16 23:04:18.245417] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:26:27.220 [2024-04-16 23:04:18.245431] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:26:27.220 [2024-04-16 23:04:18.245442] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x10f39f0 00:26:27.220 [2024-04-16 23:04:18.245470] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:26:27.220 qpair failed and we were unable to recover it. 00:26:27.220 [2024-04-16 23:04:18.255167] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:26:27.220 [2024-04-16 23:04:18.255290] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:26:27.220 [2024-04-16 23:04:18.255316] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:26:27.220 [2024-04-16 23:04:18.255330] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:26:27.220 [2024-04-16 23:04:18.255342] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x10f39f0 00:26:27.220 [2024-04-16 23:04:18.255369] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:26:27.220 qpair failed and we were unable to recover it. 00:26:27.220 [2024-04-16 23:04:18.265224] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:26:27.220 [2024-04-16 23:04:18.265390] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:26:27.220 [2024-04-16 23:04:18.265415] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:26:27.220 [2024-04-16 23:04:18.265429] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:26:27.220 [2024-04-16 23:04:18.265441] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x10f39f0 00:26:27.220 [2024-04-16 23:04:18.265468] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:26:27.220 qpair failed and we were unable to recover it. 00:26:27.220 [2024-04-16 23:04:18.275258] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:26:27.220 [2024-04-16 23:04:18.275404] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:26:27.220 [2024-04-16 23:04:18.275441] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:26:27.220 [2024-04-16 23:04:18.275456] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:26:27.220 [2024-04-16 23:04:18.275467] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x10f39f0 00:26:27.220 [2024-04-16 23:04:18.275494] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:26:27.220 qpair failed and we were unable to recover it. 00:26:27.220 [2024-04-16 23:04:18.285282] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:26:27.220 [2024-04-16 23:04:18.285453] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:26:27.220 [2024-04-16 23:04:18.285481] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:26:27.220 [2024-04-16 23:04:18.285496] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:26:27.220 [2024-04-16 23:04:18.285508] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x10f39f0 00:26:27.220 [2024-04-16 23:04:18.285536] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:26:27.220 qpair failed and we were unable to recover it. 00:26:27.220 [2024-04-16 23:04:18.295314] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:26:27.220 [2024-04-16 23:04:18.295434] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:26:27.220 [2024-04-16 23:04:18.295460] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:26:27.220 [2024-04-16 23:04:18.295474] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:26:27.220 [2024-04-16 23:04:18.295486] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x10f39f0 00:26:27.220 [2024-04-16 23:04:18.295514] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:26:27.220 qpair failed and we were unable to recover it. 00:26:27.221 [2024-04-16 23:04:18.305358] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:26:27.221 [2024-04-16 23:04:18.305483] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:26:27.221 [2024-04-16 23:04:18.305509] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:26:27.221 [2024-04-16 23:04:18.305523] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:26:27.221 [2024-04-16 23:04:18.305535] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x10f39f0 00:26:27.221 [2024-04-16 23:04:18.305561] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:26:27.221 qpair failed and we were unable to recover it. 00:26:27.221 [2024-04-16 23:04:18.315365] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:26:27.221 [2024-04-16 23:04:18.315491] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:26:27.221 [2024-04-16 23:04:18.315517] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:26:27.221 [2024-04-16 23:04:18.315530] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:26:27.221 [2024-04-16 23:04:18.315542] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x10f39f0 00:26:27.221 [2024-04-16 23:04:18.315569] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:26:27.221 qpair failed and we were unable to recover it. 00:26:27.221 [2024-04-16 23:04:18.325379] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:26:27.221 [2024-04-16 23:04:18.325492] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:26:27.221 [2024-04-16 23:04:18.325518] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:26:27.221 [2024-04-16 23:04:18.325538] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:26:27.221 [2024-04-16 23:04:18.325550] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x10f39f0 00:26:27.221 [2024-04-16 23:04:18.325577] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:26:27.221 qpair failed and we were unable to recover it. 00:26:27.221 [2024-04-16 23:04:18.335408] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:26:27.221 [2024-04-16 23:04:18.335524] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:26:27.221 [2024-04-16 23:04:18.335549] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:26:27.221 [2024-04-16 23:04:18.335563] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:26:27.221 [2024-04-16 23:04:18.335575] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x10f39f0 00:26:27.221 [2024-04-16 23:04:18.335602] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:26:27.221 qpair failed and we were unable to recover it. 00:26:27.221 [2024-04-16 23:04:18.345446] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:26:27.221 [2024-04-16 23:04:18.345564] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:26:27.221 [2024-04-16 23:04:18.345591] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:26:27.221 [2024-04-16 23:04:18.345605] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:26:27.221 [2024-04-16 23:04:18.345617] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x10f39f0 00:26:27.221 [2024-04-16 23:04:18.345644] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:26:27.221 qpair failed and we were unable to recover it. 00:26:27.482 [2024-04-16 23:04:18.355491] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:26:27.482 [2024-04-16 23:04:18.355617] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:26:27.482 [2024-04-16 23:04:18.355645] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:26:27.482 [2024-04-16 23:04:18.355661] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:26:27.482 [2024-04-16 23:04:18.355675] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x10f39f0 00:26:27.482 [2024-04-16 23:04:18.355703] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:26:27.482 qpair failed and we were unable to recover it. 00:26:27.482 [2024-04-16 23:04:18.365498] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:26:27.482 [2024-04-16 23:04:18.365614] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:26:27.482 [2024-04-16 23:04:18.365641] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:26:27.482 [2024-04-16 23:04:18.365658] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:26:27.482 [2024-04-16 23:04:18.365671] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x10f39f0 00:26:27.482 [2024-04-16 23:04:18.365698] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:26:27.482 qpair failed and we were unable to recover it. 00:26:27.482 [2024-04-16 23:04:18.375528] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:26:27.482 [2024-04-16 23:04:18.375644] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:26:27.482 [2024-04-16 23:04:18.375670] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:26:27.482 [2024-04-16 23:04:18.375684] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:26:27.482 [2024-04-16 23:04:18.375695] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x10f39f0 00:26:27.482 [2024-04-16 23:04:18.375722] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:26:27.482 qpair failed and we were unable to recover it. 00:26:27.482 [2024-04-16 23:04:18.385664] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:26:27.482 [2024-04-16 23:04:18.385783] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:26:27.482 [2024-04-16 23:04:18.385809] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:26:27.482 [2024-04-16 23:04:18.385823] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:26:27.482 [2024-04-16 23:04:18.385835] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x10f39f0 00:26:27.482 [2024-04-16 23:04:18.385862] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:26:27.482 qpair failed and we were unable to recover it. 00:26:27.482 [2024-04-16 23:04:18.395593] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:26:27.482 [2024-04-16 23:04:18.395713] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:26:27.482 [2024-04-16 23:04:18.395739] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:26:27.482 [2024-04-16 23:04:18.395753] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:26:27.482 [2024-04-16 23:04:18.395765] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x10f39f0 00:26:27.482 [2024-04-16 23:04:18.395793] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:26:27.482 qpair failed and we were unable to recover it. 00:26:27.482 [2024-04-16 23:04:18.405615] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:26:27.482 [2024-04-16 23:04:18.405736] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:26:27.482 [2024-04-16 23:04:18.405761] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:26:27.483 [2024-04-16 23:04:18.405776] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:26:27.483 [2024-04-16 23:04:18.405788] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x10f39f0 00:26:27.483 [2024-04-16 23:04:18.405814] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:26:27.483 qpair failed and we were unable to recover it. 00:26:27.483 [2024-04-16 23:04:18.415688] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:26:27.483 [2024-04-16 23:04:18.415827] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:26:27.483 [2024-04-16 23:04:18.415857] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:26:27.483 [2024-04-16 23:04:18.415873] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:26:27.483 [2024-04-16 23:04:18.415884] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x10f39f0 00:26:27.483 [2024-04-16 23:04:18.415911] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:26:27.483 qpair failed and we were unable to recover it. 00:26:27.483 [2024-04-16 23:04:18.425714] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:26:27.483 [2024-04-16 23:04:18.425861] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:26:27.483 [2024-04-16 23:04:18.425888] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:26:27.483 [2024-04-16 23:04:18.425903] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:26:27.483 [2024-04-16 23:04:18.425918] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x10f39f0 00:26:27.483 [2024-04-16 23:04:18.425947] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:26:27.483 qpair failed and we were unable to recover it. 00:26:27.483 [2024-04-16 23:04:18.435746] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:26:27.483 [2024-04-16 23:04:18.435868] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:26:27.483 [2024-04-16 23:04:18.435894] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:26:27.483 [2024-04-16 23:04:18.435910] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:26:27.483 [2024-04-16 23:04:18.435922] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x10f39f0 00:26:27.483 [2024-04-16 23:04:18.435949] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:26:27.483 qpair failed and we were unable to recover it. 00:26:27.483 [2024-04-16 23:04:18.445767] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:26:27.483 [2024-04-16 23:04:18.445898] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:26:27.483 [2024-04-16 23:04:18.445924] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:26:27.483 [2024-04-16 23:04:18.445938] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:26:27.483 [2024-04-16 23:04:18.445950] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x10f39f0 00:26:27.483 [2024-04-16 23:04:18.445977] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:26:27.483 qpair failed and we were unable to recover it. 00:26:27.483 [2024-04-16 23:04:18.455752] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:26:27.483 [2024-04-16 23:04:18.455864] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:26:27.483 [2024-04-16 23:04:18.455889] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:26:27.483 [2024-04-16 23:04:18.455903] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:26:27.483 [2024-04-16 23:04:18.455915] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x10f39f0 00:26:27.483 [2024-04-16 23:04:18.455942] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:26:27.483 qpair failed and we were unable to recover it. 00:26:27.483 [2024-04-16 23:04:18.465793] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:26:27.483 [2024-04-16 23:04:18.465916] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:26:27.483 [2024-04-16 23:04:18.465942] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:26:27.483 [2024-04-16 23:04:18.465956] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:26:27.483 [2024-04-16 23:04:18.465967] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x10f39f0 00:26:27.483 [2024-04-16 23:04:18.465994] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:26:27.483 qpair failed and we were unable to recover it. 00:26:27.483 [2024-04-16 23:04:18.475855] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:26:27.483 [2024-04-16 23:04:18.475971] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:26:27.483 [2024-04-16 23:04:18.475996] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:26:27.483 [2024-04-16 23:04:18.476010] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:26:27.483 [2024-04-16 23:04:18.476022] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x10f39f0 00:26:27.483 [2024-04-16 23:04:18.476049] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:26:27.483 qpair failed and we were unable to recover it. 00:26:27.483 [2024-04-16 23:04:18.485845] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:26:27.483 [2024-04-16 23:04:18.485971] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:26:27.483 [2024-04-16 23:04:18.485999] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:26:27.483 [2024-04-16 23:04:18.486013] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:26:27.483 [2024-04-16 23:04:18.486025] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x10f39f0 00:26:27.483 [2024-04-16 23:04:18.486052] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:26:27.483 qpair failed and we were unable to recover it. 00:26:27.483 [2024-04-16 23:04:18.495908] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:26:27.483 [2024-04-16 23:04:18.496026] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:26:27.483 [2024-04-16 23:04:18.496051] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:26:27.483 [2024-04-16 23:04:18.496066] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:26:27.483 [2024-04-16 23:04:18.496077] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x10f39f0 00:26:27.483 [2024-04-16 23:04:18.496104] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:26:27.483 qpair failed and we were unable to recover it. 00:26:27.483 [2024-04-16 23:04:18.505980] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:26:27.483 [2024-04-16 23:04:18.506104] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:26:27.483 [2024-04-16 23:04:18.506136] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:26:27.483 [2024-04-16 23:04:18.506151] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:26:27.483 [2024-04-16 23:04:18.506162] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x10f39f0 00:26:27.483 [2024-04-16 23:04:18.506198] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:26:27.483 qpair failed and we were unable to recover it. 00:26:27.483 [2024-04-16 23:04:18.516009] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:26:27.483 [2024-04-16 23:04:18.516170] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:26:27.483 [2024-04-16 23:04:18.516206] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:26:27.483 [2024-04-16 23:04:18.516224] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:26:27.483 [2024-04-16 23:04:18.516236] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x10f39f0 00:26:27.483 [2024-04-16 23:04:18.516265] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:26:27.483 qpair failed and we were unable to recover it. 00:26:27.483 [2024-04-16 23:04:18.526001] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:26:27.483 [2024-04-16 23:04:18.526124] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:26:27.483 [2024-04-16 23:04:18.526150] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:26:27.483 [2024-04-16 23:04:18.526164] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:26:27.483 [2024-04-16 23:04:18.526182] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x10f39f0 00:26:27.483 [2024-04-16 23:04:18.526212] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:26:27.483 qpair failed and we were unable to recover it. 00:26:27.483 [2024-04-16 23:04:18.536039] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:26:27.483 [2024-04-16 23:04:18.536195] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:26:27.483 [2024-04-16 23:04:18.536227] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:26:27.483 [2024-04-16 23:04:18.536240] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:26:27.483 [2024-04-16 23:04:18.536252] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x10f39f0 00:26:27.483 [2024-04-16 23:04:18.536279] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:26:27.483 qpair failed and we were unable to recover it. 00:26:27.484 [2024-04-16 23:04:18.546094] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:26:27.484 [2024-04-16 23:04:18.546246] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:26:27.484 [2024-04-16 23:04:18.546271] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:26:27.484 [2024-04-16 23:04:18.546285] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:26:27.484 [2024-04-16 23:04:18.546297] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x10f39f0 00:26:27.484 [2024-04-16 23:04:18.546329] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:26:27.484 qpair failed and we were unable to recover it. 00:26:27.484 [2024-04-16 23:04:18.556092] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:26:27.484 [2024-04-16 23:04:18.556225] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:26:27.484 [2024-04-16 23:04:18.556250] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:26:27.484 [2024-04-16 23:04:18.556264] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:26:27.484 [2024-04-16 23:04:18.556276] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x10f39f0 00:26:27.484 [2024-04-16 23:04:18.556303] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:26:27.484 qpair failed and we were unable to recover it. 00:26:27.484 [2024-04-16 23:04:18.566105] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:26:27.484 [2024-04-16 23:04:18.566267] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:26:27.484 [2024-04-16 23:04:18.566292] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:26:27.484 [2024-04-16 23:04:18.566306] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:26:27.484 [2024-04-16 23:04:18.566318] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x10f39f0 00:26:27.484 [2024-04-16 23:04:18.566345] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:26:27.484 qpair failed and we were unable to recover it. 00:26:27.484 [2024-04-16 23:04:18.576139] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:26:27.484 [2024-04-16 23:04:18.576266] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:26:27.484 [2024-04-16 23:04:18.576292] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:26:27.484 [2024-04-16 23:04:18.576309] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:26:27.484 [2024-04-16 23:04:18.576321] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x10f39f0 00:26:27.484 [2024-04-16 23:04:18.576349] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:26:27.484 qpair failed and we were unable to recover it. 00:26:27.484 [2024-04-16 23:04:18.586204] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:26:27.484 [2024-04-16 23:04:18.586371] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:26:27.484 [2024-04-16 23:04:18.586396] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:26:27.484 [2024-04-16 23:04:18.586411] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:26:27.484 [2024-04-16 23:04:18.586422] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x10f39f0 00:26:27.484 [2024-04-16 23:04:18.586449] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:26:27.484 qpair failed and we were unable to recover it. 00:26:27.484 [2024-04-16 23:04:18.596209] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:26:27.484 [2024-04-16 23:04:18.596378] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:26:27.484 [2024-04-16 23:04:18.596409] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:26:27.484 [2024-04-16 23:04:18.596424] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:26:27.484 [2024-04-16 23:04:18.596436] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x10f39f0 00:26:27.484 [2024-04-16 23:04:18.596463] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:26:27.484 qpair failed and we were unable to recover it. 00:26:27.484 [2024-04-16 23:04:18.606205] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:26:27.484 [2024-04-16 23:04:18.606321] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:26:27.484 [2024-04-16 23:04:18.606348] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:26:27.484 [2024-04-16 23:04:18.606363] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:26:27.484 [2024-04-16 23:04:18.606374] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x10f39f0 00:26:27.484 [2024-04-16 23:04:18.606401] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:26:27.484 qpair failed and we were unable to recover it. 00:26:27.745 [2024-04-16 23:04:18.616241] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:26:27.745 [2024-04-16 23:04:18.616366] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:26:27.745 [2024-04-16 23:04:18.616392] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:26:27.746 [2024-04-16 23:04:18.616407] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:26:27.746 [2024-04-16 23:04:18.616418] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x10f39f0 00:26:27.746 [2024-04-16 23:04:18.616446] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:26:27.746 qpair failed and we were unable to recover it. 00:26:27.746 [2024-04-16 23:04:18.626324] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:26:27.746 [2024-04-16 23:04:18.626487] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:26:27.746 [2024-04-16 23:04:18.626515] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:26:27.746 [2024-04-16 23:04:18.626532] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:26:27.746 [2024-04-16 23:04:18.626544] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x10f39f0 00:26:27.746 [2024-04-16 23:04:18.626572] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:26:27.746 qpair failed and we were unable to recover it. 00:26:27.746 [2024-04-16 23:04:18.636285] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:26:27.746 [2024-04-16 23:04:18.636402] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:26:27.746 [2024-04-16 23:04:18.636428] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:26:27.746 [2024-04-16 23:04:18.636443] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:26:27.746 [2024-04-16 23:04:18.636454] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x10f39f0 00:26:27.746 [2024-04-16 23:04:18.636487] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:26:27.746 qpair failed and we were unable to recover it. 00:26:27.746 [2024-04-16 23:04:18.646304] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:26:27.746 [2024-04-16 23:04:18.646439] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:26:27.746 [2024-04-16 23:04:18.646465] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:26:27.746 [2024-04-16 23:04:18.646479] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:26:27.746 [2024-04-16 23:04:18.646491] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x10f39f0 00:26:27.746 [2024-04-16 23:04:18.646518] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:26:27.746 qpair failed and we were unable to recover it. 00:26:27.746 [2024-04-16 23:04:18.656347] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:26:27.746 [2024-04-16 23:04:18.656490] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:26:27.746 [2024-04-16 23:04:18.656515] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:26:27.746 [2024-04-16 23:04:18.656529] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:26:27.746 [2024-04-16 23:04:18.656541] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x10f39f0 00:26:27.746 [2024-04-16 23:04:18.656568] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:26:27.746 qpair failed and we were unable to recover it. 00:26:27.746 [2024-04-16 23:04:18.666406] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:26:27.746 [2024-04-16 23:04:18.666525] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:26:27.746 [2024-04-16 23:04:18.666551] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:26:27.746 [2024-04-16 23:04:18.666565] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:26:27.746 [2024-04-16 23:04:18.666577] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x10f39f0 00:26:27.746 [2024-04-16 23:04:18.666604] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:26:27.746 qpair failed and we were unable to recover it. 00:26:27.746 [2024-04-16 23:04:18.676392] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:26:27.746 [2024-04-16 23:04:18.676504] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:26:27.746 [2024-04-16 23:04:18.676529] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:26:27.746 [2024-04-16 23:04:18.676542] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:26:27.746 [2024-04-16 23:04:18.676554] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x10f39f0 00:26:27.746 [2024-04-16 23:04:18.676580] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:26:27.746 qpair failed and we were unable to recover it. 00:26:27.746 [2024-04-16 23:04:18.686462] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:26:27.746 [2024-04-16 23:04:18.686580] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:26:27.746 [2024-04-16 23:04:18.686610] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:26:27.746 [2024-04-16 23:04:18.686625] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:26:27.746 [2024-04-16 23:04:18.686637] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x10f39f0 00:26:27.746 [2024-04-16 23:04:18.686664] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:26:27.746 qpair failed and we were unable to recover it. 00:26:27.746 [2024-04-16 23:04:18.696479] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:26:27.746 [2024-04-16 23:04:18.696587] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:26:27.746 [2024-04-16 23:04:18.696612] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:26:27.746 [2024-04-16 23:04:18.696626] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:26:27.746 [2024-04-16 23:04:18.696637] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x10f39f0 00:26:27.746 [2024-04-16 23:04:18.696665] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:26:27.746 qpair failed and we were unable to recover it. 00:26:27.746 [2024-04-16 23:04:18.706578] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:26:27.746 [2024-04-16 23:04:18.706693] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:26:27.746 [2024-04-16 23:04:18.706719] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:26:27.746 [2024-04-16 23:04:18.706733] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:26:27.746 [2024-04-16 23:04:18.706744] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x10f39f0 00:26:27.746 [2024-04-16 23:04:18.706771] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:26:27.746 qpair failed and we were unable to recover it. 00:26:27.746 [2024-04-16 23:04:18.716501] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:26:27.746 [2024-04-16 23:04:18.716622] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:26:27.746 [2024-04-16 23:04:18.716647] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:26:27.746 [2024-04-16 23:04:18.716661] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:26:27.746 [2024-04-16 23:04:18.716673] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x10f39f0 00:26:27.746 [2024-04-16 23:04:18.716700] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:26:27.746 qpair failed and we were unable to recover it. 00:26:27.746 [2024-04-16 23:04:18.726534] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:26:27.746 [2024-04-16 23:04:18.726678] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:26:27.746 [2024-04-16 23:04:18.726703] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:26:27.746 [2024-04-16 23:04:18.726717] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:26:27.746 [2024-04-16 23:04:18.726729] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x10f39f0 00:26:27.746 [2024-04-16 23:04:18.726761] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:26:27.746 qpair failed and we were unable to recover it. 00:26:27.746 [2024-04-16 23:04:18.736558] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:26:27.746 [2024-04-16 23:04:18.736686] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:26:27.746 [2024-04-16 23:04:18.736711] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:26:27.746 [2024-04-16 23:04:18.736726] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:26:27.746 [2024-04-16 23:04:18.736738] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x10f39f0 00:26:27.746 [2024-04-16 23:04:18.736765] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:26:27.746 qpair failed and we were unable to recover it. 00:26:27.746 [2024-04-16 23:04:18.746730] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:26:27.746 [2024-04-16 23:04:18.746852] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:26:27.746 [2024-04-16 23:04:18.746877] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:26:27.746 [2024-04-16 23:04:18.746891] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:26:27.746 [2024-04-16 23:04:18.746903] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x10f39f0 00:26:27.746 [2024-04-16 23:04:18.746930] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:26:27.746 qpair failed and we were unable to recover it. 00:26:27.746 [2024-04-16 23:04:18.756606] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:26:27.747 [2024-04-16 23:04:18.756747] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:26:27.747 [2024-04-16 23:04:18.756772] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:26:27.747 [2024-04-16 23:04:18.756786] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:26:27.747 [2024-04-16 23:04:18.756797] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x10f39f0 00:26:27.747 [2024-04-16 23:04:18.756824] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:26:27.747 qpair failed and we were unable to recover it. 00:26:27.747 [2024-04-16 23:04:18.766649] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:26:27.747 [2024-04-16 23:04:18.766788] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:26:27.747 [2024-04-16 23:04:18.766814] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:26:27.747 [2024-04-16 23:04:18.766828] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:26:27.747 [2024-04-16 23:04:18.766840] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x10f39f0 00:26:27.747 [2024-04-16 23:04:18.766867] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:26:27.747 qpair failed and we were unable to recover it. 00:26:27.747 [2024-04-16 23:04:18.776750] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:26:27.747 [2024-04-16 23:04:18.776861] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:26:27.747 [2024-04-16 23:04:18.776891] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:26:27.747 [2024-04-16 23:04:18.776906] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:26:27.747 [2024-04-16 23:04:18.776918] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x10f39f0 00:26:27.747 [2024-04-16 23:04:18.776945] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:26:27.747 qpair failed and we were unable to recover it. 00:26:27.747 [2024-04-16 23:04:18.786702] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:26:27.747 [2024-04-16 23:04:18.786862] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:26:27.747 [2024-04-16 23:04:18.786887] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:26:27.747 [2024-04-16 23:04:18.786902] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:26:27.747 [2024-04-16 23:04:18.786914] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x10f39f0 00:26:27.747 [2024-04-16 23:04:18.786941] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:26:27.747 qpair failed and we were unable to recover it. 00:26:27.747 [2024-04-16 23:04:18.796736] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:26:27.747 [2024-04-16 23:04:18.796855] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:26:27.747 [2024-04-16 23:04:18.796880] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:26:27.747 [2024-04-16 23:04:18.796894] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:26:27.747 [2024-04-16 23:04:18.796906] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x10f39f0 00:26:27.747 [2024-04-16 23:04:18.796933] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:26:27.747 qpair failed and we were unable to recover it. 00:26:27.747 [2024-04-16 23:04:18.806874] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:26:27.747 [2024-04-16 23:04:18.806987] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:26:27.747 [2024-04-16 23:04:18.807013] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:26:27.747 [2024-04-16 23:04:18.807028] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:26:27.747 [2024-04-16 23:04:18.807039] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x10f39f0 00:26:27.747 [2024-04-16 23:04:18.807067] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:26:27.747 qpair failed and we were unable to recover it. 00:26:27.747 [2024-04-16 23:04:18.816794] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:26:27.747 [2024-04-16 23:04:18.816906] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:26:27.747 [2024-04-16 23:04:18.816931] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:26:27.747 [2024-04-16 23:04:18.816945] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:26:27.747 [2024-04-16 23:04:18.816957] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x10f39f0 00:26:27.747 [2024-04-16 23:04:18.816990] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:26:27.747 qpair failed and we were unable to recover it. 00:26:27.747 [2024-04-16 23:04:18.826940] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:26:27.747 [2024-04-16 23:04:18.827075] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:26:27.747 [2024-04-16 23:04:18.827101] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:26:27.747 [2024-04-16 23:04:18.827115] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:26:27.747 [2024-04-16 23:04:18.827127] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x10f39f0 00:26:27.747 [2024-04-16 23:04:18.827154] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:26:27.747 qpair failed and we were unable to recover it. 00:26:27.747 [2024-04-16 23:04:18.836935] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:26:27.747 [2024-04-16 23:04:18.837051] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:26:27.747 [2024-04-16 23:04:18.837076] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:26:27.747 [2024-04-16 23:04:18.837090] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:26:27.747 [2024-04-16 23:04:18.837102] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x10f39f0 00:26:27.747 [2024-04-16 23:04:18.837129] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:26:27.747 qpair failed and we were unable to recover it. 00:26:27.747 [2024-04-16 23:04:18.846871] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:26:27.747 [2024-04-16 23:04:18.846990] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:26:27.747 [2024-04-16 23:04:18.847016] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:26:27.747 [2024-04-16 23:04:18.847030] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:26:27.747 [2024-04-16 23:04:18.847042] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x10f39f0 00:26:27.747 [2024-04-16 23:04:18.847069] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:26:27.747 qpair failed and we were unable to recover it. 00:26:27.747 [2024-04-16 23:04:18.856982] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:26:27.747 [2024-04-16 23:04:18.857092] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:26:27.747 [2024-04-16 23:04:18.857117] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:26:27.747 [2024-04-16 23:04:18.857131] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:26:27.747 [2024-04-16 23:04:18.857143] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x10f39f0 00:26:27.747 [2024-04-16 23:04:18.857169] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:26:27.747 qpair failed and we were unable to recover it. 00:26:27.747 [2024-04-16 23:04:18.866964] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:26:27.747 [2024-04-16 23:04:18.867132] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:26:27.747 [2024-04-16 23:04:18.867163] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:26:27.747 [2024-04-16 23:04:18.867186] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:26:27.747 [2024-04-16 23:04:18.867200] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x10f39f0 00:26:27.747 [2024-04-16 23:04:18.867228] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:26:27.747 qpair failed and we were unable to recover it. 00:26:28.007 [2024-04-16 23:04:18.876976] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:26:28.007 [2024-04-16 23:04:18.877100] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:26:28.007 [2024-04-16 23:04:18.877126] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:26:28.007 [2024-04-16 23:04:18.877141] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:26:28.007 [2024-04-16 23:04:18.877152] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x10f39f0 00:26:28.007 [2024-04-16 23:04:18.877188] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:26:28.007 qpair failed and we were unable to recover it. 00:26:28.007 [2024-04-16 23:04:18.886981] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:26:28.007 [2024-04-16 23:04:18.887101] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:26:28.007 [2024-04-16 23:04:18.887128] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:26:28.007 [2024-04-16 23:04:18.887143] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:26:28.007 [2024-04-16 23:04:18.887156] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x10f39f0 00:26:28.007 [2024-04-16 23:04:18.887192] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:26:28.007 qpair failed and we were unable to recover it. 00:26:28.007 [2024-04-16 23:04:18.897022] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:26:28.008 [2024-04-16 23:04:18.897149] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:26:28.008 [2024-04-16 23:04:18.897183] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:26:28.008 [2024-04-16 23:04:18.897200] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:26:28.008 [2024-04-16 23:04:18.897213] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x10f39f0 00:26:28.008 [2024-04-16 23:04:18.897240] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:26:28.008 qpair failed and we were unable to recover it. 00:26:28.008 [2024-04-16 23:04:18.907097] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:26:28.008 [2024-04-16 23:04:18.907242] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:26:28.008 [2024-04-16 23:04:18.907271] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:26:28.008 [2024-04-16 23:04:18.907285] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:26:28.008 [2024-04-16 23:04:18.907305] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x10f39f0 00:26:28.008 [2024-04-16 23:04:18.907333] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:26:28.008 qpair failed and we were unable to recover it. 00:26:28.008 [2024-04-16 23:04:18.917066] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:26:28.008 [2024-04-16 23:04:18.917189] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:26:28.008 [2024-04-16 23:04:18.917216] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:26:28.008 [2024-04-16 23:04:18.917230] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:26:28.008 [2024-04-16 23:04:18.917242] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x10f39f0 00:26:28.008 [2024-04-16 23:04:18.917269] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:26:28.008 qpair failed and we were unable to recover it. 00:26:28.008 [2024-04-16 23:04:18.927105] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:26:28.008 [2024-04-16 23:04:18.927242] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:26:28.008 [2024-04-16 23:04:18.927268] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:26:28.008 [2024-04-16 23:04:18.927282] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:26:28.008 [2024-04-16 23:04:18.927294] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x10f39f0 00:26:28.008 [2024-04-16 23:04:18.927321] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:26:28.008 qpair failed and we were unable to recover it. 00:26:28.008 [2024-04-16 23:04:18.937118] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:26:28.008 [2024-04-16 23:04:18.937260] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:26:28.008 [2024-04-16 23:04:18.937286] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:26:28.008 [2024-04-16 23:04:18.937300] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:26:28.008 [2024-04-16 23:04:18.937312] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x10f39f0 00:26:28.008 [2024-04-16 23:04:18.937339] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:26:28.008 qpair failed and we were unable to recover it. 00:26:28.008 [2024-04-16 23:04:18.947263] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:26:28.008 [2024-04-16 23:04:18.947388] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:26:28.008 [2024-04-16 23:04:18.947413] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:26:28.008 [2024-04-16 23:04:18.947428] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:26:28.008 [2024-04-16 23:04:18.947439] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x10f39f0 00:26:28.008 [2024-04-16 23:04:18.947466] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:26:28.008 qpair failed and we were unable to recover it. 00:26:28.008 [2024-04-16 23:04:18.957181] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:26:28.008 [2024-04-16 23:04:18.957311] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:26:28.008 [2024-04-16 23:04:18.957336] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:26:28.008 [2024-04-16 23:04:18.957350] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:26:28.008 [2024-04-16 23:04:18.957362] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x10f39f0 00:26:28.008 [2024-04-16 23:04:18.957389] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:26:28.008 qpair failed and we were unable to recover it. 00:26:28.008 [2024-04-16 23:04:18.967301] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:26:28.008 [2024-04-16 23:04:18.967444] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:26:28.008 [2024-04-16 23:04:18.967469] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:26:28.008 [2024-04-16 23:04:18.967484] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:26:28.008 [2024-04-16 23:04:18.967496] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x10f39f0 00:26:28.008 [2024-04-16 23:04:18.967523] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:26:28.008 qpair failed and we were unable to recover it. 00:26:28.008 [2024-04-16 23:04:18.977230] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:26:28.008 [2024-04-16 23:04:18.977349] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:26:28.008 [2024-04-16 23:04:18.977374] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:26:28.008 [2024-04-16 23:04:18.977387] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:26:28.008 [2024-04-16 23:04:18.977399] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x10f39f0 00:26:28.008 [2024-04-16 23:04:18.977427] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:26:28.008 qpair failed and we were unable to recover it. 00:26:28.008 [2024-04-16 23:04:18.987329] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:26:28.008 [2024-04-16 23:04:18.987490] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:26:28.008 [2024-04-16 23:04:18.987516] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:26:28.008 [2024-04-16 23:04:18.987530] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:26:28.008 [2024-04-16 23:04:18.987542] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x10f39f0 00:26:28.008 [2024-04-16 23:04:18.987568] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:26:28.008 qpair failed and we were unable to recover it. 00:26:28.008 [2024-04-16 23:04:18.997333] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:26:28.008 [2024-04-16 23:04:18.997493] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:26:28.008 [2024-04-16 23:04:18.997518] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:26:28.008 [2024-04-16 23:04:18.997533] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:26:28.008 [2024-04-16 23:04:18.997550] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x10f39f0 00:26:28.008 [2024-04-16 23:04:18.997577] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:26:28.008 qpair failed and we were unable to recover it. 00:26:28.008 [2024-04-16 23:04:19.007349] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:26:28.008 [2024-04-16 23:04:19.007474] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:26:28.008 [2024-04-16 23:04:19.007499] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:26:28.008 [2024-04-16 23:04:19.007513] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:26:28.008 [2024-04-16 23:04:19.007524] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x10f39f0 00:26:28.008 [2024-04-16 23:04:19.007551] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:26:28.008 qpair failed and we were unable to recover it. 00:26:28.008 [2024-04-16 23:04:19.017366] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:26:28.008 [2024-04-16 23:04:19.017484] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:26:28.008 [2024-04-16 23:04:19.017510] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:26:28.008 [2024-04-16 23:04:19.017525] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:26:28.008 [2024-04-16 23:04:19.017537] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x10f39f0 00:26:28.008 [2024-04-16 23:04:19.017563] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:26:28.008 qpair failed and we were unable to recover it. 00:26:28.008 [2024-04-16 23:04:19.027431] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:26:28.008 [2024-04-16 23:04:19.027556] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:26:28.008 [2024-04-16 23:04:19.027582] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:26:28.008 [2024-04-16 23:04:19.027596] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:26:28.009 [2024-04-16 23:04:19.027607] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x10f39f0 00:26:28.009 [2024-04-16 23:04:19.027634] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:26:28.009 qpair failed and we were unable to recover it. 00:26:28.009 [2024-04-16 23:04:19.037426] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:26:28.009 [2024-04-16 23:04:19.037546] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:26:28.009 [2024-04-16 23:04:19.037571] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:26:28.009 [2024-04-16 23:04:19.037585] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:26:28.009 [2024-04-16 23:04:19.037597] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x10f39f0 00:26:28.009 [2024-04-16 23:04:19.037624] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:26:28.009 qpair failed and we were unable to recover it. 00:26:28.009 [2024-04-16 23:04:19.047457] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:26:28.009 [2024-04-16 23:04:19.047594] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:26:28.009 [2024-04-16 23:04:19.047618] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:26:28.009 [2024-04-16 23:04:19.047632] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:26:28.009 [2024-04-16 23:04:19.047646] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x10f39f0 00:26:28.009 [2024-04-16 23:04:19.047673] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:26:28.009 qpair failed and we were unable to recover it. 00:26:28.009 [2024-04-16 23:04:19.057542] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:26:28.009 [2024-04-16 23:04:19.057663] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:26:28.009 [2024-04-16 23:04:19.057690] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:26:28.009 [2024-04-16 23:04:19.057704] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:26:28.009 [2024-04-16 23:04:19.057720] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x10f39f0 00:26:28.009 [2024-04-16 23:04:19.057748] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:26:28.009 qpair failed and we were unable to recover it. 00:26:28.009 [2024-04-16 23:04:19.067552] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:26:28.009 [2024-04-16 23:04:19.067672] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:26:28.009 [2024-04-16 23:04:19.067698] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:26:28.009 [2024-04-16 23:04:19.067712] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:26:28.009 [2024-04-16 23:04:19.067724] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x10f39f0 00:26:28.009 [2024-04-16 23:04:19.067751] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:26:28.009 qpair failed and we were unable to recover it. 00:26:28.009 [2024-04-16 23:04:19.077563] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:26:28.009 [2024-04-16 23:04:19.077676] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:26:28.009 [2024-04-16 23:04:19.077702] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:26:28.009 [2024-04-16 23:04:19.077716] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:26:28.009 [2024-04-16 23:04:19.077727] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x10f39f0 00:26:28.009 [2024-04-16 23:04:19.077754] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:26:28.009 qpair failed and we were unable to recover it. 00:26:28.009 [2024-04-16 23:04:19.087621] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:26:28.009 [2024-04-16 23:04:19.087739] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:26:28.009 [2024-04-16 23:04:19.087764] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:26:28.009 [2024-04-16 23:04:19.087778] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:26:28.009 [2024-04-16 23:04:19.087795] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x10f39f0 00:26:28.009 [2024-04-16 23:04:19.087823] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:26:28.009 qpair failed and we were unable to recover it. 00:26:28.009 [2024-04-16 23:04:19.097629] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:26:28.009 [2024-04-16 23:04:19.097783] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:26:28.009 [2024-04-16 23:04:19.097808] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:26:28.009 [2024-04-16 23:04:19.097823] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:26:28.009 [2024-04-16 23:04:19.097834] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x10f39f0 00:26:28.009 [2024-04-16 23:04:19.097861] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:26:28.009 qpair failed and we were unable to recover it. 00:26:28.009 [2024-04-16 23:04:19.107681] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:26:28.009 [2024-04-16 23:04:19.107804] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:26:28.009 [2024-04-16 23:04:19.107830] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:26:28.009 [2024-04-16 23:04:19.107844] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:26:28.009 [2024-04-16 23:04:19.107855] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x10f39f0 00:26:28.009 [2024-04-16 23:04:19.107882] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:26:28.009 qpair failed and we were unable to recover it. 00:26:28.009 [2024-04-16 23:04:19.117633] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:26:28.009 [2024-04-16 23:04:19.117747] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:26:28.009 [2024-04-16 23:04:19.117773] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:26:28.009 [2024-04-16 23:04:19.117787] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:26:28.009 [2024-04-16 23:04:19.117798] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x10f39f0 00:26:28.009 [2024-04-16 23:04:19.117825] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:26:28.009 qpair failed and we were unable to recover it. 00:26:28.009 [2024-04-16 23:04:19.127711] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:26:28.009 [2024-04-16 23:04:19.127831] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:26:28.009 [2024-04-16 23:04:19.127857] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:26:28.009 [2024-04-16 23:04:19.127871] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:26:28.009 [2024-04-16 23:04:19.127883] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x10f39f0 00:26:28.009 [2024-04-16 23:04:19.127909] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:26:28.009 qpair failed and we were unable to recover it. 00:26:28.270 [2024-04-16 23:04:19.137721] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:26:28.270 [2024-04-16 23:04:19.137840] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:26:28.270 [2024-04-16 23:04:19.137867] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:26:28.270 [2024-04-16 23:04:19.137881] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:26:28.270 [2024-04-16 23:04:19.137893] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x10f39f0 00:26:28.270 [2024-04-16 23:04:19.137920] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:26:28.270 qpair failed and we were unable to recover it. 00:26:28.270 [2024-04-16 23:04:19.147756] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:26:28.270 [2024-04-16 23:04:19.147872] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:26:28.270 [2024-04-16 23:04:19.147898] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:26:28.270 [2024-04-16 23:04:19.147912] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:26:28.270 [2024-04-16 23:04:19.147924] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x10f39f0 00:26:28.270 [2024-04-16 23:04:19.147951] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:26:28.270 qpair failed and we were unable to recover it. 00:26:28.270 [2024-04-16 23:04:19.157779] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:26:28.270 [2024-04-16 23:04:19.157944] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:26:28.270 [2024-04-16 23:04:19.157969] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:26:28.270 [2024-04-16 23:04:19.157983] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:26:28.270 [2024-04-16 23:04:19.157995] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x10f39f0 00:26:28.270 [2024-04-16 23:04:19.158022] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:26:28.270 qpair failed and we were unable to recover it. 00:26:28.270 [2024-04-16 23:04:19.167839] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:26:28.270 [2024-04-16 23:04:19.167966] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:26:28.270 [2024-04-16 23:04:19.167992] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:26:28.270 [2024-04-16 23:04:19.168009] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:26:28.270 [2024-04-16 23:04:19.168021] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x10f39f0 00:26:28.270 [2024-04-16 23:04:19.168048] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:26:28.270 qpair failed and we were unable to recover it. 00:26:28.270 [2024-04-16 23:04:19.177839] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:26:28.270 [2024-04-16 23:04:19.177950] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:26:28.270 [2024-04-16 23:04:19.177975] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:26:28.270 [2024-04-16 23:04:19.177989] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:26:28.270 [2024-04-16 23:04:19.178009] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x10f39f0 00:26:28.270 [2024-04-16 23:04:19.178037] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:26:28.270 qpair failed and we were unable to recover it. 00:26:28.270 [2024-04-16 23:04:19.187880] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:26:28.270 [2024-04-16 23:04:19.188001] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:26:28.270 [2024-04-16 23:04:19.188026] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:26:28.270 [2024-04-16 23:04:19.188040] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:26:28.270 [2024-04-16 23:04:19.188052] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x10f39f0 00:26:28.270 [2024-04-16 23:04:19.188079] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:26:28.270 qpair failed and we were unable to recover it. 00:26:28.270 [2024-04-16 23:04:19.197877] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:26:28.270 [2024-04-16 23:04:19.197997] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:26:28.270 [2024-04-16 23:04:19.198022] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:26:28.270 [2024-04-16 23:04:19.198036] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:26:28.270 [2024-04-16 23:04:19.198048] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x10f39f0 00:26:28.270 [2024-04-16 23:04:19.198075] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:26:28.270 qpair failed and we were unable to recover it. 00:26:28.270 [2024-04-16 23:04:19.207925] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:26:28.270 [2024-04-16 23:04:19.208038] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:26:28.270 [2024-04-16 23:04:19.208064] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:26:28.270 [2024-04-16 23:04:19.208078] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:26:28.270 [2024-04-16 23:04:19.208089] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x10f39f0 00:26:28.270 [2024-04-16 23:04:19.208116] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:26:28.270 qpair failed and we were unable to recover it. 00:26:28.270 [2024-04-16 23:04:19.217949] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:26:28.270 [2024-04-16 23:04:19.218063] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:26:28.270 [2024-04-16 23:04:19.218089] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:26:28.270 [2024-04-16 23:04:19.218103] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:26:28.270 [2024-04-16 23:04:19.218115] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x10f39f0 00:26:28.270 [2024-04-16 23:04:19.218142] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:26:28.270 qpair failed and we were unable to recover it. 00:26:28.270 [2024-04-16 23:04:19.228015] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:26:28.270 [2024-04-16 23:04:19.228134] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:26:28.270 [2024-04-16 23:04:19.228160] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:26:28.270 [2024-04-16 23:04:19.228184] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:26:28.270 [2024-04-16 23:04:19.228199] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x10f39f0 00:26:28.270 [2024-04-16 23:04:19.228227] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:26:28.270 qpair failed and we were unable to recover it. 00:26:28.270 [2024-04-16 23:04:19.238062] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:26:28.270 [2024-04-16 23:04:19.238193] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:26:28.270 [2024-04-16 23:04:19.238219] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:26:28.270 [2024-04-16 23:04:19.238233] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:26:28.271 [2024-04-16 23:04:19.238245] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x10f39f0 00:26:28.271 [2024-04-16 23:04:19.238272] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:26:28.271 qpair failed and we were unable to recover it. 00:26:28.271 [2024-04-16 23:04:19.248116] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:26:28.271 [2024-04-16 23:04:19.248247] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:26:28.271 [2024-04-16 23:04:19.248273] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:26:28.271 [2024-04-16 23:04:19.248287] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:26:28.271 [2024-04-16 23:04:19.248299] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x10f39f0 00:26:28.271 [2024-04-16 23:04:19.248326] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:26:28.271 qpair failed and we were unable to recover it. 00:26:28.271 [2024-04-16 23:04:19.258106] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:26:28.271 [2024-04-16 23:04:19.258252] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:26:28.271 [2024-04-16 23:04:19.258279] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:26:28.271 [2024-04-16 23:04:19.258297] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:26:28.271 [2024-04-16 23:04:19.258310] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x10f39f0 00:26:28.271 [2024-04-16 23:04:19.258338] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:26:28.271 qpair failed and we were unable to recover it. 00:26:28.271 [2024-04-16 23:04:19.268186] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:26:28.271 [2024-04-16 23:04:19.268301] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:26:28.271 [2024-04-16 23:04:19.268327] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:26:28.271 [2024-04-16 23:04:19.268345] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:26:28.271 [2024-04-16 23:04:19.268358] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x10f39f0 00:26:28.271 [2024-04-16 23:04:19.268385] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:26:28.271 qpair failed and we were unable to recover it. 00:26:28.271 [2024-04-16 23:04:19.278192] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:26:28.271 [2024-04-16 23:04:19.278335] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:26:28.271 [2024-04-16 23:04:19.278361] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:26:28.271 [2024-04-16 23:04:19.278375] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:26:28.271 [2024-04-16 23:04:19.278387] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x10f39f0 00:26:28.271 [2024-04-16 23:04:19.278414] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:26:28.271 qpair failed and we were unable to recover it. 00:26:28.271 [2024-04-16 23:04:19.288163] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:26:28.271 [2024-04-16 23:04:19.288326] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:26:28.271 [2024-04-16 23:04:19.288351] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:26:28.271 [2024-04-16 23:04:19.288365] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:26:28.271 [2024-04-16 23:04:19.288377] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x10f39f0 00:26:28.271 [2024-04-16 23:04:19.288404] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:26:28.271 qpair failed and we were unable to recover it. 00:26:28.271 [2024-04-16 23:04:19.298228] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:26:28.271 [2024-04-16 23:04:19.298346] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:26:28.271 [2024-04-16 23:04:19.298371] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:26:28.271 [2024-04-16 23:04:19.298386] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:26:28.271 [2024-04-16 23:04:19.298398] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x10f39f0 00:26:28.271 [2024-04-16 23:04:19.298425] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:26:28.271 qpair failed and we were unable to recover it. 00:26:28.271 [2024-04-16 23:04:19.308261] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:26:28.271 [2024-04-16 23:04:19.308416] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:26:28.271 [2024-04-16 23:04:19.308441] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:26:28.271 [2024-04-16 23:04:19.308454] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:26:28.271 [2024-04-16 23:04:19.308466] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x10f39f0 00:26:28.271 [2024-04-16 23:04:19.308494] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:26:28.271 qpair failed and we were unable to recover it. 00:26:28.271 [2024-04-16 23:04:19.318260] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:26:28.271 [2024-04-16 23:04:19.318381] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:26:28.271 [2024-04-16 23:04:19.318406] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:26:28.271 [2024-04-16 23:04:19.318420] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:26:28.271 [2024-04-16 23:04:19.318431] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x10f39f0 00:26:28.271 [2024-04-16 23:04:19.318459] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:26:28.271 qpair failed and we were unable to recover it. 00:26:28.271 [2024-04-16 23:04:19.328293] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:26:28.271 [2024-04-16 23:04:19.328411] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:26:28.271 [2024-04-16 23:04:19.328435] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:26:28.271 [2024-04-16 23:04:19.328450] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:26:28.271 [2024-04-16 23:04:19.328461] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x10f39f0 00:26:28.271 [2024-04-16 23:04:19.328488] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:26:28.271 qpair failed and we were unable to recover it. 00:26:28.271 [2024-04-16 23:04:19.338305] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:26:28.271 [2024-04-16 23:04:19.338417] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:26:28.271 [2024-04-16 23:04:19.338442] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:26:28.271 [2024-04-16 23:04:19.338456] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:26:28.271 [2024-04-16 23:04:19.338467] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x10f39f0 00:26:28.271 [2024-04-16 23:04:19.338494] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:26:28.271 qpair failed and we were unable to recover it. 00:26:28.271 [2024-04-16 23:04:19.348392] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:26:28.271 [2024-04-16 23:04:19.348538] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:26:28.271 [2024-04-16 23:04:19.348563] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:26:28.271 [2024-04-16 23:04:19.348577] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:26:28.271 [2024-04-16 23:04:19.348588] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x10f39f0 00:26:28.271 [2024-04-16 23:04:19.348615] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:26:28.271 qpair failed and we were unable to recover it. 00:26:28.271 [2024-04-16 23:04:19.358402] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:26:28.271 [2024-04-16 23:04:19.358558] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:26:28.271 [2024-04-16 23:04:19.358583] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:26:28.271 [2024-04-16 23:04:19.358603] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:26:28.271 [2024-04-16 23:04:19.358616] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x10f39f0 00:26:28.271 [2024-04-16 23:04:19.358643] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:26:28.271 qpair failed and we were unable to recover it. 00:26:28.271 [2024-04-16 23:04:19.368409] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:26:28.271 [2024-04-16 23:04:19.368581] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:26:28.271 [2024-04-16 23:04:19.368607] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:26:28.271 [2024-04-16 23:04:19.368621] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:26:28.271 [2024-04-16 23:04:19.368633] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x10f39f0 00:26:28.271 [2024-04-16 23:04:19.368660] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:26:28.271 qpair failed and we were unable to recover it. 00:26:28.271 [2024-04-16 23:04:19.378426] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:26:28.272 [2024-04-16 23:04:19.378537] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:26:28.272 [2024-04-16 23:04:19.378563] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:26:28.272 [2024-04-16 23:04:19.378577] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:26:28.272 [2024-04-16 23:04:19.378589] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x10f39f0 00:26:28.272 [2024-04-16 23:04:19.378615] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:26:28.272 qpair failed and we were unable to recover it. 00:26:28.272 [2024-04-16 23:04:19.388498] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:26:28.272 [2024-04-16 23:04:19.388626] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:26:28.272 [2024-04-16 23:04:19.388651] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:26:28.272 [2024-04-16 23:04:19.388664] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:26:28.272 [2024-04-16 23:04:19.388676] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x10f39f0 00:26:28.272 [2024-04-16 23:04:19.388703] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:26:28.272 qpair failed and we were unable to recover it. 00:26:28.532 [2024-04-16 23:04:19.398490] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:26:28.532 [2024-04-16 23:04:19.398614] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:26:28.532 [2024-04-16 23:04:19.398640] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:26:28.532 [2024-04-16 23:04:19.398655] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:26:28.532 [2024-04-16 23:04:19.398667] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x10f39f0 00:26:28.532 [2024-04-16 23:04:19.398693] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:26:28.532 qpair failed and we were unable to recover it. 00:26:28.532 [2024-04-16 23:04:19.408511] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:26:28.532 [2024-04-16 23:04:19.408627] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:26:28.532 [2024-04-16 23:04:19.408653] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:26:28.532 [2024-04-16 23:04:19.408667] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:26:28.532 [2024-04-16 23:04:19.408679] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x10f39f0 00:26:28.532 [2024-04-16 23:04:19.408706] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:26:28.532 qpair failed and we were unable to recover it. 00:26:28.532 [2024-04-16 23:04:19.418529] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:26:28.532 [2024-04-16 23:04:19.418645] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:26:28.532 [2024-04-16 23:04:19.418671] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:26:28.532 [2024-04-16 23:04:19.418685] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:26:28.532 [2024-04-16 23:04:19.418697] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x10f39f0 00:26:28.532 [2024-04-16 23:04:19.418724] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:26:28.532 qpair failed and we were unable to recover it. 00:26:28.532 [2024-04-16 23:04:19.428598] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:26:28.532 [2024-04-16 23:04:19.428714] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:26:28.532 [2024-04-16 23:04:19.428739] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:26:28.532 [2024-04-16 23:04:19.428754] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:26:28.532 [2024-04-16 23:04:19.428766] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x10f39f0 00:26:28.532 [2024-04-16 23:04:19.428793] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:26:28.532 qpair failed and we were unable to recover it. 00:26:28.532 [2024-04-16 23:04:19.438673] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:26:28.532 [2024-04-16 23:04:19.438797] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:26:28.532 [2024-04-16 23:04:19.438823] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:26:28.532 [2024-04-16 23:04:19.438837] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:26:28.532 [2024-04-16 23:04:19.438850] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x10f39f0 00:26:28.532 [2024-04-16 23:04:19.438877] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:26:28.532 qpair failed and we were unable to recover it. 00:26:28.532 [2024-04-16 23:04:19.448637] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:26:28.532 [2024-04-16 23:04:19.448750] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:26:28.532 [2024-04-16 23:04:19.448775] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:26:28.532 [2024-04-16 23:04:19.448794] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:26:28.532 [2024-04-16 23:04:19.448808] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x10f39f0 00:26:28.532 [2024-04-16 23:04:19.448834] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:26:28.532 qpair failed and we were unable to recover it. 00:26:28.532 [2024-04-16 23:04:19.458670] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:26:28.532 [2024-04-16 23:04:19.458783] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:26:28.532 [2024-04-16 23:04:19.458808] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:26:28.532 [2024-04-16 23:04:19.458823] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:26:28.532 [2024-04-16 23:04:19.458834] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x10f39f0 00:26:28.532 [2024-04-16 23:04:19.458861] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:26:28.532 qpair failed and we were unable to recover it. 00:26:28.532 [2024-04-16 23:04:19.468749] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:26:28.532 [2024-04-16 23:04:19.468872] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:26:28.532 [2024-04-16 23:04:19.468898] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:26:28.532 [2024-04-16 23:04:19.468912] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:26:28.532 [2024-04-16 23:04:19.468924] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x10f39f0 00:26:28.532 [2024-04-16 23:04:19.468951] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:26:28.532 qpair failed and we were unable to recover it. 00:26:28.532 [2024-04-16 23:04:19.478709] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:26:28.532 [2024-04-16 23:04:19.478872] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:26:28.532 [2024-04-16 23:04:19.478904] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:26:28.532 [2024-04-16 23:04:19.478918] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:26:28.532 [2024-04-16 23:04:19.478930] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x10f39f0 00:26:28.532 [2024-04-16 23:04:19.478957] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:26:28.532 qpair failed and we were unable to recover it. 00:26:28.532 [2024-04-16 23:04:19.488785] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:26:28.532 [2024-04-16 23:04:19.488947] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:26:28.533 [2024-04-16 23:04:19.488972] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:26:28.533 [2024-04-16 23:04:19.488986] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:26:28.533 [2024-04-16 23:04:19.488998] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x10f39f0 00:26:28.533 [2024-04-16 23:04:19.489025] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:26:28.533 qpair failed and we were unable to recover it. 00:26:28.533 [2024-04-16 23:04:19.498803] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:26:28.533 [2024-04-16 23:04:19.498919] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:26:28.533 [2024-04-16 23:04:19.498944] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:26:28.533 [2024-04-16 23:04:19.498958] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:26:28.533 [2024-04-16 23:04:19.498970] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x10f39f0 00:26:28.533 [2024-04-16 23:04:19.498997] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:26:28.533 qpair failed and we were unable to recover it. 00:26:28.533 [2024-04-16 23:04:19.508817] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:26:28.533 [2024-04-16 23:04:19.508940] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:26:28.533 [2024-04-16 23:04:19.508965] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:26:28.533 [2024-04-16 23:04:19.508979] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:26:28.533 [2024-04-16 23:04:19.508990] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x10f39f0 00:26:28.533 [2024-04-16 23:04:19.509017] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:26:28.533 qpair failed and we were unable to recover it. 00:26:28.533 [2024-04-16 23:04:19.518853] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:26:28.533 [2024-04-16 23:04:19.519004] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:26:28.533 [2024-04-16 23:04:19.519030] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:26:28.533 [2024-04-16 23:04:19.519044] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:26:28.533 [2024-04-16 23:04:19.519055] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x10f39f0 00:26:28.533 [2024-04-16 23:04:19.519083] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:26:28.533 qpair failed and we were unable to recover it. 00:26:28.533 [2024-04-16 23:04:19.528861] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:26:28.533 [2024-04-16 23:04:19.528976] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:26:28.533 [2024-04-16 23:04:19.529002] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:26:28.533 [2024-04-16 23:04:19.529016] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:26:28.533 [2024-04-16 23:04:19.529029] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x10f39f0 00:26:28.533 [2024-04-16 23:04:19.529056] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:26:28.533 qpair failed and we were unable to recover it. 00:26:28.533 [2024-04-16 23:04:19.538885] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:26:28.533 [2024-04-16 23:04:19.539034] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:26:28.533 [2024-04-16 23:04:19.539059] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:26:28.533 [2024-04-16 23:04:19.539079] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:26:28.533 [2024-04-16 23:04:19.539093] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x10f39f0 00:26:28.533 [2024-04-16 23:04:19.539121] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:26:28.533 qpair failed and we were unable to recover it. 00:26:28.533 [2024-04-16 23:04:19.548910] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:26:28.533 [2024-04-16 23:04:19.549037] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:26:28.533 [2024-04-16 23:04:19.549062] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:26:28.533 [2024-04-16 23:04:19.549075] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:26:28.533 [2024-04-16 23:04:19.549088] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x10f39f0 00:26:28.533 [2024-04-16 23:04:19.549116] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:26:28.533 qpair failed and we were unable to recover it. 00:26:28.533 [2024-04-16 23:04:19.559018] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:26:28.533 [2024-04-16 23:04:19.559157] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:26:28.533 [2024-04-16 23:04:19.559188] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:26:28.533 [2024-04-16 23:04:19.559203] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:26:28.533 [2024-04-16 23:04:19.559216] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x10f39f0 00:26:28.533 [2024-04-16 23:04:19.559243] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:26:28.533 qpair failed and we were unable to recover it. 00:26:28.533 [2024-04-16 23:04:19.568976] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:26:28.533 [2024-04-16 23:04:19.569099] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:26:28.533 [2024-04-16 23:04:19.569125] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:26:28.533 [2024-04-16 23:04:19.569139] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:26:28.533 [2024-04-16 23:04:19.569152] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x10f39f0 00:26:28.533 [2024-04-16 23:04:19.569188] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:26:28.533 qpair failed and we were unable to recover it. 00:26:28.533 [2024-04-16 23:04:19.579039] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:26:28.533 [2024-04-16 23:04:19.579157] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:26:28.533 [2024-04-16 23:04:19.579190] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:26:28.533 [2024-04-16 23:04:19.579206] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:26:28.533 [2024-04-16 23:04:19.579219] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x10f39f0 00:26:28.533 [2024-04-16 23:04:19.579246] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:26:28.533 qpair failed and we were unable to recover it. 00:26:28.533 [2024-04-16 23:04:19.589075] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:26:28.533 [2024-04-16 23:04:19.589205] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:26:28.533 [2024-04-16 23:04:19.589231] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:26:28.533 [2024-04-16 23:04:19.589245] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:26:28.533 [2024-04-16 23:04:19.589257] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x10f39f0 00:26:28.533 [2024-04-16 23:04:19.589285] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:26:28.533 qpair failed and we were unable to recover it. 00:26:28.533 [2024-04-16 23:04:19.599132] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:26:28.533 [2024-04-16 23:04:19.599271] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:26:28.533 [2024-04-16 23:04:19.599296] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:26:28.533 [2024-04-16 23:04:19.599310] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:26:28.533 [2024-04-16 23:04:19.599323] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x10f39f0 00:26:28.533 [2024-04-16 23:04:19.599351] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:26:28.533 qpair failed and we were unable to recover it. 00:26:28.533 [2024-04-16 23:04:19.609069] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:26:28.533 [2024-04-16 23:04:19.609202] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:26:28.533 [2024-04-16 23:04:19.609227] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:26:28.533 [2024-04-16 23:04:19.609242] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:26:28.533 [2024-04-16 23:04:19.609255] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x10f39f0 00:26:28.533 [2024-04-16 23:04:19.609282] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:26:28.533 qpair failed and we were unable to recover it. 00:26:28.533 [2024-04-16 23:04:19.619202] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:26:28.533 [2024-04-16 23:04:19.619318] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:26:28.533 [2024-04-16 23:04:19.619344] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:26:28.533 [2024-04-16 23:04:19.619358] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:26:28.533 [2024-04-16 23:04:19.619371] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x10f39f0 00:26:28.533 [2024-04-16 23:04:19.619398] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:26:28.533 qpair failed and we were unable to recover it. 00:26:28.534 [2024-04-16 23:04:19.629189] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:26:28.534 [2024-04-16 23:04:19.629337] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:26:28.534 [2024-04-16 23:04:19.629367] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:26:28.534 [2024-04-16 23:04:19.629382] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:26:28.534 [2024-04-16 23:04:19.629395] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x10f39f0 00:26:28.534 [2024-04-16 23:04:19.629423] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:26:28.534 qpair failed and we were unable to recover it. 00:26:28.534 [2024-04-16 23:04:19.639159] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:26:28.534 [2024-04-16 23:04:19.639292] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:26:28.534 [2024-04-16 23:04:19.639318] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:26:28.534 [2024-04-16 23:04:19.639332] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:26:28.534 [2024-04-16 23:04:19.639345] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x10f39f0 00:26:28.534 [2024-04-16 23:04:19.639373] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:26:28.534 qpair failed and we were unable to recover it. 00:26:28.534 [2024-04-16 23:04:19.649209] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:26:28.534 [2024-04-16 23:04:19.649351] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:26:28.534 [2024-04-16 23:04:19.649376] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:26:28.534 [2024-04-16 23:04:19.649390] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:26:28.534 [2024-04-16 23:04:19.649402] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x10f39f0 00:26:28.534 [2024-04-16 23:04:19.649430] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:26:28.534 qpair failed and we were unable to recover it. 00:26:28.795 [2024-04-16 23:04:19.659312] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:26:28.795 [2024-04-16 23:04:19.659437] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:26:28.795 [2024-04-16 23:04:19.659467] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:26:28.795 [2024-04-16 23:04:19.659482] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:26:28.795 [2024-04-16 23:04:19.659494] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x10f39f0 00:26:28.795 [2024-04-16 23:04:19.659522] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:26:28.795 qpair failed and we were unable to recover it. 00:26:28.795 [2024-04-16 23:04:19.669355] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:26:28.795 [2024-04-16 23:04:19.669489] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:26:28.795 [2024-04-16 23:04:19.669514] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:26:28.795 [2024-04-16 23:04:19.669529] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:26:28.795 [2024-04-16 23:04:19.669542] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x10f39f0 00:26:28.795 [2024-04-16 23:04:19.669569] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:26:28.795 qpair failed and we were unable to recover it. 00:26:28.795 [2024-04-16 23:04:19.679277] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:26:28.795 [2024-04-16 23:04:19.679396] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:26:28.795 [2024-04-16 23:04:19.679421] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:26:28.795 [2024-04-16 23:04:19.679435] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:26:28.795 [2024-04-16 23:04:19.679448] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x10f39f0 00:26:28.795 [2024-04-16 23:04:19.679475] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:26:28.795 qpair failed and we were unable to recover it. 00:26:28.795 [2024-04-16 23:04:19.689407] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:26:28.795 [2024-04-16 23:04:19.689545] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:26:28.795 [2024-04-16 23:04:19.689570] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:26:28.795 [2024-04-16 23:04:19.689583] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:26:28.795 [2024-04-16 23:04:19.689595] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x10f39f0 00:26:28.795 [2024-04-16 23:04:19.689622] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:26:28.795 qpair failed and we were unable to recover it. 00:26:28.795 [2024-04-16 23:04:19.699367] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:26:28.795 [2024-04-16 23:04:19.699486] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:26:28.795 [2024-04-16 23:04:19.699512] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:26:28.795 [2024-04-16 23:04:19.699526] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:26:28.795 [2024-04-16 23:04:19.699539] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x10f39f0 00:26:28.795 [2024-04-16 23:04:19.699566] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:26:28.795 qpair failed and we were unable to recover it. 00:26:28.796 [2024-04-16 23:04:19.709471] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:26:28.796 [2024-04-16 23:04:19.709592] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:26:28.796 [2024-04-16 23:04:19.709617] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:26:28.796 [2024-04-16 23:04:19.709632] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:26:28.796 [2024-04-16 23:04:19.709644] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x10f39f0 00:26:28.796 [2024-04-16 23:04:19.709671] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:26:28.796 qpair failed and we were unable to recover it. 00:26:28.796 [2024-04-16 23:04:19.719397] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:26:28.796 [2024-04-16 23:04:19.719515] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:26:28.796 [2024-04-16 23:04:19.719545] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:26:28.796 [2024-04-16 23:04:19.719560] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:26:28.796 [2024-04-16 23:04:19.719573] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x10f39f0 00:26:28.796 [2024-04-16 23:04:19.719601] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:26:28.796 qpair failed and we were unable to recover it. 00:26:28.796 [2024-04-16 23:04:19.729433] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:26:28.796 [2024-04-16 23:04:19.729571] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:26:28.796 [2024-04-16 23:04:19.729597] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:26:28.796 [2024-04-16 23:04:19.729611] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:26:28.796 [2024-04-16 23:04:19.729624] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x10f39f0 00:26:28.796 [2024-04-16 23:04:19.729651] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:26:28.796 qpair failed and we were unable to recover it. 00:26:28.796 [2024-04-16 23:04:19.739468] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:26:28.796 [2024-04-16 23:04:19.739610] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:26:28.796 [2024-04-16 23:04:19.739635] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:26:28.796 [2024-04-16 23:04:19.739650] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:26:28.796 [2024-04-16 23:04:19.739664] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x10f39f0 00:26:28.796 [2024-04-16 23:04:19.739690] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:26:28.796 qpair failed and we were unable to recover it. 00:26:28.796 [2024-04-16 23:04:19.749598] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:26:28.796 [2024-04-16 23:04:19.749744] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:26:28.796 [2024-04-16 23:04:19.749769] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:26:28.796 [2024-04-16 23:04:19.749783] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:26:28.796 [2024-04-16 23:04:19.749796] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x10f39f0 00:26:28.796 [2024-04-16 23:04:19.749822] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:26:28.796 qpair failed and we were unable to recover it. 00:26:28.796 [2024-04-16 23:04:19.759546] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:26:28.796 [2024-04-16 23:04:19.759674] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:26:28.796 [2024-04-16 23:04:19.759699] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:26:28.796 [2024-04-16 23:04:19.759713] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:26:28.796 [2024-04-16 23:04:19.759726] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x10f39f0 00:26:28.796 [2024-04-16 23:04:19.759758] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:26:28.796 qpair failed and we were unable to recover it. 00:26:28.796 [2024-04-16 23:04:19.769680] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:26:28.796 [2024-04-16 23:04:19.769797] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:26:28.796 [2024-04-16 23:04:19.769823] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:26:28.796 [2024-04-16 23:04:19.769837] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:26:28.796 [2024-04-16 23:04:19.769849] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x10f39f0 00:26:28.796 [2024-04-16 23:04:19.769876] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:26:28.796 qpair failed and we were unable to recover it. 00:26:28.796 [2024-04-16 23:04:19.779591] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:26:28.796 [2024-04-16 23:04:19.779720] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:26:28.796 [2024-04-16 23:04:19.779745] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:26:28.796 [2024-04-16 23:04:19.779759] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:26:28.796 [2024-04-16 23:04:19.779772] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x10f39f0 00:26:28.796 [2024-04-16 23:04:19.779799] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:26:28.796 qpair failed and we were unable to recover it. 00:26:28.796 [2024-04-16 23:04:19.789740] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:26:28.796 [2024-04-16 23:04:19.789871] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:26:28.796 [2024-04-16 23:04:19.789896] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:26:28.796 [2024-04-16 23:04:19.789910] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:26:28.796 [2024-04-16 23:04:19.789923] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x10f39f0 00:26:28.796 [2024-04-16 23:04:19.789951] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:26:28.796 qpair failed and we were unable to recover it. 00:26:28.796 [2024-04-16 23:04:19.799780] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:26:28.796 [2024-04-16 23:04:19.799926] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:26:28.796 [2024-04-16 23:04:19.799951] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:26:28.796 [2024-04-16 23:04:19.799965] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:26:28.796 [2024-04-16 23:04:19.799978] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x10f39f0 00:26:28.796 [2024-04-16 23:04:19.800005] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:26:28.796 qpair failed and we were unable to recover it. 00:26:28.796 [2024-04-16 23:04:19.809674] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:26:28.796 [2024-04-16 23:04:19.809832] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:26:28.796 [2024-04-16 23:04:19.809862] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:26:28.796 [2024-04-16 23:04:19.809877] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:26:28.796 [2024-04-16 23:04:19.809889] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x10f39f0 00:26:28.796 [2024-04-16 23:04:19.809916] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:26:28.796 qpair failed and we were unable to recover it. 00:26:28.796 [2024-04-16 23:04:19.819740] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:26:28.796 [2024-04-16 23:04:19.819898] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:26:28.796 [2024-04-16 23:04:19.819924] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:26:28.796 [2024-04-16 23:04:19.819938] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:26:28.796 [2024-04-16 23:04:19.819950] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x10f39f0 00:26:28.796 [2024-04-16 23:04:19.819977] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:26:28.796 qpair failed and we were unable to recover it. 00:26:28.796 [2024-04-16 23:04:19.829801] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:26:28.796 [2024-04-16 23:04:19.829930] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:26:28.796 [2024-04-16 23:04:19.829955] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:26:28.796 [2024-04-16 23:04:19.829969] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:26:28.796 [2024-04-16 23:04:19.829982] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x10f39f0 00:26:28.796 [2024-04-16 23:04:19.830009] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:26:28.796 qpair failed and we were unable to recover it. 00:26:28.796 [2024-04-16 23:04:19.839817] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:26:28.796 [2024-04-16 23:04:19.839944] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:26:28.796 [2024-04-16 23:04:19.839969] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:26:28.797 [2024-04-16 23:04:19.839984] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:26:28.797 [2024-04-16 23:04:19.839999] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x10f39f0 00:26:28.797 [2024-04-16 23:04:19.840026] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:26:28.797 qpair failed and we were unable to recover it. 00:26:28.797 [2024-04-16 23:04:19.849818] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:26:28.797 [2024-04-16 23:04:19.849983] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:26:28.797 [2024-04-16 23:04:19.850009] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:26:28.797 [2024-04-16 23:04:19.850023] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:26:28.797 [2024-04-16 23:04:19.850035] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x10f39f0 00:26:28.797 [2024-04-16 23:04:19.850072] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:26:28.797 qpair failed and we were unable to recover it. 00:26:28.797 [2024-04-16 23:04:19.859871] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:26:28.797 [2024-04-16 23:04:19.860000] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:26:28.797 [2024-04-16 23:04:19.860025] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:26:28.797 [2024-04-16 23:04:19.860039] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:26:28.797 [2024-04-16 23:04:19.860052] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x10f39f0 00:26:28.797 [2024-04-16 23:04:19.860079] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:26:28.797 qpair failed and we were unable to recover it. 00:26:28.797 [2024-04-16 23:04:19.869880] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:26:28.797 [2024-04-16 23:04:19.870001] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:26:28.797 [2024-04-16 23:04:19.870026] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:26:28.797 [2024-04-16 23:04:19.870040] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:26:28.797 [2024-04-16 23:04:19.870053] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x10f39f0 00:26:28.797 [2024-04-16 23:04:19.870080] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:26:28.797 qpair failed and we were unable to recover it. 00:26:28.797 [2024-04-16 23:04:19.879914] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:26:28.797 [2024-04-16 23:04:19.880031] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:26:28.797 [2024-04-16 23:04:19.880057] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:26:28.797 [2024-04-16 23:04:19.880070] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:26:28.797 [2024-04-16 23:04:19.880083] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x10f39f0 00:26:28.797 [2024-04-16 23:04:19.880110] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:26:28.797 qpair failed and we were unable to recover it. 00:26:28.797 [2024-04-16 23:04:19.889947] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:26:28.797 [2024-04-16 23:04:19.890064] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:26:28.797 [2024-04-16 23:04:19.890090] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:26:28.797 [2024-04-16 23:04:19.890104] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:26:28.797 [2024-04-16 23:04:19.890116] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x10f39f0 00:26:28.797 [2024-04-16 23:04:19.890144] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:26:28.797 qpair failed and we were unable to recover it. 00:26:28.797 [2024-04-16 23:04:19.900024] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:26:28.797 [2024-04-16 23:04:19.900167] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:26:28.797 [2024-04-16 23:04:19.900204] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:26:28.797 [2024-04-16 23:04:19.900220] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:26:28.797 [2024-04-16 23:04:19.900232] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x10f39f0 00:26:28.797 [2024-04-16 23:04:19.900260] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:26:28.797 qpair failed and we were unable to recover it. 00:26:28.797 [2024-04-16 23:04:19.910061] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:26:28.797 [2024-04-16 23:04:19.910195] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:26:28.797 [2024-04-16 23:04:19.910220] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:26:28.797 [2024-04-16 23:04:19.910234] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:26:28.797 [2024-04-16 23:04:19.910248] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x10f39f0 00:26:28.797 [2024-04-16 23:04:19.910275] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:26:28.797 qpair failed and we were unable to recover it. 00:26:28.797 [2024-04-16 23:04:19.920018] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:26:28.797 [2024-04-16 23:04:19.920143] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:26:28.797 [2024-04-16 23:04:19.920170] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:26:28.797 [2024-04-16 23:04:19.920193] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:26:28.797 [2024-04-16 23:04:19.920207] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x10f39f0 00:26:28.797 [2024-04-16 23:04:19.920235] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:26:28.797 qpair failed and we were unable to recover it. 00:26:29.057 [2024-04-16 23:04:19.930039] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:26:29.057 [2024-04-16 23:04:19.930211] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:26:29.057 [2024-04-16 23:04:19.930238] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:26:29.057 [2024-04-16 23:04:19.930253] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:26:29.057 [2024-04-16 23:04:19.930266] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x10f39f0 00:26:29.057 [2024-04-16 23:04:19.930296] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:26:29.057 qpair failed and we were unable to recover it. 00:26:29.057 [2024-04-16 23:04:19.940067] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:26:29.057 [2024-04-16 23:04:19.940194] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:26:29.057 [2024-04-16 23:04:19.940220] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:26:29.057 [2024-04-16 23:04:19.940234] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:26:29.057 [2024-04-16 23:04:19.940247] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x10f39f0 00:26:29.057 [2024-04-16 23:04:19.940281] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:26:29.057 qpair failed and we were unable to recover it. 00:26:29.057 [2024-04-16 23:04:19.950146] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:26:29.057 [2024-04-16 23:04:19.950277] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:26:29.058 [2024-04-16 23:04:19.950303] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:26:29.058 [2024-04-16 23:04:19.950319] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:26:29.058 [2024-04-16 23:04:19.950332] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x10f39f0 00:26:29.058 [2024-04-16 23:04:19.950359] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:26:29.058 qpair failed and we were unable to recover it. 00:26:29.058 [2024-04-16 23:04:19.960132] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:26:29.058 [2024-04-16 23:04:19.960274] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:26:29.058 [2024-04-16 23:04:19.960299] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:26:29.058 [2024-04-16 23:04:19.960314] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:26:29.058 [2024-04-16 23:04:19.960326] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x10f39f0 00:26:29.058 [2024-04-16 23:04:19.960354] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:26:29.058 qpair failed and we were unable to recover it. 00:26:29.058 [2024-04-16 23:04:19.970143] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:26:29.058 [2024-04-16 23:04:19.970276] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:26:29.058 [2024-04-16 23:04:19.970301] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:26:29.058 [2024-04-16 23:04:19.970315] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:26:29.058 [2024-04-16 23:04:19.970327] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x10f39f0 00:26:29.058 [2024-04-16 23:04:19.970355] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:26:29.058 qpair failed and we were unable to recover it. 00:26:29.058 [2024-04-16 23:04:19.980214] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:26:29.058 [2024-04-16 23:04:19.980330] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:26:29.058 [2024-04-16 23:04:19.980356] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:26:29.058 [2024-04-16 23:04:19.980370] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:26:29.058 [2024-04-16 23:04:19.980382] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x10f39f0 00:26:29.058 [2024-04-16 23:04:19.980409] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:26:29.058 qpair failed and we were unable to recover it. 00:26:29.058 [2024-04-16 23:04:19.990274] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:26:29.058 [2024-04-16 23:04:19.990403] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:26:29.058 [2024-04-16 23:04:19.990432] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:26:29.058 [2024-04-16 23:04:19.990447] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:26:29.058 [2024-04-16 23:04:19.990460] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x10f39f0 00:26:29.058 [2024-04-16 23:04:19.990487] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:26:29.058 qpair failed and we were unable to recover it. 00:26:29.058 [2024-04-16 23:04:20.000291] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:26:29.058 [2024-04-16 23:04:20.000414] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:26:29.058 [2024-04-16 23:04:20.000439] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:26:29.058 [2024-04-16 23:04:20.000453] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:26:29.058 [2024-04-16 23:04:20.000466] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x10f39f0 00:26:29.058 [2024-04-16 23:04:20.000493] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:26:29.058 qpair failed and we were unable to recover it. 00:26:29.058 [2024-04-16 23:04:20.010325] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:26:29.058 [2024-04-16 23:04:20.010451] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:26:29.058 [2024-04-16 23:04:20.010477] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:26:29.058 [2024-04-16 23:04:20.010491] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:26:29.058 [2024-04-16 23:04:20.010504] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x10f39f0 00:26:29.058 [2024-04-16 23:04:20.010532] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:26:29.058 qpair failed and we were unable to recover it. 00:26:29.058 [2024-04-16 23:04:20.020348] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:26:29.058 [2024-04-16 23:04:20.020519] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:26:29.058 [2024-04-16 23:04:20.020545] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:26:29.058 [2024-04-16 23:04:20.020559] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:26:29.058 [2024-04-16 23:04:20.020572] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x10f39f0 00:26:29.058 [2024-04-16 23:04:20.020599] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:26:29.058 qpair failed and we were unable to recover it. 00:26:29.058 [2024-04-16 23:04:20.030411] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:26:29.058 [2024-04-16 23:04:20.030546] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:26:29.058 [2024-04-16 23:04:20.030574] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:26:29.058 [2024-04-16 23:04:20.030588] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:26:29.058 [2024-04-16 23:04:20.030601] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x10f39f0 00:26:29.058 [2024-04-16 23:04:20.030637] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:26:29.058 qpair failed and we were unable to recover it. 00:26:29.058 [2024-04-16 23:04:20.040412] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:26:29.058 [2024-04-16 23:04:20.040577] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:26:29.058 [2024-04-16 23:04:20.040603] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:26:29.058 [2024-04-16 23:04:20.040618] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:26:29.058 [2024-04-16 23:04:20.040632] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x10f39f0 00:26:29.058 [2024-04-16 23:04:20.040660] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:26:29.058 qpair failed and we were unable to recover it. 00:26:29.058 [2024-04-16 23:04:20.050461] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:26:29.058 [2024-04-16 23:04:20.050584] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:26:29.058 [2024-04-16 23:04:20.050609] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:26:29.058 [2024-04-16 23:04:20.050633] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:26:29.058 [2024-04-16 23:04:20.050645] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x10f39f0 00:26:29.058 [2024-04-16 23:04:20.050672] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:26:29.058 qpair failed and we were unable to recover it. 00:26:29.058 [2024-04-16 23:04:20.060540] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:26:29.058 [2024-04-16 23:04:20.060681] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:26:29.058 [2024-04-16 23:04:20.060709] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:26:29.058 [2024-04-16 23:04:20.060724] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:26:29.058 [2024-04-16 23:04:20.060738] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x10f39f0 00:26:29.058 [2024-04-16 23:04:20.060766] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:26:29.058 qpair failed and we were unable to recover it. 00:26:29.058 [2024-04-16 23:04:20.070541] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:26:29.058 [2024-04-16 23:04:20.070662] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:26:29.058 [2024-04-16 23:04:20.070688] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:26:29.058 [2024-04-16 23:04:20.070702] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:26:29.058 [2024-04-16 23:04:20.070715] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x10f39f0 00:26:29.058 [2024-04-16 23:04:20.070744] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:26:29.058 qpair failed and we were unable to recover it. 00:26:29.058 [2024-04-16 23:04:20.080523] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:26:29.058 [2024-04-16 23:04:20.080646] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:26:29.058 [2024-04-16 23:04:20.080680] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:26:29.058 [2024-04-16 23:04:20.080695] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:26:29.058 [2024-04-16 23:04:20.080708] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x10f39f0 00:26:29.058 [2024-04-16 23:04:20.080735] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:26:29.059 qpair failed and we were unable to recover it. 00:26:29.059 [2024-04-16 23:04:20.090535] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:26:29.059 [2024-04-16 23:04:20.090657] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:26:29.059 [2024-04-16 23:04:20.090682] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:26:29.059 [2024-04-16 23:04:20.090697] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:26:29.059 [2024-04-16 23:04:20.090710] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x10f39f0 00:26:29.059 [2024-04-16 23:04:20.090738] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:26:29.059 qpair failed and we were unable to recover it. 00:26:29.059 [2024-04-16 23:04:20.100640] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:26:29.059 [2024-04-16 23:04:20.100763] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:26:29.059 [2024-04-16 23:04:20.100789] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:26:29.059 [2024-04-16 23:04:20.100803] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:26:29.059 [2024-04-16 23:04:20.100816] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x10f39f0 00:26:29.059 [2024-04-16 23:04:20.100844] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:26:29.059 qpair failed and we were unable to recover it. 00:26:29.059 [2024-04-16 23:04:20.110615] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:26:29.059 [2024-04-16 23:04:20.110769] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:26:29.059 [2024-04-16 23:04:20.110795] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:26:29.059 [2024-04-16 23:04:20.110809] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:26:29.059 [2024-04-16 23:04:20.110822] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x10f39f0 00:26:29.059 [2024-04-16 23:04:20.110849] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:26:29.059 qpair failed and we were unable to recover it. 00:26:29.059 [2024-04-16 23:04:20.120633] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:26:29.059 [2024-04-16 23:04:20.120755] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:26:29.059 [2024-04-16 23:04:20.120781] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:26:29.059 [2024-04-16 23:04:20.120795] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:26:29.059 [2024-04-16 23:04:20.120812] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x10f39f0 00:26:29.059 [2024-04-16 23:04:20.120840] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:26:29.059 qpair failed and we were unable to recover it. 00:26:29.059 [2024-04-16 23:04:20.130667] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:26:29.059 [2024-04-16 23:04:20.130790] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:26:29.059 [2024-04-16 23:04:20.130816] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:26:29.059 [2024-04-16 23:04:20.130830] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:26:29.059 [2024-04-16 23:04:20.130843] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x10f39f0 00:26:29.059 [2024-04-16 23:04:20.130871] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:26:29.059 qpair failed and we were unable to recover it. 00:26:29.059 [2024-04-16 23:04:20.140711] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:26:29.059 [2024-04-16 23:04:20.140843] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:26:29.059 [2024-04-16 23:04:20.140870] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:26:29.059 [2024-04-16 23:04:20.140885] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:26:29.059 [2024-04-16 23:04:20.140898] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x10f39f0 00:26:29.059 [2024-04-16 23:04:20.140926] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:26:29.059 qpair failed and we were unable to recover it. 00:26:29.059 [2024-04-16 23:04:20.150755] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:26:29.059 [2024-04-16 23:04:20.150927] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:26:29.059 [2024-04-16 23:04:20.150953] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:26:29.059 [2024-04-16 23:04:20.150967] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:26:29.059 [2024-04-16 23:04:20.150979] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x10f39f0 00:26:29.059 [2024-04-16 23:04:20.151010] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:26:29.059 qpair failed and we were unable to recover it. 00:26:29.059 [2024-04-16 23:04:20.160728] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:26:29.059 [2024-04-16 23:04:20.160854] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:26:29.059 [2024-04-16 23:04:20.160880] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:26:29.059 [2024-04-16 23:04:20.160894] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:26:29.059 [2024-04-16 23:04:20.160907] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x10f39f0 00:26:29.059 [2024-04-16 23:04:20.160935] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:26:29.059 qpair failed and we were unable to recover it. 00:26:29.059 [2024-04-16 23:04:20.161191] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11014b0 is same with the state(5) to be set 00:26:29.059 [2024-04-16 23:04:20.170786] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:26:29.059 [2024-04-16 23:04:20.170907] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:26:29.059 [2024-04-16 23:04:20.170941] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:26:29.059 [2024-04-16 23:04:20.170957] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:26:29.059 [2024-04-16 23:04:20.170971] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f3ea0000b90 00:26:29.059 [2024-04-16 23:04:20.171002] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:26:29.059 qpair failed and we were unable to recover it. 00:26:29.059 [2024-04-16 23:04:20.180814] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:26:29.059 [2024-04-16 23:04:20.180938] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:26:29.059 [2024-04-16 23:04:20.180967] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:26:29.059 [2024-04-16 23:04:20.180982] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:26:29.059 [2024-04-16 23:04:20.180996] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f3ea0000b90 00:26:29.059 [2024-04-16 23:04:20.181027] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:26:29.059 qpair failed and we were unable to recover it. 00:26:29.320 [2024-04-16 23:04:20.190853] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:26:29.320 [2024-04-16 23:04:20.190984] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:26:29.320 [2024-04-16 23:04:20.191016] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:26:29.320 [2024-04-16 23:04:20.191032] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:26:29.320 [2024-04-16 23:04:20.191046] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f3eb0000b90 00:26:29.320 [2024-04-16 23:04:20.191079] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:26:29.320 qpair failed and we were unable to recover it. 00:26:29.320 [2024-04-16 23:04:20.200843] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:26:29.320 [2024-04-16 23:04:20.200971] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:26:29.320 [2024-04-16 23:04:20.200998] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:26:29.320 [2024-04-16 23:04:20.201013] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:26:29.320 [2024-04-16 23:04:20.201026] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f3eb0000b90 00:26:29.320 [2024-04-16 23:04:20.201058] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:26:29.320 qpair failed and we were unable to recover it. 00:26:29.320 [2024-04-16 23:04:20.210931] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:26:29.320 [2024-04-16 23:04:20.211065] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:26:29.320 [2024-04-16 23:04:20.211097] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:26:29.320 [2024-04-16 23:04:20.211119] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:26:29.320 [2024-04-16 23:04:20.211134] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f3ea8000b90 00:26:29.320 [2024-04-16 23:04:20.211166] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:26:29.320 qpair failed and we were unable to recover it. 00:26:29.320 [2024-04-16 23:04:20.220927] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:26:29.320 [2024-04-16 23:04:20.221040] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:26:29.320 [2024-04-16 23:04:20.221067] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:26:29.320 [2024-04-16 23:04:20.221082] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:26:29.320 [2024-04-16 23:04:20.221095] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f3ea8000b90 00:26:29.320 [2024-04-16 23:04:20.221127] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:26:29.320 qpair failed and we were unable to recover it. 00:26:29.320 [2024-04-16 23:04:20.221409] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x11014b0 (9): Bad file descriptor 00:26:29.320 Initializing NVMe Controllers 00:26:29.320 Attaching to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:26:29.320 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:26:29.320 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) with lcore 0 00:26:29.320 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) with lcore 1 00:26:29.320 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) with lcore 2 00:26:29.320 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) with lcore 3 00:26:29.320 Initialization complete. Launching workers. 00:26:29.320 Starting thread on core 1 00:26:29.320 Starting thread on core 2 00:26:29.320 Starting thread on core 3 00:26:29.320 Starting thread on core 0 00:26:29.320 23:04:20 -- host/target_disconnect.sh@59 -- # sync 00:26:29.320 00:26:29.320 real 0m11.393s 00:26:29.320 user 0m20.677s 00:26:29.320 sys 0m5.620s 00:26:29.320 23:04:20 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:26:29.320 23:04:20 -- common/autotest_common.sh@10 -- # set +x 00:26:29.320 ************************************ 00:26:29.320 END TEST nvmf_target_disconnect_tc2 00:26:29.320 ************************************ 00:26:29.320 23:04:20 -- host/target_disconnect.sh@80 -- # '[' -n '' ']' 00:26:29.320 23:04:20 -- host/target_disconnect.sh@84 -- # trap - SIGINT SIGTERM EXIT 00:26:29.320 23:04:20 -- host/target_disconnect.sh@85 -- # nvmftestfini 00:26:29.320 23:04:20 -- nvmf/common.sh@476 -- # nvmfcleanup 00:26:29.320 23:04:20 -- nvmf/common.sh@116 -- # sync 00:26:29.320 23:04:20 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:26:29.320 23:04:20 -- nvmf/common.sh@119 -- # set +e 00:26:29.320 23:04:20 -- nvmf/common.sh@120 -- # for i in {1..20} 00:26:29.320 23:04:20 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:26:29.320 rmmod nvme_tcp 00:26:29.320 rmmod nvme_fabrics 00:26:29.320 rmmod nvme_keyring 00:26:29.320 23:04:20 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:26:29.320 23:04:20 -- nvmf/common.sh@123 -- # set -e 00:26:29.320 23:04:20 -- nvmf/common.sh@124 -- # return 0 00:26:29.321 23:04:20 -- nvmf/common.sh@477 -- # '[' -n 392433 ']' 00:26:29.321 23:04:20 -- nvmf/common.sh@478 -- # killprocess 392433 00:26:29.321 23:04:20 -- common/autotest_common.sh@926 -- # '[' -z 392433 ']' 00:26:29.321 23:04:20 -- common/autotest_common.sh@930 -- # kill -0 392433 00:26:29.321 23:04:20 -- common/autotest_common.sh@931 -- # uname 00:26:29.321 23:04:20 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:26:29.321 23:04:20 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 392433 00:26:29.321 23:04:20 -- common/autotest_common.sh@932 -- # process_name=reactor_4 00:26:29.321 23:04:20 -- common/autotest_common.sh@936 -- # '[' reactor_4 = sudo ']' 00:26:29.321 23:04:20 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 392433' 00:26:29.321 killing process with pid 392433 00:26:29.321 23:04:20 -- common/autotest_common.sh@945 -- # kill 392433 00:26:29.321 23:04:20 -- common/autotest_common.sh@950 -- # wait 392433 00:26:29.579 23:04:20 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:26:29.579 23:04:20 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:26:29.579 23:04:20 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:26:29.579 23:04:20 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:26:29.579 23:04:20 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:26:29.579 23:04:20 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:26:29.579 23:04:20 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:26:29.579 23:04:20 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:26:32.112 23:04:22 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:26:32.112 00:26:32.112 real 0m16.015s 00:26:32.112 user 0m46.592s 00:26:32.112 sys 0m7.425s 00:26:32.112 23:04:22 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:26:32.112 23:04:22 -- common/autotest_common.sh@10 -- # set +x 00:26:32.112 ************************************ 00:26:32.112 END TEST nvmf_target_disconnect 00:26:32.112 ************************************ 00:26:32.112 23:04:22 -- nvmf/nvmf.sh@126 -- # timing_exit host 00:26:32.112 23:04:22 -- common/autotest_common.sh@718 -- # xtrace_disable 00:26:32.112 23:04:22 -- common/autotest_common.sh@10 -- # set +x 00:26:32.112 23:04:22 -- nvmf/nvmf.sh@128 -- # trap - SIGINT SIGTERM EXIT 00:26:32.112 00:26:32.112 real 20m36.331s 00:26:32.112 user 58m30.671s 00:26:32.112 sys 4m49.627s 00:26:32.112 23:04:22 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:26:32.112 23:04:22 -- common/autotest_common.sh@10 -- # set +x 00:26:32.112 ************************************ 00:26:32.112 END TEST nvmf_tcp 00:26:32.112 ************************************ 00:26:32.112 23:04:22 -- spdk/autotest.sh@296 -- # [[ 0 -eq 0 ]] 00:26:32.112 23:04:22 -- spdk/autotest.sh@297 -- # run_test spdkcli_nvmf_tcp /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/spdkcli/nvmf.sh --transport=tcp 00:26:32.112 23:04:22 -- common/autotest_common.sh@1077 -- # '[' 3 -le 1 ']' 00:26:32.112 23:04:22 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:26:32.112 23:04:22 -- common/autotest_common.sh@10 -- # set +x 00:26:32.112 ************************************ 00:26:32.112 START TEST spdkcli_nvmf_tcp 00:26:32.112 ************************************ 00:26:32.112 23:04:22 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/spdkcli/nvmf.sh --transport=tcp 00:26:32.112 * Looking for test storage... 00:26:32.113 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/spdkcli 00:26:32.113 23:04:22 -- spdkcli/nvmf.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/spdkcli/common.sh 00:26:32.113 23:04:22 -- spdkcli/common.sh@6 -- # spdkcli_job=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/spdkcli/spdkcli_job.py 00:26:32.113 23:04:22 -- spdkcli/common.sh@7 -- # spdk_clear_config_py=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/clear_config.py 00:26:32.113 23:04:22 -- spdkcli/nvmf.sh@10 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:26:32.113 23:04:22 -- nvmf/common.sh@7 -- # uname -s 00:26:32.113 23:04:22 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:26:32.113 23:04:22 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:26:32.113 23:04:22 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:26:32.113 23:04:22 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:26:32.113 23:04:22 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:26:32.113 23:04:22 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:26:32.113 23:04:22 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:26:32.113 23:04:22 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:26:32.113 23:04:22 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:26:32.113 23:04:22 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:26:32.113 23:04:22 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:26:32.113 23:04:22 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:26:32.113 23:04:22 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:26:32.113 23:04:22 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:26:32.113 23:04:22 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:26:32.113 23:04:22 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:26:32.113 23:04:22 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:26:32.113 23:04:22 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:26:32.113 23:04:22 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:26:32.113 23:04:22 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:26:32.113 23:04:22 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:26:32.113 23:04:22 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:26:32.113 23:04:22 -- paths/export.sh@5 -- # export PATH 00:26:32.113 23:04:22 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:26:32.113 23:04:22 -- nvmf/common.sh@46 -- # : 0 00:26:32.113 23:04:22 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:26:32.113 23:04:22 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:26:32.113 23:04:22 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:26:32.113 23:04:22 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:26:32.113 23:04:22 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:26:32.113 23:04:22 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:26:32.113 23:04:22 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:26:32.113 23:04:22 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:26:32.113 23:04:22 -- spdkcli/nvmf.sh@12 -- # MATCH_FILE=spdkcli_nvmf.test 00:26:32.113 23:04:22 -- spdkcli/nvmf.sh@13 -- # SPDKCLI_BRANCH=/nvmf 00:26:32.113 23:04:22 -- spdkcli/nvmf.sh@15 -- # trap cleanup EXIT 00:26:32.113 23:04:22 -- spdkcli/nvmf.sh@17 -- # timing_enter run_nvmf_tgt 00:26:32.113 23:04:22 -- common/autotest_common.sh@712 -- # xtrace_disable 00:26:32.113 23:04:22 -- common/autotest_common.sh@10 -- # set +x 00:26:32.113 23:04:22 -- spdkcli/nvmf.sh@18 -- # run_nvmf_tgt 00:26:32.113 23:04:22 -- spdkcli/common.sh@33 -- # nvmf_tgt_pid=393656 00:26:32.113 23:04:22 -- spdkcli/common.sh@32 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -m 0x3 -p 0 00:26:32.113 23:04:22 -- spdkcli/common.sh@34 -- # waitforlisten 393656 00:26:32.113 23:04:22 -- common/autotest_common.sh@819 -- # '[' -z 393656 ']' 00:26:32.113 23:04:22 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk.sock 00:26:32.113 23:04:22 -- common/autotest_common.sh@824 -- # local max_retries=100 00:26:32.113 23:04:22 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:26:32.113 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:26:32.113 23:04:22 -- common/autotest_common.sh@828 -- # xtrace_disable 00:26:32.113 23:04:22 -- common/autotest_common.sh@10 -- # set +x 00:26:32.113 [2024-04-16 23:04:22.839755] Starting SPDK v24.01.1-pre git sha1 4b134b4ab / DPDK 23.11.0 initialization... 00:26:32.113 [2024-04-16 23:04:22.839849] [ DPDK EAL parameters: nvmf --no-shconf -c 0x3 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid393656 ] 00:26:32.113 EAL: No free 2048 kB hugepages reported on node 1 00:26:32.113 [2024-04-16 23:04:22.896966] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 2 00:26:32.113 [2024-04-16 23:04:23.001244] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:26:32.113 [2024-04-16 23:04:23.001444] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:26:32.113 [2024-04-16 23:04:23.001449] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:26:32.680 23:04:23 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:26:32.680 23:04:23 -- common/autotest_common.sh@852 -- # return 0 00:26:32.680 23:04:23 -- spdkcli/nvmf.sh@19 -- # timing_exit run_nvmf_tgt 00:26:32.680 23:04:23 -- common/autotest_common.sh@718 -- # xtrace_disable 00:26:32.680 23:04:23 -- common/autotest_common.sh@10 -- # set +x 00:26:32.680 23:04:23 -- spdkcli/nvmf.sh@21 -- # NVMF_TARGET_IP=127.0.0.1 00:26:32.680 23:04:23 -- spdkcli/nvmf.sh@22 -- # [[ tcp == \r\d\m\a ]] 00:26:32.680 23:04:23 -- spdkcli/nvmf.sh@27 -- # timing_enter spdkcli_create_nvmf_config 00:26:32.680 23:04:23 -- common/autotest_common.sh@712 -- # xtrace_disable 00:26:32.680 23:04:23 -- common/autotest_common.sh@10 -- # set +x 00:26:32.680 23:04:23 -- spdkcli/nvmf.sh@65 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/spdkcli/spdkcli_job.py ''\''/bdevs/malloc create 32 512 Malloc1'\'' '\''Malloc1'\'' True 00:26:32.680 '\''/bdevs/malloc create 32 512 Malloc2'\'' '\''Malloc2'\'' True 00:26:32.680 '\''/bdevs/malloc create 32 512 Malloc3'\'' '\''Malloc3'\'' True 00:26:32.680 '\''/bdevs/malloc create 32 512 Malloc4'\'' '\''Malloc4'\'' True 00:26:32.680 '\''/bdevs/malloc create 32 512 Malloc5'\'' '\''Malloc5'\'' True 00:26:32.680 '\''/bdevs/malloc create 32 512 Malloc6'\'' '\''Malloc6'\'' True 00:26:32.680 '\''nvmf/transport create tcp max_io_qpairs_per_ctrlr=4 io_unit_size=8192'\'' '\'''\'' True 00:26:32.680 '\''/nvmf/subsystem create nqn.2014-08.org.spdk:cnode1 N37SXV509SRW max_namespaces=4 allow_any_host=True'\'' '\''nqn.2014-08.org.spdk:cnode1'\'' True 00:26:32.680 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/namespaces create Malloc3 1'\'' '\''Malloc3'\'' True 00:26:32.680 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/namespaces create Malloc4 2'\'' '\''Malloc4'\'' True 00:26:32.681 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/listen_addresses create tcp 127.0.0.1 4260 IPv4'\'' '\''127.0.0.1:4260'\'' True 00:26:32.681 '\''/nvmf/subsystem create nqn.2014-08.org.spdk:cnode2 N37SXV509SRD max_namespaces=2 allow_any_host=True'\'' '\''nqn.2014-08.org.spdk:cnode2'\'' True 00:26:32.681 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode2/namespaces create Malloc2'\'' '\''Malloc2'\'' True 00:26:32.681 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode2/listen_addresses create tcp 127.0.0.1 4260 IPv4'\'' '\''127.0.0.1:4260'\'' True 00:26:32.681 '\''/nvmf/subsystem create nqn.2014-08.org.spdk:cnode3 N37SXV509SRR max_namespaces=2 allow_any_host=True'\'' '\''nqn.2014-08.org.spdk:cnode2'\'' True 00:26:32.681 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode3/namespaces create Malloc1'\'' '\''Malloc1'\'' True 00:26:32.681 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode3/listen_addresses create tcp 127.0.0.1 4260 IPv4'\'' '\''127.0.0.1:4260'\'' True 00:26:32.681 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode3/listen_addresses create tcp 127.0.0.1 4261 IPv4'\'' '\''127.0.0.1:4261'\'' True 00:26:32.681 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode3/hosts create nqn.2014-08.org.spdk:cnode1'\'' '\''nqn.2014-08.org.spdk:cnode1'\'' True 00:26:32.681 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode3/hosts create nqn.2014-08.org.spdk:cnode2'\'' '\''nqn.2014-08.org.spdk:cnode2'\'' True 00:26:32.681 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1 allow_any_host True'\'' '\''Allow any host'\'' 00:26:32.681 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1 allow_any_host False'\'' '\''Allow any host'\'' True 00:26:32.681 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/listen_addresses create tcp 127.0.0.1 4261 IPv4'\'' '\''127.0.0.1:4261'\'' True 00:26:32.681 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/listen_addresses create tcp 127.0.0.1 4262 IPv4'\'' '\''127.0.0.1:4262'\'' True 00:26:32.681 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/hosts create nqn.2014-08.org.spdk:cnode2'\'' '\''nqn.2014-08.org.spdk:cnode2'\'' True 00:26:32.681 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/namespaces create Malloc5'\'' '\''Malloc5'\'' True 00:26:32.681 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/namespaces create Malloc6'\'' '\''Malloc6'\'' True 00:26:32.681 '\''/nvmf/referral create tcp 127.0.0.2 4030 IPv4'\'' 00:26:32.681 ' 00:26:33.251 [2024-04-16 23:04:24.175218] nvmf_rpc.c: 275:rpc_nvmf_get_subsystems: *WARNING*: rpc_nvmf_get_subsystems: deprecated feature listener.transport is deprecated in favor of trtype to be removed in v24.05 00:26:35.781 [2024-04-16 23:04:26.347295] tcp.c: 659:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:26:36.719 [2024-04-16 23:04:27.587841] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 127.0.0.1 port 4260 *** 00:26:39.254 [2024-04-16 23:04:29.871272] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 127.0.0.1 port 4261 *** 00:26:41.187 [2024-04-16 23:04:31.813556] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 127.0.0.1 port 4262 *** 00:26:42.577 Executing command: ['/bdevs/malloc create 32 512 Malloc1', 'Malloc1', True] 00:26:42.577 Executing command: ['/bdevs/malloc create 32 512 Malloc2', 'Malloc2', True] 00:26:42.577 Executing command: ['/bdevs/malloc create 32 512 Malloc3', 'Malloc3', True] 00:26:42.577 Executing command: ['/bdevs/malloc create 32 512 Malloc4', 'Malloc4', True] 00:26:42.577 Executing command: ['/bdevs/malloc create 32 512 Malloc5', 'Malloc5', True] 00:26:42.577 Executing command: ['/bdevs/malloc create 32 512 Malloc6', 'Malloc6', True] 00:26:42.577 Executing command: ['nvmf/transport create tcp max_io_qpairs_per_ctrlr=4 io_unit_size=8192', '', True] 00:26:42.577 Executing command: ['/nvmf/subsystem create nqn.2014-08.org.spdk:cnode1 N37SXV509SRW max_namespaces=4 allow_any_host=True', 'nqn.2014-08.org.spdk:cnode1', True] 00:26:42.577 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/namespaces create Malloc3 1', 'Malloc3', True] 00:26:42.577 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/namespaces create Malloc4 2', 'Malloc4', True] 00:26:42.577 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/listen_addresses create tcp 127.0.0.1 4260 IPv4', '127.0.0.1:4260', True] 00:26:42.577 Executing command: ['/nvmf/subsystem create nqn.2014-08.org.spdk:cnode2 N37SXV509SRD max_namespaces=2 allow_any_host=True', 'nqn.2014-08.org.spdk:cnode2', True] 00:26:42.577 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode2/namespaces create Malloc2', 'Malloc2', True] 00:26:42.577 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode2/listen_addresses create tcp 127.0.0.1 4260 IPv4', '127.0.0.1:4260', True] 00:26:42.577 Executing command: ['/nvmf/subsystem create nqn.2014-08.org.spdk:cnode3 N37SXV509SRR max_namespaces=2 allow_any_host=True', 'nqn.2014-08.org.spdk:cnode2', True] 00:26:42.577 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode3/namespaces create Malloc1', 'Malloc1', True] 00:26:42.577 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode3/listen_addresses create tcp 127.0.0.1 4260 IPv4', '127.0.0.1:4260', True] 00:26:42.577 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode3/listen_addresses create tcp 127.0.0.1 4261 IPv4', '127.0.0.1:4261', True] 00:26:42.577 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode3/hosts create nqn.2014-08.org.spdk:cnode1', 'nqn.2014-08.org.spdk:cnode1', True] 00:26:42.577 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode3/hosts create nqn.2014-08.org.spdk:cnode2', 'nqn.2014-08.org.spdk:cnode2', True] 00:26:42.577 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1 allow_any_host True', 'Allow any host', False] 00:26:42.577 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1 allow_any_host False', 'Allow any host', True] 00:26:42.577 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/listen_addresses create tcp 127.0.0.1 4261 IPv4', '127.0.0.1:4261', True] 00:26:42.577 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/listen_addresses create tcp 127.0.0.1 4262 IPv4', '127.0.0.1:4262', True] 00:26:42.577 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/hosts create nqn.2014-08.org.spdk:cnode2', 'nqn.2014-08.org.spdk:cnode2', True] 00:26:42.577 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/namespaces create Malloc5', 'Malloc5', True] 00:26:42.577 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/namespaces create Malloc6', 'Malloc6', True] 00:26:42.577 Executing command: ['/nvmf/referral create tcp 127.0.0.2 4030 IPv4', False] 00:26:42.577 23:04:33 -- spdkcli/nvmf.sh@66 -- # timing_exit spdkcli_create_nvmf_config 00:26:42.577 23:04:33 -- common/autotest_common.sh@718 -- # xtrace_disable 00:26:42.577 23:04:33 -- common/autotest_common.sh@10 -- # set +x 00:26:42.577 23:04:33 -- spdkcli/nvmf.sh@68 -- # timing_enter spdkcli_check_match 00:26:42.577 23:04:33 -- common/autotest_common.sh@712 -- # xtrace_disable 00:26:42.577 23:04:33 -- common/autotest_common.sh@10 -- # set +x 00:26:42.577 23:04:33 -- spdkcli/nvmf.sh@69 -- # check_match 00:26:42.577 23:04:33 -- spdkcli/common.sh@44 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/spdkcli.py ll /nvmf 00:26:42.834 23:04:33 -- spdkcli/common.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/app/match/match /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/spdkcli/match_files/spdkcli_nvmf.test.match 00:26:42.834 23:04:33 -- spdkcli/common.sh@46 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/spdkcli/match_files/spdkcli_nvmf.test 00:26:42.834 23:04:33 -- spdkcli/nvmf.sh@70 -- # timing_exit spdkcli_check_match 00:26:42.834 23:04:33 -- common/autotest_common.sh@718 -- # xtrace_disable 00:26:42.834 23:04:33 -- common/autotest_common.sh@10 -- # set +x 00:26:42.834 23:04:33 -- spdkcli/nvmf.sh@72 -- # timing_enter spdkcli_clear_nvmf_config 00:26:42.834 23:04:33 -- common/autotest_common.sh@712 -- # xtrace_disable 00:26:42.834 23:04:33 -- common/autotest_common.sh@10 -- # set +x 00:26:42.834 23:04:33 -- spdkcli/nvmf.sh@87 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/spdkcli/spdkcli_job.py ''\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/namespaces delete nsid=1'\'' '\''Malloc3'\'' 00:26:42.834 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/namespaces delete_all'\'' '\''Malloc4'\'' 00:26:42.834 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/hosts delete nqn.2014-08.org.spdk:cnode2'\'' '\''nqn.2014-08.org.spdk:cnode2'\'' 00:26:42.834 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode3/hosts delete_all'\'' '\''nqn.2014-08.org.spdk:cnode1'\'' 00:26:42.834 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/listen_addresses delete tcp 127.0.0.1 4262'\'' '\''127.0.0.1:4262'\'' 00:26:42.834 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/listen_addresses delete_all'\'' '\''127.0.0.1:4261'\'' 00:26:42.834 '\''/nvmf/subsystem delete nqn.2014-08.org.spdk:cnode3'\'' '\''nqn.2014-08.org.spdk:cnode3'\'' 00:26:42.834 '\''/nvmf/subsystem delete_all'\'' '\''nqn.2014-08.org.spdk:cnode2'\'' 00:26:42.834 '\''/bdevs/malloc delete Malloc6'\'' '\''Malloc6'\'' 00:26:42.834 '\''/bdevs/malloc delete Malloc5'\'' '\''Malloc5'\'' 00:26:42.834 '\''/bdevs/malloc delete Malloc4'\'' '\''Malloc4'\'' 00:26:42.834 '\''/bdevs/malloc delete Malloc3'\'' '\''Malloc3'\'' 00:26:42.834 '\''/bdevs/malloc delete Malloc2'\'' '\''Malloc2'\'' 00:26:42.834 '\''/bdevs/malloc delete Malloc1'\'' '\''Malloc1'\'' 00:26:42.834 ' 00:26:48.104 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/namespaces delete nsid=1', 'Malloc3', False] 00:26:48.104 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/namespaces delete_all', 'Malloc4', False] 00:26:48.104 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/hosts delete nqn.2014-08.org.spdk:cnode2', 'nqn.2014-08.org.spdk:cnode2', False] 00:26:48.104 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode3/hosts delete_all', 'nqn.2014-08.org.spdk:cnode1', False] 00:26:48.104 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/listen_addresses delete tcp 127.0.0.1 4262', '127.0.0.1:4262', False] 00:26:48.104 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/listen_addresses delete_all', '127.0.0.1:4261', False] 00:26:48.104 Executing command: ['/nvmf/subsystem delete nqn.2014-08.org.spdk:cnode3', 'nqn.2014-08.org.spdk:cnode3', False] 00:26:48.104 Executing command: ['/nvmf/subsystem delete_all', 'nqn.2014-08.org.spdk:cnode2', False] 00:26:48.104 Executing command: ['/bdevs/malloc delete Malloc6', 'Malloc6', False] 00:26:48.104 Executing command: ['/bdevs/malloc delete Malloc5', 'Malloc5', False] 00:26:48.104 Executing command: ['/bdevs/malloc delete Malloc4', 'Malloc4', False] 00:26:48.104 Executing command: ['/bdevs/malloc delete Malloc3', 'Malloc3', False] 00:26:48.104 Executing command: ['/bdevs/malloc delete Malloc2', 'Malloc2', False] 00:26:48.104 Executing command: ['/bdevs/malloc delete Malloc1', 'Malloc1', False] 00:26:48.104 23:04:39 -- spdkcli/nvmf.sh@88 -- # timing_exit spdkcli_clear_nvmf_config 00:26:48.104 23:04:39 -- common/autotest_common.sh@718 -- # xtrace_disable 00:26:48.104 23:04:39 -- common/autotest_common.sh@10 -- # set +x 00:26:48.104 23:04:39 -- spdkcli/nvmf.sh@90 -- # killprocess 393656 00:26:48.104 23:04:39 -- common/autotest_common.sh@926 -- # '[' -z 393656 ']' 00:26:48.104 23:04:39 -- common/autotest_common.sh@930 -- # kill -0 393656 00:26:48.104 23:04:39 -- common/autotest_common.sh@931 -- # uname 00:26:48.104 23:04:39 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:26:48.104 23:04:39 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 393656 00:26:48.104 23:04:39 -- common/autotest_common.sh@932 -- # process_name=reactor_0 00:26:48.104 23:04:39 -- common/autotest_common.sh@936 -- # '[' reactor_0 = sudo ']' 00:26:48.104 23:04:39 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 393656' 00:26:48.104 killing process with pid 393656 00:26:48.104 23:04:39 -- common/autotest_common.sh@945 -- # kill 393656 00:26:48.104 [2024-04-16 23:04:39.171673] app.c: 883:log_deprecation_hits: *WARNING*: rpc_nvmf_get_subsystems: deprecation 'listener.transport is deprecated in favor of trtype' scheduled for removal in v24.05 hit 1 times 00:26:48.104 23:04:39 -- common/autotest_common.sh@950 -- # wait 393656 00:26:48.363 23:04:39 -- spdkcli/nvmf.sh@1 -- # cleanup 00:26:48.363 23:04:39 -- spdkcli/common.sh@10 -- # '[' -n '' ']' 00:26:48.363 23:04:39 -- spdkcli/common.sh@13 -- # '[' -n 393656 ']' 00:26:48.363 23:04:39 -- spdkcli/common.sh@14 -- # killprocess 393656 00:26:48.363 23:04:39 -- common/autotest_common.sh@926 -- # '[' -z 393656 ']' 00:26:48.363 23:04:39 -- common/autotest_common.sh@930 -- # kill -0 393656 00:26:48.363 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/autotest_common.sh: line 930: kill: (393656) - No such process 00:26:48.363 23:04:39 -- common/autotest_common.sh@953 -- # echo 'Process with pid 393656 is not found' 00:26:48.363 Process with pid 393656 is not found 00:26:48.363 23:04:39 -- spdkcli/common.sh@16 -- # '[' -n '' ']' 00:26:48.363 23:04:39 -- spdkcli/common.sh@19 -- # '[' -n '' ']' 00:26:48.363 23:04:39 -- spdkcli/common.sh@22 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/spdkcli/spdkcli_nvmf.test /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/spdkcli/match_files/spdkcli_details_vhost.test /tmp/sample_aio 00:26:48.363 00:26:48.363 real 0m16.685s 00:26:48.363 user 0m35.277s 00:26:48.363 sys 0m0.838s 00:26:48.363 23:04:39 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:26:48.363 23:04:39 -- common/autotest_common.sh@10 -- # set +x 00:26:48.363 ************************************ 00:26:48.363 END TEST spdkcli_nvmf_tcp 00:26:48.363 ************************************ 00:26:48.363 23:04:39 -- spdk/autotest.sh@298 -- # run_test nvmf_identify_passthru /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/identify_passthru.sh --transport=tcp 00:26:48.363 23:04:39 -- common/autotest_common.sh@1077 -- # '[' 3 -le 1 ']' 00:26:48.363 23:04:39 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:26:48.363 23:04:39 -- common/autotest_common.sh@10 -- # set +x 00:26:48.363 ************************************ 00:26:48.363 START TEST nvmf_identify_passthru 00:26:48.363 ************************************ 00:26:48.363 23:04:39 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/identify_passthru.sh --transport=tcp 00:26:48.363 * Looking for test storage... 00:26:48.622 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:26:48.622 23:04:39 -- target/identify_passthru.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:26:48.622 23:04:39 -- nvmf/common.sh@7 -- # uname -s 00:26:48.622 23:04:39 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:26:48.622 23:04:39 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:26:48.622 23:04:39 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:26:48.622 23:04:39 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:26:48.622 23:04:39 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:26:48.622 23:04:39 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:26:48.622 23:04:39 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:26:48.622 23:04:39 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:26:48.622 23:04:39 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:26:48.622 23:04:39 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:26:48.622 23:04:39 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:26:48.622 23:04:39 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:26:48.622 23:04:39 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:26:48.622 23:04:39 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:26:48.622 23:04:39 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:26:48.622 23:04:39 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:26:48.622 23:04:39 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:26:48.622 23:04:39 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:26:48.622 23:04:39 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:26:48.622 23:04:39 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:26:48.622 23:04:39 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:26:48.622 23:04:39 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:26:48.622 23:04:39 -- paths/export.sh@5 -- # export PATH 00:26:48.622 23:04:39 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:26:48.622 23:04:39 -- nvmf/common.sh@46 -- # : 0 00:26:48.622 23:04:39 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:26:48.622 23:04:39 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:26:48.622 23:04:39 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:26:48.622 23:04:39 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:26:48.622 23:04:39 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:26:48.622 23:04:39 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:26:48.622 23:04:39 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:26:48.622 23:04:39 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:26:48.622 23:04:39 -- target/identify_passthru.sh@10 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:26:48.622 23:04:39 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:26:48.622 23:04:39 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:26:48.622 23:04:39 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:26:48.622 23:04:39 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:26:48.622 23:04:39 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:26:48.622 23:04:39 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:26:48.622 23:04:39 -- paths/export.sh@5 -- # export PATH 00:26:48.622 23:04:39 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:26:48.622 23:04:39 -- target/identify_passthru.sh@12 -- # nvmftestinit 00:26:48.622 23:04:39 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:26:48.622 23:04:39 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:26:48.622 23:04:39 -- nvmf/common.sh@436 -- # prepare_net_devs 00:26:48.622 23:04:39 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:26:48.622 23:04:39 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:26:48.622 23:04:39 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:26:48.622 23:04:39 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 13> /dev/null' 00:26:48.622 23:04:39 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:26:48.623 23:04:39 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:26:48.623 23:04:39 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:26:48.623 23:04:39 -- nvmf/common.sh@284 -- # xtrace_disable 00:26:48.623 23:04:39 -- common/autotest_common.sh@10 -- # set +x 00:26:50.523 23:04:41 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:26:50.523 23:04:41 -- nvmf/common.sh@290 -- # pci_devs=() 00:26:50.523 23:04:41 -- nvmf/common.sh@290 -- # local -a pci_devs 00:26:50.524 23:04:41 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:26:50.524 23:04:41 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:26:50.524 23:04:41 -- nvmf/common.sh@292 -- # pci_drivers=() 00:26:50.524 23:04:41 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:26:50.524 23:04:41 -- nvmf/common.sh@294 -- # net_devs=() 00:26:50.524 23:04:41 -- nvmf/common.sh@294 -- # local -ga net_devs 00:26:50.524 23:04:41 -- nvmf/common.sh@295 -- # e810=() 00:26:50.524 23:04:41 -- nvmf/common.sh@295 -- # local -ga e810 00:26:50.524 23:04:41 -- nvmf/common.sh@296 -- # x722=() 00:26:50.524 23:04:41 -- nvmf/common.sh@296 -- # local -ga x722 00:26:50.524 23:04:41 -- nvmf/common.sh@297 -- # mlx=() 00:26:50.524 23:04:41 -- nvmf/common.sh@297 -- # local -ga mlx 00:26:50.524 23:04:41 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:26:50.524 23:04:41 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:26:50.524 23:04:41 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:26:50.524 23:04:41 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:26:50.524 23:04:41 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:26:50.524 23:04:41 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:26:50.524 23:04:41 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:26:50.524 23:04:41 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:26:50.524 23:04:41 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:26:50.524 23:04:41 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:26:50.524 23:04:41 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:26:50.524 23:04:41 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:26:50.524 23:04:41 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:26:50.524 23:04:41 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:26:50.524 23:04:41 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:26:50.524 23:04:41 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:26:50.524 23:04:41 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:26:50.524 23:04:41 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:26:50.524 23:04:41 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:26:50.524 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:26:50.524 23:04:41 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:26:50.524 23:04:41 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:26:50.524 23:04:41 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:26:50.524 23:04:41 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:26:50.524 23:04:41 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:26:50.524 23:04:41 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:26:50.524 23:04:41 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:26:50.524 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:26:50.524 23:04:41 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:26:50.524 23:04:41 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:26:50.524 23:04:41 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:26:50.524 23:04:41 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:26:50.524 23:04:41 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:26:50.524 23:04:41 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:26:50.524 23:04:41 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:26:50.524 23:04:41 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:26:50.524 23:04:41 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:26:50.524 23:04:41 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:26:50.524 23:04:41 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:26:50.524 23:04:41 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:26:50.524 23:04:41 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:26:50.524 Found net devices under 0000:0a:00.0: cvl_0_0 00:26:50.524 23:04:41 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:26:50.524 23:04:41 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:26:50.524 23:04:41 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:26:50.524 23:04:41 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:26:50.524 23:04:41 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:26:50.524 23:04:41 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:26:50.524 Found net devices under 0000:0a:00.1: cvl_0_1 00:26:50.524 23:04:41 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:26:50.524 23:04:41 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:26:50.524 23:04:41 -- nvmf/common.sh@402 -- # is_hw=yes 00:26:50.524 23:04:41 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:26:50.524 23:04:41 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:26:50.524 23:04:41 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:26:50.524 23:04:41 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:26:50.524 23:04:41 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:26:50.524 23:04:41 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:26:50.524 23:04:41 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:26:50.524 23:04:41 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:26:50.524 23:04:41 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:26:50.524 23:04:41 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:26:50.524 23:04:41 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:26:50.524 23:04:41 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:26:50.524 23:04:41 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:26:50.524 23:04:41 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:26:50.524 23:04:41 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:26:50.524 23:04:41 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:26:50.524 23:04:41 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:26:50.524 23:04:41 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:26:50.524 23:04:41 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:26:50.524 23:04:41 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:26:50.524 23:04:41 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:26:50.524 23:04:41 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:26:50.524 23:04:41 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:26:50.524 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:26:50.524 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.230 ms 00:26:50.524 00:26:50.524 --- 10.0.0.2 ping statistics --- 00:26:50.524 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:26:50.524 rtt min/avg/max/mdev = 0.230/0.230/0.230/0.000 ms 00:26:50.524 23:04:41 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:26:50.524 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:26:50.524 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.140 ms 00:26:50.524 00:26:50.524 --- 10.0.0.1 ping statistics --- 00:26:50.524 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:26:50.524 rtt min/avg/max/mdev = 0.140/0.140/0.140/0.000 ms 00:26:50.524 23:04:41 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:26:50.524 23:04:41 -- nvmf/common.sh@410 -- # return 0 00:26:50.524 23:04:41 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:26:50.524 23:04:41 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:26:50.524 23:04:41 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:26:50.524 23:04:41 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:26:50.524 23:04:41 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:26:50.524 23:04:41 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:26:50.524 23:04:41 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:26:50.524 23:04:41 -- target/identify_passthru.sh@14 -- # timing_enter nvme_identify 00:26:50.524 23:04:41 -- common/autotest_common.sh@712 -- # xtrace_disable 00:26:50.524 23:04:41 -- common/autotest_common.sh@10 -- # set +x 00:26:50.524 23:04:41 -- target/identify_passthru.sh@16 -- # get_first_nvme_bdf 00:26:50.524 23:04:41 -- common/autotest_common.sh@1509 -- # bdfs=() 00:26:50.524 23:04:41 -- common/autotest_common.sh@1509 -- # local bdfs 00:26:50.524 23:04:41 -- common/autotest_common.sh@1510 -- # bdfs=($(get_nvme_bdfs)) 00:26:50.524 23:04:41 -- common/autotest_common.sh@1510 -- # get_nvme_bdfs 00:26:50.524 23:04:41 -- common/autotest_common.sh@1498 -- # bdfs=() 00:26:50.524 23:04:41 -- common/autotest_common.sh@1498 -- # local bdfs 00:26:50.524 23:04:41 -- common/autotest_common.sh@1499 -- # bdfs=($("$rootdir/scripts/gen_nvme.sh" | jq -r '.config[].params.traddr')) 00:26:50.524 23:04:41 -- common/autotest_common.sh@1499 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/gen_nvme.sh 00:26:50.524 23:04:41 -- common/autotest_common.sh@1499 -- # jq -r '.config[].params.traddr' 00:26:50.524 23:04:41 -- common/autotest_common.sh@1500 -- # (( 1 == 0 )) 00:26:50.524 23:04:41 -- common/autotest_common.sh@1504 -- # printf '%s\n' 0000:88:00.0 00:26:50.524 23:04:41 -- common/autotest_common.sh@1512 -- # echo 0000:88:00.0 00:26:50.524 23:04:41 -- target/identify_passthru.sh@16 -- # bdf=0000:88:00.0 00:26:50.524 23:04:41 -- target/identify_passthru.sh@17 -- # '[' -z 0000:88:00.0 ']' 00:26:50.524 23:04:41 -- target/identify_passthru.sh@23 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_identify -r 'trtype:PCIe traddr:0000:88:00.0' -i 0 00:26:50.524 23:04:41 -- target/identify_passthru.sh@23 -- # grep 'Serial Number:' 00:26:50.524 23:04:41 -- target/identify_passthru.sh@23 -- # awk '{print $3}' 00:26:50.524 EAL: No free 2048 kB hugepages reported on node 1 00:26:54.709 23:04:45 -- target/identify_passthru.sh@23 -- # nvme_serial_number=PHLJ916004901P0FGN 00:26:54.709 23:04:45 -- target/identify_passthru.sh@24 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_identify -r 'trtype:PCIe traddr:0000:88:00.0' -i 0 00:26:54.709 23:04:45 -- target/identify_passthru.sh@24 -- # grep 'Model Number:' 00:26:54.709 23:04:45 -- target/identify_passthru.sh@24 -- # awk '{print $3}' 00:26:54.967 EAL: No free 2048 kB hugepages reported on node 1 00:26:59.152 23:04:49 -- target/identify_passthru.sh@24 -- # nvme_model_number=INTEL 00:26:59.152 23:04:49 -- target/identify_passthru.sh@26 -- # timing_exit nvme_identify 00:26:59.152 23:04:49 -- common/autotest_common.sh@718 -- # xtrace_disable 00:26:59.152 23:04:49 -- common/autotest_common.sh@10 -- # set +x 00:26:59.152 23:04:50 -- target/identify_passthru.sh@28 -- # timing_enter start_nvmf_tgt 00:26:59.152 23:04:50 -- common/autotest_common.sh@712 -- # xtrace_disable 00:26:59.152 23:04:50 -- common/autotest_common.sh@10 -- # set +x 00:26:59.152 23:04:50 -- target/identify_passthru.sh@31 -- # nvmfpid=398388 00:26:59.152 23:04:50 -- target/identify_passthru.sh@30 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF --wait-for-rpc 00:26:59.152 23:04:50 -- target/identify_passthru.sh@33 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:26:59.152 23:04:50 -- target/identify_passthru.sh@35 -- # waitforlisten 398388 00:26:59.152 23:04:50 -- common/autotest_common.sh@819 -- # '[' -z 398388 ']' 00:26:59.152 23:04:50 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk.sock 00:26:59.152 23:04:50 -- common/autotest_common.sh@824 -- # local max_retries=100 00:26:59.152 23:04:50 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:26:59.152 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:26:59.152 23:04:50 -- common/autotest_common.sh@828 -- # xtrace_disable 00:26:59.152 23:04:50 -- common/autotest_common.sh@10 -- # set +x 00:26:59.152 [2024-04-16 23:04:50.056268] Starting SPDK v24.01.1-pre git sha1 4b134b4ab / DPDK 23.11.0 initialization... 00:26:59.152 [2024-04-16 23:04:50.056359] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:26:59.152 EAL: No free 2048 kB hugepages reported on node 1 00:26:59.152 [2024-04-16 23:04:50.118374] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:26:59.152 [2024-04-16 23:04:50.223523] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:26:59.152 [2024-04-16 23:04:50.223675] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:26:59.152 [2024-04-16 23:04:50.223693] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:26:59.152 [2024-04-16 23:04:50.223705] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:26:59.152 [2024-04-16 23:04:50.223757] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:26:59.152 [2024-04-16 23:04:50.223816] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:26:59.152 [2024-04-16 23:04:50.223866] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:26:59.152 [2024-04-16 23:04:50.223869] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:26:59.152 23:04:50 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:26:59.152 23:04:50 -- common/autotest_common.sh@852 -- # return 0 00:26:59.152 23:04:50 -- target/identify_passthru.sh@36 -- # rpc_cmd -v nvmf_set_config --passthru-identify-ctrlr 00:26:59.152 23:04:50 -- common/autotest_common.sh@551 -- # xtrace_disable 00:26:59.152 23:04:50 -- common/autotest_common.sh@10 -- # set +x 00:26:59.152 INFO: Log level set to 20 00:26:59.152 INFO: Requests: 00:26:59.152 { 00:26:59.152 "jsonrpc": "2.0", 00:26:59.152 "method": "nvmf_set_config", 00:26:59.152 "id": 1, 00:26:59.152 "params": { 00:26:59.152 "admin_cmd_passthru": { 00:26:59.152 "identify_ctrlr": true 00:26:59.152 } 00:26:59.152 } 00:26:59.152 } 00:26:59.152 00:26:59.152 INFO: response: 00:26:59.152 { 00:26:59.152 "jsonrpc": "2.0", 00:26:59.152 "id": 1, 00:26:59.152 "result": true 00:26:59.152 } 00:26:59.152 00:26:59.152 23:04:50 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:26:59.152 23:04:50 -- target/identify_passthru.sh@37 -- # rpc_cmd -v framework_start_init 00:26:59.152 23:04:50 -- common/autotest_common.sh@551 -- # xtrace_disable 00:26:59.152 23:04:50 -- common/autotest_common.sh@10 -- # set +x 00:26:59.152 INFO: Setting log level to 20 00:26:59.152 INFO: Setting log level to 20 00:26:59.152 INFO: Log level set to 20 00:26:59.152 INFO: Log level set to 20 00:26:59.152 INFO: Requests: 00:26:59.152 { 00:26:59.152 "jsonrpc": "2.0", 00:26:59.152 "method": "framework_start_init", 00:26:59.152 "id": 1 00:26:59.152 } 00:26:59.152 00:26:59.152 INFO: Requests: 00:26:59.152 { 00:26:59.152 "jsonrpc": "2.0", 00:26:59.152 "method": "framework_start_init", 00:26:59.152 "id": 1 00:26:59.152 } 00:26:59.152 00:26:59.410 [2024-04-16 23:04:50.377470] nvmf_tgt.c: 423:nvmf_tgt_advance_state: *NOTICE*: Custom identify ctrlr handler enabled 00:26:59.410 INFO: response: 00:26:59.410 { 00:26:59.410 "jsonrpc": "2.0", 00:26:59.410 "id": 1, 00:26:59.410 "result": true 00:26:59.410 } 00:26:59.410 00:26:59.410 INFO: response: 00:26:59.410 { 00:26:59.410 "jsonrpc": "2.0", 00:26:59.410 "id": 1, 00:26:59.410 "result": true 00:26:59.410 } 00:26:59.410 00:26:59.410 23:04:50 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:26:59.410 23:04:50 -- target/identify_passthru.sh@38 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:26:59.410 23:04:50 -- common/autotest_common.sh@551 -- # xtrace_disable 00:26:59.410 23:04:50 -- common/autotest_common.sh@10 -- # set +x 00:26:59.410 INFO: Setting log level to 40 00:26:59.410 INFO: Setting log level to 40 00:26:59.410 INFO: Setting log level to 40 00:26:59.410 [2024-04-16 23:04:50.387560] tcp.c: 659:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:26:59.410 23:04:50 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:26:59.410 23:04:50 -- target/identify_passthru.sh@39 -- # timing_exit start_nvmf_tgt 00:26:59.410 23:04:50 -- common/autotest_common.sh@718 -- # xtrace_disable 00:26:59.410 23:04:50 -- common/autotest_common.sh@10 -- # set +x 00:26:59.410 23:04:50 -- target/identify_passthru.sh@41 -- # rpc_cmd bdev_nvme_attach_controller -b Nvme0 -t PCIe -a 0000:88:00.0 00:26:59.410 23:04:50 -- common/autotest_common.sh@551 -- # xtrace_disable 00:26:59.410 23:04:50 -- common/autotest_common.sh@10 -- # set +x 00:27:02.687 Nvme0n1 00:27:02.688 23:04:53 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:27:02.688 23:04:53 -- target/identify_passthru.sh@42 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 -m 1 00:27:02.688 23:04:53 -- common/autotest_common.sh@551 -- # xtrace_disable 00:27:02.688 23:04:53 -- common/autotest_common.sh@10 -- # set +x 00:27:02.688 23:04:53 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:27:02.688 23:04:53 -- target/identify_passthru.sh@43 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Nvme0n1 00:27:02.688 23:04:53 -- common/autotest_common.sh@551 -- # xtrace_disable 00:27:02.688 23:04:53 -- common/autotest_common.sh@10 -- # set +x 00:27:02.688 23:04:53 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:27:02.688 23:04:53 -- target/identify_passthru.sh@44 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:27:02.688 23:04:53 -- common/autotest_common.sh@551 -- # xtrace_disable 00:27:02.688 23:04:53 -- common/autotest_common.sh@10 -- # set +x 00:27:02.688 [2024-04-16 23:04:53.272644] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:27:02.688 23:04:53 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:27:02.688 23:04:53 -- target/identify_passthru.sh@46 -- # rpc_cmd nvmf_get_subsystems 00:27:02.688 23:04:53 -- common/autotest_common.sh@551 -- # xtrace_disable 00:27:02.688 23:04:53 -- common/autotest_common.sh@10 -- # set +x 00:27:02.688 [2024-04-16 23:04:53.280364] nvmf_rpc.c: 275:rpc_nvmf_get_subsystems: *WARNING*: rpc_nvmf_get_subsystems: deprecated feature listener.transport is deprecated in favor of trtype to be removed in v24.05 00:27:02.688 [ 00:27:02.688 { 00:27:02.688 "nqn": "nqn.2014-08.org.nvmexpress.discovery", 00:27:02.688 "subtype": "Discovery", 00:27:02.688 "listen_addresses": [], 00:27:02.688 "allow_any_host": true, 00:27:02.688 "hosts": [] 00:27:02.688 }, 00:27:02.688 { 00:27:02.688 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:27:02.688 "subtype": "NVMe", 00:27:02.688 "listen_addresses": [ 00:27:02.688 { 00:27:02.688 "transport": "TCP", 00:27:02.688 "trtype": "TCP", 00:27:02.688 "adrfam": "IPv4", 00:27:02.688 "traddr": "10.0.0.2", 00:27:02.688 "trsvcid": "4420" 00:27:02.688 } 00:27:02.688 ], 00:27:02.688 "allow_any_host": true, 00:27:02.688 "hosts": [], 00:27:02.688 "serial_number": "SPDK00000000000001", 00:27:02.688 "model_number": "SPDK bdev Controller", 00:27:02.688 "max_namespaces": 1, 00:27:02.688 "min_cntlid": 1, 00:27:02.688 "max_cntlid": 65519, 00:27:02.688 "namespaces": [ 00:27:02.688 { 00:27:02.688 "nsid": 1, 00:27:02.688 "bdev_name": "Nvme0n1", 00:27:02.688 "name": "Nvme0n1", 00:27:02.688 "nguid": "6CB59B02D7364C119AF0C41AE10FC706", 00:27:02.688 "uuid": "6cb59b02-d736-4c11-9af0-c41ae10fc706" 00:27:02.688 } 00:27:02.688 ] 00:27:02.688 } 00:27:02.688 ] 00:27:02.688 23:04:53 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:27:02.688 23:04:53 -- target/identify_passthru.sh@54 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_identify -r ' trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1' 00:27:02.688 23:04:53 -- target/identify_passthru.sh@54 -- # grep 'Serial Number:' 00:27:02.688 23:04:53 -- target/identify_passthru.sh@54 -- # awk '{print $3}' 00:27:02.688 EAL: No free 2048 kB hugepages reported on node 1 00:27:02.688 23:04:53 -- target/identify_passthru.sh@54 -- # nvmf_serial_number=PHLJ916004901P0FGN 00:27:02.688 23:04:53 -- target/identify_passthru.sh@61 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_identify -r ' trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1' 00:27:02.688 23:04:53 -- target/identify_passthru.sh@61 -- # grep 'Model Number:' 00:27:02.688 23:04:53 -- target/identify_passthru.sh@61 -- # awk '{print $3}' 00:27:02.688 EAL: No free 2048 kB hugepages reported on node 1 00:27:02.688 23:04:53 -- target/identify_passthru.sh@61 -- # nvmf_model_number=INTEL 00:27:02.688 23:04:53 -- target/identify_passthru.sh@63 -- # '[' PHLJ916004901P0FGN '!=' PHLJ916004901P0FGN ']' 00:27:02.688 23:04:53 -- target/identify_passthru.sh@68 -- # '[' INTEL '!=' INTEL ']' 00:27:02.688 23:04:53 -- target/identify_passthru.sh@73 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:27:02.688 23:04:53 -- common/autotest_common.sh@551 -- # xtrace_disable 00:27:02.688 23:04:53 -- common/autotest_common.sh@10 -- # set +x 00:27:02.688 23:04:53 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:27:02.688 23:04:53 -- target/identify_passthru.sh@75 -- # trap - SIGINT SIGTERM EXIT 00:27:02.688 23:04:53 -- target/identify_passthru.sh@77 -- # nvmftestfini 00:27:02.688 23:04:53 -- nvmf/common.sh@476 -- # nvmfcleanup 00:27:02.688 23:04:53 -- nvmf/common.sh@116 -- # sync 00:27:02.688 23:04:53 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:27:02.688 23:04:53 -- nvmf/common.sh@119 -- # set +e 00:27:02.688 23:04:53 -- nvmf/common.sh@120 -- # for i in {1..20} 00:27:02.688 23:04:53 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:27:02.688 rmmod nvme_tcp 00:27:02.688 rmmod nvme_fabrics 00:27:02.688 rmmod nvme_keyring 00:27:02.688 23:04:53 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:27:02.688 23:04:53 -- nvmf/common.sh@123 -- # set -e 00:27:02.688 23:04:53 -- nvmf/common.sh@124 -- # return 0 00:27:02.688 23:04:53 -- nvmf/common.sh@477 -- # '[' -n 398388 ']' 00:27:02.688 23:04:53 -- nvmf/common.sh@478 -- # killprocess 398388 00:27:02.688 23:04:53 -- common/autotest_common.sh@926 -- # '[' -z 398388 ']' 00:27:02.688 23:04:53 -- common/autotest_common.sh@930 -- # kill -0 398388 00:27:02.688 23:04:53 -- common/autotest_common.sh@931 -- # uname 00:27:02.688 23:04:53 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:27:02.688 23:04:53 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 398388 00:27:02.688 23:04:53 -- common/autotest_common.sh@932 -- # process_name=reactor_0 00:27:02.688 23:04:53 -- common/autotest_common.sh@936 -- # '[' reactor_0 = sudo ']' 00:27:02.688 23:04:53 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 398388' 00:27:02.688 killing process with pid 398388 00:27:02.688 23:04:53 -- common/autotest_common.sh@945 -- # kill 398388 00:27:02.688 [2024-04-16 23:04:53.628728] app.c: 883:log_deprecation_hits: *WARNING*: rpc_nvmf_get_subsystems: deprecation 'listener.transport is deprecated in favor of trtype' scheduled for removal in v24.05 hit 1 times 00:27:02.688 23:04:53 -- common/autotest_common.sh@950 -- # wait 398388 00:27:04.117 23:04:55 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:27:04.117 23:04:55 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:27:04.117 23:04:55 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:27:04.117 23:04:55 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:27:04.117 23:04:55 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:27:04.117 23:04:55 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:27:04.117 23:04:55 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 13> /dev/null' 00:27:04.117 23:04:55 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:27:06.649 23:04:57 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:27:06.650 00:27:06.650 real 0m17.828s 00:27:06.650 user 0m26.288s 00:27:06.650 sys 0m2.223s 00:27:06.650 23:04:57 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:27:06.650 23:04:57 -- common/autotest_common.sh@10 -- # set +x 00:27:06.650 ************************************ 00:27:06.650 END TEST nvmf_identify_passthru 00:27:06.650 ************************************ 00:27:06.650 23:04:57 -- spdk/autotest.sh@300 -- # run_test nvmf_dif /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/dif.sh 00:27:06.650 23:04:57 -- common/autotest_common.sh@1077 -- # '[' 2 -le 1 ']' 00:27:06.650 23:04:57 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:27:06.650 23:04:57 -- common/autotest_common.sh@10 -- # set +x 00:27:06.650 ************************************ 00:27:06.650 START TEST nvmf_dif 00:27:06.650 ************************************ 00:27:06.650 23:04:57 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/dif.sh 00:27:06.650 * Looking for test storage... 00:27:06.650 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:27:06.650 23:04:57 -- target/dif.sh@13 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:27:06.650 23:04:57 -- nvmf/common.sh@7 -- # uname -s 00:27:06.650 23:04:57 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:27:06.650 23:04:57 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:27:06.650 23:04:57 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:27:06.650 23:04:57 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:27:06.650 23:04:57 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:27:06.650 23:04:57 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:27:06.650 23:04:57 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:27:06.650 23:04:57 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:27:06.650 23:04:57 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:27:06.650 23:04:57 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:27:06.650 23:04:57 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:27:06.650 23:04:57 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:27:06.650 23:04:57 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:27:06.650 23:04:57 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:27:06.650 23:04:57 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:27:06.650 23:04:57 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:27:06.650 23:04:57 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:27:06.650 23:04:57 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:27:06.650 23:04:57 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:27:06.650 23:04:57 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:27:06.650 23:04:57 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:27:06.650 23:04:57 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:27:06.650 23:04:57 -- paths/export.sh@5 -- # export PATH 00:27:06.650 23:04:57 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:27:06.650 23:04:57 -- nvmf/common.sh@46 -- # : 0 00:27:06.650 23:04:57 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:27:06.650 23:04:57 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:27:06.650 23:04:57 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:27:06.650 23:04:57 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:27:06.650 23:04:57 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:27:06.650 23:04:57 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:27:06.650 23:04:57 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:27:06.650 23:04:57 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:27:06.650 23:04:57 -- target/dif.sh@15 -- # NULL_META=16 00:27:06.650 23:04:57 -- target/dif.sh@15 -- # NULL_BLOCK_SIZE=512 00:27:06.650 23:04:57 -- target/dif.sh@15 -- # NULL_SIZE=64 00:27:06.650 23:04:57 -- target/dif.sh@15 -- # NULL_DIF=1 00:27:06.650 23:04:57 -- target/dif.sh@135 -- # nvmftestinit 00:27:06.650 23:04:57 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:27:06.650 23:04:57 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:27:06.650 23:04:57 -- nvmf/common.sh@436 -- # prepare_net_devs 00:27:06.650 23:04:57 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:27:06.650 23:04:57 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:27:06.650 23:04:57 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:27:06.650 23:04:57 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 13> /dev/null' 00:27:06.650 23:04:57 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:27:06.650 23:04:57 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:27:06.650 23:04:57 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:27:06.650 23:04:57 -- nvmf/common.sh@284 -- # xtrace_disable 00:27:06.650 23:04:57 -- common/autotest_common.sh@10 -- # set +x 00:27:08.550 23:04:59 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:27:08.550 23:04:59 -- nvmf/common.sh@290 -- # pci_devs=() 00:27:08.550 23:04:59 -- nvmf/common.sh@290 -- # local -a pci_devs 00:27:08.550 23:04:59 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:27:08.550 23:04:59 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:27:08.550 23:04:59 -- nvmf/common.sh@292 -- # pci_drivers=() 00:27:08.550 23:04:59 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:27:08.550 23:04:59 -- nvmf/common.sh@294 -- # net_devs=() 00:27:08.550 23:04:59 -- nvmf/common.sh@294 -- # local -ga net_devs 00:27:08.550 23:04:59 -- nvmf/common.sh@295 -- # e810=() 00:27:08.551 23:04:59 -- nvmf/common.sh@295 -- # local -ga e810 00:27:08.551 23:04:59 -- nvmf/common.sh@296 -- # x722=() 00:27:08.551 23:04:59 -- nvmf/common.sh@296 -- # local -ga x722 00:27:08.551 23:04:59 -- nvmf/common.sh@297 -- # mlx=() 00:27:08.551 23:04:59 -- nvmf/common.sh@297 -- # local -ga mlx 00:27:08.551 23:04:59 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:27:08.551 23:04:59 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:27:08.551 23:04:59 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:27:08.551 23:04:59 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:27:08.551 23:04:59 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:27:08.551 23:04:59 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:27:08.551 23:04:59 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:27:08.551 23:04:59 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:27:08.551 23:04:59 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:27:08.551 23:04:59 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:27:08.551 23:04:59 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:27:08.551 23:04:59 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:27:08.551 23:04:59 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:27:08.551 23:04:59 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:27:08.551 23:04:59 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:27:08.551 23:04:59 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:27:08.551 23:04:59 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:27:08.551 23:04:59 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:27:08.551 23:04:59 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:27:08.551 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:27:08.551 23:04:59 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:27:08.551 23:04:59 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:27:08.551 23:04:59 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:27:08.551 23:04:59 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:27:08.551 23:04:59 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:27:08.551 23:04:59 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:27:08.551 23:04:59 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:27:08.551 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:27:08.551 23:04:59 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:27:08.551 23:04:59 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:27:08.551 23:04:59 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:27:08.551 23:04:59 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:27:08.551 23:04:59 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:27:08.551 23:04:59 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:27:08.551 23:04:59 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:27:08.551 23:04:59 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:27:08.551 23:04:59 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:27:08.551 23:04:59 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:27:08.551 23:04:59 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:27:08.551 23:04:59 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:27:08.551 23:04:59 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:27:08.551 Found net devices under 0000:0a:00.0: cvl_0_0 00:27:08.551 23:04:59 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:27:08.551 23:04:59 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:27:08.551 23:04:59 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:27:08.551 23:04:59 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:27:08.551 23:04:59 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:27:08.551 23:04:59 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:27:08.551 Found net devices under 0000:0a:00.1: cvl_0_1 00:27:08.551 23:04:59 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:27:08.551 23:04:59 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:27:08.551 23:04:59 -- nvmf/common.sh@402 -- # is_hw=yes 00:27:08.551 23:04:59 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:27:08.551 23:04:59 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:27:08.551 23:04:59 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:27:08.551 23:04:59 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:27:08.551 23:04:59 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:27:08.551 23:04:59 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:27:08.551 23:04:59 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:27:08.551 23:04:59 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:27:08.551 23:04:59 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:27:08.551 23:04:59 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:27:08.551 23:04:59 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:27:08.551 23:04:59 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:27:08.551 23:04:59 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:27:08.551 23:04:59 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:27:08.551 23:04:59 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:27:08.551 23:04:59 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:27:08.551 23:04:59 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:27:08.551 23:04:59 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:27:08.551 23:04:59 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:27:08.551 23:04:59 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:27:08.551 23:04:59 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:27:08.551 23:04:59 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:27:08.551 23:04:59 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:27:08.551 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:27:08.551 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.099 ms 00:27:08.551 00:27:08.551 --- 10.0.0.2 ping statistics --- 00:27:08.551 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:27:08.551 rtt min/avg/max/mdev = 0.099/0.099/0.099/0.000 ms 00:27:08.551 23:04:59 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:27:08.551 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:27:08.551 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.081 ms 00:27:08.551 00:27:08.551 --- 10.0.0.1 ping statistics --- 00:27:08.551 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:27:08.551 rtt min/avg/max/mdev = 0.081/0.081/0.081/0.000 ms 00:27:08.551 23:04:59 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:27:08.551 23:04:59 -- nvmf/common.sh@410 -- # return 0 00:27:08.551 23:04:59 -- nvmf/common.sh@438 -- # '[' iso == iso ']' 00:27:08.551 23:04:59 -- nvmf/common.sh@439 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh 00:27:09.487 0000:00:04.7 (8086 0e27): Already using the vfio-pci driver 00:27:09.487 0000:88:00.0 (8086 0a54): Already using the vfio-pci driver 00:27:09.487 0000:00:04.6 (8086 0e26): Already using the vfio-pci driver 00:27:09.487 0000:00:04.5 (8086 0e25): Already using the vfio-pci driver 00:27:09.487 0000:00:04.4 (8086 0e24): Already using the vfio-pci driver 00:27:09.487 0000:00:04.3 (8086 0e23): Already using the vfio-pci driver 00:27:09.487 0000:00:04.2 (8086 0e22): Already using the vfio-pci driver 00:27:09.487 0000:00:04.1 (8086 0e21): Already using the vfio-pci driver 00:27:09.487 0000:00:04.0 (8086 0e20): Already using the vfio-pci driver 00:27:09.487 0000:80:04.7 (8086 0e27): Already using the vfio-pci driver 00:27:09.487 0000:80:04.6 (8086 0e26): Already using the vfio-pci driver 00:27:09.487 0000:80:04.5 (8086 0e25): Already using the vfio-pci driver 00:27:09.487 0000:80:04.4 (8086 0e24): Already using the vfio-pci driver 00:27:09.487 0000:80:04.3 (8086 0e23): Already using the vfio-pci driver 00:27:09.487 0000:80:04.2 (8086 0e22): Already using the vfio-pci driver 00:27:09.487 0000:80:04.1 (8086 0e21): Already using the vfio-pci driver 00:27:09.487 0000:80:04.0 (8086 0e20): Already using the vfio-pci driver 00:27:09.745 23:05:00 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:27:09.745 23:05:00 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:27:09.745 23:05:00 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:27:09.745 23:05:00 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:27:09.745 23:05:00 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:27:09.745 23:05:00 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:27:09.745 23:05:00 -- target/dif.sh@136 -- # NVMF_TRANSPORT_OPTS+=' --dif-insert-or-strip' 00:27:09.745 23:05:00 -- target/dif.sh@137 -- # nvmfappstart 00:27:09.745 23:05:00 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:27:09.745 23:05:00 -- common/autotest_common.sh@712 -- # xtrace_disable 00:27:09.745 23:05:00 -- common/autotest_common.sh@10 -- # set +x 00:27:09.745 23:05:00 -- nvmf/common.sh@469 -- # nvmfpid=401578 00:27:09.745 23:05:00 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF 00:27:09.745 23:05:00 -- nvmf/common.sh@470 -- # waitforlisten 401578 00:27:09.745 23:05:00 -- common/autotest_common.sh@819 -- # '[' -z 401578 ']' 00:27:09.745 23:05:00 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk.sock 00:27:09.745 23:05:00 -- common/autotest_common.sh@824 -- # local max_retries=100 00:27:09.745 23:05:00 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:27:09.745 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:27:09.745 23:05:00 -- common/autotest_common.sh@828 -- # xtrace_disable 00:27:09.745 23:05:00 -- common/autotest_common.sh@10 -- # set +x 00:27:09.745 [2024-04-16 23:05:00.699304] Starting SPDK v24.01.1-pre git sha1 4b134b4ab / DPDK 23.11.0 initialization... 00:27:09.745 [2024-04-16 23:05:00.699386] [ DPDK EAL parameters: nvmf -c 0x1 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:27:09.745 EAL: No free 2048 kB hugepages reported on node 1 00:27:09.745 [2024-04-16 23:05:00.767056] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:27:10.003 [2024-04-16 23:05:00.884527] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:27:10.003 [2024-04-16 23:05:00.884670] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:27:10.003 [2024-04-16 23:05:00.884689] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:27:10.003 [2024-04-16 23:05:00.884703] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:27:10.003 [2024-04-16 23:05:00.884731] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:27:10.570 23:05:01 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:27:10.570 23:05:01 -- common/autotest_common.sh@852 -- # return 0 00:27:10.570 23:05:01 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:27:10.570 23:05:01 -- common/autotest_common.sh@718 -- # xtrace_disable 00:27:10.570 23:05:01 -- common/autotest_common.sh@10 -- # set +x 00:27:10.570 23:05:01 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:27:10.570 23:05:01 -- target/dif.sh@139 -- # create_transport 00:27:10.570 23:05:01 -- target/dif.sh@50 -- # rpc_cmd nvmf_create_transport -t tcp -o --dif-insert-or-strip 00:27:10.570 23:05:01 -- common/autotest_common.sh@551 -- # xtrace_disable 00:27:10.570 23:05:01 -- common/autotest_common.sh@10 -- # set +x 00:27:10.570 [2024-04-16 23:05:01.692207] tcp.c: 659:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:27:10.570 23:05:01 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:27:10.570 23:05:01 -- target/dif.sh@141 -- # run_test fio_dif_1_default fio_dif_1 00:27:10.570 23:05:01 -- common/autotest_common.sh@1077 -- # '[' 2 -le 1 ']' 00:27:10.570 23:05:01 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:27:10.570 23:05:01 -- common/autotest_common.sh@10 -- # set +x 00:27:10.828 ************************************ 00:27:10.828 START TEST fio_dif_1_default 00:27:10.828 ************************************ 00:27:10.828 23:05:01 -- common/autotest_common.sh@1104 -- # fio_dif_1 00:27:10.828 23:05:01 -- target/dif.sh@86 -- # create_subsystems 0 00:27:10.828 23:05:01 -- target/dif.sh@28 -- # local sub 00:27:10.828 23:05:01 -- target/dif.sh@30 -- # for sub in "$@" 00:27:10.828 23:05:01 -- target/dif.sh@31 -- # create_subsystem 0 00:27:10.828 23:05:01 -- target/dif.sh@18 -- # local sub_id=0 00:27:10.828 23:05:01 -- target/dif.sh@21 -- # rpc_cmd bdev_null_create bdev_null0 64 512 --md-size 16 --dif-type 1 00:27:10.828 23:05:01 -- common/autotest_common.sh@551 -- # xtrace_disable 00:27:10.828 23:05:01 -- common/autotest_common.sh@10 -- # set +x 00:27:10.828 bdev_null0 00:27:10.828 23:05:01 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:27:10.828 23:05:01 -- target/dif.sh@22 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode0 --serial-number 53313233-0 --allow-any-host 00:27:10.828 23:05:01 -- common/autotest_common.sh@551 -- # xtrace_disable 00:27:10.828 23:05:01 -- common/autotest_common.sh@10 -- # set +x 00:27:10.828 23:05:01 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:27:10.828 23:05:01 -- target/dif.sh@23 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode0 bdev_null0 00:27:10.828 23:05:01 -- common/autotest_common.sh@551 -- # xtrace_disable 00:27:10.828 23:05:01 -- common/autotest_common.sh@10 -- # set +x 00:27:10.828 23:05:01 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:27:10.828 23:05:01 -- target/dif.sh@24 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode0 -t tcp -a 10.0.0.2 -s 4420 00:27:10.828 23:05:01 -- common/autotest_common.sh@551 -- # xtrace_disable 00:27:10.828 23:05:01 -- common/autotest_common.sh@10 -- # set +x 00:27:10.828 [2024-04-16 23:05:01.732476] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:27:10.828 23:05:01 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:27:10.828 23:05:01 -- target/dif.sh@87 -- # fio /dev/fd/62 00:27:10.828 23:05:01 -- target/dif.sh@87 -- # create_json_sub_conf 0 00:27:10.828 23:05:01 -- target/dif.sh@51 -- # gen_nvmf_target_json 0 00:27:10.828 23:05:01 -- target/dif.sh@82 -- # fio_bdev --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:27:10.828 23:05:01 -- nvmf/common.sh@520 -- # config=() 00:27:10.829 23:05:01 -- common/autotest_common.sh@1335 -- # fio_plugin /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:27:10.829 23:05:01 -- nvmf/common.sh@520 -- # local subsystem config 00:27:10.829 23:05:01 -- target/dif.sh@82 -- # gen_fio_conf 00:27:10.829 23:05:01 -- common/autotest_common.sh@1316 -- # local fio_dir=/usr/src/fio 00:27:10.829 23:05:01 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:27:10.829 23:05:01 -- common/autotest_common.sh@1318 -- # sanitizers=('libasan' 'libclang_rt.asan') 00:27:10.829 23:05:01 -- target/dif.sh@54 -- # local file 00:27:10.829 23:05:01 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:27:10.829 { 00:27:10.829 "params": { 00:27:10.829 "name": "Nvme$subsystem", 00:27:10.829 "trtype": "$TEST_TRANSPORT", 00:27:10.829 "traddr": "$NVMF_FIRST_TARGET_IP", 00:27:10.829 "adrfam": "ipv4", 00:27:10.829 "trsvcid": "$NVMF_PORT", 00:27:10.829 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:27:10.829 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:27:10.829 "hdgst": ${hdgst:-false}, 00:27:10.829 "ddgst": ${ddgst:-false} 00:27:10.829 }, 00:27:10.829 "method": "bdev_nvme_attach_controller" 00:27:10.829 } 00:27:10.829 EOF 00:27:10.829 )") 00:27:10.829 23:05:01 -- common/autotest_common.sh@1318 -- # local sanitizers 00:27:10.829 23:05:01 -- target/dif.sh@56 -- # cat 00:27:10.829 23:05:01 -- common/autotest_common.sh@1319 -- # local plugin=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:27:10.829 23:05:01 -- common/autotest_common.sh@1320 -- # shift 00:27:10.829 23:05:01 -- common/autotest_common.sh@1322 -- # local asan_lib= 00:27:10.829 23:05:01 -- common/autotest_common.sh@1323 -- # for sanitizer in "${sanitizers[@]}" 00:27:10.829 23:05:01 -- nvmf/common.sh@542 -- # cat 00:27:10.829 23:05:01 -- common/autotest_common.sh@1324 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:27:10.829 23:05:01 -- target/dif.sh@72 -- # (( file = 1 )) 00:27:10.829 23:05:01 -- common/autotest_common.sh@1324 -- # grep libasan 00:27:10.829 23:05:01 -- target/dif.sh@72 -- # (( file <= files )) 00:27:10.829 23:05:01 -- common/autotest_common.sh@1324 -- # awk '{print $3}' 00:27:10.829 23:05:01 -- nvmf/common.sh@544 -- # jq . 00:27:10.829 23:05:01 -- nvmf/common.sh@545 -- # IFS=, 00:27:10.829 23:05:01 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:27:10.829 "params": { 00:27:10.829 "name": "Nvme0", 00:27:10.829 "trtype": "tcp", 00:27:10.829 "traddr": "10.0.0.2", 00:27:10.829 "adrfam": "ipv4", 00:27:10.829 "trsvcid": "4420", 00:27:10.829 "subnqn": "nqn.2016-06.io.spdk:cnode0", 00:27:10.829 "hostnqn": "nqn.2016-06.io.spdk:host0", 00:27:10.829 "hdgst": false, 00:27:10.829 "ddgst": false 00:27:10.829 }, 00:27:10.829 "method": "bdev_nvme_attach_controller" 00:27:10.829 }' 00:27:10.829 23:05:01 -- common/autotest_common.sh@1324 -- # asan_lib= 00:27:10.829 23:05:01 -- common/autotest_common.sh@1325 -- # [[ -n '' ]] 00:27:10.829 23:05:01 -- common/autotest_common.sh@1323 -- # for sanitizer in "${sanitizers[@]}" 00:27:10.829 23:05:01 -- common/autotest_common.sh@1324 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:27:10.829 23:05:01 -- common/autotest_common.sh@1324 -- # grep libclang_rt.asan 00:27:10.829 23:05:01 -- common/autotest_common.sh@1324 -- # awk '{print $3}' 00:27:10.829 23:05:01 -- common/autotest_common.sh@1324 -- # asan_lib= 00:27:10.829 23:05:01 -- common/autotest_common.sh@1325 -- # [[ -n '' ]] 00:27:10.829 23:05:01 -- common/autotest_common.sh@1331 -- # LD_PRELOAD=' /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev' 00:27:10.829 23:05:01 -- common/autotest_common.sh@1331 -- # /usr/src/fio/fio --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:27:11.087 filename0: (g=0): rw=randread, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=spdk_bdev, iodepth=4 00:27:11.087 fio-3.35 00:27:11.087 Starting 1 thread 00:27:11.087 EAL: No free 2048 kB hugepages reported on node 1 00:27:11.345 [2024-04-16 23:05:02.394299] rpc.c: 181:spdk_rpc_listen: *ERROR*: RPC Unix domain socket path /var/tmp/spdk.sock in use. Specify another. 00:27:11.345 [2024-04-16 23:05:02.394374] rpc.c: 90:spdk_rpc_initialize: *ERROR*: Unable to start RPC service at /var/tmp/spdk.sock 00:27:23.541 00:27:23.541 filename0: (groupid=0, jobs=1): err= 0: pid=401943: Tue Apr 16 23:05:12 2024 00:27:23.541 read: IOPS=190, BW=760KiB/s (778kB/s)(7632KiB/10041msec) 00:27:23.541 slat (nsec): min=6733, max=63250, avg=8553.86, stdev=3091.12 00:27:23.541 clat (usec): min=680, max=43602, avg=21023.00, stdev=20206.55 00:27:23.541 lat (usec): min=687, max=43636, avg=21031.55, stdev=20206.54 00:27:23.541 clat percentiles (usec): 00:27:23.541 | 1.00th=[ 701], 5.00th=[ 717], 10.00th=[ 742], 20.00th=[ 766], 00:27:23.541 | 30.00th=[ 783], 40.00th=[ 807], 50.00th=[41157], 60.00th=[41157], 00:27:23.541 | 70.00th=[41157], 80.00th=[41157], 90.00th=[41157], 95.00th=[41157], 00:27:23.541 | 99.00th=[41157], 99.50th=[41157], 99.90th=[43779], 99.95th=[43779], 00:27:23.541 | 99.99th=[43779] 00:27:23.541 bw ( KiB/s): min= 704, max= 768, per=100.00%, avg=761.60, stdev=16.74, samples=20 00:27:23.541 iops : min= 176, max= 192, avg=190.40, stdev= 4.19, samples=20 00:27:23.541 lat (usec) : 750=11.90%, 1000=38.00% 00:27:23.541 lat (msec) : 50=50.10% 00:27:23.541 cpu : usr=91.02%, sys=8.71%, ctx=20, majf=0, minf=196 00:27:23.541 IO depths : 1=25.0%, 2=50.0%, 4=25.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:27:23.541 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:27:23.541 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:27:23.541 issued rwts: total=1908,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:27:23.541 latency : target=0, window=0, percentile=100.00%, depth=4 00:27:23.541 00:27:23.541 Run status group 0 (all jobs): 00:27:23.541 READ: bw=760KiB/s (778kB/s), 760KiB/s-760KiB/s (778kB/s-778kB/s), io=7632KiB (7815kB), run=10041-10041msec 00:27:23.541 23:05:12 -- target/dif.sh@88 -- # destroy_subsystems 0 00:27:23.541 23:05:12 -- target/dif.sh@43 -- # local sub 00:27:23.541 23:05:12 -- target/dif.sh@45 -- # for sub in "$@" 00:27:23.541 23:05:12 -- target/dif.sh@46 -- # destroy_subsystem 0 00:27:23.541 23:05:12 -- target/dif.sh@36 -- # local sub_id=0 00:27:23.541 23:05:12 -- target/dif.sh@38 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode0 00:27:23.541 23:05:12 -- common/autotest_common.sh@551 -- # xtrace_disable 00:27:23.541 23:05:12 -- common/autotest_common.sh@10 -- # set +x 00:27:23.541 23:05:12 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:27:23.541 23:05:12 -- target/dif.sh@39 -- # rpc_cmd bdev_null_delete bdev_null0 00:27:23.541 23:05:12 -- common/autotest_common.sh@551 -- # xtrace_disable 00:27:23.541 23:05:12 -- common/autotest_common.sh@10 -- # set +x 00:27:23.541 23:05:12 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:27:23.541 00:27:23.541 real 0m11.148s 00:27:23.541 user 0m10.229s 00:27:23.541 sys 0m1.129s 00:27:23.541 23:05:12 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:27:23.541 23:05:12 -- common/autotest_common.sh@10 -- # set +x 00:27:23.541 ************************************ 00:27:23.541 END TEST fio_dif_1_default 00:27:23.541 ************************************ 00:27:23.541 23:05:12 -- target/dif.sh@142 -- # run_test fio_dif_1_multi_subsystems fio_dif_1_multi_subsystems 00:27:23.541 23:05:12 -- common/autotest_common.sh@1077 -- # '[' 2 -le 1 ']' 00:27:23.541 23:05:12 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:27:23.541 23:05:12 -- common/autotest_common.sh@10 -- # set +x 00:27:23.541 ************************************ 00:27:23.541 START TEST fio_dif_1_multi_subsystems 00:27:23.541 ************************************ 00:27:23.541 23:05:12 -- common/autotest_common.sh@1104 -- # fio_dif_1_multi_subsystems 00:27:23.541 23:05:12 -- target/dif.sh@92 -- # local files=1 00:27:23.541 23:05:12 -- target/dif.sh@94 -- # create_subsystems 0 1 00:27:23.541 23:05:12 -- target/dif.sh@28 -- # local sub 00:27:23.541 23:05:12 -- target/dif.sh@30 -- # for sub in "$@" 00:27:23.541 23:05:12 -- target/dif.sh@31 -- # create_subsystem 0 00:27:23.541 23:05:12 -- target/dif.sh@18 -- # local sub_id=0 00:27:23.541 23:05:12 -- target/dif.sh@21 -- # rpc_cmd bdev_null_create bdev_null0 64 512 --md-size 16 --dif-type 1 00:27:23.541 23:05:12 -- common/autotest_common.sh@551 -- # xtrace_disable 00:27:23.541 23:05:12 -- common/autotest_common.sh@10 -- # set +x 00:27:23.541 bdev_null0 00:27:23.541 23:05:12 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:27:23.541 23:05:12 -- target/dif.sh@22 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode0 --serial-number 53313233-0 --allow-any-host 00:27:23.541 23:05:12 -- common/autotest_common.sh@551 -- # xtrace_disable 00:27:23.541 23:05:12 -- common/autotest_common.sh@10 -- # set +x 00:27:23.541 23:05:12 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:27:23.541 23:05:12 -- target/dif.sh@23 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode0 bdev_null0 00:27:23.541 23:05:12 -- common/autotest_common.sh@551 -- # xtrace_disable 00:27:23.541 23:05:12 -- common/autotest_common.sh@10 -- # set +x 00:27:23.541 23:05:12 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:27:23.541 23:05:12 -- target/dif.sh@24 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode0 -t tcp -a 10.0.0.2 -s 4420 00:27:23.541 23:05:12 -- common/autotest_common.sh@551 -- # xtrace_disable 00:27:23.541 23:05:12 -- common/autotest_common.sh@10 -- # set +x 00:27:23.541 [2024-04-16 23:05:12.902263] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:27:23.541 23:05:12 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:27:23.541 23:05:12 -- target/dif.sh@30 -- # for sub in "$@" 00:27:23.541 23:05:12 -- target/dif.sh@31 -- # create_subsystem 1 00:27:23.541 23:05:12 -- target/dif.sh@18 -- # local sub_id=1 00:27:23.541 23:05:12 -- target/dif.sh@21 -- # rpc_cmd bdev_null_create bdev_null1 64 512 --md-size 16 --dif-type 1 00:27:23.541 23:05:12 -- common/autotest_common.sh@551 -- # xtrace_disable 00:27:23.541 23:05:12 -- common/autotest_common.sh@10 -- # set +x 00:27:23.541 bdev_null1 00:27:23.541 23:05:12 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:27:23.541 23:05:12 -- target/dif.sh@22 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 --serial-number 53313233-1 --allow-any-host 00:27:23.541 23:05:12 -- common/autotest_common.sh@551 -- # xtrace_disable 00:27:23.541 23:05:12 -- common/autotest_common.sh@10 -- # set +x 00:27:23.541 23:05:12 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:27:23.541 23:05:12 -- target/dif.sh@23 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 bdev_null1 00:27:23.541 23:05:12 -- common/autotest_common.sh@551 -- # xtrace_disable 00:27:23.541 23:05:12 -- common/autotest_common.sh@10 -- # set +x 00:27:23.541 23:05:12 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:27:23.541 23:05:12 -- target/dif.sh@24 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:27:23.541 23:05:12 -- common/autotest_common.sh@551 -- # xtrace_disable 00:27:23.541 23:05:12 -- common/autotest_common.sh@10 -- # set +x 00:27:23.541 23:05:12 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:27:23.541 23:05:12 -- target/dif.sh@95 -- # fio /dev/fd/62 00:27:23.541 23:05:12 -- target/dif.sh@95 -- # create_json_sub_conf 0 1 00:27:23.541 23:05:12 -- target/dif.sh@51 -- # gen_nvmf_target_json 0 1 00:27:23.541 23:05:12 -- nvmf/common.sh@520 -- # config=() 00:27:23.541 23:05:12 -- nvmf/common.sh@520 -- # local subsystem config 00:27:23.541 23:05:12 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:27:23.541 23:05:12 -- target/dif.sh@82 -- # fio_bdev --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:27:23.541 23:05:12 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:27:23.541 { 00:27:23.541 "params": { 00:27:23.541 "name": "Nvme$subsystem", 00:27:23.541 "trtype": "$TEST_TRANSPORT", 00:27:23.541 "traddr": "$NVMF_FIRST_TARGET_IP", 00:27:23.541 "adrfam": "ipv4", 00:27:23.541 "trsvcid": "$NVMF_PORT", 00:27:23.541 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:27:23.541 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:27:23.541 "hdgst": ${hdgst:-false}, 00:27:23.541 "ddgst": ${ddgst:-false} 00:27:23.541 }, 00:27:23.541 "method": "bdev_nvme_attach_controller" 00:27:23.541 } 00:27:23.541 EOF 00:27:23.541 )") 00:27:23.541 23:05:12 -- target/dif.sh@82 -- # gen_fio_conf 00:27:23.541 23:05:12 -- common/autotest_common.sh@1335 -- # fio_plugin /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:27:23.541 23:05:12 -- target/dif.sh@54 -- # local file 00:27:23.541 23:05:12 -- common/autotest_common.sh@1316 -- # local fio_dir=/usr/src/fio 00:27:23.541 23:05:12 -- target/dif.sh@56 -- # cat 00:27:23.541 23:05:12 -- common/autotest_common.sh@1318 -- # sanitizers=('libasan' 'libclang_rt.asan') 00:27:23.541 23:05:12 -- common/autotest_common.sh@1318 -- # local sanitizers 00:27:23.541 23:05:12 -- common/autotest_common.sh@1319 -- # local plugin=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:27:23.541 23:05:12 -- common/autotest_common.sh@1320 -- # shift 00:27:23.541 23:05:12 -- nvmf/common.sh@542 -- # cat 00:27:23.541 23:05:12 -- common/autotest_common.sh@1322 -- # local asan_lib= 00:27:23.541 23:05:12 -- common/autotest_common.sh@1323 -- # for sanitizer in "${sanitizers[@]}" 00:27:23.541 23:05:12 -- target/dif.sh@72 -- # (( file = 1 )) 00:27:23.541 23:05:12 -- common/autotest_common.sh@1324 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:27:23.541 23:05:12 -- target/dif.sh@72 -- # (( file <= files )) 00:27:23.541 23:05:12 -- target/dif.sh@73 -- # cat 00:27:23.541 23:05:12 -- common/autotest_common.sh@1324 -- # grep libasan 00:27:23.541 23:05:12 -- common/autotest_common.sh@1324 -- # awk '{print $3}' 00:27:23.541 23:05:12 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:27:23.541 23:05:12 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:27:23.541 { 00:27:23.541 "params": { 00:27:23.541 "name": "Nvme$subsystem", 00:27:23.541 "trtype": "$TEST_TRANSPORT", 00:27:23.541 "traddr": "$NVMF_FIRST_TARGET_IP", 00:27:23.541 "adrfam": "ipv4", 00:27:23.541 "trsvcid": "$NVMF_PORT", 00:27:23.541 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:27:23.541 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:27:23.541 "hdgst": ${hdgst:-false}, 00:27:23.541 "ddgst": ${ddgst:-false} 00:27:23.541 }, 00:27:23.541 "method": "bdev_nvme_attach_controller" 00:27:23.541 } 00:27:23.541 EOF 00:27:23.541 )") 00:27:23.542 23:05:12 -- target/dif.sh@72 -- # (( file++ )) 00:27:23.542 23:05:12 -- nvmf/common.sh@542 -- # cat 00:27:23.542 23:05:12 -- target/dif.sh@72 -- # (( file <= files )) 00:27:23.542 23:05:12 -- nvmf/common.sh@544 -- # jq . 00:27:23.542 23:05:12 -- nvmf/common.sh@545 -- # IFS=, 00:27:23.542 23:05:12 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:27:23.542 "params": { 00:27:23.542 "name": "Nvme0", 00:27:23.542 "trtype": "tcp", 00:27:23.542 "traddr": "10.0.0.2", 00:27:23.542 "adrfam": "ipv4", 00:27:23.542 "trsvcid": "4420", 00:27:23.542 "subnqn": "nqn.2016-06.io.spdk:cnode0", 00:27:23.542 "hostnqn": "nqn.2016-06.io.spdk:host0", 00:27:23.542 "hdgst": false, 00:27:23.542 "ddgst": false 00:27:23.542 }, 00:27:23.542 "method": "bdev_nvme_attach_controller" 00:27:23.542 },{ 00:27:23.542 "params": { 00:27:23.542 "name": "Nvme1", 00:27:23.542 "trtype": "tcp", 00:27:23.542 "traddr": "10.0.0.2", 00:27:23.542 "adrfam": "ipv4", 00:27:23.542 "trsvcid": "4420", 00:27:23.542 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:27:23.542 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:27:23.542 "hdgst": false, 00:27:23.542 "ddgst": false 00:27:23.542 }, 00:27:23.542 "method": "bdev_nvme_attach_controller" 00:27:23.542 }' 00:27:23.542 23:05:12 -- common/autotest_common.sh@1324 -- # asan_lib= 00:27:23.542 23:05:12 -- common/autotest_common.sh@1325 -- # [[ -n '' ]] 00:27:23.542 23:05:12 -- common/autotest_common.sh@1323 -- # for sanitizer in "${sanitizers[@]}" 00:27:23.542 23:05:12 -- common/autotest_common.sh@1324 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:27:23.542 23:05:12 -- common/autotest_common.sh@1324 -- # grep libclang_rt.asan 00:27:23.542 23:05:12 -- common/autotest_common.sh@1324 -- # awk '{print $3}' 00:27:23.542 23:05:12 -- common/autotest_common.sh@1324 -- # asan_lib= 00:27:23.542 23:05:12 -- common/autotest_common.sh@1325 -- # [[ -n '' ]] 00:27:23.542 23:05:12 -- common/autotest_common.sh@1331 -- # LD_PRELOAD=' /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev' 00:27:23.542 23:05:12 -- common/autotest_common.sh@1331 -- # /usr/src/fio/fio --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:27:23.542 filename0: (g=0): rw=randread, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=spdk_bdev, iodepth=4 00:27:23.542 filename1: (g=0): rw=randread, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=spdk_bdev, iodepth=4 00:27:23.542 fio-3.35 00:27:23.542 Starting 2 threads 00:27:23.542 EAL: No free 2048 kB hugepages reported on node 1 00:27:23.542 [2024-04-16 23:05:13.908539] rpc.c: 181:spdk_rpc_listen: *ERROR*: RPC Unix domain socket path /var/tmp/spdk.sock in use. Specify another. 00:27:23.542 [2024-04-16 23:05:13.908609] rpc.c: 90:spdk_rpc_initialize: *ERROR*: Unable to start RPC service at /var/tmp/spdk.sock 00:27:33.509 00:27:33.509 filename0: (groupid=0, jobs=1): err= 0: pid=403384: Tue Apr 16 23:05:24 2024 00:27:33.509 read: IOPS=95, BW=384KiB/s (393kB/s)(3840KiB/10002msec) 00:27:33.509 slat (nsec): min=6820, max=27121, avg=8896.31, stdev=2755.43 00:27:33.509 clat (usec): min=40854, max=43902, avg=41646.88, stdev=513.30 00:27:33.509 lat (usec): min=40873, max=43924, avg=41655.78, stdev=513.43 00:27:33.509 clat percentiles (usec): 00:27:33.509 | 1.00th=[41157], 5.00th=[41157], 10.00th=[41157], 20.00th=[41157], 00:27:33.509 | 30.00th=[41157], 40.00th=[41681], 50.00th=[42206], 60.00th=[42206], 00:27:33.509 | 70.00th=[42206], 80.00th=[42206], 90.00th=[42206], 95.00th=[42206], 00:27:33.509 | 99.00th=[42206], 99.50th=[42206], 99.90th=[43779], 99.95th=[43779], 00:27:33.509 | 99.99th=[43779] 00:27:33.509 bw ( KiB/s): min= 352, max= 416, per=33.57%, avg=384.00, stdev=10.67, samples=19 00:27:33.509 iops : min= 88, max= 104, avg=96.00, stdev= 2.67, samples=19 00:27:33.509 lat (msec) : 50=100.00% 00:27:33.509 cpu : usr=95.24%, sys=4.46%, ctx=15, majf=0, minf=115 00:27:33.509 IO depths : 1=25.0%, 2=50.0%, 4=25.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:27:33.509 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:27:33.509 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:27:33.509 issued rwts: total=960,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:27:33.509 latency : target=0, window=0, percentile=100.00%, depth=4 00:27:33.509 filename1: (groupid=0, jobs=1): err= 0: pid=403385: Tue Apr 16 23:05:24 2024 00:27:33.509 read: IOPS=189, BW=760KiB/s (778kB/s)(7600KiB/10001msec) 00:27:33.509 slat (nsec): min=6789, max=49205, avg=10000.73, stdev=4893.63 00:27:33.509 clat (usec): min=694, max=43908, avg=21024.34, stdev=20233.33 00:27:33.509 lat (usec): min=702, max=43931, avg=21034.34, stdev=20234.25 00:27:33.509 clat percentiles (usec): 00:27:33.509 | 1.00th=[ 725], 5.00th=[ 734], 10.00th=[ 734], 20.00th=[ 742], 00:27:33.509 | 30.00th=[ 750], 40.00th=[ 758], 50.00th=[41157], 60.00th=[41157], 00:27:33.509 | 70.00th=[41157], 80.00th=[41157], 90.00th=[41157], 95.00th=[41157], 00:27:33.509 | 99.00th=[41157], 99.50th=[41681], 99.90th=[43779], 99.95th=[43779], 00:27:33.509 | 99.99th=[43779] 00:27:33.509 bw ( KiB/s): min= 704, max= 768, per=66.53%, avg=761.26, stdev=20.18, samples=19 00:27:33.509 iops : min= 176, max= 192, avg=190.32, stdev= 5.04, samples=19 00:27:33.509 lat (usec) : 750=28.84%, 1000=20.63% 00:27:33.509 lat (msec) : 2=0.42%, 50=50.11% 00:27:33.509 cpu : usr=95.15%, sys=4.54%, ctx=36, majf=0, minf=183 00:27:33.509 IO depths : 1=25.0%, 2=50.0%, 4=25.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:27:33.509 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:27:33.509 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:27:33.509 issued rwts: total=1900,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:27:33.509 latency : target=0, window=0, percentile=100.00%, depth=4 00:27:33.509 00:27:33.509 Run status group 0 (all jobs): 00:27:33.509 READ: bw=1144KiB/s (1171kB/s), 384KiB/s-760KiB/s (393kB/s-778kB/s), io=11.2MiB (11.7MB), run=10001-10002msec 00:27:33.509 23:05:24 -- target/dif.sh@96 -- # destroy_subsystems 0 1 00:27:33.509 23:05:24 -- target/dif.sh@43 -- # local sub 00:27:33.509 23:05:24 -- target/dif.sh@45 -- # for sub in "$@" 00:27:33.509 23:05:24 -- target/dif.sh@46 -- # destroy_subsystem 0 00:27:33.509 23:05:24 -- target/dif.sh@36 -- # local sub_id=0 00:27:33.509 23:05:24 -- target/dif.sh@38 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode0 00:27:33.509 23:05:24 -- common/autotest_common.sh@551 -- # xtrace_disable 00:27:33.509 23:05:24 -- common/autotest_common.sh@10 -- # set +x 00:27:33.509 23:05:24 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:27:33.509 23:05:24 -- target/dif.sh@39 -- # rpc_cmd bdev_null_delete bdev_null0 00:27:33.509 23:05:24 -- common/autotest_common.sh@551 -- # xtrace_disable 00:27:33.509 23:05:24 -- common/autotest_common.sh@10 -- # set +x 00:27:33.509 23:05:24 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:27:33.509 23:05:24 -- target/dif.sh@45 -- # for sub in "$@" 00:27:33.509 23:05:24 -- target/dif.sh@46 -- # destroy_subsystem 1 00:27:33.509 23:05:24 -- target/dif.sh@36 -- # local sub_id=1 00:27:33.509 23:05:24 -- target/dif.sh@38 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:27:33.509 23:05:24 -- common/autotest_common.sh@551 -- # xtrace_disable 00:27:33.509 23:05:24 -- common/autotest_common.sh@10 -- # set +x 00:27:33.509 23:05:24 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:27:33.509 23:05:24 -- target/dif.sh@39 -- # rpc_cmd bdev_null_delete bdev_null1 00:27:33.509 23:05:24 -- common/autotest_common.sh@551 -- # xtrace_disable 00:27:33.509 23:05:24 -- common/autotest_common.sh@10 -- # set +x 00:27:33.509 23:05:24 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:27:33.509 00:27:33.509 real 0m11.491s 00:27:33.509 user 0m20.409s 00:27:33.509 sys 0m1.207s 00:27:33.509 23:05:24 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:27:33.509 23:05:24 -- common/autotest_common.sh@10 -- # set +x 00:27:33.509 ************************************ 00:27:33.509 END TEST fio_dif_1_multi_subsystems 00:27:33.509 ************************************ 00:27:33.509 23:05:24 -- target/dif.sh@143 -- # run_test fio_dif_rand_params fio_dif_rand_params 00:27:33.509 23:05:24 -- common/autotest_common.sh@1077 -- # '[' 2 -le 1 ']' 00:27:33.509 23:05:24 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:27:33.509 23:05:24 -- common/autotest_common.sh@10 -- # set +x 00:27:33.509 ************************************ 00:27:33.509 START TEST fio_dif_rand_params 00:27:33.509 ************************************ 00:27:33.509 23:05:24 -- common/autotest_common.sh@1104 -- # fio_dif_rand_params 00:27:33.509 23:05:24 -- target/dif.sh@100 -- # local NULL_DIF 00:27:33.509 23:05:24 -- target/dif.sh@101 -- # local bs numjobs runtime iodepth files 00:27:33.509 23:05:24 -- target/dif.sh@103 -- # NULL_DIF=3 00:27:33.509 23:05:24 -- target/dif.sh@103 -- # bs=128k 00:27:33.509 23:05:24 -- target/dif.sh@103 -- # numjobs=3 00:27:33.509 23:05:24 -- target/dif.sh@103 -- # iodepth=3 00:27:33.509 23:05:24 -- target/dif.sh@103 -- # runtime=5 00:27:33.509 23:05:24 -- target/dif.sh@105 -- # create_subsystems 0 00:27:33.509 23:05:24 -- target/dif.sh@28 -- # local sub 00:27:33.509 23:05:24 -- target/dif.sh@30 -- # for sub in "$@" 00:27:33.509 23:05:24 -- target/dif.sh@31 -- # create_subsystem 0 00:27:33.509 23:05:24 -- target/dif.sh@18 -- # local sub_id=0 00:27:33.509 23:05:24 -- target/dif.sh@21 -- # rpc_cmd bdev_null_create bdev_null0 64 512 --md-size 16 --dif-type 3 00:27:33.509 23:05:24 -- common/autotest_common.sh@551 -- # xtrace_disable 00:27:33.509 23:05:24 -- common/autotest_common.sh@10 -- # set +x 00:27:33.509 bdev_null0 00:27:33.509 23:05:24 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:27:33.509 23:05:24 -- target/dif.sh@22 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode0 --serial-number 53313233-0 --allow-any-host 00:27:33.509 23:05:24 -- common/autotest_common.sh@551 -- # xtrace_disable 00:27:33.509 23:05:24 -- common/autotest_common.sh@10 -- # set +x 00:27:33.509 23:05:24 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:27:33.509 23:05:24 -- target/dif.sh@23 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode0 bdev_null0 00:27:33.509 23:05:24 -- common/autotest_common.sh@551 -- # xtrace_disable 00:27:33.509 23:05:24 -- common/autotest_common.sh@10 -- # set +x 00:27:33.509 23:05:24 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:27:33.509 23:05:24 -- target/dif.sh@24 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode0 -t tcp -a 10.0.0.2 -s 4420 00:27:33.509 23:05:24 -- common/autotest_common.sh@551 -- # xtrace_disable 00:27:33.510 23:05:24 -- common/autotest_common.sh@10 -- # set +x 00:27:33.510 [2024-04-16 23:05:24.417220] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:27:33.510 23:05:24 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:27:33.510 23:05:24 -- target/dif.sh@106 -- # fio /dev/fd/62 00:27:33.510 23:05:24 -- target/dif.sh@106 -- # create_json_sub_conf 0 00:27:33.510 23:05:24 -- target/dif.sh@51 -- # gen_nvmf_target_json 0 00:27:33.510 23:05:24 -- nvmf/common.sh@520 -- # config=() 00:27:33.510 23:05:24 -- nvmf/common.sh@520 -- # local subsystem config 00:27:33.510 23:05:24 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:27:33.510 23:05:24 -- target/dif.sh@82 -- # fio_bdev --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:27:33.510 23:05:24 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:27:33.510 { 00:27:33.510 "params": { 00:27:33.510 "name": "Nvme$subsystem", 00:27:33.510 "trtype": "$TEST_TRANSPORT", 00:27:33.510 "traddr": "$NVMF_FIRST_TARGET_IP", 00:27:33.510 "adrfam": "ipv4", 00:27:33.510 "trsvcid": "$NVMF_PORT", 00:27:33.510 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:27:33.510 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:27:33.510 "hdgst": ${hdgst:-false}, 00:27:33.510 "ddgst": ${ddgst:-false} 00:27:33.510 }, 00:27:33.510 "method": "bdev_nvme_attach_controller" 00:27:33.510 } 00:27:33.510 EOF 00:27:33.510 )") 00:27:33.510 23:05:24 -- target/dif.sh@82 -- # gen_fio_conf 00:27:33.510 23:05:24 -- common/autotest_common.sh@1335 -- # fio_plugin /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:27:33.510 23:05:24 -- target/dif.sh@54 -- # local file 00:27:33.510 23:05:24 -- target/dif.sh@56 -- # cat 00:27:33.510 23:05:24 -- common/autotest_common.sh@1316 -- # local fio_dir=/usr/src/fio 00:27:33.510 23:05:24 -- common/autotest_common.sh@1318 -- # sanitizers=('libasan' 'libclang_rt.asan') 00:27:33.510 23:05:24 -- common/autotest_common.sh@1318 -- # local sanitizers 00:27:33.510 23:05:24 -- common/autotest_common.sh@1319 -- # local plugin=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:27:33.510 23:05:24 -- common/autotest_common.sh@1320 -- # shift 00:27:33.510 23:05:24 -- nvmf/common.sh@542 -- # cat 00:27:33.510 23:05:24 -- common/autotest_common.sh@1322 -- # local asan_lib= 00:27:33.510 23:05:24 -- common/autotest_common.sh@1323 -- # for sanitizer in "${sanitizers[@]}" 00:27:33.510 23:05:24 -- target/dif.sh@72 -- # (( file = 1 )) 00:27:33.510 23:05:24 -- target/dif.sh@72 -- # (( file <= files )) 00:27:33.510 23:05:24 -- common/autotest_common.sh@1324 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:27:33.510 23:05:24 -- common/autotest_common.sh@1324 -- # grep libasan 00:27:33.510 23:05:24 -- common/autotest_common.sh@1324 -- # awk '{print $3}' 00:27:33.510 23:05:24 -- nvmf/common.sh@544 -- # jq . 00:27:33.510 23:05:24 -- nvmf/common.sh@545 -- # IFS=, 00:27:33.510 23:05:24 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:27:33.510 "params": { 00:27:33.510 "name": "Nvme0", 00:27:33.510 "trtype": "tcp", 00:27:33.510 "traddr": "10.0.0.2", 00:27:33.510 "adrfam": "ipv4", 00:27:33.510 "trsvcid": "4420", 00:27:33.510 "subnqn": "nqn.2016-06.io.spdk:cnode0", 00:27:33.510 "hostnqn": "nqn.2016-06.io.spdk:host0", 00:27:33.510 "hdgst": false, 00:27:33.510 "ddgst": false 00:27:33.510 }, 00:27:33.510 "method": "bdev_nvme_attach_controller" 00:27:33.510 }' 00:27:33.510 23:05:24 -- common/autotest_common.sh@1324 -- # asan_lib= 00:27:33.510 23:05:24 -- common/autotest_common.sh@1325 -- # [[ -n '' ]] 00:27:33.510 23:05:24 -- common/autotest_common.sh@1323 -- # for sanitizer in "${sanitizers[@]}" 00:27:33.510 23:05:24 -- common/autotest_common.sh@1324 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:27:33.510 23:05:24 -- common/autotest_common.sh@1324 -- # grep libclang_rt.asan 00:27:33.510 23:05:24 -- common/autotest_common.sh@1324 -- # awk '{print $3}' 00:27:33.510 23:05:24 -- common/autotest_common.sh@1324 -- # asan_lib= 00:27:33.510 23:05:24 -- common/autotest_common.sh@1325 -- # [[ -n '' ]] 00:27:33.510 23:05:24 -- common/autotest_common.sh@1331 -- # LD_PRELOAD=' /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev' 00:27:33.510 23:05:24 -- common/autotest_common.sh@1331 -- # /usr/src/fio/fio --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:27:33.768 filename0: (g=0): rw=randread, bs=(R) 128KiB-128KiB, (W) 128KiB-128KiB, (T) 128KiB-128KiB, ioengine=spdk_bdev, iodepth=3 00:27:33.768 ... 00:27:33.768 fio-3.35 00:27:33.768 Starting 3 threads 00:27:33.768 EAL: No free 2048 kB hugepages reported on node 1 00:27:34.026 [2024-04-16 23:05:25.076599] rpc.c: 181:spdk_rpc_listen: *ERROR*: RPC Unix domain socket path /var/tmp/spdk.sock in use. Specify another. 00:27:34.026 [2024-04-16 23:05:25.076669] rpc.c: 90:spdk_rpc_initialize: *ERROR*: Unable to start RPC service at /var/tmp/spdk.sock 00:27:39.287 00:27:39.287 filename0: (groupid=0, jobs=1): err= 0: pid=404823: Tue Apr 16 23:05:30 2024 00:27:39.287 read: IOPS=203, BW=25.4MiB/s (26.7MB/s)(128MiB/5046msec) 00:27:39.287 slat (nsec): min=6938, max=45622, avg=13867.53, stdev=4214.67 00:27:39.287 clat (usec): min=5685, max=89303, avg=14690.71, stdev=12519.37 00:27:39.287 lat (usec): min=5696, max=89314, avg=14704.58, stdev=12519.52 00:27:39.287 clat percentiles (usec): 00:27:39.287 | 1.00th=[ 6194], 5.00th=[ 6915], 10.00th=[ 7898], 20.00th=[ 8586], 00:27:39.287 | 30.00th=[ 9110], 40.00th=[ 9634], 50.00th=[10814], 60.00th=[11731], 00:27:39.287 | 70.00th=[12518], 80.00th=[13698], 90.00th=[45876], 95.00th=[50594], 00:27:39.287 | 99.00th=[53740], 99.50th=[53740], 99.90th=[55313], 99.95th=[89654], 00:27:39.287 | 99.99th=[89654] 00:27:39.287 bw ( KiB/s): min=20736, max=34304, per=32.29%, avg=26214.40, stdev=4504.44, samples=10 00:27:39.287 iops : min= 162, max= 268, avg=204.80, stdev=35.19, samples=10 00:27:39.287 lat (msec) : 10=43.27%, 20=46.69%, 50=3.70%, 100=6.34% 00:27:39.287 cpu : usr=93.84%, sys=5.71%, ctx=20, majf=0, minf=75 00:27:39.287 IO depths : 1=1.1%, 2=98.9%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:27:39.287 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:27:39.287 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:27:39.287 issued rwts: total=1026,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:27:39.287 latency : target=0, window=0, percentile=100.00%, depth=3 00:27:39.287 filename0: (groupid=0, jobs=1): err= 0: pid=404824: Tue Apr 16 23:05:30 2024 00:27:39.287 read: IOPS=242, BW=30.3MiB/s (31.8MB/s)(153MiB/5045msec) 00:27:39.287 slat (nsec): min=7052, max=88764, avg=13786.45, stdev=4673.48 00:27:39.287 clat (usec): min=4915, max=92971, avg=12321.71, stdev=10282.49 00:27:39.287 lat (usec): min=4926, max=92989, avg=12335.49, stdev=10282.56 00:27:39.287 clat percentiles (usec): 00:27:39.287 | 1.00th=[ 5407], 5.00th=[ 5866], 10.00th=[ 6325], 20.00th=[ 7963], 00:27:39.287 | 30.00th=[ 8586], 40.00th=[ 8979], 50.00th=[ 9634], 60.00th=[10683], 00:27:39.287 | 70.00th=[11600], 80.00th=[12518], 90.00th=[14615], 95.00th=[48497], 00:27:39.287 | 99.00th=[54264], 99.50th=[55837], 99.90th=[56361], 99.95th=[92799], 00:27:39.287 | 99.99th=[92799] 00:27:39.288 bw ( KiB/s): min=20736, max=45568, per=38.51%, avg=31257.60, stdev=7467.96, samples=10 00:27:39.288 iops : min= 162, max= 356, avg=244.20, stdev=58.34, samples=10 00:27:39.288 lat (msec) : 10=53.64%, 20=40.39%, 50=2.29%, 100=3.68% 00:27:39.288 cpu : usr=93.70%, sys=5.85%, ctx=9, majf=0, minf=128 00:27:39.288 IO depths : 1=1.1%, 2=98.9%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:27:39.288 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:27:39.288 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:27:39.288 issued rwts: total=1223,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:27:39.288 latency : target=0, window=0, percentile=100.00%, depth=3 00:27:39.288 filename0: (groupid=0, jobs=1): err= 0: pid=404825: Tue Apr 16 23:05:30 2024 00:27:39.288 read: IOPS=189, BW=23.7MiB/s (24.9MB/s)(119MiB/5006msec) 00:27:39.288 slat (nsec): min=4850, max=59786, avg=17462.81, stdev=6233.52 00:27:39.288 clat (usec): min=5463, max=93755, avg=15759.38, stdev=14747.07 00:27:39.288 lat (usec): min=5472, max=93774, avg=15776.84, stdev=14747.02 00:27:39.288 clat percentiles (usec): 00:27:39.288 | 1.00th=[ 5800], 5.00th=[ 6259], 10.00th=[ 7635], 20.00th=[ 8356], 00:27:39.288 | 30.00th=[ 8979], 40.00th=[ 9896], 50.00th=[10814], 60.00th=[11469], 00:27:39.288 | 70.00th=[12125], 80.00th=[13173], 90.00th=[49546], 95.00th=[52167], 00:27:39.288 | 99.00th=[54264], 99.50th=[58983], 99.90th=[93848], 99.95th=[93848], 00:27:39.288 | 99.99th=[93848] 00:27:39.288 bw ( KiB/s): min=13568, max=35840, per=29.90%, avg=24268.80, stdev=6722.19, samples=10 00:27:39.288 iops : min= 106, max= 280, avg=189.60, stdev=52.52, samples=10 00:27:39.288 lat (msec) : 10=40.69%, 20=46.16%, 50=4.31%, 100=8.83% 00:27:39.288 cpu : usr=92.55%, sys=5.73%, ctx=370, majf=0, minf=164 00:27:39.288 IO depths : 1=3.5%, 2=96.5%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:27:39.288 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:27:39.288 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:27:39.288 issued rwts: total=951,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:27:39.288 latency : target=0, window=0, percentile=100.00%, depth=3 00:27:39.288 00:27:39.288 Run status group 0 (all jobs): 00:27:39.288 READ: bw=79.3MiB/s (83.1MB/s), 23.7MiB/s-30.3MiB/s (24.9MB/s-31.8MB/s), io=400MiB (419MB), run=5006-5046msec 00:27:39.548 23:05:30 -- target/dif.sh@107 -- # destroy_subsystems 0 00:27:39.548 23:05:30 -- target/dif.sh@43 -- # local sub 00:27:39.548 23:05:30 -- target/dif.sh@45 -- # for sub in "$@" 00:27:39.548 23:05:30 -- target/dif.sh@46 -- # destroy_subsystem 0 00:27:39.548 23:05:30 -- target/dif.sh@36 -- # local sub_id=0 00:27:39.548 23:05:30 -- target/dif.sh@38 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode0 00:27:39.548 23:05:30 -- common/autotest_common.sh@551 -- # xtrace_disable 00:27:39.548 23:05:30 -- common/autotest_common.sh@10 -- # set +x 00:27:39.548 23:05:30 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:27:39.548 23:05:30 -- target/dif.sh@39 -- # rpc_cmd bdev_null_delete bdev_null0 00:27:39.548 23:05:30 -- common/autotest_common.sh@551 -- # xtrace_disable 00:27:39.548 23:05:30 -- common/autotest_common.sh@10 -- # set +x 00:27:39.548 23:05:30 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:27:39.548 23:05:30 -- target/dif.sh@109 -- # NULL_DIF=2 00:27:39.548 23:05:30 -- target/dif.sh@109 -- # bs=4k 00:27:39.548 23:05:30 -- target/dif.sh@109 -- # numjobs=8 00:27:39.548 23:05:30 -- target/dif.sh@109 -- # iodepth=16 00:27:39.548 23:05:30 -- target/dif.sh@109 -- # runtime= 00:27:39.548 23:05:30 -- target/dif.sh@109 -- # files=2 00:27:39.548 23:05:30 -- target/dif.sh@111 -- # create_subsystems 0 1 2 00:27:39.548 23:05:30 -- target/dif.sh@28 -- # local sub 00:27:39.548 23:05:30 -- target/dif.sh@30 -- # for sub in "$@" 00:27:39.548 23:05:30 -- target/dif.sh@31 -- # create_subsystem 0 00:27:39.548 23:05:30 -- target/dif.sh@18 -- # local sub_id=0 00:27:39.548 23:05:30 -- target/dif.sh@21 -- # rpc_cmd bdev_null_create bdev_null0 64 512 --md-size 16 --dif-type 2 00:27:39.548 23:05:30 -- common/autotest_common.sh@551 -- # xtrace_disable 00:27:39.548 23:05:30 -- common/autotest_common.sh@10 -- # set +x 00:27:39.548 bdev_null0 00:27:39.548 23:05:30 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:27:39.548 23:05:30 -- target/dif.sh@22 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode0 --serial-number 53313233-0 --allow-any-host 00:27:39.548 23:05:30 -- common/autotest_common.sh@551 -- # xtrace_disable 00:27:39.548 23:05:30 -- common/autotest_common.sh@10 -- # set +x 00:27:39.548 23:05:30 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:27:39.548 23:05:30 -- target/dif.sh@23 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode0 bdev_null0 00:27:39.548 23:05:30 -- common/autotest_common.sh@551 -- # xtrace_disable 00:27:39.548 23:05:30 -- common/autotest_common.sh@10 -- # set +x 00:27:39.548 23:05:30 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:27:39.548 23:05:30 -- target/dif.sh@24 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode0 -t tcp -a 10.0.0.2 -s 4420 00:27:39.548 23:05:30 -- common/autotest_common.sh@551 -- # xtrace_disable 00:27:39.548 23:05:30 -- common/autotest_common.sh@10 -- # set +x 00:27:39.548 [2024-04-16 23:05:30.504634] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:27:39.548 23:05:30 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:27:39.548 23:05:30 -- target/dif.sh@30 -- # for sub in "$@" 00:27:39.548 23:05:30 -- target/dif.sh@31 -- # create_subsystem 1 00:27:39.548 23:05:30 -- target/dif.sh@18 -- # local sub_id=1 00:27:39.548 23:05:30 -- target/dif.sh@21 -- # rpc_cmd bdev_null_create bdev_null1 64 512 --md-size 16 --dif-type 2 00:27:39.548 23:05:30 -- common/autotest_common.sh@551 -- # xtrace_disable 00:27:39.548 23:05:30 -- common/autotest_common.sh@10 -- # set +x 00:27:39.548 bdev_null1 00:27:39.548 23:05:30 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:27:39.548 23:05:30 -- target/dif.sh@22 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 --serial-number 53313233-1 --allow-any-host 00:27:39.548 23:05:30 -- common/autotest_common.sh@551 -- # xtrace_disable 00:27:39.548 23:05:30 -- common/autotest_common.sh@10 -- # set +x 00:27:39.548 23:05:30 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:27:39.548 23:05:30 -- target/dif.sh@23 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 bdev_null1 00:27:39.548 23:05:30 -- common/autotest_common.sh@551 -- # xtrace_disable 00:27:39.548 23:05:30 -- common/autotest_common.sh@10 -- # set +x 00:27:39.548 23:05:30 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:27:39.548 23:05:30 -- target/dif.sh@24 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:27:39.548 23:05:30 -- common/autotest_common.sh@551 -- # xtrace_disable 00:27:39.548 23:05:30 -- common/autotest_common.sh@10 -- # set +x 00:27:39.548 23:05:30 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:27:39.548 23:05:30 -- target/dif.sh@30 -- # for sub in "$@" 00:27:39.548 23:05:30 -- target/dif.sh@31 -- # create_subsystem 2 00:27:39.548 23:05:30 -- target/dif.sh@18 -- # local sub_id=2 00:27:39.548 23:05:30 -- target/dif.sh@21 -- # rpc_cmd bdev_null_create bdev_null2 64 512 --md-size 16 --dif-type 2 00:27:39.548 23:05:30 -- common/autotest_common.sh@551 -- # xtrace_disable 00:27:39.548 23:05:30 -- common/autotest_common.sh@10 -- # set +x 00:27:39.548 bdev_null2 00:27:39.548 23:05:30 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:27:39.548 23:05:30 -- target/dif.sh@22 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode2 --serial-number 53313233-2 --allow-any-host 00:27:39.548 23:05:30 -- common/autotest_common.sh@551 -- # xtrace_disable 00:27:39.548 23:05:30 -- common/autotest_common.sh@10 -- # set +x 00:27:39.548 23:05:30 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:27:39.548 23:05:30 -- target/dif.sh@23 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode2 bdev_null2 00:27:39.548 23:05:30 -- common/autotest_common.sh@551 -- # xtrace_disable 00:27:39.548 23:05:30 -- common/autotest_common.sh@10 -- # set +x 00:27:39.548 23:05:30 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:27:39.548 23:05:30 -- target/dif.sh@24 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode2 -t tcp -a 10.0.0.2 -s 4420 00:27:39.548 23:05:30 -- common/autotest_common.sh@551 -- # xtrace_disable 00:27:39.548 23:05:30 -- common/autotest_common.sh@10 -- # set +x 00:27:39.548 23:05:30 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:27:39.548 23:05:30 -- target/dif.sh@112 -- # fio /dev/fd/62 00:27:39.548 23:05:30 -- target/dif.sh@112 -- # create_json_sub_conf 0 1 2 00:27:39.548 23:05:30 -- target/dif.sh@51 -- # gen_nvmf_target_json 0 1 2 00:27:39.548 23:05:30 -- nvmf/common.sh@520 -- # config=() 00:27:39.548 23:05:30 -- nvmf/common.sh@520 -- # local subsystem config 00:27:39.548 23:05:30 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:27:39.548 23:05:30 -- target/dif.sh@82 -- # fio_bdev --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:27:39.548 23:05:30 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:27:39.548 { 00:27:39.548 "params": { 00:27:39.548 "name": "Nvme$subsystem", 00:27:39.548 "trtype": "$TEST_TRANSPORT", 00:27:39.548 "traddr": "$NVMF_FIRST_TARGET_IP", 00:27:39.548 "adrfam": "ipv4", 00:27:39.548 "trsvcid": "$NVMF_PORT", 00:27:39.548 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:27:39.548 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:27:39.548 "hdgst": ${hdgst:-false}, 00:27:39.548 "ddgst": ${ddgst:-false} 00:27:39.548 }, 00:27:39.548 "method": "bdev_nvme_attach_controller" 00:27:39.548 } 00:27:39.548 EOF 00:27:39.548 )") 00:27:39.548 23:05:30 -- common/autotest_common.sh@1335 -- # fio_plugin /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:27:39.548 23:05:30 -- common/autotest_common.sh@1316 -- # local fio_dir=/usr/src/fio 00:27:39.548 23:05:30 -- target/dif.sh@82 -- # gen_fio_conf 00:27:39.548 23:05:30 -- common/autotest_common.sh@1318 -- # sanitizers=('libasan' 'libclang_rt.asan') 00:27:39.548 23:05:30 -- target/dif.sh@54 -- # local file 00:27:39.548 23:05:30 -- common/autotest_common.sh@1318 -- # local sanitizers 00:27:39.548 23:05:30 -- target/dif.sh@56 -- # cat 00:27:39.548 23:05:30 -- common/autotest_common.sh@1319 -- # local plugin=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:27:39.548 23:05:30 -- common/autotest_common.sh@1320 -- # shift 00:27:39.548 23:05:30 -- common/autotest_common.sh@1322 -- # local asan_lib= 00:27:39.548 23:05:30 -- common/autotest_common.sh@1323 -- # for sanitizer in "${sanitizers[@]}" 00:27:39.548 23:05:30 -- nvmf/common.sh@542 -- # cat 00:27:39.548 23:05:30 -- common/autotest_common.sh@1324 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:27:39.548 23:05:30 -- common/autotest_common.sh@1324 -- # grep libasan 00:27:39.548 23:05:30 -- target/dif.sh@72 -- # (( file = 1 )) 00:27:39.548 23:05:30 -- target/dif.sh@72 -- # (( file <= files )) 00:27:39.548 23:05:30 -- common/autotest_common.sh@1324 -- # awk '{print $3}' 00:27:39.548 23:05:30 -- target/dif.sh@73 -- # cat 00:27:39.548 23:05:30 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:27:39.548 23:05:30 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:27:39.548 { 00:27:39.548 "params": { 00:27:39.548 "name": "Nvme$subsystem", 00:27:39.548 "trtype": "$TEST_TRANSPORT", 00:27:39.548 "traddr": "$NVMF_FIRST_TARGET_IP", 00:27:39.548 "adrfam": "ipv4", 00:27:39.548 "trsvcid": "$NVMF_PORT", 00:27:39.548 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:27:39.548 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:27:39.549 "hdgst": ${hdgst:-false}, 00:27:39.549 "ddgst": ${ddgst:-false} 00:27:39.549 }, 00:27:39.549 "method": "bdev_nvme_attach_controller" 00:27:39.549 } 00:27:39.549 EOF 00:27:39.549 )") 00:27:39.549 23:05:30 -- nvmf/common.sh@542 -- # cat 00:27:39.549 23:05:30 -- target/dif.sh@72 -- # (( file++ )) 00:27:39.549 23:05:30 -- target/dif.sh@72 -- # (( file <= files )) 00:27:39.549 23:05:30 -- target/dif.sh@73 -- # cat 00:27:39.549 23:05:30 -- target/dif.sh@72 -- # (( file++ )) 00:27:39.549 23:05:30 -- target/dif.sh@72 -- # (( file <= files )) 00:27:39.549 23:05:30 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:27:39.549 23:05:30 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:27:39.549 { 00:27:39.549 "params": { 00:27:39.549 "name": "Nvme$subsystem", 00:27:39.549 "trtype": "$TEST_TRANSPORT", 00:27:39.549 "traddr": "$NVMF_FIRST_TARGET_IP", 00:27:39.549 "adrfam": "ipv4", 00:27:39.549 "trsvcid": "$NVMF_PORT", 00:27:39.549 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:27:39.549 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:27:39.549 "hdgst": ${hdgst:-false}, 00:27:39.549 "ddgst": ${ddgst:-false} 00:27:39.549 }, 00:27:39.549 "method": "bdev_nvme_attach_controller" 00:27:39.549 } 00:27:39.549 EOF 00:27:39.549 )") 00:27:39.549 23:05:30 -- nvmf/common.sh@542 -- # cat 00:27:39.549 23:05:30 -- nvmf/common.sh@544 -- # jq . 00:27:39.549 23:05:30 -- nvmf/common.sh@545 -- # IFS=, 00:27:39.549 23:05:30 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:27:39.549 "params": { 00:27:39.549 "name": "Nvme0", 00:27:39.549 "trtype": "tcp", 00:27:39.549 "traddr": "10.0.0.2", 00:27:39.549 "adrfam": "ipv4", 00:27:39.549 "trsvcid": "4420", 00:27:39.549 "subnqn": "nqn.2016-06.io.spdk:cnode0", 00:27:39.549 "hostnqn": "nqn.2016-06.io.spdk:host0", 00:27:39.549 "hdgst": false, 00:27:39.549 "ddgst": false 00:27:39.549 }, 00:27:39.549 "method": "bdev_nvme_attach_controller" 00:27:39.549 },{ 00:27:39.549 "params": { 00:27:39.549 "name": "Nvme1", 00:27:39.549 "trtype": "tcp", 00:27:39.549 "traddr": "10.0.0.2", 00:27:39.549 "adrfam": "ipv4", 00:27:39.549 "trsvcid": "4420", 00:27:39.549 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:27:39.549 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:27:39.549 "hdgst": false, 00:27:39.549 "ddgst": false 00:27:39.549 }, 00:27:39.549 "method": "bdev_nvme_attach_controller" 00:27:39.549 },{ 00:27:39.549 "params": { 00:27:39.549 "name": "Nvme2", 00:27:39.549 "trtype": "tcp", 00:27:39.549 "traddr": "10.0.0.2", 00:27:39.549 "adrfam": "ipv4", 00:27:39.549 "trsvcid": "4420", 00:27:39.549 "subnqn": "nqn.2016-06.io.spdk:cnode2", 00:27:39.549 "hostnqn": "nqn.2016-06.io.spdk:host2", 00:27:39.549 "hdgst": false, 00:27:39.549 "ddgst": false 00:27:39.549 }, 00:27:39.549 "method": "bdev_nvme_attach_controller" 00:27:39.549 }' 00:27:39.549 23:05:30 -- common/autotest_common.sh@1324 -- # asan_lib= 00:27:39.549 23:05:30 -- common/autotest_common.sh@1325 -- # [[ -n '' ]] 00:27:39.549 23:05:30 -- common/autotest_common.sh@1323 -- # for sanitizer in "${sanitizers[@]}" 00:27:39.549 23:05:30 -- common/autotest_common.sh@1324 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:27:39.549 23:05:30 -- common/autotest_common.sh@1324 -- # grep libclang_rt.asan 00:27:39.549 23:05:30 -- common/autotest_common.sh@1324 -- # awk '{print $3}' 00:27:39.549 23:05:30 -- common/autotest_common.sh@1324 -- # asan_lib= 00:27:39.549 23:05:30 -- common/autotest_common.sh@1325 -- # [[ -n '' ]] 00:27:39.549 23:05:30 -- common/autotest_common.sh@1331 -- # LD_PRELOAD=' /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev' 00:27:39.549 23:05:30 -- common/autotest_common.sh@1331 -- # /usr/src/fio/fio --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:27:39.809 filename0: (g=0): rw=randread, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=spdk_bdev, iodepth=16 00:27:39.809 ... 00:27:39.809 filename1: (g=0): rw=randread, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=spdk_bdev, iodepth=16 00:27:39.809 ... 00:27:39.809 filename2: (g=0): rw=randread, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=spdk_bdev, iodepth=16 00:27:39.809 ... 00:27:39.809 fio-3.35 00:27:39.809 Starting 24 threads 00:27:39.809 EAL: No free 2048 kB hugepages reported on node 1 00:27:40.746 [2024-04-16 23:05:31.753635] rpc.c: 181:spdk_rpc_listen: *ERROR*: RPC Unix domain socket path /var/tmp/spdk.sock in use. Specify another. 00:27:40.747 [2024-04-16 23:05:31.753696] rpc.c: 90:spdk_rpc_initialize: *ERROR*: Unable to start RPC service at /var/tmp/spdk.sock 00:27:53.017 00:27:53.017 filename0: (groupid=0, jobs=1): err= 0: pid=405716: Tue Apr 16 23:05:42 2024 00:27:53.017 read: IOPS=41, BW=164KiB/s (168kB/s)(1664KiB/10116msec) 00:27:53.017 slat (nsec): min=7471, max=50627, avg=30359.80, stdev=9260.29 00:27:53.017 clat (msec): min=253, max=718, avg=388.79, stdev=74.68 00:27:53.017 lat (msec): min=253, max=718, avg=388.82, stdev=74.68 00:27:53.017 clat percentiles (msec): 00:27:53.017 | 1.00th=[ 300], 5.00th=[ 305], 10.00th=[ 338], 20.00th=[ 351], 00:27:53.017 | 30.00th=[ 355], 40.00th=[ 368], 50.00th=[ 380], 60.00th=[ 384], 00:27:53.017 | 70.00th=[ 397], 80.00th=[ 405], 90.00th=[ 430], 95.00th=[ 468], 00:27:53.017 | 99.00th=[ 718], 99.50th=[ 718], 99.90th=[ 718], 99.95th=[ 718], 00:27:53.017 | 99.99th=[ 718] 00:27:53.017 bw ( KiB/s): min= 128, max= 256, per=3.45%, avg=168.42, stdev=57.78, samples=19 00:27:53.017 iops : min= 32, max= 64, avg=42.11, stdev=14.44, samples=19 00:27:53.017 lat (msec) : 500=96.15%, 750=3.85% 00:27:53.017 cpu : usr=98.66%, sys=0.94%, ctx=23, majf=0, minf=41 00:27:53.017 IO depths : 1=4.3%, 2=10.6%, 4=25.0%, 8=51.9%, 16=8.2%, 32=0.0%, >=64=0.0% 00:27:53.017 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:27:53.017 complete : 0=0.0%, 4=94.2%, 8=0.0%, 16=5.8%, 32=0.0%, 64=0.0%, >=64=0.0% 00:27:53.017 issued rwts: total=416,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:27:53.017 latency : target=0, window=0, percentile=100.00%, depth=16 00:27:53.017 filename0: (groupid=0, jobs=1): err= 0: pid=405717: Tue Apr 16 23:05:42 2024 00:27:53.017 read: IOPS=59, BW=239KiB/s (245kB/s)(2424KiB/10133msec) 00:27:53.017 slat (usec): min=7, max=118, avg=12.09, stdev=10.80 00:27:53.017 clat (msec): min=160, max=509, avg=266.33, stdev=55.69 00:27:53.017 lat (msec): min=160, max=509, avg=266.34, stdev=55.69 00:27:53.017 clat percentiles (msec): 00:27:53.017 | 1.00th=[ 194], 5.00th=[ 215], 10.00th=[ 215], 20.00th=[ 226], 00:27:53.017 | 30.00th=[ 232], 40.00th=[ 243], 50.00th=[ 255], 60.00th=[ 268], 00:27:53.017 | 70.00th=[ 284], 80.00th=[ 292], 90.00th=[ 330], 95.00th=[ 388], 00:27:53.017 | 99.00th=[ 472], 99.50th=[ 472], 99.90th=[ 510], 99.95th=[ 510], 00:27:53.017 | 99.99th=[ 510] 00:27:53.017 bw ( KiB/s): min= 128, max= 256, per=4.84%, avg=236.00, stdev=39.83, samples=20 00:27:53.017 iops : min= 32, max= 64, avg=59.00, stdev= 9.96, samples=20 00:27:53.017 lat (msec) : 250=45.87%, 500=53.80%, 750=0.33% 00:27:53.017 cpu : usr=98.41%, sys=1.01%, ctx=38, majf=0, minf=66 00:27:53.017 IO depths : 1=0.3%, 2=1.0%, 4=7.9%, 8=78.4%, 16=12.4%, 32=0.0%, >=64=0.0% 00:27:53.017 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:27:53.017 complete : 0=0.0%, 4=89.1%, 8=5.6%, 16=5.3%, 32=0.0%, 64=0.0%, >=64=0.0% 00:27:53.017 issued rwts: total=606,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:27:53.017 latency : target=0, window=0, percentile=100.00%, depth=16 00:27:53.017 filename0: (groupid=0, jobs=1): err= 0: pid=405718: Tue Apr 16 23:05:42 2024 00:27:53.017 read: IOPS=42, BW=171KiB/s (175kB/s)(1728KiB/10130msec) 00:27:53.017 slat (usec): min=3, max=131, avg=21.53, stdev=19.75 00:27:53.017 clat (msec): min=183, max=589, avg=374.96, stdev=62.90 00:27:53.017 lat (msec): min=183, max=589, avg=374.99, stdev=62.90 00:27:53.017 clat percentiles (msec): 00:27:53.017 | 1.00th=[ 197], 5.00th=[ 255], 10.00th=[ 347], 20.00th=[ 355], 00:27:53.017 | 30.00th=[ 363], 40.00th=[ 363], 50.00th=[ 376], 60.00th=[ 384], 00:27:53.017 | 70.00th=[ 393], 80.00th=[ 405], 90.00th=[ 422], 95.00th=[ 426], 00:27:53.017 | 99.00th=[ 592], 99.50th=[ 592], 99.90th=[ 592], 99.95th=[ 592], 00:27:53.017 | 99.99th=[ 592] 00:27:53.017 bw ( KiB/s): min= 128, max= 256, per=3.59%, avg=175.16, stdev=63.44, samples=19 00:27:53.017 iops : min= 32, max= 64, avg=43.79, stdev=15.86, samples=19 00:27:53.017 lat (msec) : 250=3.70%, 500=92.59%, 750=3.70% 00:27:53.017 cpu : usr=97.90%, sys=1.23%, ctx=59, majf=0, minf=32 00:27:53.017 IO depths : 1=6.0%, 2=12.3%, 4=25.0%, 8=50.2%, 16=6.5%, 32=0.0%, >=64=0.0% 00:27:53.017 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:27:53.017 complete : 0=0.0%, 4=94.1%, 8=0.0%, 16=5.9%, 32=0.0%, 64=0.0%, >=64=0.0% 00:27:53.017 issued rwts: total=432,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:27:53.017 latency : target=0, window=0, percentile=100.00%, depth=16 00:27:53.017 filename0: (groupid=0, jobs=1): err= 0: pid=405719: Tue Apr 16 23:05:42 2024 00:27:53.017 read: IOPS=61, BW=247KiB/s (253kB/s)(2504KiB/10153msec) 00:27:53.017 slat (usec): min=3, max=117, avg=15.37, stdev=19.30 00:27:53.017 clat (msec): min=159, max=389, avg=257.65, stdev=51.78 00:27:53.017 lat (msec): min=159, max=389, avg=257.67, stdev=51.79 00:27:53.017 clat percentiles (msec): 00:27:53.017 | 1.00th=[ 161], 5.00th=[ 174], 10.00th=[ 194], 20.00th=[ 220], 00:27:53.017 | 30.00th=[ 228], 40.00th=[ 241], 50.00th=[ 255], 60.00th=[ 271], 00:27:53.017 | 70.00th=[ 288], 80.00th=[ 300], 90.00th=[ 313], 95.00th=[ 372], 00:27:53.017 | 99.00th=[ 380], 99.50th=[ 388], 99.90th=[ 388], 99.95th=[ 388], 00:27:53.018 | 99.99th=[ 388] 00:27:53.018 bw ( KiB/s): min= 128, max= 336, per=5.01%, avg=244.00, stdev=55.64, samples=20 00:27:53.018 iops : min= 32, max= 84, avg=61.00, stdev=13.91, samples=20 00:27:53.018 lat (msec) : 250=47.60%, 500=52.40% 00:27:53.018 cpu : usr=98.69%, sys=0.88%, ctx=19, majf=0, minf=50 00:27:53.018 IO depths : 1=0.5%, 2=3.2%, 4=14.2%, 8=70.0%, 16=12.1%, 32=0.0%, >=64=0.0% 00:27:53.018 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:27:53.018 complete : 0=0.0%, 4=91.0%, 8=3.6%, 16=5.4%, 32=0.0%, 64=0.0%, >=64=0.0% 00:27:53.018 issued rwts: total=626,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:27:53.018 latency : target=0, window=0, percentile=100.00%, depth=16 00:27:53.018 filename0: (groupid=0, jobs=1): err= 0: pid=405720: Tue Apr 16 23:05:42 2024 00:27:53.018 read: IOPS=64, BW=258KiB/s (264kB/s)(2624KiB/10161msec) 00:27:53.018 slat (nsec): min=3672, max=52268, avg=9986.77, stdev=3406.97 00:27:53.018 clat (msec): min=144, max=320, avg=247.71, stdev=55.39 00:27:53.018 lat (msec): min=144, max=320, avg=247.72, stdev=55.39 00:27:53.018 clat percentiles (msec): 00:27:53.018 | 1.00th=[ 144], 5.00th=[ 171], 10.00th=[ 176], 20.00th=[ 180], 00:27:53.018 | 30.00th=[ 194], 40.00th=[ 253], 50.00th=[ 271], 60.00th=[ 284], 00:27:53.018 | 70.00th=[ 292], 80.00th=[ 300], 90.00th=[ 305], 95.00th=[ 313], 00:27:53.018 | 99.00th=[ 321], 99.50th=[ 321], 99.90th=[ 321], 99.95th=[ 321], 00:27:53.018 | 99.99th=[ 321] 00:27:53.018 bw ( KiB/s): min= 256, max= 256, per=5.25%, avg=256.00, stdev= 0.00, samples=20 00:27:53.018 iops : min= 64, max= 64, avg=64.00, stdev= 0.00, samples=20 00:27:53.018 lat (msec) : 250=36.59%, 500=63.41% 00:27:53.018 cpu : usr=98.08%, sys=1.33%, ctx=17, majf=0, minf=59 00:27:53.018 IO depths : 1=6.2%, 2=12.5%, 4=25.0%, 8=50.0%, 16=6.2%, 32=0.0%, >=64=0.0% 00:27:53.018 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:27:53.018 complete : 0=0.0%, 4=94.1%, 8=0.0%, 16=5.9%, 32=0.0%, 64=0.0%, >=64=0.0% 00:27:53.018 issued rwts: total=656,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:27:53.018 latency : target=0, window=0, percentile=100.00%, depth=16 00:27:53.018 filename0: (groupid=0, jobs=1): err= 0: pid=405721: Tue Apr 16 23:05:42 2024 00:27:53.018 read: IOPS=61, BW=244KiB/s (250kB/s)(2480KiB/10150msec) 00:27:53.018 slat (usec): min=6, max=144, avg=27.92, stdev=34.63 00:27:53.018 clat (msec): min=139, max=404, avg=260.59, stdev=47.58 00:27:53.018 lat (msec): min=139, max=404, avg=260.62, stdev=47.58 00:27:53.018 clat percentiles (msec): 00:27:53.018 | 1.00th=[ 153], 5.00th=[ 184], 10.00th=[ 203], 20.00th=[ 226], 00:27:53.018 | 30.00th=[ 232], 40.00th=[ 243], 50.00th=[ 255], 60.00th=[ 271], 00:27:53.018 | 70.00th=[ 288], 80.00th=[ 296], 90.00th=[ 309], 95.00th=[ 342], 00:27:53.018 | 99.00th=[ 401], 99.50th=[ 405], 99.90th=[ 405], 99.95th=[ 405], 00:27:53.018 | 99.99th=[ 405] 00:27:53.018 bw ( KiB/s): min= 128, max= 256, per=4.94%, avg=241.60, stdev=34.00, samples=20 00:27:53.018 iops : min= 32, max= 64, avg=60.40, stdev= 8.50, samples=20 00:27:53.018 lat (msec) : 250=42.58%, 500=57.42% 00:27:53.018 cpu : usr=98.00%, sys=1.12%, ctx=83, majf=0, minf=40 00:27:53.018 IO depths : 1=1.0%, 2=2.7%, 4=11.3%, 8=73.2%, 16=11.8%, 32=0.0%, >=64=0.0% 00:27:53.018 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:27:53.018 complete : 0=0.0%, 4=90.2%, 8=4.5%, 16=5.3%, 32=0.0%, 64=0.0%, >=64=0.0% 00:27:53.018 issued rwts: total=620,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:27:53.018 latency : target=0, window=0, percentile=100.00%, depth=16 00:27:53.018 filename0: (groupid=0, jobs=1): err= 0: pid=405722: Tue Apr 16 23:05:42 2024 00:27:53.018 read: IOPS=59, BW=240KiB/s (245kB/s)(2432KiB/10150msec) 00:27:53.018 slat (usec): min=5, max=130, avg=19.33, stdev=25.01 00:27:53.018 clat (msec): min=144, max=453, avg=266.94, stdev=63.39 00:27:53.018 lat (msec): min=144, max=453, avg=266.96, stdev=63.41 00:27:53.018 clat percentiles (msec): 00:27:53.018 | 1.00th=[ 144], 5.00th=[ 171], 10.00th=[ 180], 20.00th=[ 194], 00:27:53.018 | 30.00th=[ 241], 40.00th=[ 264], 50.00th=[ 271], 60.00th=[ 292], 00:27:53.018 | 70.00th=[ 300], 80.00th=[ 313], 90.00th=[ 355], 95.00th=[ 372], 00:27:53.018 | 99.00th=[ 401], 99.50th=[ 401], 99.90th=[ 456], 99.95th=[ 456], 00:27:53.018 | 99.99th=[ 456] 00:27:53.018 bw ( KiB/s): min= 128, max= 368, per=4.84%, avg=236.80, stdev=57.71, samples=20 00:27:53.018 iops : min= 32, max= 92, avg=59.20, stdev=14.43, samples=20 00:27:53.018 lat (msec) : 250=30.92%, 500=69.08% 00:27:53.018 cpu : usr=98.55%, sys=0.94%, ctx=39, majf=0, minf=47 00:27:53.018 IO depths : 1=1.8%, 2=8.1%, 4=25.0%, 8=54.4%, 16=10.7%, 32=0.0%, >=64=0.0% 00:27:53.018 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:27:53.018 complete : 0=0.0%, 4=94.4%, 8=0.0%, 16=5.6%, 32=0.0%, 64=0.0%, >=64=0.0% 00:27:53.018 issued rwts: total=608,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:27:53.018 latency : target=0, window=0, percentile=100.00%, depth=16 00:27:53.018 filename0: (groupid=0, jobs=1): err= 0: pid=405723: Tue Apr 16 23:05:42 2024 00:27:53.018 read: IOPS=42, BW=171KiB/s (175kB/s)(1728KiB/10133msec) 00:27:53.018 slat (nsec): min=3999, max=68780, avg=28907.48, stdev=11543.47 00:27:53.018 clat (msec): min=211, max=710, avg=374.99, stdev=68.14 00:27:53.018 lat (msec): min=211, max=710, avg=375.01, stdev=68.14 00:27:53.018 clat percentiles (msec): 00:27:53.018 | 1.00th=[ 213], 5.00th=[ 271], 10.00th=[ 305], 20.00th=[ 347], 00:27:53.018 | 30.00th=[ 355], 40.00th=[ 368], 50.00th=[ 376], 60.00th=[ 384], 00:27:53.018 | 70.00th=[ 397], 80.00th=[ 405], 90.00th=[ 430], 95.00th=[ 468], 00:27:53.018 | 99.00th=[ 592], 99.50th=[ 592], 99.90th=[ 709], 99.95th=[ 709], 00:27:53.018 | 99.99th=[ 709] 00:27:53.018 bw ( KiB/s): min= 128, max= 256, per=3.59%, avg=175.16, stdev=63.44, samples=19 00:27:53.018 iops : min= 32, max= 64, avg=43.79, stdev=15.86, samples=19 00:27:53.018 lat (msec) : 250=3.70%, 500=92.59%, 750=3.70% 00:27:53.018 cpu : usr=98.51%, sys=0.84%, ctx=15, majf=0, minf=43 00:27:53.018 IO depths : 1=3.2%, 2=9.5%, 4=25.0%, 8=53.0%, 16=9.3%, 32=0.0%, >=64=0.0% 00:27:53.018 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:27:53.018 complete : 0=0.0%, 4=94.3%, 8=0.0%, 16=5.7%, 32=0.0%, 64=0.0%, >=64=0.0% 00:27:53.018 issued rwts: total=432,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:27:53.018 latency : target=0, window=0, percentile=100.00%, depth=16 00:27:53.018 filename1: (groupid=0, jobs=1): err= 0: pid=405724: Tue Apr 16 23:05:42 2024 00:27:53.018 read: IOPS=42, BW=171KiB/s (175kB/s)(1728KiB/10130msec) 00:27:53.018 slat (usec): min=3, max=109, avg=37.72, stdev=23.66 00:27:53.018 clat (msec): min=211, max=590, avg=374.82, stdev=61.40 00:27:53.018 lat (msec): min=211, max=590, avg=374.86, stdev=61.39 00:27:53.018 clat percentiles (msec): 00:27:53.018 | 1.00th=[ 213], 5.00th=[ 305], 10.00th=[ 309], 20.00th=[ 347], 00:27:53.018 | 30.00th=[ 355], 40.00th=[ 368], 50.00th=[ 376], 60.00th=[ 384], 00:27:53.018 | 70.00th=[ 397], 80.00th=[ 397], 90.00th=[ 418], 95.00th=[ 430], 00:27:53.018 | 99.00th=[ 592], 99.50th=[ 592], 99.90th=[ 592], 99.95th=[ 592], 00:27:53.018 | 99.99th=[ 592] 00:27:53.018 bw ( KiB/s): min= 128, max= 256, per=3.59%, avg=175.16, stdev=63.44, samples=19 00:27:53.018 iops : min= 32, max= 64, avg=43.79, stdev=15.86, samples=19 00:27:53.018 lat (msec) : 250=4.17%, 500=91.67%, 750=4.17% 00:27:53.018 cpu : usr=98.38%, sys=1.00%, ctx=52, majf=0, minf=44 00:27:53.018 IO depths : 1=5.8%, 2=12.0%, 4=25.0%, 8=50.5%, 16=6.7%, 32=0.0%, >=64=0.0% 00:27:53.018 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:27:53.018 complete : 0=0.0%, 4=94.1%, 8=0.0%, 16=5.9%, 32=0.0%, 64=0.0%, >=64=0.0% 00:27:53.018 issued rwts: total=432,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:27:53.018 latency : target=0, window=0, percentile=100.00%, depth=16 00:27:53.018 filename1: (groupid=0, jobs=1): err= 0: pid=405725: Tue Apr 16 23:05:42 2024 00:27:53.018 read: IOPS=62, BW=248KiB/s (254kB/s)(2520KiB/10150msec) 00:27:53.018 slat (nsec): min=5488, max=73234, avg=12085.43, stdev=6125.74 00:27:53.018 clat (msec): min=144, max=448, avg=255.87, stdev=52.56 00:27:53.018 lat (msec): min=144, max=448, avg=255.88, stdev=52.56 00:27:53.018 clat percentiles (msec): 00:27:53.018 | 1.00th=[ 144], 5.00th=[ 174], 10.00th=[ 176], 20.00th=[ 194], 00:27:53.018 | 30.00th=[ 230], 40.00th=[ 255], 50.00th=[ 271], 60.00th=[ 284], 00:27:53.018 | 70.00th=[ 292], 80.00th=[ 300], 90.00th=[ 309], 95.00th=[ 321], 00:27:53.018 | 99.00th=[ 359], 99.50th=[ 359], 99.90th=[ 447], 99.95th=[ 447], 00:27:53.018 | 99.99th=[ 447] 00:27:53.018 bw ( KiB/s): min= 128, max= 336, per=5.03%, avg=245.60, stdev=42.58, samples=20 00:27:53.018 iops : min= 32, max= 84, avg=61.40, stdev=10.64, samples=20 00:27:53.018 lat (msec) : 250=35.87%, 500=64.13% 00:27:53.018 cpu : usr=97.80%, sys=1.31%, ctx=73, majf=0, minf=47 00:27:53.018 IO depths : 1=0.3%, 2=5.9%, 4=22.9%, 8=58.7%, 16=12.2%, 32=0.0%, >=64=0.0% 00:27:53.018 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:27:53.018 complete : 0=0.0%, 4=93.6%, 8=0.8%, 16=5.5%, 32=0.0%, 64=0.0%, >=64=0.0% 00:27:53.018 issued rwts: total=630,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:27:53.018 latency : target=0, window=0, percentile=100.00%, depth=16 00:27:53.018 filename1: (groupid=0, jobs=1): err= 0: pid=405726: Tue Apr 16 23:05:42 2024 00:27:53.018 read: IOPS=62, BW=250KiB/s (255kB/s)(2536KiB/10164msec) 00:27:53.018 slat (nsec): min=3701, max=29569, avg=10142.48, stdev=3875.06 00:27:53.018 clat (msec): min=158, max=403, avg=255.20, stdev=43.80 00:27:53.018 lat (msec): min=158, max=403, avg=255.21, stdev=43.80 00:27:53.018 clat percentiles (msec): 00:27:53.018 | 1.00th=[ 159], 5.00th=[ 178], 10.00th=[ 215], 20.00th=[ 226], 00:27:53.018 | 30.00th=[ 232], 40.00th=[ 239], 50.00th=[ 249], 60.00th=[ 257], 00:27:53.018 | 70.00th=[ 275], 80.00th=[ 288], 90.00th=[ 300], 95.00th=[ 355], 00:27:53.018 | 99.00th=[ 397], 99.50th=[ 405], 99.90th=[ 405], 99.95th=[ 405], 00:27:53.019 | 99.99th=[ 405] 00:27:53.019 bw ( KiB/s): min= 176, max= 336, per=5.07%, avg=247.20, stdev=54.56, samples=20 00:27:53.019 iops : min= 44, max= 84, avg=61.80, stdev=13.64, samples=20 00:27:53.019 lat (msec) : 250=51.74%, 500=48.26% 00:27:53.019 cpu : usr=98.25%, sys=1.07%, ctx=54, majf=0, minf=56 00:27:53.019 IO depths : 1=0.2%, 2=0.5%, 4=6.8%, 8=80.0%, 16=12.6%, 32=0.0%, >=64=0.0% 00:27:53.019 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:27:53.019 complete : 0=0.0%, 4=88.8%, 8=6.0%, 16=5.2%, 32=0.0%, 64=0.0%, >=64=0.0% 00:27:53.019 issued rwts: total=634,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:27:53.019 latency : target=0, window=0, percentile=100.00%, depth=16 00:27:53.019 filename1: (groupid=0, jobs=1): err= 0: pid=405727: Tue Apr 16 23:05:42 2024 00:27:53.019 read: IOPS=42, BW=171KiB/s (175kB/s)(1728KiB/10134msec) 00:27:53.019 slat (nsec): min=12073, max=60309, avg=27220.38, stdev=10107.00 00:27:53.019 clat (msec): min=298, max=463, avg=375.06, stdev=36.58 00:27:53.019 lat (msec): min=298, max=463, avg=375.09, stdev=36.58 00:27:53.019 clat percentiles (msec): 00:27:53.019 | 1.00th=[ 300], 5.00th=[ 305], 10.00th=[ 313], 20.00th=[ 351], 00:27:53.019 | 30.00th=[ 355], 40.00th=[ 368], 50.00th=[ 380], 60.00th=[ 384], 00:27:53.019 | 70.00th=[ 397], 80.00th=[ 405], 90.00th=[ 430], 95.00th=[ 435], 00:27:53.019 | 99.00th=[ 447], 99.50th=[ 451], 99.90th=[ 464], 99.95th=[ 464], 00:27:53.019 | 99.99th=[ 464] 00:27:53.019 bw ( KiB/s): min= 128, max= 256, per=3.41%, avg=166.40, stdev=60.18, samples=20 00:27:53.019 iops : min= 32, max= 64, avg=41.60, stdev=15.05, samples=20 00:27:53.019 lat (msec) : 500=100.00% 00:27:53.019 cpu : usr=98.10%, sys=1.21%, ctx=14, majf=0, minf=52 00:27:53.019 IO depths : 1=4.9%, 2=11.1%, 4=25.0%, 8=51.4%, 16=7.6%, 32=0.0%, >=64=0.0% 00:27:53.019 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:27:53.019 complete : 0=0.0%, 4=94.2%, 8=0.0%, 16=5.8%, 32=0.0%, 64=0.0%, >=64=0.0% 00:27:53.019 issued rwts: total=432,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:27:53.019 latency : target=0, window=0, percentile=100.00%, depth=16 00:27:53.019 filename1: (groupid=0, jobs=1): err= 0: pid=405728: Tue Apr 16 23:05:42 2024 00:27:53.019 read: IOPS=55, BW=223KiB/s (229kB/s)(2264KiB/10132msec) 00:27:53.019 slat (usec): min=7, max=128, avg=40.09, stdev=38.69 00:27:53.019 clat (msec): min=144, max=557, avg=285.01, stdev=74.54 00:27:53.019 lat (msec): min=144, max=558, avg=285.05, stdev=74.55 00:27:53.019 clat percentiles (msec): 00:27:53.019 | 1.00th=[ 144], 5.00th=[ 176], 10.00th=[ 182], 20.00th=[ 224], 00:27:53.019 | 30.00th=[ 239], 40.00th=[ 264], 50.00th=[ 288], 60.00th=[ 300], 00:27:53.019 | 70.00th=[ 313], 80.00th=[ 342], 90.00th=[ 384], 95.00th=[ 397], 00:27:53.019 | 99.00th=[ 472], 99.50th=[ 542], 99.90th=[ 558], 99.95th=[ 558], 00:27:53.019 | 99.99th=[ 558] 00:27:53.019 bw ( KiB/s): min= 128, max= 272, per=4.49%, avg=220.00, stdev=54.41, samples=20 00:27:53.019 iops : min= 32, max= 68, avg=55.00, stdev=13.60, samples=20 00:27:53.019 lat (msec) : 250=33.92%, 500=65.37%, 750=0.71% 00:27:53.019 cpu : usr=98.55%, sys=0.96%, ctx=33, majf=0, minf=39 00:27:53.019 IO depths : 1=1.2%, 2=5.1%, 4=17.8%, 8=64.5%, 16=11.3%, 32=0.0%, >=64=0.0% 00:27:53.019 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:27:53.019 complete : 0=0.0%, 4=92.1%, 8=2.4%, 16=5.5%, 32=0.0%, 64=0.0%, >=64=0.0% 00:27:53.019 issued rwts: total=566,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:27:53.019 latency : target=0, window=0, percentile=100.00%, depth=16 00:27:53.019 filename1: (groupid=0, jobs=1): err= 0: pid=405729: Tue Apr 16 23:05:42 2024 00:27:53.019 read: IOPS=41, BW=164KiB/s (168kB/s)(1664KiB/10116msec) 00:27:53.019 slat (usec): min=6, max=125, avg=38.41, stdev=23.19 00:27:53.019 clat (msec): min=253, max=789, avg=388.75, stdev=77.75 00:27:53.019 lat (msec): min=253, max=789, avg=388.79, stdev=77.74 00:27:53.019 clat percentiles (msec): 00:27:53.019 | 1.00th=[ 292], 5.00th=[ 305], 10.00th=[ 338], 20.00th=[ 351], 00:27:53.019 | 30.00th=[ 355], 40.00th=[ 368], 50.00th=[ 380], 60.00th=[ 384], 00:27:53.019 | 70.00th=[ 397], 80.00th=[ 405], 90.00th=[ 430], 95.00th=[ 460], 00:27:53.019 | 99.00th=[ 718], 99.50th=[ 718], 99.90th=[ 793], 99.95th=[ 793], 00:27:53.019 | 99.99th=[ 793] 00:27:53.019 bw ( KiB/s): min= 128, max= 256, per=3.45%, avg=168.42, stdev=57.78, samples=19 00:27:53.019 iops : min= 32, max= 64, avg=42.11, stdev=14.44, samples=19 00:27:53.019 lat (msec) : 500=96.15%, 750=3.37%, 1000=0.48% 00:27:53.019 cpu : usr=98.87%, sys=0.74%, ctx=15, majf=0, minf=46 00:27:53.019 IO depths : 1=3.1%, 2=9.4%, 4=25.0%, 8=53.1%, 16=9.4%, 32=0.0%, >=64=0.0% 00:27:53.019 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:27:53.019 complete : 0=0.0%, 4=94.3%, 8=0.0%, 16=5.7%, 32=0.0%, 64=0.0%, >=64=0.0% 00:27:53.019 issued rwts: total=416,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:27:53.019 latency : target=0, window=0, percentile=100.00%, depth=16 00:27:53.019 filename1: (groupid=0, jobs=1): err= 0: pid=405730: Tue Apr 16 23:05:42 2024 00:27:53.019 read: IOPS=42, BW=171KiB/s (175kB/s)(1728KiB/10121msec) 00:27:53.019 slat (nsec): min=6661, max=35757, avg=15842.50, stdev=7217.12 00:27:53.019 clat (msec): min=165, max=604, avg=374.69, stdev=73.87 00:27:53.019 lat (msec): min=165, max=604, avg=374.71, stdev=73.87 00:27:53.019 clat percentiles (msec): 00:27:53.019 | 1.00th=[ 182], 5.00th=[ 197], 10.00th=[ 347], 20.00th=[ 347], 00:27:53.019 | 30.00th=[ 359], 40.00th=[ 363], 50.00th=[ 376], 60.00th=[ 384], 00:27:53.019 | 70.00th=[ 397], 80.00th=[ 405], 90.00th=[ 422], 95.00th=[ 584], 00:27:53.019 | 99.00th=[ 584], 99.50th=[ 609], 99.90th=[ 609], 99.95th=[ 609], 00:27:53.019 | 99.99th=[ 609] 00:27:53.019 bw ( KiB/s): min= 128, max= 256, per=3.59%, avg=175.16, stdev=58.54, samples=19 00:27:53.019 iops : min= 32, max= 64, avg=43.79, stdev=14.63, samples=19 00:27:53.019 lat (msec) : 250=5.56%, 500=88.89%, 750=5.56% 00:27:53.019 cpu : usr=98.85%, sys=0.76%, ctx=12, majf=0, minf=39 00:27:53.019 IO depths : 1=4.9%, 2=11.1%, 4=25.0%, 8=51.4%, 16=7.6%, 32=0.0%, >=64=0.0% 00:27:53.019 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:27:53.019 complete : 0=0.0%, 4=94.2%, 8=0.0%, 16=5.8%, 32=0.0%, 64=0.0%, >=64=0.0% 00:27:53.019 issued rwts: total=432,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:27:53.019 latency : target=0, window=0, percentile=100.00%, depth=16 00:27:53.019 filename1: (groupid=0, jobs=1): err= 0: pid=405731: Tue Apr 16 23:05:42 2024 00:27:53.019 read: IOPS=42, BW=171KiB/s (175kB/s)(1728KiB/10134msec) 00:27:53.019 slat (usec): min=9, max=136, avg=34.86, stdev=25.26 00:27:53.019 clat (msec): min=269, max=503, avg=374.99, stdev=38.27 00:27:53.019 lat (msec): min=269, max=503, avg=375.03, stdev=38.27 00:27:53.019 clat percentiles (msec): 00:27:53.019 | 1.00th=[ 296], 5.00th=[ 305], 10.00th=[ 321], 20.00th=[ 347], 00:27:53.019 | 30.00th=[ 355], 40.00th=[ 368], 50.00th=[ 380], 60.00th=[ 384], 00:27:53.019 | 70.00th=[ 397], 80.00th=[ 405], 90.00th=[ 426], 95.00th=[ 435], 00:27:53.019 | 99.00th=[ 468], 99.50th=[ 472], 99.90th=[ 502], 99.95th=[ 502], 00:27:53.019 | 99.99th=[ 502] 00:27:53.019 bw ( KiB/s): min= 128, max= 256, per=3.41%, avg=166.40, stdev=60.18, samples=20 00:27:53.019 iops : min= 32, max= 64, avg=41.60, stdev=15.05, samples=20 00:27:53.019 lat (msec) : 500=99.54%, 750=0.46% 00:27:53.019 cpu : usr=98.83%, sys=0.78%, ctx=15, majf=0, minf=39 00:27:53.019 IO depths : 1=4.9%, 2=11.1%, 4=25.0%, 8=51.4%, 16=7.6%, 32=0.0%, >=64=0.0% 00:27:53.019 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:27:53.019 complete : 0=0.0%, 4=94.2%, 8=0.0%, 16=5.8%, 32=0.0%, 64=0.0%, >=64=0.0% 00:27:53.019 issued rwts: total=432,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:27:53.019 latency : target=0, window=0, percentile=100.00%, depth=16 00:27:53.019 filename2: (groupid=0, jobs=1): err= 0: pid=405732: Tue Apr 16 23:05:42 2024 00:27:53.019 read: IOPS=42, BW=171KiB/s (175kB/s)(1728KiB/10124msec) 00:27:53.019 slat (nsec): min=7531, max=96787, avg=25462.72, stdev=12950.90 00:27:53.019 clat (msec): min=182, max=584, avg=374.72, stdev=64.18 00:27:53.019 lat (msec): min=182, max=584, avg=374.74, stdev=64.18 00:27:53.019 clat percentiles (msec): 00:27:53.019 | 1.00th=[ 201], 5.00th=[ 292], 10.00th=[ 305], 20.00th=[ 342], 00:27:53.019 | 30.00th=[ 355], 40.00th=[ 368], 50.00th=[ 380], 60.00th=[ 388], 00:27:53.019 | 70.00th=[ 397], 80.00th=[ 401], 90.00th=[ 418], 95.00th=[ 472], 00:27:53.019 | 99.00th=[ 584], 99.50th=[ 584], 99.90th=[ 584], 99.95th=[ 584], 00:27:53.019 | 99.99th=[ 584] 00:27:53.019 bw ( KiB/s): min= 128, max= 256, per=3.59%, avg=175.16, stdev=61.85, samples=19 00:27:53.019 iops : min= 32, max= 64, avg=43.79, stdev=15.46, samples=19 00:27:53.019 lat (msec) : 250=3.70%, 500=92.13%, 750=4.17% 00:27:53.019 cpu : usr=98.19%, sys=1.13%, ctx=68, majf=0, minf=43 00:27:53.019 IO depths : 1=3.7%, 2=10.0%, 4=25.0%, 8=52.5%, 16=8.8%, 32=0.0%, >=64=0.0% 00:27:53.019 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:27:53.019 complete : 0=0.0%, 4=94.3%, 8=0.0%, 16=5.7%, 32=0.0%, 64=0.0%, >=64=0.0% 00:27:53.019 issued rwts: total=432,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:27:53.019 latency : target=0, window=0, percentile=100.00%, depth=16 00:27:53.019 filename2: (groupid=0, jobs=1): err= 0: pid=405733: Tue Apr 16 23:05:42 2024 00:27:53.019 read: IOPS=62, BW=251KiB/s (257kB/s)(2544KiB/10152msec) 00:27:53.019 slat (usec): min=5, max=126, avg=19.85, stdev=27.18 00:27:53.019 clat (msec): min=159, max=417, avg=254.05, stdev=53.05 00:27:53.020 lat (msec): min=159, max=417, avg=254.07, stdev=53.05 00:27:53.020 clat percentiles (msec): 00:27:53.020 | 1.00th=[ 159], 5.00th=[ 163], 10.00th=[ 178], 20.00th=[ 197], 00:27:53.020 | 30.00th=[ 230], 40.00th=[ 243], 50.00th=[ 255], 60.00th=[ 271], 00:27:53.020 | 70.00th=[ 292], 80.00th=[ 300], 90.00th=[ 313], 95.00th=[ 342], 00:27:53.020 | 99.00th=[ 380], 99.50th=[ 418], 99.90th=[ 418], 99.95th=[ 418], 00:27:53.020 | 99.99th=[ 418] 00:27:53.020 bw ( KiB/s): min= 176, max= 304, per=5.07%, avg=248.00, stdev=33.04, samples=20 00:27:53.020 iops : min= 44, max= 76, avg=62.00, stdev= 8.26, samples=20 00:27:53.020 lat (msec) : 250=42.77%, 500=57.23% 00:27:53.020 cpu : usr=98.95%, sys=0.65%, ctx=20, majf=0, minf=52 00:27:53.020 IO depths : 1=0.8%, 2=3.6%, 4=16.4%, 8=67.3%, 16=11.9%, 32=0.0%, >=64=0.0% 00:27:53.020 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:27:53.020 complete : 0=0.0%, 4=92.0%, 8=2.7%, 16=5.3%, 32=0.0%, 64=0.0%, >=64=0.0% 00:27:53.020 issued rwts: total=636,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:27:53.020 latency : target=0, window=0, percentile=100.00%, depth=16 00:27:53.020 filename2: (groupid=0, jobs=1): err= 0: pid=405734: Tue Apr 16 23:05:42 2024 00:27:53.020 read: IOPS=42, BW=171KiB/s (175kB/s)(1728KiB/10133msec) 00:27:53.020 slat (nsec): min=8792, max=55666, avg=28233.25, stdev=8856.79 00:27:53.020 clat (msec): min=253, max=503, avg=375.05, stdev=42.43 00:27:53.020 lat (msec): min=253, max=503, avg=375.08, stdev=42.43 00:27:53.020 clat percentiles (msec): 00:27:53.020 | 1.00th=[ 292], 5.00th=[ 305], 10.00th=[ 305], 20.00th=[ 347], 00:27:53.020 | 30.00th=[ 355], 40.00th=[ 368], 50.00th=[ 376], 60.00th=[ 384], 00:27:53.020 | 70.00th=[ 397], 80.00th=[ 405], 90.00th=[ 430], 95.00th=[ 447], 00:27:53.020 | 99.00th=[ 468], 99.50th=[ 472], 99.90th=[ 502], 99.95th=[ 502], 00:27:53.020 | 99.99th=[ 502] 00:27:53.020 bw ( KiB/s): min= 128, max= 256, per=3.41%, avg=166.40, stdev=56.96, samples=20 00:27:53.020 iops : min= 32, max= 64, avg=41.60, stdev=14.24, samples=20 00:27:53.020 lat (msec) : 500=99.54%, 750=0.46% 00:27:53.020 cpu : usr=98.49%, sys=0.98%, ctx=21, majf=0, minf=45 00:27:53.020 IO depths : 1=3.2%, 2=9.5%, 4=25.0%, 8=53.0%, 16=9.3%, 32=0.0%, >=64=0.0% 00:27:53.020 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:27:53.020 complete : 0=0.0%, 4=94.3%, 8=0.0%, 16=5.7%, 32=0.0%, 64=0.0%, >=64=0.0% 00:27:53.020 issued rwts: total=432,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:27:53.020 latency : target=0, window=0, percentile=100.00%, depth=16 00:27:53.020 filename2: (groupid=0, jobs=1): err= 0: pid=405735: Tue Apr 16 23:05:42 2024 00:27:53.020 read: IOPS=63, BW=252KiB/s (258kB/s)(2560KiB/10151msec) 00:27:53.020 slat (nsec): min=5174, max=35380, avg=10586.70, stdev=3966.31 00:27:53.020 clat (msec): min=144, max=353, avg=253.66, stdev=57.27 00:27:53.020 lat (msec): min=144, max=353, avg=253.67, stdev=57.27 00:27:53.020 clat percentiles (msec): 00:27:53.020 | 1.00th=[ 144], 5.00th=[ 161], 10.00th=[ 176], 20.00th=[ 180], 00:27:53.020 | 30.00th=[ 190], 40.00th=[ 257], 50.00th=[ 271], 60.00th=[ 284], 00:27:53.020 | 70.00th=[ 292], 80.00th=[ 300], 90.00th=[ 313], 95.00th=[ 321], 00:27:53.020 | 99.00th=[ 355], 99.50th=[ 355], 99.90th=[ 355], 99.95th=[ 355], 00:27:53.020 | 99.99th=[ 355] 00:27:53.020 bw ( KiB/s): min= 128, max= 384, per=5.11%, avg=249.60, stdev=50.44, samples=20 00:27:53.020 iops : min= 32, max= 96, avg=62.40, stdev=12.61, samples=20 00:27:53.020 lat (msec) : 250=32.50%, 500=67.50% 00:27:53.020 cpu : usr=98.94%, sys=0.66%, ctx=13, majf=0, minf=48 00:27:53.020 IO depths : 1=6.2%, 2=12.5%, 4=25.0%, 8=50.0%, 16=6.2%, 32=0.0%, >=64=0.0% 00:27:53.020 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:27:53.020 complete : 0=0.0%, 4=94.1%, 8=0.0%, 16=5.9%, 32=0.0%, 64=0.0%, >=64=0.0% 00:27:53.020 issued rwts: total=640,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:27:53.020 latency : target=0, window=0, percentile=100.00%, depth=16 00:27:53.020 filename2: (groupid=0, jobs=1): err= 0: pid=405736: Tue Apr 16 23:05:42 2024 00:27:53.020 read: IOPS=41, BW=164KiB/s (168kB/s)(1664KiB/10116msec) 00:27:53.020 slat (nsec): min=9934, max=48910, avg=29622.35, stdev=9074.79 00:27:53.020 clat (msec): min=253, max=788, avg=388.81, stdev=77.98 00:27:53.020 lat (msec): min=253, max=788, avg=388.83, stdev=77.98 00:27:53.020 clat percentiles (msec): 00:27:53.020 | 1.00th=[ 292], 5.00th=[ 305], 10.00th=[ 338], 20.00th=[ 351], 00:27:53.020 | 30.00th=[ 355], 40.00th=[ 368], 50.00th=[ 380], 60.00th=[ 384], 00:27:53.020 | 70.00th=[ 397], 80.00th=[ 405], 90.00th=[ 430], 95.00th=[ 468], 00:27:53.020 | 99.00th=[ 718], 99.50th=[ 718], 99.90th=[ 793], 99.95th=[ 793], 00:27:53.020 | 99.99th=[ 793] 00:27:53.020 bw ( KiB/s): min= 128, max= 256, per=3.45%, avg=168.42, stdev=56.03, samples=19 00:27:53.020 iops : min= 32, max= 64, avg=42.11, stdev=14.01, samples=19 00:27:53.020 lat (msec) : 500=96.15%, 750=3.37%, 1000=0.48% 00:27:53.020 cpu : usr=98.86%, sys=0.74%, ctx=13, majf=0, minf=50 00:27:53.020 IO depths : 1=3.1%, 2=9.4%, 4=25.0%, 8=53.1%, 16=9.4%, 32=0.0%, >=64=0.0% 00:27:53.020 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:27:53.020 complete : 0=0.0%, 4=94.3%, 8=0.0%, 16=5.7%, 32=0.0%, 64=0.0%, >=64=0.0% 00:27:53.020 issued rwts: total=416,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:27:53.020 latency : target=0, window=0, percentile=100.00%, depth=16 00:27:53.020 filename2: (groupid=0, jobs=1): err= 0: pid=405737: Tue Apr 16 23:05:42 2024 00:27:53.020 read: IOPS=61, BW=247KiB/s (253kB/s)(2504KiB/10132msec) 00:27:53.020 slat (nsec): min=7903, max=37691, avg=11086.87, stdev=4394.06 00:27:53.020 clat (msec): min=154, max=388, avg=257.77, stdev=40.05 00:27:53.020 lat (msec): min=154, max=388, avg=257.78, stdev=40.05 00:27:53.020 clat percentiles (msec): 00:27:53.020 | 1.00th=[ 163], 5.00th=[ 199], 10.00th=[ 215], 20.00th=[ 226], 00:27:53.020 | 30.00th=[ 232], 40.00th=[ 241], 50.00th=[ 251], 60.00th=[ 268], 00:27:53.020 | 70.00th=[ 288], 80.00th=[ 292], 90.00th=[ 309], 95.00th=[ 317], 00:27:53.020 | 99.00th=[ 384], 99.50th=[ 388], 99.90th=[ 388], 99.95th=[ 388], 00:27:53.020 | 99.99th=[ 388] 00:27:53.020 bw ( KiB/s): min= 128, max= 256, per=5.01%, avg=244.00, stdev=30.66, samples=20 00:27:53.020 iops : min= 32, max= 64, avg=61.00, stdev= 7.66, samples=20 00:27:53.020 lat (msec) : 250=47.60%, 500=52.40% 00:27:53.020 cpu : usr=98.83%, sys=0.78%, ctx=19, majf=0, minf=51 00:27:53.020 IO depths : 1=0.5%, 2=1.8%, 4=9.9%, 8=75.7%, 16=12.1%, 32=0.0%, >=64=0.0% 00:27:53.020 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:27:53.020 complete : 0=0.0%, 4=89.8%, 8=4.8%, 16=5.4%, 32=0.0%, 64=0.0%, >=64=0.0% 00:27:53.020 issued rwts: total=626,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:27:53.020 latency : target=0, window=0, percentile=100.00%, depth=16 00:27:53.020 filename2: (groupid=0, jobs=1): err= 0: pid=405738: Tue Apr 16 23:05:42 2024 00:27:53.020 read: IOPS=41, BW=164KiB/s (168kB/s)(1664KiB/10116msec) 00:27:53.020 slat (usec): min=10, max=128, avg=36.42, stdev=20.84 00:27:53.020 clat (msec): min=304, max=718, avg=388.72, stdev=72.12 00:27:53.020 lat (msec): min=304, max=718, avg=388.76, stdev=72.11 00:27:53.020 clat percentiles (msec): 00:27:53.020 | 1.00th=[ 305], 5.00th=[ 338], 10.00th=[ 342], 20.00th=[ 351], 00:27:53.020 | 30.00th=[ 355], 40.00th=[ 368], 50.00th=[ 380], 60.00th=[ 384], 00:27:53.020 | 70.00th=[ 397], 80.00th=[ 405], 90.00th=[ 426], 95.00th=[ 430], 00:27:53.020 | 99.00th=[ 718], 99.50th=[ 718], 99.90th=[ 718], 99.95th=[ 718], 00:27:53.020 | 99.99th=[ 718] 00:27:53.020 bw ( KiB/s): min= 128, max= 256, per=3.45%, avg=168.42, stdev=61.13, samples=19 00:27:53.020 iops : min= 32, max= 64, avg=42.11, stdev=15.28, samples=19 00:27:53.020 lat (msec) : 500=96.15%, 750=3.85% 00:27:53.020 cpu : usr=98.72%, sys=0.88%, ctx=12, majf=0, minf=48 00:27:53.020 IO depths : 1=6.0%, 2=12.3%, 4=25.0%, 8=50.2%, 16=6.5%, 32=0.0%, >=64=0.0% 00:27:53.020 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:27:53.020 complete : 0=0.0%, 4=94.1%, 8=0.0%, 16=5.9%, 32=0.0%, 64=0.0%, >=64=0.0% 00:27:53.020 issued rwts: total=416,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:27:53.020 latency : target=0, window=0, percentile=100.00%, depth=16 00:27:53.020 filename2: (groupid=0, jobs=1): err= 0: pid=405739: Tue Apr 16 23:05:42 2024 00:27:53.020 read: IOPS=41, BW=165KiB/s (169kB/s)(1664KiB/10109msec) 00:27:53.020 slat (usec): min=8, max=125, avg=53.07, stdev=33.42 00:27:53.020 clat (msec): min=300, max=712, avg=388.32, stdev=71.28 00:27:53.020 lat (msec): min=300, max=713, avg=388.37, stdev=71.29 00:27:53.020 clat percentiles (msec): 00:27:53.020 | 1.00th=[ 305], 5.00th=[ 338], 10.00th=[ 342], 20.00th=[ 351], 00:27:53.020 | 30.00th=[ 355], 40.00th=[ 368], 50.00th=[ 380], 60.00th=[ 384], 00:27:53.020 | 70.00th=[ 397], 80.00th=[ 401], 90.00th=[ 422], 95.00th=[ 430], 00:27:53.020 | 99.00th=[ 709], 99.50th=[ 709], 99.90th=[ 709], 99.95th=[ 709], 00:27:53.020 | 99.99th=[ 709] 00:27:53.020 bw ( KiB/s): min= 128, max= 256, per=3.45%, avg=168.42, stdev=61.13, samples=19 00:27:53.020 iops : min= 32, max= 64, avg=42.11, stdev=15.28, samples=19 00:27:53.020 lat (msec) : 500=96.15%, 750=3.85% 00:27:53.020 cpu : usr=98.30%, sys=1.10%, ctx=14, majf=0, minf=42 00:27:53.020 IO depths : 1=6.0%, 2=12.3%, 4=25.0%, 8=50.2%, 16=6.5%, 32=0.0%, >=64=0.0% 00:27:53.020 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:27:53.020 complete : 0=0.0%, 4=94.1%, 8=0.0%, 16=5.9%, 32=0.0%, 64=0.0%, >=64=0.0% 00:27:53.021 issued rwts: total=416,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:27:53.021 latency : target=0, window=0, percentile=100.00%, depth=16 00:27:53.021 00:27:53.021 Run status group 0 (all jobs): 00:27:53.021 READ: bw=4874KiB/s (4991kB/s), 164KiB/s-258KiB/s (168kB/s-264kB/s), io=48.4MiB (50.7MB), run=10109-10164msec 00:27:53.021 23:05:42 -- target/dif.sh@113 -- # destroy_subsystems 0 1 2 00:27:53.021 23:05:42 -- target/dif.sh@43 -- # local sub 00:27:53.021 23:05:42 -- target/dif.sh@45 -- # for sub in "$@" 00:27:53.021 23:05:42 -- target/dif.sh@46 -- # destroy_subsystem 0 00:27:53.021 23:05:42 -- target/dif.sh@36 -- # local sub_id=0 00:27:53.021 23:05:42 -- target/dif.sh@38 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode0 00:27:53.021 23:05:42 -- common/autotest_common.sh@551 -- # xtrace_disable 00:27:53.021 23:05:42 -- common/autotest_common.sh@10 -- # set +x 00:27:53.021 23:05:42 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:27:53.021 23:05:42 -- target/dif.sh@39 -- # rpc_cmd bdev_null_delete bdev_null0 00:27:53.021 23:05:42 -- common/autotest_common.sh@551 -- # xtrace_disable 00:27:53.021 23:05:42 -- common/autotest_common.sh@10 -- # set +x 00:27:53.021 23:05:42 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:27:53.021 23:05:42 -- target/dif.sh@45 -- # for sub in "$@" 00:27:53.021 23:05:42 -- target/dif.sh@46 -- # destroy_subsystem 1 00:27:53.021 23:05:42 -- target/dif.sh@36 -- # local sub_id=1 00:27:53.021 23:05:42 -- target/dif.sh@38 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:27:53.021 23:05:42 -- common/autotest_common.sh@551 -- # xtrace_disable 00:27:53.021 23:05:42 -- common/autotest_common.sh@10 -- # set +x 00:27:53.021 23:05:42 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:27:53.021 23:05:42 -- target/dif.sh@39 -- # rpc_cmd bdev_null_delete bdev_null1 00:27:53.021 23:05:42 -- common/autotest_common.sh@551 -- # xtrace_disable 00:27:53.021 23:05:42 -- common/autotest_common.sh@10 -- # set +x 00:27:53.021 23:05:42 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:27:53.021 23:05:42 -- target/dif.sh@45 -- # for sub in "$@" 00:27:53.021 23:05:42 -- target/dif.sh@46 -- # destroy_subsystem 2 00:27:53.021 23:05:42 -- target/dif.sh@36 -- # local sub_id=2 00:27:53.021 23:05:42 -- target/dif.sh@38 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode2 00:27:53.021 23:05:42 -- common/autotest_common.sh@551 -- # xtrace_disable 00:27:53.021 23:05:42 -- common/autotest_common.sh@10 -- # set +x 00:27:53.021 23:05:42 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:27:53.021 23:05:42 -- target/dif.sh@39 -- # rpc_cmd bdev_null_delete bdev_null2 00:27:53.021 23:05:42 -- common/autotest_common.sh@551 -- # xtrace_disable 00:27:53.021 23:05:42 -- common/autotest_common.sh@10 -- # set +x 00:27:53.021 23:05:42 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:27:53.021 23:05:42 -- target/dif.sh@115 -- # NULL_DIF=1 00:27:53.021 23:05:42 -- target/dif.sh@115 -- # bs=8k,16k,128k 00:27:53.021 23:05:42 -- target/dif.sh@115 -- # numjobs=2 00:27:53.021 23:05:42 -- target/dif.sh@115 -- # iodepth=8 00:27:53.021 23:05:42 -- target/dif.sh@115 -- # runtime=5 00:27:53.021 23:05:42 -- target/dif.sh@115 -- # files=1 00:27:53.021 23:05:42 -- target/dif.sh@117 -- # create_subsystems 0 1 00:27:53.021 23:05:42 -- target/dif.sh@28 -- # local sub 00:27:53.021 23:05:42 -- target/dif.sh@30 -- # for sub in "$@" 00:27:53.021 23:05:42 -- target/dif.sh@31 -- # create_subsystem 0 00:27:53.021 23:05:42 -- target/dif.sh@18 -- # local sub_id=0 00:27:53.021 23:05:42 -- target/dif.sh@21 -- # rpc_cmd bdev_null_create bdev_null0 64 512 --md-size 16 --dif-type 1 00:27:53.021 23:05:42 -- common/autotest_common.sh@551 -- # xtrace_disable 00:27:53.021 23:05:42 -- common/autotest_common.sh@10 -- # set +x 00:27:53.021 bdev_null0 00:27:53.021 23:05:42 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:27:53.021 23:05:42 -- target/dif.sh@22 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode0 --serial-number 53313233-0 --allow-any-host 00:27:53.021 23:05:42 -- common/autotest_common.sh@551 -- # xtrace_disable 00:27:53.021 23:05:42 -- common/autotest_common.sh@10 -- # set +x 00:27:53.021 23:05:42 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:27:53.021 23:05:42 -- target/dif.sh@23 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode0 bdev_null0 00:27:53.021 23:05:42 -- common/autotest_common.sh@551 -- # xtrace_disable 00:27:53.021 23:05:42 -- common/autotest_common.sh@10 -- # set +x 00:27:53.021 23:05:42 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:27:53.021 23:05:42 -- target/dif.sh@24 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode0 -t tcp -a 10.0.0.2 -s 4420 00:27:53.021 23:05:42 -- common/autotest_common.sh@551 -- # xtrace_disable 00:27:53.021 23:05:42 -- common/autotest_common.sh@10 -- # set +x 00:27:53.021 [2024-04-16 23:05:42.361647] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:27:53.021 23:05:42 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:27:53.021 23:05:42 -- target/dif.sh@30 -- # for sub in "$@" 00:27:53.021 23:05:42 -- target/dif.sh@31 -- # create_subsystem 1 00:27:53.021 23:05:42 -- target/dif.sh@18 -- # local sub_id=1 00:27:53.021 23:05:42 -- target/dif.sh@21 -- # rpc_cmd bdev_null_create bdev_null1 64 512 --md-size 16 --dif-type 1 00:27:53.021 23:05:42 -- common/autotest_common.sh@551 -- # xtrace_disable 00:27:53.021 23:05:42 -- common/autotest_common.sh@10 -- # set +x 00:27:53.021 bdev_null1 00:27:53.021 23:05:42 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:27:53.021 23:05:42 -- target/dif.sh@22 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 --serial-number 53313233-1 --allow-any-host 00:27:53.021 23:05:42 -- common/autotest_common.sh@551 -- # xtrace_disable 00:27:53.021 23:05:42 -- common/autotest_common.sh@10 -- # set +x 00:27:53.021 23:05:42 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:27:53.021 23:05:42 -- target/dif.sh@23 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 bdev_null1 00:27:53.021 23:05:42 -- common/autotest_common.sh@551 -- # xtrace_disable 00:27:53.021 23:05:42 -- common/autotest_common.sh@10 -- # set +x 00:27:53.021 23:05:42 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:27:53.021 23:05:42 -- target/dif.sh@24 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:27:53.021 23:05:42 -- common/autotest_common.sh@551 -- # xtrace_disable 00:27:53.021 23:05:42 -- common/autotest_common.sh@10 -- # set +x 00:27:53.021 23:05:42 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:27:53.021 23:05:42 -- target/dif.sh@118 -- # fio /dev/fd/62 00:27:53.021 23:05:42 -- target/dif.sh@82 -- # fio_bdev --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:27:53.021 23:05:42 -- target/dif.sh@118 -- # create_json_sub_conf 0 1 00:27:53.021 23:05:42 -- common/autotest_common.sh@1335 -- # fio_plugin /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:27:53.021 23:05:42 -- target/dif.sh@51 -- # gen_nvmf_target_json 0 1 00:27:53.021 23:05:42 -- common/autotest_common.sh@1316 -- # local fio_dir=/usr/src/fio 00:27:53.021 23:05:42 -- target/dif.sh@82 -- # gen_fio_conf 00:27:53.021 23:05:42 -- nvmf/common.sh@520 -- # config=() 00:27:53.021 23:05:42 -- common/autotest_common.sh@1318 -- # sanitizers=('libasan' 'libclang_rt.asan') 00:27:53.021 23:05:42 -- common/autotest_common.sh@1318 -- # local sanitizers 00:27:53.021 23:05:42 -- target/dif.sh@54 -- # local file 00:27:53.021 23:05:42 -- nvmf/common.sh@520 -- # local subsystem config 00:27:53.021 23:05:42 -- common/autotest_common.sh@1319 -- # local plugin=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:27:53.021 23:05:42 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:27:53.021 23:05:42 -- common/autotest_common.sh@1320 -- # shift 00:27:53.021 23:05:42 -- target/dif.sh@56 -- # cat 00:27:53.021 23:05:42 -- common/autotest_common.sh@1322 -- # local asan_lib= 00:27:53.021 23:05:42 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:27:53.021 { 00:27:53.021 "params": { 00:27:53.021 "name": "Nvme$subsystem", 00:27:53.021 "trtype": "$TEST_TRANSPORT", 00:27:53.021 "traddr": "$NVMF_FIRST_TARGET_IP", 00:27:53.021 "adrfam": "ipv4", 00:27:53.021 "trsvcid": "$NVMF_PORT", 00:27:53.021 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:27:53.021 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:27:53.021 "hdgst": ${hdgst:-false}, 00:27:53.021 "ddgst": ${ddgst:-false} 00:27:53.021 }, 00:27:53.021 "method": "bdev_nvme_attach_controller" 00:27:53.021 } 00:27:53.021 EOF 00:27:53.021 )") 00:27:53.021 23:05:42 -- common/autotest_common.sh@1323 -- # for sanitizer in "${sanitizers[@]}" 00:27:53.021 23:05:42 -- nvmf/common.sh@542 -- # cat 00:27:53.021 23:05:42 -- common/autotest_common.sh@1324 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:27:53.021 23:05:42 -- common/autotest_common.sh@1324 -- # grep libasan 00:27:53.021 23:05:42 -- target/dif.sh@72 -- # (( file = 1 )) 00:27:53.021 23:05:42 -- target/dif.sh@72 -- # (( file <= files )) 00:27:53.021 23:05:42 -- common/autotest_common.sh@1324 -- # awk '{print $3}' 00:27:53.021 23:05:42 -- target/dif.sh@73 -- # cat 00:27:53.021 23:05:42 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:27:53.021 23:05:42 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:27:53.021 { 00:27:53.021 "params": { 00:27:53.021 "name": "Nvme$subsystem", 00:27:53.021 "trtype": "$TEST_TRANSPORT", 00:27:53.021 "traddr": "$NVMF_FIRST_TARGET_IP", 00:27:53.021 "adrfam": "ipv4", 00:27:53.021 "trsvcid": "$NVMF_PORT", 00:27:53.021 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:27:53.021 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:27:53.021 "hdgst": ${hdgst:-false}, 00:27:53.021 "ddgst": ${ddgst:-false} 00:27:53.021 }, 00:27:53.021 "method": "bdev_nvme_attach_controller" 00:27:53.021 } 00:27:53.021 EOF 00:27:53.021 )") 00:27:53.021 23:05:42 -- target/dif.sh@72 -- # (( file++ )) 00:27:53.021 23:05:42 -- target/dif.sh@72 -- # (( file <= files )) 00:27:53.021 23:05:42 -- nvmf/common.sh@542 -- # cat 00:27:53.021 23:05:42 -- nvmf/common.sh@544 -- # jq . 00:27:53.021 23:05:42 -- nvmf/common.sh@545 -- # IFS=, 00:27:53.021 23:05:42 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:27:53.021 "params": { 00:27:53.021 "name": "Nvme0", 00:27:53.021 "trtype": "tcp", 00:27:53.021 "traddr": "10.0.0.2", 00:27:53.021 "adrfam": "ipv4", 00:27:53.021 "trsvcid": "4420", 00:27:53.021 "subnqn": "nqn.2016-06.io.spdk:cnode0", 00:27:53.021 "hostnqn": "nqn.2016-06.io.spdk:host0", 00:27:53.021 "hdgst": false, 00:27:53.021 "ddgst": false 00:27:53.021 }, 00:27:53.021 "method": "bdev_nvme_attach_controller" 00:27:53.021 },{ 00:27:53.021 "params": { 00:27:53.021 "name": "Nvme1", 00:27:53.021 "trtype": "tcp", 00:27:53.021 "traddr": "10.0.0.2", 00:27:53.021 "adrfam": "ipv4", 00:27:53.021 "trsvcid": "4420", 00:27:53.022 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:27:53.022 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:27:53.022 "hdgst": false, 00:27:53.022 "ddgst": false 00:27:53.022 }, 00:27:53.022 "method": "bdev_nvme_attach_controller" 00:27:53.022 }' 00:27:53.022 23:05:42 -- common/autotest_common.sh@1324 -- # asan_lib= 00:27:53.022 23:05:42 -- common/autotest_common.sh@1325 -- # [[ -n '' ]] 00:27:53.022 23:05:42 -- common/autotest_common.sh@1323 -- # for sanitizer in "${sanitizers[@]}" 00:27:53.022 23:05:42 -- common/autotest_common.sh@1324 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:27:53.022 23:05:42 -- common/autotest_common.sh@1324 -- # grep libclang_rt.asan 00:27:53.022 23:05:42 -- common/autotest_common.sh@1324 -- # awk '{print $3}' 00:27:53.022 23:05:42 -- common/autotest_common.sh@1324 -- # asan_lib= 00:27:53.022 23:05:42 -- common/autotest_common.sh@1325 -- # [[ -n '' ]] 00:27:53.022 23:05:42 -- common/autotest_common.sh@1331 -- # LD_PRELOAD=' /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev' 00:27:53.022 23:05:42 -- common/autotest_common.sh@1331 -- # /usr/src/fio/fio --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:27:53.022 filename0: (g=0): rw=randread, bs=(R) 8192B-8192B, (W) 16.0KiB-16.0KiB, (T) 128KiB-128KiB, ioengine=spdk_bdev, iodepth=8 00:27:53.022 ... 00:27:53.022 filename1: (g=0): rw=randread, bs=(R) 8192B-8192B, (W) 16.0KiB-16.0KiB, (T) 128KiB-128KiB, ioengine=spdk_bdev, iodepth=8 00:27:53.022 ... 00:27:53.022 fio-3.35 00:27:53.022 Starting 4 threads 00:27:53.022 EAL: No free 2048 kB hugepages reported on node 1 00:27:53.022 [2024-04-16 23:05:43.301942] rpc.c: 181:spdk_rpc_listen: *ERROR*: RPC Unix domain socket path /var/tmp/spdk.sock in use. Specify another. 00:27:53.022 [2024-04-16 23:05:43.302023] rpc.c: 90:spdk_rpc_initialize: *ERROR*: Unable to start RPC service at /var/tmp/spdk.sock 00:27:58.287 00:27:58.287 filename0: (groupid=0, jobs=1): err= 0: pid=407094: Tue Apr 16 23:05:48 2024 00:27:58.287 read: IOPS=1950, BW=15.2MiB/s (16.0MB/s)(76.3MiB/5005msec) 00:27:58.287 slat (nsec): min=4273, max=71175, avg=13548.14, stdev=8449.96 00:27:58.287 clat (usec): min=1286, max=7533, avg=4054.89, stdev=600.44 00:27:58.287 lat (usec): min=1298, max=7540, avg=4068.44, stdev=602.02 00:27:58.287 clat percentiles (usec): 00:27:58.287 | 1.00th=[ 2573], 5.00th=[ 2999], 10.00th=[ 3228], 20.00th=[ 3621], 00:27:58.287 | 30.00th=[ 3851], 40.00th=[ 4047], 50.00th=[ 4146], 60.00th=[ 4228], 00:27:58.287 | 70.00th=[ 4359], 80.00th=[ 4424], 90.00th=[ 4555], 95.00th=[ 4817], 00:27:58.287 | 99.00th=[ 5932], 99.50th=[ 6259], 99.90th=[ 6849], 99.95th=[ 7111], 00:27:58.287 | 99.99th=[ 7504] 00:27:58.287 bw ( KiB/s): min=14384, max=17200, per=26.14%, avg=15608.00, stdev=845.88, samples=10 00:27:58.287 iops : min= 1798, max= 2150, avg=1951.00, stdev=105.73, samples=10 00:27:58.287 lat (msec) : 2=0.18%, 4=37.65%, 10=62.16% 00:27:58.287 cpu : usr=93.88%, sys=5.42%, ctx=12, majf=0, minf=9 00:27:58.287 IO depths : 1=0.1%, 2=9.7%, 4=62.6%, 8=27.6%, 16=0.0%, 32=0.0%, >=64=0.0% 00:27:58.287 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:27:58.287 complete : 0=0.0%, 4=92.3%, 8=7.7%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:27:58.287 issued rwts: total=9763,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:27:58.287 latency : target=0, window=0, percentile=100.00%, depth=8 00:27:58.287 filename0: (groupid=0, jobs=1): err= 0: pid=407095: Tue Apr 16 23:05:48 2024 00:27:58.287 read: IOPS=1836, BW=14.3MiB/s (15.0MB/s)(71.8MiB/5002msec) 00:27:58.287 slat (nsec): min=3763, max=63761, avg=16626.68, stdev=8905.72 00:27:58.287 clat (usec): min=980, max=8358, avg=4302.74, stdev=661.80 00:27:58.287 lat (usec): min=1000, max=8370, avg=4319.36, stdev=661.01 00:27:58.287 clat percentiles (usec): 00:27:58.287 | 1.00th=[ 2802], 5.00th=[ 3326], 10.00th=[ 3589], 20.00th=[ 3884], 00:27:58.287 | 30.00th=[ 4047], 40.00th=[ 4146], 50.00th=[ 4228], 60.00th=[ 4359], 00:27:58.287 | 70.00th=[ 4424], 80.00th=[ 4621], 90.00th=[ 5145], 95.00th=[ 5604], 00:27:58.287 | 99.00th=[ 6456], 99.50th=[ 6652], 99.90th=[ 7046], 99.95th=[ 7242], 00:27:58.287 | 99.99th=[ 8356] 00:27:58.287 bw ( KiB/s): min=13696, max=15488, per=24.52%, avg=14641.78, stdev=631.62, samples=9 00:27:58.287 iops : min= 1712, max= 1936, avg=1830.22, stdev=78.95, samples=9 00:27:58.287 lat (usec) : 1000=0.01% 00:27:58.287 lat (msec) : 2=0.11%, 4=26.05%, 10=73.83% 00:27:58.287 cpu : usr=95.04%, sys=4.20%, ctx=34, majf=0, minf=9 00:27:58.287 IO depths : 1=0.1%, 2=7.9%, 4=63.9%, 8=28.2%, 16=0.0%, 32=0.0%, >=64=0.0% 00:27:58.287 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:27:58.287 complete : 0=0.0%, 4=92.9%, 8=7.1%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:27:58.287 issued rwts: total=9185,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:27:58.287 latency : target=0, window=0, percentile=100.00%, depth=8 00:27:58.287 filename1: (groupid=0, jobs=1): err= 0: pid=407096: Tue Apr 16 23:05:48 2024 00:27:58.287 read: IOPS=1873, BW=14.6MiB/s (15.3MB/s)(73.2MiB/5002msec) 00:27:58.287 slat (nsec): min=4013, max=64693, avg=14232.26, stdev=9203.63 00:27:58.287 clat (usec): min=967, max=7723, avg=4220.77, stdev=576.96 00:27:58.287 lat (usec): min=986, max=7737, avg=4235.01, stdev=577.72 00:27:58.287 clat percentiles (usec): 00:27:58.287 | 1.00th=[ 2802], 5.00th=[ 3392], 10.00th=[ 3621], 20.00th=[ 3851], 00:27:58.287 | 30.00th=[ 4015], 40.00th=[ 4113], 50.00th=[ 4228], 60.00th=[ 4293], 00:27:58.287 | 70.00th=[ 4359], 80.00th=[ 4490], 90.00th=[ 4752], 95.00th=[ 5342], 00:27:58.287 | 99.00th=[ 6259], 99.50th=[ 6456], 99.90th=[ 6915], 99.95th=[ 7242], 00:27:58.287 | 99.99th=[ 7701] 00:27:58.287 bw ( KiB/s): min=14336, max=15472, per=25.09%, avg=14982.10, stdev=352.03, samples=10 00:27:58.287 iops : min= 1792, max= 1934, avg=1872.70, stdev=44.03, samples=10 00:27:58.287 lat (usec) : 1000=0.01% 00:27:58.287 lat (msec) : 2=0.14%, 4=28.86%, 10=70.99% 00:27:58.287 cpu : usr=93.66%, sys=5.66%, ctx=9, majf=0, minf=9 00:27:58.287 IO depths : 1=0.1%, 2=8.7%, 4=63.9%, 8=27.3%, 16=0.0%, 32=0.0%, >=64=0.0% 00:27:58.287 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:27:58.287 complete : 0=0.0%, 4=92.0%, 8=8.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:27:58.287 issued rwts: total=9370,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:27:58.287 latency : target=0, window=0, percentile=100.00%, depth=8 00:27:58.287 filename1: (groupid=0, jobs=1): err= 0: pid=407097: Tue Apr 16 23:05:48 2024 00:27:58.287 read: IOPS=1806, BW=14.1MiB/s (14.8MB/s)(70.6MiB/5003msec) 00:27:58.287 slat (nsec): min=3953, max=67854, avg=13981.30, stdev=8817.68 00:27:58.287 clat (usec): min=2152, max=8270, avg=4387.40, stdev=716.75 00:27:58.287 lat (usec): min=2164, max=8278, avg=4401.38, stdev=716.27 00:27:58.287 clat percentiles (usec): 00:27:58.287 | 1.00th=[ 3163], 5.00th=[ 3589], 10.00th=[ 3752], 20.00th=[ 3949], 00:27:58.287 | 30.00th=[ 4080], 40.00th=[ 4178], 50.00th=[ 4293], 60.00th=[ 4359], 00:27:58.287 | 70.00th=[ 4424], 80.00th=[ 4555], 90.00th=[ 5276], 95.00th=[ 6194], 00:27:58.287 | 99.00th=[ 6915], 99.50th=[ 7177], 99.90th=[ 7701], 99.95th=[ 7963], 00:27:58.287 | 99.99th=[ 8291] 00:27:58.287 bw ( KiB/s): min=13579, max=15024, per=24.20%, avg=14449.10, stdev=434.88, samples=10 00:27:58.287 iops : min= 1697, max= 1878, avg=1806.10, stdev=54.44, samples=10 00:27:58.287 lat (msec) : 4=23.51%, 10=76.49% 00:27:58.287 cpu : usr=94.34%, sys=5.20%, ctx=10, majf=0, minf=9 00:27:58.287 IO depths : 1=0.2%, 2=1.1%, 4=71.9%, 8=26.7%, 16=0.0%, 32=0.0%, >=64=0.0% 00:27:58.287 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:27:58.287 complete : 0=0.0%, 4=92.0%, 8=8.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:27:58.287 issued rwts: total=9037,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:27:58.287 latency : target=0, window=0, percentile=100.00%, depth=8 00:27:58.287 00:27:58.287 Run status group 0 (all jobs): 00:27:58.287 READ: bw=58.3MiB/s (61.1MB/s), 14.1MiB/s-15.2MiB/s (14.8MB/s-16.0MB/s), io=292MiB (306MB), run=5002-5005msec 00:27:58.287 23:05:48 -- target/dif.sh@119 -- # destroy_subsystems 0 1 00:27:58.287 23:05:48 -- target/dif.sh@43 -- # local sub 00:27:58.287 23:05:48 -- target/dif.sh@45 -- # for sub in "$@" 00:27:58.287 23:05:48 -- target/dif.sh@46 -- # destroy_subsystem 0 00:27:58.287 23:05:48 -- target/dif.sh@36 -- # local sub_id=0 00:27:58.287 23:05:48 -- target/dif.sh@38 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode0 00:27:58.287 23:05:48 -- common/autotest_common.sh@551 -- # xtrace_disable 00:27:58.287 23:05:48 -- common/autotest_common.sh@10 -- # set +x 00:27:58.287 23:05:48 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:27:58.287 23:05:48 -- target/dif.sh@39 -- # rpc_cmd bdev_null_delete bdev_null0 00:27:58.287 23:05:48 -- common/autotest_common.sh@551 -- # xtrace_disable 00:27:58.287 23:05:48 -- common/autotest_common.sh@10 -- # set +x 00:27:58.287 23:05:48 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:27:58.287 23:05:48 -- target/dif.sh@45 -- # for sub in "$@" 00:27:58.287 23:05:48 -- target/dif.sh@46 -- # destroy_subsystem 1 00:27:58.287 23:05:48 -- target/dif.sh@36 -- # local sub_id=1 00:27:58.287 23:05:48 -- target/dif.sh@38 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:27:58.287 23:05:48 -- common/autotest_common.sh@551 -- # xtrace_disable 00:27:58.287 23:05:48 -- common/autotest_common.sh@10 -- # set +x 00:27:58.287 23:05:48 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:27:58.287 23:05:48 -- target/dif.sh@39 -- # rpc_cmd bdev_null_delete bdev_null1 00:27:58.287 23:05:48 -- common/autotest_common.sh@551 -- # xtrace_disable 00:27:58.287 23:05:48 -- common/autotest_common.sh@10 -- # set +x 00:27:58.287 23:05:48 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:27:58.287 00:27:58.287 real 0m24.345s 00:27:58.287 user 4m37.046s 00:27:58.287 sys 0m5.130s 00:27:58.287 23:05:48 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:27:58.287 23:05:48 -- common/autotest_common.sh@10 -- # set +x 00:27:58.287 ************************************ 00:27:58.287 END TEST fio_dif_rand_params 00:27:58.287 ************************************ 00:27:58.287 23:05:48 -- target/dif.sh@144 -- # run_test fio_dif_digest fio_dif_digest 00:27:58.287 23:05:48 -- common/autotest_common.sh@1077 -- # '[' 2 -le 1 ']' 00:27:58.287 23:05:48 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:27:58.288 23:05:48 -- common/autotest_common.sh@10 -- # set +x 00:27:58.288 ************************************ 00:27:58.288 START TEST fio_dif_digest 00:27:58.288 ************************************ 00:27:58.288 23:05:48 -- common/autotest_common.sh@1104 -- # fio_dif_digest 00:27:58.288 23:05:48 -- target/dif.sh@123 -- # local NULL_DIF 00:27:58.288 23:05:48 -- target/dif.sh@124 -- # local bs numjobs runtime iodepth files 00:27:58.288 23:05:48 -- target/dif.sh@125 -- # local hdgst ddgst 00:27:58.288 23:05:48 -- target/dif.sh@127 -- # NULL_DIF=3 00:27:58.288 23:05:48 -- target/dif.sh@127 -- # bs=128k,128k,128k 00:27:58.288 23:05:48 -- target/dif.sh@127 -- # numjobs=3 00:27:58.288 23:05:48 -- target/dif.sh@127 -- # iodepth=3 00:27:58.288 23:05:48 -- target/dif.sh@127 -- # runtime=10 00:27:58.288 23:05:48 -- target/dif.sh@128 -- # hdgst=true 00:27:58.288 23:05:48 -- target/dif.sh@128 -- # ddgst=true 00:27:58.288 23:05:48 -- target/dif.sh@130 -- # create_subsystems 0 00:27:58.288 23:05:48 -- target/dif.sh@28 -- # local sub 00:27:58.288 23:05:48 -- target/dif.sh@30 -- # for sub in "$@" 00:27:58.288 23:05:48 -- target/dif.sh@31 -- # create_subsystem 0 00:27:58.288 23:05:48 -- target/dif.sh@18 -- # local sub_id=0 00:27:58.288 23:05:48 -- target/dif.sh@21 -- # rpc_cmd bdev_null_create bdev_null0 64 512 --md-size 16 --dif-type 3 00:27:58.288 23:05:48 -- common/autotest_common.sh@551 -- # xtrace_disable 00:27:58.288 23:05:48 -- common/autotest_common.sh@10 -- # set +x 00:27:58.288 bdev_null0 00:27:58.288 23:05:48 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:27:58.288 23:05:48 -- target/dif.sh@22 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode0 --serial-number 53313233-0 --allow-any-host 00:27:58.288 23:05:48 -- common/autotest_common.sh@551 -- # xtrace_disable 00:27:58.288 23:05:48 -- common/autotest_common.sh@10 -- # set +x 00:27:58.288 23:05:48 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:27:58.288 23:05:48 -- target/dif.sh@23 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode0 bdev_null0 00:27:58.288 23:05:48 -- common/autotest_common.sh@551 -- # xtrace_disable 00:27:58.288 23:05:48 -- common/autotest_common.sh@10 -- # set +x 00:27:58.288 23:05:48 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:27:58.288 23:05:48 -- target/dif.sh@24 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode0 -t tcp -a 10.0.0.2 -s 4420 00:27:58.288 23:05:48 -- common/autotest_common.sh@551 -- # xtrace_disable 00:27:58.288 23:05:48 -- common/autotest_common.sh@10 -- # set +x 00:27:58.288 [2024-04-16 23:05:48.798941] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:27:58.288 23:05:48 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:27:58.288 23:05:48 -- target/dif.sh@131 -- # fio /dev/fd/62 00:27:58.288 23:05:48 -- target/dif.sh@131 -- # create_json_sub_conf 0 00:27:58.288 23:05:48 -- target/dif.sh@51 -- # gen_nvmf_target_json 0 00:27:58.288 23:05:48 -- nvmf/common.sh@520 -- # config=() 00:27:58.288 23:05:48 -- target/dif.sh@82 -- # fio_bdev --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:27:58.288 23:05:48 -- nvmf/common.sh@520 -- # local subsystem config 00:27:58.288 23:05:48 -- common/autotest_common.sh@1335 -- # fio_plugin /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:27:58.288 23:05:48 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:27:58.288 23:05:48 -- target/dif.sh@82 -- # gen_fio_conf 00:27:58.288 23:05:48 -- common/autotest_common.sh@1316 -- # local fio_dir=/usr/src/fio 00:27:58.288 23:05:48 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:27:58.288 { 00:27:58.288 "params": { 00:27:58.288 "name": "Nvme$subsystem", 00:27:58.288 "trtype": "$TEST_TRANSPORT", 00:27:58.288 "traddr": "$NVMF_FIRST_TARGET_IP", 00:27:58.288 "adrfam": "ipv4", 00:27:58.288 "trsvcid": "$NVMF_PORT", 00:27:58.288 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:27:58.288 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:27:58.288 "hdgst": ${hdgst:-false}, 00:27:58.288 "ddgst": ${ddgst:-false} 00:27:58.288 }, 00:27:58.288 "method": "bdev_nvme_attach_controller" 00:27:58.288 } 00:27:58.288 EOF 00:27:58.288 )") 00:27:58.288 23:05:48 -- common/autotest_common.sh@1318 -- # sanitizers=('libasan' 'libclang_rt.asan') 00:27:58.288 23:05:48 -- target/dif.sh@54 -- # local file 00:27:58.288 23:05:48 -- common/autotest_common.sh@1318 -- # local sanitizers 00:27:58.288 23:05:48 -- common/autotest_common.sh@1319 -- # local plugin=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:27:58.288 23:05:48 -- target/dif.sh@56 -- # cat 00:27:58.288 23:05:48 -- common/autotest_common.sh@1320 -- # shift 00:27:58.288 23:05:48 -- common/autotest_common.sh@1322 -- # local asan_lib= 00:27:58.288 23:05:48 -- common/autotest_common.sh@1323 -- # for sanitizer in "${sanitizers[@]}" 00:27:58.288 23:05:48 -- nvmf/common.sh@542 -- # cat 00:27:58.288 23:05:48 -- common/autotest_common.sh@1324 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:27:58.288 23:05:48 -- target/dif.sh@72 -- # (( file = 1 )) 00:27:58.288 23:05:48 -- common/autotest_common.sh@1324 -- # grep libasan 00:27:58.288 23:05:48 -- target/dif.sh@72 -- # (( file <= files )) 00:27:58.288 23:05:48 -- common/autotest_common.sh@1324 -- # awk '{print $3}' 00:27:58.288 23:05:48 -- nvmf/common.sh@544 -- # jq . 00:27:58.288 23:05:48 -- nvmf/common.sh@545 -- # IFS=, 00:27:58.288 23:05:48 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:27:58.288 "params": { 00:27:58.288 "name": "Nvme0", 00:27:58.288 "trtype": "tcp", 00:27:58.288 "traddr": "10.0.0.2", 00:27:58.288 "adrfam": "ipv4", 00:27:58.288 "trsvcid": "4420", 00:27:58.288 "subnqn": "nqn.2016-06.io.spdk:cnode0", 00:27:58.288 "hostnqn": "nqn.2016-06.io.spdk:host0", 00:27:58.288 "hdgst": true, 00:27:58.288 "ddgst": true 00:27:58.288 }, 00:27:58.288 "method": "bdev_nvme_attach_controller" 00:27:58.288 }' 00:27:58.288 23:05:48 -- common/autotest_common.sh@1324 -- # asan_lib= 00:27:58.288 23:05:48 -- common/autotest_common.sh@1325 -- # [[ -n '' ]] 00:27:58.288 23:05:48 -- common/autotest_common.sh@1323 -- # for sanitizer in "${sanitizers[@]}" 00:27:58.288 23:05:48 -- common/autotest_common.sh@1324 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:27:58.288 23:05:48 -- common/autotest_common.sh@1324 -- # grep libclang_rt.asan 00:27:58.288 23:05:48 -- common/autotest_common.sh@1324 -- # awk '{print $3}' 00:27:58.288 23:05:48 -- common/autotest_common.sh@1324 -- # asan_lib= 00:27:58.288 23:05:48 -- common/autotest_common.sh@1325 -- # [[ -n '' ]] 00:27:58.288 23:05:48 -- common/autotest_common.sh@1331 -- # LD_PRELOAD=' /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev' 00:27:58.288 23:05:48 -- common/autotest_common.sh@1331 -- # /usr/src/fio/fio --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:27:58.288 filename0: (g=0): rw=randread, bs=(R) 128KiB-128KiB, (W) 128KiB-128KiB, (T) 128KiB-128KiB, ioengine=spdk_bdev, iodepth=3 00:27:58.288 ... 00:27:58.288 fio-3.35 00:27:58.288 Starting 3 threads 00:27:58.288 EAL: No free 2048 kB hugepages reported on node 1 00:27:58.547 [2024-04-16 23:05:49.597888] rpc.c: 181:spdk_rpc_listen: *ERROR*: RPC Unix domain socket path /var/tmp/spdk.sock in use. Specify another. 00:27:58.547 [2024-04-16 23:05:49.597933] rpc.c: 90:spdk_rpc_initialize: *ERROR*: Unable to start RPC service at /var/tmp/spdk.sock 00:28:10.744 00:28:10.744 filename0: (groupid=0, jobs=1): err= 0: pid=407939: Tue Apr 16 23:05:59 2024 00:28:10.744 read: IOPS=210, BW=26.3MiB/s (27.5MB/s)(264MiB/10047msec) 00:28:10.744 slat (nsec): min=6035, max=56870, avg=18199.38, stdev=5906.59 00:28:10.744 clat (usec): min=9060, max=50589, avg=14235.06, stdev=1562.44 00:28:10.744 lat (usec): min=9079, max=50602, avg=14253.26, stdev=1561.30 00:28:10.744 clat percentiles (usec): 00:28:10.745 | 1.00th=[11207], 5.00th=[12518], 10.00th=[12911], 20.00th=[13304], 00:28:10.745 | 30.00th=[13698], 40.00th=[13960], 50.00th=[14222], 60.00th=[14484], 00:28:10.745 | 70.00th=[14746], 80.00th=[15139], 90.00th=[15664], 95.00th=[16057], 00:28:10.745 | 99.00th=[16909], 99.50th=[17433], 99.90th=[18482], 99.95th=[47449], 00:28:10.745 | 99.99th=[50594] 00:28:10.745 bw ( KiB/s): min=25344, max=28928, per=34.06%, avg=26995.20, stdev=915.42, samples=20 00:28:10.745 iops : min= 198, max= 226, avg=210.90, stdev= 7.15, samples=20 00:28:10.745 lat (msec) : 10=0.33%, 20=99.57%, 50=0.05%, 100=0.05% 00:28:10.745 cpu : usr=92.12%, sys=7.15%, ctx=235, majf=0, minf=145 00:28:10.745 IO depths : 1=0.1%, 2=99.9%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:28:10.745 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:28:10.745 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:28:10.745 issued rwts: total=2111,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:28:10.745 latency : target=0, window=0, percentile=100.00%, depth=3 00:28:10.745 filename0: (groupid=0, jobs=1): err= 0: pid=407940: Tue Apr 16 23:05:59 2024 00:28:10.745 read: IOPS=201, BW=25.2MiB/s (26.5MB/s)(254MiB/10046msec) 00:28:10.745 slat (nsec): min=6274, max=44771, avg=14973.78, stdev=4609.15 00:28:10.745 clat (usec): min=9171, max=54536, avg=14819.83, stdev=1661.86 00:28:10.745 lat (usec): min=9189, max=54549, avg=14834.80, stdev=1661.55 00:28:10.745 clat percentiles (usec): 00:28:10.745 | 1.00th=[11731], 5.00th=[12911], 10.00th=[13435], 20.00th=[13829], 00:28:10.745 | 30.00th=[14222], 40.00th=[14484], 50.00th=[14746], 60.00th=[15008], 00:28:10.745 | 70.00th=[15401], 80.00th=[15664], 90.00th=[16319], 95.00th=[16909], 00:28:10.745 | 99.00th=[17695], 99.50th=[17957], 99.90th=[19792], 99.95th=[48497], 00:28:10.745 | 99.99th=[54789] 00:28:10.745 bw ( KiB/s): min=24320, max=27136, per=32.72%, avg=25932.80, stdev=835.13, samples=20 00:28:10.745 iops : min= 190, max= 212, avg=202.60, stdev= 6.52, samples=20 00:28:10.745 lat (msec) : 10=0.20%, 20=99.70%, 50=0.05%, 100=0.05% 00:28:10.745 cpu : usr=91.74%, sys=7.78%, ctx=22, majf=0, minf=220 00:28:10.745 IO depths : 1=0.1%, 2=99.9%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:28:10.745 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:28:10.745 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:28:10.745 issued rwts: total=2028,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:28:10.745 latency : target=0, window=0, percentile=100.00%, depth=3 00:28:10.745 filename0: (groupid=0, jobs=1): err= 0: pid=407941: Tue Apr 16 23:05:59 2024 00:28:10.745 read: IOPS=207, BW=25.9MiB/s (27.2MB/s)(260MiB/10046msec) 00:28:10.745 slat (nsec): min=6154, max=44071, avg=15289.11, stdev=4857.00 00:28:10.745 clat (usec): min=10793, max=55740, avg=14434.94, stdev=2252.36 00:28:10.745 lat (usec): min=10807, max=55767, avg=14450.23, stdev=2252.29 00:28:10.745 clat percentiles (usec): 00:28:10.745 | 1.00th=[11600], 5.00th=[12387], 10.00th=[12780], 20.00th=[13304], 00:28:10.745 | 30.00th=[13698], 40.00th=[14091], 50.00th=[14353], 60.00th=[14615], 00:28:10.745 | 70.00th=[14877], 80.00th=[15270], 90.00th=[15795], 95.00th=[16319], 00:28:10.745 | 99.00th=[17171], 99.50th=[17433], 99.90th=[55837], 99.95th=[55837], 00:28:10.745 | 99.99th=[55837] 00:28:10.745 bw ( KiB/s): min=23808, max=28160, per=33.59%, avg=26626.65, stdev=922.00, samples=20 00:28:10.745 iops : min= 186, max= 220, avg=208.00, stdev= 7.20, samples=20 00:28:10.745 lat (msec) : 20=99.76%, 50=0.05%, 100=0.19% 00:28:10.745 cpu : usr=91.90%, sys=7.62%, ctx=22, majf=0, minf=132 00:28:10.745 IO depths : 1=0.2%, 2=99.8%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:28:10.745 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:28:10.745 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:28:10.745 issued rwts: total=2082,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:28:10.745 latency : target=0, window=0, percentile=100.00%, depth=3 00:28:10.745 00:28:10.745 Run status group 0 (all jobs): 00:28:10.745 READ: bw=77.4MiB/s (81.2MB/s), 25.2MiB/s-26.3MiB/s (26.5MB/s-27.5MB/s), io=778MiB (815MB), run=10046-10047msec 00:28:10.745 23:06:00 -- target/dif.sh@132 -- # destroy_subsystems 0 00:28:10.745 23:06:00 -- target/dif.sh@43 -- # local sub 00:28:10.745 23:06:00 -- target/dif.sh@45 -- # for sub in "$@" 00:28:10.745 23:06:00 -- target/dif.sh@46 -- # destroy_subsystem 0 00:28:10.745 23:06:00 -- target/dif.sh@36 -- # local sub_id=0 00:28:10.745 23:06:00 -- target/dif.sh@38 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode0 00:28:10.745 23:06:00 -- common/autotest_common.sh@551 -- # xtrace_disable 00:28:10.745 23:06:00 -- common/autotest_common.sh@10 -- # set +x 00:28:10.745 23:06:00 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:28:10.745 23:06:00 -- target/dif.sh@39 -- # rpc_cmd bdev_null_delete bdev_null0 00:28:10.745 23:06:00 -- common/autotest_common.sh@551 -- # xtrace_disable 00:28:10.745 23:06:00 -- common/autotest_common.sh@10 -- # set +x 00:28:10.745 23:06:00 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:28:10.745 00:28:10.745 real 0m11.341s 00:28:10.745 user 0m29.042s 00:28:10.745 sys 0m2.534s 00:28:10.745 23:06:00 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:28:10.745 23:06:00 -- common/autotest_common.sh@10 -- # set +x 00:28:10.745 ************************************ 00:28:10.745 END TEST fio_dif_digest 00:28:10.745 ************************************ 00:28:10.745 23:06:00 -- target/dif.sh@146 -- # trap - SIGINT SIGTERM EXIT 00:28:10.745 23:06:00 -- target/dif.sh@147 -- # nvmftestfini 00:28:10.745 23:06:00 -- nvmf/common.sh@476 -- # nvmfcleanup 00:28:10.745 23:06:00 -- nvmf/common.sh@116 -- # sync 00:28:10.745 23:06:00 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:28:10.745 23:06:00 -- nvmf/common.sh@119 -- # set +e 00:28:10.745 23:06:00 -- nvmf/common.sh@120 -- # for i in {1..20} 00:28:10.745 23:06:00 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:28:10.745 rmmod nvme_tcp 00:28:10.745 rmmod nvme_fabrics 00:28:10.745 rmmod nvme_keyring 00:28:10.745 23:06:00 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:28:10.745 23:06:00 -- nvmf/common.sh@123 -- # set -e 00:28:10.745 23:06:00 -- nvmf/common.sh@124 -- # return 0 00:28:10.745 23:06:00 -- nvmf/common.sh@477 -- # '[' -n 401578 ']' 00:28:10.745 23:06:00 -- nvmf/common.sh@478 -- # killprocess 401578 00:28:10.745 23:06:00 -- common/autotest_common.sh@926 -- # '[' -z 401578 ']' 00:28:10.745 23:06:00 -- common/autotest_common.sh@930 -- # kill -0 401578 00:28:10.745 23:06:00 -- common/autotest_common.sh@931 -- # uname 00:28:10.745 23:06:00 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:28:10.745 23:06:00 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 401578 00:28:10.745 23:06:00 -- common/autotest_common.sh@932 -- # process_name=reactor_0 00:28:10.745 23:06:00 -- common/autotest_common.sh@936 -- # '[' reactor_0 = sudo ']' 00:28:10.745 23:06:00 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 401578' 00:28:10.745 killing process with pid 401578 00:28:10.745 23:06:00 -- common/autotest_common.sh@945 -- # kill 401578 00:28:10.745 23:06:00 -- common/autotest_common.sh@950 -- # wait 401578 00:28:10.745 23:06:00 -- nvmf/common.sh@480 -- # '[' iso == iso ']' 00:28:10.745 23:06:00 -- nvmf/common.sh@481 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh reset 00:28:10.745 Waiting for block devices as requested 00:28:10.745 0000:88:00.0 (8086 0a54): vfio-pci -> nvme 00:28:10.745 0000:00:04.7 (8086 0e27): vfio-pci -> ioatdma 00:28:10.745 0000:00:04.6 (8086 0e26): vfio-pci -> ioatdma 00:28:10.745 0000:00:04.5 (8086 0e25): vfio-pci -> ioatdma 00:28:10.745 0000:00:04.4 (8086 0e24): vfio-pci -> ioatdma 00:28:10.745 0000:00:04.3 (8086 0e23): vfio-pci -> ioatdma 00:28:11.005 0000:00:04.2 (8086 0e22): vfio-pci -> ioatdma 00:28:11.005 0000:00:04.1 (8086 0e21): vfio-pci -> ioatdma 00:28:11.005 0000:00:04.0 (8086 0e20): vfio-pci -> ioatdma 00:28:11.005 0000:80:04.7 (8086 0e27): vfio-pci -> ioatdma 00:28:11.267 0000:80:04.6 (8086 0e26): vfio-pci -> ioatdma 00:28:11.267 0000:80:04.5 (8086 0e25): vfio-pci -> ioatdma 00:28:11.267 0000:80:04.4 (8086 0e24): vfio-pci -> ioatdma 00:28:11.267 0000:80:04.3 (8086 0e23): vfio-pci -> ioatdma 00:28:11.525 0000:80:04.2 (8086 0e22): vfio-pci -> ioatdma 00:28:11.525 0000:80:04.1 (8086 0e21): vfio-pci -> ioatdma 00:28:11.525 0000:80:04.0 (8086 0e20): vfio-pci -> ioatdma 00:28:11.525 23:06:02 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:28:11.525 23:06:02 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:28:11.525 23:06:02 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:28:11.525 23:06:02 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:28:11.525 23:06:02 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:28:11.525 23:06:02 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 13> /dev/null' 00:28:11.525 23:06:02 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:28:14.066 23:06:04 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:28:14.066 00:28:14.066 real 1m7.385s 00:28:14.066 user 6m34.849s 00:28:14.066 sys 0m16.388s 00:28:14.066 23:06:04 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:28:14.066 23:06:04 -- common/autotest_common.sh@10 -- # set +x 00:28:14.066 ************************************ 00:28:14.066 END TEST nvmf_dif 00:28:14.066 ************************************ 00:28:14.067 23:06:04 -- spdk/autotest.sh@301 -- # run_test nvmf_abort_qd_sizes /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/abort_qd_sizes.sh 00:28:14.067 23:06:04 -- common/autotest_common.sh@1077 -- # '[' 2 -le 1 ']' 00:28:14.067 23:06:04 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:28:14.067 23:06:04 -- common/autotest_common.sh@10 -- # set +x 00:28:14.067 ************************************ 00:28:14.067 START TEST nvmf_abort_qd_sizes 00:28:14.067 ************************************ 00:28:14.067 23:06:04 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/abort_qd_sizes.sh 00:28:14.067 * Looking for test storage... 00:28:14.067 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:28:14.067 23:06:04 -- target/abort_qd_sizes.sh@14 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:28:14.067 23:06:04 -- nvmf/common.sh@7 -- # uname -s 00:28:14.067 23:06:04 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:28:14.067 23:06:04 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:28:14.067 23:06:04 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:28:14.067 23:06:04 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:28:14.067 23:06:04 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:28:14.067 23:06:04 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:28:14.067 23:06:04 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:28:14.067 23:06:04 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:28:14.067 23:06:04 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:28:14.067 23:06:04 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:28:14.067 23:06:04 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:28:14.067 23:06:04 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:28:14.067 23:06:04 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:28:14.067 23:06:04 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:28:14.067 23:06:04 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:28:14.067 23:06:04 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:28:14.067 23:06:04 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:28:14.067 23:06:04 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:28:14.067 23:06:04 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:28:14.067 23:06:04 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:28:14.067 23:06:04 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:28:14.067 23:06:04 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:28:14.067 23:06:04 -- paths/export.sh@5 -- # export PATH 00:28:14.067 23:06:04 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:28:14.067 23:06:04 -- nvmf/common.sh@46 -- # : 0 00:28:14.067 23:06:04 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:28:14.067 23:06:04 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:28:14.067 23:06:04 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:28:14.067 23:06:04 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:28:14.067 23:06:04 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:28:14.067 23:06:04 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:28:14.067 23:06:04 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:28:14.067 23:06:04 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:28:14.067 23:06:04 -- target/abort_qd_sizes.sh@73 -- # nvmftestinit 00:28:14.067 23:06:04 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:28:14.067 23:06:04 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:28:14.067 23:06:04 -- nvmf/common.sh@436 -- # prepare_net_devs 00:28:14.067 23:06:04 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:28:14.067 23:06:04 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:28:14.067 23:06:04 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:28:14.067 23:06:04 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 13> /dev/null' 00:28:14.067 23:06:04 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:28:14.067 23:06:04 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:28:14.067 23:06:04 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:28:14.067 23:06:04 -- nvmf/common.sh@284 -- # xtrace_disable 00:28:14.067 23:06:04 -- common/autotest_common.sh@10 -- # set +x 00:28:15.973 23:06:06 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:28:15.973 23:06:06 -- nvmf/common.sh@290 -- # pci_devs=() 00:28:15.973 23:06:06 -- nvmf/common.sh@290 -- # local -a pci_devs 00:28:15.973 23:06:06 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:28:15.973 23:06:06 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:28:15.973 23:06:06 -- nvmf/common.sh@292 -- # pci_drivers=() 00:28:15.973 23:06:06 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:28:15.973 23:06:06 -- nvmf/common.sh@294 -- # net_devs=() 00:28:15.973 23:06:06 -- nvmf/common.sh@294 -- # local -ga net_devs 00:28:15.973 23:06:06 -- nvmf/common.sh@295 -- # e810=() 00:28:15.973 23:06:06 -- nvmf/common.sh@295 -- # local -ga e810 00:28:15.973 23:06:06 -- nvmf/common.sh@296 -- # x722=() 00:28:15.973 23:06:06 -- nvmf/common.sh@296 -- # local -ga x722 00:28:15.973 23:06:06 -- nvmf/common.sh@297 -- # mlx=() 00:28:15.973 23:06:06 -- nvmf/common.sh@297 -- # local -ga mlx 00:28:15.973 23:06:06 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:28:15.973 23:06:06 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:28:15.973 23:06:06 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:28:15.973 23:06:06 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:28:15.973 23:06:06 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:28:15.973 23:06:06 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:28:15.973 23:06:06 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:28:15.973 23:06:06 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:28:15.973 23:06:06 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:28:15.973 23:06:06 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:28:15.973 23:06:06 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:28:15.973 23:06:06 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:28:15.973 23:06:06 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:28:15.973 23:06:06 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:28:15.973 23:06:06 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:28:15.973 23:06:06 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:28:15.973 23:06:06 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:28:15.973 23:06:06 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:28:15.973 23:06:06 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:28:15.973 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:28:15.973 23:06:06 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:28:15.973 23:06:06 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:28:15.973 23:06:06 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:28:15.973 23:06:06 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:28:15.973 23:06:06 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:28:15.973 23:06:06 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:28:15.973 23:06:06 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:28:15.973 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:28:15.973 23:06:06 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:28:15.973 23:06:06 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:28:15.973 23:06:06 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:28:15.974 23:06:06 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:28:15.974 23:06:06 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:28:15.974 23:06:06 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:28:15.974 23:06:06 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:28:15.974 23:06:06 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:28:15.974 23:06:06 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:28:15.974 23:06:06 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:28:15.974 23:06:06 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:28:15.974 23:06:06 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:28:15.974 23:06:06 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:28:15.974 Found net devices under 0000:0a:00.0: cvl_0_0 00:28:15.974 23:06:06 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:28:15.974 23:06:06 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:28:15.974 23:06:06 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:28:15.974 23:06:06 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:28:15.974 23:06:06 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:28:15.974 23:06:06 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:28:15.974 Found net devices under 0000:0a:00.1: cvl_0_1 00:28:15.974 23:06:06 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:28:15.974 23:06:06 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:28:15.974 23:06:06 -- nvmf/common.sh@402 -- # is_hw=yes 00:28:15.974 23:06:06 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:28:15.974 23:06:06 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:28:15.974 23:06:06 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:28:15.974 23:06:06 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:28:15.974 23:06:06 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:28:15.974 23:06:06 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:28:15.974 23:06:06 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:28:15.974 23:06:06 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:28:15.974 23:06:06 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:28:15.974 23:06:06 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:28:15.974 23:06:06 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:28:15.974 23:06:06 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:28:15.974 23:06:06 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:28:15.974 23:06:06 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:28:15.974 23:06:06 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:28:15.974 23:06:06 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:28:15.974 23:06:06 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:28:15.974 23:06:06 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:28:15.974 23:06:06 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:28:15.974 23:06:06 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:28:15.974 23:06:06 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:28:15.974 23:06:06 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:28:15.974 23:06:06 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:28:15.974 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:28:15.974 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.138 ms 00:28:15.974 00:28:15.974 --- 10.0.0.2 ping statistics --- 00:28:15.974 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:28:15.974 rtt min/avg/max/mdev = 0.138/0.138/0.138/0.000 ms 00:28:15.974 23:06:06 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:28:15.974 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:28:15.974 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.197 ms 00:28:15.974 00:28:15.974 --- 10.0.0.1 ping statistics --- 00:28:15.974 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:28:15.974 rtt min/avg/max/mdev = 0.197/0.197/0.197/0.000 ms 00:28:15.974 23:06:06 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:28:15.974 23:06:06 -- nvmf/common.sh@410 -- # return 0 00:28:15.974 23:06:06 -- nvmf/common.sh@438 -- # '[' iso == iso ']' 00:28:15.974 23:06:06 -- nvmf/common.sh@439 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh 00:28:16.910 0000:00:04.7 (8086 0e27): ioatdma -> vfio-pci 00:28:16.910 0000:00:04.6 (8086 0e26): ioatdma -> vfio-pci 00:28:16.910 0000:00:04.5 (8086 0e25): ioatdma -> vfio-pci 00:28:16.910 0000:00:04.4 (8086 0e24): ioatdma -> vfio-pci 00:28:16.910 0000:00:04.3 (8086 0e23): ioatdma -> vfio-pci 00:28:16.910 0000:00:04.2 (8086 0e22): ioatdma -> vfio-pci 00:28:16.910 0000:00:04.1 (8086 0e21): ioatdma -> vfio-pci 00:28:16.910 0000:00:04.0 (8086 0e20): ioatdma -> vfio-pci 00:28:16.910 0000:80:04.7 (8086 0e27): ioatdma -> vfio-pci 00:28:16.910 0000:80:04.6 (8086 0e26): ioatdma -> vfio-pci 00:28:16.910 0000:80:04.5 (8086 0e25): ioatdma -> vfio-pci 00:28:16.910 0000:80:04.4 (8086 0e24): ioatdma -> vfio-pci 00:28:16.910 0000:80:04.3 (8086 0e23): ioatdma -> vfio-pci 00:28:16.910 0000:80:04.2 (8086 0e22): ioatdma -> vfio-pci 00:28:16.910 0000:80:04.1 (8086 0e21): ioatdma -> vfio-pci 00:28:16.910 0000:80:04.0 (8086 0e20): ioatdma -> vfio-pci 00:28:17.846 0000:88:00.0 (8086 0a54): nvme -> vfio-pci 00:28:18.107 23:06:09 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:28:18.107 23:06:09 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:28:18.107 23:06:09 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:28:18.107 23:06:09 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:28:18.107 23:06:09 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:28:18.107 23:06:09 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:28:18.107 23:06:09 -- target/abort_qd_sizes.sh@74 -- # nvmfappstart -m 0xf 00:28:18.107 23:06:09 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:28:18.107 23:06:09 -- common/autotest_common.sh@712 -- # xtrace_disable 00:28:18.107 23:06:09 -- common/autotest_common.sh@10 -- # set +x 00:28:18.107 23:06:09 -- nvmf/common.sh@469 -- # nvmfpid=413436 00:28:18.107 23:06:09 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xf 00:28:18.107 23:06:09 -- nvmf/common.sh@470 -- # waitforlisten 413436 00:28:18.107 23:06:09 -- common/autotest_common.sh@819 -- # '[' -z 413436 ']' 00:28:18.107 23:06:09 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk.sock 00:28:18.107 23:06:09 -- common/autotest_common.sh@824 -- # local max_retries=100 00:28:18.107 23:06:09 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:28:18.107 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:28:18.107 23:06:09 -- common/autotest_common.sh@828 -- # xtrace_disable 00:28:18.107 23:06:09 -- common/autotest_common.sh@10 -- # set +x 00:28:18.107 [2024-04-16 23:06:09.174000] Starting SPDK v24.01.1-pre git sha1 4b134b4ab / DPDK 23.11.0 initialization... 00:28:18.107 [2024-04-16 23:06:09.174064] [ DPDK EAL parameters: nvmf -c 0xf --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:28:18.107 EAL: No free 2048 kB hugepages reported on node 1 00:28:18.365 [2024-04-16 23:06:09.242138] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:28:18.365 [2024-04-16 23:06:09.353552] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:28:18.365 [2024-04-16 23:06:09.353704] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:28:18.365 [2024-04-16 23:06:09.353721] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:28:18.365 [2024-04-16 23:06:09.353734] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:28:18.365 [2024-04-16 23:06:09.353798] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:28:18.365 [2024-04-16 23:06:09.353856] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:28:18.365 [2024-04-16 23:06:09.353907] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:28:18.365 [2024-04-16 23:06:09.353910] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:28:19.303 23:06:10 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:28:19.303 23:06:10 -- common/autotest_common.sh@852 -- # return 0 00:28:19.303 23:06:10 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:28:19.303 23:06:10 -- common/autotest_common.sh@718 -- # xtrace_disable 00:28:19.303 23:06:10 -- common/autotest_common.sh@10 -- # set +x 00:28:19.303 23:06:10 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:28:19.303 23:06:10 -- target/abort_qd_sizes.sh@76 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini || :; clean_kernel_target' SIGINT SIGTERM EXIT 00:28:19.303 23:06:10 -- target/abort_qd_sizes.sh@78 -- # mapfile -t nvmes 00:28:19.303 23:06:10 -- target/abort_qd_sizes.sh@78 -- # nvme_in_userspace 00:28:19.303 23:06:10 -- scripts/common.sh@311 -- # local bdf bdfs 00:28:19.303 23:06:10 -- scripts/common.sh@312 -- # local nvmes 00:28:19.303 23:06:10 -- scripts/common.sh@314 -- # [[ -n 0000:88:00.0 ]] 00:28:19.303 23:06:10 -- scripts/common.sh@315 -- # nvmes=(${pci_bus_cache["0x010802"]}) 00:28:19.303 23:06:10 -- scripts/common.sh@320 -- # for bdf in "${nvmes[@]}" 00:28:19.303 23:06:10 -- scripts/common.sh@321 -- # [[ -e /sys/bus/pci/drivers/nvme/0000:88:00.0 ]] 00:28:19.303 23:06:10 -- scripts/common.sh@322 -- # uname -s 00:28:19.303 23:06:10 -- scripts/common.sh@322 -- # [[ Linux == FreeBSD ]] 00:28:19.303 23:06:10 -- scripts/common.sh@325 -- # bdfs+=("$bdf") 00:28:19.303 23:06:10 -- scripts/common.sh@327 -- # (( 1 )) 00:28:19.303 23:06:10 -- scripts/common.sh@328 -- # printf '%s\n' 0000:88:00.0 00:28:19.303 23:06:10 -- target/abort_qd_sizes.sh@79 -- # (( 1 > 0 )) 00:28:19.303 23:06:10 -- target/abort_qd_sizes.sh@81 -- # nvme=0000:88:00.0 00:28:19.303 23:06:10 -- target/abort_qd_sizes.sh@83 -- # run_test spdk_target_abort spdk_target 00:28:19.303 23:06:10 -- common/autotest_common.sh@1077 -- # '[' 2 -le 1 ']' 00:28:19.303 23:06:10 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:28:19.303 23:06:10 -- common/autotest_common.sh@10 -- # set +x 00:28:19.303 ************************************ 00:28:19.303 START TEST spdk_target_abort 00:28:19.303 ************************************ 00:28:19.303 23:06:10 -- common/autotest_common.sh@1104 -- # spdk_target 00:28:19.303 23:06:10 -- target/abort_qd_sizes.sh@43 -- # local name=spdk_target 00:28:19.303 23:06:10 -- target/abort_qd_sizes.sh@44 -- # local subnqn=nqn.2016-06.io.spdk:spdk_target 00:28:19.303 23:06:10 -- target/abort_qd_sizes.sh@46 -- # rpc_cmd bdev_nvme_attach_controller -t pcie -a 0000:88:00.0 -b spdk_target 00:28:19.303 23:06:10 -- common/autotest_common.sh@551 -- # xtrace_disable 00:28:19.303 23:06:10 -- common/autotest_common.sh@10 -- # set +x 00:28:22.622 spdk_targetn1 00:28:22.622 23:06:13 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:28:22.622 23:06:13 -- target/abort_qd_sizes.sh@48 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:28:22.622 23:06:13 -- common/autotest_common.sh@551 -- # xtrace_disable 00:28:22.622 23:06:13 -- common/autotest_common.sh@10 -- # set +x 00:28:22.623 [2024-04-16 23:06:13.013217] tcp.c: 659:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:28:22.623 23:06:13 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:28:22.623 23:06:13 -- target/abort_qd_sizes.sh@49 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:spdk_target -a -s SPDKISFASTANDAWESOME 00:28:22.623 23:06:13 -- common/autotest_common.sh@551 -- # xtrace_disable 00:28:22.623 23:06:13 -- common/autotest_common.sh@10 -- # set +x 00:28:22.623 23:06:13 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:28:22.623 23:06:13 -- target/abort_qd_sizes.sh@50 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:spdk_target spdk_targetn1 00:28:22.623 23:06:13 -- common/autotest_common.sh@551 -- # xtrace_disable 00:28:22.623 23:06:13 -- common/autotest_common.sh@10 -- # set +x 00:28:22.623 23:06:13 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:28:22.623 23:06:13 -- target/abort_qd_sizes.sh@51 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:spdk_target -t tcp -a 10.0.0.2 -s 4420 00:28:22.623 23:06:13 -- common/autotest_common.sh@551 -- # xtrace_disable 00:28:22.623 23:06:13 -- common/autotest_common.sh@10 -- # set +x 00:28:22.623 [2024-04-16 23:06:13.045501] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:28:22.623 23:06:13 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:28:22.623 23:06:13 -- target/abort_qd_sizes.sh@53 -- # rabort tcp IPv4 10.0.0.2 4420 nqn.2016-06.io.spdk:spdk_target 00:28:22.623 23:06:13 -- target/abort_qd_sizes.sh@17 -- # local trtype=tcp 00:28:22.623 23:06:13 -- target/abort_qd_sizes.sh@18 -- # local adrfam=IPv4 00:28:22.623 23:06:13 -- target/abort_qd_sizes.sh@19 -- # local traddr=10.0.0.2 00:28:22.623 23:06:13 -- target/abort_qd_sizes.sh@20 -- # local trsvcid=4420 00:28:22.623 23:06:13 -- target/abort_qd_sizes.sh@21 -- # local subnqn=nqn.2016-06.io.spdk:spdk_target 00:28:22.623 23:06:13 -- target/abort_qd_sizes.sh@23 -- # local qds qd 00:28:22.623 23:06:13 -- target/abort_qd_sizes.sh@24 -- # local target r 00:28:22.623 23:06:13 -- target/abort_qd_sizes.sh@26 -- # qds=(4 24 64) 00:28:22.623 23:06:13 -- target/abort_qd_sizes.sh@28 -- # for r in trtype adrfam traddr trsvcid subnqn 00:28:22.623 23:06:13 -- target/abort_qd_sizes.sh@29 -- # target=trtype:tcp 00:28:22.623 23:06:13 -- target/abort_qd_sizes.sh@28 -- # for r in trtype adrfam traddr trsvcid subnqn 00:28:22.623 23:06:13 -- target/abort_qd_sizes.sh@29 -- # target='trtype:tcp adrfam:IPv4' 00:28:22.623 23:06:13 -- target/abort_qd_sizes.sh@28 -- # for r in trtype adrfam traddr trsvcid subnqn 00:28:22.623 23:06:13 -- target/abort_qd_sizes.sh@29 -- # target='trtype:tcp adrfam:IPv4 traddr:10.0.0.2' 00:28:22.623 23:06:13 -- target/abort_qd_sizes.sh@28 -- # for r in trtype adrfam traddr trsvcid subnqn 00:28:22.623 23:06:13 -- target/abort_qd_sizes.sh@29 -- # target='trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' 00:28:22.623 23:06:13 -- target/abort_qd_sizes.sh@28 -- # for r in trtype adrfam traddr trsvcid subnqn 00:28:22.623 23:06:13 -- target/abort_qd_sizes.sh@29 -- # target='trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:spdk_target' 00:28:22.623 23:06:13 -- target/abort_qd_sizes.sh@32 -- # for qd in "${qds[@]}" 00:28:22.623 23:06:13 -- target/abort_qd_sizes.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/abort -q 4 -w rw -M 50 -o 4096 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:spdk_target' 00:28:22.623 EAL: No free 2048 kB hugepages reported on node 1 00:28:25.160 Initializing NVMe Controllers 00:28:25.160 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:spdk_target 00:28:25.160 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:spdk_target) NSID 1 with lcore 0 00:28:25.160 Initialization complete. Launching workers. 00:28:25.160 NS: TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:spdk_target) NSID 1 I/O completed: 11930, failed: 0 00:28:25.160 CTRLR: TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:spdk_target) abort submitted 1237, failed to submit 10693 00:28:25.160 success 803, unsuccess 434, failed 0 00:28:25.160 23:06:16 -- target/abort_qd_sizes.sh@32 -- # for qd in "${qds[@]}" 00:28:25.160 23:06:16 -- target/abort_qd_sizes.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/abort -q 24 -w rw -M 50 -o 4096 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:spdk_target' 00:28:25.160 EAL: No free 2048 kB hugepages reported on node 1 00:28:29.350 Initializing NVMe Controllers 00:28:29.350 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:spdk_target 00:28:29.350 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:spdk_target) NSID 1 with lcore 0 00:28:29.350 Initialization complete. Launching workers. 00:28:29.350 NS: TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:spdk_target) NSID 1 I/O completed: 8534, failed: 0 00:28:29.350 CTRLR: TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:spdk_target) abort submitted 1213, failed to submit 7321 00:28:29.350 success 368, unsuccess 845, failed 0 00:28:29.350 23:06:19 -- target/abort_qd_sizes.sh@32 -- # for qd in "${qds[@]}" 00:28:29.350 23:06:19 -- target/abort_qd_sizes.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/abort -q 64 -w rw -M 50 -o 4096 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:spdk_target' 00:28:29.350 EAL: No free 2048 kB hugepages reported on node 1 00:28:31.882 Initializing NVMe Controllers 00:28:31.882 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:spdk_target 00:28:31.882 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:spdk_target) NSID 1 with lcore 0 00:28:31.882 Initialization complete. Launching workers. 00:28:31.882 NS: TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:spdk_target) NSID 1 I/O completed: 32258, failed: 0 00:28:31.882 CTRLR: TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:spdk_target) abort submitted 2728, failed to submit 29530 00:28:31.882 success 569, unsuccess 2159, failed 0 00:28:31.882 23:06:22 -- target/abort_qd_sizes.sh@55 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:spdk_target 00:28:31.882 23:06:22 -- common/autotest_common.sh@551 -- # xtrace_disable 00:28:31.882 23:06:22 -- common/autotest_common.sh@10 -- # set +x 00:28:31.882 23:06:22 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:28:31.882 23:06:22 -- target/abort_qd_sizes.sh@56 -- # rpc_cmd bdev_nvme_detach_controller spdk_target 00:28:31.882 23:06:22 -- common/autotest_common.sh@551 -- # xtrace_disable 00:28:31.882 23:06:22 -- common/autotest_common.sh@10 -- # set +x 00:28:33.262 23:06:24 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:28:33.262 23:06:24 -- target/abort_qd_sizes.sh@62 -- # killprocess 413436 00:28:33.262 23:06:24 -- common/autotest_common.sh@926 -- # '[' -z 413436 ']' 00:28:33.262 23:06:24 -- common/autotest_common.sh@930 -- # kill -0 413436 00:28:33.262 23:06:24 -- common/autotest_common.sh@931 -- # uname 00:28:33.262 23:06:24 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:28:33.262 23:06:24 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 413436 00:28:33.262 23:06:24 -- common/autotest_common.sh@932 -- # process_name=reactor_0 00:28:33.262 23:06:24 -- common/autotest_common.sh@936 -- # '[' reactor_0 = sudo ']' 00:28:33.262 23:06:24 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 413436' 00:28:33.262 killing process with pid 413436 00:28:33.262 23:06:24 -- common/autotest_common.sh@945 -- # kill 413436 00:28:33.262 23:06:24 -- common/autotest_common.sh@950 -- # wait 413436 00:28:33.521 00:28:33.521 real 0m14.262s 00:28:33.521 user 0m56.265s 00:28:33.521 sys 0m2.759s 00:28:33.521 23:06:24 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:28:33.521 23:06:24 -- common/autotest_common.sh@10 -- # set +x 00:28:33.521 ************************************ 00:28:33.521 END TEST spdk_target_abort 00:28:33.521 ************************************ 00:28:33.521 23:06:24 -- target/abort_qd_sizes.sh@84 -- # run_test kernel_target_abort kernel_target 00:28:33.521 23:06:24 -- common/autotest_common.sh@1077 -- # '[' 2 -le 1 ']' 00:28:33.521 23:06:24 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:28:33.521 23:06:24 -- common/autotest_common.sh@10 -- # set +x 00:28:33.521 ************************************ 00:28:33.521 START TEST kernel_target_abort 00:28:33.521 ************************************ 00:28:33.521 23:06:24 -- common/autotest_common.sh@1104 -- # kernel_target 00:28:33.521 23:06:24 -- target/abort_qd_sizes.sh@66 -- # local name=kernel_target 00:28:33.521 23:06:24 -- target/abort_qd_sizes.sh@68 -- # configure_kernel_target kernel_target 00:28:33.521 23:06:24 -- nvmf/common.sh@621 -- # kernel_name=kernel_target 00:28:33.521 23:06:24 -- nvmf/common.sh@622 -- # nvmet=/sys/kernel/config/nvmet 00:28:33.521 23:06:24 -- nvmf/common.sh@623 -- # kernel_subsystem=/sys/kernel/config/nvmet/subsystems/kernel_target 00:28:33.521 23:06:24 -- nvmf/common.sh@624 -- # kernel_namespace=/sys/kernel/config/nvmet/subsystems/kernel_target/namespaces/1 00:28:33.521 23:06:24 -- nvmf/common.sh@625 -- # kernel_port=/sys/kernel/config/nvmet/ports/1 00:28:33.521 23:06:24 -- nvmf/common.sh@627 -- # local block nvme 00:28:33.521 23:06:24 -- nvmf/common.sh@629 -- # [[ ! -e /sys/module/nvmet ]] 00:28:33.521 23:06:24 -- nvmf/common.sh@630 -- # modprobe nvmet 00:28:33.521 23:06:24 -- nvmf/common.sh@633 -- # [[ -e /sys/kernel/config/nvmet ]] 00:28:33.521 23:06:24 -- nvmf/common.sh@635 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh reset 00:28:34.898 Waiting for block devices as requested 00:28:34.898 0000:88:00.0 (8086 0a54): vfio-pci -> nvme 00:28:34.898 0000:00:04.7 (8086 0e27): vfio-pci -> ioatdma 00:28:34.898 0000:00:04.6 (8086 0e26): vfio-pci -> ioatdma 00:28:34.898 0000:00:04.5 (8086 0e25): vfio-pci -> ioatdma 00:28:34.898 0000:00:04.4 (8086 0e24): vfio-pci -> ioatdma 00:28:34.898 0000:00:04.3 (8086 0e23): vfio-pci -> ioatdma 00:28:35.156 0000:00:04.2 (8086 0e22): vfio-pci -> ioatdma 00:28:35.156 0000:00:04.1 (8086 0e21): vfio-pci -> ioatdma 00:28:35.156 0000:00:04.0 (8086 0e20): vfio-pci -> ioatdma 00:28:35.156 0000:80:04.7 (8086 0e27): vfio-pci -> ioatdma 00:28:35.413 0000:80:04.6 (8086 0e26): vfio-pci -> ioatdma 00:28:35.413 0000:80:04.5 (8086 0e25): vfio-pci -> ioatdma 00:28:35.413 0000:80:04.4 (8086 0e24): vfio-pci -> ioatdma 00:28:35.413 0000:80:04.3 (8086 0e23): vfio-pci -> ioatdma 00:28:35.413 0000:80:04.2 (8086 0e22): vfio-pci -> ioatdma 00:28:35.672 0000:80:04.1 (8086 0e21): vfio-pci -> ioatdma 00:28:35.672 0000:80:04.0 (8086 0e20): vfio-pci -> ioatdma 00:28:35.672 23:06:26 -- nvmf/common.sh@638 -- # for block in /sys/block/nvme* 00:28:35.672 23:06:26 -- nvmf/common.sh@639 -- # [[ -e /sys/block/nvme0n1 ]] 00:28:35.672 23:06:26 -- nvmf/common.sh@640 -- # block_in_use nvme0n1 00:28:35.672 23:06:26 -- scripts/common.sh@380 -- # local block=nvme0n1 pt 00:28:35.672 23:06:26 -- scripts/common.sh@389 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/spdk-gpt.py nvme0n1 00:28:35.929 No valid GPT data, bailing 00:28:35.929 23:06:26 -- scripts/common.sh@393 -- # blkid -s PTTYPE -o value /dev/nvme0n1 00:28:35.929 23:06:26 -- scripts/common.sh@393 -- # pt= 00:28:35.929 23:06:26 -- scripts/common.sh@394 -- # return 1 00:28:35.929 23:06:26 -- nvmf/common.sh@640 -- # nvme=/dev/nvme0n1 00:28:35.929 23:06:26 -- nvmf/common.sh@643 -- # [[ -b /dev/nvme0n1 ]] 00:28:35.929 23:06:26 -- nvmf/common.sh@645 -- # mkdir /sys/kernel/config/nvmet/subsystems/kernel_target 00:28:35.929 23:06:26 -- nvmf/common.sh@646 -- # mkdir /sys/kernel/config/nvmet/subsystems/kernel_target/namespaces/1 00:28:35.929 23:06:26 -- nvmf/common.sh@647 -- # mkdir /sys/kernel/config/nvmet/ports/1 00:28:35.929 23:06:26 -- nvmf/common.sh@652 -- # echo SPDK-kernel_target 00:28:35.929 23:06:26 -- nvmf/common.sh@654 -- # echo 1 00:28:35.929 23:06:26 -- nvmf/common.sh@655 -- # echo /dev/nvme0n1 00:28:35.929 23:06:26 -- nvmf/common.sh@656 -- # echo 1 00:28:35.929 23:06:26 -- nvmf/common.sh@662 -- # echo 10.0.0.1 00:28:35.929 23:06:26 -- nvmf/common.sh@663 -- # echo tcp 00:28:35.929 23:06:26 -- nvmf/common.sh@664 -- # echo 4420 00:28:35.929 23:06:26 -- nvmf/common.sh@665 -- # echo ipv4 00:28:35.929 23:06:26 -- nvmf/common.sh@668 -- # ln -s /sys/kernel/config/nvmet/subsystems/kernel_target /sys/kernel/config/nvmet/ports/1/subsystems/ 00:28:35.929 23:06:26 -- nvmf/common.sh@671 -- # nvme discover --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -a 10.0.0.1 -t tcp -s 4420 00:28:35.929 00:28:35.929 Discovery Log Number of Records 2, Generation counter 2 00:28:35.929 =====Discovery Log Entry 0====== 00:28:35.929 trtype: tcp 00:28:35.929 adrfam: ipv4 00:28:35.929 subtype: current discovery subsystem 00:28:35.929 treq: not specified, sq flow control disable supported 00:28:35.929 portid: 1 00:28:35.929 trsvcid: 4420 00:28:35.929 subnqn: nqn.2014-08.org.nvmexpress.discovery 00:28:35.929 traddr: 10.0.0.1 00:28:35.929 eflags: none 00:28:35.929 sectype: none 00:28:35.929 =====Discovery Log Entry 1====== 00:28:35.929 trtype: tcp 00:28:35.929 adrfam: ipv4 00:28:35.930 subtype: nvme subsystem 00:28:35.930 treq: not specified, sq flow control disable supported 00:28:35.930 portid: 1 00:28:35.930 trsvcid: 4420 00:28:35.930 subnqn: kernel_target 00:28:35.930 traddr: 10.0.0.1 00:28:35.930 eflags: none 00:28:35.930 sectype: none 00:28:35.930 23:06:26 -- target/abort_qd_sizes.sh@69 -- # rabort tcp IPv4 10.0.0.1 4420 kernel_target 00:28:35.930 23:06:26 -- target/abort_qd_sizes.sh@17 -- # local trtype=tcp 00:28:35.930 23:06:26 -- target/abort_qd_sizes.sh@18 -- # local adrfam=IPv4 00:28:35.930 23:06:26 -- target/abort_qd_sizes.sh@19 -- # local traddr=10.0.0.1 00:28:35.930 23:06:26 -- target/abort_qd_sizes.sh@20 -- # local trsvcid=4420 00:28:35.930 23:06:26 -- target/abort_qd_sizes.sh@21 -- # local subnqn=kernel_target 00:28:35.930 23:06:26 -- target/abort_qd_sizes.sh@23 -- # local qds qd 00:28:35.930 23:06:26 -- target/abort_qd_sizes.sh@24 -- # local target r 00:28:35.930 23:06:26 -- target/abort_qd_sizes.sh@26 -- # qds=(4 24 64) 00:28:35.930 23:06:26 -- target/abort_qd_sizes.sh@28 -- # for r in trtype adrfam traddr trsvcid subnqn 00:28:35.930 23:06:26 -- target/abort_qd_sizes.sh@29 -- # target=trtype:tcp 00:28:35.930 23:06:26 -- target/abort_qd_sizes.sh@28 -- # for r in trtype adrfam traddr trsvcid subnqn 00:28:35.930 23:06:26 -- target/abort_qd_sizes.sh@29 -- # target='trtype:tcp adrfam:IPv4' 00:28:35.930 23:06:26 -- target/abort_qd_sizes.sh@28 -- # for r in trtype adrfam traddr trsvcid subnqn 00:28:35.930 23:06:26 -- target/abort_qd_sizes.sh@29 -- # target='trtype:tcp adrfam:IPv4 traddr:10.0.0.1' 00:28:35.930 23:06:26 -- target/abort_qd_sizes.sh@28 -- # for r in trtype adrfam traddr trsvcid subnqn 00:28:35.930 23:06:26 -- target/abort_qd_sizes.sh@29 -- # target='trtype:tcp adrfam:IPv4 traddr:10.0.0.1 trsvcid:4420' 00:28:35.930 23:06:26 -- target/abort_qd_sizes.sh@28 -- # for r in trtype adrfam traddr trsvcid subnqn 00:28:35.930 23:06:26 -- target/abort_qd_sizes.sh@29 -- # target='trtype:tcp adrfam:IPv4 traddr:10.0.0.1 trsvcid:4420 subnqn:kernel_target' 00:28:35.930 23:06:26 -- target/abort_qd_sizes.sh@32 -- # for qd in "${qds[@]}" 00:28:35.930 23:06:26 -- target/abort_qd_sizes.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/abort -q 4 -w rw -M 50 -o 4096 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.1 trsvcid:4420 subnqn:kernel_target' 00:28:35.930 EAL: No free 2048 kB hugepages reported on node 1 00:28:39.213 Initializing NVMe Controllers 00:28:39.213 Attached to NVMe over Fabrics controller at 10.0.0.1:4420: kernel_target 00:28:39.213 Associating TCP (addr:10.0.0.1 subnqn:kernel_target) NSID 1 with lcore 0 00:28:39.213 Initialization complete. Launching workers. 00:28:39.213 NS: TCP (addr:10.0.0.1 subnqn:kernel_target) NSID 1 I/O completed: 34064, failed: 0 00:28:39.213 CTRLR: TCP (addr:10.0.0.1 subnqn:kernel_target) abort submitted 34064, failed to submit 0 00:28:39.213 success 0, unsuccess 34064, failed 0 00:28:39.213 23:06:29 -- target/abort_qd_sizes.sh@32 -- # for qd in "${qds[@]}" 00:28:39.213 23:06:29 -- target/abort_qd_sizes.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/abort -q 24 -w rw -M 50 -o 4096 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.1 trsvcid:4420 subnqn:kernel_target' 00:28:39.213 EAL: No free 2048 kB hugepages reported on node 1 00:28:42.501 Initializing NVMe Controllers 00:28:42.501 Attached to NVMe over Fabrics controller at 10.0.0.1:4420: kernel_target 00:28:42.501 Associating TCP (addr:10.0.0.1 subnqn:kernel_target) NSID 1 with lcore 0 00:28:42.501 Initialization complete. Launching workers. 00:28:42.501 NS: TCP (addr:10.0.0.1 subnqn:kernel_target) NSID 1 I/O completed: 67355, failed: 0 00:28:42.501 CTRLR: TCP (addr:10.0.0.1 subnqn:kernel_target) abort submitted 16998, failed to submit 50357 00:28:42.501 success 0, unsuccess 16998, failed 0 00:28:42.501 23:06:32 -- target/abort_qd_sizes.sh@32 -- # for qd in "${qds[@]}" 00:28:42.501 23:06:32 -- target/abort_qd_sizes.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/abort -q 64 -w rw -M 50 -o 4096 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.1 trsvcid:4420 subnqn:kernel_target' 00:28:42.501 EAL: No free 2048 kB hugepages reported on node 1 00:28:45.033 Initializing NVMe Controllers 00:28:45.033 Attached to NVMe over Fabrics controller at 10.0.0.1:4420: kernel_target 00:28:45.033 Associating TCP (addr:10.0.0.1 subnqn:kernel_target) NSID 1 with lcore 0 00:28:45.033 Initialization complete. Launching workers. 00:28:45.033 NS: TCP (addr:10.0.0.1 subnqn:kernel_target) NSID 1 I/O completed: 66204, failed: 0 00:28:45.033 CTRLR: TCP (addr:10.0.0.1 subnqn:kernel_target) abort submitted 16530, failed to submit 49674 00:28:45.033 success 0, unsuccess 16530, failed 0 00:28:45.033 23:06:36 -- target/abort_qd_sizes.sh@70 -- # clean_kernel_target 00:28:45.033 23:06:36 -- nvmf/common.sh@675 -- # [[ -e /sys/kernel/config/nvmet/subsystems/kernel_target ]] 00:28:45.033 23:06:36 -- nvmf/common.sh@677 -- # echo 0 00:28:45.033 23:06:36 -- nvmf/common.sh@679 -- # rm -f /sys/kernel/config/nvmet/ports/1/subsystems/kernel_target 00:28:45.033 23:06:36 -- nvmf/common.sh@680 -- # rmdir /sys/kernel/config/nvmet/subsystems/kernel_target/namespaces/1 00:28:45.033 23:06:36 -- nvmf/common.sh@681 -- # rmdir /sys/kernel/config/nvmet/ports/1 00:28:45.033 23:06:36 -- nvmf/common.sh@682 -- # rmdir /sys/kernel/config/nvmet/subsystems/kernel_target 00:28:45.033 23:06:36 -- nvmf/common.sh@684 -- # modules=(/sys/module/nvmet/holders/*) 00:28:45.033 23:06:36 -- nvmf/common.sh@686 -- # modprobe -r nvmet_tcp nvmet 00:28:45.033 00:28:45.033 real 0m11.636s 00:28:45.033 user 0m4.794s 00:28:45.033 sys 0m2.520s 00:28:45.033 23:06:36 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:28:45.033 23:06:36 -- common/autotest_common.sh@10 -- # set +x 00:28:45.033 ************************************ 00:28:45.033 END TEST kernel_target_abort 00:28:45.033 ************************************ 00:28:45.033 23:06:36 -- target/abort_qd_sizes.sh@86 -- # trap - SIGINT SIGTERM EXIT 00:28:45.033 23:06:36 -- target/abort_qd_sizes.sh@87 -- # nvmftestfini 00:28:45.033 23:06:36 -- nvmf/common.sh@476 -- # nvmfcleanup 00:28:45.033 23:06:36 -- nvmf/common.sh@116 -- # sync 00:28:45.033 23:06:36 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:28:45.033 23:06:36 -- nvmf/common.sh@119 -- # set +e 00:28:45.033 23:06:36 -- nvmf/common.sh@120 -- # for i in {1..20} 00:28:45.033 23:06:36 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:28:45.033 rmmod nvme_tcp 00:28:45.033 rmmod nvme_fabrics 00:28:45.033 rmmod nvme_keyring 00:28:45.033 23:06:36 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:28:45.292 23:06:36 -- nvmf/common.sh@123 -- # set -e 00:28:45.292 23:06:36 -- nvmf/common.sh@124 -- # return 0 00:28:45.292 23:06:36 -- nvmf/common.sh@477 -- # '[' -n 413436 ']' 00:28:45.292 23:06:36 -- nvmf/common.sh@478 -- # killprocess 413436 00:28:45.292 23:06:36 -- common/autotest_common.sh@926 -- # '[' -z 413436 ']' 00:28:45.292 23:06:36 -- common/autotest_common.sh@930 -- # kill -0 413436 00:28:45.292 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/autotest_common.sh: line 930: kill: (413436) - No such process 00:28:45.292 23:06:36 -- common/autotest_common.sh@953 -- # echo 'Process with pid 413436 is not found' 00:28:45.292 Process with pid 413436 is not found 00:28:45.292 23:06:36 -- nvmf/common.sh@480 -- # '[' iso == iso ']' 00:28:45.292 23:06:36 -- nvmf/common.sh@481 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh reset 00:28:46.224 0000:88:00.0 (8086 0a54): Already using the nvme driver 00:28:46.224 0000:00:04.7 (8086 0e27): Already using the ioatdma driver 00:28:46.483 0000:00:04.6 (8086 0e26): Already using the ioatdma driver 00:28:46.484 0000:00:04.5 (8086 0e25): Already using the ioatdma driver 00:28:46.484 0000:00:04.4 (8086 0e24): Already using the ioatdma driver 00:28:46.484 0000:00:04.3 (8086 0e23): Already using the ioatdma driver 00:28:46.484 0000:00:04.2 (8086 0e22): Already using the ioatdma driver 00:28:46.484 0000:00:04.1 (8086 0e21): Already using the ioatdma driver 00:28:46.484 0000:00:04.0 (8086 0e20): Already using the ioatdma driver 00:28:46.484 0000:80:04.7 (8086 0e27): Already using the ioatdma driver 00:28:46.484 0000:80:04.6 (8086 0e26): Already using the ioatdma driver 00:28:46.484 0000:80:04.5 (8086 0e25): Already using the ioatdma driver 00:28:46.484 0000:80:04.4 (8086 0e24): Already using the ioatdma driver 00:28:46.484 0000:80:04.3 (8086 0e23): Already using the ioatdma driver 00:28:46.484 0000:80:04.2 (8086 0e22): Already using the ioatdma driver 00:28:46.484 0000:80:04.1 (8086 0e21): Already using the ioatdma driver 00:28:46.484 0000:80:04.0 (8086 0e20): Already using the ioatdma driver 00:28:46.484 23:06:37 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:28:46.484 23:06:37 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:28:46.484 23:06:37 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:28:46.484 23:06:37 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:28:46.484 23:06:37 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:28:46.484 23:06:37 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 13> /dev/null' 00:28:46.484 23:06:37 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:28:49.052 23:06:39 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:28:49.052 00:28:49.052 real 0m34.928s 00:28:49.052 user 1m3.343s 00:28:49.052 sys 0m8.521s 00:28:49.052 23:06:39 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:28:49.052 23:06:39 -- common/autotest_common.sh@10 -- # set +x 00:28:49.052 ************************************ 00:28:49.052 END TEST nvmf_abort_qd_sizes 00:28:49.052 ************************************ 00:28:49.052 23:06:39 -- spdk/autotest.sh@311 -- # '[' 0 -eq 1 ']' 00:28:49.052 23:06:39 -- spdk/autotest.sh@315 -- # '[' 0 -eq 1 ']' 00:28:49.052 23:06:39 -- spdk/autotest.sh@319 -- # '[' 0 -eq 1 ']' 00:28:49.052 23:06:39 -- spdk/autotest.sh@324 -- # '[' 0 -eq 1 ']' 00:28:49.052 23:06:39 -- spdk/autotest.sh@333 -- # '[' 0 -eq 1 ']' 00:28:49.052 23:06:39 -- spdk/autotest.sh@338 -- # '[' 0 -eq 1 ']' 00:28:49.052 23:06:39 -- spdk/autotest.sh@342 -- # '[' 0 -eq 1 ']' 00:28:49.052 23:06:39 -- spdk/autotest.sh@346 -- # '[' 0 -eq 1 ']' 00:28:49.052 23:06:39 -- spdk/autotest.sh@350 -- # '[' 0 -eq 1 ']' 00:28:49.052 23:06:39 -- spdk/autotest.sh@355 -- # '[' 0 -eq 1 ']' 00:28:49.052 23:06:39 -- spdk/autotest.sh@359 -- # '[' 0 -eq 1 ']' 00:28:49.052 23:06:39 -- spdk/autotest.sh@366 -- # [[ 0 -eq 1 ]] 00:28:49.052 23:06:39 -- spdk/autotest.sh@370 -- # [[ 0 -eq 1 ]] 00:28:49.052 23:06:39 -- spdk/autotest.sh@374 -- # [[ 0 -eq 1 ]] 00:28:49.052 23:06:39 -- spdk/autotest.sh@378 -- # [[ 0 -eq 1 ]] 00:28:49.052 23:06:39 -- spdk/autotest.sh@383 -- # trap - SIGINT SIGTERM EXIT 00:28:49.052 23:06:39 -- spdk/autotest.sh@385 -- # timing_enter post_cleanup 00:28:49.052 23:06:39 -- common/autotest_common.sh@712 -- # xtrace_disable 00:28:49.052 23:06:39 -- common/autotest_common.sh@10 -- # set +x 00:28:49.052 23:06:39 -- spdk/autotest.sh@386 -- # autotest_cleanup 00:28:49.052 23:06:39 -- common/autotest_common.sh@1371 -- # local autotest_es=0 00:28:49.052 23:06:39 -- common/autotest_common.sh@1372 -- # xtrace_disable 00:28:49.052 23:06:39 -- common/autotest_common.sh@10 -- # set +x 00:28:50.428 INFO: APP EXITING 00:28:50.428 INFO: killing all VMs 00:28:50.428 INFO: killing vhost app 00:28:50.428 INFO: EXIT DONE 00:28:51.804 0000:88:00.0 (8086 0a54): Already using the nvme driver 00:28:51.804 0000:00:04.7 (8086 0e27): Already using the ioatdma driver 00:28:51.804 0000:00:04.6 (8086 0e26): Already using the ioatdma driver 00:28:51.804 0000:00:04.5 (8086 0e25): Already using the ioatdma driver 00:28:51.804 0000:00:04.4 (8086 0e24): Already using the ioatdma driver 00:28:51.804 0000:00:04.3 (8086 0e23): Already using the ioatdma driver 00:28:51.804 0000:00:04.2 (8086 0e22): Already using the ioatdma driver 00:28:51.804 0000:00:04.1 (8086 0e21): Already using the ioatdma driver 00:28:51.804 0000:00:04.0 (8086 0e20): Already using the ioatdma driver 00:28:51.804 0000:80:04.7 (8086 0e27): Already using the ioatdma driver 00:28:51.804 0000:80:04.6 (8086 0e26): Already using the ioatdma driver 00:28:51.804 0000:80:04.5 (8086 0e25): Already using the ioatdma driver 00:28:51.804 0000:80:04.4 (8086 0e24): Already using the ioatdma driver 00:28:51.804 0000:80:04.3 (8086 0e23): Already using the ioatdma driver 00:28:51.804 0000:80:04.2 (8086 0e22): Already using the ioatdma driver 00:28:51.804 0000:80:04.1 (8086 0e21): Already using the ioatdma driver 00:28:51.804 0000:80:04.0 (8086 0e20): Already using the ioatdma driver 00:28:53.184 Cleaning 00:28:53.184 Removing: /var/run/dpdk/spdk0/config 00:28:53.184 Removing: /var/run/dpdk/spdk0/fbarray_memseg-2048k-0-0 00:28:53.184 Removing: /var/run/dpdk/spdk0/fbarray_memseg-2048k-0-1 00:28:53.184 Removing: /var/run/dpdk/spdk0/fbarray_memseg-2048k-0-2 00:28:53.184 Removing: /var/run/dpdk/spdk0/fbarray_memseg-2048k-0-3 00:28:53.185 Removing: /var/run/dpdk/spdk0/fbarray_memseg-2048k-1-0 00:28:53.185 Removing: /var/run/dpdk/spdk0/fbarray_memseg-2048k-1-1 00:28:53.185 Removing: /var/run/dpdk/spdk0/fbarray_memseg-2048k-1-2 00:28:53.185 Removing: /var/run/dpdk/spdk0/fbarray_memseg-2048k-1-3 00:28:53.185 Removing: /var/run/dpdk/spdk0/fbarray_memzone 00:28:53.185 Removing: /var/run/dpdk/spdk0/hugepage_info 00:28:53.185 Removing: /var/run/dpdk/spdk1/config 00:28:53.185 Removing: /var/run/dpdk/spdk1/fbarray_memseg-2048k-0-0 00:28:53.185 Removing: /var/run/dpdk/spdk1/fbarray_memseg-2048k-0-1 00:28:53.185 Removing: /var/run/dpdk/spdk1/fbarray_memseg-2048k-0-2 00:28:53.185 Removing: /var/run/dpdk/spdk1/fbarray_memseg-2048k-0-3 00:28:53.185 Removing: /var/run/dpdk/spdk1/fbarray_memseg-2048k-1-0 00:28:53.185 Removing: /var/run/dpdk/spdk1/fbarray_memseg-2048k-1-1 00:28:53.185 Removing: /var/run/dpdk/spdk1/fbarray_memseg-2048k-1-2 00:28:53.185 Removing: /var/run/dpdk/spdk1/fbarray_memseg-2048k-1-3 00:28:53.185 Removing: /var/run/dpdk/spdk1/fbarray_memzone 00:28:53.185 Removing: /var/run/dpdk/spdk1/hugepage_info 00:28:53.185 Removing: /var/run/dpdk/spdk1/mp_socket 00:28:53.185 Removing: /var/run/dpdk/spdk2/config 00:28:53.185 Removing: /var/run/dpdk/spdk2/fbarray_memseg-2048k-0-0 00:28:53.185 Removing: /var/run/dpdk/spdk2/fbarray_memseg-2048k-0-1 00:28:53.185 Removing: /var/run/dpdk/spdk2/fbarray_memseg-2048k-0-2 00:28:53.185 Removing: /var/run/dpdk/spdk2/fbarray_memseg-2048k-0-3 00:28:53.185 Removing: /var/run/dpdk/spdk2/fbarray_memseg-2048k-1-0 00:28:53.185 Removing: /var/run/dpdk/spdk2/fbarray_memseg-2048k-1-1 00:28:53.185 Removing: /var/run/dpdk/spdk2/fbarray_memseg-2048k-1-2 00:28:53.185 Removing: /var/run/dpdk/spdk2/fbarray_memseg-2048k-1-3 00:28:53.185 Removing: /var/run/dpdk/spdk2/fbarray_memzone 00:28:53.185 Removing: /var/run/dpdk/spdk2/hugepage_info 00:28:53.185 Removing: /var/run/dpdk/spdk3/config 00:28:53.185 Removing: /var/run/dpdk/spdk3/fbarray_memseg-2048k-0-0 00:28:53.185 Removing: /var/run/dpdk/spdk3/fbarray_memseg-2048k-0-1 00:28:53.185 Removing: /var/run/dpdk/spdk3/fbarray_memseg-2048k-0-2 00:28:53.185 Removing: /var/run/dpdk/spdk3/fbarray_memseg-2048k-0-3 00:28:53.185 Removing: /var/run/dpdk/spdk3/fbarray_memseg-2048k-1-0 00:28:53.185 Removing: /var/run/dpdk/spdk3/fbarray_memseg-2048k-1-1 00:28:53.185 Removing: /var/run/dpdk/spdk3/fbarray_memseg-2048k-1-2 00:28:53.185 Removing: /var/run/dpdk/spdk3/fbarray_memseg-2048k-1-3 00:28:53.185 Removing: /var/run/dpdk/spdk3/fbarray_memzone 00:28:53.185 Removing: /var/run/dpdk/spdk3/hugepage_info 00:28:53.185 Removing: /var/run/dpdk/spdk4/config 00:28:53.185 Removing: /var/run/dpdk/spdk4/fbarray_memseg-2048k-0-0 00:28:53.185 Removing: /var/run/dpdk/spdk4/fbarray_memseg-2048k-0-1 00:28:53.185 Removing: /var/run/dpdk/spdk4/fbarray_memseg-2048k-0-2 00:28:53.185 Removing: /var/run/dpdk/spdk4/fbarray_memseg-2048k-0-3 00:28:53.185 Removing: /var/run/dpdk/spdk4/fbarray_memseg-2048k-1-0 00:28:53.185 Removing: /var/run/dpdk/spdk4/fbarray_memseg-2048k-1-1 00:28:53.185 Removing: /var/run/dpdk/spdk4/fbarray_memseg-2048k-1-2 00:28:53.185 Removing: /var/run/dpdk/spdk4/fbarray_memseg-2048k-1-3 00:28:53.185 Removing: /var/run/dpdk/spdk4/fbarray_memzone 00:28:53.185 Removing: /var/run/dpdk/spdk4/hugepage_info 00:28:53.185 Removing: /dev/shm/bdev_svc_trace.1 00:28:53.185 Removing: /dev/shm/nvmf_trace.0 00:28:53.185 Removing: /dev/shm/spdk_tgt_trace.pid150831 00:28:53.185 Removing: /var/run/dpdk/spdk0 00:28:53.185 Removing: /var/run/dpdk/spdk1 00:28:53.185 Removing: /var/run/dpdk/spdk2 00:28:53.185 Removing: /var/run/dpdk/spdk3 00:28:53.185 Removing: /var/run/dpdk/spdk4 00:28:53.185 Removing: /var/run/dpdk/spdk_pid149135 00:28:53.185 Removing: /var/run/dpdk/spdk_pid149887 00:28:53.185 Removing: /var/run/dpdk/spdk_pid150831 00:28:53.185 Removing: /var/run/dpdk/spdk_pid151315 00:28:53.185 Removing: /var/run/dpdk/spdk_pid152536 00:28:53.185 Removing: /var/run/dpdk/spdk_pid153477 00:28:53.185 Removing: /var/run/dpdk/spdk_pid153795 00:28:53.185 Removing: /var/run/dpdk/spdk_pid154017 00:28:53.185 Removing: /var/run/dpdk/spdk_pid154325 00:28:53.185 Removing: /var/run/dpdk/spdk_pid154648 00:28:53.185 Removing: /var/run/dpdk/spdk_pid154806 00:28:53.185 Removing: /var/run/dpdk/spdk_pid154968 00:28:53.185 Removing: /var/run/dpdk/spdk_pid155147 00:28:53.185 Removing: /var/run/dpdk/spdk_pid155738 00:28:53.185 Removing: /var/run/dpdk/spdk_pid158772 00:28:53.185 Removing: /var/run/dpdk/spdk_pid159069 00:28:53.185 Removing: /var/run/dpdk/spdk_pid159246 00:28:53.185 Removing: /var/run/dpdk/spdk_pid159386 00:28:53.185 Removing: /var/run/dpdk/spdk_pid159822 00:28:53.185 Removing: /var/run/dpdk/spdk_pid159962 00:28:53.185 Removing: /var/run/dpdk/spdk_pid160334 00:28:53.185 Removing: /var/run/dpdk/spdk_pid160420 00:28:53.185 Removing: /var/run/dpdk/spdk_pid160709 00:28:53.185 Removing: /var/run/dpdk/spdk_pid160851 00:28:53.185 Removing: /var/run/dpdk/spdk_pid161018 00:28:53.185 Removing: /var/run/dpdk/spdk_pid161161 00:28:53.185 Removing: /var/run/dpdk/spdk_pid161533 00:28:53.185 Removing: /var/run/dpdk/spdk_pid161690 00:28:53.185 Removing: /var/run/dpdk/spdk_pid161882 00:28:53.185 Removing: /var/run/dpdk/spdk_pid162189 00:28:53.185 Removing: /var/run/dpdk/spdk_pid162214 00:28:53.185 Removing: /var/run/dpdk/spdk_pid162396 00:28:53.185 Removing: /var/run/dpdk/spdk_pid162540 00:28:53.185 Removing: /var/run/dpdk/spdk_pid162695 00:28:53.185 Removing: /var/run/dpdk/spdk_pid162960 00:28:53.185 Removing: /var/run/dpdk/spdk_pid163123 00:28:53.185 Removing: /var/run/dpdk/spdk_pid163261 00:28:53.185 Removing: /var/run/dpdk/spdk_pid163542 00:28:53.185 Removing: /var/run/dpdk/spdk_pid163691 00:28:53.185 Removing: /var/run/dpdk/spdk_pid163852 00:28:53.185 Removing: /var/run/dpdk/spdk_pid164080 00:28:53.185 Removing: /var/run/dpdk/spdk_pid164280 00:28:53.185 Removing: /var/run/dpdk/spdk_pid164420 00:28:53.185 Removing: /var/run/dpdk/spdk_pid164620 00:28:53.185 Removing: /var/run/dpdk/spdk_pid164846 00:28:53.185 Removing: /var/run/dpdk/spdk_pid165009 00:28:53.185 Removing: /var/run/dpdk/spdk_pid165147 00:28:53.185 Removing: /var/run/dpdk/spdk_pid165429 00:28:53.185 Removing: /var/run/dpdk/spdk_pid165575 00:28:53.185 Removing: /var/run/dpdk/spdk_pid165737 00:28:53.185 Removing: /var/run/dpdk/spdk_pid165994 00:28:53.185 Removing: /var/run/dpdk/spdk_pid166167 00:28:53.185 Removing: /var/run/dpdk/spdk_pid166306 00:28:53.185 Removing: /var/run/dpdk/spdk_pid166580 00:28:53.185 Removing: /var/run/dpdk/spdk_pid166733 00:28:53.185 Removing: /var/run/dpdk/spdk_pid166889 00:28:53.185 Removing: /var/run/dpdk/spdk_pid167152 00:28:53.185 Removing: /var/run/dpdk/spdk_pid167311 00:28:53.185 Removing: /var/run/dpdk/spdk_pid167461 00:28:53.185 Removing: /var/run/dpdk/spdk_pid167735 00:28:53.185 Removing: /var/run/dpdk/spdk_pid167879 00:28:53.185 Removing: /var/run/dpdk/spdk_pid168044 00:28:53.185 Removing: /var/run/dpdk/spdk_pid168278 00:28:53.185 Removing: /var/run/dpdk/spdk_pid168464 00:28:53.185 Removing: /var/run/dpdk/spdk_pid168620 00:28:53.185 Removing: /var/run/dpdk/spdk_pid168883 00:28:53.185 Removing: /var/run/dpdk/spdk_pid169045 00:28:53.185 Removing: /var/run/dpdk/spdk_pid169207 00:28:53.185 Removing: /var/run/dpdk/spdk_pid169426 00:28:53.185 Removing: /var/run/dpdk/spdk_pid169631 00:28:53.443 Removing: /var/run/dpdk/spdk_pid169777 00:28:53.443 Removing: /var/run/dpdk/spdk_pid170059 00:28:53.443 Removing: /var/run/dpdk/spdk_pid170124 00:28:53.443 Removing: /var/run/dpdk/spdk_pid170327 00:28:53.443 Removing: /var/run/dpdk/spdk_pid172531 00:28:53.443 Removing: /var/run/dpdk/spdk_pid227280 00:28:53.443 Removing: /var/run/dpdk/spdk_pid229936 00:28:53.443 Removing: /var/run/dpdk/spdk_pid236050 00:28:53.443 Removing: /var/run/dpdk/spdk_pid239403 00:28:53.443 Removing: /var/run/dpdk/spdk_pid241813 00:28:53.443 Removing: /var/run/dpdk/spdk_pid242323 00:28:53.443 Removing: /var/run/dpdk/spdk_pid247411 00:28:53.443 Removing: /var/run/dpdk/spdk_pid247696 00:28:53.443 Removing: /var/run/dpdk/spdk_pid250482 00:28:53.443 Removing: /var/run/dpdk/spdk_pid254752 00:28:53.443 Removing: /var/run/dpdk/spdk_pid256929 00:28:53.443 Removing: /var/run/dpdk/spdk_pid263609 00:28:53.443 Removing: /var/run/dpdk/spdk_pid269027 00:28:53.443 Removing: /var/run/dpdk/spdk_pid270255 00:28:53.443 Removing: /var/run/dpdk/spdk_pid270944 00:28:53.443 Removing: /var/run/dpdk/spdk_pid281425 00:28:53.443 Removing: /var/run/dpdk/spdk_pid283673 00:28:53.443 Removing: /var/run/dpdk/spdk_pid286491 00:28:53.443 Removing: /var/run/dpdk/spdk_pid287825 00:28:53.443 Removing: /var/run/dpdk/spdk_pid289700 00:28:53.443 Removing: /var/run/dpdk/spdk_pid289974 00:28:53.443 Removing: /var/run/dpdk/spdk_pid290125 00:28:53.443 Removing: /var/run/dpdk/spdk_pid290288 00:28:53.443 Removing: /var/run/dpdk/spdk_pid290870 00:28:53.443 Removing: /var/run/dpdk/spdk_pid292360 00:28:53.443 Removing: /var/run/dpdk/spdk_pid293256 00:28:53.443 Removing: /var/run/dpdk/spdk_pid293704 00:28:53.443 Removing: /var/run/dpdk/spdk_pid297330 00:28:53.443 Removing: /var/run/dpdk/spdk_pid300787 00:28:53.443 Removing: /var/run/dpdk/spdk_pid304437 00:28:53.443 Removing: /var/run/dpdk/spdk_pid328716 00:28:53.443 Removing: /var/run/dpdk/spdk_pid331394 00:28:53.443 Removing: /var/run/dpdk/spdk_pid335278 00:28:53.443 Removing: /var/run/dpdk/spdk_pid336373 00:28:53.443 Removing: /var/run/dpdk/spdk_pid337499 00:28:53.443 Removing: /var/run/dpdk/spdk_pid340205 00:28:53.443 Removing: /var/run/dpdk/spdk_pid342657 00:28:53.443 Removing: /var/run/dpdk/spdk_pid346984 00:28:53.443 Removing: /var/run/dpdk/spdk_pid347022 00:28:53.443 Removing: /var/run/dpdk/spdk_pid349929 00:28:53.443 Removing: /var/run/dpdk/spdk_pid350130 00:28:53.443 Removing: /var/run/dpdk/spdk_pid350316 00:28:53.443 Removing: /var/run/dpdk/spdk_pid350715 00:28:53.443 Removing: /var/run/dpdk/spdk_pid350720 00:28:53.443 Removing: /var/run/dpdk/spdk_pid352334 00:28:53.443 Removing: /var/run/dpdk/spdk_pid353555 00:28:53.443 Removing: /var/run/dpdk/spdk_pid354788 00:28:53.443 Removing: /var/run/dpdk/spdk_pid356072 00:28:53.443 Removing: /var/run/dpdk/spdk_pid357347 00:28:53.443 Removing: /var/run/dpdk/spdk_pid358566 00:28:53.443 Removing: /var/run/dpdk/spdk_pid362307 00:28:53.443 Removing: /var/run/dpdk/spdk_pid362654 00:28:53.443 Removing: /var/run/dpdk/spdk_pid363701 00:28:53.443 Removing: /var/run/dpdk/spdk_pid364306 00:28:53.443 Removing: /var/run/dpdk/spdk_pid367955 00:28:53.443 Removing: /var/run/dpdk/spdk_pid369998 00:28:53.443 Removing: /var/run/dpdk/spdk_pid373605 00:28:53.443 Removing: /var/run/dpdk/spdk_pid377226 00:28:53.443 Removing: /var/run/dpdk/spdk_pid381368 00:28:53.443 Removing: /var/run/dpdk/spdk_pid381932 00:28:53.443 Removing: /var/run/dpdk/spdk_pid382489 00:28:53.443 Removing: /var/run/dpdk/spdk_pid382905 00:28:53.443 Removing: /var/run/dpdk/spdk_pid383494 00:28:53.443 Removing: /var/run/dpdk/spdk_pid384051 00:28:53.443 Removing: /var/run/dpdk/spdk_pid384605 00:28:53.443 Removing: /var/run/dpdk/spdk_pid385042 00:28:53.443 Removing: /var/run/dpdk/spdk_pid387697 00:28:53.443 Removing: /var/run/dpdk/spdk_pid387935 00:28:53.443 Removing: /var/run/dpdk/spdk_pid391726 00:28:53.443 Removing: /var/run/dpdk/spdk_pid392009 00:28:53.443 Removing: /var/run/dpdk/spdk_pid393656 00:28:53.443 Removing: /var/run/dpdk/spdk_pid398811 00:28:53.443 Removing: /var/run/dpdk/spdk_pid398816 00:28:53.443 Removing: /var/run/dpdk/spdk_pid401760 00:28:53.443 Removing: /var/run/dpdk/spdk_pid403200 00:28:53.443 Removing: /var/run/dpdk/spdk_pid404643 00:28:53.443 Removing: /var/run/dpdk/spdk_pid405528 00:28:53.443 Removing: /var/run/dpdk/spdk_pid406976 00:28:53.443 Removing: /var/run/dpdk/spdk_pid407754 00:28:53.443 Removing: /var/run/dpdk/spdk_pid413894 00:28:53.443 Removing: /var/run/dpdk/spdk_pid414298 00:28:53.443 Removing: /var/run/dpdk/spdk_pid414702 00:28:53.443 Removing: /var/run/dpdk/spdk_pid416175 00:28:53.443 Removing: /var/run/dpdk/spdk_pid416588 00:28:53.443 Removing: /var/run/dpdk/spdk_pid416996 00:28:53.443 Clean 00:28:53.700 killing process with pid 121855 00:29:01.814 killing process with pid 121852 00:29:01.814 killing process with pid 121854 00:29:01.814 killing process with pid 121853 00:29:01.814 23:06:52 -- common/autotest_common.sh@1436 -- # return 0 00:29:01.814 23:06:52 -- spdk/autotest.sh@387 -- # timing_exit post_cleanup 00:29:01.814 23:06:52 -- common/autotest_common.sh@718 -- # xtrace_disable 00:29:01.814 23:06:52 -- common/autotest_common.sh@10 -- # set +x 00:29:01.814 23:06:52 -- spdk/autotest.sh@389 -- # timing_exit autotest 00:29:01.814 23:06:52 -- common/autotest_common.sh@718 -- # xtrace_disable 00:29:01.814 23:06:52 -- common/autotest_common.sh@10 -- # set +x 00:29:01.814 23:06:52 -- spdk/autotest.sh@390 -- # chmod a+r /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/timing.txt 00:29:01.815 23:06:52 -- spdk/autotest.sh@392 -- # [[ -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/udev.log ]] 00:29:01.815 23:06:52 -- spdk/autotest.sh@392 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/udev.log 00:29:01.815 23:06:52 -- spdk/autotest.sh@394 -- # hash lcov 00:29:01.815 23:06:52 -- spdk/autotest.sh@394 -- # [[ CC_TYPE=gcc == *\c\l\a\n\g* ]] 00:29:01.815 23:06:52 -- spdk/autotest.sh@396 -- # hostname 00:29:01.815 23:06:52 -- spdk/autotest.sh@396 -- # lcov --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 --rc genhtml_branch_coverage=1 --rc genhtml_function_coverage=1 --rc genhtml_legend=1 --rc geninfo_all_blocks=1 --no-external -q -c -d /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk -t spdk-gp-11 -o /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/cov_test.info 00:29:01.815 geninfo: WARNING: invalid characters removed from testname! 00:29:33.907 23:07:21 -- spdk/autotest.sh@397 -- # lcov --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 --rc genhtml_branch_coverage=1 --rc genhtml_function_coverage=1 --rc genhtml_legend=1 --rc geninfo_all_blocks=1 --no-external -q -a /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/cov_base.info -a /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/cov_test.info -o /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/cov_total.info 00:29:34.475 23:07:25 -- spdk/autotest.sh@398 -- # lcov --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 --rc genhtml_branch_coverage=1 --rc genhtml_function_coverage=1 --rc genhtml_legend=1 --rc geninfo_all_blocks=1 --no-external -q -r /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/cov_total.info '*/dpdk/*' -o /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/cov_total.info 00:29:37.014 23:07:28 -- spdk/autotest.sh@399 -- # lcov --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 --rc genhtml_branch_coverage=1 --rc genhtml_function_coverage=1 --rc genhtml_legend=1 --rc geninfo_all_blocks=1 --no-external -q -r /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/cov_total.info '/usr/*' -o /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/cov_total.info 00:29:39.553 23:07:30 -- spdk/autotest.sh@400 -- # lcov --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 --rc genhtml_branch_coverage=1 --rc genhtml_function_coverage=1 --rc genhtml_legend=1 --rc geninfo_all_blocks=1 --no-external -q -r /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/cov_total.info '*/examples/vmd/*' -o /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/cov_total.info 00:29:42.871 23:07:33 -- spdk/autotest.sh@401 -- # lcov --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 --rc genhtml_branch_coverage=1 --rc genhtml_function_coverage=1 --rc genhtml_legend=1 --rc geninfo_all_blocks=1 --no-external -q -r /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/cov_total.info '*/app/spdk_lspci/*' -o /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/cov_total.info 00:29:45.410 23:07:35 -- spdk/autotest.sh@402 -- # lcov --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 --rc genhtml_branch_coverage=1 --rc genhtml_function_coverage=1 --rc genhtml_legend=1 --rc geninfo_all_blocks=1 --no-external -q -r /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/cov_total.info '*/app/spdk_top/*' -o /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/cov_total.info 00:29:47.947 23:07:38 -- spdk/autotest.sh@403 -- # rm -f cov_base.info cov_test.info OLD_STDOUT OLD_STDERR 00:29:47.947 23:07:38 -- common/autobuild_common.sh@15 -- $ source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:29:47.947 23:07:38 -- scripts/common.sh@433 -- $ [[ -e /bin/wpdk_common.sh ]] 00:29:47.947 23:07:38 -- scripts/common.sh@441 -- $ [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:29:47.947 23:07:38 -- scripts/common.sh@442 -- $ source /etc/opt/spdk-pkgdep/paths/export.sh 00:29:47.947 23:07:38 -- paths/export.sh@2 -- $ PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/home/sys_sgci/.local/bin:/home/sys_sgci/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:29:47.947 23:07:38 -- paths/export.sh@3 -- $ PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/home/sys_sgci/.local/bin:/home/sys_sgci/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:29:47.947 23:07:38 -- paths/export.sh@4 -- $ PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/home/sys_sgci/.local/bin:/home/sys_sgci/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:29:47.947 23:07:38 -- paths/export.sh@5 -- $ export PATH 00:29:47.947 23:07:38 -- paths/export.sh@6 -- $ echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/home/sys_sgci/.local/bin:/home/sys_sgci/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:29:47.947 23:07:38 -- common/autobuild_common.sh@434 -- $ out=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output 00:29:47.947 23:07:38 -- common/autobuild_common.sh@435 -- $ date +%s 00:29:47.947 23:07:38 -- common/autobuild_common.sh@435 -- $ mktemp -dt spdk_1713301658.XXXXXX 00:29:47.947 23:07:38 -- common/autobuild_common.sh@435 -- $ SPDK_WORKSPACE=/tmp/spdk_1713301658.9s8J7U 00:29:47.947 23:07:38 -- common/autobuild_common.sh@437 -- $ [[ -n '' ]] 00:29:47.947 23:07:38 -- common/autobuild_common.sh@441 -- $ '[' -n '' ']' 00:29:47.947 23:07:38 -- common/autobuild_common.sh@444 -- $ scanbuild_exclude='--exclude /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/dpdk/' 00:29:47.948 23:07:38 -- common/autobuild_common.sh@448 -- $ scanbuild_exclude+=' --exclude /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/xnvme --exclude /tmp' 00:29:47.948 23:07:38 -- common/autobuild_common.sh@450 -- $ scanbuild='scan-build -o /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/scan-build-tmp --exclude /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/dpdk/ --exclude /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/xnvme --exclude /tmp --status-bugs' 00:29:47.948 23:07:38 -- common/autobuild_common.sh@451 -- $ get_config_params 00:29:47.948 23:07:38 -- common/autotest_common.sh@387 -- $ xtrace_disable 00:29:47.948 23:07:38 -- common/autotest_common.sh@10 -- $ set +x 00:29:47.948 23:07:38 -- common/autobuild_common.sh@451 -- $ config_params='--enable-debug --enable-werror --with-rdma --with-idxd --with-fio=/usr/src/fio --with-iscsi-initiator --disable-unit-tests --enable-ubsan --enable-coverage --with-ublk' 00:29:47.948 23:07:38 -- spdk/autopackage.sh@10 -- $ MAKEFLAGS=-j48 00:29:47.948 23:07:38 -- spdk/autopackage.sh@11 -- $ cd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:29:47.948 23:07:38 -- spdk/autopackage.sh@13 -- $ [[ 0 -eq 1 ]] 00:29:47.948 23:07:38 -- spdk/autopackage.sh@18 -- $ [[ 1 -eq 0 ]] 00:29:47.948 23:07:38 -- spdk/autopackage.sh@18 -- $ [[ 0 -eq 0 ]] 00:29:47.948 23:07:38 -- spdk/autopackage.sh@19 -- $ timing_finish 00:29:47.948 23:07:38 -- common/autotest_common.sh@724 -- $ flamegraph=/usr/local/FlameGraph/flamegraph.pl 00:29:47.948 23:07:38 -- common/autotest_common.sh@725 -- $ '[' -x /usr/local/FlameGraph/flamegraph.pl ']' 00:29:47.948 23:07:38 -- common/autotest_common.sh@727 -- $ /usr/local/FlameGraph/flamegraph.pl --title 'Build Timing' --nametype Step: --countname seconds /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/timing.txt 00:29:47.948 23:07:38 -- spdk/autopackage.sh@20 -- $ exit 0 00:29:47.948 + [[ -n 78951 ]] 00:29:47.948 + sudo kill 78951 00:29:47.958 [Pipeline] } 00:29:47.975 [Pipeline] // stage 00:29:47.979 [Pipeline] } 00:29:47.995 [Pipeline] // timeout 00:29:47.999 [Pipeline] } 00:29:48.014 [Pipeline] // catchError 00:29:48.019 [Pipeline] } 00:29:48.034 [Pipeline] // wrap 00:29:48.039 [Pipeline] } 00:29:48.053 [Pipeline] // catchError 00:29:48.061 [Pipeline] stage 00:29:48.063 [Pipeline] { (Epilogue) 00:29:48.076 [Pipeline] catchError 00:29:48.077 [Pipeline] { 00:29:48.090 [Pipeline] echo 00:29:48.091 Cleanup processes 00:29:48.096 [Pipeline] sh 00:29:48.376 + sudo pgrep -af /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:29:48.376 428627 sudo pgrep -af /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:29:48.387 [Pipeline] sh 00:29:48.668 ++ sudo pgrep -af /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:29:48.668 ++ grep -v 'sudo pgrep' 00:29:48.668 ++ awk '{print $1}' 00:29:48.668 + sudo kill -9 00:29:48.668 + true 00:29:48.680 [Pipeline] sh 00:29:48.962 + jbp/jenkins/jjb-config/jobs/scripts/compress_artifacts.sh 00:29:58.941 [Pipeline] sh 00:29:59.226 + jbp/jenkins/jjb-config/jobs/scripts/check_artifacts_size.sh 00:29:59.226 Artifacts sizes are good 00:29:59.242 [Pipeline] archiveArtifacts 00:29:59.250 Archiving artifacts 00:29:59.497 [Pipeline] sh 00:29:59.781 + sudo chown -R sys_sgci /var/jenkins/workspace/nvmf-tcp-phy-autotest 00:29:59.796 [Pipeline] cleanWs 00:29:59.807 [WS-CLEANUP] Deleting project workspace... 00:29:59.807 [WS-CLEANUP] Deferred wipeout is used... 00:29:59.814 [WS-CLEANUP] done 00:29:59.816 [Pipeline] } 00:29:59.836 [Pipeline] // catchError 00:29:59.848 [Pipeline] sh 00:30:00.129 + logger -p user.info -t JENKINS-CI 00:30:00.137 [Pipeline] } 00:30:00.152 [Pipeline] // stage 00:30:00.158 [Pipeline] } 00:30:00.174 [Pipeline] // node 00:30:00.179 [Pipeline] End of Pipeline 00:30:00.221 Finished: SUCCESS